2024-04-26T10:59:51.282 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T10:59:51.282 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_teuthology@teuthology --name teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi --verbose --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-hybrid powercycle/default supported-all-distro/centos_8 tasks/admin_socket_objecter_requests thrashosds-health} --archive /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674154 -- /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674154/orig.config.yaml 2024-04-26T10:59:51.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T10:59:51.406 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674154 branch: reef description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-hybrid powercycle/default supported-all-distro/centos_8 tasks/admin_socket_objecter_requests thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7674154' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: reef ceph: conf: client.0: admin socket: /var/run/ceph/ceph-$name.asok mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluefs allocator: hybrid bluestore allocator: hybrid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: dc093b5e41f728edab6e0330295fdf9156d31664 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: dc093b5e41f728edab6e0330295fdf9156d31664 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 7d2137f0a666c92a9411c1af5c33e4968be54da6 owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 1136 sha1: dc093b5e41f728edab6e0330295fdf9156d31664 sleep_before_teardown: 0 subset: 0/4 suite: powercycle suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 7d2137f0a666c92a9411c1af5c33e4968be54da6 targets: smithi029.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMvFP3/i+qNFhrLrSKYyFE8gWBsL2OZdfWB817Z/dPozxKdB/U71Ej3xUqWCmWhrsZF5w9q3Vey72NtZ1uLsRAk= smithi072.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDat4KCggYe5lLshnvsgT7auYwnu4zEt12LMX+uCe1UDLcslBFGfBZ01+rSfSJjeCqTTVCSzh+pGs6TAqL2EEm4= smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKGx8hqCwJti/sIpDr7U93Y6jpWYdgCYPRx+AleFmPuzO3tBDJLcj6TWOsApRrzO9IDQuc/xdV9grc1t7tT8O6k= smithi122.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAuXcmuGAMQnUwC6xteZpBL+Vl9Y9rLQ8Iic+HDWyfxw6GSyqTDoXqlEd/EGjb1oftigPxQaeLkozsuhfhbyQZY= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - radosbench: clients: - client.0 time: 60 - admin_socket: client.0: objecter_requests: test: http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch} teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_22:32:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T10:59:51.406 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa; will attempt to use it 2024-04-26T10:59:51.407 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa/tasks 2024-04-26T10:59:51.407 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T10:59:51.408 INFO:teuthology.task.internal:Checking packages... 2024-04-26T10:59:51.435 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'dc093b5e41f728edab6e0330295fdf9156d31664' 2024-04-26T10:59:51.436 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T10:59:51.436 INFO:teuthology.packaging:ref: None 2024-04-26T10:59:51.436 INFO:teuthology.packaging:tag: None 2024-04-26T10:59:51.436 INFO:teuthology.packaging:branch: reef 2024-04-26T10:59:51.436 INFO:teuthology.packaging:sha1: dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T10:59:51.436 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2024-04-26T10:59:51.676 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1258.g7d2137f0 2024-04-26T10:59:51.678 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T10:59:51.685 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T10:59:51.685 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T10:59:51.699 INFO:teuthology.task.internal:Saving configuration 2024-04-26T10:59:51.713 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T10:59:51.719 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T10:59:51.745 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674154', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 10:54:20.982097', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMvFP3/i+qNFhrLrSKYyFE8gWBsL2OZdfWB817Z/dPozxKdB/U71Ej3xUqWCmWhrsZF5w9q3Vey72NtZ1uLsRAk='} 2024-04-26T10:59:51.766 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674154', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 10:54:20.983300', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDat4KCggYe5lLshnvsgT7auYwnu4zEt12LMX+uCe1UDLcslBFGfBZ01+rSfSJjeCqTTVCSzh+pGs6TAqL2EEm4='} 2024-04-26T10:59:51.791 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674154', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 10:54:20.980882', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKGx8hqCwJti/sIpDr7U93Y6jpWYdgCYPRx+AleFmPuzO3tBDJLcj6TWOsApRrzO9IDQuc/xdV9grc1t7tT8O6k='} 2024-04-26T10:59:51.814 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi122.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674154', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 10:54:20.979184', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAuXcmuGAMQnUwC6xteZpBL+Vl9Y9rLQ8Iic+HDWyfxw6GSyqTDoXqlEd/EGjb1oftigPxQaeLkozsuhfhbyQZY='} 2024-04-26T10:59:51.814 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T10:59:51.820 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-04-26T10:59:51.820 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['osd.0'] 2024-04-26T10:59:51.820 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['osd.1'] 2024-04-26T10:59:51.820 INFO:teuthology.task.internal:roles: ubuntu@smithi122.front.sepia.ceph.com - ['osd.2'] 2024-04-26T10:59:51.820 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T10:59:51.990 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbb7bb2a0d0>, signals=[15]) 2024-04-26T10:59:51.991 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T10:59:51.997 INFO:teuthology.task.internal:Opening connections... 2024-04-26T10:59:51.998 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi029.front.sepia.ceph.com 2024-04-26T10:59:51.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:59:52.080 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T10:59:52.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:59:52.154 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T10:59:52.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:59:52.228 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi122.front.sepia.ceph.com 2024-04-26T10:59:52.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:59:52.302 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T10:59:52.310 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2024-04-26T10:59:52.335 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2024-04-26T10:59:52.335 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-04-26T10:59:52.397 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2024-04-26T10:59:52.397 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8" 2024-04-26T10:59:52.397 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2024-04-26T10:59:52.397 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2024-04-26T10:59:52.397 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8" 2024-04-26T10:59:52.397 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2024-04-26T10:59:52.397 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-26T10:59:52.397 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2024-04-26T10:59:52.397 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-26T10:59:52.398 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2024-04-26T10:59:52.398 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T10:59:52.398 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-26T10:59:52.398 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T10:59:52.398 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-04-26T10:59:52.423 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2024-04-26T10:59:52.445 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2024-04-26T10:59:52.446 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2024-04-26T10:59:52.507 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2024-04-26T10:59:52.507 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8" 2024-04-26T10:59:52.507 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2024-04-26T10:59:52.507 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2024-04-26T10:59:52.507 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8" 2024-04-26T10:59:52.508 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2024-04-26T10:59:52.508 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-26T10:59:52.508 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2024-04-26T10:59:52.508 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-26T10:59:52.508 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2024-04-26T10:59:52.508 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T10:59:52.508 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-26T10:59:52.508 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T10:59:52.508 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2024-04-26T10:59:52.531 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2024-04-26T10:59:52.553 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2024-04-26T10:59:52.554 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-04-26T10:59:52.615 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2024-04-26T10:59:52.615 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="8" 2024-04-26T10:59:52.615 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2024-04-26T10:59:52.615 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2024-04-26T10:59:52.615 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="8" 2024-04-26T10:59:52.615 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el8" 2024-04-26T10:59:52.616 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-26T10:59:52.616 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-04-26T10:59:52.616 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-26T10:59:52.616 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2024-04-26T10:59:52.616 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T10:59:52.616 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-26T10:59:52.616 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T10:59:52.616 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-04-26T10:59:52.640 DEBUG:teuthology.orchestra.run.smithi122:> uname -m 2024-04-26T10:59:52.664 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2024-04-26T10:59:52.664 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2024-04-26T10:59:52.726 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Stream" 2024-04-26T10:59:52.727 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="8" 2024-04-26T10:59:52.727 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos" 2024-04-26T10:59:52.727 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora" 2024-04-26T10:59:52.727 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="8" 2024-04-26T10:59:52.727 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el8" 2024-04-26T10:59:52.727 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-26T10:59:52.727 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2024-04-26T10:59:52.727 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-26T10:59:52.727 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/" 2024-04-26T10:59:52.727 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T10:59:52.727 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-26T10:59:52.727 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T10:59:52.728 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2024-04-26T10:59:52.748 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T10:59:52.758 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T10:59:52.763 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T10:59:52.764 DEBUG:teuthology.orchestra.run.smithi029:> test '!' -e /home/ubuntu/cephtest 2024-04-26T10:59:52.766 DEBUG:teuthology.orchestra.run.smithi072:> test '!' -e /home/ubuntu/cephtest 2024-04-26T10:59:52.768 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2024-04-26T10:59:52.770 DEBUG:teuthology.orchestra.run.smithi122:> test '!' -e /home/ubuntu/cephtest 2024-04-26T10:59:52.790 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T10:59:52.797 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T10:59:52.797 DEBUG:teuthology.orchestra.run.smithi029:> test -z $(ls -A /var/lib/ceph) 2024-04-26T10:59:52.827 DEBUG:teuthology.orchestra.run.smithi072:> test -z $(ls -A /var/lib/ceph) 2024-04-26T10:59:52.829 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2024-04-26T10:59:52.832 DEBUG:teuthology.orchestra.run.smithi122:> test -z $(ls -A /var/lib/ceph) 2024-04-26T10:59:52.870 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T10:59:52.979 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T10:59:52.995 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-26T10:59:52.995 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-26T10:59:52.996 DEBUG:teuthology.orchestra.run.smithi029:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T10:59:52.997 DEBUG:teuthology.orchestra.run.smithi072:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T10:59:52.998 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T10:59:52.998 DEBUG:teuthology.orchestra.run.smithi122:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T10:59:53.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:59:53.019 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:59:53.019 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2024-04-26T10:59:53.020 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-04-26T10:59:53.020 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:59:53.021 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:59:53.022 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2024-04-26T10:59:53.022 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-04-26T10:59:53.080 INFO:teuthology.orchestra.run.smithi072.stdout:4.18.0-489.el8.x86_64 2024-04-26T10:59:53.080 INFO:teuthology.task.kernel:Running kernel on smithi072: 4.18.0-489.el8.x86_64 2024-04-26T10:59:53.080 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum install -y kernel 2024-04-26T10:59:53.081 INFO:teuthology.orchestra.run.smithi082.stdout:4.18.0-489.el8.x86_64 2024-04-26T10:59:53.081 INFO:teuthology.task.kernel:Running kernel on smithi082: 4.18.0-489.el8.x86_64 2024-04-26T10:59:53.082 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum install -y kernel 2024-04-26T10:59:53.084 INFO:teuthology.orchestra.run.smithi122.stdout:4.18.0-489.el8.x86_64 2024-04-26T10:59:53.084 INFO:teuthology.orchestra.run.smithi029.stdout:4.18.0-489.el8.x86_64 2024-04-26T10:59:53.084 INFO:teuthology.task.kernel:Running kernel on smithi122: 4.18.0-489.el8.x86_64 2024-04-26T10:59:53.084 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum install -y kernel 2024-04-26T10:59:53.085 INFO:teuthology.task.kernel:Running kernel on smithi029: 4.18.0-489.el8.x86_64 2024-04-26T10:59:53.085 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum install -y kernel 2024-04-26T10:59:57.175 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 8 - AppStream 20 MB/s | 28 MB 00:01 2024-04-26T10:59:57.887 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 8 - AppStream 13 MB/s | 28 MB 00:02 2024-04-26T10:59:58.921 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - AppStream 18 MB/s | 28 MB 00:01 2024-04-26T11:00:00.057 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 8 - AppStream 12 MB/s | 28 MB 00:02 2024-04-26T11:00:07.195 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 8 - BaseOS 2.4 MB/s | 10 MB 00:04 2024-04-26T11:00:08.491 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 8 - BaseOS 3.4 MB/s | 10 MB 00:03 2024-04-26T11:00:10.279 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 8 - Extras 12 kB/s | 18 kB 00:01 2024-04-26T11:00:12.226 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 8 - Extras 8.9 kB/s | 18 kB 00:01 2024-04-26T11:00:21.472 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 8 - BaseOS 548 kB/s | 10 MB 00:19 2024-04-26T11:00:23.147 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - BaseOS 552 kB/s | 10 MB 00:19 2024-04-26T11:00:23.347 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 8 - Extras 76 kB/s | 18 kB 00:00 2024-04-26T11:00:24.047 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 7.7 kB 00:00 2024-04-26T11:00:24.307 INFO:teuthology.orchestra.run.smithi082.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2024-04-26T11:00:25.041 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - Extras 65 kB/s | 18 kB 00:00 2024-04-26T11:00:25.284 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - Extras common packages 57 kB/s | 7.7 kB 00:00 2024-04-26T11:00:25.511 INFO:teuthology.orchestra.run.smithi072.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2024-04-26T11:00:26.237 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 8 - Extras common packages 497 B/s | 7.7 kB 00:15 2024-04-26T11:00:26.463 INFO:teuthology.orchestra.run.smithi122.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-04-26T11:00:26.510 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 7.7 MB/s | 16 MB 00:02 2024-04-26T11:00:26.880 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2024-04-26T11:00:27.473 INFO:teuthology.orchestra.run.smithi122.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2024-04-26T11:00:28.243 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 8 - Extras common packages 496 B/s | 7.7 kB 00:15 2024-04-26T11:00:28.512 INFO:teuthology.orchestra.run.smithi029.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2024-04-26T11:00:29.805 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2024-04-26T11:00:30.316 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 432 kB/s | 24 kB 00:00 2024-04-26T11:00:30.698 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 514 kB/s | 24 kB 00:00 2024-04-26T11:00:31.317 INFO:teuthology.orchestra.run.smithi122.stdout:lab-extras 318 kB/s | 24 kB 00:00 2024-04-26T11:00:33.379 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-26T11:00:33.380 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-26T11:00:33.505 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-26T11:00:33.506 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-26T11:00:33.506 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2024-04-26T11:00:33.506 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-26T11:00:33.506 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-04-26T11:00:33.506 INFO:teuthology.orchestra.run.smithi082.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-26T11:00:33.506 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-04-26T11:00:33.506 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-26T11:00:33.506 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-26T11:00:33.506 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:00:33.506 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-04-26T11:00:33.507 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-04-26T11:00:33.507 INFO:teuthology.orchestra.run.smithi082.stdout:Install 3 Packages 2024-04-26T11:00:33.507 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:00:33.507 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 90 M 2024-04-26T11:00:33.507 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 96 M 2024-04-26T11:00:33.507 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-04-26T11:00:33.747 INFO:teuthology.orchestra.run.smithi072.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-26T11:00:33.748 INFO:teuthology.orchestra.run.smithi072.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-26T11:00:33.833 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 413 kB/s | 24 kB 00:00 2024-04-26T11:00:33.933 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-26T11:00:33.934 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-26T11:00:33.934 INFO:teuthology.orchestra.run.smithi072.stdout: Package Architecture Version Repository Size 2024-04-26T11:00:33.934 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-26T11:00:33.934 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-04-26T11:00:33.934 INFO:teuthology.orchestra.run.smithi072.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-26T11:00:33.934 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-04-26T11:00:33.934 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-26T11:00:33.935 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-26T11:00:33.935 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:00:33.935 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-04-26T11:00:33.935 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-04-26T11:00:33.935 INFO:teuthology.orchestra.run.smithi072.stdout:Install 3 Packages 2024-04-26T11:00:33.935 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:00:33.936 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 90 M 2024-04-26T11:00:33.936 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 96 M 2024-04-26T11:00:33.936 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-04-26T11:00:34.396 INFO:teuthology.orchestra.run.smithi122.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-26T11:00:34.396 INFO:teuthology.orchestra.run.smithi122.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-26T11:00:34.515 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-26T11:00:34.516 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-26T11:00:34.516 INFO:teuthology.orchestra.run.smithi122.stdout: Package Architecture Version Repository Size 2024-04-26T11:00:34.516 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-26T11:00:34.516 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-04-26T11:00:34.516 INFO:teuthology.orchestra.run.smithi122.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-26T11:00:34.516 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-04-26T11:00:34.517 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-26T11:00:34.517 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-26T11:00:34.517 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:00:34.517 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-04-26T11:00:34.517 INFO:teuthology.orchestra.run.smithi122.stdout:================================================================================ 2024-04-26T11:00:34.517 INFO:teuthology.orchestra.run.smithi122.stdout:Install 3 Packages 2024-04-26T11:00:34.517 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:00:34.517 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 90 M 2024-04-26T11:00:34.518 INFO:teuthology.orchestra.run.smithi122.stdout:Installed size: 96 M 2024-04-26T11:00:34.518 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-04-26T11:00:35.184 INFO:teuthology.orchestra.run.smithi082.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 6.4 MB/s | 10 MB 00:01 2024-04-26T11:00:35.702 INFO:teuthology.orchestra.run.smithi072.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 6.6 MB/s | 10 MB 00:01 2024-04-26T11:00:36.300 INFO:teuthology.orchestra.run.smithi082.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 13 MB/s | 36 MB 00:02 2024-04-26T11:00:36.508 INFO:teuthology.orchestra.run.smithi122.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 5.7 MB/s | 10 MB 00:01 2024-04-26T11:00:37.084 INFO:teuthology.orchestra.run.smithi082.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 12 MB/s | 44 MB 00:03 2024-04-26T11:00:37.084 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-26T11:00:37.084 INFO:teuthology.orchestra.run.smithi082.stdout:Total 25 MB/s | 90 MB 00:03 2024-04-26T11:00:37.173 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-26T11:00:37.173 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-26T11:00:37.315 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-26T11:00:37.316 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-26T11:00:37.316 INFO:teuthology.orchestra.run.smithi029.stdout: Package Architecture Version Repository Size 2024-04-26T11:00:37.316 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-26T11:00:37.316 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-26T11:00:37.316 INFO:teuthology.orchestra.run.smithi029.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-26T11:00:37.316 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-04-26T11:00:37.316 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-26T11:00:37.316 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-26T11:00:37.316 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:00:37.316 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-26T11:00:37.316 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-04-26T11:00:37.316 INFO:teuthology.orchestra.run.smithi029.stdout:Install 3 Packages 2024-04-26T11:00:37.316 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:00:37.317 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 90 M 2024-04-26T11:00:37.317 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 96 M 2024-04-26T11:00:37.317 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-26T11:00:37.457 INFO:teuthology.orchestra.run.smithi072.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 11 MB/s | 36 MB 00:03 2024-04-26T11:00:37.659 INFO:teuthology.orchestra.run.smithi122.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 12 MB/s | 36 MB 00:02 2024-04-26T11:00:37.772 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-04-26T11:00:38.200 INFO:teuthology.orchestra.run.smithi122.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 13 MB/s | 44 MB 00:03 2024-04-26T11:00:38.201 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-04-26T11:00:38.201 INFO:teuthology.orchestra.run.smithi122.stdout:Total 25 MB/s | 90 MB 00:03 2024-04-26T11:00:38.219 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-04-26T11:00:38.219 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-04-26T11:00:38.264 INFO:teuthology.orchestra.run.smithi072.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 11 MB/s | 44 MB 00:04 2024-04-26T11:00:38.264 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-04-26T11:00:38.264 INFO:teuthology.orchestra.run.smithi072.stdout:Total 21 MB/s | 90 MB 00:04 2024-04-26T11:00:38.603 INFO:teuthology.orchestra.run.smithi029.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 9.4 MB/s | 10 MB 00:01 2024-04-26T11:00:38.887 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-04-26T11:00:38.953 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-04-26T11:00:39.310 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-04-26T11:00:39.310 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-04-26T11:00:39.418 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-04-26T11:00:39.418 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-04-26T11:00:39.486 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-04-26T11:00:39.526 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-04-26T11:00:40.003 INFO:teuthology.orchestra.run.smithi029.stdout:(2/3): kernel-core-4.18.0-552.el8.x86_64.rpm 17 MB/s | 44 MB 00:02 2024-04-26T11:00:40.557 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-04-26T11:00:40.581 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-04-26T11:00:40.649 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-04-26T11:00:40.668 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-04-26T11:00:40.779 INFO:teuthology.orchestra.run.smithi029.stdout:(3/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 11 MB/s | 36 MB 00:03 2024-04-26T11:00:40.779 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-26T11:00:40.779 INFO:teuthology.orchestra.run.smithi029.stdout:Total 26 MB/s | 90 MB 00:03 2024-04-26T11:00:41.496 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-26T11:00:41.991 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-26T11:00:41.992 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-26T11:00:42.330 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-04-26T11:00:42.848 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T11:00:43.288 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-26T11:00:43.315 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-26T11:00:43.338 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-04-26T11:00:43.462 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-04-26T11:00:43.874 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T11:00:44.063 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T11:00:46.384 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T11:00:46.393 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-26T11:00:46.781 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T11:00:47.085 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T11:00:47.447 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T11:00:47.602 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T11:00:47.840 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T11:00:48.338 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T11:00:50.220 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T11:00:50.519 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T11:00:50.990 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T11:00:51.276 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T11:00:51.520 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T11:00:51.539 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T11:00:51.788 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T11:00:52.129 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T11:00:55.212 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T11:00:55.556 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T11:01:12.677 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-26T11:01:12.702 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T11:01:13.185 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T11:01:13.185 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-26T11:01:13.185 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-26T11:01:13.491 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-26T11:01:13.517 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T11:01:13.671 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T11:01:13.672 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:01:13.672 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-04-26T11:01:13.672 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-26T11:01:13.672 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-26T11:01:13.672 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:01:13.672 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-26T11:01:13.824 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T11:01:13.858 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T11:01:13.858 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-26T11:01:13.858 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-26T11:01:14.043 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T11:01:14.044 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T11:01:14.044 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-26T11:01:14.044 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T11:01:14.044 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T11:01:14.044 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-04-26T11:01:14.044 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi082.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T11:01:14.045 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T11:01:14.254 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T11:01:14.255 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T11:01:14.255 DEBUG:teuthology.orchestra.run.smithi082:> sudo rpm -qi grub2-tools 2024-04-26T11:01:14.288 INFO:teuthology.orchestra.run.smithi082.stdout:Name : grub2-tools 2024-04-26T11:01:14.289 INFO:teuthology.orchestra.run.smithi082.stdout:Epoch : 1 2024-04-26T11:01:14.289 INFO:teuthology.orchestra.run.smithi082.stdout:Version : 2.02 2024-04-26T11:01:14.289 INFO:teuthology.orchestra.run.smithi082.stdout:Release : 129.el8 2024-04-26T11:01:14.289 INFO:teuthology.orchestra.run.smithi082.stdout:Architecture: x86_64 2024-04-26T11:01:14.289 INFO:teuthology.orchestra.run.smithi082.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-26T11:01:14.289 INFO:teuthology.orchestra.run.smithi082.stdout:Group : System Environment/Base 2024-04-26T11:01:14.289 INFO:teuthology.orchestra.run.smithi082.stdout:Size : 9265586 2024-04-26T11:01:14.289 INFO:teuthology.orchestra.run.smithi082.stdout:License : GPLv3+ 2024-04-26T11:01:14.289 INFO:teuthology.orchestra.run.smithi082.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-26T11:01:14.289 INFO:teuthology.orchestra.run.smithi082.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-26T11:01:14.289 INFO:teuthology.orchestra.run.smithi082.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-26T11:01:14.289 INFO:teuthology.orchestra.run.smithi082.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-26T11:01:14.289 INFO:teuthology.orchestra.run.smithi082.stdout:Relocations : (not relocatable) 2024-04-26T11:01:14.290 INFO:teuthology.orchestra.run.smithi082.stdout:Packager : CentOS BuildSystem 2024-04-26T11:01:14.290 INFO:teuthology.orchestra.run.smithi082.stdout:Vendor : CentOS 2024-04-26T11:01:14.290 INFO:teuthology.orchestra.run.smithi082.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T11:01:14.290 INFO:teuthology.orchestra.run.smithi082.stdout:Summary : Support tools for GRUB. 2024-04-26T11:01:14.290 INFO:teuthology.orchestra.run.smithi082.stdout:Description : 2024-04-26T11:01:14.290 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:01:14.290 INFO:teuthology.orchestra.run.smithi082.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T11:01:14.290 INFO:teuthology.orchestra.run.smithi082.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T11:01:14.290 INFO:teuthology.orchestra.run.smithi082.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T11:01:14.290 INFO:teuthology.orchestra.run.smithi082.stdout:hardware devices. 2024-04-26T11:01:14.290 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:01:14.290 INFO:teuthology.orchestra.run.smithi082.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T11:01:14.291 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T11:01:14.291 INFO:teuthology.task.kernel:Updating grub on smithi082 to boot 4.18.0-552.el8.x86_64 2024-04-26T11:01:14.291 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T11:01:14.333 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T11:01:14.334 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:01:14.334 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-04-26T11:01:14.334 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-26T11:01:14.334 INFO:teuthology.orchestra.run.smithi122.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-26T11:01:14.334 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:01:14.334 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-26T11:01:14.494 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T11:01:14.709 INFO:teuthology.orchestra.run.smithi122.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T11:01:14.709 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T11:01:14.709 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-26T11:01:14.709 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T11:01:14.709 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T11:01:14.710 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-04-26T11:01:14.710 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi122.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T11:01:14.710 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T11:01:14.921 INFO:teuthology.orchestra.run.smithi122.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T11:01:14.921 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T11:01:14.921 DEBUG:teuthology.orchestra.run.smithi122:> sudo rpm -qi grub2-tools 2024-04-26T11:01:14.954 INFO:teuthology.orchestra.run.smithi122.stdout:Name : grub2-tools 2024-04-26T11:01:14.954 INFO:teuthology.orchestra.run.smithi122.stdout:Epoch : 1 2024-04-26T11:01:14.954 INFO:teuthology.orchestra.run.smithi122.stdout:Version : 2.02 2024-04-26T11:01:14.954 INFO:teuthology.orchestra.run.smithi122.stdout:Release : 129.el8 2024-04-26T11:01:14.954 INFO:teuthology.orchestra.run.smithi122.stdout:Architecture: x86_64 2024-04-26T11:01:14.955 INFO:teuthology.orchestra.run.smithi122.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-26T11:01:14.955 INFO:teuthology.orchestra.run.smithi122.stdout:Group : System Environment/Base 2024-04-26T11:01:14.955 INFO:teuthology.orchestra.run.smithi122.stdout:Size : 9265586 2024-04-26T11:01:14.955 INFO:teuthology.orchestra.run.smithi122.stdout:License : GPLv3+ 2024-04-26T11:01:14.955 INFO:teuthology.orchestra.run.smithi122.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-26T11:01:14.955 INFO:teuthology.orchestra.run.smithi122.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-26T11:01:14.955 INFO:teuthology.orchestra.run.smithi122.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-26T11:01:14.955 INFO:teuthology.orchestra.run.smithi122.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-26T11:01:14.955 INFO:teuthology.orchestra.run.smithi122.stdout:Relocations : (not relocatable) 2024-04-26T11:01:14.955 INFO:teuthology.orchestra.run.smithi122.stdout:Packager : CentOS BuildSystem 2024-04-26T11:01:14.955 INFO:teuthology.orchestra.run.smithi122.stdout:Vendor : CentOS 2024-04-26T11:01:14.955 INFO:teuthology.orchestra.run.smithi122.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T11:01:14.955 INFO:teuthology.orchestra.run.smithi122.stdout:Summary : Support tools for GRUB. 2024-04-26T11:01:14.955 INFO:teuthology.orchestra.run.smithi122.stdout:Description : 2024-04-26T11:01:14.955 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:01:14.956 INFO:teuthology.orchestra.run.smithi122.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T11:01:14.956 INFO:teuthology.orchestra.run.smithi122.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T11:01:14.956 INFO:teuthology.orchestra.run.smithi122.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T11:01:14.956 INFO:teuthology.orchestra.run.smithi122.stdout:hardware devices. 2024-04-26T11:01:14.956 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:01:14.956 INFO:teuthology.orchestra.run.smithi122.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T11:01:14.957 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T11:01:14.957 INFO:teuthology.task.kernel:Updating grub on smithi122 to boot 4.18.0-552.el8.x86_64 2024-04-26T11:01:14.957 DEBUG:teuthology.orchestra.run.smithi122:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T11:01:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-26T11:01:15.773 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2024-04-26T11:01:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T11:01:16.149 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T11:01:16.149 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-26T11:01:16.149 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-26T11:01:16.575 INFO:teuthology.orchestra.run.smithi122.stderr:Generating grub configuration file ... 2024-04-26T11:01:16.683 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T11:01:16.683 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:01:16.683 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-04-26T11:01:16.683 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-26T11:01:16.683 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-26T11:01:16.683 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:01:16.683 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-26T11:01:16.823 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T11:01:17.040 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T11:01:17.040 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T11:01:17.040 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-26T11:01:17.040 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T11:01:17.040 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T11:01:17.040 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-04-26T11:01:17.040 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi072.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T11:01:17.041 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T11:01:17.252 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T11:01:17.252 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T11:01:17.252 DEBUG:teuthology.orchestra.run.smithi072:> sudo rpm -qi grub2-tools 2024-04-26T11:01:17.289 INFO:teuthology.orchestra.run.smithi072.stdout:Name : grub2-tools 2024-04-26T11:01:17.289 INFO:teuthology.orchestra.run.smithi072.stdout:Epoch : 1 2024-04-26T11:01:17.289 INFO:teuthology.orchestra.run.smithi072.stdout:Version : 2.02 2024-04-26T11:01:17.289 INFO:teuthology.orchestra.run.smithi072.stdout:Release : 129.el8 2024-04-26T11:01:17.289 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: x86_64 2024-04-26T11:01:17.289 INFO:teuthology.orchestra.run.smithi072.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-26T11:01:17.290 INFO:teuthology.orchestra.run.smithi072.stdout:Group : System Environment/Base 2024-04-26T11:01:17.290 INFO:teuthology.orchestra.run.smithi072.stdout:Size : 9265586 2024-04-26T11:01:17.290 INFO:teuthology.orchestra.run.smithi072.stdout:License : GPLv3+ 2024-04-26T11:01:17.290 INFO:teuthology.orchestra.run.smithi072.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-26T11:01:17.290 INFO:teuthology.orchestra.run.smithi072.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-26T11:01:17.290 INFO:teuthology.orchestra.run.smithi072.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-26T11:01:17.290 INFO:teuthology.orchestra.run.smithi072.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-26T11:01:17.290 INFO:teuthology.orchestra.run.smithi072.stdout:Relocations : (not relocatable) 2024-04-26T11:01:17.290 INFO:teuthology.orchestra.run.smithi072.stdout:Packager : CentOS BuildSystem 2024-04-26T11:01:17.290 INFO:teuthology.orchestra.run.smithi072.stdout:Vendor : CentOS 2024-04-26T11:01:17.290 INFO:teuthology.orchestra.run.smithi072.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T11:01:17.290 INFO:teuthology.orchestra.run.smithi072.stdout:Summary : Support tools for GRUB. 2024-04-26T11:01:17.290 INFO:teuthology.orchestra.run.smithi072.stdout:Description : 2024-04-26T11:01:17.290 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:01:17.291 INFO:teuthology.orchestra.run.smithi072.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T11:01:17.291 INFO:teuthology.orchestra.run.smithi072.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T11:01:17.291 INFO:teuthology.orchestra.run.smithi072.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T11:01:17.291 INFO:teuthology.orchestra.run.smithi072.stdout:hardware devices. 2024-04-26T11:01:17.291 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:01:17.291 INFO:teuthology.orchestra.run.smithi072.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T11:01:17.292 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T11:01:17.292 INFO:teuthology.task.kernel:Updating grub on smithi072 to boot 4.18.0-552.el8.x86_64 2024-04-26T11:01:17.292 DEBUG:teuthology.orchestra.run.smithi072:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T11:01:17.847 INFO:teuthology.orchestra.run.smithi082.stderr:done 2024-04-26T11:01:17.848 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2024-04-26T11:01:17.870 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.gDIw1ZSrvr 2024-04-26T11:01:17.871 DEBUG:teuthology.orchestra.run.smithi082:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.gDIw1ZSrvr 2024-04-26T11:01:17.944 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.gDIw1ZSrvr 2024-04-26T11:01:18.090 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.gDIw1ZSrvr is 6KB 2024-04-26T11:01:18.137 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.gDIw1ZSrvr 2024-04-26T11:01:18.155 DEBUG:teuthology.orchestra.run.smithi082:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T11:01:18.228 INFO:teuthology.orchestra.run.smithi082.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-26T11:01:18.229 INFO:teuthology.orchestra.run.smithi082.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-26T11:01:18.229 INFO:teuthology.orchestra.run.smithi082.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-26T11:01:18.229 INFO:teuthology.orchestra.run.smithi082.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-26T11:01:18.230 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-26T11:01:18.399 DEBUG:teuthology.orchestra.run.smithi082:> sudo shutdown -r now 2024-04-26T11:01:18.836 INFO:teuthology.orchestra.run.smithi122.stderr:done 2024-04-26T11:01:18.837 DEBUG:teuthology.orchestra.run.smithi122:> mktemp 2024-04-26T11:01:18.874 INFO:teuthology.orchestra.run.smithi122.stdout:/tmp/tmp.C2CjiBrZZO 2024-04-26T11:01:18.875 DEBUG:teuthology.orchestra.run.smithi122:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.C2CjiBrZZO 2024-04-26T11:01:18.948 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0666 /tmp/tmp.C2CjiBrZZO 2024-04-26T11:01:18.981 INFO:teuthology.orchestra.run.smithi072.stderr:Generating grub configuration file ... 2024-04-26T11:01:19.093 DEBUG:teuthology.orchestra.remote:smithi122:/tmp/tmp.C2CjiBrZZO is 6KB 2024-04-26T11:01:19.140 DEBUG:teuthology.orchestra.run.smithi122:> rm -fr /tmp/tmp.C2CjiBrZZO 2024-04-26T11:01:19.158 DEBUG:teuthology.orchestra.run.smithi122:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T11:01:19.223 INFO:teuthology.orchestra.run.smithi122.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-26T11:01:19.223 INFO:teuthology.orchestra.run.smithi122.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-26T11:01:19.223 INFO:teuthology.orchestra.run.smithi122.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-26T11:01:19.223 INFO:teuthology.orchestra.run.smithi122.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-26T11:01:19.224 DEBUG:teuthology.orchestra.run.smithi122:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-26T11:01:19.392 DEBUG:teuthology.orchestra.run.smithi122:> sudo shutdown -r now 2024-04-26T11:01:20.267 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-26T11:01:20.291 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T11:01:20.664 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T11:01:20.664 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-26T11:01:20.664 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-26T11:01:21.166 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T11:01:21.166 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:01:21.166 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-26T11:01:21.166 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-26T11:01:21.166 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-26T11:01:21.166 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:01:21.167 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-26T11:01:21.284 INFO:teuthology.orchestra.run.smithi072.stderr:done 2024-04-26T11:01:21.297 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2024-04-26T11:01:21.331 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T11:01:21.332 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.EQH6lZfPXw 2024-04-26T11:01:21.333 DEBUG:teuthology.orchestra.run.smithi072:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.EQH6lZfPXw 2024-04-26T11:01:21.407 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.EQH6lZfPXw 2024-04-26T11:01:21.550 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.EQH6lZfPXw is 6KB 2024-04-26T11:01:21.581 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T11:01:21.581 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T11:01:21.581 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-26T11:01:21.581 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T11:01:21.581 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T11:01:21.581 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-26T11:01:21.581 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi029.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T11:01:21.582 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T11:01:21.601 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.EQH6lZfPXw 2024-04-26T11:01:21.619 DEBUG:teuthology.orchestra.run.smithi072:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T11:01:21.684 INFO:teuthology.orchestra.run.smithi072.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-26T11:01:21.684 INFO:teuthology.orchestra.run.smithi072.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-26T11:01:21.685 INFO:teuthology.orchestra.run.smithi072.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-26T11:01:21.685 INFO:teuthology.orchestra.run.smithi072.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-26T11:01:21.686 DEBUG:teuthology.orchestra.run.smithi072:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-26T11:01:21.803 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T11:01:21.803 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T11:01:21.803 DEBUG:teuthology.orchestra.run.smithi029:> sudo rpm -qi grub2-tools 2024-04-26T11:01:21.838 INFO:teuthology.orchestra.run.smithi029.stdout:Name : grub2-tools 2024-04-26T11:01:21.838 INFO:teuthology.orchestra.run.smithi029.stdout:Epoch : 1 2024-04-26T11:01:21.838 INFO:teuthology.orchestra.run.smithi029.stdout:Version : 2.02 2024-04-26T11:01:21.838 INFO:teuthology.orchestra.run.smithi029.stdout:Release : 129.el8 2024-04-26T11:01:21.838 INFO:teuthology.orchestra.run.smithi029.stdout:Architecture: x86_64 2024-04-26T11:01:21.838 INFO:teuthology.orchestra.run.smithi029.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-26T11:01:21.838 INFO:teuthology.orchestra.run.smithi029.stdout:Group : System Environment/Base 2024-04-26T11:01:21.838 INFO:teuthology.orchestra.run.smithi029.stdout:Size : 9265586 2024-04-26T11:01:21.838 INFO:teuthology.orchestra.run.smithi029.stdout:License : GPLv3+ 2024-04-26T11:01:21.838 INFO:teuthology.orchestra.run.smithi029.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-26T11:01:21.839 INFO:teuthology.orchestra.run.smithi029.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-26T11:01:21.839 INFO:teuthology.orchestra.run.smithi029.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-26T11:01:21.839 INFO:teuthology.orchestra.run.smithi029.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-26T11:01:21.839 INFO:teuthology.orchestra.run.smithi029.stdout:Relocations : (not relocatable) 2024-04-26T11:01:21.839 INFO:teuthology.orchestra.run.smithi029.stdout:Packager : CentOS BuildSystem 2024-04-26T11:01:21.839 INFO:teuthology.orchestra.run.smithi029.stdout:Vendor : CentOS 2024-04-26T11:01:21.839 INFO:teuthology.orchestra.run.smithi029.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T11:01:21.839 INFO:teuthology.orchestra.run.smithi029.stdout:Summary : Support tools for GRUB. 2024-04-26T11:01:21.839 INFO:teuthology.orchestra.run.smithi029.stdout:Description : 2024-04-26T11:01:21.839 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:01:21.839 INFO:teuthology.orchestra.run.smithi029.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T11:01:21.839 INFO:teuthology.orchestra.run.smithi029.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T11:01:21.839 INFO:teuthology.orchestra.run.smithi029.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T11:01:21.839 INFO:teuthology.orchestra.run.smithi029.stdout:hardware devices. 2024-04-26T11:01:21.839 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:01:21.840 INFO:teuthology.orchestra.run.smithi029.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T11:01:21.840 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T11:01:21.840 INFO:teuthology.task.kernel:Updating grub on smithi029 to boot 4.18.0-552.el8.x86_64 2024-04-26T11:01:21.841 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T11:01:21.855 DEBUG:teuthology.orchestra.run.smithi072:> sudo shutdown -r now 2024-04-26T11:01:23.778 INFO:teuthology.orchestra.run.smithi029.stderr:Generating grub configuration file ... 2024-04-26T11:01:26.039 INFO:teuthology.orchestra.run.smithi029.stderr:done 2024-04-26T11:01:26.040 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-04-26T11:01:26.104 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.NsMgOGQb12 2024-04-26T11:01:26.104 DEBUG:teuthology.orchestra.run.smithi029:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NsMgOGQb12 2024-04-26T11:01:26.137 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.NsMgOGQb12 2024-04-26T11:01:26.296 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.NsMgOGQb12 is 6KB 2024-04-26T11:01:26.344 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.NsMgOGQb12 2024-04-26T11:01:26.362 DEBUG:teuthology.orchestra.run.smithi029:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T11:01:26.437 INFO:teuthology.orchestra.run.smithi029.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-26T11:01:26.437 INFO:teuthology.orchestra.run.smithi029.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-26T11:01:26.437 INFO:teuthology.orchestra.run.smithi029.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-26T11:01:26.437 INFO:teuthology.orchestra.run.smithi029.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-26T11:01:26.438 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-26T11:01:26.615 DEBUG:teuthology.orchestra.run.smithi029:> sudo shutdown -r now 2024-04-26T11:01:48.422 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-04-26T11:01:48.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-26T11:01:48.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:01:49.395 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-04-26T11:01:49.395 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-26T11:01:49.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:01:51.858 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-04-26T11:01:51.858 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-26T11:01:51.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:01:56.622 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-26T11:01:56.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-26T11:01:56.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:02:06.883 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-26T11:02:07.902 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-26T11:02:10.210 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-26T11:02:15.075 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-04-26T11:02:15.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-26T11:02:15.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:02:16.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-26T11:02:16.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:02:18.942 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-04-26T11:02:19.212 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-26T11:02:19.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:02:19.966 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-26T11:02:22.274 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-26T11:02:24.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-26T11:02:24.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:02:31.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-26T11:02:31.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:02:31.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-26T11:02:31.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:02:34.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-26T11:02:34.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:02:50.402 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.122 2024-04-26T11:03:02.838 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-04-26T11:03:03.143 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-26T11:03:03.144 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "4.18.0-552.el8.x86_64"... 2024-04-26T11:03:03.144 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-04-26T11:03:03.161 INFO:teuthology.orchestra.run.smithi082.stdout:4.18.0-552.el8.x86_64 2024-04-26T11:03:03.161 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-26T11:03:03.161 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T11:03:03.161 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T11:03:04.161 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-04-26T11:03:04.162 DEBUG:teuthology.orchestra.run.smithi082:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T11:03:04.246 INFO:teuthology.orchestra.run.smithi082.stdout:ttyS1 2024-04-26T11:03:04.256 DEBUG:teuthology.parallel:result is None 2024-04-26T11:03:05.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-26T11:03:05.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:03:06.216 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-04-26T11:03:06.476 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-04-26T11:03:06.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-26T11:03:06.877 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "4.18.0-552.el8.x86_64"... 2024-04-26T11:03:06.877 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2024-04-26T11:03:06.894 INFO:teuthology.orchestra.run.smithi072.stdout:4.18.0-552.el8.x86_64 2024-04-26T11:03:06.894 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-26T11:03:06.894 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T11:03:06.894 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T11:03:07.091 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-26T11:03:07.092 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "4.18.0-552.el8.x86_64"... 2024-04-26T11:03:07.092 DEBUG:teuthology.orchestra.run.smithi122:> uname -r 2024-04-26T11:03:07.109 INFO:teuthology.orchestra.run.smithi122.stdout:4.18.0-552.el8.x86_64 2024-04-26T11:03:07.109 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-26T11:03:07.109 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T11:03:07.110 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T11:03:07.896 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-04-26T11:03:07.896 DEBUG:teuthology.orchestra.run.smithi072:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T11:03:08.003 INFO:teuthology.orchestra.run.smithi072.stdout:ttyS1 2024-04-26T11:03:08.018 DEBUG:teuthology.parallel:result is None 2024-04-26T11:03:08.110 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-04-26T11:03:08.110 DEBUG:teuthology.orchestra.run.smithi122:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T11:03:08.184 INFO:teuthology.orchestra.run.smithi122.stdout:ttyS1 2024-04-26T11:03:08.204 DEBUG:teuthology.parallel:result is None 2024-04-26T11:03:24.081 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T11:03:36.082 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-26T11:03:36.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:03:36.527 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-04-26T11:03:36.854 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-26T11:03:36.854 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-552.el8.x86_64"... 2024-04-26T11:03:36.854 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-04-26T11:03:36.875 INFO:teuthology.orchestra.run.smithi029.stdout:4.18.0-552.el8.x86_64 2024-04-26T11:03:36.875 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-26T11:03:36.875 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T11:03:36.875 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T11:03:37.876 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-26T11:03:37.876 DEBUG:teuthology.orchestra.run.smithi029:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T11:03:37.964 INFO:teuthology.orchestra.run.smithi029.stdout:ttyS1 2024-04-26T11:03:37.978 DEBUG:teuthology.parallel:result is None 2024-04-26T11:03:37.978 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T11:03:37.985 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T11:03:37.985 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T11:03:37.987 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T11:03:37.991 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T11:03:37.993 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T11:03:38.016 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T11:03:38.023 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T11:03:38.029 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T11:03:38.029 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T11:03:38.057 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T11:03:38.060 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T11:03:38.063 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T11:03:38.113 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T11:03:38.119 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T11:03:38.119 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T11:03:38.123 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T11:03:38.134 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T11:03:38.136 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T11:03:38.158 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:03:38.170 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:03:38.171 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:03:38.177 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:03:38.182 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:03:38.185 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:03:38.188 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:03:38.198 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:03:38.199 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T11:03:38.207 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T11:03:38.207 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T11:03:38.215 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T11:03:38.217 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T11:03:38.226 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T11:03:38.260 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T11:03:38.270 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T11:03:38.270 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T11:03:38.287 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T11:03:38.291 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T11:03:38.297 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T11:03:38.322 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:03:38.393 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:03:38.442 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:03:38.529 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:03:38.574 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:03:38.574 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T11:03:38.642 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:03:38.690 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:03:38.744 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:03:38.831 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:03:38.873 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T11:03:38.873 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T11:03:38.940 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:03:38.988 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:03:39.052 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:03:39.097 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:03:39.142 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T11:03:39.142 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T11:03:39.210 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:03:39.260 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:03:39.314 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:03:39.405 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:03:39.455 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-26T11:03:39.455 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T11:03:39.527 DEBUG:teuthology.orchestra.run.smithi029:> sudo service rsyslog restart 2024-04-26T11:03:39.529 DEBUG:teuthology.orchestra.run.smithi072:> sudo service rsyslog restart 2024-04-26T11:03:39.531 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2024-04-26T11:03:39.534 DEBUG:teuthology.orchestra.run.smithi122:> sudo service rsyslog restart 2024-04-26T11:03:39.594 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T11:03:39.605 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T11:03:39.609 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T11:03:39.621 INFO:teuthology.orchestra.run.smithi122.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T11:03:39.983 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T11:03:39.991 INFO:teuthology.task.internal:Starting timer... 2024-04-26T11:03:39.991 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T11:03:40.008 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T11:03:40.016 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-04-26T11:03:40.017 DEBUG:teuthology.orchestra.run.smithi029:> sudo service auditd rotate 2024-04-26T11:03:40.112 INFO:teuthology.orchestra.run.smithi029.stdout:Rotating logs: 2024-04-26T11:03:40.114 DEBUG:teuthology.orchestra.run.smithi072:> sudo service auditd rotate 2024-04-26T11:03:40.214 INFO:teuthology.orchestra.run.smithi072.stdout:Rotating logs: 2024-04-26T11:03:40.216 DEBUG:teuthology.orchestra.run.smithi082:> sudo service auditd rotate 2024-04-26T11:03:40.284 INFO:teuthology.orchestra.run.smithi082.stdout:Rotating logs: 2024-04-26T11:03:40.285 DEBUG:teuthology.orchestra.run.smithi122:> sudo service auditd rotate 2024-04-26T11:03:40.362 INFO:teuthology.orchestra.run.smithi122.stdout:Rotating logs: 2024-04-26T11:03:40.364 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T11:03:40.364 DEBUG:teuthology.orchestra.run.smithi029:> /usr/sbin/getenforce 2024-04-26T11:03:40.395 INFO:teuthology.orchestra.run.smithi029.stdout:Permissive 2024-04-26T11:03:40.395 DEBUG:teuthology.orchestra.run.smithi072:> /usr/sbin/getenforce 2024-04-26T11:03:40.430 INFO:teuthology.orchestra.run.smithi072.stdout:Permissive 2024-04-26T11:03:40.431 DEBUG:teuthology.orchestra.run.smithi082:> /usr/sbin/getenforce 2024-04-26T11:03:40.483 INFO:teuthology.orchestra.run.smithi082.stdout:Permissive 2024-04-26T11:03:40.484 DEBUG:teuthology.orchestra.run.smithi122:> /usr/sbin/getenforce 2024-04-26T11:03:40.552 INFO:teuthology.orchestra.run.smithi122.stdout:Permissive 2024-04-26T11:03:40.552 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi029.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi072.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi082.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi122.front.sepia.ceph.com': 'permissive'} 2024-04-26T11:03:40.552 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T11:03:40.585 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:03:40.585 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T11:03:40.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:03:40.616 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T11:03:40.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:03:40.646 DEBUG:teuthology.orchestra.run.smithi122:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T11:03:40.675 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:03:40.675 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T11:03:40.675 DEBUG:teuthology.orchestra.run.smithi029:> sudo /usr/sbin/setenforce permissive 2024-04-26T11:03:40.708 DEBUG:teuthology.orchestra.run.smithi072:> sudo /usr/sbin/setenforce permissive 2024-04-26T11:03:40.746 DEBUG:teuthology.orchestra.run.smithi082:> sudo /usr/sbin/setenforce permissive 2024-04-26T11:03:40.781 DEBUG:teuthology.orchestra.run.smithi122:> sudo /usr/sbin/setenforce permissive 2024-04-26T11:03:40.808 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T11:03:40.817 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T11:03:40.835 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T11:03:40.837 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi029.front.sepia.ceph.com,smithi072.front.sepia.ceph.com,smithi082.front.sepia.ceph.com,smithi122.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T11:10:03.852 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi029.front.sepia.ceph.com'), Remote(name='ubuntu@smithi072.front.sepia.ceph.com'), Remote(name='ubuntu@smithi082.front.sepia.ceph.com'), Remote(name='ubuntu@smithi122.front.sepia.ceph.com')] 2024-04-26T11:10:03.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-26T11:10:03.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:10:03.933 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-04-26T11:10:04.006 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-26T11:10:04.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-26T11:10:04.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:10:04.084 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-04-26T11:10:04.155 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-26T11:10:04.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-26T11:10:04.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:10:04.236 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-04-26T11:10:04.305 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-04-26T11:10:04.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-26T11:10:04.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:10:04.381 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-04-26T11:10:04.455 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-04-26T11:10:04.456 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T11:10:04.467 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T11:10:04.468 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T11:10:04.468 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:10:04.471 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T11:10:04.471 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:10:04.473 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T11:10:04.473 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:10:04.476 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T11:10:04.476 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:10:04.504 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T11:10:04.506 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T11:10:04.507 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T11:10:04.518 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T11:10:04.520 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T11:10:04.522 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T11:10:04.530 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T11:10:04.544 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T11:10:04.581 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: ntpd: command not found 2024-04-26T11:10:04.581 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: ntpd: command not found 2024-04-26T11:10:04.588 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: ntpd: command not found 2024-04-26T11:10:04.591 INFO:teuthology.orchestra.run.smithi082.stdout:506 Cannot talk to daemon 2024-04-26T11:10:04.592 INFO:teuthology.orchestra.run.smithi072.stdout:506 Cannot talk to daemon 2024-04-26T11:10:04.599 INFO:teuthology.orchestra.run.smithi029.stdout:506 Cannot talk to daemon 2024-04-26T11:10:04.601 INFO:teuthology.orchestra.run.smithi122.stderr:sudo: ntpd: command not found 2024-04-26T11:10:04.605 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T11:10:04.607 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T11:10:04.612 INFO:teuthology.orchestra.run.smithi122.stdout:506 Cannot talk to daemon 2024-04-26T11:10:04.615 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T11:10:04.619 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T11:10:04.620 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T11:10:04.626 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T11:10:04.630 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T11:10:04.639 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T11:10:04.690 INFO:teuthology.orchestra.run.smithi082.stderr:bash: ntpq: command not found 2024-04-26T11:10:04.693 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T11:10:04.693 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-04-26T11:10:04.693 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:10:04.693 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:10:04.693 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:10:04.693 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:10:04.704 INFO:teuthology.orchestra.run.smithi029.stderr:bash: ntpq: command not found 2024-04-26T11:10:04.705 INFO:teuthology.orchestra.run.smithi072.stderr:bash: ntpq: command not found 2024-04-26T11:10:04.708 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T11:10:04.708 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2024-04-26T11:10:04.708 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:10:04.708 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:10:04.708 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:10:04.708 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:10:04.710 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T11:10:04.710 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2024-04-26T11:10:04.710 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:10:04.710 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:10:04.710 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:10:04.710 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:10:04.712 INFO:teuthology.orchestra.run.smithi122.stderr:bash: ntpq: command not found 2024-04-26T11:10:04.716 INFO:teuthology.orchestra.run.smithi122.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T11:10:04.716 INFO:teuthology.orchestra.run.smithi122.stdout:=============================================================================== 2024-04-26T11:10:04.716 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:10:04.716 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:10:04.716 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:10:04.716 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:10:04.717 INFO:teuthology.run_tasks:Running task install... 2024-04-26T11:10:04.725 DEBUG:teuthology.task.install:project ceph 2024-04-26T11:10:04.725 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}} 2024-04-26T11:10:04.726 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'} 2024-04-26T11:10:04.726 INFO:teuthology.task.install:Using flavor: default 2024-04-26T11:10:04.731 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T11:10:04.731 INFO:teuthology.task.install:extra packages: [] 2024-04-26T11:10:04.732 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T11:10:04.732 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:10:04.734 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T11:10:04.734 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:10:04.735 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T11:10:04.735 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:10:04.736 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T11:10:04.737 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:10:04.960 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/ 2024-04-26T11:10:04.960 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T11:10:04.964 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/ 2024-04-26T11:10:04.964 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T11:10:04.967 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/ 2024-04-26T11:10:04.967 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T11:10:04.985 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/ 2024-04-26T11:10:04.985 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T11:10:05.079 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T11:10:05.079 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-26T11:10:05.079 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T11:10:05.081 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T11:10:05.081 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T11:10:05.081 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T11:10:05.110 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T11:10:05.110 DEBUG:teuthology.orchestra.run.smithi082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T11:10:05.111 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T11:10:05.111 DEBUG:teuthology.orchestra.run.smithi122:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T11:10:05.147 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T11:10:05.147 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:10:05.147 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T11:10:05.170 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T11:10:05.171 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T11:10:05.171 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T11:10:05.178 DEBUG:teuthology.orchestra.run.smithi082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T11:10:05.180 DEBUG:teuthology.orchestra.run.smithi122:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T11:10:05.182 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T11:10:05.183 DEBUG:teuthology.orchestra.run.smithi029:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T11:10:05.199 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T11:10:05.200 DEBUG:teuthology.orchestra.run.smithi072:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T11:10:05.255 DEBUG:teuthology.orchestra.run.smithi082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T11:10:05.256 DEBUG:teuthology.orchestra.run.smithi029:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T11:10:05.257 DEBUG:teuthology.orchestra.run.smithi122:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T11:10:05.269 DEBUG:teuthology.orchestra.run.smithi072:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T11:10:05.321 INFO:teuthology.orchestra.run.smithi082.stdout:check_obsoletes = 1 2024-04-26T11:10:05.322 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum clean all 2024-04-26T11:10:05.324 INFO:teuthology.orchestra.run.smithi122.stdout:check_obsoletes = 1 2024-04-26T11:10:05.325 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum clean all 2024-04-26T11:10:05.338 DEBUG:teuthology.orchestra.run.smithi029:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T11:10:05.347 DEBUG:teuthology.orchestra.run.smithi072:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T11:10:05.408 INFO:teuthology.orchestra.run.smithi029.stdout:check_obsoletes = 1 2024-04-26T11:10:05.409 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum clean all 2024-04-26T11:10:05.413 INFO:teuthology.orchestra.run.smithi072.stdout:check_obsoletes = 1 2024-04-26T11:10:05.414 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum clean all 2024-04-26T11:10:05.587 INFO:teuthology.orchestra.run.smithi082.stdout:78 files removed 2024-04-26T11:10:05.592 INFO:teuthology.orchestra.run.smithi122.stdout:78 files removed 2024-04-26T11:10:05.614 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T11:10:05.619 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T11:10:05.679 INFO:teuthology.orchestra.run.smithi072.stdout:78 files removed 2024-04-26T11:10:05.687 INFO:teuthology.orchestra.run.smithi029.stdout:78 files removed 2024-04-26T11:10:05.706 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T11:10:05.716 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T11:10:06.276 INFO:teuthology.orchestra.run.smithi082.stdout:ceph packages for x86_64 310 kB/s | 80 kB 00:00 2024-04-26T11:10:06.385 INFO:teuthology.orchestra.run.smithi122.stdout:ceph packages for x86_64 221 kB/s | 80 kB 00:00 2024-04-26T11:10:06.447 INFO:teuthology.orchestra.run.smithi072.stdout:ceph packages for x86_64 237 kB/s | 80 kB 00:00 2024-04-26T11:10:06.467 INFO:teuthology.orchestra.run.smithi029.stdout:ceph packages for x86_64 249 kB/s | 80 kB 00:00 2024-04-26T11:10:06.602 INFO:teuthology.orchestra.run.smithi082.stdout:ceph noarch packages 40 kB/s | 11 kB 00:00 2024-04-26T11:10:06.753 INFO:teuthology.orchestra.run.smithi122.stdout:ceph noarch packages 35 kB/s | 11 kB 00:00 2024-04-26T11:10:06.765 INFO:teuthology.orchestra.run.smithi072.stdout:ceph noarch packages 41 kB/s | 11 kB 00:00 2024-04-26T11:10:06.844 INFO:teuthology.orchestra.run.smithi029.stdout:ceph noarch packages 34 kB/s | 11 kB 00:00 2024-04-26T11:10:06.853 INFO:teuthology.orchestra.run.smithi082.stdout:ceph source packages 6.7 kB/s | 1.5 kB 00:00 2024-04-26T11:10:07.070 INFO:teuthology.orchestra.run.smithi122.stdout:ceph source packages 5.1 kB/s | 1.5 kB 00:00 2024-04-26T11:10:07.150 INFO:teuthology.orchestra.run.smithi072.stdout:ceph source packages 4.2 kB/s | 1.5 kB 00:00 2024-04-26T11:10:07.161 INFO:teuthology.orchestra.run.smithi029.stdout:ceph source packages 5.2 kB/s | 1.5 kB 00:00 2024-04-26T11:10:08.636 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 8 - AppStream 16 MB/s | 28 MB 00:01 2024-04-26T11:10:09.529 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 8 - AppStream 11 MB/s | 28 MB 00:02 2024-04-26T11:10:11.360 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - AppStream 6.7 MB/s | 28 MB 00:04 2024-04-26T11:10:11.637 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 8 - AppStream 6.3 MB/s | 28 MB 00:04 2024-04-26T11:10:14.695 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 8 - BaseOS 9.4 MB/s | 10 MB 00:01 2024-04-26T11:10:15.504 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 8 - BaseOS 12 MB/s | 10 MB 00:00 2024-04-26T11:10:18.150 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 8 - BaseOS 8.5 MB/s | 10 MB 00:01 2024-04-26T11:10:18.181 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - BaseOS 5.7 MB/s | 10 MB 00:01 2024-04-26T11:10:18.489 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 8 - Extras 13 kB/s | 18 kB 00:01 2024-04-26T11:10:20.173 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - Extras 45 kB/s | 18 kB 00:00 2024-04-26T11:10:20.319 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 8 - Extras 39 kB/s | 18 kB 00:00 2024-04-26T11:10:20.337 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 8 - Extras 4.4 kB/s | 18 kB 00:04 2024-04-26T11:10:20.746 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 8 - Extras common packages 26 kB/s | 7.7 kB 00:00 2024-04-26T11:10:20.950 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - Extras common packages 11 kB/s | 7.7 kB 00:00 2024-04-26T11:10:21.154 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 8 - Extras common packages 11 kB/s | 7.7 kB 00:00 2024-04-26T11:10:21.961 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 8 - PowerTools 4.4 MB/s | 5.0 MB 00:01 2024-04-26T11:10:22.153 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 8 - PowerTools 4.5 MB/s | 5.0 MB 00:01 2024-04-26T11:10:22.414 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 8 - Extras common packages 2.0 kB/s | 7.7 kB 00:03 2024-04-26T11:10:22.916 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 8 - PowerTools 3.0 MB/s | 5.0 MB 00:01 2024-04-26T11:10:23.173 INFO:teuthology.orchestra.run.smithi082.stdout:Copr repo for python3-asyncssh owned by ceph 13 kB/s | 3.5 kB 00:00 2024-04-26T11:10:23.382 INFO:teuthology.orchestra.run.smithi072.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2024-04-26T11:10:24.034 INFO:teuthology.orchestra.run.smithi029.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2024-04-26T11:10:24.285 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:01 2024-04-26T11:10:25.241 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 8 - PowerTools 1.8 MB/s | 5.0 MB 00:02 2024-04-26T11:10:25.806 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 16 MB 00:01 2024-04-26T11:10:26.317 INFO:teuthology.orchestra.run.smithi122.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-04-26T11:10:26.492 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 5.4 MB/s | 16 MB 00:03 2024-04-26T11:10:27.301 INFO:teuthology.orchestra.run.smithi122.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2024-04-26T11:10:28.100 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 405 kB/s | 24 kB 00:00 2024-04-26T11:10:29.830 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 446 kB/s | 24 kB 00:00 2024-04-26T11:10:30.319 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 447 kB/s | 24 kB 00:00 2024-04-26T11:10:31.152 INFO:teuthology.orchestra.run.smithi122.stdout:lab-extras 392 kB/s | 24 kB 00:00 2024-04-26T11:10:31.665 INFO:teuthology.orchestra.run.smithi082.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T11:10:31.665 INFO:teuthology.orchestra.run.smithi082.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T11:10:31.743 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-04-26T11:10:31.756 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================================ 2024-04-26T11:10:31.756 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-04-26T11:10:31.756 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================================ 2024-04-26T11:10:31.756 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-04-26T11:10:31.756 INFO:teuthology.orchestra.run.smithi082.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-04-26T11:10:31.757 INFO:teuthology.orchestra.run.smithi082.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.4 k 2024-04-26T11:10:31.757 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 5.5 M 2024-04-26T11:10:31.757 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 859 k 2024-04-26T11:10:31.757 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 165 k 2024-04-26T11:10:31.757 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 1.6 M 2024-04-26T11:10:31.757 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 138 k 2024-04-26T11:10:31.757 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 3.5 M 2024-04-26T11:10:31.757 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 7.4 M 2024-04-26T11:10:31.757 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 49 k 2024-04-26T11:10:31.757 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 13 M 2024-04-26T11:10:31.757 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 47 M 2024-04-26T11:10:31.758 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 263 k 2024-04-26T11:10:31.758 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 173 k 2024-04-26T11:10:31.758 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-04-26T11:10:31.758 INFO:teuthology.orchestra.run.smithi082.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-04-26T11:10:31.758 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2024-04-26T11:10:31.758 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 31 k 2024-04-26T11:10:31.758 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 781 k 2024-04-26T11:10:31.758 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 139 k 2024-04-26T11:10:31.758 INFO:teuthology.orchestra.run.smithi082.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2024-04-26T11:10:31.758 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel x86_64 2.32.1-46.el8 baseos 100 k 2024-04-26T11:10:31.758 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-04-26T11:10:31.758 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 197 k 2024-04-26T11:10:31.758 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 371 k 2024-04-26T11:10:31.759 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 364 k 2024-04-26T11:10:31.759 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 107 k 2024-04-26T11:10:31.759 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 95 k 2024-04-26T11:10:31.759 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.5 M 2024-04-26T11:10:31.759 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 181 k 2024-04-26T11:10:31.759 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2024-04-26T11:10:31.759 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2024-04-26T11:10:31.759 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-04-26T11:10:31.759 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-04-26T11:10:31.759 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-04-26T11:10:31.759 INFO:teuthology.orchestra.run.smithi082.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-04-26T11:10:31.760 INFO:teuthology.orchestra.run.smithi082.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-04-26T11:10:31.760 INFO:teuthology.orchestra.run.smithi082.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-04-26T11:10:31.760 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.7 M 2024-04-26T11:10:31.760 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.6 M 2024-04-26T11:10:31.760 INFO:teuthology.orchestra.run.smithi082.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-04-26T11:10:31.760 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-04-26T11:10:31.760 INFO:teuthology.orchestra.run.smithi082.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-04-26T11:10:31.760 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-04-26T11:10:31.760 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-04-26T11:10:31.760 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-04-26T11:10:31.760 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2024-04-26T11:10:31.760 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-04-26T11:10:31.761 INFO:teuthology.orchestra.run.smithi082.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2024-04-26T11:10:31.761 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 22 M 2024-04-26T11:10:31.761 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 24 k 2024-04-26T11:10:31.761 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 2.3 M 2024-04-26T11:10:31.761 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 246 k 2024-04-26T11:10:31.761 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 4.8 M 2024-04-26T11:10:31.761 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 18 M 2024-04-26T11:10:31.761 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 15 k 2024-04-26T11:10:31.761 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 24 k 2024-04-26T11:10:31.761 INFO:teuthology.orchestra.run.smithi082.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-26T11:10:31.761 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-26T11:10:31.761 INFO:teuthology.orchestra.run.smithi082.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-26T11:10:31.761 INFO:teuthology.orchestra.run.smithi082.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-04-26T11:10:31.761 INFO:teuthology.orchestra.run.smithi082.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-04-26T11:10:31.762 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 142 k 2024-04-26T11:10:31.762 INFO:teuthology.orchestra.run.smithi082.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-04-26T11:10:31.762 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran x86_64 8.5.0-22.el8 baseos 645 k 2024-04-26T11:10:31.762 INFO:teuthology.orchestra.run.smithi082.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-26T11:10:31.762 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath x86_64 8.5.0-22.el8 baseos 172 k 2024-04-26T11:10:31.762 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-26T11:10:31.762 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 474 k 2024-04-26T11:10:31.762 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-26T11:10:31.762 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.6 M 2024-04-26T11:10:31.762 INFO:teuthology.orchestra.run.smithi082.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-04-26T11:10:31.762 INFO:teuthology.orchestra.run.smithi082.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-04-26T11:10:31.762 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-26T11:10:31.762 INFO:teuthology.orchestra.run.smithi082.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-04-26T11:10:31.763 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-04-26T11:10:31.763 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-26T11:10:31.763 INFO:teuthology.orchestra.run.smithi082.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-26T11:10:31.763 INFO:teuthology.orchestra.run.smithi082.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-26T11:10:31.763 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-26T11:10:31.763 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-04-26T11:10:31.763 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-04-26T11:10:31.763 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-04-26T11:10:31.763 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-26T11:10:31.763 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-04-26T11:10:31.763 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-26T11:10:31.763 INFO:teuthology.orchestra.run.smithi082.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-26T11:10:31.763 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-26T11:10:31.764 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 45 k 2024-04-26T11:10:31.764 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 129 k 2024-04-26T11:10:31.764 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-26T11:10:31.764 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-26T11:10:31.764 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-26T11:10:31.764 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-26T11:10:31.764 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-26T11:10:31.764 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-26T11:10:31.764 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-26T11:10:31.764 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-26T11:10:31.764 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-04-26T11:10:31.764 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-26T11:10:31.764 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-26T11:10:31.764 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-26T11:10:31.765 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-26T11:10:31.765 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-26T11:10:31.765 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-26T11:10:31.765 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-26T11:10:31.765 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-26T11:10:31.765 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-26T11:10:31.765 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-26T11:10:31.765 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-26T11:10:31.765 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-26T11:10:31.765 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging noarch 16.8-9.el8 powertools 48 k 2024-04-26T11:10:31.765 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-26T11:10:31.765 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-26T11:10:31.765 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-26T11:10:31.765 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-26T11:10:31.766 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-26T11:10:31.766 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-26T11:10:31.766 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-26T11:10:31.766 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-26T11:10:31.766 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-26T11:10:31.766 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-26T11:10:31.766 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-26T11:10:31.766 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-26T11:10:31.766 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-26T11:10:31.766 INFO:teuthology.orchestra.run.smithi082.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-26T11:10:31.766 INFO:teuthology.orchestra.run.smithi082.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-26T11:10:31.766 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-26T11:10:31.766 INFO:teuthology.orchestra.run.smithi082.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-26T11:10:31.767 INFO:teuthology.orchestra.run.smithi082.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-26T11:10:31.767 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-26T11:10:31.767 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-26T11:10:31.767 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-26T11:10:31.767 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-26T11:10:31.767 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-26T11:10:31.767 INFO:teuthology.orchestra.run.smithi082.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-26T11:10:31.767 INFO:teuthology.orchestra.run.smithi082.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-26T11:10:31.767 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-26T11:10:31.767 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-04-26T11:10:31.767 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:10:31.767 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-04-26T11:10:31.767 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================================ 2024-04-26T11:10:31.767 INFO:teuthology.orchestra.run.smithi082.stdout:Install 122 Packages 2024-04-26T11:10:31.768 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 15 Packages 2024-04-26T11:10:31.768 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:10:31.768 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 207 M 2024-04-26T11:10:31.768 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-04-26T11:10:32.500 INFO:teuthology.orchestra.run.smithi082.stdout:(1/137): ceph-18.2.2-1256.gdc093b5e.el8.x86_64. 31 kB/s | 6.4 kB 00:00 2024-04-26T11:10:32.934 INFO:teuthology.orchestra.run.smithi082.stdout:(2/137): ceph-base-18.2.2-1256.gdc093b5e.el8.x8 8.7 MB/s | 5.5 MB 00:00 2024-04-26T11:10:32.993 INFO:teuthology.orchestra.run.smithi082.stdout:(3/137): ceph-immutable-object-cache-18.2.2-125 2.8 MB/s | 165 kB 00:00 2024-04-26T11:10:33.235 INFO:teuthology.orchestra.run.smithi082.stdout:(4/137): ceph-mds-18.2.2-1256.gdc093b5e.el8.x86 9.4 MB/s | 2.3 MB 00:00 2024-04-26T11:10:33.401 INFO:teuthology.orchestra.run.smithi082.stdout:(5/137): ceph-mgr-18.2.2-1256.gdc093b5e.el8.x86 9.4 MB/s | 1.6 MB 00:00 2024-04-26T11:10:33.702 INFO:teuthology.orchestra.run.smithi029.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T11:10:33.702 INFO:teuthology.orchestra.run.smithi029.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T11:10:33.788 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-04-26T11:10:33.802 INFO:teuthology.orchestra.run.smithi029.stdout:============================================================================================ 2024-04-26T11:10:33.802 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-04-26T11:10:33.802 INFO:teuthology.orchestra.run.smithi029.stdout:============================================================================================ 2024-04-26T11:10:33.802 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-04-26T11:10:33.802 INFO:teuthology.orchestra.run.smithi029.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-04-26T11:10:33.802 INFO:teuthology.orchestra.run.smithi029.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.4 k 2024-04-26T11:10:33.802 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 5.5 M 2024-04-26T11:10:33.802 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 859 k 2024-04-26T11:10:33.802 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 165 k 2024-04-26T11:10:33.802 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 1.6 M 2024-04-26T11:10:33.803 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 138 k 2024-04-26T11:10:33.803 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 3.5 M 2024-04-26T11:10:33.803 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 7.4 M 2024-04-26T11:10:33.803 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 49 k 2024-04-26T11:10:33.803 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 13 M 2024-04-26T11:10:33.803 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 47 M 2024-04-26T11:10:33.803 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 263 k 2024-04-26T11:10:33.803 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 173 k 2024-04-26T11:10:33.803 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-04-26T11:10:33.803 INFO:teuthology.orchestra.run.smithi029.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-04-26T11:10:33.803 INFO:teuthology.orchestra.run.smithi029.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2024-04-26T11:10:33.803 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 31 k 2024-04-26T11:10:33.803 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 781 k 2024-04-26T11:10:33.803 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 139 k 2024-04-26T11:10:33.804 INFO:teuthology.orchestra.run.smithi029.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2024-04-26T11:10:33.804 INFO:teuthology.orchestra.run.smithi029.stdout: libuuid-devel x86_64 2.32.1-46.el8 baseos 100 k 2024-04-26T11:10:33.804 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-04-26T11:10:33.804 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 197 k 2024-04-26T11:10:33.804 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 371 k 2024-04-26T11:10:33.804 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 364 k 2024-04-26T11:10:33.804 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 107 k 2024-04-26T11:10:33.804 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 95 k 2024-04-26T11:10:33.804 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.5 M 2024-04-26T11:10:33.804 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 181 k 2024-04-26T11:10:33.804 INFO:teuthology.orchestra.run.smithi029.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2024-04-26T11:10:33.804 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrading: 2024-04-26T11:10:33.804 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-04-26T11:10:33.804 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-04-26T11:10:33.805 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-04-26T11:10:33.805 INFO:teuthology.orchestra.run.smithi029.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-04-26T11:10:33.805 INFO:teuthology.orchestra.run.smithi029.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-04-26T11:10:33.805 INFO:teuthology.orchestra.run.smithi029.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-04-26T11:10:33.805 INFO:teuthology.orchestra.run.smithi029.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.7 M 2024-04-26T11:10:33.805 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.6 M 2024-04-26T11:10:33.805 INFO:teuthology.orchestra.run.smithi029.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-04-26T11:10:33.805 INFO:teuthology.orchestra.run.smithi029.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-04-26T11:10:33.805 INFO:teuthology.orchestra.run.smithi029.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-04-26T11:10:33.805 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-04-26T11:10:33.805 INFO:teuthology.orchestra.run.smithi029.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-04-26T11:10:33.805 INFO:teuthology.orchestra.run.smithi029.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-04-26T11:10:33.805 INFO:teuthology.orchestra.run.smithi029.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2024-04-26T11:10:33.805 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-04-26T11:10:33.806 INFO:teuthology.orchestra.run.smithi029.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2024-04-26T11:10:33.806 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 22 M 2024-04-26T11:10:33.806 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 24 k 2024-04-26T11:10:33.806 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 2.3 M 2024-04-26T11:10:33.806 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 246 k 2024-04-26T11:10:33.806 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 4.8 M 2024-04-26T11:10:33.806 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 18 M 2024-04-26T11:10:33.806 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 15 k 2024-04-26T11:10:33.806 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 24 k 2024-04-26T11:10:33.806 INFO:teuthology.orchestra.run.smithi029.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-26T11:10:33.806 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-26T11:10:33.806 INFO:teuthology.orchestra.run.smithi029.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-26T11:10:33.807 INFO:teuthology.orchestra.run.smithi029.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-04-26T11:10:33.807 INFO:teuthology.orchestra.run.smithi029.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-04-26T11:10:33.807 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 142 k 2024-04-26T11:10:33.807 INFO:teuthology.orchestra.run.smithi029.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-04-26T11:10:33.807 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran x86_64 8.5.0-22.el8 baseos 645 k 2024-04-26T11:10:33.807 INFO:teuthology.orchestra.run.smithi029.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-26T11:10:33.807 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath x86_64 8.5.0-22.el8 baseos 172 k 2024-04-26T11:10:33.807 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-26T11:10:33.807 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 474 k 2024-04-26T11:10:33.807 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-26T11:10:33.807 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.6 M 2024-04-26T11:10:33.807 INFO:teuthology.orchestra.run.smithi029.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-04-26T11:10:33.807 INFO:teuthology.orchestra.run.smithi029.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-04-26T11:10:33.807 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-26T11:10:33.808 INFO:teuthology.orchestra.run.smithi029.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-04-26T11:10:33.808 INFO:teuthology.orchestra.run.smithi029.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-04-26T11:10:33.808 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-26T11:10:33.808 INFO:teuthology.orchestra.run.smithi029.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-26T11:10:33.808 INFO:teuthology.orchestra.run.smithi029.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-26T11:10:33.808 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-26T11:10:33.808 INFO:teuthology.orchestra.run.smithi029.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-04-26T11:10:33.808 INFO:teuthology.orchestra.run.smithi029.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-04-26T11:10:33.808 INFO:teuthology.orchestra.run.smithi029.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-04-26T11:10:33.808 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-26T11:10:33.808 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-04-26T11:10:33.808 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-26T11:10:33.808 INFO:teuthology.orchestra.run.smithi029.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-26T11:10:33.809 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-26T11:10:33.809 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 45 k 2024-04-26T11:10:33.809 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 129 k 2024-04-26T11:10:33.809 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-26T11:10:33.809 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-26T11:10:33.809 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-26T11:10:33.809 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-26T11:10:33.809 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-26T11:10:33.809 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-26T11:10:33.809 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-26T11:10:33.809 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-26T11:10:33.809 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-04-26T11:10:33.809 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-26T11:10:33.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-26T11:10:33.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-26T11:10:33.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-26T11:10:33.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-26T11:10:33.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-26T11:10:33.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-26T11:10:33.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-26T11:10:33.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-26T11:10:33.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-26T11:10:33.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-26T11:10:33.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-26T11:10:33.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-packaging noarch 16.8-9.el8 powertools 48 k 2024-04-26T11:10:33.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-26T11:10:33.811 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-26T11:10:33.811 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-26T11:10:33.811 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-26T11:10:33.811 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-26T11:10:33.811 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-26T11:10:33.811 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-26T11:10:33.811 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-26T11:10:33.811 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-26T11:10:33.811 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-26T11:10:33.811 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-26T11:10:33.811 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-26T11:10:33.811 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-26T11:10:33.812 INFO:teuthology.orchestra.run.smithi029.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-26T11:10:33.812 INFO:teuthology.orchestra.run.smithi029.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-26T11:10:33.812 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-26T11:10:33.812 INFO:teuthology.orchestra.run.smithi029.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-26T11:10:33.812 INFO:teuthology.orchestra.run.smithi029.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-26T11:10:33.812 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-26T11:10:33.812 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-26T11:10:33.812 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-26T11:10:33.812 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-26T11:10:33.812 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-26T11:10:33.812 INFO:teuthology.orchestra.run.smithi029.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-26T11:10:33.812 INFO:teuthology.orchestra.run.smithi029.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-26T11:10:33.812 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-26T11:10:33.813 INFO:teuthology.orchestra.run.smithi029.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-04-26T11:10:33.813 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:10:33.813 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-04-26T11:10:33.813 INFO:teuthology.orchestra.run.smithi029.stdout:============================================================================================ 2024-04-26T11:10:33.813 INFO:teuthology.orchestra.run.smithi029.stdout:Install 122 Packages 2024-04-26T11:10:33.813 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrade 15 Packages 2024-04-26T11:10:33.813 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:10:33.814 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 207 M 2024-04-26T11:10:33.814 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-04-26T11:10:33.918 INFO:teuthology.orchestra.run.smithi082.stdout:(6/137): ceph-common-18.2.2-1256.gdc093b5e.el8. 13 MB/s | 22 MB 00:01 2024-04-26T11:10:33.970 INFO:teuthology.orchestra.run.smithi072.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T11:10:33.970 INFO:teuthology.orchestra.run.smithi072.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T11:10:34.018 INFO:teuthology.orchestra.run.smithi082.stdout:(7/137): ceph-mon-18.2.2-1256.gdc093b5e.el8.x86 7.8 MB/s | 4.8 MB 00:00 2024-04-26T11:10:34.049 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-04-26T11:10:34.062 INFO:teuthology.orchestra.run.smithi072.stdout:============================================================================================ 2024-04-26T11:10:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2024-04-26T11:10:34.063 INFO:teuthology.orchestra.run.smithi072.stdout:============================================================================================ 2024-04-26T11:10:34.063 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-04-26T11:10:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-04-26T11:10:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.4 k 2024-04-26T11:10:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 5.5 M 2024-04-26T11:10:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 859 k 2024-04-26T11:10:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 165 k 2024-04-26T11:10:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 1.6 M 2024-04-26T11:10:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 138 k 2024-04-26T11:10:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 3.5 M 2024-04-26T11:10:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 7.4 M 2024-04-26T11:10:34.063 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 49 k 2024-04-26T11:10:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 13 M 2024-04-26T11:10:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 47 M 2024-04-26T11:10:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 263 k 2024-04-26T11:10:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 173 k 2024-04-26T11:10:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-04-26T11:10:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-04-26T11:10:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2024-04-26T11:10:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 31 k 2024-04-26T11:10:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 781 k 2024-04-26T11:10:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 139 k 2024-04-26T11:10:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2024-04-26T11:10:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel x86_64 2.32.1-46.el8 baseos 100 k 2024-04-26T11:10:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-04-26T11:10:34.064 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 197 k 2024-04-26T11:10:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 371 k 2024-04-26T11:10:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 364 k 2024-04-26T11:10:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 107 k 2024-04-26T11:10:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 95 k 2024-04-26T11:10:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.5 M 2024-04-26T11:10:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 181 k 2024-04-26T11:10:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2024-04-26T11:10:34.065 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2024-04-26T11:10:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-04-26T11:10:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-04-26T11:10:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-04-26T11:10:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-04-26T11:10:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-04-26T11:10:34.065 INFO:teuthology.orchestra.run.smithi072.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-04-26T11:10:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.7 M 2024-04-26T11:10:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.6 M 2024-04-26T11:10:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-04-26T11:10:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-04-26T11:10:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-04-26T11:10:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-04-26T11:10:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-04-26T11:10:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-04-26T11:10:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2024-04-26T11:10:34.066 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-04-26T11:10:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2024-04-26T11:10:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 22 M 2024-04-26T11:10:34.066 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 24 k 2024-04-26T11:10:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 2.3 M 2024-04-26T11:10:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 246 k 2024-04-26T11:10:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 4.8 M 2024-04-26T11:10:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 18 M 2024-04-26T11:10:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 15 k 2024-04-26T11:10:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 24 k 2024-04-26T11:10:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-26T11:10:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-26T11:10:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-26T11:10:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-04-26T11:10:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-04-26T11:10:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 142 k 2024-04-26T11:10:34.067 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-04-26T11:10:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran x86_64 8.5.0-22.el8 baseos 645 k 2024-04-26T11:10:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-26T11:10:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath x86_64 8.5.0-22.el8 baseos 172 k 2024-04-26T11:10:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-26T11:10:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 474 k 2024-04-26T11:10:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-26T11:10:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.6 M 2024-04-26T11:10:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-04-26T11:10:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-04-26T11:10:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-26T11:10:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-04-26T11:10:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-04-26T11:10:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-26T11:10:34.068 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-26T11:10:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-26T11:10:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-26T11:10:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-04-26T11:10:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-04-26T11:10:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-04-26T11:10:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-26T11:10:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-04-26T11:10:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-26T11:10:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-26T11:10:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-26T11:10:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 45 k 2024-04-26T11:10:34.069 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 129 k 2024-04-26T11:10:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-26T11:10:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-26T11:10:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-26T11:10:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-26T11:10:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-26T11:10:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-26T11:10:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-26T11:10:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-26T11:10:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-04-26T11:10:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-26T11:10:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-26T11:10:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-26T11:10:34.070 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-26T11:10:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-26T11:10:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-26T11:10:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-26T11:10:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-26T11:10:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-26T11:10:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-26T11:10:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-26T11:10:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-26T11:10:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: python3-packaging noarch 16.8-9.el8 powertools 48 k 2024-04-26T11:10:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-26T11:10:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-26T11:10:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-26T11:10:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-26T11:10:34.071 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-26T11:10:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-26T11:10:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-26T11:10:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-26T11:10:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-26T11:10:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-26T11:10:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-26T11:10:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-26T11:10:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-26T11:10:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-26T11:10:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-26T11:10:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-26T11:10:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-26T11:10:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-26T11:10:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-26T11:10:34.072 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-26T11:10:34.073 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-26T11:10:34.073 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-26T11:10:34.073 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-26T11:10:34.073 INFO:teuthology.orchestra.run.smithi072.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-26T11:10:34.073 INFO:teuthology.orchestra.run.smithi072.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-26T11:10:34.073 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-26T11:10:34.073 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-04-26T11:10:34.073 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:10:34.073 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-04-26T11:10:34.073 INFO:teuthology.orchestra.run.smithi072.stdout:============================================================================================ 2024-04-26T11:10:34.073 INFO:teuthology.orchestra.run.smithi072.stdout:Install 122 Packages 2024-04-26T11:10:34.073 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 15 Packages 2024-04-26T11:10:34.073 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:10:34.074 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 207 M 2024-04-26T11:10:34.074 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-04-26T11:10:34.709 INFO:teuthology.orchestra.run.smithi029.stdout:(1/137): ceph-18.2.2-1256.gdc093b5e.el8.x86_64. 19 kB/s | 6.4 kB 00:00 2024-04-26T11:10:34.766 INFO:teuthology.orchestra.run.smithi122.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T11:10:34.767 INFO:teuthology.orchestra.run.smithi122.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T11:10:34.845 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-04-26T11:10:34.858 INFO:teuthology.orchestra.run.smithi122.stdout:============================================================================================ 2024-04-26T11:10:34.858 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-04-26T11:10:34.858 INFO:teuthology.orchestra.run.smithi122.stdout:============================================================================================ 2024-04-26T11:10:34.858 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-04-26T11:10:34.858 INFO:teuthology.orchestra.run.smithi122.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-04-26T11:10:34.858 INFO:teuthology.orchestra.run.smithi122.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.4 k 2024-04-26T11:10:34.858 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 5.5 M 2024-04-26T11:10:34.859 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 859 k 2024-04-26T11:10:34.859 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 165 k 2024-04-26T11:10:34.859 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 1.6 M 2024-04-26T11:10:34.859 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 138 k 2024-04-26T11:10:34.859 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 3.5 M 2024-04-26T11:10:34.860 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 7.4 M 2024-04-26T11:10:34.860 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 49 k 2024-04-26T11:10:34.860 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 13 M 2024-04-26T11:10:34.860 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 47 M 2024-04-26T11:10:34.860 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 263 k 2024-04-26T11:10:34.860 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 173 k 2024-04-26T11:10:34.860 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-04-26T11:10:34.860 INFO:teuthology.orchestra.run.smithi122.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-04-26T11:10:34.860 INFO:teuthology.orchestra.run.smithi122.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2024-04-26T11:10:34.860 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 31 k 2024-04-26T11:10:34.860 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 781 k 2024-04-26T11:10:34.860 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 139 k 2024-04-26T11:10:34.861 INFO:teuthology.orchestra.run.smithi122.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2024-04-26T11:10:34.861 INFO:teuthology.orchestra.run.smithi122.stdout: libuuid-devel x86_64 2.32.1-46.el8 baseos 100 k 2024-04-26T11:10:34.861 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-04-26T11:10:34.861 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 197 k 2024-04-26T11:10:34.861 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 371 k 2024-04-26T11:10:34.861 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 364 k 2024-04-26T11:10:34.861 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 107 k 2024-04-26T11:10:34.861 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 95 k 2024-04-26T11:10:34.861 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.5 M 2024-04-26T11:10:34.861 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 181 k 2024-04-26T11:10:34.861 INFO:teuthology.orchestra.run.smithi122.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2024-04-26T11:10:34.861 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrading: 2024-04-26T11:10:34.861 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-04-26T11:10:34.861 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-04-26T11:10:34.862 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-04-26T11:10:34.862 INFO:teuthology.orchestra.run.smithi122.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-04-26T11:10:34.862 INFO:teuthology.orchestra.run.smithi122.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-04-26T11:10:34.862 INFO:teuthology.orchestra.run.smithi122.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-04-26T11:10:34.862 INFO:teuthology.orchestra.run.smithi122.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.7 M 2024-04-26T11:10:34.862 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.6 M 2024-04-26T11:10:34.862 INFO:teuthology.orchestra.run.smithi122.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-04-26T11:10:34.862 INFO:teuthology.orchestra.run.smithi122.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-04-26T11:10:34.862 INFO:teuthology.orchestra.run.smithi122.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-04-26T11:10:34.862 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-04-26T11:10:34.862 INFO:teuthology.orchestra.run.smithi122.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-04-26T11:10:34.862 INFO:teuthology.orchestra.run.smithi122.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-04-26T11:10:34.862 INFO:teuthology.orchestra.run.smithi122.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2024-04-26T11:10:34.862 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-04-26T11:10:34.863 INFO:teuthology.orchestra.run.smithi122.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2024-04-26T11:10:34.863 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 22 M 2024-04-26T11:10:34.863 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 24 k 2024-04-26T11:10:34.863 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 2.3 M 2024-04-26T11:10:34.863 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 246 k 2024-04-26T11:10:34.863 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 4.8 M 2024-04-26T11:10:34.863 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 18 M 2024-04-26T11:10:34.863 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 15 k 2024-04-26T11:10:34.863 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 24 k 2024-04-26T11:10:34.863 INFO:teuthology.orchestra.run.smithi122.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-26T11:10:34.863 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-26T11:10:34.863 INFO:teuthology.orchestra.run.smithi122.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-26T11:10:34.863 INFO:teuthology.orchestra.run.smithi122.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-04-26T11:10:34.863 INFO:teuthology.orchestra.run.smithi122.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-04-26T11:10:34.864 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 142 k 2024-04-26T11:10:34.864 INFO:teuthology.orchestra.run.smithi122.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-04-26T11:10:34.864 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran x86_64 8.5.0-22.el8 baseos 645 k 2024-04-26T11:10:34.864 INFO:teuthology.orchestra.run.smithi122.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-26T11:10:34.864 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath x86_64 8.5.0-22.el8 baseos 172 k 2024-04-26T11:10:34.864 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-26T11:10:34.864 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 474 k 2024-04-26T11:10:34.864 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-26T11:10:34.864 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.6 M 2024-04-26T11:10:34.864 INFO:teuthology.orchestra.run.smithi122.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-04-26T11:10:34.864 INFO:teuthology.orchestra.run.smithi122.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-04-26T11:10:34.864 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-26T11:10:34.864 INFO:teuthology.orchestra.run.smithi122.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-04-26T11:10:34.864 INFO:teuthology.orchestra.run.smithi122.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-04-26T11:10:34.865 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-26T11:10:34.865 INFO:teuthology.orchestra.run.smithi122.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-26T11:10:34.865 INFO:teuthology.orchestra.run.smithi122.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-26T11:10:34.865 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-26T11:10:34.865 INFO:teuthology.orchestra.run.smithi122.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-04-26T11:10:34.865 INFO:teuthology.orchestra.run.smithi122.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-04-26T11:10:34.865 INFO:teuthology.orchestra.run.smithi122.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-04-26T11:10:34.865 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-26T11:10:34.865 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-04-26T11:10:34.866 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-26T11:10:34.866 INFO:teuthology.orchestra.run.smithi122.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-26T11:10:34.866 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-26T11:10:34.866 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 45 k 2024-04-26T11:10:34.866 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 129 k 2024-04-26T11:10:34.866 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-26T11:10:34.866 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-26T11:10:34.866 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-26T11:10:34.866 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-26T11:10:34.866 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-26T11:10:34.866 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-26T11:10:34.866 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-26T11:10:34.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-26T11:10:34.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-04-26T11:10:34.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-26T11:10:34.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-26T11:10:34.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-26T11:10:34.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-26T11:10:34.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-26T11:10:34.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-26T11:10:34.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-26T11:10:34.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-26T11:10:34.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-26T11:10:34.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-26T11:10:34.867 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-26T11:10:34.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-26T11:10:34.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-packaging noarch 16.8-9.el8 powertools 48 k 2024-04-26T11:10:34.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-26T11:10:34.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-26T11:10:34.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-26T11:10:34.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-26T11:10:34.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-26T11:10:34.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-26T11:10:34.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-26T11:10:34.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-26T11:10:34.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-26T11:10:34.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-26T11:10:34.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-26T11:10:34.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-26T11:10:34.868 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-26T11:10:34.869 INFO:teuthology.orchestra.run.smithi122.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-26T11:10:34.869 INFO:teuthology.orchestra.run.smithi122.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-26T11:10:34.869 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-26T11:10:34.869 INFO:teuthology.orchestra.run.smithi122.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-26T11:10:34.869 INFO:teuthology.orchestra.run.smithi122.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-26T11:10:34.869 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-26T11:10:34.869 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-26T11:10:34.869 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-26T11:10:34.869 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-26T11:10:34.869 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-26T11:10:34.869 INFO:teuthology.orchestra.run.smithi122.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-26T11:10:34.869 INFO:teuthology.orchestra.run.smithi122.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-26T11:10:34.869 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-26T11:10:34.869 INFO:teuthology.orchestra.run.smithi122.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-04-26T11:10:34.870 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:10:34.870 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-04-26T11:10:34.870 INFO:teuthology.orchestra.run.smithi122.stdout:============================================================================================ 2024-04-26T11:10:34.870 INFO:teuthology.orchestra.run.smithi122.stdout:Install 122 Packages 2024-04-26T11:10:34.870 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrade 15 Packages 2024-04-26T11:10:34.870 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:10:34.870 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 207 M 2024-04-26T11:10:34.871 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-04-26T11:10:35.056 INFO:teuthology.orchestra.run.smithi072.stdout:(1/137): ceph-18.2.2-1256.gdc093b5e.el8.x86_64. 15 kB/s | 6.4 kB 00:00 2024-04-26T11:10:35.185 INFO:teuthology.orchestra.run.smithi082.stdout:(8/137): ceph-radosgw-18.2.2-1256.gdc093b5e.el8 11 MB/s | 13 MB 00:01 2024-04-26T11:10:35.369 INFO:teuthology.orchestra.run.smithi082.stdout:(9/137): ceph-osd-18.2.2-1256.gdc093b5e.el8.x86 13 MB/s | 18 MB 00:01 2024-04-26T11:10:35.394 INFO:teuthology.orchestra.run.smithi082.stdout:(10/137): ceph-selinux-18.2.2-1256.gdc093b5e.el 117 kB/s | 24 kB 00:00 2024-04-26T11:10:35.423 INFO:teuthology.orchestra.run.smithi072.stdout:(2/137): ceph-fuse-18.2.2-1256.gdc093b5e.el8.x8 2.3 MB/s | 859 kB 00:00 2024-04-26T11:10:35.453 INFO:teuthology.orchestra.run.smithi082.stdout:(11/137): ceph-fuse-18.2.2-1256.gdc093b5e.el8.x 291 kB/s | 859 kB 00:02 2024-04-26T11:10:35.486 INFO:teuthology.orchestra.run.smithi082.stdout:(12/137): libcephfs-devel-18.2.2-1256.gdc093b5e 336 kB/s | 31 kB 00:00 2024-04-26T11:10:35.570 INFO:teuthology.orchestra.run.smithi082.stdout:(13/137): libcephsqlite-18.2.2-1256.gdc093b5e.e 1.7 MB/s | 142 kB 00:00 2024-04-26T11:10:35.624 INFO:teuthology.orchestra.run.smithi072.stdout:(3/137): ceph-base-18.2.2-1256.gdc093b5e.el8.x8 5.6 MB/s | 5.5 MB 00:00 2024-04-26T11:10:35.637 INFO:teuthology.orchestra.run.smithi082.stdout:(14/137): librados-devel-18.2.2-1256.gdc093b5e. 2.0 MB/s | 139 kB 00:00 2024-04-26T11:10:35.644 INFO:teuthology.orchestra.run.smithi122.stdout:(1/137): ceph-18.2.2-1256.gdc093b5e.el8.x86_64. 26 kB/s | 6.4 kB 00:00 2024-04-26T11:10:35.650 INFO:teuthology.orchestra.run.smithi072.stdout:(4/137): ceph-immutable-object-cache-18.2.2-125 733 kB/s | 165 kB 00:00 2024-04-26T11:10:35.850 INFO:teuthology.orchestra.run.smithi072.stdout:(5/137): ceph-mds-18.2.2-1256.gdc093b5e.el8.x86 10 MB/s | 2.3 MB 00:00 2024-04-26T11:10:36.211 INFO:teuthology.orchestra.run.smithi122.stdout:(2/137): ceph-fuse-18.2.2-1256.gdc093b5e.el8.x8 1.5 MB/s | 859 kB 00:00 2024-04-26T11:10:36.261 INFO:teuthology.orchestra.run.smithi122.stdout:(3/137): ceph-immutable-object-cache-18.2.2-125 3.2 MB/s | 165 kB 00:00 2024-04-26T11:10:36.285 INFO:teuthology.orchestra.run.smithi029.stdout:(2/137): ceph-fuse-18.2.2-1256.gdc093b5e.el8.x8 545 kB/s | 859 kB 00:01 2024-04-26T11:10:36.320 INFO:teuthology.orchestra.run.smithi072.stdout:(6/137): ceph-mon-18.2.2-1256.gdc093b5e.el8.x86 10 MB/s | 4.8 MB 00:00 2024-04-26T11:10:36.537 INFO:teuthology.orchestra.run.smithi082.stdout:(15/137): libradosstriper1-18.2.2-1256.gdc093b5 526 kB/s | 474 kB 00:00 2024-04-26T11:10:36.584 INFO:teuthology.orchestra.run.smithi072.stdout:(7/137): ceph-mgr-18.2.2-1256.gdc093b5e.el8.x86 1.7 MB/s | 1.6 MB 00:00 2024-04-26T11:10:36.594 INFO:teuthology.orchestra.run.smithi029.stdout:(3/137): ceph-immutable-object-cache-18.2.2-125 536 kB/s | 165 kB 00:00 2024-04-26T11:10:37.328 INFO:teuthology.orchestra.run.smithi122.stdout:(4/137): ceph-mds-18.2.2-1256.gdc093b5e.el8.x86 2.1 MB/s | 2.3 MB 00:01 2024-04-26T11:10:37.862 INFO:teuthology.orchestra.run.smithi082.stdout:(16/137): librgw2-18.2.2-1256.gdc093b5e.el8.x86 4.9 MB/s | 6.6 MB 00:01 2024-04-26T11:10:37.938 INFO:teuthology.orchestra.run.smithi082.stdout:(17/137): libcephfs2-18.2.2-1256.gdc093b5e.el8. 314 kB/s | 781 kB 00:02 2024-04-26T11:10:37.963 INFO:teuthology.orchestra.run.smithi082.stdout:(18/137): python3-ceph-argparse-18.2.2-1256.gdc 445 kB/s | 45 kB 00:00 2024-04-26T11:10:38.055 INFO:teuthology.orchestra.run.smithi082.stdout:(19/137): python3-cephfs-18.2.2-1256.gdc093b5e. 2.1 MB/s | 197 kB 00:00 2024-04-26T11:10:38.189 INFO:teuthology.orchestra.run.smithi082.stdout:(20/137): python3-rados-18.2.2-1256.gdc093b5e.e 2.7 MB/s | 371 kB 00:00 2024-04-26T11:10:38.245 INFO:teuthology.orchestra.run.smithi122.stdout:(5/137): ceph-mgr-18.2.2-1256.gdc093b5e.el8.x86 1.7 MB/s | 1.6 MB 00:00 2024-04-26T11:10:38.280 INFO:teuthology.orchestra.run.smithi082.stdout:(21/137): python3-rbd-18.2.2-1256.gdc093b5e.el8 3.9 MB/s | 364 kB 00:00 2024-04-26T11:10:38.306 INFO:teuthology.orchestra.run.smithi082.stdout:(22/137): python3-ceph-common-18.2.2-1256.gdc09 350 kB/s | 129 kB 00:00 2024-04-26T11:10:38.364 INFO:teuthology.orchestra.run.smithi082.stdout:(23/137): python3-rgw-18.2.2-1256.gdc093b5e.el8 1.2 MB/s | 107 kB 00:00 2024-04-26T11:10:38.507 INFO:teuthology.orchestra.run.smithi082.stdout:(24/137): rbd-fuse-18.2.2-1256.gdc093b5e.el8.x8 474 kB/s | 95 kB 00:00 2024-04-26T11:10:38.652 INFO:teuthology.orchestra.run.smithi072.stdout:(8/137): ceph-osd-18.2.2-1256.gdc093b5e.el8.x86 7.9 MB/s | 18 MB 00:02 2024-04-26T11:10:38.761 INFO:teuthology.orchestra.run.smithi072.stdout:(9/137): ceph-selinux-18.2.2-1256.gdc093b5e.el8 224 kB/s | 24 kB 00:00 2024-04-26T11:10:38.790 INFO:teuthology.orchestra.run.smithi082.stdout:(25/137): rbd-nbd-18.2.2-1256.gdc093b5e.el8.x86 640 kB/s | 181 kB 00:00 2024-04-26T11:10:38.857 INFO:teuthology.orchestra.run.smithi082.stdout:(26/137): rbd-mirror-18.2.2-1256.gdc093b5e.el8. 7.0 MB/s | 3.5 MB 00:00 2024-04-26T11:10:38.882 INFO:teuthology.orchestra.run.smithi082.stdout:(27/137): ceph-grafana-dashboards-18.2.2-1256.g 264 kB/s | 24 kB 00:00 2024-04-26T11:10:38.950 INFO:teuthology.orchestra.run.smithi082.stdout:(28/137): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 1.5 MB/s | 138 kB 00:00 2024-04-26T11:10:39.327 INFO:teuthology.orchestra.run.smithi029.stdout:(4/137): ceph-mds-18.2.2-1256.gdc093b5e.el8.x86 851 kB/s | 2.3 MB 00:02 2024-04-26T11:10:39.445 INFO:teuthology.orchestra.run.smithi072.stdout:(10/137): ceph-radosgw-18.2.2-1256.gdc093b5e.el 4.6 MB/s | 13 MB 00:02 2024-04-26T11:10:39.537 INFO:teuthology.orchestra.run.smithi072.stdout:(11/137): libcephfs-devel-18.2.2-1256.gdc093b5e 337 kB/s | 31 kB 00:00 2024-04-26T11:10:39.846 INFO:teuthology.orchestra.run.smithi072.stdout:(12/137): libcephfs2-18.2.2-1256.gdc093b5e.el8. 2.5 MB/s | 781 kB 00:00 2024-04-26T11:10:39.981 INFO:teuthology.orchestra.run.smithi072.stdout:(13/137): libcephsqlite-18.2.2-1256.gdc093b5e.e 1.0 MB/s | 142 kB 00:00 2024-04-26T11:10:40.098 INFO:teuthology.orchestra.run.smithi072.stdout:(14/137): librados-devel-18.2.2-1256.gdc093b5e. 1.2 MB/s | 139 kB 00:00 2024-04-26T11:10:40.208 INFO:teuthology.orchestra.run.smithi082.stdout:(29/137): ceph-mgr-diskprediction-local-18.2.2- 5.9 MB/s | 7.4 MB 00:01 2024-04-26T11:10:40.291 INFO:teuthology.orchestra.run.smithi072.stdout:(15/137): libradosstriper1-18.2.2-1256.gdc093b5 2.4 MB/s | 474 kB 00:00 2024-04-26T11:10:40.325 INFO:teuthology.orchestra.run.smithi082.stdout:(30/137): ceph-mgr-modules-core-18.2.2-1256.gdc 2.1 MB/s | 246 kB 00:00 2024-04-26T11:10:40.409 INFO:teuthology.orchestra.run.smithi082.stdout:(31/137): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 591 kB/s | 49 kB 00:00 2024-04-26T11:10:40.454 INFO:teuthology.orchestra.run.smithi122.stdout:(6/137): ceph-mon-18.2.2-1256.gdc093b5e.el8.x86 2.2 MB/s | 4.8 MB 00:02 2024-04-26T11:10:40.475 INFO:teuthology.orchestra.run.smithi082.stdout:(32/137): ceph-prometheus-alerts-18.2.2-1256.gd 229 kB/s | 15 kB 00:00 2024-04-26T11:10:40.567 INFO:teuthology.orchestra.run.smithi082.stdout:(33/137): ceph-volume-18.2.2-1256.gdc093b5e.el8 2.8 MB/s | 263 kB 00:00 2024-04-26T11:10:40.676 INFO:teuthology.orchestra.run.smithi082.stdout:(34/137): cephadm-18.2.2-1256.gdc093b5e.el8.noa 1.6 MB/s | 173 kB 00:00 2024-04-26T11:10:41.035 INFO:teuthology.orchestra.run.smithi082.stdout:(35/137): automake-1.16.1-8.el8.noarch.rpm 2.0 MB/s | 740 kB 00:00 2024-04-26T11:10:41.061 INFO:teuthology.orchestra.run.smithi029.stdout:(5/137): ceph-mgr-18.2.2-1256.gdc093b5e.el8.x86 921 kB/s | 1.6 MB 00:01 2024-04-26T11:10:41.477 INFO:teuthology.orchestra.run.smithi082.stdout:(36/137): bison-3.0.4-10.el8.x86_64.rpm 1.5 MB/s | 688 kB 00:00 2024-04-26T11:10:41.577 INFO:teuthology.orchestra.run.smithi082.stdout:(37/137): flex-2.6.1-9.el8.x86_64.rpm 3.1 MB/s | 320 kB 00:00 2024-04-26T11:10:41.652 INFO:teuthology.orchestra.run.smithi082.stdout:(38/137): jq-1.6-8.el8.x86_64.rpm 2.7 MB/s | 203 kB 00:00 2024-04-26T11:10:41.761 INFO:teuthology.orchestra.run.smithi082.stdout:(39/137): librdkafka-1.6.1-1.el8.x86_64.rpm 6.1 MB/s | 677 kB 00:00 2024-04-26T11:10:41.853 INFO:teuthology.orchestra.run.smithi082.stdout:(40/137): libtool-2.4.6-25.el8.x86_64.rpm 7.6 MB/s | 709 kB 00:00 2024-04-26T11:10:41.904 INFO:teuthology.orchestra.run.smithi029.stdout:(6/137): ceph-base-18.2.2-1256.gdc093b5e.el8.x8 750 kB/s | 5.5 MB 00:07 2024-04-26T11:10:41.928 INFO:teuthology.orchestra.run.smithi082.stdout:(41/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.4 MB/s | 259 kB 00:00 2024-04-26T11:10:41.933 INFO:teuthology.orchestra.run.smithi072.stdout:(16/137): librgw2-18.2.2-1256.gdc093b5e.el8.x86 4.0 MB/s | 6.6 MB 00:01 2024-04-26T11:10:42.025 INFO:teuthology.orchestra.run.smithi072.stdout:(17/137): python3-ceph-argparse-18.2.2-1256.gdc 487 kB/s | 45 kB 00:00 2024-04-26T11:10:42.045 INFO:teuthology.orchestra.run.smithi082.stdout:(42/137): oniguruma-6.8.2-3.el8.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-04-26T11:10:42.129 INFO:teuthology.orchestra.run.smithi122.stdout:(7/137): ceph-base-18.2.2-1256.gdc093b5e.el8.x8 840 kB/s | 5.5 MB 00:06 2024-04-26T11:10:42.134 INFO:teuthology.orchestra.run.smithi072.stdout:(18/137): python3-ceph-common-18.2.2-1256.gdc09 1.2 MB/s | 129 kB 00:00 2024-04-26T11:10:42.268 INFO:teuthology.orchestra.run.smithi072.stdout:(19/137): python3-cephfs-18.2.2-1256.gdc093b5e. 1.4 MB/s | 197 kB 00:00 2024-04-26T11:10:42.379 INFO:teuthology.orchestra.run.smithi082.stdout:(43/137): openblas-0.3.15-4.el8.x86_64.rpm 14 MB/s | 4.7 MB 00:00 2024-04-26T11:10:42.434 INFO:teuthology.orchestra.run.smithi072.stdout:(20/137): python3-rados-18.2.2-1256.gdc093b5e.e 2.2 MB/s | 371 kB 00:00 2024-04-26T11:10:42.594 INFO:teuthology.orchestra.run.smithi072.stdout:(21/137): python3-rbd-18.2.2-1256.gdc093b5e.el8 2.2 MB/s | 364 kB 00:00 2024-04-26T11:10:42.663 INFO:teuthology.orchestra.run.smithi082.stdout:(44/137): openblas-threads-0.3.15-4.el8.x86_64. 17 MB/s | 4.9 MB 00:00 2024-04-26T11:10:42.703 INFO:teuthology.orchestra.run.smithi072.stdout:(22/137): python3-rgw-18.2.2-1256.gdc093b5e.el8 987 kB/s | 107 kB 00:00 2024-04-26T11:10:42.812 INFO:teuthology.orchestra.run.smithi072.stdout:(23/137): rbd-fuse-18.2.2-1256.gdc093b5e.el8.x8 873 kB/s | 95 kB 00:00 2024-04-26T11:10:42.971 INFO:teuthology.orchestra.run.smithi082.stdout:(45/137): python3-babel-2.5.1-7.el8.noarch.rpm 16 MB/s | 4.8 MB 00:00 2024-04-26T11:10:43.230 INFO:teuthology.orchestra.run.smithi082.stdout:(46/137): python3-jinja2-2.10.1-4.el8.noarch.rp 2.2 MB/s | 578 kB 00:00 2024-04-26T11:10:43.297 INFO:teuthology.orchestra.run.smithi082.stdout:(47/137): python3-jsonpatch-1.21-2.el8.noarch.r 399 kB/s | 27 kB 00:00 2024-04-26T11:10:43.372 INFO:teuthology.orchestra.run.smithi082.stdout:(48/137): python3-jsonpointer-1.10-11.el8.noarc 266 kB/s | 20 kB 00:00 2024-04-26T11:10:43.448 INFO:teuthology.orchestra.run.smithi082.stdout:(49/137): python3-mako-1.0.6-14.el8.noarch.rpm 2.0 MB/s | 157 kB 00:00 2024-04-26T11:10:43.623 INFO:teuthology.orchestra.run.smithi072.stdout:(24/137): ceph-common-18.2.2-1256.gdc093b5e.el8 2.4 MB/s | 22 MB 00:08 2024-04-26T11:10:43.648 INFO:teuthology.orchestra.run.smithi082.stdout:(50/137): ceph-mgr-dashboard-18.2.2-1256.gdc093 758 kB/s | 3.5 MB 00:04 2024-04-26T11:10:43.732 INFO:teuthology.orchestra.run.smithi082.stdout:(51/137): python3-markupsafe-0.23-19.el8.x86_64 137 kB/s | 39 kB 00:00 2024-04-26T11:10:43.763 INFO:teuthology.orchestra.run.smithi072.stdout:(25/137): rbd-mirror-18.2.2-1256.gdc093b5e.el8. 3.6 MB/s | 3.5 MB 00:00 2024-04-26T11:10:43.789 INFO:teuthology.orchestra.run.smithi072.stdout:(26/137): rbd-nbd-18.2.2-1256.gdc093b5e.el8.x86 1.1 MB/s | 181 kB 00:00 2024-04-26T11:10:43.807 INFO:teuthology.orchestra.run.smithi082.stdout:(52/137): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.9 MB/s | 225 kB 00:00 2024-04-26T11:10:43.882 INFO:teuthology.orchestra.run.smithi082.stdout:(53/137): python3-prettytable-0.7.2-14.el8.noar 586 kB/s | 44 kB 00:00 2024-04-26T11:10:43.982 INFO:teuthology.orchestra.run.smithi082.stdout:(54/137): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.0 MB/s | 103 kB 00:00 2024-04-26T11:10:44.058 INFO:teuthology.orchestra.run.smithi082.stdout:(55/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.6 MB/s | 126 kB 00:00 2024-04-26T11:10:44.141 INFO:teuthology.orchestra.run.smithi082.stdout:(56/137): python3-pyasn1-modules-0.3.7-6.el8.no 1.3 MB/s | 110 kB 00:00 2024-04-26T11:10:44.154 INFO:teuthology.orchestra.run.smithi029.stdout:(7/137): ceph-mon-18.2.2-1256.gdc093b5e.el8.x86 1.6 MB/s | 4.8 MB 00:03 2024-04-26T11:10:44.192 INFO:teuthology.orchestra.run.smithi082.stdout:(57/137): python3-numpy-1.14.3-10.el8.x86_64.rp 6.9 MB/s | 3.7 MB 00:00 2024-04-26T11:10:44.241 INFO:teuthology.orchestra.run.smithi082.stdout:(58/137): python3-pytz-2017.2-11.el8.noarch.rpm 573 kB/s | 57 kB 00:00 2024-04-26T11:10:44.376 INFO:teuthology.orchestra.run.smithi082.stdout:(59/137): python3-werkzeug-0.12.2-4.el8.noarch. 3.3 MB/s | 457 kB 00:00 2024-04-26T11:10:44.396 INFO:teuthology.orchestra.run.smithi122.stdout:(8/137): ceph-common-18.2.2-1256.gdc093b5e.el8. 2.4 MB/s | 22 MB 00:08 2024-04-26T11:10:44.459 INFO:teuthology.orchestra.run.smithi082.stdout:(60/137): socat-1.7.4.1-1.el8.x86_64.rpm 3.8 MB/s | 323 kB 00:00 2024-04-26T11:10:44.479 INFO:teuthology.orchestra.run.smithi122.stdout:(9/137): ceph-selinux-18.2.2-1256.gdc093b5e.el8 293 kB/s | 24 kB 00:00 2024-04-26T11:10:44.533 INFO:teuthology.orchestra.run.smithi072.stdout:(27/137): ceph-test-18.2.2-1256.gdc093b5e.el8.x 8.2 MB/s | 47 MB 00:05 2024-04-26T11:10:44.534 INFO:teuthology.orchestra.run.smithi082.stdout:(61/137): xmlstarlet-1.6.1-20.el8.x86_64.rpm 944 kB/s | 71 kB 00:00 2024-04-26T11:10:44.558 INFO:teuthology.orchestra.run.smithi072.stdout:(28/137): ceph-grafana-dashboards-18.2.2-1256.g 31 kB/s | 24 kB 00:00 2024-04-26T11:10:44.592 INFO:teuthology.orchestra.run.smithi072.stdout:(29/137): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 172 kB/s | 138 kB 00:00 2024-04-26T11:10:44.735 INFO:teuthology.orchestra.run.smithi082.stdout:(62/137): python3-scipy-1.0.0-21.module_el8+762 26 MB/s | 14 MB 00:00 2024-04-26T11:10:44.842 INFO:teuthology.orchestra.run.smithi072.stdout:(30/137): ceph-mgr-modules-core-18.2.2-1256.gdc 982 kB/s | 246 kB 00:00 2024-04-26T11:10:44.877 INFO:teuthology.orchestra.run.smithi082.stdout:(63/137): elfutils-libelf-devel-0.190-2.el8.x86 182 kB/s | 62 kB 00:00 2024-04-26T11:10:44.903 INFO:teuthology.orchestra.run.smithi082.stdout:(64/137): fuse-2.9.7-19.el8.x86_64.rpm 498 kB/s | 83 kB 00:00 2024-04-26T11:10:44.936 INFO:teuthology.orchestra.run.smithi082.stdout:(65/137): keyutils-libs-devel-1.5.10-9.el8.x86_ 820 kB/s | 48 kB 00:00 2024-04-26T11:10:44.951 INFO:teuthology.orchestra.run.smithi072.stdout:(31/137): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 453 kB/s | 49 kB 00:00 2024-04-26T11:10:45.003 INFO:teuthology.orchestra.run.smithi082.stdout:(66/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 280 kB/s | 19 kB 00:00 2024-04-26T11:10:45.060 INFO:teuthology.orchestra.run.smithi072.stdout:(32/137): ceph-prometheus-alerts-18.2.2-1256.gd 140 kB/s | 15 kB 00:00 2024-04-26T11:10:45.078 INFO:teuthology.orchestra.run.smithi082.stdout:(67/137): libcom_err-devel-1.45.6-5.el8.x86_64. 516 kB/s | 39 kB 00:00 2024-04-26T11:10:45.112 INFO:teuthology.orchestra.run.smithi082.stdout:(68/137): krb5-devel-1.18.2-22.el8.x86_64.rpm 2.6 MB/s | 561 kB 00:00 2024-04-26T11:10:45.144 INFO:teuthology.orchestra.run.smithi072.stdout:(33/137): ceph-mgr-dashboard-18.2.2-1256.gdc093 5.8 MB/s | 3.5 MB 00:00 2024-04-26T11:10:45.171 INFO:teuthology.orchestra.run.smithi082.stdout:(69/137): libquadmath-8.5.0-22.el8.x86_64.rpm 2.9 MB/s | 172 kB 00:00 2024-04-26T11:10:45.213 INFO:teuthology.orchestra.run.smithi082.stdout:(70/137): libgfortran-8.5.0-22.el8.x86_64.rpm 4.7 MB/s | 645 kB 00:00 2024-04-26T11:10:45.228 INFO:teuthology.orchestra.run.smithi072.stdout:(34/137): ceph-volume-18.2.2-1256.gdc093b5e.el8 1.5 MB/s | 263 kB 00:00 2024-04-26T11:10:45.238 INFO:teuthology.orchestra.run.smithi082.stdout:(71/137): librabbitmq-0.9.0-5.el8.x86_64.rpm 703 kB/s | 47 kB 00:00 2024-04-26T11:10:45.254 INFO:teuthology.orchestra.run.smithi072.stdout:(35/137): cephadm-18.2.2-1256.gdc093b5e.el8.noa 1.5 MB/s | 173 kB 00:00 2024-04-26T11:10:45.280 INFO:teuthology.orchestra.run.smithi082.stdout:(72/137): libselinux-devel-2.9-8.el8.x86_64.rpm 2.9 MB/s | 200 kB 00:00 2024-04-26T11:10:45.331 INFO:teuthology.orchestra.run.smithi082.stdout:(73/137): libsepol-devel-2.9-3.el8.x86_64.rpm 941 kB/s | 87 kB 00:00 2024-04-26T11:10:45.365 INFO:teuthology.orchestra.run.smithi082.stdout:(74/137): libuuid-devel-2.32.1-46.el8.x86_64.rp 1.2 MB/s | 100 kB 00:00 2024-04-26T11:10:45.389 INFO:teuthology.orchestra.run.smithi082.stdout:(75/137): libverto-devel-0.3.2-2.el8.x86_64.rpm 312 kB/s | 18 kB 00:00 2024-04-26T11:10:45.423 INFO:teuthology.orchestra.run.smithi082.stdout:(76/137): libzstd-devel-1.4.4-1.el8.x86_64.rpm 750 kB/s | 44 kB 00:00 2024-04-26T11:10:45.531 INFO:teuthology.orchestra.run.smithi082.stdout:(77/137): pcre2-devel-10.32-3.el8.x86_64.rpm 5.5 MB/s | 605 kB 00:00 2024-04-26T11:10:45.626 INFO:teuthology.orchestra.run.smithi082.stdout:(78/137): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.4 MB/s | 229 kB 00:00 2024-04-26T11:10:45.690 INFO:teuthology.orchestra.run.smithi082.stdout:(79/137): pcre2-utf32-10.32-3.el8.x86_64.rpm 3.4 MB/s | 220 kB 00:00 2024-04-26T11:10:45.721 INFO:teuthology.orchestra.run.smithi122.stdout:(10/137): ceph-osd-18.2.2-1256.gdc093b5e.el8.x8 3.5 MB/s | 18 MB 00:05 2024-04-26T11:10:45.749 INFO:teuthology.orchestra.run.smithi082.stdout:(80/137): python3-cffi-1.11.5-6.el8.x86_64.rpm 4.2 MB/s | 249 kB 00:00 2024-04-26T11:10:45.780 INFO:teuthology.orchestra.run.smithi122.stdout:(11/137): libcephfs-devel-18.2.2-1256.gdc093b5e 534 kB/s | 31 kB 00:00 2024-04-26T11:10:45.821 INFO:teuthology.orchestra.run.smithi072.stdout:(36/137): automake-1.16.1-8.el8.noarch.rpm 1.2 MB/s | 740 kB 00:00 2024-04-26T11:10:45.849 INFO:teuthology.orchestra.run.smithi082.stdout:(81/137): python3-cryptography-3.2.1-7.el8.x86_ 6.3 MB/s | 641 kB 00:00 2024-04-26T11:10:45.854 INFO:teuthology.orchestra.run.smithi072.stdout:(37/137): bison-3.0.4-10.el8.x86_64.rpm 1.1 MB/s | 688 kB 00:00 2024-04-26T11:10:45.932 INFO:teuthology.orchestra.run.smithi082.stdout:(82/137): python3-jwt-1.6.1-2.el8.noarch.rpm 513 kB/s | 43 kB 00:00 2024-04-26T11:10:45.980 INFO:teuthology.orchestra.run.smithi122.stdout:(12/137): libcephfs2-18.2.2-1256.gdc093b5e.el8. 3.8 MB/s | 781 kB 00:00 2024-04-26T11:10:45.982 INFO:teuthology.orchestra.run.smithi082.stdout:(83/137): openssl-devel-1.1.1k-12.el8.x86_64.rp 5.4 MB/s | 3.2 MB 00:00 2024-04-26T11:10:46.008 INFO:teuthology.orchestra.run.smithi082.stdout:(84/137): python3-oauthlib-2.1.0-1.el8.noarch.r 2.0 MB/s | 155 kB 00:00 2024-04-26T11:10:46.042 INFO:teuthology.orchestra.run.smithi082.stdout:(85/137): python3-pycparser-2.14-14.el8.noarch. 1.8 MB/s | 109 kB 00:00 2024-04-26T11:10:46.053 INFO:teuthology.orchestra.run.smithi122.stdout:(13/137): libcephsqlite-18.2.2-1256.gdc093b5e.e 1.9 MB/s | 142 kB 00:00 2024-04-26T11:10:46.075 INFO:teuthology.orchestra.run.smithi082.stdout:(86/137): python3-requests-oauthlib-1.0.0-1.el8 638 kB/s | 43 kB 00:00 2024-04-26T11:10:46.101 INFO:teuthology.orchestra.run.smithi082.stdout:(87/137): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.2 MB/s | 74 kB 00:00 2024-04-26T11:10:46.105 INFO:teuthology.orchestra.run.smithi072.stdout:(38/137): ceph-mgr-diskprediction-local-18.2.2- 4.8 MB/s | 7.4 MB 00:01 2024-04-26T11:10:46.122 INFO:teuthology.orchestra.run.smithi122.stdout:(14/137): librados-devel-18.2.2-1256.gdc093b5e. 2.0 MB/s | 139 kB 00:00 2024-04-26T11:10:46.134 INFO:teuthology.orchestra.run.smithi082.stdout:(88/137): zlib-devel-1.2.11-21.el8.x86_64.rpm 988 kB/s | 58 kB 00:00 2024-04-26T11:10:46.139 INFO:teuthology.orchestra.run.smithi072.stdout:(39/137): flex-2.6.1-9.el8.x86_64.rpm 1.0 MB/s | 320 kB 00:00 2024-04-26T11:10:46.165 INFO:teuthology.orchestra.run.smithi072.stdout:(40/137): jq-1.6-8.el8.x86_64.rpm 655 kB/s | 203 kB 00:00 2024-04-26T11:10:46.273 INFO:teuthology.orchestra.run.smithi122.stdout:(15/137): libradosstriper1-18.2.2-1256.gdc093b5 3.1 MB/s | 474 kB 00:00 2024-04-26T11:10:46.293 INFO:teuthology.orchestra.run.smithi082.stdout:(89/137): python3-packaging-16.8-9.el8.noarch.r 251 kB/s | 48 kB 00:00 2024-04-26T11:10:46.350 INFO:teuthology.orchestra.run.smithi072.stdout:(41/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.4 MB/s | 259 kB 00:00 2024-04-26T11:10:46.410 INFO:teuthology.orchestra.run.smithi082.stdout:(90/137): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2024-04-26T11:10:46.434 INFO:teuthology.orchestra.run.smithi072.stdout:(42/137): libtool-2.4.6-25.el8.x86_64.rpm 2.3 MB/s | 709 kB 00:00 2024-04-26T11:10:46.469 INFO:teuthology.orchestra.run.smithi082.stdout:(91/137): liboath-2.6.2-3.el8.x86_64.rpm 335 kB/s | 59 kB 00:00 2024-04-26T11:10:46.494 INFO:teuthology.orchestra.run.smithi082.stdout:(92/137): libunwind-1.3.1-3.el8.x86_64.rpm 895 kB/s | 75 kB 00:00 2024-04-26T11:10:46.553 INFO:teuthology.orchestra.run.smithi082.stdout:(93/137): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 747 kB/s | 44 kB 00:00 2024-04-26T11:10:46.568 INFO:teuthology.orchestra.run.smithi072.stdout:(43/137): librdkafka-1.6.1-1.el8.x86_64.rpm 1.4 MB/s | 677 kB 00:00 2024-04-26T11:10:46.593 INFO:teuthology.orchestra.run.smithi072.stdout:(44/137): oniguruma-6.8.2-3.el8.x86_64.rpm 774 kB/s | 188 kB 00:00 2024-04-26T11:10:46.636 INFO:teuthology.orchestra.run.smithi082.stdout:(94/137): python3-beautifulsoup4-4.6.3-2.el8.1. 2.2 MB/s | 185 kB 00:00 2024-04-26T11:10:46.715 INFO:teuthology.orchestra.run.smithi082.stdout:(95/137): python3-asyncssh-2.7.0-2.el8.noarch.r 1.9 MB/s | 476 kB 00:00 2024-04-26T11:10:46.745 INFO:teuthology.orchestra.run.smithi082.stdout:(96/137): python3-cachetools-3.1.1-4.el8.noarch 304 kB/s | 33 kB 00:00 2024-04-26T11:10:46.779 INFO:teuthology.orchestra.run.smithi082.stdout:(97/137): python3-certifi-2018.10.15-7.el8.noar 258 kB/s | 16 kB 00:00 2024-04-26T11:10:46.788 INFO:teuthology.orchestra.run.smithi029.stdout:(8/137): ceph-common-18.2.2-1256.gdc093b5e.el8. 1.7 MB/s | 22 MB 00:12 2024-04-26T11:10:46.838 INFO:teuthology.orchestra.run.smithi082.stdout:(98/137): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2024-04-26T11:10:46.838 INFO:teuthology.orchestra.run.smithi029.stdout:(9/137): ceph-selinux-18.2.2-1256.gdc093b5e.el8 487 kB/s | 24 kB 00:00 2024-04-26T11:10:46.896 INFO:teuthology.orchestra.run.smithi082.stdout:(99/137): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2024-04-26T11:10:46.947 INFO:teuthology.orchestra.run.smithi082.stdout:(100/137): python3-jaraco-6.2-6.el8.noarch.rpm 222 kB/s | 11 kB 00:00 2024-04-26T11:10:46.994 INFO:teuthology.orchestra.run.smithi072.stdout:(45/137): openblas-threads-0.3.15-4.el8.x86_64. 11 MB/s | 4.9 MB 00:00 2024-04-26T11:10:47.002 INFO:teuthology.orchestra.run.smithi082.stdout:(101/137): python3-cherrypy-18.4.0-1.el8.noarch 1.7 MB/s | 384 kB 00:00 2024-04-26T11:10:47.031 INFO:teuthology.orchestra.run.smithi082.stdout:(102/137): python3-jaraco-functools-2.0-4.el8.n 210 kB/s | 18 kB 00:00 2024-04-26T11:10:47.086 INFO:teuthology.orchestra.run.smithi072.stdout:(46/137): python3-jinja2-2.10.1-4.el8.noarch.rp 6.2 MB/s | 578 kB 00:00 2024-04-26T11:10:47.089 INFO:teuthology.orchestra.run.smithi082.stdout:(103/137): python3-logutils-0.3.5-11.el8.noarch 834 kB/s | 49 kB 00:00 2024-04-26T11:10:47.148 INFO:teuthology.orchestra.run.smithi082.stdout:(104/137): python3-more-itertools-7.2.0-3.el8.n 1.0 MB/s | 59 kB 00:00 2024-04-26T11:10:47.170 INFO:teuthology.orchestra.run.smithi072.stdout:(47/137): python3-jsonpatch-1.21-2.el8.noarch.r 318 kB/s | 27 kB 00:00 2024-04-26T11:10:47.206 INFO:teuthology.orchestra.run.smithi082.stdout:(105/137): python3-natsort-7.1.1-2.el8.noarch.r 1.0 MB/s | 60 kB 00:00 2024-04-26T11:10:47.279 INFO:teuthology.orchestra.run.smithi072.stdout:(48/137): python3-jsonpointer-1.10-11.el8.noarc 184 kB/s | 20 kB 00:00 2024-04-26T11:10:47.314 INFO:teuthology.orchestra.run.smithi122.stdout:(16/137): librgw2-18.2.2-1256.gdc093b5e.el8.x86 6.3 MB/s | 6.6 MB 00:01 2024-04-26T11:10:47.315 INFO:teuthology.orchestra.run.smithi082.stdout:(106/137): python3-pecan-1.3.2-9.el8.noarch.rpm 2.6 MB/s | 283 kB 00:00 2024-04-26T11:10:47.349 INFO:teuthology.orchestra.run.smithi082.stdout:(107/137): python3-kubernetes-11.0.0-6.el8.noar 3.4 MB/s | 1.2 MB 00:00 2024-04-26T11:10:47.354 INFO:teuthology.orchestra.run.smithi072.stdout:(49/137): python3-mako-1.0.6-14.el8.noarch.rpm 2.0 MB/s | 157 kB 00:00 2024-04-26T11:10:47.374 INFO:teuthology.orchestra.run.smithi082.stdout:(108/137): python3-portend-2.6-1.el8.noarch.rpm 266 kB/s | 16 kB 00:00 2024-04-26T11:10:47.381 INFO:teuthology.orchestra.run.smithi122.stdout:(17/137): python3-ceph-argparse-18.2.2-1256.gdc 673 kB/s | 45 kB 00:00 2024-04-26T11:10:47.399 INFO:teuthology.orchestra.run.smithi082.stdout:(109/137): python3-repoze-lru-0.7-6.el8.noarch. 672 kB/s | 34 kB 00:00 2024-04-26T11:10:47.438 INFO:teuthology.orchestra.run.smithi072.stdout:(50/137): python3-markupsafe-0.23-19.el8.x86_64 464 kB/s | 39 kB 00:00 2024-04-26T11:10:47.440 INFO:teuthology.orchestra.run.smithi122.stdout:(18/137): python3-ceph-common-18.2.2-1256.gdc09 2.2 MB/s | 129 kB 00:00 2024-04-26T11:10:47.449 INFO:teuthology.orchestra.run.smithi082.stdout:(110/137): python3-routes-2.4.1-12.el8.noarch.r 2.6 MB/s | 196 kB 00:00 2024-04-26T11:10:47.467 INFO:teuthology.orchestra.run.smithi082.stdout:(111/137): python3-rsa-4.9-2.el8.noarch.rpm 960 kB/s | 64 kB 00:00 2024-04-26T11:10:47.492 INFO:teuthology.orchestra.run.smithi082.stdout:(112/137): python3-simplegeneric-0.8.1-17.el8.n 447 kB/s | 19 kB 00:00 2024-04-26T11:10:47.515 INFO:teuthology.orchestra.run.smithi122.stdout:(19/137): python3-cephfs-18.2.2-1256.gdc093b5e. 2.6 MB/s | 197 kB 00:00 2024-04-26T11:10:47.559 INFO:teuthology.orchestra.run.smithi082.stdout:(113/137): python3-singledispatch-3.4.0.3-18.el 259 kB/s | 24 kB 00:00 2024-04-26T11:10:47.584 INFO:teuthology.orchestra.run.smithi082.stdout:(114/137): python3-tempora-1.14.1-5.el8.noarch. 318 kB/s | 29 kB 00:00 2024-04-26T11:10:47.601 INFO:teuthology.orchestra.run.smithi082.stdout:(115/137): python3-trustme-0.6.0-4.el8.noarch.r 663 kB/s | 27 kB 00:00 2024-04-26T11:10:47.647 INFO:teuthology.orchestra.run.smithi122.stdout:(20/137): python3-rados-18.2.2-1256.gdc093b5e.e 2.8 MB/s | 371 kB 00:00 2024-04-26T11:10:47.676 INFO:teuthology.orchestra.run.smithi082.stdout:(116/137): python3-waitress-1.4.3-1.el8.noarch. 2.7 MB/s | 255 kB 00:00 2024-04-26T11:10:47.702 INFO:teuthology.orchestra.run.smithi082.stdout:(117/137): python3-webob-1.8.5-1.el8.1.noarch.r 2.4 MB/s | 251 kB 00:00 2024-04-26T11:10:47.724 INFO:teuthology.orchestra.run.smithi122.stdout:(21/137): python3-rbd-18.2.2-1256.gdc093b5e.el8 4.6 MB/s | 364 kB 00:00 2024-04-26T11:10:47.727 INFO:teuthology.orchestra.run.smithi082.stdout:(118/137): python3-websocket-client-0.56.0-5.el 1.2 MB/s | 61 kB 00:00 2024-04-26T11:10:47.753 INFO:teuthology.orchestra.run.smithi082.stdout:(119/137): python3-webtest-2.0.33-1.el8.noarch. 1.7 MB/s | 85 kB 00:00 2024-04-26T11:10:47.774 INFO:teuthology.orchestra.run.smithi122.stdout:(22/137): python3-rgw-18.2.2-1256.gdc093b5e.el8 2.1 MB/s | 107 kB 00:00 2024-04-26T11:10:47.778 INFO:teuthology.orchestra.run.smithi082.stdout:(120/137): python3-zc-lockfile-2.0-2.el8.noarch 459 kB/s | 23 kB 00:00 2024-04-26T11:10:47.825 INFO:teuthology.orchestra.run.smithi122.stdout:(23/137): rbd-fuse-18.2.2-1256.gdc093b5e.el8.x8 1.9 MB/s | 95 kB 00:00 2024-04-26T11:10:47.840 INFO:teuthology.orchestra.run.smithi029.stdout:(10/137): ceph-radosgw-18.2.2-1256.gdc093b5e.el 3.6 MB/s | 13 MB 00:03 2024-04-26T11:10:47.864 INFO:teuthology.orchestra.run.smithi072.stdout:(51/137): openblas-0.3.15-4.el8.x86_64.rpm 3.3 MB/s | 4.7 MB 00:01 2024-04-26T11:10:47.899 INFO:teuthology.orchestra.run.smithi029.stdout:(11/137): libcephfs-devel-18.2.2-1256.gdc093b5e 530 kB/s | 31 kB 00:00 2024-04-26T11:10:47.948 INFO:teuthology.orchestra.run.smithi072.stdout:(52/137): python3-numpy-1.14.3-10.el8.x86_64.rp 7.3 MB/s | 3.7 MB 00:00 2024-04-26T11:10:47.983 INFO:teuthology.orchestra.run.smithi122.stdout:(24/137): ceph-radosgw-18.2.2-1256.gdc093b5e.el 2.2 MB/s | 13 MB 00:05 2024-04-26T11:10:47.995 INFO:teuthology.orchestra.run.smithi082.stdout:(121/137): thrift-0.13.0-2.el8.x86_64.rpm 7.2 MB/s | 1.7 MB 00:00 2024-04-26T11:10:48.040 INFO:teuthology.orchestra.run.smithi072.stdout:(53/137): python3-babel-2.5.1-7.el8.noarch.rpm 3.3 MB/s | 4.8 MB 00:01 2024-04-26T11:10:48.058 INFO:teuthology.orchestra.run.smithi072.stdout:(54/137): python3-prettytable-0.7.2-14.el8.noar 403 kB/s | 44 kB 00:00 2024-04-26T11:10:48.075 INFO:teuthology.orchestra.run.smithi122.stdout:(25/137): rbd-nbd-18.2.2-1256.gdc093b5e.el8.x86 1.9 MB/s | 181 kB 00:00 2024-04-26T11:10:48.091 INFO:teuthology.orchestra.run.smithi072.stdout:(55/137): python3-numpy-f2py-1.14.3-10.el8.x86_ 993 kB/s | 225 kB 00:00 2024-04-26T11:10:48.119 INFO:teuthology.orchestra.run.smithi072.stdout:(56/137): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.3 MB/s | 103 kB 00:00 2024-04-26T11:10:48.144 INFO:teuthology.orchestra.run.smithi072.stdout:(57/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.4 MB/s | 126 kB 00:00 2024-04-26T11:10:48.150 INFO:teuthology.orchestra.run.smithi122.stdout:(26/137): ceph-grafana-dashboards-18.2.2-1256.g 325 kB/s | 24 kB 00:00 2024-04-26T11:10:48.166 INFO:teuthology.orchestra.run.smithi029.stdout:(12/137): libcephfs2-18.2.2-1256.gdc093b5e.el8. 2.9 MB/s | 781 kB 00:00 2024-04-26T11:10:48.170 INFO:teuthology.orchestra.run.smithi072.stdout:(58/137): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2024-04-26T11:10:48.195 INFO:teuthology.orchestra.run.smithi072.stdout:(59/137): python3-pytz-2017.2-11.el8.noarch.rpm 747 kB/s | 57 kB 00:00 2024-04-26T11:10:48.234 INFO:teuthology.orchestra.run.smithi122.stdout:(27/137): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 1.6 MB/s | 138 kB 00:00 2024-04-26T11:10:48.267 INFO:teuthology.orchestra.run.smithi029.stdout:(13/137): libcephsqlite-18.2.2-1256.gdc093b5e.e 1.4 MB/s | 142 kB 00:00 2024-04-26T11:10:48.279 INFO:teuthology.orchestra.run.smithi072.stdout:(60/137): socat-1.7.4.1-1.el8.x86_64.rpm 3.8 MB/s | 323 kB 00:00 2024-04-26T11:10:48.330 INFO:teuthology.orchestra.run.smithi072.stdout:(61/137): python3-werkzeug-0.12.2-4.el8.noarch. 2.8 MB/s | 457 kB 00:00 2024-04-26T11:10:48.342 INFO:teuthology.orchestra.run.smithi029.stdout:(14/137): librados-devel-18.2.2-1256.gdc093b5e. 1.8 MB/s | 139 kB 00:00 2024-04-26T11:10:48.355 INFO:teuthology.orchestra.run.smithi072.stdout:(62/137): xmlstarlet-1.6.1-20.el8.x86_64.rpm 930 kB/s | 71 kB 00:00 2024-04-26T11:10:48.493 INFO:teuthology.orchestra.run.smithi122.stdout:(28/137): rbd-mirror-18.2.2-1256.gdc093b5e.el8. 5.2 MB/s | 3.5 MB 00:00 2024-04-26T11:10:48.496 INFO:teuthology.orchestra.run.smithi082.stdout:(122/137): ceph-test-18.2.2-1256.gdc093b5e.el8. 3.6 MB/s | 47 MB 00:13 2024-04-26T11:10:48.506 INFO:teuthology.orchestra.run.smithi072.stdout:(63/137): elfutils-libelf-devel-0.190-2.el8.x86 354 kB/s | 62 kB 00:00 2024-04-26T11:10:48.518 INFO:teuthology.orchestra.run.smithi029.stdout:(15/137): libradosstriper1-18.2.2-1256.gdc093b5 2.6 MB/s | 474 kB 00:00 2024-04-26T11:10:48.532 INFO:teuthology.orchestra.run.smithi072.stdout:(64/137): fuse-2.9.7-19.el8.x86_64.rpm 473 kB/s | 83 kB 00:00 2024-04-26T11:10:48.566 INFO:teuthology.orchestra.run.smithi072.stdout:(65/137): keyutils-libs-devel-1.5.10-9.el8.x86_ 811 kB/s | 48 kB 00:00 2024-04-26T11:10:48.624 INFO:teuthology.orchestra.run.smithi072.stdout:(66/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 319 kB/s | 19 kB 00:00 2024-04-26T11:10:48.647 INFO:teuthology.orchestra.run.smithi082.stdout:(123/137): elfutils-debuginfod-client-0.190-2.e 509 kB/s | 77 kB 00:00 2024-04-26T11:10:48.700 INFO:teuthology.orchestra.run.smithi072.stdout:(67/137): libcom_err-devel-1.45.6-5.el8.x86_64. 515 kB/s | 39 kB 00:00 2024-04-26T11:10:48.813 INFO:teuthology.orchestra.run.smithi082.stdout:(124/137): elfutils-libelf-0.190-2.el8.x86_64.r 1.4 MB/s | 233 kB 00:00 2024-04-26T11:10:48.868 INFO:teuthology.orchestra.run.smithi072.stdout:(68/137): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.6 MB/s | 561 kB 00:00 2024-04-26T11:10:48.880 INFO:teuthology.orchestra.run.smithi082.stdout:(125/137): librbd1-18.2.2-1256.gdc093b5e.el8.x8 4.0 MB/s | 3.6 MB 00:00 2024-04-26T11:10:48.946 INFO:teuthology.orchestra.run.smithi082.stdout:(126/137): elfutils-libs-0.190-2.el8.x86_64.rpm 2.2 MB/s | 305 kB 00:00 2024-04-26T11:10:49.014 INFO:teuthology.orchestra.run.smithi082.stdout:(127/137): libfdisk-2.32.1-46.el8.x86_64.rpm 3.7 MB/s | 254 kB 00:00 2024-04-26T11:10:49.072 INFO:teuthology.orchestra.run.smithi082.stdout:(128/137): libblkid-2.32.1-46.el8.x86_64.rpm 1.1 MB/s | 221 kB 00:00 2024-04-26T11:10:49.106 INFO:teuthology.orchestra.run.smithi082.stdout:(129/137): libmount-2.32.1-46.el8.x86_64.rpm 2.5 MB/s | 237 kB 00:00 2024-04-26T11:10:49.109 INFO:teuthology.orchestra.run.smithi072.stdout:(69/137): python3-scipy-1.0.0-21.module_el8+762 15 MB/s | 14 MB 00:00 2024-04-26T11:10:49.131 INFO:teuthology.orchestra.run.smithi082.stdout:(130/137): libsmartcols-2.32.1-46.el8.x86_64.rp 3.0 MB/s | 180 kB 00:00 2024-04-26T11:10:49.137 INFO:teuthology.orchestra.run.smithi072.stdout:(70/137): libquadmath-8.5.0-22.el8.x86_64.rpm 642 kB/s | 172 kB 00:00 2024-04-26T11:10:49.183 INFO:teuthology.orchestra.run.smithi122.stdout:(29/137): ceph-mgr-dashboard-18.2.2-1256.gdc093 3.7 MB/s | 3.5 MB 00:00 2024-04-26T11:10:49.197 INFO:teuthology.orchestra.run.smithi082.stdout:(131/137): libuuid-2.32.1-46.el8.x86_64.rpm 1.1 MB/s | 99 kB 00:00 2024-04-26T11:10:49.237 INFO:teuthology.orchestra.run.smithi072.stdout:(71/137): libselinux-devel-2.9-8.el8.x86_64.rpm 2.0 MB/s | 200 kB 00:00 2024-04-26T11:10:49.271 INFO:teuthology.orchestra.run.smithi072.stdout:(72/137): libgfortran-8.5.0-22.el8.x86_64.rpm 1.1 MB/s | 645 kB 00:00 2024-04-26T11:10:49.277 INFO:teuthology.orchestra.run.smithi122.stdout:(30/137): ceph-mgr-modules-core-18.2.2-1256.gdc 2.6 MB/s | 246 kB 00:00 2024-04-26T11:10:49.296 INFO:teuthology.orchestra.run.smithi072.stdout:(73/137): librabbitmq-0.9.0-5.el8.x86_64.rpm 252 kB/s | 47 kB 00:00 2024-04-26T11:10:49.315 INFO:teuthology.orchestra.run.smithi082.stdout:(132/137): openssl-1.1.1k-12.el8.x86_64.rpm 3.9 MB/s | 738 kB 00:00 2024-04-26T11:10:49.322 INFO:teuthology.orchestra.run.smithi072.stdout:(74/137): libsepol-devel-2.9-3.el8.x86_64.rpm 1.0 MB/s | 87 kB 00:00 2024-04-26T11:10:49.344 INFO:teuthology.orchestra.run.smithi122.stdout:(31/137): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 741 kB/s | 49 kB 00:00 2024-04-26T11:10:49.356 INFO:teuthology.orchestra.run.smithi072.stdout:(75/137): libverto-devel-0.3.2-2.el8.x86_64.rpm 305 kB/s | 18 kB 00:00 2024-04-26T11:10:49.381 INFO:teuthology.orchestra.run.smithi072.stdout:(76/137): libuuid-devel-2.32.1-46.el8.x86_64.rp 911 kB/s | 100 kB 00:00 2024-04-26T11:10:49.382 INFO:teuthology.orchestra.run.smithi082.stdout:(133/137): openssl-libs-1.1.1k-12.el8.x86_64.rp 8.0 MB/s | 1.5 MB 00:00 2024-04-26T11:10:49.403 INFO:teuthology.orchestra.run.smithi122.stdout:(32/137): ceph-prometheus-alerts-18.2.2-1256.gd 260 kB/s | 15 kB 00:00 2024-04-26T11:10:49.406 INFO:teuthology.orchestra.run.smithi072.stdout:(77/137): libzstd-devel-1.4.4-1.el8.x86_64.rpm 520 kB/s | 44 kB 00:00 2024-04-26T11:10:49.441 INFO:teuthology.orchestra.run.smithi082.stdout:(134/137): util-linux-user-2.32.1-46.el8.x86_64 1.7 MB/s | 103 kB 00:00 2024-04-26T11:10:49.468 INFO:teuthology.orchestra.run.smithi029.stdout:(16/137): ceph-osd-18.2.2-1256.gdc093b5e.el8.x8 2.4 MB/s | 18 MB 00:07 2024-04-26T11:10:49.494 INFO:teuthology.orchestra.run.smithi122.stdout:(33/137): ceph-volume-18.2.2-1256.gdc093b5e.el8 2.8 MB/s | 263 kB 00:00 2024-04-26T11:10:49.507 INFO:teuthology.orchestra.run.smithi072.stdout:(78/137): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.2 MB/s | 229 kB 00:00 2024-04-26T11:10:49.544 INFO:teuthology.orchestra.run.smithi029.stdout:(17/137): python3-ceph-argparse-18.2.2-1256.gdc 596 kB/s | 45 kB 00:00 2024-04-26T11:10:49.586 INFO:teuthology.orchestra.run.smithi122.stdout:(34/137): cephadm-18.2.2-1256.gdc093b5e.el8.noa 1.8 MB/s | 173 kB 00:00 2024-04-26T11:10:49.636 INFO:teuthology.orchestra.run.smithi029.stdout:(18/137): python3-ceph-common-18.2.2-1256.gdc09 1.4 MB/s | 129 kB 00:00 2024-04-26T11:10:49.649 INFO:teuthology.orchestra.run.smithi082.stdout:(135/137): util-linux-2.32.1-46.el8.x86_64.rpm 7.8 MB/s | 2.6 MB 00:00 2024-04-26T11:10:49.696 INFO:teuthology.orchestra.run.smithi072.stdout:(79/137): pcre2-devel-10.32-3.el8.x86_64.rpm 1.9 MB/s | 605 kB 00:00 2024-04-26T11:10:49.720 INFO:teuthology.orchestra.run.smithi029.stdout:(19/137): python3-cephfs-18.2.2-1256.gdc093b5e. 2.3 MB/s | 197 kB 00:00 2024-04-26T11:10:49.758 INFO:teuthology.orchestra.run.smithi072.stdout:(80/137): pcre2-utf32-10.32-3.el8.x86_64.rpm 879 kB/s | 220 kB 00:00 2024-04-26T11:10:49.774 INFO:teuthology.orchestra.run.smithi082.stdout:(136/137): xfsprogs-5.0.0-12.el8.x86_64.rpm 3.2 MB/s | 1.1 MB 00:00 2024-04-26T11:10:49.804 INFO:teuthology.orchestra.run.smithi122.stdout:(35/137): ceph-mgr-diskprediction-local-18.2.2- 5.6 MB/s | 7.4 MB 00:01 2024-04-26T11:10:49.837 INFO:teuthology.orchestra.run.smithi029.stdout:(20/137): python3-rados-18.2.2-1256.gdc093b5e.e 3.1 MB/s | 371 kB 00:00 2024-04-26T11:10:49.867 INFO:teuthology.orchestra.run.smithi072.stdout:(81/137): openssl-devel-1.1.1k-12.el8.x86_64.rp 6.2 MB/s | 3.2 MB 00:00 2024-04-26T11:10:49.892 INFO:teuthology.orchestra.run.smithi072.stdout:(82/137): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.2 MB/s | 249 kB 00:00 2024-04-26T11:10:49.935 INFO:teuthology.orchestra.run.smithi072.stdout:(83/137): python3-jwt-1.6.1-2.el8.noarch.rpm 634 kB/s | 43 kB 00:00 2024-04-26T11:10:49.954 INFO:teuthology.orchestra.run.smithi029.stdout:(21/137): python3-rbd-18.2.2-1256.gdc093b5e.el8 3.0 MB/s | 364 kB 00:00 2024-04-26T11:10:49.968 INFO:teuthology.orchestra.run.smithi072.stdout:(84/137): python3-oauthlib-2.1.0-1.el8.noarch.r 2.0 MB/s | 155 kB 00:00 2024-04-26T11:10:49.987 INFO:teuthology.orchestra.run.smithi122.stdout:(36/137): automake-1.16.1-8.el8.noarch.rpm 1.8 MB/s | 740 kB 00:00 2024-04-26T11:10:50.002 INFO:teuthology.orchestra.run.smithi072.stdout:(85/137): python3-pycparser-2.14-14.el8.noarch. 1.6 MB/s | 109 kB 00:00 2024-04-26T11:10:50.038 INFO:teuthology.orchestra.run.smithi029.stdout:(22/137): python3-rgw-18.2.2-1256.gdc093b5e.el8 1.3 MB/s | 107 kB 00:00 2024-04-26T11:10:50.045 INFO:teuthology.orchestra.run.smithi072.stdout:(86/137): python3-requests-oauthlib-1.0.0-1.el8 565 kB/s | 43 kB 00:00 2024-04-26T11:10:50.080 INFO:teuthology.orchestra.run.smithi072.stdout:(87/137): python3-cryptography-3.2.1-7.el8.x86_ 1.9 MB/s | 641 kB 00:00 2024-04-26T11:10:50.087 INFO:teuthology.orchestra.run.smithi122.stdout:(37/137): flex-2.6.1-9.el8.x86_64.rpm 3.1 MB/s | 320 kB 00:00 2024-04-26T11:10:50.105 INFO:teuthology.orchestra.run.smithi072.stdout:(88/137): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 725 kB/s | 74 kB 00:00 2024-04-26T11:10:50.131 INFO:teuthology.orchestra.run.smithi072.stdout:(89/137): zlib-devel-1.2.11-21.el8.x86_64.rpm 671 kB/s | 58 kB 00:00 2024-04-26T11:10:50.188 INFO:teuthology.orchestra.run.smithi122.stdout:(38/137): jq-1.6-8.el8.x86_64.rpm 2.0 MB/s | 203 kB 00:00 2024-04-26T11:10:50.224 INFO:teuthology.orchestra.run.smithi029.stdout:(23/137): librgw2-18.2.2-1256.gdc093b5e.el8.x86 3.8 MB/s | 6.6 MB 00:01 2024-04-26T11:10:50.257 INFO:teuthology.orchestra.run.smithi072.stdout:(90/137): liboath-2.6.2-3.el8.x86_64.rpm 469 kB/s | 59 kB 00:00 2024-04-26T11:10:50.258 INFO:teuthology.orchestra.run.smithi029.stdout:(24/137): rbd-fuse-18.2.2-1256.gdc093b5e.el8.x8 434 kB/s | 95 kB 00:00 2024-04-26T11:10:50.324 INFO:teuthology.orchestra.run.smithi072.stdout:(91/137): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2024-04-26T11:10:50.349 INFO:teuthology.orchestra.run.smithi072.stdout:(92/137): libunwind-1.3.1-3.el8.x86_64.rpm 814 kB/s | 75 kB 00:00 2024-04-26T11:10:50.358 INFO:teuthology.orchestra.run.smithi029.stdout:(25/137): rbd-nbd-18.2.2-1256.gdc093b5e.el8.x86 1.8 MB/s | 181 kB 00:00 2024-04-26T11:10:50.383 INFO:teuthology.orchestra.run.smithi072.stdout:(93/137): python3-packaging-16.8-9.el8.noarch.r 159 kB/s | 48 kB 00:00 2024-04-26T11:10:50.409 INFO:teuthology.orchestra.run.smithi072.stdout:(94/137): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 740 kB/s | 44 kB 00:00 2024-04-26T11:10:50.442 INFO:teuthology.orchestra.run.smithi029.stdout:(26/137): ceph-grafana-dashboards-18.2.2-1256.g 291 kB/s | 24 kB 00:00 2024-04-26T11:10:50.443 INFO:teuthology.orchestra.run.smithi072.stdout:(95/137): python3-asyncssh-2.7.0-2.el8.noarch.r 3.9 MB/s | 476 kB 00:00 2024-04-26T11:10:50.468 INFO:teuthology.orchestra.run.smithi072.stdout:(96/137): python3-cachetools-3.1.1-4.el8.noarch 558 kB/s | 33 kB 00:00 2024-04-26T11:10:50.474 INFO:teuthology.orchestra.run.smithi082.stdout:(137/137): librados2-18.2.2-1256.gdc093b5e.el8. 1.4 MB/s | 3.7 MB 00:02 2024-04-26T11:10:50.479 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-04-26T11:10:50.479 INFO:teuthology.orchestra.run.smithi082.stdout:Total 11 MB/s | 207 MB 00:18 2024-04-26T11:10:50.494 INFO:teuthology.orchestra.run.smithi072.stdout:(97/137): python3-certifi-2018.10.15-7.el8.noar 321 kB/s | 16 kB 00:00 2024-04-26T11:10:50.543 INFO:teuthology.orchestra.run.smithi029.stdout:(27/137): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 1.3 MB/s | 138 kB 00:00 2024-04-26T11:10:50.553 INFO:teuthology.orchestra.run.smithi072.stdout:(98/137): python3-beautifulsoup4-4.6.3-2.el8.1. 1.1 MB/s | 185 kB 00:00 2024-04-26T11:10:50.587 INFO:teuthology.orchestra.run.smithi072.stdout:(99/137): python3-cheroot-8.5.2-1.el8.noarch.rp 1.4 MB/s | 173 kB 00:00 2024-04-26T11:10:50.612 INFO:teuthology.orchestra.run.smithi072.stdout:(100/137): python3-cherrypy-18.4.0-1.el8.noarch 3.2 MB/s | 384 kB 00:00 2024-04-26T11:10:50.629 INFO:teuthology.orchestra.run.smithi072.stdout:(101/137): python3-google-auth-1.1.1-10.el8.noa 1.0 MB/s | 81 kB 00:00 2024-04-26T11:10:50.656 INFO:teuthology.orchestra.run.smithi072.stdout:(102/137): python3-jaraco-6.2-6.el8.noarch.rpm 160 kB/s | 11 kB 00:00 2024-04-26T11:10:50.663 INFO:teuthology.orchestra.run.smithi122.stdout:(39/137): bison-3.0.4-10.el8.x86_64.rpm 802 kB/s | 688 kB 00:00 2024-04-26T11:10:50.682 INFO:teuthology.orchestra.run.smithi072.stdout:(103/137): python3-jaraco-functools-2.0-4.el8.n 336 kB/s | 18 kB 00:00 2024-04-26T11:10:50.708 INFO:teuthology.orchestra.run.smithi072.stdout:(104/137): python3-logutils-0.3.5-11.el8.noarch 962 kB/s | 49 kB 00:00 2024-04-26T11:10:50.733 INFO:teuthology.orchestra.run.smithi072.stdout:(105/137): python3-more-itertools-7.2.0-3.el8.n 1.1 MB/s | 59 kB 00:00 2024-04-26T11:10:50.759 INFO:teuthology.orchestra.run.smithi072.stdout:(106/137): python3-natsort-7.1.1-2.el8.noarch.r 1.2 MB/s | 60 kB 00:00 2024-04-26T11:10:50.769 INFO:teuthology.orchestra.run.smithi029.stdout:(28/137): rbd-mirror-18.2.2-1256.gdc093b5e.el8. 6.3 MB/s | 3.5 MB 00:00 2024-04-26T11:10:50.809 INFO:teuthology.orchestra.run.smithi072.stdout:(107/137): python3-kubernetes-11.0.0-6.el8.noar 6.5 MB/s | 1.2 MB 00:00 2024-04-26T11:10:50.836 INFO:teuthology.orchestra.run.smithi072.stdout:(108/137): python3-portend-2.6-1.el8.noarch.rpm 206 kB/s | 16 kB 00:00 2024-04-26T11:10:50.860 INFO:teuthology.orchestra.run.smithi072.stdout:(109/137): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2024-04-26T11:10:50.919 INFO:teuthology.orchestra.run.smithi072.stdout:(110/137): python3-repoze-lru-0.7-6.el8.noarch. 307 kB/s | 34 kB 00:00 2024-04-26T11:10:50.945 INFO:teuthology.orchestra.run.smithi072.stdout:(111/137): python3-rsa-4.9-2.el8.noarch.rpm 766 kB/s | 64 kB 00:00 2024-04-26T11:10:50.970 INFO:teuthology.orchestra.run.smithi072.stdout:(112/137): python3-simplegeneric-0.8.1-17.el8.n 369 kB/s | 19 kB 00:00 2024-04-26T11:10:50.996 INFO:teuthology.orchestra.run.smithi072.stdout:(113/137): python3-singledispatch-3.4.0.3-18.el 473 kB/s | 24 kB 00:00 2024-04-26T11:10:51.014 INFO:teuthology.orchestra.run.smithi122.stdout:(40/137): librdkafka-1.6.1-1.el8.x86_64.rpm 820 kB/s | 677 kB 00:00 2024-04-26T11:10:51.021 INFO:teuthology.orchestra.run.smithi072.stdout:(114/137): python3-routes-2.4.1-12.el8.noarch.r 1.0 MB/s | 196 kB 00:00 2024-04-26T11:10:51.047 INFO:teuthology.orchestra.run.smithi072.stdout:(115/137): python3-tempora-1.14.1-5.el8.noarch. 384 kB/s | 29 kB 00:00 2024-04-26T11:10:51.072 INFO:teuthology.orchestra.run.smithi072.stdout:(116/137): python3-trustme-0.6.0-4.el8.noarch.r 362 kB/s | 27 kB 00:00 2024-04-26T11:10:51.089 INFO:teuthology.orchestra.run.smithi122.stdout:(41/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.4 MB/s | 259 kB 00:00 2024-04-26T11:10:51.099 INFO:teuthology.orchestra.run.smithi072.stdout:(117/137): python3-webob-1.8.5-1.el8.1.noarch.r 4.7 MB/s | 251 kB 00:00 2024-04-26T11:10:51.102 INFO:teuthology.orchestra.run.smithi029.stdout:(29/137): ceph-mgr-dashboard-18.2.2-1256.gdc093 6.3 MB/s | 3.5 MB 00:00 2024-04-26T11:10:51.125 INFO:teuthology.orchestra.run.smithi072.stdout:(118/137): python3-waitress-1.4.3-1.el8.noarch. 3.2 MB/s | 255 kB 00:00 2024-04-26T11:10:51.150 INFO:teuthology.orchestra.run.smithi072.stdout:(119/137): python3-websocket-client-0.56.0-5.el 788 kB/s | 61 kB 00:00 2024-04-26T11:10:51.164 INFO:teuthology.orchestra.run.smithi122.stdout:(42/137): oniguruma-6.8.2-3.el8.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-04-26T11:10:51.176 INFO:teuthology.orchestra.run.smithi072.stdout:(120/137): python3-webtest-2.0.33-1.el8.noarch. 1.1 MB/s | 85 kB 00:00 2024-04-26T11:10:51.189 INFO:teuthology.orchestra.run.smithi122.stdout:(43/137): libtool-2.4.6-25.el8.x86_64.rpm 1.3 MB/s | 709 kB 00:00 2024-04-26T11:10:51.201 INFO:teuthology.orchestra.run.smithi072.stdout:(121/137): python3-zc-lockfile-2.0-2.el8.noarch 454 kB/s | 23 kB 00:00 2024-04-26T11:10:51.228 INFO:teuthology.orchestra.run.smithi029.stdout:(30/137): ceph-mgr-modules-core-18.2.2-1256.gdc 1.9 MB/s | 246 kB 00:00 2024-04-26T11:10:51.303 INFO:teuthology.orchestra.run.smithi029.stdout:(31/137): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 655 kB/s | 49 kB 00:00 2024-04-26T11:10:51.318 INFO:teuthology.orchestra.run.smithi072.stdout:(122/137): thrift-0.13.0-2.el8.x86_64.rpm 10 MB/s | 1.7 MB 00:00 2024-04-26T11:10:51.346 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-04-26T11:10:51.379 INFO:teuthology.orchestra.run.smithi029.stdout:(32/137): ceph-prometheus-alerts-18.2.2-1256.gd 202 kB/s | 15 kB 00:00 2024-04-26T11:10:51.444 INFO:teuthology.orchestra.run.smithi072.stdout:(123/137): elfutils-debuginfod-client-0.190-2.e 612 kB/s | 77 kB 00:00 2024-04-26T11:10:51.463 INFO:teuthology.orchestra.run.smithi029.stdout:(33/137): ceph-volume-18.2.2-1256.gdc093b5e.el8 3.1 MB/s | 263 kB 00:00 2024-04-26T11:10:51.564 INFO:teuthology.orchestra.run.smithi029.stdout:(34/137): cephadm-18.2.2-1256.gdc093b5e.el8.noa 1.7 MB/s | 173 kB 00:00 2024-04-26T11:10:51.578 INFO:teuthology.orchestra.run.smithi072.stdout:(124/137): elfutils-libelf-0.190-2.el8.x86_64.r 1.7 MB/s | 233 kB 00:00 2024-04-26T11:10:51.690 INFO:teuthology.orchestra.run.smithi122.stdout:(44/137): openblas-0.3.15-4.el8.x86_64.rpm 9.0 MB/s | 4.7 MB 00:00 2024-04-26T11:10:51.712 INFO:teuthology.orchestra.run.smithi072.stdout:(125/137): elfutils-libs-0.190-2.el8.x86_64.rpm 2.2 MB/s | 305 kB 00:00 2024-04-26T11:10:51.798 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-04-26T11:10:51.798 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-04-26T11:10:51.829 INFO:teuthology.orchestra.run.smithi072.stdout:(126/137): librados2-18.2.2-1256.gdc093b5e.el8. 5.7 MB/s | 3.7 MB 00:00 2024-04-26T11:10:51.855 INFO:teuthology.orchestra.run.smithi072.stdout:(127/137): libblkid-2.32.1-46.el8.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-04-26T11:10:51.963 INFO:teuthology.orchestra.run.smithi072.stdout:(128/137): libmount-2.32.1-46.el8.x86_64.rpm 2.1 MB/s | 237 kB 00:00 2024-04-26T11:10:51.965 INFO:teuthology.orchestra.run.smithi029.stdout:(35/137): automake-1.16.1-8.el8.noarch.rpm 1.8 MB/s | 740 kB 00:00 2024-04-26T11:10:52.064 INFO:teuthology.orchestra.run.smithi072.stdout:(129/137): libsmartcols-2.32.1-46.el8.x86_64.rp 1.8 MB/s | 180 kB 00:00 2024-04-26T11:10:52.128 INFO:teuthology.orchestra.run.smithi072.stdout:(130/137): libfdisk-2.32.1-46.el8.x86_64.rpm 852 kB/s | 254 kB 00:00 2024-04-26T11:10:52.157 INFO:teuthology.orchestra.run.smithi072.stdout:(131/137): libuuid-2.32.1-46.el8.x86_64.rpm 1.0 MB/s | 99 kB 00:00 2024-04-26T11:10:52.207 INFO:teuthology.orchestra.run.smithi029.stdout:(36/137): ceph-mgr-diskprediction-local-18.2.2- 5.1 MB/s | 7.4 MB 00:01 2024-04-26T11:10:52.215 INFO:teuthology.orchestra.run.smithi122.stdout:(45/137): python3-babel-2.5.1-7.el8.noarch.rpm 9.1 MB/s | 4.8 MB 00:00 2024-04-26T11:10:52.298 INFO:teuthology.orchestra.run.smithi122.stdout:(46/137): python3-jinja2-2.10.1-4.el8.noarch.rp 6.8 MB/s | 578 kB 00:00 2024-04-26T11:10:52.376 INFO:teuthology.orchestra.run.smithi072.stdout:(132/137): librbd1-18.2.2-1256.gdc093b5e.el8.x8 3.0 MB/s | 3.6 MB 00:01 2024-04-26T11:10:52.395 INFO:teuthology.orchestra.run.smithi122.stdout:(47/137): python3-jsonpatch-1.21-2.el8.noarch.r 274 kB/s | 27 kB 00:00 2024-04-26T11:10:52.410 INFO:teuthology.orchestra.run.smithi072.stdout:(133/137): openssl-1.1.1k-12.el8.x86_64.rpm 2.6 MB/s | 738 kB 00:00 2024-04-26T11:10:52.426 INFO:teuthology.orchestra.run.smithi029.stdout:(37/137): bison-3.0.4-10.el8.x86_64.rpm 1.5 MB/s | 688 kB 00:00 2024-04-26T11:10:52.474 INFO:teuthology.orchestra.run.smithi122.stdout:(48/137): python3-jsonpointer-1.10-11.el8.noarc 255 kB/s | 20 kB 00:00 2024-04-26T11:10:52.477 INFO:teuthology.orchestra.run.smithi072.stdout:(134/137): util-linux-user-2.32.1-46.el8.x86_64 1.5 MB/s | 103 kB 00:00 2024-04-26T11:10:52.510 INFO:teuthology.orchestra.run.smithi029.stdout:(38/137): jq-1.6-8.el8.x86_64.rpm 2.4 MB/s | 203 kB 00:00 2024-04-26T11:10:52.527 INFO:teuthology.orchestra.run.smithi072.stdout:(135/137): openssl-libs-1.1.1k-12.el8.x86_64.rp 4.0 MB/s | 1.5 MB 00:00 2024-04-26T11:10:52.544 INFO:teuthology.orchestra.run.smithi029.stdout:(39/137): flex-2.6.1-9.el8.x86_64.rpm 950 kB/s | 320 kB 00:00 2024-04-26T11:10:52.594 INFO:teuthology.orchestra.run.smithi029.stdout:(40/137): librdkafka-1.6.1-1.el8.x86_64.rpm 7.8 MB/s | 677 kB 00:00 2024-04-26T11:10:52.678 INFO:teuthology.orchestra.run.smithi029.stdout:(41/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.0 MB/s | 259 kB 00:00 2024-04-26T11:10:52.703 INFO:teuthology.orchestra.run.smithi072.stdout:(136/137): util-linux-2.32.1-46.el8.x86_64.rpm 7.9 MB/s | 2.6 MB 00:00 2024-04-26T11:10:52.729 INFO:teuthology.orchestra.run.smithi029.stdout:(42/137): libtool-2.4.6-25.el8.x86_64.rpm 3.7 MB/s | 709 kB 00:00 2024-04-26T11:10:52.763 INFO:teuthology.orchestra.run.smithi029.stdout:(43/137): oniguruma-6.8.2-3.el8.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-04-26T11:10:52.803 INFO:teuthology.orchestra.run.smithi072.stdout:(137/137): xfsprogs-5.0.0-12.el8.x86_64.rpm 3.3 MB/s | 1.1 MB 00:00 2024-04-26T11:10:52.805 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-04-26T11:10:52.806 INFO:teuthology.orchestra.run.smithi072.stdout:Total 11 MB/s | 207 MB 00:18 2024-04-26T11:10:52.941 INFO:teuthology.orchestra.run.smithi122.stdout:(49/137): ceph-test-18.2.2-1256.gdc093b5e.el8.x 5.6 MB/s | 47 MB 00:08 2024-04-26T11:10:52.958 INFO:teuthology.orchestra.run.smithi122.stdout:(50/137): python3-mako-1.0.6-14.el8.noarch.rpm 325 kB/s | 157 kB 00:00 2024-04-26T11:10:53.080 INFO:teuthology.orchestra.run.smithi029.stdout:(44/137): openblas-threads-0.3.15-4.el8.x86_64. 15 MB/s | 4.9 MB 00:00 2024-04-26T11:10:53.125 INFO:teuthology.orchestra.run.smithi122.stdout:(51/137): python3-markupsafe-0.23-19.el8.x86_64 212 kB/s | 39 kB 00:00 2024-04-26T11:10:53.214 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-04-26T11:10:53.217 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-04-26T11:10:53.331 INFO:teuthology.orchestra.run.smithi029.stdout:(45/137): openblas-0.3.15-4.el8.x86_64.rpm 7.9 MB/s | 4.7 MB 00:00 2024-04-26T11:10:53.400 INFO:teuthology.orchestra.run.smithi122.stdout:(52/137): python3-numpy-f2py-1.14.3-10.el8.x86_ 818 kB/s | 225 kB 00:00 2024-04-26T11:10:53.440 INFO:teuthology.orchestra.run.smithi029.stdout:(46/137): python3-babel-2.5.1-7.el8.noarch.rpm 13 MB/s | 4.8 MB 00:00 2024-04-26T11:10:53.459 INFO:teuthology.orchestra.run.smithi122.stdout:(53/137): python3-numpy-1.14.3-10.el8.x86_64.rp 7.5 MB/s | 3.7 MB 00:00 2024-04-26T11:10:53.473 INFO:teuthology.orchestra.run.smithi029.stdout:(47/137): python3-jinja2-2.10.1-4.el8.noarch.rp 4.0 MB/s | 578 kB 00:00 2024-04-26T11:10:53.484 INFO:teuthology.orchestra.run.smithi122.stdout:(54/137): python3-prettytable-0.7.2-14.el8.noar 525 kB/s | 44 kB 00:00 2024-04-26T11:10:53.516 INFO:teuthology.orchestra.run.smithi029.stdout:(48/137): python3-jsonpatch-1.21-2.el8.noarch.r 351 kB/s | 27 kB 00:00 2024-04-26T11:10:53.543 INFO:teuthology.orchestra.run.smithi122.stdout:(55/137): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.2 MB/s | 103 kB 00:00 2024-04-26T11:10:53.549 INFO:teuthology.orchestra.run.smithi029.stdout:(49/137): python3-jsonpointer-1.10-11.el8.noarc 263 kB/s | 20 kB 00:00 2024-04-26T11:10:53.592 INFO:teuthology.orchestra.run.smithi029.stdout:(50/137): python3-mako-1.0.6-14.el8.noarch.rpm 2.0 MB/s | 157 kB 00:00 2024-04-26T11:10:53.618 INFO:teuthology.orchestra.run.smithi122.stdout:(56/137): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2024-04-26T11:10:53.619 INFO:teuthology.orchestra.run.smithi029.stdout:(51/137): python3-markupsafe-0.23-19.el8.x86_64 561 kB/s | 39 kB 00:00 2024-04-26T11:10:53.643 INFO:teuthology.orchestra.run.smithi122.stdout:(57/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 795 kB/s | 126 kB 00:00 2024-04-26T11:10:53.646 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-04-26T11:10:53.702 INFO:teuthology.orchestra.run.smithi122.stdout:(58/137): python3-pytz-2017.2-11.el8.noarch.rpm 682 kB/s | 57 kB 00:00 2024-04-26T11:10:53.802 INFO:teuthology.orchestra.run.smithi122.stdout:(59/137): python3-werkzeug-0.12.2-4.el8.noarch. 4.5 MB/s | 457 kB 00:00 2024-04-26T11:10:53.894 INFO:teuthology.orchestra.run.smithi122.stdout:(60/137): socat-1.7.4.1-1.el8.x86_64.rpm 3.5 MB/s | 323 kB 00:00 2024-04-26T11:10:53.961 INFO:teuthology.orchestra.run.smithi122.stdout:(61/137): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.0 MB/s | 71 kB 00:00 2024-04-26T11:10:54.098 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-04-26T11:10:54.099 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-04-26T11:10:54.114 INFO:teuthology.orchestra.run.smithi122.stdout:(62/137): elfutils-libelf-devel-0.190-2.el8.x86 409 kB/s | 62 kB 00:00 2024-04-26T11:10:54.214 INFO:teuthology.orchestra.run.smithi122.stdout:(63/137): fuse-2.9.7-19.el8.x86_64.rpm 833 kB/s | 83 kB 00:00 2024-04-26T11:10:54.273 INFO:teuthology.orchestra.run.smithi122.stdout:(64/137): keyutils-libs-devel-1.5.10-9.el8.x86_ 825 kB/s | 48 kB 00:00 2024-04-26T11:10:54.390 INFO:teuthology.orchestra.run.smithi122.stdout:(65/137): openblas-threads-0.3.15-4.el8.x86_64. 1.5 MB/s | 4.9 MB 00:03 2024-04-26T11:10:54.461 INFO:teuthology.orchestra.run.smithi029.stdout:(52/137): ceph-test-18.2.2-1256.gdc093b5e.el8.x 6.2 MB/s | 47 MB 00:07 2024-04-26T11:10:54.487 INFO:teuthology.orchestra.run.smithi029.stdout:(53/137): python3-numpy-f2py-1.14.3-10.el8.x86_ 259 kB/s | 225 kB 00:00 2024-04-26T11:10:54.498 INFO:teuthology.orchestra.run.smithi122.stdout:(66/137): krb5-devel-1.18.2-22.el8.x86_64.rpm 2.4 MB/s | 561 kB 00:00 2024-04-26T11:10:54.524 INFO:teuthology.orchestra.run.smithi122.stdout:(67/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 140 kB/s | 19 kB 00:00 2024-04-26T11:10:54.557 INFO:teuthology.orchestra.run.smithi122.stdout:(68/137): libcom_err-devel-1.45.6-5.el8.x86_64. 662 kB/s | 39 kB 00:00 2024-04-26T11:10:54.571 INFO:teuthology.orchestra.run.smithi029.stdout:(54/137): python3-numpy-1.14.3-10.el8.x86_64.rp 3.8 MB/s | 3.7 MB 00:00 2024-04-26T11:10:54.605 INFO:teuthology.orchestra.run.smithi029.stdout:(55/137): python3-pyOpenSSL-19.0.0-1.el8.noarch 880 kB/s | 103 kB 00:00 2024-04-26T11:10:54.639 INFO:teuthology.orchestra.run.smithi029.stdout:(56/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.8 MB/s | 126 kB 00:00 2024-04-26T11:10:54.649 INFO:teuthology.orchestra.run.smithi122.stdout:(69/137): libquadmath-8.5.0-22.el8.x86_64.rpm 1.8 MB/s | 172 kB 00:00 2024-04-26T11:10:54.681 INFO:teuthology.orchestra.run.smithi029.stdout:(57/137): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2024-04-26T11:10:54.708 INFO:teuthology.orchestra.run.smithi122.stdout:(70/137): librabbitmq-0.9.0-5.el8.x86_64.rpm 809 kB/s | 47 kB 00:00 2024-04-26T11:10:54.714 INFO:teuthology.orchestra.run.smithi029.stdout:(58/137): python3-pytz-2017.2-11.el8.noarch.rpm 753 kB/s | 57 kB 00:00 2024-04-26T11:10:54.740 INFO:teuthology.orchestra.run.smithi029.stdout:(59/137): python3-prettytable-0.7.2-14.el8.noar 158 kB/s | 44 kB 00:00 2024-04-26T11:10:54.799 INFO:teuthology.orchestra.run.smithi029.stdout:(60/137): python3-werkzeug-0.12.2-4.el8.noarch. 5.3 MB/s | 457 kB 00:00 2024-04-26T11:10:54.800 INFO:teuthology.orchestra.run.smithi122.stdout:(71/137): libselinux-devel-2.9-8.el8.x86_64.rpm 2.1 MB/s | 200 kB 00:00 2024-04-26T11:10:54.859 INFO:teuthology.orchestra.run.smithi122.stdout:(72/137): libsepol-devel-2.9-3.el8.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2024-04-26T11:10:54.875 INFO:teuthology.orchestra.run.smithi029.stdout:(61/137): xmlstarlet-1.6.1-20.el8.x86_64.rpm 939 kB/s | 71 kB 00:00 2024-04-26T11:10:54.917 INFO:teuthology.orchestra.run.smithi122.stdout:(73/137): libuuid-devel-2.32.1-46.el8.x86_64.rp 1.7 MB/s | 100 kB 00:00 2024-04-26T11:10:54.925 INFO:teuthology.orchestra.run.smithi029.stdout:(62/137): socat-1.7.4.1-1.el8.x86_64.rpm 1.7 MB/s | 323 kB 00:00 2024-04-26T11:10:54.951 INFO:teuthology.orchestra.run.smithi122.stdout:(74/137): libgfortran-8.5.0-22.el8.x86_64.rpm 1.5 MB/s | 645 kB 00:00 2024-04-26T11:10:54.976 INFO:teuthology.orchestra.run.smithi122.stdout:(75/137): libverto-devel-0.3.2-2.el8.x86_64.rpm 308 kB/s | 18 kB 00:00 2024-04-26T11:10:55.010 INFO:teuthology.orchestra.run.smithi122.stdout:(76/137): libzstd-devel-1.4.4-1.el8.x86_64.rpm 745 kB/s | 44 kB 00:00 2024-04-26T11:10:55.051 INFO:teuthology.orchestra.run.smithi029.stdout:(63/137): elfutils-libelf-devel-0.190-2.el8.x86 354 kB/s | 62 kB 00:00 2024-04-26T11:10:55.077 INFO:teuthology.orchestra.run.smithi029.stdout:(64/137): fuse-2.9.7-19.el8.x86_64.rpm 552 kB/s | 83 kB 00:00 2024-04-26T11:10:55.112 INFO:teuthology.orchestra.run.smithi029.stdout:(65/137): keyutils-libs-devel-1.5.10-9.el8.x86_ 792 kB/s | 48 kB 00:00 2024-04-26T11:10:55.171 INFO:teuthology.orchestra.run.smithi029.stdout:(66/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 318 kB/s | 19 kB 00:00 2024-04-26T11:10:55.247 INFO:teuthology.orchestra.run.smithi029.stdout:(67/137): libcom_err-devel-1.45.6-5.el8.x86_64. 515 kB/s | 39 kB 00:00 2024-04-26T11:10:55.277 INFO:teuthology.orchestra.run.smithi122.stdout:(77/137): pcre2-devel-10.32-3.el8.x86_64.rpm 2.2 MB/s | 605 kB 00:00 2024-04-26T11:10:55.372 INFO:teuthology.orchestra.run.smithi029.stdout:(68/137): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.9 MB/s | 561 kB 00:00 2024-04-26T11:10:55.402 INFO:teuthology.orchestra.run.smithi122.stdout:(78/137): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.8 MB/s | 229 kB 00:00 2024-04-26T11:10:55.414 INFO:teuthology.orchestra.run.smithi029.stdout:(69/137): libgfortran-8.5.0-22.el8.x86_64.rpm 3.8 MB/s | 645 kB 00:00 2024-04-26T11:10:55.473 INFO:teuthology.orchestra.run.smithi029.stdout:(70/137): librabbitmq-0.9.0-5.el8.x86_64.rpm 807 kB/s | 47 kB 00:00 2024-04-26T11:10:55.494 INFO:teuthology.orchestra.run.smithi122.stdout:(79/137): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.4 MB/s | 220 kB 00:00 2024-04-26T11:10:55.499 INFO:teuthology.orchestra.run.smithi029.stdout:(71/137): libquadmath-8.5.0-22.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2024-04-26T11:10:55.517 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-04-26T11:10:55.520 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-04-26T11:10:55.541 INFO:teuthology.orchestra.run.smithi029.stdout:(72/137): libselinux-devel-2.9-8.el8.x86_64.rpm 2.9 MB/s | 200 kB 00:00 2024-04-26T11:10:55.552 INFO:teuthology.orchestra.run.smithi122.stdout:(80/137): openssl-devel-1.1.1k-12.el8.x86_64.rp 5.5 MB/s | 3.2 MB 00:00 2024-04-26T11:10:55.567 INFO:teuthology.orchestra.run.smithi029.stdout:(73/137): libsepol-devel-2.9-3.el8.x86_64.rpm 1.3 MB/s | 87 kB 00:00 2024-04-26T11:10:55.600 INFO:teuthology.orchestra.run.smithi029.stdout:(74/137): libuuid-devel-2.32.1-46.el8.x86_64.rp 1.7 MB/s | 100 kB 00:00 2024-04-26T11:10:55.619 INFO:teuthology.orchestra.run.smithi122.stdout:(81/137): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.9 MB/s | 249 kB 00:00 2024-04-26T11:10:55.634 INFO:teuthology.orchestra.run.smithi029.stdout:(75/137): libverto-devel-0.3.2-2.el8.x86_64.rpm 268 kB/s | 18 kB 00:00 2024-04-26T11:10:55.668 INFO:teuthology.orchestra.run.smithi029.stdout:(76/137): libzstd-devel-1.4.4-1.el8.x86_64.rpm 650 kB/s | 44 kB 00:00 2024-04-26T11:10:55.686 INFO:teuthology.orchestra.run.smithi122.stdout:(82/137): python3-cryptography-3.2.1-7.el8.x86_ 4.7 MB/s | 641 kB 00:00 2024-04-26T11:10:55.711 INFO:teuthology.orchestra.run.smithi122.stdout:(83/137): python3-jwt-1.6.1-2.el8.noarch.rpm 464 kB/s | 43 kB 00:00 2024-04-26T11:10:55.745 INFO:teuthology.orchestra.run.smithi122.stdout:(84/137): python3-oauthlib-2.1.0-1.el8.noarch.r 2.6 MB/s | 155 kB 00:00 2024-04-26T11:10:55.779 INFO:teuthology.orchestra.run.smithi122.stdout:(85/137): python3-pycparser-2.14-14.el8.noarch. 1.6 MB/s | 109 kB 00:00 2024-04-26T11:10:55.785 INFO:teuthology.orchestra.run.smithi029.stdout:(77/137): pcre2-devel-10.32-3.el8.x86_64.rpm 5.1 MB/s | 605 kB 00:00 2024-04-26T11:10:55.804 INFO:teuthology.orchestra.run.smithi122.stdout:(86/137): python3-requests-oauthlib-1.0.0-1.el8 728 kB/s | 43 kB 00:00 2024-04-26T11:10:55.846 INFO:teuthology.orchestra.run.smithi122.stdout:(87/137): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.1 MB/s | 74 kB 00:00 2024-04-26T11:10:55.863 INFO:teuthology.orchestra.run.smithi122.stdout:(88/137): zlib-devel-1.2.11-21.el8.x86_64.rpm 993 kB/s | 58 kB 00:00 2024-04-26T11:10:56.014 INFO:teuthology.orchestra.run.smithi122.stdout:(89/137): python3-packaging-16.8-9.el8.noarch.r 288 kB/s | 48 kB 00:00 2024-04-26T11:10:56.036 INFO:teuthology.orchestra.run.smithi029.stdout:(78/137): python3-scipy-1.0.0-21.module_el8+762 10 MB/s | 14 MB 00:01 2024-04-26T11:10:56.061 INFO:teuthology.orchestra.run.smithi029.stdout:(79/137): pcre2-utf16-10.32-3.el8.x86_64.rpm 831 kB/s | 229 kB 00:00 2024-04-26T11:10:56.147 INFO:teuthology.orchestra.run.smithi029.stdout:(80/137): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.9 MB/s | 249 kB 00:00 2024-04-26T11:10:56.256 INFO:teuthology.orchestra.run.smithi029.stdout:(81/137): python3-cryptography-3.2.1-7.el8.x86_ 5.8 MB/s | 641 kB 00:00 2024-04-26T11:10:56.272 INFO:teuthology.orchestra.run.smithi122.stdout:(90/137): python3-scipy-1.0.0-21.module_el8+762 5.4 MB/s | 14 MB 00:02 2024-04-26T11:10:56.281 INFO:teuthology.orchestra.run.smithi029.stdout:(82/137): pcre2-utf32-10.32-3.el8.x86_64.rpm 902 kB/s | 220 kB 00:00 2024-04-26T11:10:56.315 INFO:teuthology.orchestra.run.smithi029.stdout:(83/137): python3-jwt-1.6.1-2.el8.noarch.rpm 725 kB/s | 43 kB 00:00 2024-04-26T11:10:56.339 INFO:teuthology.orchestra.run.smithi122.stdout:(91/137): liboath-2.6.2-3.el8.x86_64.rpm 181 kB/s | 59 kB 00:00 2024-04-26T11:10:56.340 INFO:teuthology.orchestra.run.smithi029.stdout:(84/137): python3-oauthlib-2.1.0-1.el8.noarch.r 2.6 MB/s | 155 kB 00:00 2024-04-26T11:10:56.374 INFO:teuthology.orchestra.run.smithi029.stdout:(85/137): python3-pycparser-2.14-14.el8.noarch. 1.8 MB/s | 109 kB 00:00 2024-04-26T11:10:56.389 INFO:teuthology.orchestra.run.smithi122.stdout:(92/137): gperftools-libs-2.7-9.el8.x86_64.rpm 582 kB/s | 306 kB 00:00 2024-04-26T11:10:56.400 INFO:teuthology.orchestra.run.smithi029.stdout:(86/137): python3-requests-oauthlib-1.0.0-1.el8 721 kB/s | 43 kB 00:00 2024-04-26T11:10:56.433 INFO:teuthology.orchestra.run.smithi029.stdout:(87/137): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.2 MB/s | 74 kB 00:00 2024-04-26T11:10:56.459 INFO:teuthology.orchestra.run.smithi029.stdout:(88/137): zlib-devel-1.2.11-21.el8.x86_64.rpm 981 kB/s | 58 kB 00:00 2024-04-26T11:10:56.490 INFO:teuthology.orchestra.run.smithi122.stdout:(93/137): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 436 kB/s | 44 kB 00:00 2024-04-26T11:10:56.543 INFO:teuthology.orchestra.run.smithi029.stdout:(89/137): openssl-devel-1.1.1k-12.el8.x86_64.rp 3.5 MB/s | 3.2 MB 00:00 2024-04-26T11:10:56.623 INFO:teuthology.orchestra.run.smithi122.stdout:(94/137): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2024-04-26T11:10:56.650 INFO:teuthology.orchestra.run.smithi122.stdout:(95/137): libunwind-1.3.1-3.el8.x86_64.rpm 200 kB/s | 75 kB 00:00 2024-04-26T11:10:56.669 INFO:teuthology.orchestra.run.smithi029.stdout:(90/137): python3-packaging-16.8-9.el8.noarch.r 205 kB/s | 48 kB 00:00 2024-04-26T11:10:56.674 INFO:teuthology.orchestra.run.smithi122.stdout:(96/137): python3-asyncssh-2.7.0-2.el8.noarch.r 1.4 MB/s | 476 kB 00:00 2024-04-26T11:10:56.724 INFO:teuthology.orchestra.run.smithi122.stdout:(97/137): python3-cachetools-3.1.1-4.el8.noarch 329 kB/s | 33 kB 00:00 2024-04-26T11:10:56.758 INFO:teuthology.orchestra.run.smithi122.stdout:(98/137): python3-certifi-2018.10.15-7.el8.noar 150 kB/s | 16 kB 00:00 2024-04-26T11:10:56.783 INFO:teuthology.orchestra.run.smithi122.stdout:(99/137): python3-cheroot-8.5.2-1.el8.noarch.rp 1.5 MB/s | 173 kB 00:00 2024-04-26T11:10:56.875 INFO:teuthology.orchestra.run.smithi122.stdout:(100/137): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2024-04-26T11:10:56.886 INFO:teuthology.orchestra.run.smithi029.stdout:(91/137): liboath-2.6.2-3.el8.x86_64.rpm 171 kB/s | 59 kB 00:00 2024-04-26T11:10:56.909 INFO:teuthology.orchestra.run.smithi122.stdout:(101/137): python3-cherrypy-18.4.0-1.el8.noarch 2.0 MB/s | 384 kB 00:00 2024-04-26T11:10:56.920 INFO:teuthology.orchestra.run.smithi029.stdout:(92/137): gperftools-libs-2.7-9.el8.x86_64.rpm 665 kB/s | 306 kB 00:00 2024-04-26T11:10:56.934 INFO:teuthology.orchestra.run.smithi122.stdout:(102/137): python3-google-auth-1.1.1-10.el8.noa 462 kB/s | 81 kB 00:00 2024-04-26T11:10:56.946 INFO:teuthology.orchestra.run.smithi029.stdout:(93/137): libunwind-1.3.1-3.el8.x86_64.rpm 271 kB/s | 75 kB 00:00 2024-04-26T11:10:56.976 INFO:teuthology.orchestra.run.smithi122.stdout:(103/137): python3-jaraco-functools-2.0-4.el8.n 174 kB/s | 18 kB 00:00 2024-04-26T11:10:57.013 INFO:teuthology.orchestra.run.smithi029.stdout:(94/137): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 472 kB/s | 44 kB 00:00 2024-04-26T11:10:57.062 INFO:teuthology.orchestra.run.smithi122.stdout:(104/137): python3-logutils-0.3.5-11.el8.noarch 389 kB/s | 49 kB 00:00 2024-04-26T11:10:57.085 INFO:teuthology.orchestra.run.smithi122.stdout:(105/137): python3-more-itertools-7.2.0-3.el8.n 540 kB/s | 59 kB 00:00 2024-04-26T11:10:57.107 INFO:teuthology.orchestra.run.smithi029.stdout:(95/137): python3-beautifulsoup4-4.6.3-2.el8.1. 1.1 MB/s | 185 kB 00:00 2024-04-26T11:10:57.127 INFO:teuthology.orchestra.run.smithi122.stdout:(106/137): python3-kubernetes-11.0.0-6.el8.noar 5.3 MB/s | 1.2 MB 00:00 2024-04-26T11:10:57.174 INFO:teuthology.orchestra.run.smithi029.stdout:(96/137): python3-cachetools-3.1.1-4.el8.noarch 205 kB/s | 33 kB 00:00 2024-04-26T11:10:57.200 INFO:teuthology.orchestra.run.smithi029.stdout:(97/137): python3-certifi-2018.10.15-7.el8.noar 176 kB/s | 16 kB 00:00 2024-04-26T11:10:57.202 INFO:teuthology.orchestra.run.smithi122.stdout:(107/137): python3-natsort-7.1.1-2.el8.noarch.r 423 kB/s | 60 kB 00:00 2024-04-26T11:10:57.228 INFO:teuthology.orchestra.run.smithi122.stdout:(108/137): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2024-04-26T11:10:57.234 INFO:teuthology.orchestra.run.smithi029.stdout:(98/137): python3-asyncssh-2.7.0-2.el8.noarch.r 1.3 MB/s | 476 kB 00:00 2024-04-26T11:10:57.253 INFO:teuthology.orchestra.run.smithi122.stdout:(109/137): python3-pecan-1.3.2-9.el8.noarch.rpm 1.6 MB/s | 283 kB 00:00 2024-04-26T11:10:57.267 INFO:teuthology.orchestra.run.smithi029.stdout:(99/137): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2024-04-26T11:10:57.295 INFO:teuthology.orchestra.run.smithi122.stdout:(110/137): python3-repoze-lru-0.7-6.el8.noarch. 364 kB/s | 34 kB 00:00 2024-04-26T11:10:57.318 INFO:teuthology.orchestra.run.smithi029.stdout:(100/137): python3-google-auth-1.1.1-10.el8.noa 966 kB/s | 81 kB 00:00 2024-04-26T11:10:57.344 INFO:teuthology.orchestra.run.smithi029.stdout:(101/137): python3-cherrypy-18.4.0-1.el8.noarch 2.6 MB/s | 384 kB 00:00 2024-04-26T11:10:57.354 INFO:teuthology.orchestra.run.smithi122.stdout:(111/137): python3-rsa-4.9-2.el8.noarch.rpm 640 kB/s | 64 kB 00:00 2024-04-26T11:10:57.369 INFO:teuthology.orchestra.run.smithi029.stdout:(102/137): python3-jaraco-6.2-6.el8.noarch.rpm 109 kB/s | 11 kB 00:00 2024-04-26T11:10:57.387 INFO:teuthology.orchestra.run.smithi122.stdout:(112/137): python3-simplegeneric-0.8.1-17.el8.n 204 kB/s | 19 kB 00:00 2024-04-26T11:10:57.403 INFO:teuthology.orchestra.run.smithi029.stdout:(103/137): python3-jaraco-functools-2.0-4.el8.n 207 kB/s | 18 kB 00:00 2024-04-26T11:10:57.446 INFO:teuthology.orchestra.run.smithi122.stdout:(113/137): python3-routes-2.4.1-12.el8.noarch.r 902 kB/s | 196 kB 00:00 2024-04-26T11:10:57.454 INFO:teuthology.orchestra.run.smithi029.stdout:(104/137): python3-logutils-0.3.5-11.el8.noarch 579 kB/s | 49 kB 00:00 2024-04-26T11:10:57.474 INFO:teuthology.orchestra.run.smithi122.stdout:(114/137): python3-singledispatch-3.4.0.3-18.el 204 kB/s | 24 kB 00:00 2024-04-26T11:10:57.496 INFO:teuthology.orchestra.run.smithi029.stdout:(105/137): python3-more-itertools-7.2.0-3.el8.n 636 kB/s | 59 kB 00:00 2024-04-26T11:10:57.496 INFO:teuthology.orchestra.run.smithi122.stdout:(115/137): python3-tempora-1.14.1-5.el8.noarch. 269 kB/s | 29 kB 00:00 2024-04-26T11:10:57.538 INFO:teuthology.orchestra.run.smithi029.stdout:(106/137): python3-natsort-7.1.1-2.el8.noarch.r 715 kB/s | 60 kB 00:00 2024-04-26T11:10:57.547 INFO:teuthology.orchestra.run.smithi122.stdout:(116/137): python3-trustme-0.6.0-4.el8.noarch.r 273 kB/s | 27 kB 00:00 2024-04-26T11:10:57.605 INFO:teuthology.orchestra.run.smithi029.stdout:(107/137): python3-kubernetes-11.0.0-6.el8.noar 4.5 MB/s | 1.2 MB 00:00 2024-04-26T11:10:57.622 INFO:teuthology.orchestra.run.smithi122.stdout:(117/137): python3-webob-1.8.5-1.el8.1.noarch.r 2.0 MB/s | 251 kB 00:00 2024-04-26T11:10:57.623 INFO:teuthology.orchestra.run.smithi029.stdout:(108/137): python3-portend-2.6-1.el8.noarch.rpm 185 kB/s | 16 kB 00:00 2024-04-26T11:10:57.647 INFO:teuthology.orchestra.run.smithi122.stdout:(118/137): python3-waitress-1.4.3-1.el8.noarch. 1.4 MB/s | 255 kB 00:00 2024-04-26T11:10:57.658 INFO:teuthology.orchestra.run.smithi029.stdout:(109/137): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2024-04-26T11:10:57.673 INFO:teuthology.orchestra.run.smithi122.stdout:(119/137): python3-websocket-client-0.56.0-5.el 487 kB/s | 61 kB 00:00 2024-04-26T11:10:57.692 INFO:teuthology.orchestra.run.smithi029.stdout:(110/137): python3-repoze-lru-0.7-6.el8.noarch. 390 kB/s | 34 kB 00:00 2024-04-26T11:10:57.717 INFO:teuthology.orchestra.run.smithi029.stdout:(111/137): python3-routes-2.4.1-12.el8.noarch.r 2.0 MB/s | 196 kB 00:00 2024-04-26T11:10:57.723 INFO:teuthology.orchestra.run.smithi122.stdout:(120/137): python3-webtest-2.0.33-1.el8.noarch. 849 kB/s | 85 kB 00:00 2024-04-26T11:10:57.748 INFO:teuthology.orchestra.run.smithi122.stdout:(121/137): python3-zc-lockfile-2.0-2.el8.noarch 228 kB/s | 23 kB 00:00 2024-04-26T11:10:57.751 INFO:teuthology.orchestra.run.smithi029.stdout:(112/137): python3-rsa-4.9-2.el8.noarch.rpm 691 kB/s | 64 kB 00:00 2024-04-26T11:10:57.777 INFO:teuthology.orchestra.run.smithi029.stdout:(113/137): python3-simplegeneric-0.8.1-17.el8.n 221 kB/s | 19 kB 00:00 2024-04-26T11:10:57.803 INFO:teuthology.orchestra.run.smithi029.stdout:(114/137): python3-singledispatch-3.4.0.3-18.el 282 kB/s | 24 kB 00:00 2024-04-26T11:10:57.836 INFO:teuthology.orchestra.run.smithi029.stdout:(115/137): python3-tempora-1.14.1-5.el8.noarch. 345 kB/s | 29 kB 00:00 2024-04-26T11:10:57.862 INFO:teuthology.orchestra.run.smithi029.stdout:(116/137): python3-trustme-0.6.0-4.el8.noarch.r 324 kB/s | 27 kB 00:00 2024-04-26T11:10:57.888 INFO:teuthology.orchestra.run.smithi029.stdout:(117/137): python3-waitress-1.4.3-1.el8.noarch. 2.9 MB/s | 255 kB 00:00 2024-04-26T11:10:57.930 INFO:teuthology.orchestra.run.smithi029.stdout:(118/137): python3-webob-1.8.5-1.el8.1.noarch.r 2.6 MB/s | 251 kB 00:00 2024-04-26T11:10:57.955 INFO:teuthology.orchestra.run.smithi029.stdout:(119/137): python3-websocket-client-0.56.0-5.el 659 kB/s | 61 kB 00:00 2024-04-26T11:10:57.981 INFO:teuthology.orchestra.run.smithi029.stdout:(120/137): python3-webtest-2.0.33-1.el8.noarch. 919 kB/s | 85 kB 00:00 2024-04-26T11:10:58.015 INFO:teuthology.orchestra.run.smithi029.stdout:(121/137): python3-zc-lockfile-2.0-2.el8.noarch 271 kB/s | 23 kB 00:00 2024-04-26T11:10:58.015 INFO:teuthology.orchestra.run.smithi122.stdout:(122/137): thrift-0.13.0-2.el8.x86_64.rpm 5.1 MB/s | 1.7 MB 00:00 2024-04-26T11:10:58.157 INFO:teuthology.orchestra.run.smithi029.stdout:(122/137): thrift-0.13.0-2.el8.x86_64.rpm 8.6 MB/s | 1.7 MB 00:00 2024-04-26T11:10:58.158 INFO:teuthology.orchestra.run.smithi122.stdout:(123/137): librados2-18.2.2-1256.gdc093b5e.el8. 8.5 MB/s | 3.7 MB 00:00 2024-04-26T11:10:58.182 INFO:teuthology.orchestra.run.smithi122.stdout:(124/137): elfutils-debuginfod-client-0.190-2.e 460 kB/s | 77 kB 00:00 2024-04-26T11:10:58.275 INFO:teuthology.orchestra.run.smithi029.stdout:(123/137): elfutils-debuginfod-client-0.190-2.e 657 kB/s | 77 kB 00:00 2024-04-26T11:10:58.300 INFO:teuthology.orchestra.run.smithi122.stdout:(125/137): elfutils-libs-0.190-2.el8.x86_64.rpm 2.6 MB/s | 305 kB 00:00 2024-04-26T11:10:58.358 INFO:teuthology.orchestra.run.smithi122.stdout:(126/137): librbd1-18.2.2-1256.gdc093b5e.el8.x8 5.9 MB/s | 3.6 MB 00:00 2024-04-26T11:10:58.360 INFO:teuthology.orchestra.run.smithi029.stdout:(124/137): elfutils-libelf-0.190-2.el8.x86_64.r 2.7 MB/s | 233 kB 00:00 2024-04-26T11:10:58.383 INFO:teuthology.orchestra.run.smithi122.stdout:(127/137): elfutils-libelf-0.190-2.el8.x86_64.r 1.0 MB/s | 233 kB 00:00 2024-04-26T11:10:58.409 INFO:teuthology.orchestra.run.smithi122.stdout:(128/137): libblkid-2.32.1-46.el8.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-04-26T11:10:58.427 INFO:teuthology.orchestra.run.smithi029.stdout:(125/137): elfutils-libs-0.190-2.el8.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-04-26T11:10:58.468 INFO:teuthology.orchestra.run.smithi122.stdout:(129/137): libsmartcols-2.32.1-46.el8.x86_64.rp 3.0 MB/s | 180 kB 00:00 2024-04-26T11:10:58.526 INFO:teuthology.orchestra.run.smithi122.stdout:(130/137): libmount-2.32.1-46.el8.x86_64.rpm 1.6 MB/s | 237 kB 00:00 2024-04-26T11:10:58.527 INFO:teuthology.orchestra.run.smithi029.stdout:(126/137): librados2-18.2.2-1256.gdc093b5e.el8. 6.8 MB/s | 3.7 MB 00:00 2024-04-26T11:10:58.551 INFO:teuthology.orchestra.run.smithi122.stdout:(131/137): libuuid-2.32.1-46.el8.x86_64.rpm 1.2 MB/s | 99 kB 00:00 2024-04-26T11:10:58.561 INFO:teuthology.orchestra.run.smithi029.stdout:(127/137): libblkid-2.32.1-46.el8.x86_64.rpm 1.6 MB/s | 221 kB 00:00 2024-04-26T11:10:58.654 INFO:teuthology.orchestra.run.smithi029.stdout:(128/137): libmount-2.32.1-46.el8.x86_64.rpm 2.5 MB/s | 237 kB 00:00 2024-04-26T11:10:58.660 INFO:teuthology.orchestra.run.smithi122.stdout:(132/137): libfdisk-2.32.1-46.el8.x86_64.rpm 844 kB/s | 254 kB 00:00 2024-04-26T11:10:58.745 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-04-26T11:10:58.746 INFO:teuthology.orchestra.run.smithi029.stdout:(129/137): librbd1-18.2.2-1256.gdc093b5e.el8.x8 4.9 MB/s | 3.6 MB 00:00 2024-04-26T11:10:58.772 INFO:teuthology.orchestra.run.smithi029.stdout:(130/137): libsmartcols-2.32.1-46.el8.x86_64.rp 1.5 MB/s | 180 kB 00:00 2024-04-26T11:10:58.889 INFO:teuthology.orchestra.run.smithi029.stdout:(131/137): libfdisk-2.32.1-46.el8.x86_64.rpm 704 kB/s | 254 kB 00:00 2024-04-26T11:10:59.010 INFO:teuthology.orchestra.run.smithi122.stdout:(133/137): openssl-1.1.1k-12.el8.x86_64.rpm 1.5 MB/s | 738 kB 00:00 2024-04-26T11:10:59.018 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-04-26T11:10:59.022 INFO:teuthology.orchestra.run.smithi029.stdout:(132/137): libuuid-2.32.1-46.el8.x86_64.rpm 359 kB/s | 99 kB 00:00 2024-04-26T11:10:59.052 INFO:teuthology.orchestra.run.smithi122.stdout:(134/137): openssl-libs-1.1.1k-12.el8.x86_64.rp 2.9 MB/s | 1.5 MB 00:00 2024-04-26T11:10:59.102 INFO:teuthology.orchestra.run.smithi122.stdout:(135/137): util-linux-user-2.32.1-46.el8.x86_64 1.1 MB/s | 103 kB 00:00 2024-04-26T11:10:59.423 INFO:teuthology.orchestra.run.smithi029.stdout:(133/137): openssl-1.1.1k-12.el8.x86_64.rpm 1.1 MB/s | 738 kB 00:00 2024-04-26T11:10:59.467 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-26T11:10:59.474 INFO:teuthology.orchestra.run.smithi029.stdout:(134/137): openssl-libs-1.1.1k-12.el8.x86_64.rp 2.5 MB/s | 1.5 MB 00:00 2024-04-26T11:10:59.693 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-26T11:10:59.744 INFO:teuthology.orchestra.run.smithi122.stdout:(136/137): xfsprogs-5.0.0-12.el8.x86_64.rpm 1.6 MB/s | 1.1 MB 00:00 2024-04-26T11:10:59.766 INFO:teuthology.orchestra.run.smithi029.stdout:(135/137): util-linux-user-2.32.1-46.el8.x86_64 301 kB/s | 103 kB 00:00 2024-04-26T11:10:59.945 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/152 2024-04-26T11:11:00.066 INFO:teuthology.orchestra.run.smithi029.stdout:(136/137): xfsprogs-5.0.0-12.el8.x86_64.rpm 1.8 MB/s | 1.1 MB 00:00 2024-04-26T11:11:00.111 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-26T11:11:00.201 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-26T11:11:00.428 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-26T11:11:00.496 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-26T11:11:00.661 INFO:teuthology.orchestra.run.smithi122.stdout:(137/137): util-linux-2.32.1-46.el8.x86_64.rpm 1.3 MB/s | 2.6 MB 00:02 2024-04-26T11:11:00.664 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-04-26T11:11:00.664 INFO:teuthology.orchestra.run.smithi122.stdout:Total 8.0 MB/s | 207 MB 00:25 2024-04-26T11:11:00.732 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-04-26T11:11:00.764 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/152 2024-04-26T11:11:00.766 INFO:teuthology.orchestra.run.smithi029.stdout:(137/137): util-linux-2.32.1-46.el8.x86_64.rpm 1.5 MB/s | 2.6 MB 00:01 2024-04-26T11:11:00.769 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-04-26T11:11:00.769 INFO:teuthology.orchestra.run.smithi029.stdout:Total 7.7 MB/s | 207 MB 00:26 2024-04-26T11:11:00.927 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-04-26T11:11:01.000 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 6/152 2024-04-26T11:11:01.145 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-26T11:11:01.234 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/152 2024-04-26T11:11:01.346 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-26T11:11:01.444 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-26T11:11:01.494 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-04-26T11:11:01.569 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/152 2024-04-26T11:11:01.643 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-04-26T11:11:01.710 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-26T11:11:01.809 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-26T11:11:01.868 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-26T11:11:01.947 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-04-26T11:11:01.948 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-04-26T11:11:02.044 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-26T11:11:02.098 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-26T11:11:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T11:11:02.129 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-04-26T11:11:02.129 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-04-26T11:11:02.320 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/152 2024-04-26T11:11:02.490 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 6/152 2024-04-26T11:11:02.493 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T11:11:02.702 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T11:11:02.703 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/152 2024-04-26T11:11:02.832 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T11:11:02.860 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-26T11:11:03.019 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T11:11:03.142 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T11:11:03.267 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-26T11:11:03.347 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/152 2024-04-26T11:11:03.572 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 13/152 2024-04-26T11:11:03.622 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-04-26T11:11:03.625 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-04-26T11:11:03.652 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-04-26T11:11:03.655 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-04-26T11:11:03.810 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T11:11:03.815 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/152 2024-04-26T11:11:04.073 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/152 2024-04-26T11:11:04.207 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T11:11:04.210 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 16/152 2024-04-26T11:11:04.344 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 16/152 2024-04-26T11:11:04.427 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T11:11:04.485 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T11:11:04.548 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T11:11:04.717 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T11:11:04.718 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T11:11:04.811 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T11:11:04.994 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-26T11:11:05.044 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/152 2024-04-26T11:11:05.162 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-26T11:11:05.263 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 13/152 2024-04-26T11:11:05.391 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/152 2024-04-26T11:11:05.471 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/152 2024-04-26T11:11:05.559 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/152 2024-04-26T11:11:05.696 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/152 2024-04-26T11:11:05.752 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libquadmath-8.5.0-22.el8.x86_64 21/152 2024-04-26T11:11:05.826 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 16/152 2024-04-26T11:11:05.875 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libquadmath-8.5.0-22.el8.x86_64 21/152 2024-04-26T11:11:05.929 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 16/152 2024-04-26T11:11:06.068 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T11:11:06.068 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgfortran-8.5.0-22.el8.x86_64 22/152 2024-04-26T11:11:06.284 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T11:11:06.501 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-26T11:11:06.616 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-26T11:11:06.664 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libgfortran-8.5.0-22.el8.x86_64 22/152 2024-04-26T11:11:06.865 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/152 2024-04-26T11:11:06.885 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/152 2024-04-26T11:11:07.073 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/152 2024-04-26T11:11:07.209 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libquadmath-8.5.0-22.el8.x86_64 21/152 2024-04-26T11:11:07.348 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libquadmath-8.5.0-22.el8.x86_64 21/152 2024-04-26T11:11:07.498 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/152 2024-04-26T11:11:07.501 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libgfortran-8.5.0-22.el8.x86_64 22/152 2024-04-26T11:11:07.701 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-26T11:11:08.090 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libgfortran-8.5.0-22.el8.x86_64 22/152 2024-04-26T11:11:08.318 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/152 2024-04-26T11:11:08.386 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-26T11:11:08.726 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/152 2024-04-26T11:11:08.811 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-04-26T11:11:08.876 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-04-26T11:11:08.931 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/152 2024-04-26T11:11:08.945 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/152 2024-04-26T11:11:08.974 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-04-26T11:11:09.075 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-04-26T11:11:09.130 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/152 2024-04-26T11:11:09.168 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-26T11:11:09.178 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-26T11:11:09.317 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-26T11:11:09.386 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/152 2024-04-26T11:11:09.404 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-26T11:11:09.551 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-26T11:11:09.644 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/152 2024-04-26T11:11:09.674 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 29/152 2024-04-26T11:11:09.821 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-26T11:11:09.851 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/152 2024-04-26T11:11:09.874 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-26T11:11:09.880 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 30/152 2024-04-26T11:11:09.906 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-26T11:11:10.015 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-26T11:11:10.099 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 31/152 2024-04-26T11:11:10.104 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-26T11:11:10.116 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-26T11:11:10.176 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/152 2024-04-26T11:11:10.179 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-26T11:11:10.331 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-26T11:11:10.398 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/152 2024-04-26T11:11:10.415 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-26T11:11:10.416 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/152 2024-04-26T11:11:10.590 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/152 2024-04-26T11:11:10.593 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 6/152 2024-04-26T11:11:10.688 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/152 2024-04-26T11:11:10.793 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/152 2024-04-26T11:11:10.810 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/152 2024-04-26T11:11:10.920 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 6/152 2024-04-26T11:11:10.946 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-26T11:11:10.999 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 29/152 2024-04-26T11:11:11.116 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/152 2024-04-26T11:11:11.164 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/152 2024-04-26T11:11:11.170 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 30/152 2024-04-26T11:11:11.334 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-26T11:11:11.339 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-26T11:11:11.369 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 31/152 2024-04-26T11:11:11.512 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/152 2024-04-26T11:11:11.546 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T11:11:11.772 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-26T11:11:11.794 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 34/152 2024-04-26T11:11:11.940 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T11:11:11.975 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-26T11:11:12.022 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T11:11:12.104 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T11:11:12.233 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T11:11:12.404 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T11:11:12.414 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/152 2024-04-26T11:11:12.428 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T11:11:12.503 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T11:11:12.639 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T11:11:12.722 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/152 2024-04-26T11:11:12.756 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/152 2024-04-26T11:11:12.808 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T11:11:12.957 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 13/152 2024-04-26T11:11:12.997 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T11:11:13.062 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 34/152 2024-04-26T11:11:13.095 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T11:11:13.174 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/152 2024-04-26T11:11:13.242 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-26T11:11:13.335 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/152 2024-04-26T11:11:13.383 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/152 2024-04-26T11:11:13.512 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 16/152 2024-04-26T11:11:13.569 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 13/152 2024-04-26T11:11:13.614 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 16/152 2024-04-26T11:11:13.757 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-26T11:11:13.762 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T11:11:13.845 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/152 2024-04-26T11:11:13.961 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T11:11:14.086 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 36/152 2024-04-26T11:11:14.095 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/152 2024-04-26T11:11:14.179 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-26T11:11:14.258 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 16/152 2024-04-26T11:11:14.289 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-26T11:11:14.308 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/152 2024-04-26T11:11:14.364 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 16/152 2024-04-26T11:11:14.506 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/152 2024-04-26T11:11:14.522 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T11:11:14.526 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/152 2024-04-26T11:11:14.702 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/152 2024-04-26T11:11:14.718 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 39/152 2024-04-26T11:11:14.837 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libquadmath-8.5.0-22.el8.x86_64 21/152 2024-04-26T11:11:14.852 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T11:11:14.971 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 40/152 2024-04-26T11:11:14.974 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libquadmath-8.5.0-22.el8.x86_64 21/152 2024-04-26T11:11:15.045 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-26T11:11:15.088 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-26T11:11:15.120 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libgfortran-8.5.0-22.el8.x86_64 22/152 2024-04-26T11:11:15.198 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 41/152 2024-04-26T11:11:15.213 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-26T11:11:15.396 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 36/152 2024-04-26T11:11:15.420 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/152 2024-04-26T11:11:15.422 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 42/152 2024-04-26T11:11:15.584 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/152 2024-04-26T11:11:15.616 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-26T11:11:15.654 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/152 2024-04-26T11:11:15.714 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libgfortran-8.5.0-22.el8.x86_64 22/152 2024-04-26T11:11:15.732 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-26T11:11:15.814 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libquadmath-8.5.0-22.el8.x86_64 21/152 2024-04-26T11:11:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/152 2024-04-26T11:11:15.900 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 44/152 2024-04-26T11:11:15.920 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/152 2024-04-26T11:11:15.959 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libquadmath-8.5.0-22.el8.x86_64 21/152 2024-04-26T11:11:15.991 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 44/152 2024-04-26T11:11:16.014 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 39/152 2024-04-26T11:11:16.139 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libgfortran-8.5.0-22.el8.x86_64 22/152 2024-04-26T11:11:16.155 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libuuid-devel-2.32.1-46.el8.x86_64 45/152 2024-04-26T11:11:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 40/152 2024-04-26T11:11:16.353 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/152 2024-04-26T11:11:16.473 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 41/152 2024-04-26T11:11:16.499 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-26T11:11:16.553 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/152 2024-04-26T11:11:16.690 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 42/152 2024-04-26T11:11:16.737 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-26T11:11:16.773 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libgfortran-8.5.0-22.el8.x86_64 22/152 2024-04-26T11:11:16.875 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-26T11:11:16.950 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-26T11:11:17.006 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/152 2024-04-26T11:11:17.042 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-26T11:11:17.125 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 44/152 2024-04-26T11:11:17.194 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 44/152 2024-04-26T11:11:17.325 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-26T11:11:17.339 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-26T11:11:17.384 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libuuid-devel-2.32.1-46.el8.x86_64 45/152 2024-04-26T11:11:17.417 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-26T11:11:17.560 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/152 2024-04-26T11:11:17.564 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/152 2024-04-26T11:11:17.662 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/152 2024-04-26T11:11:17.754 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/152 2024-04-26T11:11:17.784 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-26T11:11:17.833 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/152 2024-04-26T11:11:17.863 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-26T11:11:17.959 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/152 2024-04-26T11:11:18.089 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/152 2024-04-26T11:11:18.115 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/152 2024-04-26T11:11:18.312 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/152 2024-04-26T11:11:18.313 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-26T11:11:18.330 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/152 2024-04-26T11:11:18.477 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/152 2024-04-26T11:11:18.550 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-26T11:11:18.551 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 29/152 2024-04-26T11:11:18.564 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-26T11:11:18.609 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-26T11:11:18.715 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 30/152 2024-04-26T11:11:18.716 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/152 2024-04-26T11:11:18.760 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/152 2024-04-26T11:11:18.914 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 31/152 2024-04-26T11:11:18.970 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/152 2024-04-26T11:11:18.972 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/152 2024-04-26T11:11:19.050 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/152 2024-04-26T11:11:19.178 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/152 2024-04-26T11:11:19.202 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/152 2024-04-26T11:11:19.256 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/152 2024-04-26T11:11:19.364 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/152 2024-04-26T11:11:19.385 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/152 2024-04-26T11:11:19.454 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/152 2024-04-26T11:11:19.579 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/152 2024-04-26T11:11:19.618 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/152 2024-04-26T11:11:19.619 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/152 2024-04-26T11:11:19.785 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/152 2024-04-26T11:11:19.824 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/152 2024-04-26T11:11:19.845 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 29/152 2024-04-26T11:11:19.892 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/152 2024-04-26T11:11:19.986 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/152 2024-04-26T11:11:20.012 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 30/152 2024-04-26T11:11:20.036 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/152 2024-04-26T11:11:20.165 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/152 2024-04-26T11:11:20.250 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/152 2024-04-26T11:11:20.252 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/152 2024-04-26T11:11:20.286 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 31/152 2024-04-26T11:11:20.373 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/152 2024-04-26T11:11:20.428 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/152 2024-04-26T11:11:20.564 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/152 2024-04-26T11:11:20.589 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/152 2024-04-26T11:11:20.770 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/152 2024-04-26T11:11:20.821 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/152 2024-04-26T11:11:20.834 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 34/152 2024-04-26T11:11:20.939 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/152 2024-04-26T11:11:21.011 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-26T11:11:21.058 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/152 2024-04-26T11:11:21.116 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/152 2024-04-26T11:11:21.357 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/152 2024-04-26T11:11:21.393 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/152 2024-04-26T11:11:21.446 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/152 2024-04-26T11:11:21.574 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/152 2024-04-26T11:11:21.723 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/152 2024-04-26T11:11:21.760 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/152 2024-04-26T11:11:21.814 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/152 2024-04-26T11:11:21.987 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/152 2024-04-26T11:11:22.043 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/152 2024-04-26T11:11:22.054 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 34/152 2024-04-26T11:11:22.238 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-26T11:11:22.357 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/152 2024-04-26T11:11:22.633 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/152 2024-04-26T11:11:22.777 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-26T11:11:22.822 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/152 2024-04-26T11:11:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/152 2024-04-26T11:11:22.989 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 70/152 2024-04-26T11:11:23.065 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 36/152 2024-04-26T11:11:23.087 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 70/152 2024-04-26T11:11:23.245 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/152 2024-04-26T11:11:23.273 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 71/152 2024-04-26T11:11:23.451 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/152 2024-04-26T11:11:23.535 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-packaging-16.8-9.el8.noarch 72/152 2024-04-26T11:11:23.608 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/152 2024-04-26T11:11:23.624 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 39/152 2024-04-26T11:11:23.801 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 73/152 2024-04-26T11:11:23.807 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 70/152 2024-04-26T11:11:23.809 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 40/152 2024-04-26T11:11:23.879 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 70/152 2024-04-26T11:11:24.016 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 41/152 2024-04-26T11:11:24.092 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 71/152 2024-04-26T11:11:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 74/152 2024-04-26T11:11:24.203 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 42/152 2024-04-26T11:11:24.237 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-26T11:11:24.312 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-packaging-16.8-9.el8.noarch 72/152 2024-04-26T11:11:24.428 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-26T11:11:24.495 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-26T11:11:24.517 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 75/152 2024-04-26T11:11:24.527 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 73/152 2024-04-26T11:11:24.586 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 36/152 2024-04-26T11:11:24.703 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 44/152 2024-04-26T11:11:24.749 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 76/152 2024-04-26T11:11:24.771 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 44/152 2024-04-26T11:11:24.790 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/152 2024-04-26T11:11:24.883 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 74/152 2024-04-26T11:11:24.950 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libuuid-devel-2.32.1-46.el8.x86_64 45/152 2024-04-26T11:11:25.019 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 77/152 2024-04-26T11:11:25.029 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/152 2024-04-26T11:11:25.114 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/152 2024-04-26T11:11:25.210 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 75/152 2024-04-26T11:11:25.294 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-26T11:11:25.296 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 39/152 2024-04-26T11:11:25.336 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 78/152 2024-04-26T11:11:25.392 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 76/152 2024-04-26T11:11:25.569 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 40/152 2024-04-26T11:11:25.637 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 77/152 2024-04-26T11:11:25.795 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-26T11:11:25.802 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 41/152 2024-04-26T11:11:25.862 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 78/152 2024-04-26T11:11:26.044 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-26T11:11:26.054 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 42/152 2024-04-26T11:11:26.057 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-26T11:11:26.230 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/152 2024-04-26T11:11:26.321 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-26T11:11:26.359 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 79/152 2024-04-26T11:11:26.399 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-26T11:11:26.469 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/152 2024-04-26T11:11:26.604 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 44/152 2024-04-26T11:11:26.676 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 44/152 2024-04-26T11:11:26.684 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/152 2024-04-26T11:11:26.704 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 80/152 2024-04-26T11:11:26.866 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libuuid-devel-2.32.1-46.el8.x86_64 45/152 2024-04-26T11:11:26.873 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/152 2024-04-26T11:11:26.916 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 79/152 2024-04-26T11:11:26.963 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 81/152 2024-04-26T11:11:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/152 2024-04-26T11:11:27.112 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/152 2024-04-26T11:11:27.187 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 82/152 2024-04-26T11:11:27.253 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/152 2024-04-26T11:11:27.282 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 80/152 2024-04-26T11:11:27.312 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-26T11:11:27.459 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 83/152 2024-04-26T11:11:27.481 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/152 2024-04-26T11:11:27.548 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 81/152 2024-04-26T11:11:27.672 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/152 2024-04-26T11:11:27.689 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/152 2024-04-26T11:11:27.774 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 82/152 2024-04-26T11:11:27.839 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/152 2024-04-26T11:11:27.894 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-26T11:11:27.991 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 85/152 2024-04-26T11:11:27.991 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/152 2024-04-26T11:11:28.078 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 83/152 2024-04-26T11:11:28.156 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/152 2024-04-26T11:11:28.221 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-26T11:11:28.233 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 86/152 2024-04-26T11:11:28.236 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-26T11:11:28.308 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/152 2024-04-26T11:11:28.316 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/152 2024-04-26T11:11:28.433 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/152 2024-04-26T11:11:28.477 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/152 2024-04-26T11:11:28.568 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 85/152 2024-04-26T11:11:28.596 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 87/152 2024-04-26T11:11:28.659 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/152 2024-04-26T11:11:28.729 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/152 2024-04-26T11:11:28.801 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 88/152 2024-04-26T11:11:28.819 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 86/152 2024-04-26T11:11:28.892 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/152 2024-04-26T11:11:28.953 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/152 2024-04-26T11:11:29.007 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 89/152 2024-04-26T11:11:29.132 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/152 2024-04-26T11:11:29.147 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 87/152 2024-04-26T11:11:29.201 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/152 2024-04-26T11:11:29.211 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 90/152 2024-04-26T11:11:29.328 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/152 2024-04-26T11:11:29.354 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 88/152 2024-04-26T11:11:29.391 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/152 2024-04-26T11:11:29.501 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 89/152 2024-04-26T11:11:29.556 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 91/152 2024-04-26T11:11:29.592 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/152 2024-04-26T11:11:29.653 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 90/152 2024-04-26T11:11:29.671 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/152 2024-04-26T11:11:29.809 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 92/152 2024-04-26T11:11:29.827 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/152 2024-04-26T11:11:29.919 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/152 2024-04-26T11:11:29.951 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 93/152 2024-04-26T11:11:29.995 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 91/152 2024-04-26T11:11:30.092 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/152 2024-04-26T11:11:30.153 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/152 2024-04-26T11:11:30.211 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 92/152 2024-04-26T11:11:30.274 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/152 2024-04-26T11:11:30.343 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 93/152 2024-04-26T11:11:30.443 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/152 2024-04-26T11:11:30.458 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 94/152 2024-04-26T11:11:30.538 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 94/152 2024-04-26T11:11:30.642 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/152 2024-04-26T11:11:30.766 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 95/152 2024-04-26T11:11:30.835 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/152 2024-04-26T11:11:30.857 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 95/152 2024-04-26T11:11:30.951 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/152 2024-04-26T11:11:30.967 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fuse-2.9.7-19.el8.x86_64 96/152 2024-04-26T11:11:31.062 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/152 2024-04-26T11:11:31.090 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-2.9.7-19.el8.x86_64 96/152 2024-04-26T11:11:31.177 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 70/152 2024-04-26T11:11:31.198 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 97/152 2024-04-26T11:11:31.234 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 70/152 2024-04-26T11:11:31.255 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/152 2024-04-26T11:11:31.338 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 97/152 2024-04-26T11:11:31.349 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 98/152 2024-04-26T11:11:31.418 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 71/152 2024-04-26T11:11:31.498 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/152 2024-04-26T11:11:31.530 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 98/152 2024-04-26T11:11:31.639 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-packaging-16.8-9.el8.noarch 72/152 2024-04-26T11:11:31.747 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/152 2024-04-26T11:11:31.861 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 73/152 2024-04-26T11:11:32.034 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/152 2024-04-26T11:11:32.214 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 74/152 2024-04-26T11:11:32.399 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/152 2024-04-26T11:11:32.496 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 75/152 2024-04-26T11:11:32.654 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/152 2024-04-26T11:11:32.686 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 76/152 2024-04-26T11:11:32.901 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/152 2024-04-26T11:11:32.946 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 77/152 2024-04-26T11:11:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 78/152 2024-04-26T11:11:33.767 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/152 2024-04-26T11:11:33.924 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T11:11:34.004 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 70/152 2024-04-26T11:11:34.078 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 70/152 2024-04-26T11:11:34.132 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T11:11:34.182 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T11:11:34.214 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 79/152 2024-04-26T11:11:34.314 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 71/152 2024-04-26T11:11:34.429 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T11:11:34.535 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-packaging-16.8-9.el8.noarch 72/152 2024-04-26T11:11:34.584 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 80/152 2024-04-26T11:11:34.737 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T11:11:34.769 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 73/152 2024-04-26T11:11:34.809 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 81/152 2024-04-26T11:11:35.044 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T11:11:35.049 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 82/152 2024-04-26T11:11:35.067 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/152 2024-04-26T11:11:35.168 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 74/152 2024-04-26T11:11:35.339 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 83/152 2024-04-26T11:11:35.368 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/152 2024-04-26T11:11:35.474 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 75/152 2024-04-26T11:11:35.501 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/152 2024-04-26T11:11:35.577 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/152 2024-04-26T11:11:35.664 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/152 2024-04-26T11:11:35.697 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 76/152 2024-04-26T11:11:35.710 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/152 2024-04-26T11:11:35.812 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 85/152 2024-04-26T11:11:36.012 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 86/152 2024-04-26T11:11:36.023 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 77/152 2024-04-26T11:11:36.264 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/152 2024-04-26T11:11:36.295 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 78/152 2024-04-26T11:11:36.364 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 87/152 2024-04-26T11:11:36.598 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 88/152 2024-04-26T11:11:36.770 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 89/152 2024-04-26T11:11:36.963 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 90/152 2024-04-26T11:11:37.266 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 91/152 2024-04-26T11:11:37.426 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 79/152 2024-04-26T11:11:37.488 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 92/152 2024-04-26T11:11:37.629 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 93/152 2024-04-26T11:11:37.848 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 94/152 2024-04-26T11:11:37.871 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 80/152 2024-04-26T11:11:38.102 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 95/152 2024-04-26T11:11:38.103 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 81/152 2024-04-26T11:11:38.327 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : fuse-2.9.7-19.el8.x86_64 96/152 2024-04-26T11:11:38.332 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 82/152 2024-04-26T11:11:38.534 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 97/152 2024-04-26T11:11:38.685 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 98/152 2024-04-26T11:11:38.717 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 83/152 2024-04-26T11:11:39.005 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/152 2024-04-26T11:11:39.299 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 85/152 2024-04-26T11:11:39.541 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 86/152 2024-04-26T11:11:39.964 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 87/152 2024-04-26T11:11:40.191 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 88/152 2024-04-26T11:11:40.363 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 89/152 2024-04-26T11:11:40.629 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 90/152 2024-04-26T11:11:40.979 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 91/152 2024-04-26T11:11:41.215 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 92/152 2024-04-26T11:11:41.257 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T11:11:41.376 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 93/152 2024-04-26T11:11:41.656 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 94/152 2024-04-26T11:11:41.718 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T11:11:41.896 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 95/152 2024-04-26T11:11:42.130 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : fuse-2.9.7-19.el8.x86_64 96/152 2024-04-26T11:11:42.310 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T11:11:42.353 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 97/152 2024-04-26T11:11:42.561 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 98/152 2024-04-26T11:11:42.624 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/152 2024-04-26T11:11:42.734 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/152 2024-04-26T11:11:42.917 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/152 2024-04-26T11:11:45.425 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T11:11:45.711 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T11:11:46.341 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T11:11:46.729 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/152 2024-04-26T11:11:46.845 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/152 2024-04-26T11:11:47.110 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/152 2024-04-26T11:11:55.324 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/152 2024-04-26T11:11:55.324 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /sys 2024-04-26T11:11:55.324 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /proc 2024-04-26T11:11:55.324 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /dev 2024-04-26T11:11:55.324 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /run 2024-04-26T11:11:55.325 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /mnt 2024-04-26T11:11:55.325 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /var/tmp 2024-04-26T11:11:55.325 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /home 2024-04-26T11:11:55.325 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /tmp 2024-04-26T11:11:55.325 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /dev 2024-04-26T11:11:55.325 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:11:55.716 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 102/152 2024-04-26T11:11:57.176 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/152 2024-04-26T11:11:57.176 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /sys 2024-04-26T11:11:57.176 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /proc 2024-04-26T11:11:57.176 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /dev 2024-04-26T11:11:57.176 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /run 2024-04-26T11:11:57.176 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /mnt 2024-04-26T11:11:57.177 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /var/tmp 2024-04-26T11:11:57.177 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /home 2024-04-26T11:11:57.177 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /tmp 2024-04-26T11:11:57.177 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /dev 2024-04-26T11:11:57.177 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:11:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 102/152 2024-04-26T11:11:57.529 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 102/152 2024-04-26T11:11:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/152 2024-04-26T11:11:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/152 2024-04-26T11:11:57.974 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/152 2024-04-26T11:11:58.448 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/152 2024-04-26T11:11:58.690 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 105/152 2024-04-26T11:11:58.714 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 105/152 2024-04-26T11:11:58.988 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 106/152 2024-04-26T11:11:59.176 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 102/152 2024-04-26T11:11:59.251 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 107/152 2024-04-26T11:11:59.397 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/152 2024-04-26T11:11:59.406 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-26T11:11:59.516 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-26T11:11:59.614 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/152 2024-04-26T11:11:59.783 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : jq-1.6-8.el8.x86_64 109/152 2024-04-26T11:11:59.812 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/152 2024-04-26T11:12:00.025 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : automake-1.16.1-8.el8.noarch 110/152 2024-04-26T11:12:00.285 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/152 2024-04-26T11:12:00.478 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 105/152 2024-04-26T11:12:00.502 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 105/152 2024-04-26T11:12:00.629 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 111/152 2024-04-26T11:12:00.752 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 106/152 2024-04-26T11:12:00.831 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 111/152 2024-04-26T11:12:00.988 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 112/152 2024-04-26T11:12:00.989 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 107/152 2024-04-26T11:12:01.136 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-26T11:12:01.218 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-26T11:12:01.240 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 113/152 2024-04-26T11:12:01.490 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 114/152 2024-04-26T11:12:01.497 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : jq-1.6-8.el8.x86_64 109/152 2024-04-26T11:12:01.703 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : automake-1.16.1-8.el8.noarch 110/152 2024-04-26T11:12:02.242 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 111/152 2024-04-26T11:12:02.256 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/152 2024-04-26T11:12:02.257 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /sys 2024-04-26T11:12:02.257 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /proc 2024-04-26T11:12:02.257 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /dev 2024-04-26T11:12:02.257 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /run 2024-04-26T11:12:02.257 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /mnt 2024-04-26T11:12:02.257 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /var/tmp 2024-04-26T11:12:02.257 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /home 2024-04-26T11:12:02.257 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /tmp 2024-04-26T11:12:02.257 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /dev 2024-04-26T11:12:02.257 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:02.424 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 111/152 2024-04-26T11:12:02.503 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 114/152 2024-04-26T11:12:02.543 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 112/152 2024-04-26T11:12:02.632 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 102/152 2024-04-26T11:12:02.720 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 113/152 2024-04-26T11:12:02.834 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 115/152 2024-04-26T11:12:02.903 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 114/152 2024-04-26T11:12:03.797 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 115/152 2024-04-26T11:12:03.917 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 114/152 2024-04-26T11:12:04.014 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 116/152 2024-04-26T11:12:04.105 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 116/152 2024-04-26T11:12:04.179 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 115/152 2024-04-26T11:12:04.272 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 102/152 2024-04-26T11:12:04.496 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/152 2024-04-26T11:12:04.606 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 117/152 2024-04-26T11:12:04.714 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/152 2024-04-26T11:12:04.881 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/152 2024-04-26T11:12:04.911 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/152 2024-04-26T11:12:04.948 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/152 2024-04-26T11:12:05.142 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 115/152 2024-04-26T11:12:05.155 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 119/152 2024-04-26T11:12:05.166 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 119/152 2024-04-26T11:12:05.328 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 116/152 2024-04-26T11:12:05.353 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 120/152 2024-04-26T11:12:05.355 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/152 2024-04-26T11:12:05.420 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 116/152 2024-04-26T11:12:05.540 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 105/152 2024-04-26T11:12:05.546 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libtool-2.4.6-25.el8.x86_64 121/152 2024-04-26T11:12:05.563 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 105/152 2024-04-26T11:12:05.783 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 117/152 2024-04-26T11:12:05.788 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 106/152 2024-04-26T11:12:05.988 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/152 2024-04-26T11:12:06.009 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 107/152 2024-04-26T11:12:06.025 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/152 2024-04-26T11:12:06.181 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-26T11:12:06.194 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 119/152 2024-04-26T11:12:06.205 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 119/152 2024-04-26T11:12:06.265 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-26T11:12:06.374 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 120/152 2024-04-26T11:12:06.544 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libtool-2.4.6-25.el8.x86_64 121/152 2024-04-26T11:12:06.551 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : jq-1.6-8.el8.x86_64 109/152 2024-04-26T11:12:06.789 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : automake-1.16.1-8.el8.noarch 110/152 2024-04-26T11:12:07.296 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 111/152 2024-04-26T11:12:07.457 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 111/152 2024-04-26T11:12:07.570 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 112/152 2024-04-26T11:12:07.756 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 113/152 2024-04-26T11:12:07.997 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 114/152 2024-04-26T11:12:09.008 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 114/152 2024-04-26T11:12:09.132 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/152 2024-04-26T11:12:09.132 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /sys 2024-04-26T11:12:09.132 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /proc 2024-04-26T11:12:09.132 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /dev 2024-04-26T11:12:09.132 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /run 2024-04-26T11:12:09.132 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /mnt 2024-04-26T11:12:09.133 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /var/tmp 2024-04-26T11:12:09.133 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /home 2024-04-26T11:12:09.133 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /tmp 2024-04-26T11:12:09.133 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /dev 2024-04-26T11:12:09.133 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:09.262 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 115/152 2024-04-26T11:12:09.533 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 102/152 2024-04-26T11:12:10.027 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 121/152 2024-04-26T11:12:10.224 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 115/152 2024-04-26T11:12:10.431 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 116/152 2024-04-26T11:12:10.522 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 116/152 2024-04-26T11:12:10.891 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 117/152 2024-04-26T11:12:11.012 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 121/152 2024-04-26T11:12:11.087 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/152 2024-04-26T11:12:11.124 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/152 2024-04-26T11:12:11.283 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 102/152 2024-04-26T11:12:11.297 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 119/152 2024-04-26T11:12:11.307 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 119/152 2024-04-26T11:12:11.486 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 120/152 2024-04-26T11:12:11.496 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 122/152 2024-04-26T11:12:11.542 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/152 2024-04-26T11:12:11.647 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libtool-2.4.6-25.el8.x86_64 121/152 2024-04-26T11:12:11.734 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T11:12:11.768 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T11:12:11.773 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/152 2024-04-26T11:12:11.983 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/152 2024-04-26T11:12:12.004 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 124/152 2024-04-26T11:12:12.350 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 124/152 2024-04-26T11:12:12.433 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 122/152 2024-04-26T11:12:12.487 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/152 2024-04-26T11:12:12.579 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T11:12:12.629 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T11:12:12.662 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T11:12:12.671 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T11:12:12.716 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 105/152 2024-04-26T11:12:12.740 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 105/152 2024-04-26T11:12:12.852 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 124/152 2024-04-26T11:12:13.082 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 106/152 2024-04-26T11:12:13.197 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 124/152 2024-04-26T11:12:13.328 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 107/152 2024-04-26T11:12:13.377 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T11:12:13.469 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T11:12:13.482 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-26T11:12:13.562 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 126/152 2024-04-26T11:12:13.569 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-26T11:12:13.890 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : jq-1.6-8.el8.x86_64 109/152 2024-04-26T11:12:13.958 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 127/152 2024-04-26T11:12:14.167 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 128/152 2024-04-26T11:12:14.174 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : automake-1.16.1-8.el8.noarch 110/152 2024-04-26T11:12:14.334 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 126/152 2024-04-26T11:12:14.373 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 129/152 2024-04-26T11:12:14.583 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 130/152 2024-04-26T11:12:14.648 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 127/152 2024-04-26T11:12:14.741 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 111/152 2024-04-26T11:12:14.812 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 131/152 2024-04-26T11:12:14.824 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 128/152 2024-04-26T11:12:14.995 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 111/152 2024-04-26T11:12:15.030 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 129/152 2024-04-26T11:12:15.061 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 132/152 2024-04-26T11:12:15.117 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 112/152 2024-04-26T11:12:15.197 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 130/152 2024-04-26T11:12:15.304 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 113/152 2024-04-26T11:12:15.386 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 131/152 2024-04-26T11:12:15.416 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 133/152 2024-04-26T11:12:15.531 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 114/152 2024-04-26T11:12:15.643 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 132/152 2024-04-26T11:12:15.687 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 134/152 2024-04-26T11:12:15.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/152 2024-04-26T11:12:15.950 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 133/152 2024-04-26T11:12:16.108 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 121/152 2024-04-26T11:12:16.169 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/152 2024-04-26T11:12:16.203 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 134/152 2024-04-26T11:12:16.256 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/152 2024-04-26T11:12:16.397 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/152 2024-04-26T11:12:16.544 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/152 2024-04-26T11:12:16.565 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/152 2024-04-26T11:12:16.609 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/152 2024-04-26T11:12:16.620 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 114/152 2024-04-26T11:12:16.699 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/152 2024-04-26T11:12:16.771 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 138/152 2024-04-26T11:12:16.929 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 139/152 2024-04-26T11:12:16.950 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 115/152 2024-04-26T11:12:16.952 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/152 2024-04-26T11:12:16.981 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/152 2024-04-26T11:12:17.153 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 138/152 2024-04-26T11:12:17.184 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 140/152 2024-04-26T11:12:17.184 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-26T11:12:17.316 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 139/152 2024-04-26T11:12:17.463 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-26T11:12:17.464 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-26T11:12:17.523 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 122/152 2024-04-26T11:12:17.526 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 140/152 2024-04-26T11:12:17.526 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-26T11:12:17.737 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T11:12:17.756 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-26T11:12:17.756 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-26T11:12:17.769 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T11:12:17.771 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-26T11:12:17.771 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-26T11:12:17.954 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 124/152 2024-04-26T11:12:17.972 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 115/152 2024-04-26T11:12:18.030 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-26T11:12:18.038 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-26T11:12:18.038 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-26T11:12:18.182 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 116/152 2024-04-26T11:12:18.230 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 144/152 2024-04-26T11:12:18.280 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 116/152 2024-04-26T11:12:18.295 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-26T11:12:18.301 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 124/152 2024-04-26T11:12:18.464 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 144/152 2024-04-26T11:12:18.479 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 145/152 2024-04-26T11:12:18.479 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-26T11:12:18.480 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T11:12:18.571 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T11:12:18.670 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 145/152 2024-04-26T11:12:18.670 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-26T11:12:18.704 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 117/152 2024-04-26T11:12:18.730 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-26T11:12:18.730 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 147/152 2024-04-26T11:12:18.877 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-26T11:12:18.877 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 147/152 2024-04-26T11:12:18.972 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 147/152 2024-04-26T11:12:18.972 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-26T11:12:19.000 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/152 2024-04-26T11:12:19.040 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/152 2024-04-26T11:12:19.104 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 147/152 2024-04-26T11:12:19.104 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-26T11:12:19.163 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-26T11:12:19.163 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-26T11:12:19.231 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 119/152 2024-04-26T11:12:19.242 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 119/152 2024-04-26T11:12:19.303 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-26T11:12:19.304 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-26T11:12:19.396 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-26T11:12:19.396 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-26T11:12:19.435 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 120/152 2024-04-26T11:12:19.458 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 126/152 2024-04-26T11:12:19.486 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-26T11:12:19.487 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-26T11:12:19.606 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-26T11:12:19.606 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-26T11:12:19.623 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libtool-2.4.6-25.el8.x86_64 121/152 2024-04-26T11:12:19.695 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-26T11:12:19.695 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-26T11:12:19.784 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 127/152 2024-04-26T11:12:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-26T11:12:19.959 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 128/152 2024-04-26T11:12:19.971 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-26T11:12:20.052 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-26T11:12:20.151 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-26T11:12:20.199 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 129/152 2024-04-26T11:12:20.366 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 130/152 2024-04-26T11:12:20.538 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 131/152 2024-04-26T11:12:20.664 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-26T11:12:20.664 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 1/152 2024-04-26T11:12:20.664 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2/152 2024-04-26T11:12:20.664 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 3/152 2024-04-26T11:12:20.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 4/152 2024-04-26T11:12:20.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/152 2024-04-26T11:12:20.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 6/152 2024-04-26T11:12:20.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 7/152 2024-04-26T11:12:20.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 8/152 2024-04-26T11:12:20.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T11:12:20.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T11:12:20.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T11:12:20.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/152 2024-04-26T11:12:20.665 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 13/152 2024-04-26T11:12:20.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 14/152 2024-04-26T11:12:20.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/152 2024-04-26T11:12:20.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 16/152 2024-04-26T11:12:20.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T11:12:20.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 18/152 2024-04-26T11:12:20.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/152 2024-04-26T11:12:20.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 20/152 2024-04-26T11:12:20.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 21/152 2024-04-26T11:12:20.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 22/152 2024-04-26T11:12:20.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 23/152 2024-04-26T11:12:20.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 24/152 2024-04-26T11:12:20.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 25/152 2024-04-26T11:12:20.666 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 26/152 2024-04-26T11:12:20.667 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 27/152 2024-04-26T11:12:20.667 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/152 2024-04-26T11:12:20.667 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 29/152 2024-04-26T11:12:20.667 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 30/152 2024-04-26T11:12:20.667 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/152 2024-04-26T11:12:20.667 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/152 2024-04-26T11:12:20.667 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 33/152 2024-04-26T11:12:20.668 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/152 2024-04-26T11:12:20.668 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 35/152 2024-04-26T11:12:20.668 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 36/152 2024-04-26T11:12:20.668 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : automake-1.16.1-8.el8.noarch 37/152 2024-04-26T11:12:20.668 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/152 2024-04-26T11:12:20.668 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/152 2024-04-26T11:12:20.669 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : jq-1.6-8.el8.x86_64 40/152 2024-04-26T11:12:20.669 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 41/152 2024-04-26T11:12:20.669 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/152 2024-04-26T11:12:20.670 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/152 2024-04-26T11:12:20.670 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 44/152 2024-04-26T11:12:20.670 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 45/152 2024-04-26T11:12:20.670 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 46/152 2024-04-26T11:12:20.670 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 47/152 2024-04-26T11:12:20.670 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 48/152 2024-04-26T11:12:20.670 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 49/152 2024-04-26T11:12:20.670 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 50/152 2024-04-26T11:12:20.670 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 51/152 2024-04-26T11:12:20.671 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/152 2024-04-26T11:12:20.671 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/152 2024-04-26T11:12:20.671 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/152 2024-04-26T11:12:20.671 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/152 2024-04-26T11:12:20.671 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/152 2024-04-26T11:12:20.671 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/152 2024-04-26T11:12:20.672 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/152 2024-04-26T11:12:20.672 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 59/152 2024-04-26T11:12:20.672 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 60/152 2024-04-26T11:12:20.672 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 61/152 2024-04-26T11:12:20.672 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 62/152 2024-04-26T11:12:20.672 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 63/152 2024-04-26T11:12:20.672 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 64/152 2024-04-26T11:12:20.672 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 65/152 2024-04-26T11:12:20.673 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/152 2024-04-26T11:12:20.673 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 67/152 2024-04-26T11:12:20.673 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/152 2024-04-26T11:12:20.673 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 69/152 2024-04-26T11:12:20.673 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgfortran-8.5.0-22.el8.x86_64 70/152 2024-04-26T11:12:20.674 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libquadmath-8.5.0-22.el8.x86_64 71/152 2024-04-26T11:12:20.674 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 72/152 2024-04-26T11:12:20.674 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 73/152 2024-04-26T11:12:20.674 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/152 2024-04-26T11:12:20.674 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-devel-2.32.1-46.el8.x86_64 75/152 2024-04-26T11:12:20.675 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 76/152 2024-04-26T11:12:20.675 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/152 2024-04-26T11:12:20.675 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 78/152 2024-04-26T11:12:20.675 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 79/152 2024-04-26T11:12:20.675 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 80/152 2024-04-26T11:12:20.675 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 81/152 2024-04-26T11:12:20.676 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 82/152 2024-04-26T11:12:20.676 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 83/152 2024-04-26T11:12:20.676 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/152 2024-04-26T11:12:20.676 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/152 2024-04-26T11:12:20.676 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/152 2024-04-26T11:12:20.677 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 87/152 2024-04-26T11:12:20.677 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 88/152 2024-04-26T11:12:20.677 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 89/152 2024-04-26T11:12:20.677 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 90/152 2024-04-26T11:12:20.677 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 91/152 2024-04-26T11:12:20.678 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 92/152 2024-04-26T11:12:20.678 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 93/152 2024-04-26T11:12:20.678 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 94/152 2024-04-26T11:12:20.678 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 95/152 2024-04-26T11:12:20.678 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 96/152 2024-04-26T11:12:20.678 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 97/152 2024-04-26T11:12:20.679 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 98/152 2024-04-26T11:12:20.679 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 99/152 2024-04-26T11:12:20.679 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 100/152 2024-04-26T11:12:20.679 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 101/152 2024-04-26T11:12:20.679 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 102/152 2024-04-26T11:12:20.680 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 103/152 2024-04-26T11:12:20.680 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 104/152 2024-04-26T11:12:20.680 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 105/152 2024-04-26T11:12:20.680 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 106/152 2024-04-26T11:12:20.680 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 107/152 2024-04-26T11:12:20.681 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 108/152 2024-04-26T11:12:20.681 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-portend-2.6-1.el8.noarch 109/152 2024-04-26T11:12:20.681 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 110/152 2024-04-26T11:12:20.681 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 111/152 2024-04-26T11:12:20.681 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 112/152 2024-04-26T11:12:20.681 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 113/152 2024-04-26T11:12:20.682 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 114/152 2024-04-26T11:12:20.682 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 115/152 2024-04-26T11:12:20.682 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 116/152 2024-04-26T11:12:20.682 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 117/152 2024-04-26T11:12:20.682 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 118/152 2024-04-26T11:12:20.683 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 119/152 2024-04-26T11:12:20.683 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 120/152 2024-04-26T11:12:20.683 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 121/152 2024-04-26T11:12:20.683 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 122/152 2024-04-26T11:12:20.683 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T11:12:20.683 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/152 2024-04-26T11:12:20.684 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T11:12:20.684 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/152 2024-04-26T11:12:20.684 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 127/152 2024-04-26T11:12:20.684 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 128/152 2024-04-26T11:12:20.684 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 129/152 2024-04-26T11:12:20.685 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 130/152 2024-04-26T11:12:20.685 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 131/152 2024-04-26T11:12:20.685 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 132/152 2024-04-26T11:12:20.685 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 133/152 2024-04-26T11:12:20.685 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 134/152 2024-04-26T11:12:20.686 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 135/152 2024-04-26T11:12:20.686 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 136/152 2024-04-26T11:12:20.686 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 137/152 2024-04-26T11:12:20.686 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 138/152 2024-04-26T11:12:20.686 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 139/152 2024-04-26T11:12:20.686 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 140/152 2024-04-26T11:12:20.687 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 141/152 2024-04-26T11:12:20.687 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 142/152 2024-04-26T11:12:20.687 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 143/152 2024-04-26T11:12:20.687 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 144/152 2024-04-26T11:12:20.687 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 145/152 2024-04-26T11:12:20.688 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 146/152 2024-04-26T11:12:20.688 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 147/152 2024-04-26T11:12:20.688 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 148/152 2024-04-26T11:12:20.688 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 149/152 2024-04-26T11:12:20.688 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 150/152 2024-04-26T11:12:20.688 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 151/152 2024-04-26T11:12:20.749 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-26T11:12:20.750 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 1/152 2024-04-26T11:12:20.750 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2/152 2024-04-26T11:12:20.750 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 3/152 2024-04-26T11:12:20.750 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 4/152 2024-04-26T11:12:20.750 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/152 2024-04-26T11:12:20.750 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 6/152 2024-04-26T11:12:20.750 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 7/152 2024-04-26T11:12:20.750 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 8/152 2024-04-26T11:12:20.750 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T11:12:20.750 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T11:12:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T11:12:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/152 2024-04-26T11:12:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 13/152 2024-04-26T11:12:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 14/152 2024-04-26T11:12:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/152 2024-04-26T11:12:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 16/152 2024-04-26T11:12:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T11:12:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 18/152 2024-04-26T11:12:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/152 2024-04-26T11:12:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 20/152 2024-04-26T11:12:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 21/152 2024-04-26T11:12:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 22/152 2024-04-26T11:12:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 23/152 2024-04-26T11:12:20.752 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 24/152 2024-04-26T11:12:20.752 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 25/152 2024-04-26T11:12:20.752 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 26/152 2024-04-26T11:12:20.752 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 27/152 2024-04-26T11:12:20.752 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/152 2024-04-26T11:12:20.752 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 29/152 2024-04-26T11:12:20.752 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 30/152 2024-04-26T11:12:20.752 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/152 2024-04-26T11:12:20.752 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/152 2024-04-26T11:12:20.752 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 33/152 2024-04-26T11:12:20.752 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/152 2024-04-26T11:12:20.753 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 35/152 2024-04-26T11:12:20.753 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 36/152 2024-04-26T11:12:20.753 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : automake-1.16.1-8.el8.noarch 37/152 2024-04-26T11:12:20.753 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/152 2024-04-26T11:12:20.753 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/152 2024-04-26T11:12:20.753 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : jq-1.6-8.el8.x86_64 40/152 2024-04-26T11:12:20.753 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 41/152 2024-04-26T11:12:20.753 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/152 2024-04-26T11:12:20.753 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/152 2024-04-26T11:12:20.753 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 44/152 2024-04-26T11:12:20.753 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 45/152 2024-04-26T11:12:20.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 46/152 2024-04-26T11:12:20.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 47/152 2024-04-26T11:12:20.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 48/152 2024-04-26T11:12:20.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 49/152 2024-04-26T11:12:20.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 50/152 2024-04-26T11:12:20.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 51/152 2024-04-26T11:12:20.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/152 2024-04-26T11:12:20.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/152 2024-04-26T11:12:20.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/152 2024-04-26T11:12:20.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/152 2024-04-26T11:12:20.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/152 2024-04-26T11:12:20.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/152 2024-04-26T11:12:20.754 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/152 2024-04-26T11:12:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 59/152 2024-04-26T11:12:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 60/152 2024-04-26T11:12:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 61/152 2024-04-26T11:12:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 62/152 2024-04-26T11:12:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 63/152 2024-04-26T11:12:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 64/152 2024-04-26T11:12:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 65/152 2024-04-26T11:12:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/152 2024-04-26T11:12:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 67/152 2024-04-26T11:12:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/152 2024-04-26T11:12:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 69/152 2024-04-26T11:12:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgfortran-8.5.0-22.el8.x86_64 70/152 2024-04-26T11:12:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libquadmath-8.5.0-22.el8.x86_64 71/152 2024-04-26T11:12:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 72/152 2024-04-26T11:12:20.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 73/152 2024-04-26T11:12:20.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/152 2024-04-26T11:12:20.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-devel-2.32.1-46.el8.x86_64 75/152 2024-04-26T11:12:20.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 76/152 2024-04-26T11:12:20.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/152 2024-04-26T11:12:20.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 78/152 2024-04-26T11:12:20.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 79/152 2024-04-26T11:12:20.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 80/152 2024-04-26T11:12:20.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 81/152 2024-04-26T11:12:20.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 82/152 2024-04-26T11:12:20.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 83/152 2024-04-26T11:12:20.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/152 2024-04-26T11:12:20.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/152 2024-04-26T11:12:20.756 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/152 2024-04-26T11:12:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 87/152 2024-04-26T11:12:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 88/152 2024-04-26T11:12:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 89/152 2024-04-26T11:12:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 90/152 2024-04-26T11:12:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 91/152 2024-04-26T11:12:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 92/152 2024-04-26T11:12:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 93/152 2024-04-26T11:12:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 94/152 2024-04-26T11:12:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 95/152 2024-04-26T11:12:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 96/152 2024-04-26T11:12:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 97/152 2024-04-26T11:12:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 98/152 2024-04-26T11:12:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 99/152 2024-04-26T11:12:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 100/152 2024-04-26T11:12:20.758 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 101/152 2024-04-26T11:12:20.758 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 102/152 2024-04-26T11:12:20.758 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 103/152 2024-04-26T11:12:20.758 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 104/152 2024-04-26T11:12:20.758 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 105/152 2024-04-26T11:12:20.758 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 106/152 2024-04-26T11:12:20.758 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 107/152 2024-04-26T11:12:20.758 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 108/152 2024-04-26T11:12:20.758 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-portend-2.6-1.el8.noarch 109/152 2024-04-26T11:12:20.758 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 110/152 2024-04-26T11:12:20.758 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 111/152 2024-04-26T11:12:20.758 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 112/152 2024-04-26T11:12:20.758 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 113/152 2024-04-26T11:12:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 114/152 2024-04-26T11:12:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 115/152 2024-04-26T11:12:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 116/152 2024-04-26T11:12:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 117/152 2024-04-26T11:12:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 118/152 2024-04-26T11:12:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 119/152 2024-04-26T11:12:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 120/152 2024-04-26T11:12:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 121/152 2024-04-26T11:12:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 122/152 2024-04-26T11:12:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T11:12:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/152 2024-04-26T11:12:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T11:12:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/152 2024-04-26T11:12:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 127/152 2024-04-26T11:12:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 128/152 2024-04-26T11:12:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 129/152 2024-04-26T11:12:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 130/152 2024-04-26T11:12:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 131/152 2024-04-26T11:12:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 132/152 2024-04-26T11:12:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 133/152 2024-04-26T11:12:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 134/152 2024-04-26T11:12:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 135/152 2024-04-26T11:12:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 136/152 2024-04-26T11:12:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 137/152 2024-04-26T11:12:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 138/152 2024-04-26T11:12:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 139/152 2024-04-26T11:12:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 140/152 2024-04-26T11:12:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 141/152 2024-04-26T11:12:20.761 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 142/152 2024-04-26T11:12:20.761 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 143/152 2024-04-26T11:12:20.761 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 144/152 2024-04-26T11:12:20.761 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 145/152 2024-04-26T11:12:20.761 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 146/152 2024-04-26T11:12:20.761 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 147/152 2024-04-26T11:12:20.761 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 148/152 2024-04-26T11:12:20.761 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 149/152 2024-04-26T11:12:20.761 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 150/152 2024-04-26T11:12:20.761 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 151/152 2024-04-26T11:12:20.762 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 132/152 2024-04-26T11:12:21.041 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 133/152 2024-04-26T11:12:21.297 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 134/152 2024-04-26T11:12:21.486 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/152 2024-04-26T11:12:21.738 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/152 2024-04-26T11:12:21.820 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/152 2024-04-26T11:12:22.062 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/152 2024-04-26T11:12:22.079 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/152 2024-04-26T11:12:22.247 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 138/152 2024-04-26T11:12:22.390 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 139/152 2024-04-26T11:12:22.552 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 152/152 2024-04-26T11:12:22.552 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:22.553 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2024-04-26T11:12:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-04-26T11:12:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-04-26T11:12:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-04-26T11:12:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: libblkid-2.32.1-46.el8.x86_64 2024-04-26T11:12:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-04-26T11:12:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: libmount-2.32.1-46.el8.x86_64 2024-04-26T11:12:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-04-26T11:12:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-2.32.1-46.el8.x86_64 2024-04-26T11:12:22.553 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-04-26T11:12:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-04-26T11:12:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-2.32.1-46.el8.x86_64 2024-04-26T11:12:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-04-26T11:12:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-26T11:12:22.554 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-04-26T11:12:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: automake-1.16.1-8.el8.noarch 2024-04-26T11:12:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: bison-3.0.4-10.el8.x86_64 2024-04-26T11:12:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.554 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:22.555 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-04-26T11:12:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: flex-2.6.1-9.el8.x86_64 2024-04-26T11:12:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: fuse-2.9.7-19.el8.x86_64 2024-04-26T11:12:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-26T11:12:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: jq-1.6-8.el8.x86_64 2024-04-26T11:12:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-26T11:12:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-04-26T11:12:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-26T11:12:22.556 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-04-26T11:12:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran-8.5.0-22.el8.x86_64 2024-04-26T11:12:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-26T11:12:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath-8.5.0-22.el8.x86_64 2024-04-26T11:12:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-26T11:12:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-26T11:12:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.557 INFO:teuthology.orchestra.run.smithi072.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-04-26T11:12:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-26T11:12:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-26T11:12:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-26T11:12:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel-2.32.1-46.el8.x86_64 2024-04-26T11:12:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-04-26T11:12:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-26T11:12:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-26T11:12:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-04-26T11:12:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-26T11:12:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-26T11:12:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-04-26T11:12:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-04-26T11:12:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-04-26T11:12:22.558 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-04-26T11:12:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-26T11:12:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-26T11:12:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-26T11:12:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-26T11:12:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-26T11:12:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-26T11:12:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-26T11:12:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-26T11:12:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-26T11:12:22.559 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-26T11:12:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-26T11:12:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-26T11:12:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-26T11:12:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-04-26T11:12:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-26T11:12:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-26T11:12:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-26T11:12:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-26T11:12:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-26T11:12:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-26T11:12:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-26T11:12:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-26T11:12:22.560 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-26T11:12:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-26T11:12:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-26T11:12:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-26T11:12:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-26T11:12:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-26T11:12:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend-2.6-1.el8.noarch 2024-04-26T11:12:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-26T11:12:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-26T11:12:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-26T11:12:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-26T11:12:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-26T11:12:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-26T11:12:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.561 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-26T11:12:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-26T11:12:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-26T11:12:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-26T11:12:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-26T11:12:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-26T11:12:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-26T11:12:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-26T11:12:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-26T11:12:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-26T11:12:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-26T11:12:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-26T11:12:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-26T11:12:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-26T11:12:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-26T11:12:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-26T11:12:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-26T11:12:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-26T11:12:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-26T11:12:22.564 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-04-26T11:12:22.564 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:22.564 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-04-26T11:12:22.573 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 140/152 2024-04-26T11:12:22.573 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-26T11:12:22.595 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 152/152 2024-04-26T11:12:22.595 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:22.595 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2024-04-26T11:12:22.595 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-04-26T11:12:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-04-26T11:12:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-04-26T11:12:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: libblkid-2.32.1-46.el8.x86_64 2024-04-26T11:12:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-04-26T11:12:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: libmount-2.32.1-46.el8.x86_64 2024-04-26T11:12:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-04-26T11:12:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-2.32.1-46.el8.x86_64 2024-04-26T11:12:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-04-26T11:12:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-04-26T11:12:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-2.32.1-46.el8.x86_64 2024-04-26T11:12:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-04-26T11:12:22.597 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-26T11:12:22.597 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-04-26T11:12:22.597 INFO:teuthology.orchestra.run.smithi082.stdout: automake-1.16.1-8.el8.noarch 2024-04-26T11:12:22.597 INFO:teuthology.orchestra.run.smithi082.stdout: bison-3.0.4-10.el8.x86_64 2024-04-26T11:12:22.597 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.597 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.597 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.597 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.597 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:22.597 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.597 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.597 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.597 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:22.598 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:22.598 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:22.598 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:22.598 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:22.598 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.598 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.598 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:22.598 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.598 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.598 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.598 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:22.598 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:22.599 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-04-26T11:12:22.599 INFO:teuthology.orchestra.run.smithi082.stdout: flex-2.6.1-9.el8.x86_64 2024-04-26T11:12:22.599 INFO:teuthology.orchestra.run.smithi082.stdout: fuse-2.9.7-19.el8.x86_64 2024-04-26T11:12:22.599 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-26T11:12:22.599 INFO:teuthology.orchestra.run.smithi082.stdout: jq-1.6-8.el8.x86_64 2024-04-26T11:12:22.599 INFO:teuthology.orchestra.run.smithi082.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-26T11:12:22.599 INFO:teuthology.orchestra.run.smithi082.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-04-26T11:12:22.599 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-26T11:12:22.599 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.599 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.599 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.600 INFO:teuthology.orchestra.run.smithi082.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-04-26T11:12:22.600 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran-8.5.0-22.el8.x86_64 2024-04-26T11:12:22.600 INFO:teuthology.orchestra.run.smithi082.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-26T11:12:22.600 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath-8.5.0-22.el8.x86_64 2024-04-26T11:12:22.600 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-26T11:12:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-26T11:12:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-04-26T11:12:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-26T11:12:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-26T11:12:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-26T11:12:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel-2.32.1-46.el8.x86_64 2024-04-26T11:12:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-04-26T11:12:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-26T11:12:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-26T11:12:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-04-26T11:12:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-26T11:12:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-26T11:12:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-04-26T11:12:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-04-26T11:12:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-04-26T11:12:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-04-26T11:12:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-26T11:12:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-26T11:12:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-26T11:12:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-26T11:12:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-26T11:12:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-26T11:12:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-26T11:12:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-26T11:12:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-26T11:12:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-26T11:12:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-26T11:12:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-26T11:12:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-26T11:12:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-04-26T11:12:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-26T11:12:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-26T11:12:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-26T11:12:22.604 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-26T11:12:22.604 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-26T11:12:22.604 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-26T11:12:22.604 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-26T11:12:22.604 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-26T11:12:22.604 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-26T11:12:22.604 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-26T11:12:22.604 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-26T11:12:22.604 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-26T11:12:22.604 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-26T11:12:22.604 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-26T11:12:22.604 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend-2.6-1.el8.noarch 2024-04-26T11:12:22.605 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-26T11:12:22.605 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-26T11:12:22.605 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-26T11:12:22.605 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-26T11:12:22.605 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-26T11:12:22.605 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-26T11:12:22.605 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.605 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.605 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-26T11:12:22.605 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-26T11:12:22.605 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.605 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-26T11:12:22.605 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-26T11:12:22.605 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-26T11:12:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-26T11:12:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-26T11:12:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-26T11:12:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-26T11:12:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-26T11:12:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-26T11:12:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-26T11:12:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-26T11:12:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-26T11:12:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-26T11:12:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-26T11:12:22.607 INFO:teuthology.orchestra.run.smithi082.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-26T11:12:22.607 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-26T11:12:22.607 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-26T11:12:22.607 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-04-26T11:12:22.607 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:22.607 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-04-26T11:12:22.793 DEBUG:teuthology.parallel:result is None 2024-04-26T11:12:22.800 DEBUG:teuthology.parallel:result is None 2024-04-26T11:12:22.806 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-26T11:12:22.806 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-26T11:12:23.024 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-26T11:12:23.024 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-26T11:12:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-26T11:12:23.494 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 144/152 2024-04-26T11:12:23.722 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 145/152 2024-04-26T11:12:23.722 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-26T11:12:23.956 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-26T11:12:23.956 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 147/152 2024-04-26T11:12:24.164 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 147/152 2024-04-26T11:12:24.164 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-26T11:12:24.381 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-26T11:12:24.381 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-26T11:12:24.385 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 121/152 2024-04-26T11:12:24.581 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-26T11:12:24.581 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-26T11:12:24.803 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-26T11:12:24.803 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-26T11:12:25.096 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-26T11:12:25.296 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-26T11:12:25.884 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-26T11:12:25.884 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 1/152 2024-04-26T11:12:25.884 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2/152 2024-04-26T11:12:25.884 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 3/152 2024-04-26T11:12:25.884 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 4/152 2024-04-26T11:12:25.884 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/152 2024-04-26T11:12:25.884 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 6/152 2024-04-26T11:12:25.884 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 7/152 2024-04-26T11:12:25.884 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 8/152 2024-04-26T11:12:25.884 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T11:12:25.885 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T11:12:25.885 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T11:12:25.885 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/152 2024-04-26T11:12:25.885 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 13/152 2024-04-26T11:12:25.885 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 14/152 2024-04-26T11:12:25.885 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/152 2024-04-26T11:12:25.885 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 16/152 2024-04-26T11:12:25.885 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T11:12:25.885 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 18/152 2024-04-26T11:12:25.885 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/152 2024-04-26T11:12:25.885 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 20/152 2024-04-26T11:12:25.885 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 21/152 2024-04-26T11:12:25.885 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 22/152 2024-04-26T11:12:25.885 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 23/152 2024-04-26T11:12:25.886 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 24/152 2024-04-26T11:12:25.886 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 25/152 2024-04-26T11:12:25.886 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 26/152 2024-04-26T11:12:25.886 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 27/152 2024-04-26T11:12:25.902 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/152 2024-04-26T11:12:25.902 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 29/152 2024-04-26T11:12:25.902 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 30/152 2024-04-26T11:12:25.902 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/152 2024-04-26T11:12:25.902 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/152 2024-04-26T11:12:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 33/152 2024-04-26T11:12:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/152 2024-04-26T11:12:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 35/152 2024-04-26T11:12:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 36/152 2024-04-26T11:12:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : automake-1.16.1-8.el8.noarch 37/152 2024-04-26T11:12:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/152 2024-04-26T11:12:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/152 2024-04-26T11:12:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : jq-1.6-8.el8.x86_64 40/152 2024-04-26T11:12:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 41/152 2024-04-26T11:12:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/152 2024-04-26T11:12:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/152 2024-04-26T11:12:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 44/152 2024-04-26T11:12:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 45/152 2024-04-26T11:12:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 46/152 2024-04-26T11:12:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 47/152 2024-04-26T11:12:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 48/152 2024-04-26T11:12:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 49/152 2024-04-26T11:12:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 50/152 2024-04-26T11:12:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 51/152 2024-04-26T11:12:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/152 2024-04-26T11:12:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/152 2024-04-26T11:12:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/152 2024-04-26T11:12:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/152 2024-04-26T11:12:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/152 2024-04-26T11:12:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/152 2024-04-26T11:12:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/152 2024-04-26T11:12:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 59/152 2024-04-26T11:12:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 60/152 2024-04-26T11:12:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 61/152 2024-04-26T11:12:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 62/152 2024-04-26T11:12:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 63/152 2024-04-26T11:12:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 64/152 2024-04-26T11:12:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 65/152 2024-04-26T11:12:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/152 2024-04-26T11:12:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 67/152 2024-04-26T11:12:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/152 2024-04-26T11:12:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 69/152 2024-04-26T11:12:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libgfortran-8.5.0-22.el8.x86_64 70/152 2024-04-26T11:12:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libquadmath-8.5.0-22.el8.x86_64 71/152 2024-04-26T11:12:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 72/152 2024-04-26T11:12:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 73/152 2024-04-26T11:12:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/152 2024-04-26T11:12:25.906 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libuuid-devel-2.32.1-46.el8.x86_64 75/152 2024-04-26T11:12:25.906 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 76/152 2024-04-26T11:12:25.906 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/152 2024-04-26T11:12:25.906 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 78/152 2024-04-26T11:12:25.906 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 79/152 2024-04-26T11:12:25.906 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 80/152 2024-04-26T11:12:25.906 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 81/152 2024-04-26T11:12:25.906 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 82/152 2024-04-26T11:12:25.906 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 83/152 2024-04-26T11:12:25.907 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/152 2024-04-26T11:12:25.907 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/152 2024-04-26T11:12:25.907 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/152 2024-04-26T11:12:25.907 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 87/152 2024-04-26T11:12:25.907 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 88/152 2024-04-26T11:12:25.907 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 89/152 2024-04-26T11:12:25.907 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 90/152 2024-04-26T11:12:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 91/152 2024-04-26T11:12:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 92/152 2024-04-26T11:12:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 93/152 2024-04-26T11:12:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 94/152 2024-04-26T11:12:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 95/152 2024-04-26T11:12:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 96/152 2024-04-26T11:12:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 97/152 2024-04-26T11:12:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 98/152 2024-04-26T11:12:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 99/152 2024-04-26T11:12:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 100/152 2024-04-26T11:12:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 101/152 2024-04-26T11:12:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 102/152 2024-04-26T11:12:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 103/152 2024-04-26T11:12:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 104/152 2024-04-26T11:12:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 105/152 2024-04-26T11:12:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 106/152 2024-04-26T11:12:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 107/152 2024-04-26T11:12:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 108/152 2024-04-26T11:12:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-portend-2.6-1.el8.noarch 109/152 2024-04-26T11:12:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 110/152 2024-04-26T11:12:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 111/152 2024-04-26T11:12:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 112/152 2024-04-26T11:12:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 113/152 2024-04-26T11:12:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 114/152 2024-04-26T11:12:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 115/152 2024-04-26T11:12:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 116/152 2024-04-26T11:12:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 117/152 2024-04-26T11:12:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 118/152 2024-04-26T11:12:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 119/152 2024-04-26T11:12:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 120/152 2024-04-26T11:12:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 121/152 2024-04-26T11:12:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 122/152 2024-04-26T11:12:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T11:12:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/152 2024-04-26T11:12:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T11:12:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/152 2024-04-26T11:12:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 127/152 2024-04-26T11:12:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 128/152 2024-04-26T11:12:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 129/152 2024-04-26T11:12:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 130/152 2024-04-26T11:12:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 131/152 2024-04-26T11:12:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 132/152 2024-04-26T11:12:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 133/152 2024-04-26T11:12:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 134/152 2024-04-26T11:12:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 135/152 2024-04-26T11:12:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 136/152 2024-04-26T11:12:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 137/152 2024-04-26T11:12:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 138/152 2024-04-26T11:12:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 139/152 2024-04-26T11:12:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 140/152 2024-04-26T11:12:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 141/152 2024-04-26T11:12:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 142/152 2024-04-26T11:12:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 143/152 2024-04-26T11:12:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 144/152 2024-04-26T11:12:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 145/152 2024-04-26T11:12:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 146/152 2024-04-26T11:12:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 147/152 2024-04-26T11:12:25.912 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 148/152 2024-04-26T11:12:25.912 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 149/152 2024-04-26T11:12:25.912 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 150/152 2024-04-26T11:12:25.912 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 151/152 2024-04-26T11:12:25.940 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 122/152 2024-04-26T11:12:26.191 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T11:12:26.226 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T11:12:26.447 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 124/152 2024-04-26T11:12:26.813 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 124/152 2024-04-26T11:12:27.039 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T11:12:27.136 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T11:12:27.718 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 152/152 2024-04-26T11:12:27.718 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:27.718 INFO:teuthology.orchestra.run.smithi122.stdout:Upgraded: 2024-04-26T11:12:27.718 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-04-26T11:12:27.718 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-04-26T11:12:27.718 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-04-26T11:12:27.719 INFO:teuthology.orchestra.run.smithi122.stdout: libblkid-2.32.1-46.el8.x86_64 2024-04-26T11:12:27.719 INFO:teuthology.orchestra.run.smithi122.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-04-26T11:12:27.719 INFO:teuthology.orchestra.run.smithi122.stdout: libmount-2.32.1-46.el8.x86_64 2024-04-26T11:12:27.719 INFO:teuthology.orchestra.run.smithi122.stdout: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.719 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.719 INFO:teuthology.orchestra.run.smithi122.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-04-26T11:12:27.719 INFO:teuthology.orchestra.run.smithi122.stdout: libuuid-2.32.1-46.el8.x86_64 2024-04-26T11:12:27.719 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-04-26T11:12:27.719 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-04-26T11:12:27.719 INFO:teuthology.orchestra.run.smithi122.stdout: util-linux-2.32.1-46.el8.x86_64 2024-04-26T11:12:27.719 INFO:teuthology.orchestra.run.smithi122.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-04-26T11:12:27.719 INFO:teuthology.orchestra.run.smithi122.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-26T11:12:27.719 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-04-26T11:12:27.719 INFO:teuthology.orchestra.run.smithi122.stdout: automake-1.16.1-8.el8.noarch 2024-04-26T11:12:27.719 INFO:teuthology.orchestra.run.smithi122.stdout: bison-3.0.4-10.el8.x86_64 2024-04-26T11:12:27.720 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.720 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.720 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.720 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.720 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:27.720 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.720 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.720 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.720 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:27.720 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:27.720 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:27.720 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:27.720 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:27.720 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.721 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.721 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:27.721 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.721 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.721 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.721 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:27.721 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:27.721 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-04-26T11:12:27.721 INFO:teuthology.orchestra.run.smithi122.stdout: flex-2.6.1-9.el8.x86_64 2024-04-26T11:12:27.721 INFO:teuthology.orchestra.run.smithi122.stdout: fuse-2.9.7-19.el8.x86_64 2024-04-26T11:12:27.721 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-26T11:12:27.721 INFO:teuthology.orchestra.run.smithi122.stdout: jq-1.6-8.el8.x86_64 2024-04-26T11:12:27.721 INFO:teuthology.orchestra.run.smithi122.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-26T11:12:27.721 INFO:teuthology.orchestra.run.smithi122.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-04-26T11:12:27.721 INFO:teuthology.orchestra.run.smithi122.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-26T11:12:27.722 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.722 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.722 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.722 INFO:teuthology.orchestra.run.smithi122.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-04-26T11:12:27.722 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran-8.5.0-22.el8.x86_64 2024-04-26T11:12:27.722 INFO:teuthology.orchestra.run.smithi122.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-26T11:12:27.722 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath-8.5.0-22.el8.x86_64 2024-04-26T11:12:27.722 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-26T11:12:27.722 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.722 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.722 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-26T11:12:27.722 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.722 INFO:teuthology.orchestra.run.smithi122.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-04-26T11:12:27.723 INFO:teuthology.orchestra.run.smithi122.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-26T11:12:27.723 INFO:teuthology.orchestra.run.smithi122.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-26T11:12:27.723 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-26T11:12:27.723 INFO:teuthology.orchestra.run.smithi122.stdout: libuuid-devel-2.32.1-46.el8.x86_64 2024-04-26T11:12:27.723 INFO:teuthology.orchestra.run.smithi122.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-04-26T11:12:27.723 INFO:teuthology.orchestra.run.smithi122.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-26T11:12:27.723 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-26T11:12:27.723 INFO:teuthology.orchestra.run.smithi122.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-04-26T11:12:27.723 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-26T11:12:27.723 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-26T11:12:27.723 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-04-26T11:12:27.723 INFO:teuthology.orchestra.run.smithi122.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-04-26T11:12:27.723 INFO:teuthology.orchestra.run.smithi122.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-04-26T11:12:27.723 INFO:teuthology.orchestra.run.smithi122.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-04-26T11:12:27.724 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-26T11:12:27.724 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-26T11:12:27.724 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-26T11:12:27.724 INFO:teuthology.orchestra.run.smithi122.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-26T11:12:27.724 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-26T11:12:27.724 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.724 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.724 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.724 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-26T11:12:27.724 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-26T11:12:27.724 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-26T11:12:27.724 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-26T11:12:27.724 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-26T11:12:27.724 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-26T11:12:27.724 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-26T11:12:27.725 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-26T11:12:27.725 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-04-26T11:12:27.725 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-26T11:12:27.725 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-26T11:12:27.725 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-26T11:12:27.725 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-26T11:12:27.725 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-26T11:12:27.725 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-26T11:12:27.725 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-26T11:12:27.725 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-26T11:12:27.725 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-26T11:12:27.725 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-26T11:12:27.725 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-26T11:12:27.725 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-26T11:12:27.726 INFO:teuthology.orchestra.run.smithi122.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-26T11:12:27.726 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-26T11:12:27.726 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend-2.6-1.el8.noarch 2024-04-26T11:12:27.726 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-26T11:12:27.726 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-26T11:12:27.726 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-26T11:12:27.726 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-26T11:12:27.726 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-26T11:12:27.726 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-26T11:12:27.726 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.726 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.726 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-26T11:12:27.726 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-26T11:12:27.727 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.727 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-26T11:12:27.727 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-26T11:12:27.727 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-26T11:12:27.727 INFO:teuthology.orchestra.run.smithi122.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-26T11:12:27.727 INFO:teuthology.orchestra.run.smithi122.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-26T11:12:27.727 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-26T11:12:27.727 INFO:teuthology.orchestra.run.smithi122.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-26T11:12:27.727 INFO:teuthology.orchestra.run.smithi122.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-26T11:12:27.727 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-26T11:12:27.727 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-26T11:12:27.727 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-26T11:12:27.727 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-26T11:12:27.727 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-26T11:12:27.728 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.728 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.728 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:27.728 INFO:teuthology.orchestra.run.smithi122.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-26T11:12:27.728 INFO:teuthology.orchestra.run.smithi122.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-26T11:12:27.728 INFO:teuthology.orchestra.run.smithi122.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-26T11:12:27.728 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-26T11:12:27.728 INFO:teuthology.orchestra.run.smithi122.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-04-26T11:12:27.728 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:27.729 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-04-26T11:12:27.919 DEBUG:teuthology.parallel:result is None 2024-04-26T11:12:28.085 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 126/152 2024-04-26T11:12:28.427 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 127/152 2024-04-26T11:12:28.670 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 128/152 2024-04-26T11:12:28.893 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 129/152 2024-04-26T11:12:29.085 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 130/152 2024-04-26T11:12:29.307 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 131/152 2024-04-26T11:12:29.582 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 132/152 2024-04-26T11:12:29.944 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 133/152 2024-04-26T11:12:30.215 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 134/152 2024-04-26T11:12:30.447 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/152 2024-04-26T11:12:30.690 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/152 2024-04-26T11:12:30.790 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/152 2024-04-26T11:12:31.055 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/152 2024-04-26T11:12:31.088 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/152 2024-04-26T11:12:31.282 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 138/152 2024-04-26T11:12:31.529 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 139/152 2024-04-26T11:12:31.765 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 140/152 2024-04-26T11:12:31.765 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-26T11:12:32.025 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-26T11:12:32.026 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-26T11:12:32.334 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-26T11:12:32.334 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-26T11:12:32.633 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-26T11:12:32.829 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 144/152 2024-04-26T11:12:33.065 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 145/152 2024-04-26T11:12:33.065 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-26T11:12:33.341 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-26T11:12:33.341 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 147/152 2024-04-26T11:12:33.574 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 147/152 2024-04-26T11:12:33.574 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-26T11:12:33.782 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-26T11:12:33.783 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-26T11:12:34.015 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-26T11:12:34.015 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-26T11:12:34.276 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-26T11:12:34.276 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-26T11:12:34.576 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-26T11:12:34.773 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-26T11:12:35.370 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-26T11:12:35.370 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 1/152 2024-04-26T11:12:35.370 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2/152 2024-04-26T11:12:35.370 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 3/152 2024-04-26T11:12:35.370 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 4/152 2024-04-26T11:12:35.370 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/152 2024-04-26T11:12:35.370 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 6/152 2024-04-26T11:12:35.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 7/152 2024-04-26T11:12:35.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 8/152 2024-04-26T11:12:35.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T11:12:35.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T11:12:35.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T11:12:35.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/152 2024-04-26T11:12:35.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 13/152 2024-04-26T11:12:35.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 14/152 2024-04-26T11:12:35.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/152 2024-04-26T11:12:35.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 16/152 2024-04-26T11:12:35.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T11:12:35.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 18/152 2024-04-26T11:12:35.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/152 2024-04-26T11:12:35.371 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 20/152 2024-04-26T11:12:35.372 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 21/152 2024-04-26T11:12:35.372 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 22/152 2024-04-26T11:12:35.372 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 23/152 2024-04-26T11:12:35.372 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 24/152 2024-04-26T11:12:35.372 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 25/152 2024-04-26T11:12:35.372 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 26/152 2024-04-26T11:12:35.372 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 27/152 2024-04-26T11:12:35.372 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/152 2024-04-26T11:12:35.385 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 29/152 2024-04-26T11:12:35.385 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 30/152 2024-04-26T11:12:35.385 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/152 2024-04-26T11:12:35.386 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/152 2024-04-26T11:12:35.386 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 33/152 2024-04-26T11:12:35.386 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/152 2024-04-26T11:12:35.386 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 35/152 2024-04-26T11:12:35.386 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 36/152 2024-04-26T11:12:35.386 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : automake-1.16.1-8.el8.noarch 37/152 2024-04-26T11:12:35.386 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/152 2024-04-26T11:12:35.387 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/152 2024-04-26T11:12:35.387 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : jq-1.6-8.el8.x86_64 40/152 2024-04-26T11:12:35.387 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 41/152 2024-04-26T11:12:35.387 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/152 2024-04-26T11:12:35.387 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/152 2024-04-26T11:12:35.387 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 44/152 2024-04-26T11:12:35.387 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 45/152 2024-04-26T11:12:35.387 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 46/152 2024-04-26T11:12:35.387 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 47/152 2024-04-26T11:12:35.387 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 48/152 2024-04-26T11:12:35.387 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 49/152 2024-04-26T11:12:35.388 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 50/152 2024-04-26T11:12:35.388 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 51/152 2024-04-26T11:12:35.388 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/152 2024-04-26T11:12:35.388 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/152 2024-04-26T11:12:35.388 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/152 2024-04-26T11:12:35.388 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/152 2024-04-26T11:12:35.388 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/152 2024-04-26T11:12:35.388 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/152 2024-04-26T11:12:35.388 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/152 2024-04-26T11:12:35.388 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 59/152 2024-04-26T11:12:35.388 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 60/152 2024-04-26T11:12:35.388 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 61/152 2024-04-26T11:12:35.388 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 62/152 2024-04-26T11:12:35.388 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 63/152 2024-04-26T11:12:35.389 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 64/152 2024-04-26T11:12:35.389 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 65/152 2024-04-26T11:12:35.389 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/152 2024-04-26T11:12:35.389 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 67/152 2024-04-26T11:12:35.389 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/152 2024-04-26T11:12:35.389 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 69/152 2024-04-26T11:12:35.389 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libgfortran-8.5.0-22.el8.x86_64 70/152 2024-04-26T11:12:35.389 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libquadmath-8.5.0-22.el8.x86_64 71/152 2024-04-26T11:12:35.389 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 72/152 2024-04-26T11:12:35.389 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 73/152 2024-04-26T11:12:35.389 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/152 2024-04-26T11:12:35.389 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libuuid-devel-2.32.1-46.el8.x86_64 75/152 2024-04-26T11:12:35.389 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 76/152 2024-04-26T11:12:35.389 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/152 2024-04-26T11:12:35.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 78/152 2024-04-26T11:12:35.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 79/152 2024-04-26T11:12:35.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 80/152 2024-04-26T11:12:35.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 81/152 2024-04-26T11:12:35.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 82/152 2024-04-26T11:12:35.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 83/152 2024-04-26T11:12:35.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/152 2024-04-26T11:12:35.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/152 2024-04-26T11:12:35.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/152 2024-04-26T11:12:35.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 87/152 2024-04-26T11:12:35.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 88/152 2024-04-26T11:12:35.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 89/152 2024-04-26T11:12:35.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 90/152 2024-04-26T11:12:35.390 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 91/152 2024-04-26T11:12:35.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 92/152 2024-04-26T11:12:35.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 93/152 2024-04-26T11:12:35.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 94/152 2024-04-26T11:12:35.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 95/152 2024-04-26T11:12:35.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 96/152 2024-04-26T11:12:35.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 97/152 2024-04-26T11:12:35.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 98/152 2024-04-26T11:12:35.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 99/152 2024-04-26T11:12:35.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 100/152 2024-04-26T11:12:35.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 101/152 2024-04-26T11:12:35.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 102/152 2024-04-26T11:12:35.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 103/152 2024-04-26T11:12:35.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 104/152 2024-04-26T11:12:35.391 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 105/152 2024-04-26T11:12:35.392 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 106/152 2024-04-26T11:12:35.392 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 107/152 2024-04-26T11:12:35.392 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 108/152 2024-04-26T11:12:35.392 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-portend-2.6-1.el8.noarch 109/152 2024-04-26T11:12:35.392 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 110/152 2024-04-26T11:12:35.392 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 111/152 2024-04-26T11:12:35.392 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 112/152 2024-04-26T11:12:35.392 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 113/152 2024-04-26T11:12:35.392 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 114/152 2024-04-26T11:12:35.392 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 115/152 2024-04-26T11:12:35.392 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 116/152 2024-04-26T11:12:35.392 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 117/152 2024-04-26T11:12:35.392 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 118/152 2024-04-26T11:12:35.392 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 119/152 2024-04-26T11:12:35.392 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 120/152 2024-04-26T11:12:35.393 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 121/152 2024-04-26T11:12:35.393 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 122/152 2024-04-26T11:12:35.393 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T11:12:35.393 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/152 2024-04-26T11:12:35.393 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T11:12:35.393 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/152 2024-04-26T11:12:35.393 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 127/152 2024-04-26T11:12:35.393 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 128/152 2024-04-26T11:12:35.394 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 129/152 2024-04-26T11:12:35.394 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 130/152 2024-04-26T11:12:35.394 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 131/152 2024-04-26T11:12:35.394 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 132/152 2024-04-26T11:12:35.394 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 133/152 2024-04-26T11:12:35.394 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 134/152 2024-04-26T11:12:35.394 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 135/152 2024-04-26T11:12:35.394 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 136/152 2024-04-26T11:12:35.394 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 137/152 2024-04-26T11:12:35.394 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 138/152 2024-04-26T11:12:35.395 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 139/152 2024-04-26T11:12:35.395 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 140/152 2024-04-26T11:12:35.395 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 141/152 2024-04-26T11:12:35.395 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 142/152 2024-04-26T11:12:35.395 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 143/152 2024-04-26T11:12:35.395 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 144/152 2024-04-26T11:12:35.395 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 145/152 2024-04-26T11:12:35.395 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 146/152 2024-04-26T11:12:35.395 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 147/152 2024-04-26T11:12:35.395 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 148/152 2024-04-26T11:12:35.397 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 149/152 2024-04-26T11:12:35.397 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 150/152 2024-04-26T11:12:35.397 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 151/152 2024-04-26T11:12:37.208 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 152/152 2024-04-26T11:12:37.209 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:37.209 INFO:teuthology.orchestra.run.smithi029.stdout:Upgraded: 2024-04-26T11:12:37.209 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-04-26T11:12:37.209 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-04-26T11:12:37.209 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-04-26T11:12:37.209 INFO:teuthology.orchestra.run.smithi029.stdout: libblkid-2.32.1-46.el8.x86_64 2024-04-26T11:12:37.209 INFO:teuthology.orchestra.run.smithi029.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-04-26T11:12:37.209 INFO:teuthology.orchestra.run.smithi029.stdout: libmount-2.32.1-46.el8.x86_64 2024-04-26T11:12:37.209 INFO:teuthology.orchestra.run.smithi029.stdout: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.209 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.209 INFO:teuthology.orchestra.run.smithi029.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-04-26T11:12:37.210 INFO:teuthology.orchestra.run.smithi029.stdout: libuuid-2.32.1-46.el8.x86_64 2024-04-26T11:12:37.210 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-04-26T11:12:37.210 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-04-26T11:12:37.210 INFO:teuthology.orchestra.run.smithi029.stdout: util-linux-2.32.1-46.el8.x86_64 2024-04-26T11:12:37.210 INFO:teuthology.orchestra.run.smithi029.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-04-26T11:12:37.210 INFO:teuthology.orchestra.run.smithi029.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-26T11:12:37.210 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-04-26T11:12:37.210 INFO:teuthology.orchestra.run.smithi029.stdout: automake-1.16.1-8.el8.noarch 2024-04-26T11:12:37.210 INFO:teuthology.orchestra.run.smithi029.stdout: bison-3.0.4-10.el8.x86_64 2024-04-26T11:12:37.210 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.210 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.210 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.211 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.211 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:37.211 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.211 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.211 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.211 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:37.211 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:37.211 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:37.211 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:37.211 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:37.211 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.211 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.211 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:37.211 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T11:12:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-04-26T11:12:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: flex-2.6.1-9.el8.x86_64 2024-04-26T11:12:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: fuse-2.9.7-19.el8.x86_64 2024-04-26T11:12:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-26T11:12:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: jq-1.6-8.el8.x86_64 2024-04-26T11:12:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-26T11:12:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-04-26T11:12:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-26T11:12:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.212 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-04-26T11:12:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran-8.5.0-22.el8.x86_64 2024-04-26T11:12:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-26T11:12:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath-8.5.0-22.el8.x86_64 2024-04-26T11:12:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-26T11:12:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-26T11:12:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-04-26T11:12:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-26T11:12:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-26T11:12:37.213 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-26T11:12:37.214 INFO:teuthology.orchestra.run.smithi029.stdout: libuuid-devel-2.32.1-46.el8.x86_64 2024-04-26T11:12:37.214 INFO:teuthology.orchestra.run.smithi029.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-04-26T11:12:37.214 INFO:teuthology.orchestra.run.smithi029.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-26T11:12:37.214 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-26T11:12:37.214 INFO:teuthology.orchestra.run.smithi029.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-04-26T11:12:37.214 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-26T11:12:37.214 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-26T11:12:37.214 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-04-26T11:12:37.214 INFO:teuthology.orchestra.run.smithi029.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-04-26T11:12:37.215 INFO:teuthology.orchestra.run.smithi029.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-04-26T11:12:37.215 INFO:teuthology.orchestra.run.smithi029.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-04-26T11:12:37.215 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-26T11:12:37.215 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-26T11:12:37.215 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-26T11:12:37.215 INFO:teuthology.orchestra.run.smithi029.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-26T11:12:37.215 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-26T11:12:37.215 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.215 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.215 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.215 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-26T11:12:37.215 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-26T11:12:37.215 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-26T11:12:37.215 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-26T11:12:37.216 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-26T11:12:37.216 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-26T11:12:37.216 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-26T11:12:37.216 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-26T11:12:37.216 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-04-26T11:12:37.216 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-26T11:12:37.216 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-26T11:12:37.216 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-26T11:12:37.216 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-26T11:12:37.216 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-26T11:12:37.216 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-26T11:12:37.217 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-26T11:12:37.217 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-26T11:12:37.217 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-26T11:12:37.217 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-26T11:12:37.217 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-26T11:12:37.217 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-26T11:12:37.217 INFO:teuthology.orchestra.run.smithi029.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-26T11:12:37.217 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-26T11:12:37.217 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend-2.6-1.el8.noarch 2024-04-26T11:12:37.217 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-26T11:12:37.217 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-26T11:12:37.217 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-26T11:12:37.217 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-26T11:12:37.218 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-26T11:12:37.218 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-26T11:12:37.218 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.218 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.218 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-26T11:12:37.218 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-26T11:12:37.218 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.218 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-26T11:12:37.218 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-26T11:12:37.218 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-26T11:12:37.218 INFO:teuthology.orchestra.run.smithi029.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-26T11:12:37.218 INFO:teuthology.orchestra.run.smithi029.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-26T11:12:37.218 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-26T11:12:37.218 INFO:teuthology.orchestra.run.smithi029.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-26T11:12:37.219 INFO:teuthology.orchestra.run.smithi029.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-26T11:12:37.219 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-26T11:12:37.219 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-26T11:12:37.219 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-26T11:12:37.219 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-26T11:12:37.219 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-26T11:12:37.219 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.219 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.219 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T11:12:37.219 INFO:teuthology.orchestra.run.smithi029.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-26T11:12:37.219 INFO:teuthology.orchestra.run.smithi029.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-26T11:12:37.219 INFO:teuthology.orchestra.run.smithi029.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-26T11:12:37.219 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-26T11:12:37.220 INFO:teuthology.orchestra.run.smithi029.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-04-26T11:12:37.220 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:37.220 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-04-26T11:12:37.445 DEBUG:teuthology.parallel:result is None 2024-04-26T11:12:37.446 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:12:37.592 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T11:12:37.616 INFO:teuthology.orchestra.run.smithi029.stdout:18.2.2-1256.gdc093b5e.el8 2024-04-26T11:12:37.617 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el8 2024-04-26T11:12:37.617 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T11:12:37.619 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:12:37.757 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T11:12:37.785 INFO:teuthology.orchestra.run.smithi072.stdout:18.2.2-1256.gdc093b5e.el8 2024-04-26T11:12:37.786 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el8 2024-04-26T11:12:37.786 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T11:12:37.788 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:12:38.003 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T11:12:38.032 INFO:teuthology.orchestra.run.smithi082.stdout:18.2.2-1256.gdc093b5e.el8 2024-04-26T11:12:38.032 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el8 2024-04-26T11:12:38.032 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T11:12:38.035 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:12:38.198 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T11:12:38.227 INFO:teuthology.orchestra.run.smithi122.stdout:18.2.2-1256.gdc093b5e.el8 2024-04-26T11:12:38.227 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el8 2024-04-26T11:12:38.227 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T11:12:38.229 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T11:12:38.229 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:12:38.229 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T11:12:38.261 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T11:12:38.261 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T11:12:38.296 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T11:12:38.296 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T11:12:38.333 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-26T11:12:38.333 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T11:12:38.370 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T11:12:38.370 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:12:38.370 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T11:12:38.398 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T11:12:38.468 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T11:12:38.468 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T11:12:38.499 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T11:12:38.570 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T11:12:38.571 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T11:12:38.603 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T11:12:38.674 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-26T11:12:38.674 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T11:12:38.707 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T11:12:38.780 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T11:12:38.780 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:12:38.781 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T11:12:38.808 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T11:12:38.878 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T11:12:38.879 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T11:12:38.911 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T11:12:38.981 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T11:12:38.981 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T11:12:39.013 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T11:12:39.086 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-26T11:12:39.087 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T11:12:39.119 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T11:12:39.193 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T11:12:39.193 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:12:39.193 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T11:12:39.223 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T11:12:39.375 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T11:12:39.376 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T11:12:39.408 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T11:12:39.478 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T11:12:39.479 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T11:12:39.511 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T11:12:39.581 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-26T11:12:39.581 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T11:12:39.613 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T11:12:39.689 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T11:12:39.777 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T11:12:39.777 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 777 /var/log/ceph 2024-04-26T11:12:39.780 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 777 /var/log/ceph 2024-04-26T11:12:39.782 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /var/log/ceph 2024-04-26T11:12:39.784 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 777 /var/log/ceph 2024-04-26T11:12:39.817 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T11:12:39.817 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T11:12:39.851 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T11:12:39.854 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T11:12:39.856 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T11:12:39.890 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T11:12:39.890 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T11:12:39.924 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T11:12:39.927 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T11:12:39.930 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T11:12:39.973 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T11:12:39.973 INFO:tasks.ceph:config {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T11:12:39.973 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674154', 'branch': 'reef', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-hybrid powercycle/default supported-all-distro/centos_8 tasks/admin_socket_objecter_requests thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7674154', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 1136, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'sleep_before_teardown': 0, 'subset': '0/4', 'suite': 'powercycle', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6', 'targets': {'smithi029.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMvFP3/i+qNFhrLrSKYyFE8gWBsL2OZdfWB817Z/dPozxKdB/U71Ej3xUqWCmWhrsZF5w9q3Vey72NtZ1uLsRAk=', 'smithi072.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDat4KCggYe5lLshnvsgT7auYwnu4zEt12LMX+uCe1UDLcslBFGfBZ01+rSfSJjeCqTTVCSzh+pGs6TAqL2EEm4=', 'smithi082.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKGx8hqCwJti/sIpDr7U93Y6jpWYdgCYPRx+AleFmPuzO3tBDJLcj6TWOsApRrzO9IDQuc/xdV9grc1t7tT8O6k=', 'smithi122.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAuXcmuGAMQnUwC6xteZpBL+Vl9Y9rLQ8Iic+HDWyfxw6GSyqTDoXqlEd/EGjb1oftigPxQaeLkozsuhfhbyQZY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'radosbench': {'clients': ['client.0'], 'time': 60}}, {'admin_socket': {'client.0': {'objecter_requests': {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_22:32:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T11:12:39.973 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T11:12:39.995 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T11:12:39.997 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T11:12:39.999 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T11:12:40.025 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T11:12:40.054 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T11:12:40.057 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T11:12:40.059 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T11:12:40.101 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T11:12:40.102 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T11:12:40.143 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T11:12:40.143 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_1 2024-04-26T11:12:40.202 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T11:12:40.202 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:12:40.202 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 168272 Links: 1 2024-04-26T11:12:40.202 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:12:40.202 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T11:12:40.202 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-04-26 11:12:20.373959772 +0000 2024-04-26T11:12:40.202 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-26 11:09:07.052098604 +0000 2024-04-26T11:12:40.203 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-26 11:09:07.052098604 +0000 2024-04-26T11:12:40.203 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-04-26T11:12:40.203 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T11:12:40.268 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-04-26T11:12:40.269 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-04-26T11:12:40.269 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000263178 s, 1.9 MB/s 2024-04-26T11:12:40.270 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T11:12:40.330 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_2 2024-04-26T11:12:40.388 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T11:12:40.388 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:12:40.388 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 169207 Links: 1 2024-04-26T11:12:40.388 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:12:40.388 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T11:12:40.388 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-04-26 11:12:20.374959752 +0000 2024-04-26T11:12:40.389 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-26 11:09:07.394091648 +0000 2024-04-26T11:12:40.389 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-26 11:09:07.394091648 +0000 2024-04-26T11:12:40.389 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-04-26T11:12:40.389 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T11:12:40.454 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-04-26T11:12:40.454 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-04-26T11:12:40.454 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.00030335 s, 1.7 MB/s 2024-04-26T11:12:40.455 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T11:12:40.515 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_3 2024-04-26T11:12:40.573 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T11:12:40.574 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:12:40.574 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 167292 Links: 1 2024-04-26T11:12:40.574 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:12:40.574 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T11:12:40.574 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-04-26 11:12:20.374959752 +0000 2024-04-26T11:12:40.575 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-26 11:09:07.723084957 +0000 2024-04-26T11:12:40.575 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-26 11:09:07.723084957 +0000 2024-04-26T11:12:40.575 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-04-26T11:12:40.575 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T11:12:40.639 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-04-26T11:12:40.639 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-04-26T11:12:40.639 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.00016429 s, 3.1 MB/s 2024-04-26T11:12:40.640 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T11:12:40.698 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_4 2024-04-26T11:12:40.757 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T11:12:40.757 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:12:40.757 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 166767 Links: 1 2024-04-26T11:12:40.757 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:12:40.757 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T11:12:40.757 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-04-26 11:12:20.374959752 +0000 2024-04-26T11:12:40.757 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-04-26 11:09:08.063078042 +0000 2024-04-26T11:12:40.757 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-04-26 11:09:08.063078042 +0000 2024-04-26T11:12:40.757 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2024-04-26T11:12:40.758 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T11:12:40.823 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-04-26T11:12:40.823 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-04-26T11:12:40.823 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000215431 s, 2.4 MB/s 2024-04-26T11:12:40.824 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T11:12:40.882 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T11:12:40.883 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T11:12:40.883 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T11:12:40.904 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T11:12:40.904 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2024-04-26T11:12:40.966 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T11:12:40.966 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:12:40.966 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 167249 Links: 1 2024-04-26T11:12:40.966 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:12:40.966 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T11:12:40.966 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-26 11:12:20.297319889 +0000 2024-04-26T11:12:40.966 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-26 11:09:26.499817979 +0000 2024-04-26T11:12:40.966 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-26 11:09:26.499817979 +0000 2024-04-26T11:12:40.967 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2024-04-26T11:12:40.967 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T11:12:41.036 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-26T11:12:41.036 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-26T11:12:41.036 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000251442 s, 2.0 MB/s 2024-04-26T11:12:41.037 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T11:12:41.098 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2024-04-26T11:12:41.157 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T11:12:41.157 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:12:41.157 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 171061 Links: 1 2024-04-26T11:12:41.158 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:12:41.158 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T11:12:41.158 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-26 11:12:20.297319889 +0000 2024-04-26T11:12:41.158 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-26 11:09:26.864811141 +0000 2024-04-26T11:12:41.158 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-26 11:09:26.864811141 +0000 2024-04-26T11:12:41.158 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2024-04-26T11:12:41.158 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T11:12:41.225 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-26T11:12:41.226 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-26T11:12:41.226 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000207609 s, 2.5 MB/s 2024-04-26T11:12:41.227 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T11:12:41.287 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2024-04-26T11:12:41.349 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T11:12:41.350 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:12:41.350 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 170088 Links: 1 2024-04-26T11:12:41.350 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:12:41.350 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T11:12:41.350 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-26 11:12:20.297319889 +0000 2024-04-26T11:12:41.350 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-26 11:09:27.212804622 +0000 2024-04-26T11:12:41.351 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-26 11:09:27.212804622 +0000 2024-04-26T11:12:41.351 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2024-04-26T11:12:41.351 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T11:12:41.416 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-26T11:12:41.416 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-26T11:12:41.416 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000202824 s, 2.5 MB/s 2024-04-26T11:12:41.417 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T11:12:41.476 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2024-04-26T11:12:41.535 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T11:12:41.535 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:12:41.535 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 168815 Links: 1 2024-04-26T11:12:41.536 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:12:41.536 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T11:12:41.536 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-04-26 11:12:20.297319889 +0000 2024-04-26T11:12:41.536 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-04-26 11:09:27.580797727 +0000 2024-04-26T11:12:41.536 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-04-26 11:09:27.580797727 +0000 2024-04-26T11:12:41.536 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2024-04-26T11:12:41.536 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T11:12:41.600 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-04-26T11:12:41.600 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-04-26T11:12:41.600 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000210953 s, 2.4 MB/s 2024-04-26T11:12:41.601 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T11:12:41.660 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-26T11:12:41.660 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-26T11:12:41.660 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T11:12:41.682 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T11:12:41.682 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_1 2024-04-26T11:12:41.744 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T11:12:41.744 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:12:41.744 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 6h/6d Inode: 164859 Links: 1 2024-04-26T11:12:41.744 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:12:41.744 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T11:12:41.744 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-04-26 11:12:25.519707571 +0000 2024-04-26T11:12:41.744 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-04-26 11:09:02.485922184 +0000 2024-04-26T11:12:41.744 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-04-26 11:09:02.485922184 +0000 2024-04-26T11:12:41.744 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2024-04-26T11:12:41.745 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T11:12:41.816 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-04-26T11:12:41.816 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-04-26T11:12:41.816 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.00022305 s, 2.3 MB/s 2024-04-26T11:12:41.817 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T11:12:41.880 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_2 2024-04-26T11:12:41.946 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T11:12:41.946 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:12:41.946 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 6h/6d Inode: 168346 Links: 1 2024-04-26T11:12:41.946 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:12:41.946 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T11:12:41.947 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-04-26 11:12:25.519707571 +0000 2024-04-26T11:12:41.947 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-04-26 11:09:02.833914028 +0000 2024-04-26T11:12:41.947 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-04-26 11:09:02.833914028 +0000 2024-04-26T11:12:41.947 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2024-04-26T11:12:41.947 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T11:12:42.017 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-04-26T11:12:42.018 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-04-26T11:12:42.018 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000280406 s, 1.8 MB/s 2024-04-26T11:12:42.019 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T11:12:42.082 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_3 2024-04-26T11:12:42.143 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T11:12:42.144 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:12:42.144 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 6h/6d Inode: 169275 Links: 1 2024-04-26T11:12:42.144 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:12:42.144 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T11:12:42.144 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-04-26 11:12:25.519707571 +0000 2024-04-26T11:12:42.144 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-04-26 11:09:03.179905919 +0000 2024-04-26T11:12:42.144 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-04-26 11:09:03.179905919 +0000 2024-04-26T11:12:42.144 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2024-04-26T11:12:42.144 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T11:12:42.215 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-04-26T11:12:42.215 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-04-26T11:12:42.215 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000209268 s, 2.4 MB/s 2024-04-26T11:12:42.216 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T11:12:42.280 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_4 2024-04-26T11:12:42.342 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T11:12:42.342 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:12:42.342 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 6h/6d Inode: 165381 Links: 1 2024-04-26T11:12:42.342 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:12:42.342 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T11:12:42.342 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-04-26 11:12:25.519707571 +0000 2024-04-26T11:12:42.342 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-04-26 11:09:03.506898256 +0000 2024-04-26T11:12:42.342 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-04-26 11:09:03.506898256 +0000 2024-04-26T11:12:42.342 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: - 2024-04-26T11:12:42.343 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T11:12:42.413 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-04-26T11:12:42.413 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-04-26T11:12:42.413 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000273528 s, 1.9 MB/s 2024-04-26T11:12:42.414 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T11:12:42.478 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-26T11:12:42.478 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi122.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-26T11:12:42.478 INFO:tasks.ceph:Generating config... 2024-04-26T11:12:42.480 INFO:tasks.ceph:[client.0] admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T11:12:42.480 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T11:12:42.480 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T11:12:42.480 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T11:12:42.480 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T11:12:42.480 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T11:12:42.480 INFO:tasks.ceph:[osd] bluefs allocator = hybrid 2024-04-26T11:12:42.480 INFO:tasks.ceph:[osd] bluestore allocator = hybrid 2024-04-26T11:12:42.480 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T11:12:42.480 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T11:12:42.480 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-26T11:12:42.480 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-26T11:12:42.481 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T11:12:42.481 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T11:12:42.481 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-26T11:12:42.481 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T11:12:42.481 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T11:12:42.481 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T11:12:42.481 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-26T11:12:42.481 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T11:12:42.481 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-26T11:12:42.481 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T11:12:42.481 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T11:12:42.481 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T11:12:42.545 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T11:12:42.549 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T11:12:42.598 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T11:12:42.626 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.29'), ('mon.b', '[v2:172.21.15.29:3301,v1:172.21.15.29:6790]'), ('mon.c', '[v2:172.21.15.29:3302,v1:172.21.15.29:6791]')] 2024-04-26T11:12:42.627 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.29,[v2:172.21.15.29:3301,v1:172.21.15.29:6790],[v2:172.21.15.29:3302,v1:172.21.15.29:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}} 2024-04-26T11:12:42.627 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:12:42.628 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T11:12:42.686 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.29 --addv b '[v2:172.21.15.29:3301,v1:172.21.15.29:6790]' --addv c '[v2:172.21.15.29:3302,v1:172.21.15.29:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:12:42.778 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:12:42.779 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: generated fsid 2b52ce04-9559-478f-9787-c3cc3b261c15 2024-04-26T11:12:42.779 INFO:teuthology.orchestra.run.smithi029.stdout:setting min_mon_release = pacific 2024-04-26T11:12:42.779 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 0 2024-04-26T11:12:42.779 INFO:teuthology.orchestra.run.smithi029.stdout:fsid 2b52ce04-9559-478f-9787-c3cc3b261c15 2024-04-26T11:12:42.779 INFO:teuthology.orchestra.run.smithi029.stdout:last_changed 2024-04-26T11:12:42.776956+0000 2024-04-26T11:12:42.779 INFO:teuthology.orchestra.run.smithi029.stdout:created 2024-04-26T11:12:42.776956+0000 2024-04-26T11:12:42.779 INFO:teuthology.orchestra.run.smithi029.stdout:min_mon_release 16 (pacific) 2024-04-26T11:12:42.779 INFO:teuthology.orchestra.run.smithi029.stdout:election_strategy: 1 2024-04-26T11:12:42.779 INFO:teuthology.orchestra.run.smithi029.stdout:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-04-26T11:12:42.779 INFO:teuthology.orchestra.run.smithi029.stdout:1: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.b 2024-04-26T11:12:42.779 INFO:teuthology.orchestra.run.smithi029.stdout:2: [v2:172.21.15.29:3302/0,v1:172.21.15.29:6791/0] mon.c 2024-04-26T11:12:42.779 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T11:12:42.780 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T11:12:42.798 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2b52ce04-9559-478f-9787-c3cc3b261c15... 2024-04-26T11:12:42.799 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T11:12:42.841 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T11:12:42.844 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T11:12:42.847 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T11:12:42.884 INFO:teuthology.orchestra.run.smithi029.stdout:[global] 2024-04-26T11:12:42.885 INFO:teuthology.orchestra.run.smithi029.stdout: chdir = "" 2024-04-26T11:12:42.885 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T11:12:42.885 INFO:teuthology.orchestra.run.smithi029.stdout: auth supported = cephx 2024-04-26T11:12:42.885 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.885 INFO:teuthology.orchestra.run.smithi029.stdout: filestore xattr use omap = true 2024-04-26T11:12:42.885 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.885 INFO:teuthology.orchestra.run.smithi029.stdout: mon clock drift allowed = 1.000 2024-04-26T11:12:42.885 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.885 INFO:teuthology.orchestra.run.smithi029.stdout: osd crush chooseleaf type = 0 2024-04-26T11:12:42.885 INFO:teuthology.orchestra.run.smithi029.stdout: auth debug = true 2024-04-26T11:12:42.886 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.886 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on old message = true 2024-04-26T11:12:42.886 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on bug = true 2024-04-26T11:12:42.886 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.886 INFO:teuthology.orchestra.run.smithi029.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T11:12:42.886 INFO:teuthology.orchestra.run.smithi029.stdout: mon pg warn max object skew = 0 2024-04-26T11:12:42.886 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.886 INFO:teuthology.orchestra.run.smithi029.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T11:12:42.886 INFO:teuthology.orchestra.run.smithi029.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T11:12:42.886 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.886 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default size = 2 2024-04-26T11:12:42.887 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.887 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow primary affinity = true 2024-04-26T11:12:42.887 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow pg remap = true 2024-04-26T11:12:42.887 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on legacy crush tunables = false 2024-04-26T11:12:42.887 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on crush straw calc version zero = false 2024-04-26T11:12:42.887 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on no sortbitwise = false 2024-04-26T11:12:42.887 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on osd down out interval zero = false 2024-04-26T11:12:42.887 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on too few osds = false 2024-04-26T11:12:42.887 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T11:12:42.887 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T11:12:42.887 INFO:teuthology.orchestra.run.smithi029.stdout: mon_allow_pool_size_one = true 2024-04-26T11:12:42.887 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.888 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T11:12:42.888 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.888 INFO:teuthology.orchestra.run.smithi029.stdout: osd default data pool replay window = 5 2024-04-26T11:12:42.888 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.888 INFO:teuthology.orchestra.run.smithi029.stdout: mon allow pool delete = true 2024-04-26T11:12:42.888 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.888 INFO:teuthology.orchestra.run.smithi029.stdout: mon cluster log file level = debug 2024-04-26T11:12:42.888 INFO:teuthology.orchestra.run.smithi029.stdout: debug asserts on shutdown = true 2024-04-26T11:12:42.889 INFO:teuthology.orchestra.run.smithi029.stdout: mon health detail to clog = false 2024-04-26T11:12:42.889 INFO:teuthology.orchestra.run.smithi029.stdout: mon host = "172.21.15.29,[v2:172.21.15.29:3301,v1:172.21.15.29:6790],[v2:172.21.15.29:3302,v1:172.21.15.29:6791]" 2024-04-26T11:12:42.889 INFO:teuthology.orchestra.run.smithi029.stdout: fsid = 2b52ce04-9559-478f-9787-c3cc3b261c15 2024-04-26T11:12:42.889 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.889 INFO:teuthology.orchestra.run.smithi029.stdout:[osd] 2024-04-26T11:12:42.889 INFO:teuthology.orchestra.run.smithi029.stdout: osd journal size = 100 2024-04-26T11:12:42.889 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.889 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub load threshold = 5.0 2024-04-26T11:12:42.889 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub max interval = 600 2024-04-26T11:12:42.889 INFO:teuthology.orchestra.run.smithi029.stdout: osd mclock profile = high_recovery_ops 2024-04-26T11:12:42.889 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.889 INFO:teuthology.orchestra.run.smithi029.stdout: osd recover clone overlap = true 2024-04-26T11:12:42.889 INFO:teuthology.orchestra.run.smithi029.stdout: osd recovery max chunk = 1048576 2024-04-26T11:12:42.890 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.890 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug shutdown = true 2024-04-26T11:12:42.890 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug op order = true 2024-04-26T11:12:42.890 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug verify stray on activate = true 2024-04-26T11:12:42.890 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.890 INFO:teuthology.orchestra.run.smithi029.stdout: osd open classes on start = true 2024-04-26T11:12:42.890 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug pg log writeout = true 2024-04-26T11:12:42.890 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.890 INFO:teuthology.orchestra.run.smithi029.stdout: osd deep scrub update digest min age = 30 2024-04-26T11:12:42.890 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.890 INFO:teuthology.orchestra.run.smithi029.stdout: osd map max advance = 10 2024-04-26T11:12:42.891 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.891 INFO:teuthology.orchestra.run.smithi029.stdout: journal zero on create = true 2024-04-26T11:12:42.891 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.891 INFO:teuthology.orchestra.run.smithi029.stdout: filestore ondisk finisher threads = 3 2024-04-26T11:12:42.891 INFO:teuthology.orchestra.run.smithi029.stdout: filestore apply finisher threads = 3 2024-04-26T11:12:42.891 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.891 INFO:teuthology.orchestra.run.smithi029.stdout: bdev debug aio = true 2024-04-26T11:12:42.891 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug misdirected ops = true 2024-04-26T11:12:42.891 INFO:teuthology.orchestra.run.smithi029.stdout: bluefs allocator = hybrid 2024-04-26T11:12:42.891 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore allocator = hybrid 2024-04-26T11:12:42.891 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore block size = 96636764160 2024-04-26T11:12:42.891 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore fsck on mount = True 2024-04-26T11:12:42.892 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluefs = 1/20 2024-04-26T11:12:42.892 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluestore = 1/20 2024-04-26T11:12:42.892 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-04-26T11:12:42.892 INFO:teuthology.orchestra.run.smithi029.stdout: debug osd = 20 2024-04-26T11:12:42.892 INFO:teuthology.orchestra.run.smithi029.stdout: debug rocksdb = 4/10 2024-04-26T11:12:42.892 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T11:12:42.892 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd full ratio = 0.9 2024-04-26T11:12:42.892 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd nearfull ratio = 0.8 2024-04-26T11:12:42.892 INFO:teuthology.orchestra.run.smithi029.stdout: osd blocked scrub grace period = 3600 2024-04-26T11:12:42.892 INFO:teuthology.orchestra.run.smithi029.stdout: osd failsafe full ratio = 0.95 2024-04-26T11:12:42.892 INFO:teuthology.orchestra.run.smithi029.stdout: osd max markdown count = 1000 2024-04-26T11:12:42.892 INFO:teuthology.orchestra.run.smithi029.stdout: osd objectstore = bluestore 2024-04-26T11:12:42.893 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.893 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr] 2024-04-26T11:12:42.893 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-04-26T11:12:42.893 INFO:teuthology.orchestra.run.smithi029.stdout: debug mgr = 20 2024-04-26T11:12:42.893 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2024-04-26T11:12:42.893 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2024-04-26T11:12:42.893 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2024-04-26T11:12:42.893 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2024-04-26T11:12:42.893 INFO:teuthology.orchestra.run.smithi029.stdout: mgr/telemetry/nag = false 2024-04-26T11:12:42.893 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.893 INFO:teuthology.orchestra.run.smithi029.stdout:[mon] 2024-04-26T11:12:42.893 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-04-26T11:12:42.894 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2024-04-26T11:12:42.894 INFO:teuthology.orchestra.run.smithi029.stdout: debug paxos = 20 2024-04-26T11:12:42.894 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2024-04-26T11:12:42.894 INFO:teuthology.orchestra.run.smithi029.stdout: mon data avail warn = 5 2024-04-26T11:12:42.894 INFO:teuthology.orchestra.run.smithi029.stdout: mon mgr mkfs grace = 240 2024-04-26T11:12:42.894 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2024-04-26T11:12:42.894 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd reporter subtree level = osd 2024-04-26T11:12:42.894 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd prime pg temp = true 2024-04-26T11:12:42.894 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2024-04-26T11:12:42.894 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.894 INFO:teuthology.orchestra.run.smithi029.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T11:12:42.895 INFO:teuthology.orchestra.run.smithi029.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T11:12:42.895 INFO:teuthology.orchestra.run.smithi029.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T11:12:42.895 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.895 INFO:teuthology.orchestra.run.smithi029.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T11:12:42.895 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T11:12:42.895 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T11:12:42.895 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.895 INFO:teuthology.orchestra.run.smithi029.stdout: # 1m isn't quite enough 2024-04-26T11:12:42.895 INFO:teuthology.orchestra.run.smithi029.stdout: mon_down_mkfs_grace = 2m 2024-04-26T11:12:42.895 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.895 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_filestore_osds = false 2024-04-26T11:12:42.896 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:42.896 INFO:teuthology.orchestra.run.smithi029.stdout:[client] 2024-04-26T11:12:42.896 INFO:teuthology.orchestra.run.smithi029.stdout: rgw cache enabled = true 2024-04-26T11:12:42.896 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable ops log = true 2024-04-26T11:12:42.896 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable usage log = true 2024-04-26T11:12:42.896 INFO:teuthology.orchestra.run.smithi029.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T11:12:42.896 INFO:teuthology.orchestra.run.smithi029.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T11:12:42.896 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.a] 2024-04-26T11:12:42.896 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.b] 2024-04-26T11:12:42.896 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.c] 2024-04-26T11:12:42.896 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2024-04-26T11:12:42.897 INFO:teuthology.orchestra.run.smithi029.stdout:[client.0] 2024-04-26T11:12:42.897 INFO:teuthology.orchestra.run.smithi029.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T11:12:42.897 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2024-04-26T11:12:42.898 INFO:teuthology.orchestra.run.smithi082.stdout: chdir = "" 2024-04-26T11:12:42.898 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T11:12:42.898 INFO:teuthology.orchestra.run.smithi082.stdout: auth supported = cephx 2024-04-26T11:12:42.898 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.898 INFO:teuthology.orchestra.run.smithi082.stdout: filestore xattr use omap = true 2024-04-26T11:12:42.898 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.898 INFO:teuthology.orchestra.run.smithi082.stdout: mon clock drift allowed = 1.000 2024-04-26T11:12:42.898 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.898 INFO:teuthology.orchestra.run.smithi082.stdout: osd crush chooseleaf type = 0 2024-04-26T11:12:42.898 INFO:teuthology.orchestra.run.smithi082.stdout: auth debug = true 2024-04-26T11:12:42.899 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.899 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on old message = true 2024-04-26T11:12:42.899 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on bug = true 2024-04-26T11:12:42.899 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.899 INFO:teuthology.orchestra.run.smithi082.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T11:12:42.899 INFO:teuthology.orchestra.run.smithi082.stdout: mon pg warn max object skew = 0 2024-04-26T11:12:42.899 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.899 INFO:teuthology.orchestra.run.smithi082.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T11:12:42.899 INFO:teuthology.orchestra.run.smithi082.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T11:12:42.899 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.899 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default size = 2 2024-04-26T11:12:42.899 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.900 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow primary affinity = true 2024-04-26T11:12:42.900 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow pg remap = true 2024-04-26T11:12:42.900 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on legacy crush tunables = false 2024-04-26T11:12:42.900 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on crush straw calc version zero = false 2024-04-26T11:12:42.900 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on no sortbitwise = false 2024-04-26T11:12:42.900 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on osd down out interval zero = false 2024-04-26T11:12:42.900 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on too few osds = false 2024-04-26T11:12:42.900 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T11:12:42.900 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T11:12:42.900 INFO:teuthology.orchestra.run.smithi082.stdout: mon_allow_pool_size_one = true 2024-04-26T11:12:42.900 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.900 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T11:12:42.901 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.901 INFO:teuthology.orchestra.run.smithi082.stdout: osd default data pool replay window = 5 2024-04-26T11:12:42.901 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.901 INFO:teuthology.orchestra.run.smithi082.stdout: mon allow pool delete = true 2024-04-26T11:12:42.901 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.901 INFO:teuthology.orchestra.run.smithi082.stdout: mon cluster log file level = debug 2024-04-26T11:12:42.901 INFO:teuthology.orchestra.run.smithi082.stdout: debug asserts on shutdown = true 2024-04-26T11:12:42.901 INFO:teuthology.orchestra.run.smithi082.stdout: mon health detail to clog = false 2024-04-26T11:12:42.901 INFO:teuthology.orchestra.run.smithi082.stdout: mon host = "172.21.15.29,[v2:172.21.15.29:3301,v1:172.21.15.29:6790],[v2:172.21.15.29:3302,v1:172.21.15.29:6791]" 2024-04-26T11:12:42.901 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = 2b52ce04-9559-478f-9787-c3cc3b261c15 2024-04-26T11:12:42.901 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.901 INFO:teuthology.orchestra.run.smithi082.stdout:[osd] 2024-04-26T11:12:42.901 INFO:teuthology.orchestra.run.smithi082.stdout: osd journal size = 100 2024-04-26T11:12:42.902 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.902 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub load threshold = 5.0 2024-04-26T11:12:42.902 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub max interval = 600 2024-04-26T11:12:42.902 INFO:teuthology.orchestra.run.smithi082.stdout: osd mclock profile = high_recovery_ops 2024-04-26T11:12:42.902 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.902 INFO:teuthology.orchestra.run.smithi082.stdout: osd recover clone overlap = true 2024-04-26T11:12:42.902 INFO:teuthology.orchestra.run.smithi082.stdout: osd recovery max chunk = 1048576 2024-04-26T11:12:42.902 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.902 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug shutdown = true 2024-04-26T11:12:42.902 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug op order = true 2024-04-26T11:12:42.902 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug verify stray on activate = true 2024-04-26T11:12:42.903 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.903 INFO:teuthology.orchestra.run.smithi082.stdout: osd open classes on start = true 2024-04-26T11:12:42.903 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug pg log writeout = true 2024-04-26T11:12:42.903 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.903 INFO:teuthology.orchestra.run.smithi082.stdout: osd deep scrub update digest min age = 30 2024-04-26T11:12:42.903 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.903 INFO:teuthology.orchestra.run.smithi082.stdout: osd map max advance = 10 2024-04-26T11:12:42.903 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.903 INFO:teuthology.orchestra.run.smithi082.stdout: journal zero on create = true 2024-04-26T11:12:42.903 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.903 INFO:teuthology.orchestra.run.smithi082.stdout: filestore ondisk finisher threads = 3 2024-04-26T11:12:42.903 INFO:teuthology.orchestra.run.smithi082.stdout: filestore apply finisher threads = 3 2024-04-26T11:12:42.904 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.904 INFO:teuthology.orchestra.run.smithi082.stdout: bdev debug aio = true 2024-04-26T11:12:42.904 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug misdirected ops = true 2024-04-26T11:12:42.904 INFO:teuthology.orchestra.run.smithi082.stdout: bluefs allocator = hybrid 2024-04-26T11:12:42.904 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore allocator = hybrid 2024-04-26T11:12:42.904 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore block size = 96636764160 2024-04-26T11:12:42.904 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore fsck on mount = True 2024-04-26T11:12:42.904 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluefs = 1/20 2024-04-26T11:12:42.904 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluestore = 1/20 2024-04-26T11:12:42.904 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-04-26T11:12:42.904 INFO:teuthology.orchestra.run.smithi082.stdout: debug osd = 20 2024-04-26T11:12:42.904 INFO:teuthology.orchestra.run.smithi082.stdout: debug rocksdb = 4/10 2024-04-26T11:12:42.904 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T11:12:42.905 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd full ratio = 0.9 2024-04-26T11:12:42.905 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd nearfull ratio = 0.8 2024-04-26T11:12:42.905 INFO:teuthology.orchestra.run.smithi082.stdout: osd blocked scrub grace period = 3600 2024-04-26T11:12:42.905 INFO:teuthology.orchestra.run.smithi082.stdout: osd failsafe full ratio = 0.95 2024-04-26T11:12:42.905 INFO:teuthology.orchestra.run.smithi082.stdout: osd max markdown count = 1000 2024-04-26T11:12:42.905 INFO:teuthology.orchestra.run.smithi082.stdout: osd objectstore = bluestore 2024-04-26T11:12:42.905 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.905 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr] 2024-04-26T11:12:42.905 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-04-26T11:12:42.905 INFO:teuthology.orchestra.run.smithi082.stdout: debug mgr = 20 2024-04-26T11:12:42.905 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-04-26T11:12:42.905 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-04-26T11:12:42.906 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-04-26T11:12:42.906 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-04-26T11:12:42.906 INFO:teuthology.orchestra.run.smithi082.stdout: mgr/telemetry/nag = false 2024-04-26T11:12:42.906 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.906 INFO:teuthology.orchestra.run.smithi082.stdout:[mon] 2024-04-26T11:12:42.906 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2024-04-26T11:12:42.906 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2024-04-26T11:12:42.906 INFO:teuthology.orchestra.run.smithi082.stdout: debug paxos = 20 2024-04-26T11:12:42.906 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2024-04-26T11:12:42.906 INFO:teuthology.orchestra.run.smithi082.stdout: mon data avail warn = 5 2024-04-26T11:12:42.906 INFO:teuthology.orchestra.run.smithi082.stdout: mon mgr mkfs grace = 240 2024-04-26T11:12:42.906 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2024-04-26T11:12:42.907 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd reporter subtree level = osd 2024-04-26T11:12:42.907 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd prime pg temp = true 2024-04-26T11:12:42.907 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2024-04-26T11:12:42.907 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.907 INFO:teuthology.orchestra.run.smithi082.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T11:12:42.907 INFO:teuthology.orchestra.run.smithi082.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T11:12:42.907 INFO:teuthology.orchestra.run.smithi082.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T11:12:42.907 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.907 INFO:teuthology.orchestra.run.smithi082.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T11:12:42.907 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T11:12:42.907 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T11:12:42.907 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.908 INFO:teuthology.orchestra.run.smithi082.stdout: # 1m isn't quite enough 2024-04-26T11:12:42.908 INFO:teuthology.orchestra.run.smithi082.stdout: mon_down_mkfs_grace = 2m 2024-04-26T11:12:42.908 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.908 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_filestore_osds = false 2024-04-26T11:12:42.908 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-04-26T11:12:42.908 INFO:teuthology.orchestra.run.smithi082.stdout:[client] 2024-04-26T11:12:42.908 INFO:teuthology.orchestra.run.smithi082.stdout: rgw cache enabled = true 2024-04-26T11:12:42.908 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable ops log = true 2024-04-26T11:12:42.908 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable usage log = true 2024-04-26T11:12:42.908 INFO:teuthology.orchestra.run.smithi082.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T11:12:42.908 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T11:12:42.908 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.a] 2024-04-26T11:12:42.909 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.b] 2024-04-26T11:12:42.909 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.c] 2024-04-26T11:12:42.909 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a] 2024-04-26T11:12:42.909 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2024-04-26T11:12:42.909 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T11:12:42.909 INFO:teuthology.orchestra.run.smithi072.stdout:[global] 2024-04-26T11:12:42.909 INFO:teuthology.orchestra.run.smithi072.stdout: chdir = "" 2024-04-26T11:12:42.909 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T11:12:42.909 INFO:teuthology.orchestra.run.smithi072.stdout: auth supported = cephx 2024-04-26T11:12:42.909 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.909 INFO:teuthology.orchestra.run.smithi072.stdout: filestore xattr use omap = true 2024-04-26T11:12:42.910 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.910 INFO:teuthology.orchestra.run.smithi072.stdout: mon clock drift allowed = 1.000 2024-04-26T11:12:42.910 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.910 INFO:teuthology.orchestra.run.smithi072.stdout: osd crush chooseleaf type = 0 2024-04-26T11:12:42.910 INFO:teuthology.orchestra.run.smithi072.stdout: auth debug = true 2024-04-26T11:12:42.910 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.910 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on old message = true 2024-04-26T11:12:42.910 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on bug = true 2024-04-26T11:12:42.910 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.910 INFO:teuthology.orchestra.run.smithi072.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T11:12:42.910 INFO:teuthology.orchestra.run.smithi072.stdout: mon pg warn max object skew = 0 2024-04-26T11:12:42.910 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.911 INFO:teuthology.orchestra.run.smithi072.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T11:12:42.911 INFO:teuthology.orchestra.run.smithi072.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T11:12:42.911 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.911 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default size = 2 2024-04-26T11:12:42.911 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.911 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow primary affinity = true 2024-04-26T11:12:42.911 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow pg remap = true 2024-04-26T11:12:42.911 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on legacy crush tunables = false 2024-04-26T11:12:42.911 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on crush straw calc version zero = false 2024-04-26T11:12:42.911 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on no sortbitwise = false 2024-04-26T11:12:42.911 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on osd down out interval zero = false 2024-04-26T11:12:42.911 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on too few osds = false 2024-04-26T11:12:42.912 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T11:12:42.912 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T11:12:42.912 INFO:teuthology.orchestra.run.smithi072.stdout: mon_allow_pool_size_one = true 2024-04-26T11:12:42.912 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.912 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T11:12:42.912 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.912 INFO:teuthology.orchestra.run.smithi072.stdout: osd default data pool replay window = 5 2024-04-26T11:12:42.912 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.912 INFO:teuthology.orchestra.run.smithi072.stdout: mon allow pool delete = true 2024-04-26T11:12:42.912 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.912 INFO:teuthology.orchestra.run.smithi072.stdout: mon cluster log file level = debug 2024-04-26T11:12:42.912 INFO:teuthology.orchestra.run.smithi072.stdout: debug asserts on shutdown = true 2024-04-26T11:12:42.913 INFO:teuthology.orchestra.run.smithi072.stdout: mon health detail to clog = false 2024-04-26T11:12:42.913 INFO:teuthology.orchestra.run.smithi072.stdout: mon host = "172.21.15.29,[v2:172.21.15.29:3301,v1:172.21.15.29:6790],[v2:172.21.15.29:3302,v1:172.21.15.29:6791]" 2024-04-26T11:12:42.913 INFO:teuthology.orchestra.run.smithi072.stdout: fsid = 2b52ce04-9559-478f-9787-c3cc3b261c15 2024-04-26T11:12:42.913 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.913 INFO:teuthology.orchestra.run.smithi072.stdout:[osd] 2024-04-26T11:12:42.913 INFO:teuthology.orchestra.run.smithi072.stdout: osd journal size = 100 2024-04-26T11:12:42.913 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.913 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub load threshold = 5.0 2024-04-26T11:12:42.913 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub max interval = 600 2024-04-26T11:12:42.913 INFO:teuthology.orchestra.run.smithi072.stdout: osd mclock profile = high_recovery_ops 2024-04-26T11:12:42.913 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.914 INFO:teuthology.orchestra.run.smithi072.stdout: osd recover clone overlap = true 2024-04-26T11:12:42.914 INFO:teuthology.orchestra.run.smithi072.stdout: osd recovery max chunk = 1048576 2024-04-26T11:12:42.914 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.914 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug shutdown = true 2024-04-26T11:12:42.914 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug op order = true 2024-04-26T11:12:42.914 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug verify stray on activate = true 2024-04-26T11:12:42.914 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.914 INFO:teuthology.orchestra.run.smithi072.stdout: osd open classes on start = true 2024-04-26T11:12:42.914 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug pg log writeout = true 2024-04-26T11:12:42.914 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.914 INFO:teuthology.orchestra.run.smithi072.stdout: osd deep scrub update digest min age = 30 2024-04-26T11:12:42.914 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.915 INFO:teuthology.orchestra.run.smithi072.stdout: osd map max advance = 10 2024-04-26T11:12:42.915 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.915 INFO:teuthology.orchestra.run.smithi072.stdout: journal zero on create = true 2024-04-26T11:12:42.915 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.915 INFO:teuthology.orchestra.run.smithi072.stdout: filestore ondisk finisher threads = 3 2024-04-26T11:12:42.915 INFO:teuthology.orchestra.run.smithi072.stdout: filestore apply finisher threads = 3 2024-04-26T11:12:42.915 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.915 INFO:teuthology.orchestra.run.smithi072.stdout: bdev debug aio = true 2024-04-26T11:12:42.915 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug misdirected ops = true 2024-04-26T11:12:42.915 INFO:teuthology.orchestra.run.smithi072.stdout: bluefs allocator = hybrid 2024-04-26T11:12:42.915 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore allocator = hybrid 2024-04-26T11:12:42.915 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore block size = 96636764160 2024-04-26T11:12:42.916 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore fsck on mount = True 2024-04-26T11:12:42.916 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluefs = 1/20 2024-04-26T11:12:42.916 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluestore = 1/20 2024-04-26T11:12:42.916 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-04-26T11:12:42.916 INFO:teuthology.orchestra.run.smithi072.stdout: debug osd = 20 2024-04-26T11:12:42.916 INFO:teuthology.orchestra.run.smithi072.stdout: debug rocksdb = 4/10 2024-04-26T11:12:42.916 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T11:12:42.916 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd full ratio = 0.9 2024-04-26T11:12:42.916 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd nearfull ratio = 0.8 2024-04-26T11:12:42.916 INFO:teuthology.orchestra.run.smithi072.stdout: osd blocked scrub grace period = 3600 2024-04-26T11:12:42.916 INFO:teuthology.orchestra.run.smithi072.stdout: osd failsafe full ratio = 0.95 2024-04-26T11:12:42.917 INFO:teuthology.orchestra.run.smithi072.stdout: osd max markdown count = 1000 2024-04-26T11:12:42.917 INFO:teuthology.orchestra.run.smithi072.stdout: osd objectstore = bluestore 2024-04-26T11:12:42.917 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.917 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr] 2024-04-26T11:12:42.917 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-04-26T11:12:42.917 INFO:teuthology.orchestra.run.smithi072.stdout: debug mgr = 20 2024-04-26T11:12:42.917 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2024-04-26T11:12:42.917 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2024-04-26T11:12:42.917 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2024-04-26T11:12:42.917 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2024-04-26T11:12:42.917 INFO:teuthology.orchestra.run.smithi072.stdout: mgr/telemetry/nag = false 2024-04-26T11:12:42.917 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.918 INFO:teuthology.orchestra.run.smithi072.stdout:[mon] 2024-04-26T11:12:42.918 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-04-26T11:12:42.918 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2024-04-26T11:12:42.918 INFO:teuthology.orchestra.run.smithi072.stdout: debug paxos = 20 2024-04-26T11:12:42.918 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2024-04-26T11:12:42.918 INFO:teuthology.orchestra.run.smithi072.stdout: mon data avail warn = 5 2024-04-26T11:12:42.918 INFO:teuthology.orchestra.run.smithi072.stdout: mon mgr mkfs grace = 240 2024-04-26T11:12:42.918 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2024-04-26T11:12:42.918 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd reporter subtree level = osd 2024-04-26T11:12:42.918 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd prime pg temp = true 2024-04-26T11:12:42.918 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2024-04-26T11:12:42.918 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.919 INFO:teuthology.orchestra.run.smithi072.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T11:12:42.919 INFO:teuthology.orchestra.run.smithi072.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T11:12:42.919 INFO:teuthology.orchestra.run.smithi072.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T11:12:42.919 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.919 INFO:teuthology.orchestra.run.smithi072.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T11:12:42.919 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T11:12:42.919 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T11:12:42.919 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.919 INFO:teuthology.orchestra.run.smithi072.stdout: # 1m isn't quite enough 2024-04-26T11:12:42.919 INFO:teuthology.orchestra.run.smithi072.stdout: mon_down_mkfs_grace = 2m 2024-04-26T11:12:42.919 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.919 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_filestore_osds = false 2024-04-26T11:12:42.920 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-04-26T11:12:42.920 INFO:teuthology.orchestra.run.smithi072.stdout:[client] 2024-04-26T11:12:42.920 INFO:teuthology.orchestra.run.smithi072.stdout: rgw cache enabled = true 2024-04-26T11:12:42.920 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable ops log = true 2024-04-26T11:12:42.920 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable usage log = true 2024-04-26T11:12:42.920 INFO:teuthology.orchestra.run.smithi072.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T11:12:42.920 INFO:teuthology.orchestra.run.smithi072.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T11:12:42.920 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.a] 2024-04-26T11:12:42.920 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.b] 2024-04-26T11:12:42.920 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.c] 2024-04-26T11:12:42.920 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2024-04-26T11:12:42.920 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2024-04-26T11:12:42.921 INFO:teuthology.orchestra.run.smithi072.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T11:12:42.923 INFO:teuthology.orchestra.run.smithi122.stdout:[global] 2024-04-26T11:12:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: chdir = "" 2024-04-26T11:12:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T11:12:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: auth supported = cephx 2024-04-26T11:12:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: filestore xattr use omap = true 2024-04-26T11:12:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: mon clock drift allowed = 1.000 2024-04-26T11:12:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: osd crush chooseleaf type = 0 2024-04-26T11:12:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: auth debug = true 2024-04-26T11:12:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on old message = true 2024-04-26T11:12:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: ms die on bug = true 2024-04-26T11:12:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T11:12:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: mon pg warn max object skew = 0 2024-04-26T11:12:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T11:12:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T11:12:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default size = 2 2024-04-26T11:12:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd allow primary affinity = true 2024-04-26T11:12:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd allow pg remap = true 2024-04-26T11:12:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on legacy crush tunables = false 2024-04-26T11:12:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on crush straw calc version zero = false 2024-04-26T11:12:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on no sortbitwise = false 2024-04-26T11:12:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on osd down out interval zero = false 2024-04-26T11:12:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: mon warn on too few osds = false 2024-04-26T11:12:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T11:12:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T11:12:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: mon_allow_pool_size_one = true 2024-04-26T11:12:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T11:12:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: osd default data pool replay window = 5 2024-04-26T11:12:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: mon allow pool delete = true 2024-04-26T11:12:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: mon cluster log file level = debug 2024-04-26T11:12:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: debug asserts on shutdown = true 2024-04-26T11:12:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: mon health detail to clog = false 2024-04-26T11:12:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: mon host = "172.21.15.29,[v2:172.21.15.29:3301,v1:172.21.15.29:6790],[v2:172.21.15.29:3302,v1:172.21.15.29:6791]" 2024-04-26T11:12:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: fsid = 2b52ce04-9559-478f-9787-c3cc3b261c15 2024-04-26T11:12:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.927 INFO:teuthology.orchestra.run.smithi122.stdout:[osd] 2024-04-26T11:12:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: osd journal size = 100 2024-04-26T11:12:42.928 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.928 INFO:teuthology.orchestra.run.smithi122.stdout: osd scrub load threshold = 5.0 2024-04-26T11:12:42.928 INFO:teuthology.orchestra.run.smithi122.stdout: osd scrub max interval = 600 2024-04-26T11:12:42.928 INFO:teuthology.orchestra.run.smithi122.stdout: osd mclock profile = high_recovery_ops 2024-04-26T11:12:42.928 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.928 INFO:teuthology.orchestra.run.smithi122.stdout: osd recover clone overlap = true 2024-04-26T11:12:42.928 INFO:teuthology.orchestra.run.smithi122.stdout: osd recovery max chunk = 1048576 2024-04-26T11:12:42.928 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.928 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug shutdown = true 2024-04-26T11:12:42.928 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug op order = true 2024-04-26T11:12:42.928 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug verify stray on activate = true 2024-04-26T11:12:42.928 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.929 INFO:teuthology.orchestra.run.smithi122.stdout: osd open classes on start = true 2024-04-26T11:12:42.929 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug pg log writeout = true 2024-04-26T11:12:42.929 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.929 INFO:teuthology.orchestra.run.smithi122.stdout: osd deep scrub update digest min age = 30 2024-04-26T11:12:42.929 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.929 INFO:teuthology.orchestra.run.smithi122.stdout: osd map max advance = 10 2024-04-26T11:12:42.929 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.929 INFO:teuthology.orchestra.run.smithi122.stdout: journal zero on create = true 2024-04-26T11:12:42.929 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.930 INFO:teuthology.orchestra.run.smithi122.stdout: filestore ondisk finisher threads = 3 2024-04-26T11:12:42.930 INFO:teuthology.orchestra.run.smithi122.stdout: filestore apply finisher threads = 3 2024-04-26T11:12:42.930 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.930 INFO:teuthology.orchestra.run.smithi122.stdout: bdev debug aio = true 2024-04-26T11:12:42.930 INFO:teuthology.orchestra.run.smithi122.stdout: osd debug misdirected ops = true 2024-04-26T11:12:42.930 INFO:teuthology.orchestra.run.smithi122.stdout: bluefs allocator = hybrid 2024-04-26T11:12:42.930 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore allocator = hybrid 2024-04-26T11:12:42.930 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore block size = 96636764160 2024-04-26T11:12:42.930 INFO:teuthology.orchestra.run.smithi122.stdout: bluestore fsck on mount = True 2024-04-26T11:12:42.930 INFO:teuthology.orchestra.run.smithi122.stdout: debug bluefs = 1/20 2024-04-26T11:12:42.930 INFO:teuthology.orchestra.run.smithi122.stdout: debug bluestore = 1/20 2024-04-26T11:12:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-04-26T11:12:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: debug osd = 20 2024-04-26T11:12:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: debug rocksdb = 4/10 2024-04-26T11:12:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T11:12:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd full ratio = 0.9 2024-04-26T11:12:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd nearfull ratio = 0.8 2024-04-26T11:12:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: osd blocked scrub grace period = 3600 2024-04-26T11:12:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: osd failsafe full ratio = 0.95 2024-04-26T11:12:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: osd max markdown count = 1000 2024-04-26T11:12:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: osd objectstore = bluestore 2024-04-26T11:12:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.931 INFO:teuthology.orchestra.run.smithi122.stdout:[mgr] 2024-04-26T11:12:42.932 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-04-26T11:12:42.932 INFO:teuthology.orchestra.run.smithi122.stdout: debug mgr = 20 2024-04-26T11:12:42.932 INFO:teuthology.orchestra.run.smithi122.stdout: debug mon = 20 2024-04-26T11:12:42.932 INFO:teuthology.orchestra.run.smithi122.stdout: debug auth = 20 2024-04-26T11:12:42.932 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min pgs per osd = 4 2024-04-26T11:12:42.932 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min bytes per osd = 10 2024-04-26T11:12:42.932 INFO:teuthology.orchestra.run.smithi122.stdout: mgr/telemetry/nag = false 2024-04-26T11:12:42.932 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.932 INFO:teuthology.orchestra.run.smithi122.stdout:[mon] 2024-04-26T11:12:42.932 INFO:teuthology.orchestra.run.smithi122.stdout: debug ms = 1 2024-04-26T11:12:42.932 INFO:teuthology.orchestra.run.smithi122.stdout: debug mon = 20 2024-04-26T11:12:42.932 INFO:teuthology.orchestra.run.smithi122.stdout: debug paxos = 20 2024-04-26T11:12:42.933 INFO:teuthology.orchestra.run.smithi122.stdout: debug auth = 20 2024-04-26T11:12:42.933 INFO:teuthology.orchestra.run.smithi122.stdout: mon data avail warn = 5 2024-04-26T11:12:42.933 INFO:teuthology.orchestra.run.smithi122.stdout: mon mgr mkfs grace = 240 2024-04-26T11:12:42.933 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min pgs per osd = 4 2024-04-26T11:12:42.933 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd reporter subtree level = osd 2024-04-26T11:12:42.933 INFO:teuthology.orchestra.run.smithi122.stdout: mon osd prime pg temp = true 2024-04-26T11:12:42.933 INFO:teuthology.orchestra.run.smithi122.stdout: mon reweight min bytes per osd = 10 2024-04-26T11:12:42.933 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T11:12:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T11:12:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T11:12:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T11:12:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T11:12:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T11:12:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: # 1m isn't quite enough 2024-04-26T11:12:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: mon_down_mkfs_grace = 2m 2024-04-26T11:12:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: mon_warn_on_filestore_osds = false 2024-04-26T11:12:42.935 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-04-26T11:12:42.935 INFO:teuthology.orchestra.run.smithi122.stdout:[client] 2024-04-26T11:12:42.935 INFO:teuthology.orchestra.run.smithi122.stdout: rgw cache enabled = true 2024-04-26T11:12:42.935 INFO:teuthology.orchestra.run.smithi122.stdout: rgw enable ops log = true 2024-04-26T11:12:42.935 INFO:teuthology.orchestra.run.smithi122.stdout: rgw enable usage log = true 2024-04-26T11:12:42.935 INFO:teuthology.orchestra.run.smithi122.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T11:12:42.935 INFO:teuthology.orchestra.run.smithi122.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T11:12:42.935 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.a] 2024-04-26T11:12:42.935 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.b] 2024-04-26T11:12:42.935 INFO:teuthology.orchestra.run.smithi122.stdout:[mon.c] 2024-04-26T11:12:42.935 INFO:teuthology.orchestra.run.smithi122.stdout:[mds.a] 2024-04-26T11:12:42.935 INFO:teuthology.orchestra.run.smithi122.stdout:[client.0] 2024-04-26T11:12:42.936 INFO:teuthology.orchestra.run.smithi122.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T11:12:42.936 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T11:12:42.936 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T11:12:43.020 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T11:12:43.021 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:12:43.021 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T11:12:43.039 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:12:43.039 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T11:12:43.098 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi029.front.sepia.ceph.com 2024-04-26T11:12:43.098 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:12:43.098 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T11:12:43.098 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T11:12:43.174 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:12:43.175 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:12:43.234 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T11:12:43.234 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T11:12:43.234 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T11:12:43.234 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T11:12:43.277 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T11:12:43.277 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:12:43.337 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T11:12:43.337 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T11:12:43.337 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T11:12:43.337 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T11:12:43.381 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T11:12:43.381 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:12:43.441 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi122.front.sepia.ceph.com 2024-04-26T11:12:43.441 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-26T11:12:43.441 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T11:12:43.441 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T11:12:43.486 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-26T11:12:43.486 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:12:43.548 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T11:12:43.549 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T11:12:43.549 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T11:12:43.607 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T11:12:43.609 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T11:12:43.664 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T11:12:43.666 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T11:12:43.666 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T11:12:43.720 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T11:12:43.723 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T11:12:43.750 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T11:12:43.750 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T11:12:43.834 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T11:12:43.847 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T11:12:43.847 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi122.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-26T11:12:43.848 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T11:12:43.880 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T11:12:43.880 INFO:tasks.ceph:role: osd.0 2024-04-26T11:12:43.880 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T11:12:43.880 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T11:12:43.957 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T11:12:43.958 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T11:12:43.958 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T11:12:43.958 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T11:12:43.958 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T11:12:43.958 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-04-26T11:12:43.958 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T11:12:43.958 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T11:12:43.958 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T11:12:43.958 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T11:12:44.390 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2024-04-26T11:12:44.391 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-04-26T11:12:44.391 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T11:12:44.566 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T11:12:44.602 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:12:44.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T11:12:44.975+0000 7f194f193800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T11:12:44.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T11:12:44.975+0000 7f194f193800 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T11:12:44.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T11:12:44.975+0000 7f194f193800 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T11:12:44.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T11:12:44.975+0000 7f194f193800 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T11:12:44.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T11:12:44.975+0000 7f194f193800 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T11:12:44.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-04-26T11:12:44.976+0000 7f194f193800 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T11:12:47.827 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T11:12:47.860 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T11:12:47.894 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-26T11:12:47.895 INFO:tasks.ceph:role: osd.1 2024-04-26T11:12:47.895 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T11:12:47.895 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T11:12:47.973 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T11:12:47.974 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T11:12:47.974 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T11:12:47.974 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T11:12:47.974 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T11:12:47.974 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2024-04-26T11:12:47.974 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T11:12:47.974 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T11:12:47.974 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T11:12:47.974 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T11:12:48.412 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2024-04-26T11:12:48.414 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2024-04-26T11:12:48.414 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-26T11:12:48.575 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T11:12:48.612 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:12:48.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T11:12:48.717+0000 7f16ed736800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T11:12:48.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T11:12:48.721+0000 7f16ed736800 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T11:12:48.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T11:12:48.721+0000 7f16ed736800 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T11:12:48.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T11:12:48.721+0000 7f16ed736800 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T11:12:48.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T11:12:48.721+0000 7f16ed736800 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T11:12:48.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-04-26T11:12:48.723+0000 7f16ed736800 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T11:12:51.579 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T11:12:51.611 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T11:12:51.645 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-26T11:12:51.645 INFO:tasks.ceph:role: osd.2 2024-04-26T11:12:51.645 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi122.front.sepia.ceph.com 2024-04-26T11:12:51.645 DEBUG:teuthology.orchestra.run.smithi122:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T11:12:51.725 INFO:teuthology.orchestra.run.smithi122.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T11:12:51.725 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T11:12:51.725 INFO:teuthology.orchestra.run.smithi122.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T11:12:51.725 INFO:teuthology.orchestra.run.smithi122.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T11:12:51.726 INFO:teuthology.orchestra.run.smithi122.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T11:12:51.726 INFO:teuthology.orchestra.run.smithi122.stdout: = sunit=0 swidth=0 blks 2024-04-26T11:12:51.726 INFO:teuthology.orchestra.run.smithi122.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T11:12:51.726 INFO:teuthology.orchestra.run.smithi122.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T11:12:51.726 INFO:teuthology.orchestra.run.smithi122.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T11:12:51.726 INFO:teuthology.orchestra.run.smithi122.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T11:12:52.158 INFO:teuthology.orchestra.run.smithi122.stdout:Discarding blocks...Done. 2024-04-26T11:12:52.160 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi122.front.sepia.ceph.com -o noatime 2024-04-26T11:12:52.160 DEBUG:teuthology.orchestra.run.smithi122:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-26T11:12:52.316 DEBUG:teuthology.orchestra.run.smithi122:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T11:12:52.356 DEBUG:teuthology.orchestra.run.smithi122:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:12:52.460 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-26T11:12:52.459+0000 7f95829d1800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T11:12:52.461 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-26T11:12:52.460+0000 7f95829d1800 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T11:12:52.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-26T11:12:52.460+0000 7f95829d1800 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T11:12:52.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-26T11:12:52.460+0000 7f95829d1800 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T11:12:52.462 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-26T11:12:52.460+0000 7f95829d1800 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T11:12:52.468 INFO:teuthology.orchestra.run.smithi122.stderr:2024-04-26T11:12:52.467+0000 7f95829d1800 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T11:12:55.320 DEBUG:teuthology.orchestra.run.smithi122:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T11:12:55.353 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T11:12:55.353 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:12:55.353 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T11:12:55.387 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:12:55.387 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T11:12:55.460 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:12:55.460 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T11:12:55.532 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T11:12:55.532 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T11:12:55.564 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T11:12:55.564 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T11:12:55.597 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-26T11:12:55.597 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T11:12:55.629 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-04-26T11:12:55.629 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T11:12:55.651 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T11:12:55.652 DEBUG:teuthology.orchestra.run.smithi029:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T11:12:55.721 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.x] 2024-04-26T11:12:55.721 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQArjCtmuGckJBAA09hDZdhHrO3AjWyLrQi15g== 2024-04-26T11:12:55.721 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.y] 2024-04-26T11:12:55.721 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQArjCtm3fGNJxAA6SjsMSvbJ5UWVftz81moLQ== 2024-04-26T11:12:55.721 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2024-04-26T11:12:55.722 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQArjCtmioXuKhAAYubz3suawQjJXoWEhVw/rg== 2024-04-26T11:12:55.722 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.0] 2024-04-26T11:12:55.722 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAsjCtmJQ43OhAAh6hTqzBWrvSm3dslqZDgng== 2024-04-26T11:12:55.722 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.1] 2024-04-26T11:12:55.722 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAwjCtm6VnbKhAAf43FOgrp/NS852fxgCZfWw== 2024-04-26T11:12:55.722 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.2] 2024-04-26T11:12:55.722 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQA0jCtmWotuGxAAHX1YP35eo3eP8vV6lL8Vbw== 2024-04-26T11:12:55.722 INFO:teuthology.orchestra.run.smithi029.stdout:[client.0] 2024-04-26T11:12:55.722 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQArjCtm8V26MRAAdiYBGpJroq+IRpTms1uMWA== 2024-04-26T11:12:55.723 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T11:12:55.911 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T11:12:56.120 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T11:12:56.313 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T11:12:56.434 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T11:12:56.600 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T11:12:56.807 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T11:12:56.957 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T11:12:56.957 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T11:12:56.986 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T11:12:57.329 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T11:12:57.360 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T11:12:57.431 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T11:12:57.533 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T11:12:57.560 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T11:12:57.628 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T11:12:57.727 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T11:12:57.754 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:12:57.813 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T11:12:57.813 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T11:12:57.813 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T11:12:57.855 INFO:tasks.ceph.mon.a:Started 2024-04-26T11:12:57.855 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T11:12:57.855 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T11:12:57.857 INFO:tasks.ceph.mon.b:Started 2024-04-26T11:12:57.857 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T11:12:57.857 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T11:12:57.859 INFO:tasks.ceph.mon.c:Started 2024-04-26T11:12:57.859 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T11:12:57.859 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T11:12:57.859 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T11:12:57.861 INFO:tasks.ceph.mgr.x:Started 2024-04-26T11:12:57.861 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T11:12:57.862 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T11:12:57.863 INFO:tasks.ceph.mgr.y:Started 2024-04-26T11:12:57.864 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T11:12:57.864 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T11:12:58.294 INFO:teuthology.orchestra.run.smithi029.stderr:adjusted tunables profile to default 2024-04-26T11:12:58.309 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T11:12:58.309 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T11:12:58.309 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-04-26T11:12:58.310 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T11:12:58.331 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:12:58.330+0000 7f21676ee240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T11:12:58.332 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:12:58.330+0000 7fb9f543c240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T11:12:58.341 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-04-26T11:12:58.341 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T11:12:58.373 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-04-26T11:12:58.374 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T11:12:58.406 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new c3496b3f-5972-47ff-a449-832f5055beac 0 2024-04-26T11:12:58.521 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:12:58.519+0000 7fb9f543c240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T11:12:58.522 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:12:58.519+0000 7f21676ee240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T11:12:58.677 INFO:teuthology.orchestra.run.smithi122.stdout:0 2024-04-26T11:12:58.689 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new 4842abe1-e7b4-480f-85b3-11c8fa2123f1 1 2024-04-26T11:12:58.896 INFO:teuthology.orchestra.run.smithi122.stdout:1 2024-04-26T11:12:58.908 DEBUG:teuthology.orchestra.run.smithi122:> sudo ceph --cluster ceph osd new 57b4a874-e4ce-42a9-a7fd-f9e0acf03cec 2 2024-04-26T11:12:58.933 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:12:58.931+0000 7f21676ee240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T11:12:58.933 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:12:58.931+0000 7fb9f543c240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T11:12:59.119 INFO:teuthology.orchestra.run.smithi122.stdout:2 2024-04-26T11:12:59.131 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T11:12:59.131 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T11:12:59.133 INFO:tasks.ceph.osd.0:Started 2024-04-26T11:12:59.134 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T11:12:59.134 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T11:12:59.136 INFO:tasks.ceph.osd.1:Started 2024-04-26T11:12:59.136 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T11:12:59.137 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T11:12:59.138 INFO:tasks.ceph.osd.2:Started 2024-04-26T11:12:59.139 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:12:59.352 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:12:59.352 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":5,"fsid":"2b52ce04-9559-478f-9787-c3cc3b261c15","created":"2024-04-26T11:12:58.193418+0000","modified":"2024-04-26T11:12:59.116286+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T11:12:59.116286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c3496b3f-5972-47ff-a449-832f5055beac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4842abe1-e7b4-480f-85b3-11c8fa2123f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"57b4a874-e4ce-42a9-a7fd-f9e0acf03cec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:12:59.366 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T11:12:59.366 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T11:12:59.450 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:12:59.448+0000 7f21676ee240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T11:12:59.450 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:12:59.448+0000 7fb9f543c240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T11:12:59.668 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T11:12:59.673 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:12:59.671+0000 7fb9f543c240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T11:12:59.673 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:12:59.671+0000 7f21676ee240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T11:12:59.725 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:12:59.723+0000 7f236c0cd800 -1 Falling back to public interface 2024-04-26T11:12:59.731 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:12:59.731+0000 7fe89bb52800 -1 Falling back to public interface 2024-04-26T11:12:59.735 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:12:59.733+0000 7f9e360d4800 -1 Falling back to public interface 2024-04-26T11:12:59.866 INFO:teuthology.misc.health.smithi029.stdout: 2024-04-26T11:12:59.866 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":5,"fsid":"2b52ce04-9559-478f-9787-c3cc3b261c15","created":"2024-04-26T11:12:58.193418+0000","modified":"2024-04-26T11:12:59.116286+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T11:12:59.116286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c3496b3f-5972-47ff-a449-832f5055beac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4842abe1-e7b4-480f-85b3-11c8fa2123f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"57b4a874-e4ce-42a9-a7fd-f9e0acf03cec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:12:59.883 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-26T11:13:00.103 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:13:00.101+0000 7fb9f543c240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T11:13:00.104 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:13:00.101+0000 7f21676ee240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T11:13:00.824 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:13:00.822+0000 7f21676ee240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T11:13:00.825 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:13:00.823+0000 7fb9f543c240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T11:13:00.903 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:13:00.901+0000 7f21676ee240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T11:13:00.903 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:13:00.901+0000 7fb9f543c240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T11:13:01.047 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:13:01.045+0000 7f21676ee240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T11:13:01.047 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:13:01.045+0000 7fb9f543c240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T11:13:01.236 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:13:01.234+0000 7f21676ee240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T11:13:01.236 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:13:01.234+0000 7fb9f543c240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T11:13:01.315 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:13:01.313+0000 7f21676ee240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T11:13:01.316 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:13:01.314+0000 7fb9f543c240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T11:13:01.400 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:13:01.398+0000 7f21676ee240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T11:13:01.400 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:13:01.398+0000 7fb9f543c240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T11:13:01.483 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:13:01.481+0000 7f21676ee240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T11:13:01.483 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:13:01.481+0000 7fb9f543c240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T11:13:01.578 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:13:01.576+0000 7fb9f543c240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T11:13:01.578 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:13:01.576+0000 7f21676ee240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T11:13:01.789 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:13:01.787+0000 7f21676ee240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T11:13:01.789 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:13:01.787+0000 7fb9f543c240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T11:13:02.020 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:13:02.018+0000 7fb9f543c240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T11:13:02.020 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:13:02.018+0000 7f21676ee240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T11:13:02.187 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:13:02.185+0000 7f21676ee240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T11:13:02.188 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:13:02.186+0000 7fb9f543c240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T11:13:02.264 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:13:02.262+0000 7fb9f543c240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T11:13:02.264 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:13:02.262+0000 7f21676ee240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T11:13:02.989 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:13:02.987+0000 7fb9f543c240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T11:13:02.989 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:13:02.988+0000 7f21676ee240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T11:13:03.162 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:03.161+0000 7fe89bb52800 -1 osd.0 0 log_to_monitors true 2024-04-26T11:13:03.165 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:03.163+0000 7f9e360d4800 -1 osd.1 0 log_to_monitors true 2024-04-26T11:13:03.167 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:13:03.165+0000 7f21676ee240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T11:13:03.167 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:13:03.166+0000 7fb9f543c240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T11:13:03.176 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:03.174+0000 7f236c0cd800 -1 osd.2 0 log_to_monitors true 2024-04-26T11:13:03.341 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:13:03.339+0000 7f21676ee240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:13:03.342 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:13:03.339+0000 7fb9f543c240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:13:03.772 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:13:03.770+0000 7fb9f543c240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T11:13:03.773 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:13:03.771+0000 7f21676ee240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T11:13:03.947 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:13:03.945+0000 7fb9f543c240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:13:03.947 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:13:03.945+0000 7f21676ee240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:13:04.336 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:13:04.334+0000 7f21676ee240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T11:13:04.337 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:13:04.335+0000 7fb9f543c240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T11:13:04.443 INFO:tasks.ceph.mgr.y.smithi029.stderr:2024-04-26T11:13:04.442+0000 7f21676ee240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T11:13:04.444 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:13:04.442+0000 7fb9f543c240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T11:13:05.098 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:05.095+0000 7f9e2a475700 -1 osd.1 0 waiting for initial osdmap 2024-04-26T11:13:05.101 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:05.100+0000 7f2360c6f700 -1 osd.2 0 waiting for initial osdmap 2024-04-26T11:13:05.108 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:05.106+0000 7f9e2204f700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T11:13:05.115 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:05.114+0000 7f2358048700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T11:13:05.129 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:05.128+0000 7fe88fef3700 -1 osd.0 0 waiting for initial osdmap 2024-04-26T11:13:05.140 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:05.139+0000 7fe887acd700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T11:13:05.462 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:13:05.460+0000 7fb9b682b700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T11:13:05.462 INFO:tasks.ceph.mgr.x.smithi029.stderr:2024-04-26T11:13:05.460+0000 7fb9b682b700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T11:13:06.186 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T11:13:06.535 INFO:teuthology.misc.health.smithi029.stdout: 2024-04-26T11:13:06.535 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":8,"fsid":"2b52ce04-9559-478f-9787-c3cc3b261c15","created":"2024-04-26T11:12:58.193418+0000","modified":"2024-04-26T11:13:06.102821+0000","last_up_change":"2024-04-26T11:13:06.102821+0000","last_in_change":"2024-04-26T11:12:59.116286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c3496b3f-5972-47ff-a449-832f5055beac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":41434},{"type":"v1","addr":"172.21.15.72:6801","nonce":41434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":41434},{"type":"v1","addr":"172.21.15.72:6803","nonce":41434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":41434},{"type":"v1","addr":"172.21.15.72:6807","nonce":41434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":41434},{"type":"v1","addr":"172.21.15.72:6805","nonce":41434}]},"public_addr":"172.21.15.72:6801/41434","cluster_addr":"172.21.15.72:6803/41434","heartbeat_back_addr":"172.21.15.72:6807/41434","heartbeat_front_addr":"172.21.15.72:6805/41434","state":["exists","up"]},{"osd":1,"uuid":"4842abe1-e7b4-480f-85b3-11c8fa2123f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":41442},{"type":"v1","addr":"172.21.15.82:6801","nonce":41442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":41442},{"type":"v1","addr":"172.21.15.82:6803","nonce":41442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":41442},{"type":"v1","addr":"172.21.15.82:6807","nonce":41442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":41442},{"type":"v1","addr":"172.21.15.82:6805","nonce":41442}]},"public_addr":"172.21.15.82:6801/41442","cluster_addr":"172.21.15.82:6803/41442","heartbeat_back_addr":"172.21.15.82:6807/41442","heartbeat_front_addr":"172.21.15.82:6805/41442","state":["exists","up"]},{"osd":2,"uuid":"57b4a874-e4ce-42a9-a7fd-f9e0acf03cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":41571},{"type":"v1","addr":"172.21.15.122:6801","nonce":41571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":41571},{"type":"v1","addr":"172.21.15.122:6803","nonce":41571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":41571},{"type":"v1","addr":"172.21.15.122:6807","nonce":41571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":41571},{"type":"v1","addr":"172.21.15.122:6805","nonce":41571}]},"public_addr":"172.21.15.122:6801/41571","cluster_addr":"172.21.15.122:6803/41571","heartbeat_back_addr":"172.21.15.122:6807/41571","heartbeat_front_addr":"172.21.15.122:6805/41571","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:13:06.548 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-04-26T11:13:06.548 INFO:tasks.ceph:Creating RBD pool 2024-04-26T11:13:06.548 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-26T11:13:07.112 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'rbd' created 2024-04-26T11:13:07.124 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-26T11:13:08.114 INFO:teuthology.orchestra.run.smithi029.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-26T11:13:08.128 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T11:13:08.129 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T11:13:08.129 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T11:13:08.131 INFO:tasks.ceph.mds.a:Started 2024-04-26T11:13:08.131 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T11:13:08.131 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:13:08.218 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2024-04-26T11:13:08.493 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:08.493 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":10,"fsid":"2b52ce04-9559-478f-9787-c3cc3b261c15","created":"2024-04-26T11:12:58.193418+0000","modified":"2024-04-26T11:13:08.105485+0000","last_up_change":"2024-04-26T11:13:06.102821+0000","last_in_change":"2024-04-26T11:12:59.116286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:13:06.502266+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:13:06.913870+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3496b3f-5972-47ff-a449-832f5055beac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":41434},{"type":"v1","addr":"172.21.15.72:6801","nonce":41434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":41434},{"type":"v1","addr":"172.21.15.72:6803","nonce":41434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":41434},{"type":"v1","addr":"172.21.15.72:6807","nonce":41434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":41434},{"type":"v1","addr":"172.21.15.72:6805","nonce":41434}]},"public_addr":"172.21.15.72:6801/41434","cluster_addr":"172.21.15.72:6803/41434","heartbeat_back_addr":"172.21.15.72:6807/41434","heartbeat_front_addr":"172.21.15.72:6805/41434","state":["exists","up"]},{"osd":1,"uuid":"4842abe1-e7b4-480f-85b3-11c8fa2123f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":41442},{"type":"v1","addr":"172.21.15.82:6801","nonce":41442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":41442},{"type":"v1","addr":"172.21.15.82:6803","nonce":41442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":41442},{"type":"v1","addr":"172.21.15.82:6807","nonce":41442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":41442},{"type":"v1","addr":"172.21.15.82:6805","nonce":41442}]},"public_addr":"172.21.15.82:6801/41442","cluster_addr":"172.21.15.82:6803/41442","heartbeat_back_addr":"172.21.15.82:6807/41442","heartbeat_front_addr":"172.21.15.82:6805/41442","state":["exists","up"]},{"osd":2,"uuid":"57b4a874-e4ce-42a9-a7fd-f9e0acf03cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":41571},{"type":"v1","addr":"172.21.15.122:6801","nonce":41571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":41571},{"type":"v1","addr":"172.21.15.122:6803","nonce":41571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":41571},{"type":"v1","addr":"172.21.15.122:6807","nonce":41571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":41571},{"type":"v1","addr":"172.21.15.122:6805","nonce":41571}]},"public_addr":"172.21.15.122:6801/41571","cluster_addr":"172.21.15.122:6803/41571","heartbeat_back_addr":"172.21.15.122:6807/41571","heartbeat_front_addr":"172.21.15.122:6805/41571","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.123925+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.145646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:05.101494+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:13:08.507 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T11:13:06.502266+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T11:13:06.913870+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T11:13:08.508 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T11:13:08.862 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-26T11:13:08.877 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T11:13:09.219 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2024-04-26T11:13:09.233 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T11:13:09.623 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:09.623 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6803/1340829810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1340829810},{"type":"v1","addr":"172.21.15.29:6803","nonce":1340829810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-04-26T11:13:09.625 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 2 2024-04-26T11:13:09.637 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:13:09.974 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:09.975 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":11,"fsid":"2b52ce04-9559-478f-9787-c3cc3b261c15","created":"2024-04-26T11:12:58.193418+0000","modified":"2024-04-26T11:13:09.106651+0000","last_up_change":"2024-04-26T11:13:06.102821+0000","last_in_change":"2024-04-26T11:12:59.116286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:13:06.502266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:13:06.913870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3496b3f-5972-47ff-a449-832f5055beac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":41434},{"type":"v1","addr":"172.21.15.72:6801","nonce":41434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":41434},{"type":"v1","addr":"172.21.15.72:6803","nonce":41434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":41434},{"type":"v1","addr":"172.21.15.72:6807","nonce":41434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":41434},{"type":"v1","addr":"172.21.15.72:6805","nonce":41434}]},"public_addr":"172.21.15.72:6801/41434","cluster_addr":"172.21.15.72:6803/41434","heartbeat_back_addr":"172.21.15.72:6807/41434","heartbeat_front_addr":"172.21.15.72:6805/41434","state":["exists","up"]},{"osd":1,"uuid":"4842abe1-e7b4-480f-85b3-11c8fa2123f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":41442},{"type":"v1","addr":"172.21.15.82:6801","nonce":41442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":41442},{"type":"v1","addr":"172.21.15.82:6803","nonce":41442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":41442},{"type":"v1","addr":"172.21.15.82:6807","nonce":41442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":41442},{"type":"v1","addr":"172.21.15.82:6805","nonce":41442}]},"public_addr":"172.21.15.82:6801/41442","cluster_addr":"172.21.15.82:6803/41442","heartbeat_back_addr":"172.21.15.82:6807/41442","heartbeat_front_addr":"172.21.15.82:6805/41442","state":["exists","up"]},{"osd":2,"uuid":"57b4a874-e4ce-42a9-a7fd-f9e0acf03cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":41571},{"type":"v1","addr":"172.21.15.122:6801","nonce":41571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":41571},{"type":"v1","addr":"172.21.15.122:6803","nonce":41571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":41571},{"type":"v1","addr":"172.21.15.122:6807","nonce":41571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":41571},{"type":"v1","addr":"172.21.15.122:6805","nonce":41571}]},"public_addr":"172.21.15.122:6801/41571","cluster_addr":"172.21.15.122:6803/41571","heartbeat_back_addr":"172.21.15.122:6807/41571","heartbeat_front_addr":"172.21.15.122:6805/41571","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.123925+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.145646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:05.101494+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:13:09.989 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T11:13:06.502266+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T11:13:06.913870+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T11:13:09.989 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T11:13:10.331 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-26T11:13:10.346 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T11:13:10.690 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2024-04-26T11:13:10.706 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T11:13:11.046 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:11.047 INFO:teuthology.orchestra.run.smithi029.stdout:[ 2024-04-26T11:13:11.047 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:11.047 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 1, 2024-04-26T11:13:11.047 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": ".mgr" 2024-04-26T11:13:11.047 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:11.047 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:11.047 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 2, 2024-04-26T11:13:11.047 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": "rbd" 2024-04-26T11:13:11.047 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:11.047 INFO:teuthology.orchestra.run.smithi029.stdout:] 2024-04-26T11:13:11.061 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T11:13:11.061 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T11:13:11.476 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' created 2024-04-26T11:13:11.487 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T11:13:12.486 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' created 2024-04-26T11:13:12.501 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T11:13:12.907 INFO:teuthology.orchestra.run.smithi029.stderr:new fs with metadata pool 3 and data pool 4 2024-04-26T11:13:12.920 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:13:13.263 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:13.263 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":14,"fsid":"2b52ce04-9559-478f-9787-c3cc3b261c15","created":"2024-04-26T11:12:58.193418+0000","modified":"2024-04-26T11:13:12.899561+0000","last_up_change":"2024-04-26T11:13:06.102821+0000","last_in_change":"2024-04-26T11:12:59.116286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:13:06.502266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:13:06.913870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:13:11.430854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:13:11.859264+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3496b3f-5972-47ff-a449-832f5055beac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":41434},{"type":"v1","addr":"172.21.15.72:6801","nonce":41434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":41434},{"type":"v1","addr":"172.21.15.72:6803","nonce":41434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":41434},{"type":"v1","addr":"172.21.15.72:6807","nonce":41434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":41434},{"type":"v1","addr":"172.21.15.72:6805","nonce":41434}]},"public_addr":"172.21.15.72:6801/41434","cluster_addr":"172.21.15.72:6803/41434","heartbeat_back_addr":"172.21.15.72:6807/41434","heartbeat_front_addr":"172.21.15.72:6805/41434","state":["exists","up"]},{"osd":1,"uuid":"4842abe1-e7b4-480f-85b3-11c8fa2123f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":41442},{"type":"v1","addr":"172.21.15.82:6801","nonce":41442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":41442},{"type":"v1","addr":"172.21.15.82:6803","nonce":41442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":41442},{"type":"v1","addr":"172.21.15.82:6807","nonce":41442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":41442},{"type":"v1","addr":"172.21.15.82:6805","nonce":41442}]},"public_addr":"172.21.15.82:6801/41442","cluster_addr":"172.21.15.82:6803/41442","heartbeat_back_addr":"172.21.15.82:6807/41442","heartbeat_front_addr":"172.21.15.82:6805/41442","state":["exists","up"]},{"osd":2,"uuid":"57b4a874-e4ce-42a9-a7fd-f9e0acf03cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":41571},{"type":"v1","addr":"172.21.15.122:6801","nonce":41571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":41571},{"type":"v1","addr":"172.21.15.122:6803","nonce":41571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":41571},{"type":"v1","addr":"172.21.15.122:6807","nonce":41571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":41571},{"type":"v1","addr":"172.21.15.122:6805","nonce":41571}]},"public_addr":"172.21.15.122:6801/41571","cluster_addr":"172.21.15.122:6803/41571","heartbeat_back_addr":"172.21.15.122:6807/41571","heartbeat_front_addr":"172.21.15.122:6805/41571","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.123925+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.145646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:05.101494+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:13:13.277 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:13:13.618 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:13.619 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":14,"fsid":"2b52ce04-9559-478f-9787-c3cc3b261c15","created":"2024-04-26T11:12:58.193418+0000","modified":"2024-04-26T11:13:12.899561+0000","last_up_change":"2024-04-26T11:13:06.102821+0000","last_in_change":"2024-04-26T11:12:59.116286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:13:06.502266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:13:06.913870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:13:11.430854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:13:11.859264+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3496b3f-5972-47ff-a449-832f5055beac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":41434},{"type":"v1","addr":"172.21.15.72:6801","nonce":41434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":41434},{"type":"v1","addr":"172.21.15.72:6803","nonce":41434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":41434},{"type":"v1","addr":"172.21.15.72:6807","nonce":41434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":41434},{"type":"v1","addr":"172.21.15.72:6805","nonce":41434}]},"public_addr":"172.21.15.72:6801/41434","cluster_addr":"172.21.15.72:6803/41434","heartbeat_back_addr":"172.21.15.72:6807/41434","heartbeat_front_addr":"172.21.15.72:6805/41434","state":["exists","up"]},{"osd":1,"uuid":"4842abe1-e7b4-480f-85b3-11c8fa2123f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":41442},{"type":"v1","addr":"172.21.15.82:6801","nonce":41442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":41442},{"type":"v1","addr":"172.21.15.82:6803","nonce":41442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":41442},{"type":"v1","addr":"172.21.15.82:6807","nonce":41442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":41442},{"type":"v1","addr":"172.21.15.82:6805","nonce":41442}]},"public_addr":"172.21.15.82:6801/41442","cluster_addr":"172.21.15.82:6803/41442","heartbeat_back_addr":"172.21.15.82:6807/41442","heartbeat_front_addr":"172.21.15.82:6805/41442","state":["exists","up"]},{"osd":2,"uuid":"57b4a874-e4ce-42a9-a7fd-f9e0acf03cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":41571},{"type":"v1","addr":"172.21.15.122:6801","nonce":41571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":41571},{"type":"v1","addr":"172.21.15.122:6803","nonce":41571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":41571},{"type":"v1","addr":"172.21.15.122:6807","nonce":41571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":41571},{"type":"v1","addr":"172.21.15.122:6805","nonce":41571}]},"public_addr":"172.21.15.122:6801/41571","cluster_addr":"172.21.15.122:6803/41571","heartbeat_back_addr":"172.21.15.122:6807/41571","heartbeat_front_addr":"172.21.15.122:6805/41571","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.123925+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.145646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:05.101494+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:13:13.633 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T11:13:14.929 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T11:13:14.930 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T11:13:15.932 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T11:13:15.932 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T11:13:16.324 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:16.324 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T11:13:12.899864+0000","modified":"2024-04-26T11:13:15.909042+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6803/1340829810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1340829810},{"type":"v1","addr":"172.21.15.29:6803","nonce":1340829810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T11:13:16.327 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 6 2024-04-26T11:13:16.338 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:13:16.679 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:16.679 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":15,"fsid":"2b52ce04-9559-478f-9787-c3cc3b261c15","created":"2024-04-26T11:12:58.193418+0000","modified":"2024-04-26T11:13:13.900817+0000","last_up_change":"2024-04-26T11:13:06.102821+0000","last_in_change":"2024-04-26T11:12:59.116286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:13:06.502266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:13:06.913870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:13:11.430854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:13:11.859264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3496b3f-5972-47ff-a449-832f5055beac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":41434},{"type":"v1","addr":"172.21.15.72:6801","nonce":41434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":41434},{"type":"v1","addr":"172.21.15.72:6803","nonce":41434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":41434},{"type":"v1","addr":"172.21.15.72:6807","nonce":41434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":41434},{"type":"v1","addr":"172.21.15.72:6805","nonce":41434}]},"public_addr":"172.21.15.72:6801/41434","cluster_addr":"172.21.15.72:6803/41434","heartbeat_back_addr":"172.21.15.72:6807/41434","heartbeat_front_addr":"172.21.15.72:6805/41434","state":["exists","up"]},{"osd":1,"uuid":"4842abe1-e7b4-480f-85b3-11c8fa2123f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":41442},{"type":"v1","addr":"172.21.15.82:6801","nonce":41442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":41442},{"type":"v1","addr":"172.21.15.82:6803","nonce":41442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":41442},{"type":"v1","addr":"172.21.15.82:6807","nonce":41442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":41442},{"type":"v1","addr":"172.21.15.82:6805","nonce":41442}]},"public_addr":"172.21.15.82:6801/41442","cluster_addr":"172.21.15.82:6803/41442","heartbeat_back_addr":"172.21.15.82:6807/41442","heartbeat_front_addr":"172.21.15.82:6805/41442","state":["exists","up"]},{"osd":2,"uuid":"57b4a874-e4ce-42a9-a7fd-f9e0acf03cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":41571},{"type":"v1","addr":"172.21.15.122:6801","nonce":41571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":41571},{"type":"v1","addr":"172.21.15.122:6803","nonce":41571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":41571},{"type":"v1","addr":"172.21.15.122:6807","nonce":41571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":41571},{"type":"v1","addr":"172.21.15.122:6805","nonce":41571}]},"public_addr":"172.21.15.122:6801/41571","cluster_addr":"172.21.15.122:6803/41571","heartbeat_back_addr":"172.21.15.122:6807/41571","heartbeat_front_addr":"172.21.15.122:6805/41571","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.123925+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.145646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:05.101494+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:13:16.693 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T11:13:16.694 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:13:17.043 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:17.045 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:13:17.058 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2024-04-26T11:13:16.451295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":83692,"kb_used_data":1444,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283031828,"statfs":{"total":289910292480,"available":289824591872,"internally_reserved":0,"allocated":1478656,"data_stored":1262869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.979741"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:09.110174+0000","last_change":"2024-04-26T11:13:08.113095+0000","last_active":"2024-04-26T11:13:09.110174+0000","last_peered":"2024-04-26T11:13:09.110174+0000","last_clean":"2024-04-26T11:13:09.110174+0000","last_became_active":"2024-04-26T11:13:08.112778+0000","last_became_peered":"2024-04-26T11:13:08.112778+0000","last_unstale":"2024-04-26T11:13:09.110174+0000","last_undegraded":"2024-04-26T11:13:09.110174+0000","last_fullsized":"2024-04-26T11:13:09.110174+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:41.705893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:10.180037+0000","last_change":"2024-04-26T11:13:08.112744+0000","last_active":"2024-04-26T11:13:10.180037+0000","last_peered":"2024-04-26T11:13:10.180037+0000","last_clean":"2024-04-26T11:13:10.180037+0000","last_became_active":"2024-04-26T11:13:08.112498+0000","last_became_peered":"2024-04-26T11:13:08.112498+0000","last_unstale":"2024-04-26T11:13:10.180037+0000","last_undegraded":"2024-04-26T11:13:10.180037+0000","last_fullsized":"2024-04-26T11:13:10.180037+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:38.407116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:09.110169+0000","last_change":"2024-04-26T11:13:08.113650+0000","last_active":"2024-04-26T11:13:09.110169+0000","last_peered":"2024-04-26T11:13:09.110169+0000","last_clean":"2024-04-26T11:13:09.110169+0000","last_became_active":"2024-04-26T11:13:08.113394+0000","last_became_peered":"2024-04-26T11:13:08.113394+0000","last_unstale":"2024-04-26T11:13:09.110169+0000","last_undegraded":"2024-04-26T11:13:09.110169+0000","last_fullsized":"2024-04-26T11:13:09.110169+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:44.642172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:10.180037+0000","last_change":"2024-04-26T11:13:08.112690+0000","last_active":"2024-04-26T11:13:10.180037+0000","last_peered":"2024-04-26T11:13:10.180037+0000","last_clean":"2024-04-26T11:13:10.180037+0000","last_became_active":"2024-04-26T11:13:08.112454+0000","last_became_peered":"2024-04-26T11:13:08.112454+0000","last_unstale":"2024-04-26T11:13:10.180037+0000","last_undegraded":"2024-04-26T11:13:10.180037+0000","last_fullsized":"2024-04-26T11:13:10.180037+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:41.011030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":206,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:10.180029+0000","last_change":"2024-04-26T11:13:08.113419+0000","last_active":"2024-04-26T11:13:10.180029+0000","last_peered":"2024-04-26T11:13:10.180029+0000","last_clean":"2024-04-26T11:13:10.180029+0000","last_became_active":"2024-04-26T11:13:08.113154+0000","last_became_peered":"2024-04-26T11:13:08.113154+0000","last_unstale":"2024-04-26T11:13:10.180029+0000","last_undegraded":"2024-04-26T11:13:10.180029+0000","last_fullsized":"2024-04-26T11:13:10.180029+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:36.482001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:10.180024+0000","last_change":"2024-04-26T11:13:08.113497+0000","last_active":"2024-04-26T11:13:10.180024+0000","last_peered":"2024-04-26T11:13:10.180024+0000","last_clean":"2024-04-26T11:13:10.180024+0000","last_became_active":"2024-04-26T11:13:08.113237+0000","last_became_peered":"2024-04-26T11:13:08.113237+0000","last_unstale":"2024-04-26T11:13:10.180024+0000","last_undegraded":"2024-04-26T11:13:10.180024+0000","last_fullsized":"2024-04-26T11:13:10.180024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:52.240361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:09.110335+0000","last_change":"2024-04-26T11:13:08.110433+0000","last_active":"2024-04-26T11:13:09.110335+0000","last_peered":"2024-04-26T11:13:09.110335+0000","last_clean":"2024-04-26T11:13:09.110335+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:13:09.110335+0000","last_undegraded":"2024-04-26T11:13:09.110335+0000","last_fullsized":"2024-04-26T11:13:09.110335+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:09.110236+0000","last_change":"2024-04-26T11:13:08.113157+0000","last_active":"2024-04-26T11:13:09.110236+0000","last_peered":"2024-04-26T11:13:09.110236+0000","last_clean":"2024-04-26T11:13:09.110236+0000","last_became_active":"2024-04-26T11:13:08.112788+0000","last_became_peered":"2024-04-26T11:13:08.112788+0000","last_unstale":"2024-04-26T11:13:09.110236+0000","last_undegraded":"2024-04-26T11:13:09.110236+0000","last_fullsized":"2024-04-26T11:13:09.110236+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:14.606433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:10.180069+0000","last_change":"2024-04-26T11:13:08.113505+0000","last_active":"2024-04-26T11:13:10.180069+0000","last_peered":"2024-04-26T11:13:10.180069+0000","last_clean":"2024-04-26T11:13:10.180069+0000","last_became_active":"2024-04-26T11:13:08.113224+0000","last_became_peered":"2024-04-26T11:13:08.113224+0000","last_unstale":"2024-04-26T11:13:10.180069+0000","last_undegraded":"2024-04-26T11:13:10.180069+0000","last_fullsized":"2024-04-26T11:13:10.180069+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:16.157275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738370,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28256,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343584,"statfs":{"total":96636764160,"available":96607830016,"internally_reserved":0,"allocated":688128,"data_stored":617005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738370,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28320,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343520,"statfs":{"total":96636764160,"available":96607764480,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":98304,"data_stored":27748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:13:17.064 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:13:17.446 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:17.448 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:13:17.457 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2024-04-26T11:13:16.451295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":83692,"kb_used_data":1444,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283031828,"statfs":{"total":289910292480,"available":289824591872,"internally_reserved":0,"allocated":1478656,"data_stored":1262869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.979741"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:09.110174+0000","last_change":"2024-04-26T11:13:08.113095+0000","last_active":"2024-04-26T11:13:09.110174+0000","last_peered":"2024-04-26T11:13:09.110174+0000","last_clean":"2024-04-26T11:13:09.110174+0000","last_became_active":"2024-04-26T11:13:08.112778+0000","last_became_peered":"2024-04-26T11:13:08.112778+0000","last_unstale":"2024-04-26T11:13:09.110174+0000","last_undegraded":"2024-04-26T11:13:09.110174+0000","last_fullsized":"2024-04-26T11:13:09.110174+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:41.705893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:10.180037+0000","last_change":"2024-04-26T11:13:08.112744+0000","last_active":"2024-04-26T11:13:10.180037+0000","last_peered":"2024-04-26T11:13:10.180037+0000","last_clean":"2024-04-26T11:13:10.180037+0000","last_became_active":"2024-04-26T11:13:08.112498+0000","last_became_peered":"2024-04-26T11:13:08.112498+0000","last_unstale":"2024-04-26T11:13:10.180037+0000","last_undegraded":"2024-04-26T11:13:10.180037+0000","last_fullsized":"2024-04-26T11:13:10.180037+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:38.407116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:09.110169+0000","last_change":"2024-04-26T11:13:08.113650+0000","last_active":"2024-04-26T11:13:09.110169+0000","last_peered":"2024-04-26T11:13:09.110169+0000","last_clean":"2024-04-26T11:13:09.110169+0000","last_became_active":"2024-04-26T11:13:08.113394+0000","last_became_peered":"2024-04-26T11:13:08.113394+0000","last_unstale":"2024-04-26T11:13:09.110169+0000","last_undegraded":"2024-04-26T11:13:09.110169+0000","last_fullsized":"2024-04-26T11:13:09.110169+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:44.642172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:10.180037+0000","last_change":"2024-04-26T11:13:08.112690+0000","last_active":"2024-04-26T11:13:10.180037+0000","last_peered":"2024-04-26T11:13:10.180037+0000","last_clean":"2024-04-26T11:13:10.180037+0000","last_became_active":"2024-04-26T11:13:08.112454+0000","last_became_peered":"2024-04-26T11:13:08.112454+0000","last_unstale":"2024-04-26T11:13:10.180037+0000","last_undegraded":"2024-04-26T11:13:10.180037+0000","last_fullsized":"2024-04-26T11:13:10.180037+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:41.011030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":206,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:10.180029+0000","last_change":"2024-04-26T11:13:08.113419+0000","last_active":"2024-04-26T11:13:10.180029+0000","last_peered":"2024-04-26T11:13:10.180029+0000","last_clean":"2024-04-26T11:13:10.180029+0000","last_became_active":"2024-04-26T11:13:08.113154+0000","last_became_peered":"2024-04-26T11:13:08.113154+0000","last_unstale":"2024-04-26T11:13:10.180029+0000","last_undegraded":"2024-04-26T11:13:10.180029+0000","last_fullsized":"2024-04-26T11:13:10.180029+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:36.482001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:10.180024+0000","last_change":"2024-04-26T11:13:08.113497+0000","last_active":"2024-04-26T11:13:10.180024+0000","last_peered":"2024-04-26T11:13:10.180024+0000","last_clean":"2024-04-26T11:13:10.180024+0000","last_became_active":"2024-04-26T11:13:08.113237+0000","last_became_peered":"2024-04-26T11:13:08.113237+0000","last_unstale":"2024-04-26T11:13:10.180024+0000","last_undegraded":"2024-04-26T11:13:10.180024+0000","last_fullsized":"2024-04-26T11:13:10.180024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:52.240361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:09.110335+0000","last_change":"2024-04-26T11:13:08.110433+0000","last_active":"2024-04-26T11:13:09.110335+0000","last_peered":"2024-04-26T11:13:09.110335+0000","last_clean":"2024-04-26T11:13:09.110335+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:13:09.110335+0000","last_undegraded":"2024-04-26T11:13:09.110335+0000","last_fullsized":"2024-04-26T11:13:09.110335+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:09.110236+0000","last_change":"2024-04-26T11:13:08.113157+0000","last_active":"2024-04-26T11:13:09.110236+0000","last_peered":"2024-04-26T11:13:09.110236+0000","last_clean":"2024-04-26T11:13:09.110236+0000","last_became_active":"2024-04-26T11:13:08.112788+0000","last_became_peered":"2024-04-26T11:13:08.112788+0000","last_unstale":"2024-04-26T11:13:09.110236+0000","last_undegraded":"2024-04-26T11:13:09.110236+0000","last_fullsized":"2024-04-26T11:13:09.110236+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:14.606433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:10.180069+0000","last_change":"2024-04-26T11:13:08.113505+0000","last_active":"2024-04-26T11:13:10.180069+0000","last_peered":"2024-04-26T11:13:10.180069+0000","last_clean":"2024-04-26T11:13:10.180069+0000","last_became_active":"2024-04-26T11:13:08.113224+0000","last_became_peered":"2024-04-26T11:13:08.113224+0000","last_unstale":"2024-04-26T11:13:10.180069+0000","last_undegraded":"2024-04-26T11:13:10.180069+0000","last_fullsized":"2024-04-26T11:13:10.180069+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:16.157275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738370,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28256,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343584,"statfs":{"total":96636764160,"available":96607830016,"internally_reserved":0,"allocated":688128,"data_stored":617005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738370,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28320,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343520,"statfs":{"total":96636764160,"available":96607764480,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":98304,"data_stored":27748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:13:17.462 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:13:17.839 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:17.841 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:13:17.851 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2024-04-26T11:13:16.451295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":83692,"kb_used_data":1444,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283031828,"statfs":{"total":289910292480,"available":289824591872,"internally_reserved":0,"allocated":1478656,"data_stored":1262869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.979741"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:09.110174+0000","last_change":"2024-04-26T11:13:08.113095+0000","last_active":"2024-04-26T11:13:09.110174+0000","last_peered":"2024-04-26T11:13:09.110174+0000","last_clean":"2024-04-26T11:13:09.110174+0000","last_became_active":"2024-04-26T11:13:08.112778+0000","last_became_peered":"2024-04-26T11:13:08.112778+0000","last_unstale":"2024-04-26T11:13:09.110174+0000","last_undegraded":"2024-04-26T11:13:09.110174+0000","last_fullsized":"2024-04-26T11:13:09.110174+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:41.705893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:10.180037+0000","last_change":"2024-04-26T11:13:08.112744+0000","last_active":"2024-04-26T11:13:10.180037+0000","last_peered":"2024-04-26T11:13:10.180037+0000","last_clean":"2024-04-26T11:13:10.180037+0000","last_became_active":"2024-04-26T11:13:08.112498+0000","last_became_peered":"2024-04-26T11:13:08.112498+0000","last_unstale":"2024-04-26T11:13:10.180037+0000","last_undegraded":"2024-04-26T11:13:10.180037+0000","last_fullsized":"2024-04-26T11:13:10.180037+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:38.407116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:09.110169+0000","last_change":"2024-04-26T11:13:08.113650+0000","last_active":"2024-04-26T11:13:09.110169+0000","last_peered":"2024-04-26T11:13:09.110169+0000","last_clean":"2024-04-26T11:13:09.110169+0000","last_became_active":"2024-04-26T11:13:08.113394+0000","last_became_peered":"2024-04-26T11:13:08.113394+0000","last_unstale":"2024-04-26T11:13:09.110169+0000","last_undegraded":"2024-04-26T11:13:09.110169+0000","last_fullsized":"2024-04-26T11:13:09.110169+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:44.642172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:10.180037+0000","last_change":"2024-04-26T11:13:08.112690+0000","last_active":"2024-04-26T11:13:10.180037+0000","last_peered":"2024-04-26T11:13:10.180037+0000","last_clean":"2024-04-26T11:13:10.180037+0000","last_became_active":"2024-04-26T11:13:08.112454+0000","last_became_peered":"2024-04-26T11:13:08.112454+0000","last_unstale":"2024-04-26T11:13:10.180037+0000","last_undegraded":"2024-04-26T11:13:10.180037+0000","last_fullsized":"2024-04-26T11:13:10.180037+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:41.011030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":206,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:10.180029+0000","last_change":"2024-04-26T11:13:08.113419+0000","last_active":"2024-04-26T11:13:10.180029+0000","last_peered":"2024-04-26T11:13:10.180029+0000","last_clean":"2024-04-26T11:13:10.180029+0000","last_became_active":"2024-04-26T11:13:08.113154+0000","last_became_peered":"2024-04-26T11:13:08.113154+0000","last_unstale":"2024-04-26T11:13:10.180029+0000","last_undegraded":"2024-04-26T11:13:10.180029+0000","last_fullsized":"2024-04-26T11:13:10.180029+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:36.482001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:10.180024+0000","last_change":"2024-04-26T11:13:08.113497+0000","last_active":"2024-04-26T11:13:10.180024+0000","last_peered":"2024-04-26T11:13:10.180024+0000","last_clean":"2024-04-26T11:13:10.180024+0000","last_became_active":"2024-04-26T11:13:08.113237+0000","last_became_peered":"2024-04-26T11:13:08.113237+0000","last_unstale":"2024-04-26T11:13:10.180024+0000","last_undegraded":"2024-04-26T11:13:10.180024+0000","last_fullsized":"2024-04-26T11:13:10.180024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:52.240361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:09.110335+0000","last_change":"2024-04-26T11:13:08.110433+0000","last_active":"2024-04-26T11:13:09.110335+0000","last_peered":"2024-04-26T11:13:09.110335+0000","last_clean":"2024-04-26T11:13:09.110335+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:13:09.110335+0000","last_undegraded":"2024-04-26T11:13:09.110335+0000","last_fullsized":"2024-04-26T11:13:09.110335+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:09.110236+0000","last_change":"2024-04-26T11:13:08.113157+0000","last_active":"2024-04-26T11:13:09.110236+0000","last_peered":"2024-04-26T11:13:09.110236+0000","last_clean":"2024-04-26T11:13:09.110236+0000","last_became_active":"2024-04-26T11:13:08.112788+0000","last_became_peered":"2024-04-26T11:13:08.112788+0000","last_unstale":"2024-04-26T11:13:09.110236+0000","last_undegraded":"2024-04-26T11:13:09.110236+0000","last_fullsized":"2024-04-26T11:13:09.110236+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:14.606433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T11:13:10.180069+0000","last_change":"2024-04-26T11:13:08.113505+0000","last_active":"2024-04-26T11:13:10.180069+0000","last_peered":"2024-04-26T11:13:10.180069+0000","last_clean":"2024-04-26T11:13:10.180069+0000","last_became_active":"2024-04-26T11:13:08.113224+0000","last_became_peered":"2024-04-26T11:13:08.113224+0000","last_unstale":"2024-04-26T11:13:10.180069+0000","last_undegraded":"2024-04-26T11:13:10.180069+0000","last_fullsized":"2024-04-26T11:13:10.180069+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:16.157275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:11.466521+0000","last_change":"2024-04-26T11:13:11.466521+0000","last_active":"2024-04-26T11:13:11.466521+0000","last_peered":"2024-04-26T11:13:11.466521+0000","last_clean":"2024-04-26T11:13:11.466521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:11.466521+0000","last_undegraded":"2024-04-26T11:13:11.466521+0000","last_fullsized":"2024-04-26T11:13:11.466521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:13:12.471344+0000","last_change":"2024-04-26T11:13:12.471344+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:12.471344+0000","last_undegraded":"2024-04-26T11:13:12.471344+0000","last_fullsized":"2024-04-26T11:13:12.471344+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738370,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28256,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343584,"statfs":{"total":96636764160,"available":96607830016,"internally_reserved":0,"allocated":688128,"data_stored":617005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738370,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28320,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343520,"statfs":{"total":96636764160,"available":96607764480,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":98304,"data_stored":27748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:13:17.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2024-04-26T11:13:17.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2024-04-26T11:13:17.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2024-04-26T11:13:17.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.856 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2024-04-26T11:13:17.856 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2024-04-26T11:13:17.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2024-04-26T11:13:17.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2024-04-26T11:13:17.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2024-04-26T11:13:17.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2024-04-26T11:13:17.857 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.857 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2024-04-26T11:13:17.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2024-04-26T11:13:17.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2024-04-26T11:13:17.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2024-04-26T11:13:17.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2024-04-26T11:13:17.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.858 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2024-04-26T11:13:17.858 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2024-04-26T11:13:17.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2024-04-26T11:13:17.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2024-04-26T11:13:17.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2024-04-26T11:13:17.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2024-04-26T11:13:17.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.859 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2024-04-26T11:13:17.859 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2024-04-26T11:13:17.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2024-04-26T11:13:17.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2024-04-26T11:13:17.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2024-04-26T11:13:17.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.860 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2024-04-26T11:13:17.860 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2024-04-26T11:13:17.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-04-26T11:13:17.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-04-26T11:13:17.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-04-26T11:13:17.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-04-26T11:13:17.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.861 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-04-26T11:13:17.861 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-04-26T11:13:17.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-04-26T11:13:17.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-04-26T11:13:17.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-04-26T11:13:17.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-04-26T11:13:17.862 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.862 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-04-26T11:13:17.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-04-26T11:13:17.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-04-26T11:13:17.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-04-26T11:13:17.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-04-26T11:13:17.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.863 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-04-26T11:13:17.863 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-04-26T11:13:17.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-04-26T11:13:17.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-04-26T11:13:17.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-04-26T11:13:17.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-04-26T11:13:17.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.864 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-04-26T11:13:17.864 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-04-26T11:13:17.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-04-26T11:13:17.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-04-26T11:13:17.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-04-26T11:13:17.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-04-26T11:13:17.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.865 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-04-26T11:13:17.865 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-04-26T11:13:17.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-04-26T11:13:17.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-04-26T11:13:17.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-04-26T11:13:17.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-04-26T11:13:17.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.866 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-04-26T11:13:17.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-04-26T11:13:17.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-04-26T11:13:17.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-04-26T11:13:17.867 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.867 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-04-26T11:13:17.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-04-26T11:13:17.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-04-26T11:13:17.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.868 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-04-26T11:13:17.868 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-04-26T11:13:17.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-04-26T11:13:17.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-04-26T11:13:17.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-04-26T11:13:17.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-04-26T11:13:17.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.869 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-04-26T11:13:17.869 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-04-26T11:13:17.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-04-26T11:13:17.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-04-26T11:13:17.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-04-26T11:13:17.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.870 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-04-26T11:13:17.870 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-04-26T11:13:17.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-04-26T11:13:17.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-04-26T11:13:17.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-04-26T11:13:17.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-04-26T11:13:17.871 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.871 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-04-26T11:13:17.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.872 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-04-26T11:13:17.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.872 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-04-26T11:13:17.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.872 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-04-26T11:13:17.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.872 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-04-26T11:13:17.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.872 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-04-26T11:13:17.872 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:11.466521+0000', 'last_change': '2024-04-26T11:13:11.466521+0000', 'last_active': '2024-04-26T11:13:11.466521+0000', 'last_peered': '2024-04-26T11:13:11.466521+0000', 'last_clean': '2024-04-26T11:13:11.466521+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:11.466521+0000', 'last_undegraded': '2024-04-26T11:13:11.466521+0000', 'last_fullsized': '2024-04-26T11:13:11.466521+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:11.466521+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-04-26T11:13:17.873 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2024-04-26T11:13:17.873 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2024-04-26T11:13:17.873 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2024-04-26T11:13:17.873 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2024-04-26T11:13:17.873 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.873 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2024-04-26T11:13:17.874 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T11:13:12.471344+0000', 'last_change': '2024-04-26T11:13:12.471344+0000', 'last_active': '2024-04-26T11:13:12.471344+0000', 'last_peered': '2024-04-26T11:13:12.471344+0000', 'last_clean': '2024-04-26T11:13:12.471344+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T11:13:12.471344+0000', 'last_undegraded': '2024-04-26T11:13:12.471344+0000', 'last_fullsized': '2024-04-26T11:13:12.471344+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'last_clean_scrub_stamp': '2024-04-26T11:13:12.471344+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T11:13:17.875 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T11:13:18.239 INFO:tasks.ceph.mds.a.smithi029.stderr:2024-04-26T11:13:18.237+0000 7f87ea24c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T11:13:18.314 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:18.315 INFO:teuthology.orchestra.run.smithi029.stdout:{"fsid":"2b52ce04-9559-478f-9787-c3cc3b261c15","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":20,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":15,"num_osds":3,"num_up_osds":3,"osd_up_since":1714129986,"num_in_osds":3,"osd_in_since":1714129979,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":85700608,"bytes_avail":289824591872,"bytes_total":289910292480,"unknown_pgs_ratio":0.91428571939468384},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4193}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-26T11:12:58.194354+0000","services":{}},"progress_events":{}} 2024-04-26T11:13:18.329 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-26T11:13:18.329 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:13:18.675 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:18.677 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:13:18.687 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-04-26T11:13:18.451642+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":150,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86788,"kb_used_data":1604,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028732,"statfs":{"total":289910292480,"available":289821421568,"internally_reserved":0,"allocated":1642496,"data_stored":1322490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001129"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771368+0000","last_change":"2024-04-26T11:13:12.919196+0000","last_active":"2024-04-26T11:13:14.771368+0000","last_peered":"2024-04-26T11:13:14.771368+0000","last_clean":"2024-04-26T11:13:14.771368+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:13:14.771368+0000","last_undegraded":"2024-04-26T11:13:14.771368+0000","last_fullsized":"2024-04-26T11:13:14.771368+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771085+0000","last_change":"2024-04-26T11:13:12.917670+0000","last_active":"2024-04-26T11:13:14.771085+0000","last_peered":"2024-04-26T11:13:14.771085+0000","last_clean":"2024-04-26T11:13:14.771085+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:13:14.771085+0000","last_undegraded":"2024-04-26T11:13:14.771085+0000","last_fullsized":"2024-04-26T11:13:14.771085+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905470+0000","last_change":"2024-04-26T11:13:12.922235+0000","last_active":"2024-04-26T11:13:13.905470+0000","last_peered":"2024-04-26T11:13:13.905470+0000","last_clean":"2024-04-26T11:13:13.905470+0000","last_became_active":"2024-04-26T11:13:12.919993+0000","last_became_peered":"2024-04-26T11:13:12.919993+0000","last_unstale":"2024-04-26T11:13:13.905470+0000","last_undegraded":"2024-04-26T11:13:13.905470+0000","last_fullsized":"2024-04-26T11:13:13.905470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:41.004462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905212+0000","last_change":"2024-04-26T11:13:12.916859+0000","last_active":"2024-04-26T11:13:13.905212+0000","last_peered":"2024-04-26T11:13:13.905212+0000","last_clean":"2024-04-26T11:13:13.905212+0000","last_became_active":"2024-04-26T11:13:12.915591+0000","last_became_peered":"2024-04-26T11:13:12.915591+0000","last_unstale":"2024-04-26T11:13:13.905212+0000","last_undegraded":"2024-04-26T11:13:13.905212+0000","last_fullsized":"2024-04-26T11:13:13.905212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:52.543148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770643+0000","last_change":"2024-04-26T11:13:12.917403+0000","last_active":"2024-04-26T11:13:14.770643+0000","last_peered":"2024-04-26T11:13:14.770643+0000","last_clean":"2024-04-26T11:13:14.770643+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:13:14.770643+0000","last_undegraded":"2024-04-26T11:13:14.770643+0000","last_fullsized":"2024-04-26T11:13:14.770643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:42.014955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904599+0000","last_change":"2024-04-26T11:13:12.918802+0000","last_active":"2024-04-26T11:13:13.904599+0000","last_peered":"2024-04-26T11:13:13.904599+0000","last_clean":"2024-04-26T11:13:13.904599+0000","last_became_active":"2024-04-26T11:13:12.917353+0000","last_became_peered":"2024-04-26T11:13:12.917353+0000","last_unstale":"2024-04-26T11:13:13.904599+0000","last_undegraded":"2024-04-26T11:13:13.904599+0000","last_fullsized":"2024-04-26T11:13:13.904599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:08.956085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904746+0000","last_change":"2024-04-26T11:13:12.916789+0000","last_active":"2024-04-26T11:13:13.904746+0000","last_peered":"2024-04-26T11:13:13.904746+0000","last_clean":"2024-04-26T11:13:13.904746+0000","last_became_active":"2024-04-26T11:13:12.914947+0000","last_became_peered":"2024-04-26T11:13:12.914947+0000","last_unstale":"2024-04-26T11:13:13.904746+0000","last_undegraded":"2024-04-26T11:13:13.904746+0000","last_fullsized":"2024-04-26T11:13:13.904746+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904343+0000","last_change":"2024-04-26T11:13:12.919968+0000","last_active":"2024-04-26T11:13:13.904343+0000","last_peered":"2024-04-26T11:13:13.904343+0000","last_clean":"2024-04-26T11:13:13.904343+0000","last_became_active":"2024-04-26T11:13:12.918600+0000","last_became_peered":"2024-04-26T11:13:12.918600+0000","last_unstale":"2024-04-26T11:13:13.904343+0000","last_undegraded":"2024-04-26T11:13:13.904343+0000","last_fullsized":"2024-04-26T11:13:13.904343+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:41.073901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904753+0000","last_change":"2024-04-26T11:13:12.914649+0000","last_active":"2024-04-26T11:13:13.904753+0000","last_peered":"2024-04-26T11:13:13.904753+0000","last_clean":"2024-04-26T11:13:13.904753+0000","last_became_active":"2024-04-26T11:13:12.914174+0000","last_became_peered":"2024-04-26T11:13:12.914174+0000","last_unstale":"2024-04-26T11:13:13.904753+0000","last_undegraded":"2024-04-26T11:13:13.904753+0000","last_fullsized":"2024-04-26T11:13:13.904753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:41.004462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771235+0000","last_change":"2024-04-26T11:13:12.918521+0000","last_active":"2024-04-26T11:13:14.771235+0000","last_peered":"2024-04-26T11:13:14.771235+0000","last_clean":"2024-04-26T11:13:14.771235+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:13:14.771235+0000","last_undegraded":"2024-04-26T11:13:14.771235+0000","last_fullsized":"2024-04-26T11:13:14.771235+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905226+0000","last_change":"2024-04-26T11:13:12.922456+0000","last_active":"2024-04-26T11:13:13.905226+0000","last_peered":"2024-04-26T11:13:13.905226+0000","last_clean":"2024-04-26T11:13:13.905226+0000","last_became_active":"2024-04-26T11:13:12.921230+0000","last_became_peered":"2024-04-26T11:13:12.921230+0000","last_unstale":"2024-04-26T11:13:13.905226+0000","last_undegraded":"2024-04-26T11:13:13.905226+0000","last_fullsized":"2024-04-26T11:13:13.905226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:55.318150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770399+0000","last_change":"2024-04-26T11:13:12.914082+0000","last_active":"2024-04-26T11:13:14.770399+0000","last_peered":"2024-04-26T11:13:14.770399+0000","last_clean":"2024-04-26T11:13:14.770399+0000","last_became_active":"2024-04-26T11:13:12.913374+0000","last_became_peered":"2024-04-26T11:13:12.913374+0000","last_unstale":"2024-04-26T11:13:14.770399+0000","last_undegraded":"2024-04-26T11:13:14.770399+0000","last_fullsized":"2024-04-26T11:13:14.770399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:52.543148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770460+0000","last_change":"2024-04-26T11:13:12.915484+0000","last_active":"2024-04-26T11:13:14.770460+0000","last_peered":"2024-04-26T11:13:14.770460+0000","last_clean":"2024-04-26T11:13:14.770460+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:13:14.770460+0000","last_undegraded":"2024-04-26T11:13:14.770460+0000","last_fullsized":"2024-04-26T11:13:14.770460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905148+0000","last_change":"2024-04-26T11:13:12.914318+0000","last_active":"2024-04-26T11:13:13.905148+0000","last_peered":"2024-04-26T11:13:13.905148+0000","last_clean":"2024-04-26T11:13:13.905148+0000","last_became_active":"2024-04-26T11:13:12.913437+0000","last_became_peered":"2024-04-26T11:13:12.913437+0000","last_unstale":"2024-04-26T11:13:13.905148+0000","last_undegraded":"2024-04-26T11:13:13.905148+0000","last_fullsized":"2024-04-26T11:13:13.905148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904484+0000","last_change":"2024-04-26T11:13:12.914523+0000","last_active":"2024-04-26T11:13:13.904484+0000","last_peered":"2024-04-26T11:13:13.904484+0000","last_clean":"2024-04-26T11:13:13.904484+0000","last_became_active":"2024-04-26T11:13:12.913241+0000","last_became_peered":"2024-04-26T11:13:12.913241+0000","last_unstale":"2024-04-26T11:13:13.904484+0000","last_undegraded":"2024-04-26T11:13:13.904484+0000","last_fullsized":"2024-04-26T11:13:13.904484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:10.887079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904389+0000","last_change":"2024-04-26T11:13:12.922145+0000","last_active":"2024-04-26T11:13:13.904389+0000","last_peered":"2024-04-26T11:13:13.904389+0000","last_clean":"2024-04-26T11:13:13.904389+0000","last_became_active":"2024-04-26T11:13:12.919048+0000","last_became_peered":"2024-04-26T11:13:12.919048+0000","last_unstale":"2024-04-26T11:13:13.904389+0000","last_undegraded":"2024-04-26T11:13:13.904389+0000","last_fullsized":"2024-04-26T11:13:13.904389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:47.958725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904823+0000","last_change":"2024-04-26T11:13:12.914484+0000","last_active":"2024-04-26T11:13:13.904823+0000","last_peered":"2024-04-26T11:13:13.904823+0000","last_clean":"2024-04-26T11:13:13.904823+0000","last_became_active":"2024-04-26T11:13:12.913596+0000","last_became_peered":"2024-04-26T11:13:12.913596+0000","last_unstale":"2024-04-26T11:13:13.904823+0000","last_undegraded":"2024-04-26T11:13:13.904823+0000","last_fullsized":"2024-04-26T11:13:13.904823+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:38.001491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771320+0000","last_change":"2024-04-26T11:13:12.918759+0000","last_active":"2024-04-26T11:13:14.771320+0000","last_peered":"2024-04-26T11:13:14.771320+0000","last_clean":"2024-04-26T11:13:14.771320+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:13:14.771320+0000","last_undegraded":"2024-04-26T11:13:14.771320+0000","last_fullsized":"2024-04-26T11:13:14.771320+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:55.002972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904592+0000","last_change":"2024-04-26T11:13:12.917334+0000","last_active":"2024-04-26T11:13:13.904592+0000","last_peered":"2024-04-26T11:13:13.904592+0000","last_clean":"2024-04-26T11:13:13.904592+0000","last_became_active":"2024-04-26T11:13:12.917010+0000","last_became_peered":"2024-04-26T11:13:12.917010+0000","last_unstale":"2024-04-26T11:13:13.904592+0000","last_undegraded":"2024-04-26T11:13:13.904592+0000","last_fullsized":"2024-04-26T11:13:13.904592+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:52.543148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905177+0000","last_change":"2024-04-26T11:13:12.917519+0000","last_active":"2024-04-26T11:13:13.905177+0000","last_peered":"2024-04-26T11:13:13.905177+0000","last_clean":"2024-04-26T11:13:13.905177+0000","last_became_active":"2024-04-26T11:13:12.916985+0000","last_became_peered":"2024-04-26T11:13:12.916985+0000","last_unstale":"2024-04-26T11:13:13.905177+0000","last_undegraded":"2024-04-26T11:13:13.905177+0000","last_fullsized":"2024-04-26T11:13:13.905177+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:38.001491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904702+0000","last_change":"2024-04-26T11:13:12.919641+0000","last_active":"2024-04-26T11:13:13.904702+0000","last_peered":"2024-04-26T11:13:13.904702+0000","last_clean":"2024-04-26T11:13:13.904702+0000","last_became_active":"2024-04-26T11:13:12.918830+0000","last_became_peered":"2024-04-26T11:13:12.918830+0000","last_unstale":"2024-04-26T11:13:13.904702+0000","last_undegraded":"2024-04-26T11:13:13.904702+0000","last_fullsized":"2024-04-26T11:13:13.904702+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:52.714816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770332+0000","last_change":"2024-04-26T11:13:12.914087+0000","last_active":"2024-04-26T11:13:14.770332+0000","last_peered":"2024-04-26T11:13:14.770332+0000","last_clean":"2024-04-26T11:13:14.770332+0000","last_became_active":"2024-04-26T11:13:12.913393+0000","last_became_peered":"2024-04-26T11:13:12.913393+0000","last_unstale":"2024-04-26T11:13:14.770332+0000","last_undegraded":"2024-04-26T11:13:14.770332+0000","last_fullsized":"2024-04-26T11:13:14.770332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:38.001491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.903953+0000","last_change":"2024-04-26T11:13:12.918407+0000","last_active":"2024-04-26T11:13:13.903953+0000","last_peered":"2024-04-26T11:13:13.903953+0000","last_clean":"2024-04-26T11:13:13.903953+0000","last_became_active":"2024-04-26T11:13:12.918176+0000","last_became_peered":"2024-04-26T11:13:12.918176+0000","last_unstale":"2024-04-26T11:13:13.903953+0000","last_undegraded":"2024-04-26T11:13:13.903953+0000","last_fullsized":"2024-04-26T11:13:13.903953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770185+0000","last_change":"2024-04-26T11:13:12.912756+0000","last_active":"2024-04-26T11:13:14.770185+0000","last_peered":"2024-04-26T11:13:14.770185+0000","last_clean":"2024-04-26T11:13:14.770185+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:13:14.770185+0000","last_undegraded":"2024-04-26T11:13:14.770185+0000","last_fullsized":"2024-04-26T11:13:14.770185+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:04.177831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771368+0000","last_change":"2024-04-26T11:13:12.920122+0000","last_active":"2024-04-26T11:13:14.771368+0000","last_peered":"2024-04-26T11:13:14.771368+0000","last_clean":"2024-04-26T11:13:14.771368+0000","last_became_active":"2024-04-26T11:13:12.919792+0000","last_became_peered":"2024-04-26T11:13:12.919792+0000","last_unstale":"2024-04-26T11:13:14.771368+0000","last_undegraded":"2024-04-26T11:13:14.771368+0000","last_fullsized":"2024-04-26T11:13:14.771368+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:54.809926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904864+0000","last_change":"2024-04-26T11:13:12.912803+0000","last_active":"2024-04-26T11:13:13.904864+0000","last_peered":"2024-04-26T11:13:13.904864+0000","last_clean":"2024-04-26T11:13:13.904864+0000","last_became_active":"2024-04-26T11:13:12.912254+0000","last_became_peered":"2024-04-26T11:13:12.912254+0000","last_unstale":"2024-04-26T11:13:13.904864+0000","last_undegraded":"2024-04-26T11:13:13.904864+0000","last_fullsized":"2024-04-26T11:13:13.904864+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:11.313582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905305+0000","last_change":"2024-04-26T11:13:12.921062+0000","last_active":"2024-04-26T11:13:13.905305+0000","last_peered":"2024-04-26T11:13:13.905305+0000","last_clean":"2024-04-26T11:13:13.905305+0000","last_became_active":"2024-04-26T11:13:12.918716+0000","last_became_peered":"2024-04-26T11:13:12.918716+0000","last_unstale":"2024-04-26T11:13:13.905305+0000","last_undegraded":"2024-04-26T11:13:13.905305+0000","last_fullsized":"2024-04-26T11:13:13.905305+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:55.576807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770220+0000","last_change":"2024-04-26T11:13:12.493425+0000","last_active":"2024-04-26T11:13:14.770220+0000","last_peered":"2024-04-26T11:13:14.770220+0000","last_clean":"2024-04-26T11:13:14.770220+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:13:14.770220+0000","last_undegraded":"2024-04-26T11:13:14.770220+0000","last_fullsized":"2024-04-26T11:13:14.770220+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:23.279580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771122+0000","last_change":"2024-04-26T11:13:12.918515+0000","last_active":"2024-04-26T11:13:14.771122+0000","last_peered":"2024-04-26T11:13:14.771122+0000","last_clean":"2024-04-26T11:13:14.771122+0000","last_became_active":"2024-04-26T11:13:12.918002+0000","last_became_peered":"2024-04-26T11:13:12.918002+0000","last_unstale":"2024-04-26T11:13:14.771122+0000","last_undegraded":"2024-04-26T11:13:14.771122+0000","last_fullsized":"2024-04-26T11:13:14.771122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:46.610126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904192+0000","last_change":"2024-04-26T11:13:12.490257+0000","last_active":"2024-04-26T11:13:13.904192+0000","last_peered":"2024-04-26T11:13:13.904192+0000","last_clean":"2024-04-26T11:13:13.904192+0000","last_became_active":"2024-04-26T11:13:12.488819+0000","last_became_peered":"2024-04-26T11:13:12.488819+0000","last_unstale":"2024-04-26T11:13:13.904192+0000","last_undegraded":"2024-04-26T11:13:13.904192+0000","last_fullsized":"2024-04-26T11:13:13.904192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:52.644533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904995+0000","last_change":"2024-04-26T11:13:12.915624+0000","last_active":"2024-04-26T11:13:13.904995+0000","last_peered":"2024-04-26T11:13:13.904995+0000","last_clean":"2024-04-26T11:13:13.904995+0000","last_became_active":"2024-04-26T11:13:12.915375+0000","last_became_peered":"2024-04-26T11:13:12.915375+0000","last_unstale":"2024-04-26T11:13:13.904995+0000","last_undegraded":"2024-04-26T11:13:13.904995+0000","last_fullsized":"2024-04-26T11:13:13.904995+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:28.908758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904382+0000","last_change":"2024-04-26T11:13:12.487990+0000","last_active":"2024-04-26T11:13:13.904382+0000","last_peered":"2024-04-26T11:13:13.904382+0000","last_clean":"2024-04-26T11:13:13.904382+0000","last_became_active":"2024-04-26T11:13:12.486848+0000","last_became_peered":"2024-04-26T11:13:12.486848+0000","last_unstale":"2024-04-26T11:13:13.904382+0000","last_undegraded":"2024-04-26T11:13:13.904382+0000","last_fullsized":"2024-04-26T11:13:13.904382+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:56.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771304+0000","last_change":"2024-04-26T11:13:12.917423+0000","last_active":"2024-04-26T11:13:14.771304+0000","last_peered":"2024-04-26T11:13:14.771304+0000","last_clean":"2024-04-26T11:13:14.771304+0000","last_became_active":"2024-04-26T11:13:12.916811+0000","last_became_peered":"2024-04-26T11:13:12.916811+0000","last_unstale":"2024-04-26T11:13:14.771304+0000","last_undegraded":"2024-04-26T11:13:14.771304+0000","last_fullsized":"2024-04-26T11:13:14.771304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:28.908758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905043+0000","last_change":"2024-04-26T11:13:12.490251+0000","last_active":"2024-04-26T11:13:13.905043+0000","last_peered":"2024-04-26T11:13:13.905043+0000","last_clean":"2024-04-26T11:13:13.905043+0000","last_became_active":"2024-04-26T11:13:12.489836+0000","last_became_peered":"2024-04-26T11:13:12.489836+0000","last_unstale":"2024-04-26T11:13:13.905043+0000","last_undegraded":"2024-04-26T11:13:13.905043+0000","last_fullsized":"2024-04-26T11:13:13.905043+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:42.000159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.903972+0000","last_change":"2024-04-26T11:13:12.912865+0000","last_active":"2024-04-26T11:13:13.903972+0000","last_peered":"2024-04-26T11:13:13.903972+0000","last_clean":"2024-04-26T11:13:13.903972+0000","last_became_active":"2024-04-26T11:13:12.912397+0000","last_became_peered":"2024-04-26T11:13:12.912397+0000","last_unstale":"2024-04-26T11:13:13.903972+0000","last_undegraded":"2024-04-26T11:13:13.903972+0000","last_fullsized":"2024-04-26T11:13:13.903972+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905218+0000","last_change":"2024-04-26T11:13:12.493118+0000","last_active":"2024-04-26T11:13:13.905218+0000","last_peered":"2024-04-26T11:13:13.905218+0000","last_clean":"2024-04-26T11:13:13.905218+0000","last_became_active":"2024-04-26T11:13:12.492799+0000","last_became_peered":"2024-04-26T11:13:12.492799+0000","last_unstale":"2024-04-26T11:13:13.905218+0000","last_undegraded":"2024-04-26T11:13:13.905218+0000","last_fullsized":"2024-04-26T11:13:13.905218+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:46.082467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904510+0000","last_change":"2024-04-26T11:13:12.918149+0000","last_active":"2024-04-26T11:13:13.904510+0000","last_peered":"2024-04-26T11:13:13.904510+0000","last_clean":"2024-04-26T11:13:13.904510+0000","last_became_active":"2024-04-26T11:13:12.917636+0000","last_became_peered":"2024-04-26T11:13:12.917636+0000","last_unstale":"2024-04-26T11:13:13.904510+0000","last_undegraded":"2024-04-26T11:13:13.904510+0000","last_fullsized":"2024-04-26T11:13:13.904510+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:20.837217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770906+0000","last_change":"2024-04-26T11:13:12.495785+0000","last_active":"2024-04-26T11:13:14.770906+0000","last_peered":"2024-04-26T11:13:14.770906+0000","last_clean":"2024-04-26T11:13:14.770906+0000","last_became_active":"2024-04-26T11:13:12.495527+0000","last_became_peered":"2024-04-26T11:13:12.495527+0000","last_unstale":"2024-04-26T11:13:14.770906+0000","last_undegraded":"2024-04-26T11:13:14.770906+0000","last_fullsized":"2024-04-26T11:13:14.770906+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:45.374565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904416+0000","last_change":"2024-04-26T11:13:12.913698+0000","last_active":"2024-04-26T11:13:13.904416+0000","last_peered":"2024-04-26T11:13:13.904416+0000","last_clean":"2024-04-26T11:13:13.904416+0000","last_became_active":"2024-04-26T11:13:12.913198+0000","last_became_peered":"2024-04-26T11:13:12.913198+0000","last_unstale":"2024-04-26T11:13:13.904416+0000","last_undegraded":"2024-04-26T11:13:13.904416+0000","last_fullsized":"2024-04-26T11:13:13.904416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905059+0000","last_change":"2024-04-26T11:13:12.492878+0000","last_active":"2024-04-26T11:13:13.905059+0000","last_peered":"2024-04-26T11:13:13.905059+0000","last_clean":"2024-04-26T11:13:13.905059+0000","last_became_active":"2024-04-26T11:13:12.491690+0000","last_became_peered":"2024-04-26T11:13:12.491690+0000","last_unstale":"2024-04-26T11:13:13.905059+0000","last_undegraded":"2024-04-26T11:13:13.905059+0000","last_fullsized":"2024-04-26T11:13:13.905059+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:12.581788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905197+0000","last_change":"2024-04-26T11:13:12.916914+0000","last_active":"2024-04-26T11:13:13.905197+0000","last_peered":"2024-04-26T11:13:13.905197+0000","last_clean":"2024-04-26T11:13:13.905197+0000","last_became_active":"2024-04-26T11:13:12.913900+0000","last_became_peered":"2024-04-26T11:13:12.913900+0000","last_unstale":"2024-04-26T11:13:13.905197+0000","last_undegraded":"2024-04-26T11:13:13.905197+0000","last_fullsized":"2024-04-26T11:13:13.905197+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:28.908758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905107+0000","last_change":"2024-04-26T11:13:12.493445+0000","last_active":"2024-04-26T11:13:13.905107+0000","last_peered":"2024-04-26T11:13:13.905107+0000","last_clean":"2024-04-26T11:13:13.905107+0000","last_became_active":"2024-04-26T11:13:12.493015+0000","last_became_peered":"2024-04-26T11:13:12.493015+0000","last_unstale":"2024-04-26T11:13:13.905107+0000","last_undegraded":"2024-04-26T11:13:13.905107+0000","last_fullsized":"2024-04-26T11:13:13.905107+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:17.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770711+0000","last_change":"2024-04-26T11:13:12.916685+0000","last_active":"2024-04-26T11:13:14.770711+0000","last_peered":"2024-04-26T11:13:14.770711+0000","last_clean":"2024-04-26T11:13:14.770711+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:13:14.770711+0000","last_undegraded":"2024-04-26T11:13:14.770711+0000","last_fullsized":"2024-04-26T11:13:14.770711+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904543+0000","last_change":"2024-04-26T11:13:12.491438+0000","last_active":"2024-04-26T11:13:13.904543+0000","last_peered":"2024-04-26T11:13:13.904543+0000","last_clean":"2024-04-26T11:13:13.904543+0000","last_became_active":"2024-04-26T11:13:12.490515+0000","last_became_peered":"2024-04-26T11:13:12.490515+0000","last_unstale":"2024-04-26T11:13:13.904543+0000","last_undegraded":"2024-04-26T11:13:13.904543+0000","last_fullsized":"2024-04-26T11:13:13.904543+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:11.480844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770974+0000","last_change":"2024-04-26T11:13:12.915238+0000","last_active":"2024-04-26T11:13:14.770974+0000","last_peered":"2024-04-26T11:13:14.770974+0000","last_clean":"2024-04-26T11:13:14.770974+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:13:14.770974+0000","last_undegraded":"2024-04-26T11:13:14.770974+0000","last_fullsized":"2024-04-26T11:13:14.770974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:48.068465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770266+0000","last_change":"2024-04-26T11:13:12.492682+0000","last_active":"2024-04-26T11:13:14.770266+0000","last_peered":"2024-04-26T11:13:14.770266+0000","last_clean":"2024-04-26T11:13:14.770266+0000","last_became_active":"2024-04-26T11:13:12.492346+0000","last_became_peered":"2024-04-26T11:13:12.492346+0000","last_unstale":"2024-04-26T11:13:14.770266+0000","last_undegraded":"2024-04-26T11:13:14.770266+0000","last_fullsized":"2024-04-26T11:13:14.770266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:28.034755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905121+0000","last_change":"2024-04-26T11:13:12.913671+0000","last_active":"2024-04-26T11:13:13.905121+0000","last_peered":"2024-04-26T11:13:13.905121+0000","last_clean":"2024-04-26T11:13:13.905121+0000","last_became_active":"2024-04-26T11:13:12.913264+0000","last_became_peered":"2024-04-26T11:13:12.913264+0000","last_unstale":"2024-04-26T11:13:13.905121+0000","last_undegraded":"2024-04-26T11:13:13.905121+0000","last_fullsized":"2024-04-26T11:13:13.905121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904759+0000","last_change":"2024-04-26T11:13:12.492802+0000","last_active":"2024-04-26T11:13:13.904759+0000","last_peered":"2024-04-26T11:13:13.904759+0000","last_clean":"2024-04-26T11:13:13.904759+0000","last_became_active":"2024-04-26T11:13:12.491774+0000","last_became_peered":"2024-04-26T11:13:12.491774+0000","last_unstale":"2024-04-26T11:13:13.904759+0000","last_undegraded":"2024-04-26T11:13:13.904759+0000","last_fullsized":"2024-04-26T11:13:13.904759+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:05.413010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905139+0000","last_change":"2024-04-26T11:13:12.915666+0000","last_active":"2024-04-26T11:13:13.905139+0000","last_peered":"2024-04-26T11:13:13.905139+0000","last_clean":"2024-04-26T11:13:13.905139+0000","last_became_active":"2024-04-26T11:13:12.915393+0000","last_became_peered":"2024-04-26T11:13:12.915393+0000","last_unstale":"2024-04-26T11:13:13.905139+0000","last_undegraded":"2024-04-26T11:13:13.905139+0000","last_fullsized":"2024-04-26T11:13:13.905139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905455+0000","last_change":"2024-04-26T11:13:12.491934+0000","last_active":"2024-04-26T11:13:13.905455+0000","last_peered":"2024-04-26T11:13:13.905455+0000","last_clean":"2024-04-26T11:13:13.905455+0000","last_became_active":"2024-04-26T11:13:12.491262+0000","last_became_peered":"2024-04-26T11:13:12.491262+0000","last_unstale":"2024-04-26T11:13:13.905455+0000","last_undegraded":"2024-04-26T11:13:13.905455+0000","last_fullsized":"2024-04-26T11:13:13.905455+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:11.480844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.769967+0000","last_change":"2024-04-26T11:13:12.920072+0000","last_active":"2024-04-26T11:13:14.769967+0000","last_peered":"2024-04-26T11:13:14.769967+0000","last_clean":"2024-04-26T11:13:14.769967+0000","last_became_active":"2024-04-26T11:13:12.919233+0000","last_became_peered":"2024-04-26T11:13:12.919233+0000","last_unstale":"2024-04-26T11:13:14.769967+0000","last_undegraded":"2024-04-26T11:13:14.769967+0000","last_fullsized":"2024-04-26T11:13:14.769967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:41.004462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771109+0000","last_change":"2024-04-26T11:13:12.493060+0000","last_active":"2024-04-26T11:13:14.771109+0000","last_peered":"2024-04-26T11:13:14.771109+0000","last_clean":"2024-04-26T11:13:14.771109+0000","last_became_active":"2024-04-26T11:13:12.492519+0000","last_became_peered":"2024-04-26T11:13:12.492519+0000","last_unstale":"2024-04-26T11:13:14.771109+0000","last_undegraded":"2024-04-26T11:13:14.771109+0000","last_fullsized":"2024-04-26T11:13:14.771109+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:48.928740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770525+0000","last_change":"2024-04-26T11:13:12.912207+0000","last_active":"2024-04-26T11:13:14.770525+0000","last_peered":"2024-04-26T11:13:14.770525+0000","last_clean":"2024-04-26T11:13:14.770525+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:13:14.770525+0000","last_undegraded":"2024-04-26T11:13:14.770525+0000","last_fullsized":"2024-04-26T11:13:14.770525+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905410+0000","last_change":"2024-04-26T11:13:12.492772+0000","last_active":"2024-04-26T11:13:13.905410+0000","last_peered":"2024-04-26T11:13:13.905410+0000","last_clean":"2024-04-26T11:13:13.905410+0000","last_became_active":"2024-04-26T11:13:12.491901+0000","last_became_peered":"2024-04-26T11:13:12.491901+0000","last_unstale":"2024-04-26T11:13:13.905410+0000","last_undegraded":"2024-04-26T11:13:13.905410+0000","last_fullsized":"2024-04-26T11:13:13.905410+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:45.693017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904852+0000","last_change":"2024-04-26T11:13:12.919749+0000","last_active":"2024-04-26T11:13:13.904852+0000","last_peered":"2024-04-26T11:13:13.904852+0000","last_clean":"2024-04-26T11:13:13.904852+0000","last_became_active":"2024-04-26T11:13:12.917479+0000","last_became_peered":"2024-04-26T11:13:12.917479+0000","last_unstale":"2024-04-26T11:13:13.904852+0000","last_undegraded":"2024-04-26T11:13:13.904852+0000","last_fullsized":"2024-04-26T11:13:13.904852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:12.483631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904944+0000","last_change":"2024-04-26T11:13:12.495144+0000","last_active":"2024-04-26T11:13:13.904944+0000","last_peered":"2024-04-26T11:13:13.904944+0000","last_clean":"2024-04-26T11:13:13.904944+0000","last_became_active":"2024-04-26T11:13:12.494510+0000","last_became_peered":"2024-04-26T11:13:12.494510+0000","last_unstale":"2024-04-26T11:13:13.904944+0000","last_undegraded":"2024-04-26T11:13:13.904944+0000","last_fullsized":"2024-04-26T11:13:13.904944+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:00.146717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904907+0000","last_change":"2024-04-26T11:13:12.913350+0000","last_active":"2024-04-26T11:13:13.904907+0000","last_peered":"2024-04-26T11:13:13.904907+0000","last_clean":"2024-04-26T11:13:13.904907+0000","last_became_active":"2024-04-26T11:13:12.912991+0000","last_became_peered":"2024-04-26T11:13:12.912991+0000","last_unstale":"2024-04-26T11:13:13.904907+0000","last_undegraded":"2024-04-26T11:13:13.904907+0000","last_fullsized":"2024-04-26T11:13:13.904907+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:54.809926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904432+0000","last_change":"2024-04-26T11:13:12.490343+0000","last_active":"2024-04-26T11:13:13.904432+0000","last_peered":"2024-04-26T11:13:13.904432+0000","last_clean":"2024-04-26T11:13:13.904432+0000","last_became_active":"2024-04-26T11:13:12.490027+0000","last_became_peered":"2024-04-26T11:13:12.490027+0000","last_unstale":"2024-04-26T11:13:13.904432+0000","last_undegraded":"2024-04-26T11:13:13.904432+0000","last_fullsized":"2024-04-26T11:13:13.904432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:45.693017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904814+0000","last_change":"2024-04-26T11:13:12.918774+0000","last_active":"2024-04-26T11:13:13.904814+0000","last_peered":"2024-04-26T11:13:13.904814+0000","last_clean":"2024-04-26T11:13:13.904814+0000","last_became_active":"2024-04-26T11:13:12.917269+0000","last_became_peered":"2024-04-26T11:13:12.917269+0000","last_unstale":"2024-04-26T11:13:13.904814+0000","last_undegraded":"2024-04-26T11:13:13.904814+0000","last_fullsized":"2024-04-26T11:13:13.904814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:33.358984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904745+0000","last_change":"2024-04-26T11:13:12.494689+0000","last_active":"2024-04-26T11:13:13.904745+0000","last_peered":"2024-04-26T11:13:13.904745+0000","last_clean":"2024-04-26T11:13:13.904745+0000","last_became_active":"2024-04-26T11:13:12.494236+0000","last_became_peered":"2024-04-26T11:13:12.494236+0000","last_unstale":"2024-04-26T11:13:13.904745+0000","last_undegraded":"2024-04-26T11:13:13.904745+0000","last_fullsized":"2024-04-26T11:13:13.904745+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:42.000159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905618+0000","last_change":"2024-04-26T11:13:12.919985+0000","last_active":"2024-04-26T11:13:13.905618+0000","last_peered":"2024-04-26T11:13:13.905618+0000","last_clean":"2024-04-26T11:13:13.905618+0000","last_became_active":"2024-04-26T11:13:12.916239+0000","last_became_peered":"2024-04-26T11:13:12.916239+0000","last_unstale":"2024-04-26T11:13:13.905618+0000","last_undegraded":"2024-04-26T11:13:13.905618+0000","last_fullsized":"2024-04-26T11:13:13.905618+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:54.809926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770064+0000","last_change":"2024-04-26T11:13:12.492856+0000","last_active":"2024-04-26T11:13:14.770064+0000","last_peered":"2024-04-26T11:13:14.770064+0000","last_clean":"2024-04-26T11:13:14.770064+0000","last_became_active":"2024-04-26T11:13:12.492412+0000","last_became_peered":"2024-04-26T11:13:12.492412+0000","last_unstale":"2024-04-26T11:13:14.770064+0000","last_undegraded":"2024-04-26T11:13:14.770064+0000","last_fullsized":"2024-04-26T11:13:14.770064+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:09.572402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905480+0000","last_change":"2024-04-26T11:13:12.920056+0000","last_active":"2024-04-26T11:13:13.905480+0000","last_peered":"2024-04-26T11:13:13.905480+0000","last_clean":"2024-04-26T11:13:13.905480+0000","last_became_active":"2024-04-26T11:13:12.919049+0000","last_became_peered":"2024-04-26T11:13:12.919049+0000","last_unstale":"2024-04-26T11:13:13.905480+0000","last_undegraded":"2024-04-26T11:13:13.905480+0000","last_fullsized":"2024-04-26T11:13:13.905480+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770130+0000","last_change":"2024-04-26T11:13:12.493217+0000","last_active":"2024-04-26T11:13:14.770130+0000","last_peered":"2024-04-26T11:13:14.770130+0000","last_clean":"2024-04-26T11:13:14.770130+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:13:14.770130+0000","last_undegraded":"2024-04-26T11:13:14.770130+0000","last_fullsized":"2024-04-26T11:13:14.770130+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:00.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904940+0000","last_change":"2024-04-26T11:13:12.914321+0000","last_active":"2024-04-26T11:13:13.904940+0000","last_peered":"2024-04-26T11:13:13.904940+0000","last_clean":"2024-04-26T11:13:13.904940+0000","last_became_active":"2024-04-26T11:13:12.913543+0000","last_became_peered":"2024-04-26T11:13:12.913543+0000","last_unstale":"2024-04-26T11:13:13.904940+0000","last_undegraded":"2024-04-26T11:13:13.904940+0000","last_fullsized":"2024-04-26T11:13:13.904940+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.903582+0000","last_change":"2024-04-26T11:13:08.113095+0000","last_active":"2024-04-26T11:13:12.903582+0000","last_peered":"2024-04-26T11:13:12.903582+0000","last_clean":"2024-04-26T11:13:12.903582+0000","last_became_active":"2024-04-26T11:13:08.112778+0000","last_became_peered":"2024-04-26T11:13:08.112778+0000","last_unstale":"2024-04-26T11:13:12.903582+0000","last_undegraded":"2024-04-26T11:13:12.903582+0000","last_fullsized":"2024-04-26T11:13:12.903582+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:41.705893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905517+0000","last_change":"2024-04-26T11:13:12.493960+0000","last_active":"2024-04-26T11:13:13.905517+0000","last_peered":"2024-04-26T11:13:13.905517+0000","last_clean":"2024-04-26T11:13:13.905517+0000","last_became_active":"2024-04-26T11:13:12.493087+0000","last_became_peered":"2024-04-26T11:13:12.493087+0000","last_unstale":"2024-04-26T11:13:13.905517+0000","last_undegraded":"2024-04-26T11:13:13.905517+0000","last_fullsized":"2024-04-26T11:13:13.905517+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:19.538082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770546+0000","last_change":"2024-04-26T11:13:12.917458+0000","last_active":"2024-04-26T11:13:14.770546+0000","last_peered":"2024-04-26T11:13:14.770546+0000","last_clean":"2024-04-26T11:13:14.770546+0000","last_became_active":"2024-04-26T11:13:12.916792+0000","last_became_peered":"2024-04-26T11:13:12.916792+0000","last_unstale":"2024-04-26T11:13:14.770546+0000","last_undegraded":"2024-04-26T11:13:14.770546+0000","last_fullsized":"2024-04-26T11:13:14.770546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:12.483631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.913665+0000","last_change":"2024-04-26T11:13:08.112744+0000","last_active":"2024-04-26T11:13:12.913665+0000","last_peered":"2024-04-26T11:13:12.913665+0000","last_clean":"2024-04-26T11:13:12.913665+0000","last_became_active":"2024-04-26T11:13:08.112498+0000","last_became_peered":"2024-04-26T11:13:08.112498+0000","last_unstale":"2024-04-26T11:13:12.913665+0000","last_undegraded":"2024-04-26T11:13:12.913665+0000","last_fullsized":"2024-04-26T11:13:12.913665+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:38.407116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904845+0000","last_change":"2024-04-26T11:13:12.494137+0000","last_active":"2024-04-26T11:13:13.904845+0000","last_peered":"2024-04-26T11:13:13.904845+0000","last_clean":"2024-04-26T11:13:13.904845+0000","last_became_active":"2024-04-26T11:13:12.493447+0000","last_became_peered":"2024-04-26T11:13:12.493447+0000","last_unstale":"2024-04-26T11:13:13.904845+0000","last_undegraded":"2024-04-26T11:13:13.904845+0000","last_fullsized":"2024-04-26T11:13:13.904845+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:52.644533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904572+0000","last_change":"2024-04-26T11:13:12.912553+0000","last_active":"2024-04-26T11:13:13.904572+0000","last_peered":"2024-04-26T11:13:13.904572+0000","last_clean":"2024-04-26T11:13:13.904572+0000","last_became_active":"2024-04-26T11:13:12.912022+0000","last_became_peered":"2024-04-26T11:13:12.912022+0000","last_unstale":"2024-04-26T11:13:13.904572+0000","last_undegraded":"2024-04-26T11:13:13.904572+0000","last_fullsized":"2024-04-26T11:13:13.904572+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.903369+0000","last_change":"2024-04-26T11:13:08.113650+0000","last_active":"2024-04-26T11:13:12.903369+0000","last_peered":"2024-04-26T11:13:12.903369+0000","last_clean":"2024-04-26T11:13:12.903369+0000","last_became_active":"2024-04-26T11:13:08.113394+0000","last_became_peered":"2024-04-26T11:13:08.113394+0000","last_unstale":"2024-04-26T11:13:12.903369+0000","last_undegraded":"2024-04-26T11:13:12.903369+0000","last_fullsized":"2024-04-26T11:13:12.903369+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:44.642172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770074+0000","last_change":"2024-04-26T11:13:12.492888+0000","last_active":"2024-04-26T11:13:14.770074+0000","last_peered":"2024-04-26T11:13:14.770074+0000","last_clean":"2024-04-26T11:13:14.770074+0000","last_became_active":"2024-04-26T11:13:12.492274+0000","last_became_peered":"2024-04-26T11:13:12.492274+0000","last_unstale":"2024-04-26T11:13:14.770074+0000","last_undegraded":"2024-04-26T11:13:14.770074+0000","last_fullsized":"2024-04-26T11:13:14.770074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:51.136157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905114+0000","last_change":"2024-04-26T11:13:12.914599+0000","last_active":"2024-04-26T11:13:13.905114+0000","last_peered":"2024-04-26T11:13:13.905114+0000","last_clean":"2024-04-26T11:13:13.905114+0000","last_became_active":"2024-04-26T11:13:12.913916+0000","last_became_peered":"2024-04-26T11:13:12.913916+0000","last_unstale":"2024-04-26T11:13:13.905114+0000","last_undegraded":"2024-04-26T11:13:13.905114+0000","last_fullsized":"2024-04-26T11:13:13.905114+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.915840+0000","last_change":"2024-04-26T11:13:08.112690+0000","last_active":"2024-04-26T11:13:12.915840+0000","last_peered":"2024-04-26T11:13:12.915840+0000","last_clean":"2024-04-26T11:13:12.915840+0000","last_became_active":"2024-04-26T11:13:08.112454+0000","last_became_peered":"2024-04-26T11:13:08.112454+0000","last_unstale":"2024-04-26T11:13:12.915840+0000","last_undegraded":"2024-04-26T11:13:12.915840+0000","last_fullsized":"2024-04-26T11:13:12.915840+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:41.011030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.913577+0000","last_change":"2024-04-26T11:13:08.113419+0000","last_active":"2024-04-26T11:13:12.913577+0000","last_peered":"2024-04-26T11:13:12.913577+0000","last_clean":"2024-04-26T11:13:12.913577+0000","last_became_active":"2024-04-26T11:13:08.113154+0000","last_became_peered":"2024-04-26T11:13:08.113154+0000","last_unstale":"2024-04-26T11:13:12.913577+0000","last_undegraded":"2024-04-26T11:13:12.913577+0000","last_fullsized":"2024-04-26T11:13:12.913577+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:36.482001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904292+0000","last_change":"2024-04-26T11:13:12.491278+0000","last_active":"2024-04-26T11:13:13.904292+0000","last_peered":"2024-04-26T11:13:13.904292+0000","last_clean":"2024-04-26T11:13:13.904292+0000","last_became_active":"2024-04-26T11:13:12.488223+0000","last_became_peered":"2024-04-26T11:13:12.488223+0000","last_unstale":"2024-04-26T11:13:13.904292+0000","last_undegraded":"2024-04-26T11:13:13.904292+0000","last_fullsized":"2024-04-26T11:13:13.904292+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:05.413010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905587+0000","last_change":"2024-04-26T11:13:12.920834+0000","last_active":"2024-04-26T11:13:13.905587+0000","last_peered":"2024-04-26T11:13:13.905587+0000","last_clean":"2024-04-26T11:13:13.905587+0000","last_became_active":"2024-04-26T11:13:12.917055+0000","last_became_peered":"2024-04-26T11:13:12.917055+0000","last_unstale":"2024-04-26T11:13:13.905587+0000","last_undegraded":"2024-04-26T11:13:13.905587+0000","last_fullsized":"2024-04-26T11:13:13.905587+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:11.313582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.913563+0000","last_change":"2024-04-26T11:13:08.113497+0000","last_active":"2024-04-26T11:13:12.913563+0000","last_peered":"2024-04-26T11:13:12.913563+0000","last_clean":"2024-04-26T11:13:12.913563+0000","last_became_active":"2024-04-26T11:13:08.113237+0000","last_became_peered":"2024-04-26T11:13:08.113237+0000","last_unstale":"2024-04-26T11:13:12.913563+0000","last_undegraded":"2024-04-26T11:13:12.913563+0000","last_fullsized":"2024-04-26T11:13:12.913563+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:52.240361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904041+0000","last_change":"2024-04-26T11:13:12.491936+0000","last_active":"2024-04-26T11:13:13.904041+0000","last_peered":"2024-04-26T11:13:13.904041+0000","last_clean":"2024-04-26T11:13:13.904041+0000","last_became_active":"2024-04-26T11:13:12.491533+0000","last_became_peered":"2024-04-26T11:13:12.491533+0000","last_unstale":"2024-04-26T11:13:13.904041+0000","last_undegraded":"2024-04-26T11:13:13.904041+0000","last_fullsized":"2024-04-26T11:13:13.904041+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:13.320025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771296+0000","last_change":"2024-04-26T11:13:12.918648+0000","last_active":"2024-04-26T11:13:14.771296+0000","last_peered":"2024-04-26T11:13:14.771296+0000","last_clean":"2024-04-26T11:13:14.771296+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:13:14.771296+0000","last_undegraded":"2024-04-26T11:13:14.771296+0000","last_fullsized":"2024-04-26T11:13:14.771296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.907846+0000","last_change":"2024-04-26T11:13:08.110433+0000","last_active":"2024-04-26T11:13:12.907846+0000","last_peered":"2024-04-26T11:13:12.907846+0000","last_clean":"2024-04-26T11:13:12.907846+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:13:12.907846+0000","last_undegraded":"2024-04-26T11:13:12.907846+0000","last_fullsized":"2024-04-26T11:13:12.907846+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904956+0000","last_change":"2024-04-26T11:13:12.491648+0000","last_active":"2024-04-26T11:13:13.904956+0000","last_peered":"2024-04-26T11:13:13.904956+0000","last_clean":"2024-04-26T11:13:13.904956+0000","last_became_active":"2024-04-26T11:13:12.488599+0000","last_became_peered":"2024-04-26T11:13:12.488599+0000","last_unstale":"2024-04-26T11:13:13.904956+0000","last_undegraded":"2024-04-26T11:13:13.904956+0000","last_fullsized":"2024-04-26T11:13:13.904956+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:45.374565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770640+0000","last_change":"2024-04-26T11:13:12.920065+0000","last_active":"2024-04-26T11:13:14.770640+0000","last_peered":"2024-04-26T11:13:14.770640+0000","last_clean":"2024-04-26T11:13:14.770640+0000","last_became_active":"2024-04-26T11:13:12.919741+0000","last_became_peered":"2024-04-26T11:13:12.919741+0000","last_unstale":"2024-04-26T11:13:14.770640+0000","last_undegraded":"2024-04-26T11:13:14.770640+0000","last_fullsized":"2024-04-26T11:13:14.770640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:20.837217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904894+0000","last_change":"2024-04-26T11:13:12.488576+0000","last_active":"2024-04-26T11:13:13.904894+0000","last_peered":"2024-04-26T11:13:13.904894+0000","last_clean":"2024-04-26T11:13:13.904894+0000","last_became_active":"2024-04-26T11:13:12.488248+0000","last_became_peered":"2024-04-26T11:13:12.488248+0000","last_unstale":"2024-04-26T11:13:13.904894+0000","last_undegraded":"2024-04-26T11:13:13.904894+0000","last_fullsized":"2024-04-26T11:13:13.904894+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:48.928740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.904393+0000","last_change":"2024-04-26T11:13:08.113157+0000","last_active":"2024-04-26T11:13:12.904393+0000","last_peered":"2024-04-26T11:13:12.904393+0000","last_clean":"2024-04-26T11:13:12.904393+0000","last_became_active":"2024-04-26T11:13:08.112788+0000","last_became_peered":"2024-04-26T11:13:08.112788+0000","last_unstale":"2024-04-26T11:13:12.904393+0000","last_undegraded":"2024-04-26T11:13:12.904393+0000","last_fullsized":"2024-04-26T11:13:12.904393+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:14.606433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904028+0000","last_change":"2024-04-26T11:13:12.919100+0000","last_active":"2024-04-26T11:13:13.904028+0000","last_peered":"2024-04-26T11:13:13.904028+0000","last_clean":"2024-04-26T11:13:13.904028+0000","last_became_active":"2024-04-26T11:13:12.918816+0000","last_became_peered":"2024-04-26T11:13:12.918816+0000","last_unstale":"2024-04-26T11:13:13.904028+0000","last_undegraded":"2024-04-26T11:13:13.904028+0000","last_fullsized":"2024-04-26T11:13:13.904028+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.915609+0000","last_change":"2024-04-26T11:13:08.113505+0000","last_active":"2024-04-26T11:13:12.915609+0000","last_peered":"2024-04-26T11:13:12.915609+0000","last_clean":"2024-04-26T11:13:12.915609+0000","last_became_active":"2024-04-26T11:13:08.113224+0000","last_became_peered":"2024-04-26T11:13:08.113224+0000","last_unstale":"2024-04-26T11:13:12.915609+0000","last_undegraded":"2024-04-26T11:13:12.915609+0000","last_fullsized":"2024-04-26T11:13:12.915609+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:16.157275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904844+0000","last_change":"2024-04-26T11:13:12.490249+0000","last_active":"2024-04-26T11:13:13.904844+0000","last_peered":"2024-04-26T11:13:13.904844+0000","last_clean":"2024-04-26T11:13:13.904844+0000","last_became_active":"2024-04-26T11:13:12.488836+0000","last_became_peered":"2024-04-26T11:13:12.488836+0000","last_unstale":"2024-04-26T11:13:13.904844+0000","last_undegraded":"2024-04-26T11:13:13.904844+0000","last_fullsized":"2024-04-26T11:13:13.904844+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:12.581788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770387+0000","last_change":"2024-04-26T11:13:12.913955+0000","last_active":"2024-04-26T11:13:14.770387+0000","last_peered":"2024-04-26T11:13:14.770387+0000","last_clean":"2024-04-26T11:13:14.770387+0000","last_became_active":"2024-04-26T11:13:12.913037+0000","last_became_peered":"2024-04-26T11:13:12.913037+0000","last_unstale":"2024-04-26T11:13:14.770387+0000","last_undegraded":"2024-04-26T11:13:14.770387+0000","last_fullsized":"2024-04-26T11:13:14.770387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:11.313582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770475+0000","last_change":"2024-04-26T11:13:12.493479+0000","last_active":"2024-04-26T11:13:14.770475+0000","last_peered":"2024-04-26T11:13:14.770475+0000","last_clean":"2024-04-26T11:13:14.770475+0000","last_became_active":"2024-04-26T11:13:12.493174+0000","last_became_peered":"2024-04-26T11:13:12.493174+0000","last_unstale":"2024-04-26T11:13:14.770475+0000","last_undegraded":"2024-04-26T11:13:14.770475+0000","last_fullsized":"2024-04-26T11:13:14.770475+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:05.413010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770803+0000","last_change":"2024-04-26T11:13:12.917812+0000","last_active":"2024-04-26T11:13:14.770803+0000","last_peered":"2024-04-26T11:13:14.770803+0000","last_clean":"2024-04-26T11:13:14.770803+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:13:14.770803+0000","last_undegraded":"2024-04-26T11:13:14.770803+0000","last_fullsized":"2024-04-26T11:13:14.770803+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904950+0000","last_change":"2024-04-26T11:13:12.493351+0000","last_active":"2024-04-26T11:13:13.904950+0000","last_peered":"2024-04-26T11:13:13.904950+0000","last_clean":"2024-04-26T11:13:13.904950+0000","last_became_active":"2024-04-26T11:13:12.492923+0000","last_became_peered":"2024-04-26T11:13:12.492923+0000","last_unstale":"2024-04-26T11:13:13.904950+0000","last_undegraded":"2024-04-26T11:13:13.904950+0000","last_fullsized":"2024-04-26T11:13:13.904950+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:53.444842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904852+0000","last_change":"2024-04-26T11:13:12.918383+0000","last_active":"2024-04-26T11:13:13.904852+0000","last_peered":"2024-04-26T11:13:13.904852+0000","last_clean":"2024-04-26T11:13:13.904852+0000","last_became_active":"2024-04-26T11:13:12.917098+0000","last_became_peered":"2024-04-26T11:13:12.917098+0000","last_unstale":"2024-04-26T11:13:13.904852+0000","last_undegraded":"2024-04-26T11:13:13.904852+0000","last_fullsized":"2024-04-26T11:13:13.904852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:43.397887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770971+0000","last_change":"2024-04-26T11:13:12.493387+0000","last_active":"2024-04-26T11:13:14.770971+0000","last_peered":"2024-04-26T11:13:14.770971+0000","last_clean":"2024-04-26T11:13:14.770971+0000","last_became_active":"2024-04-26T11:13:12.493158+0000","last_became_peered":"2024-04-26T11:13:12.493158+0000","last_unstale":"2024-04-26T11:13:14.770971+0000","last_undegraded":"2024-04-26T11:13:14.770971+0000","last_fullsized":"2024-04-26T11:13:14.770971+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:56.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904899+0000","last_change":"2024-04-26T11:13:12.920137+0000","last_active":"2024-04-26T11:13:13.904899+0000","last_peered":"2024-04-26T11:13:13.904899+0000","last_clean":"2024-04-26T11:13:13.904899+0000","last_became_active":"2024-04-26T11:13:12.919020+0000","last_became_peered":"2024-04-26T11:13:12.919020+0000","last_unstale":"2024-04-26T11:13:13.904899+0000","last_undegraded":"2024-04-26T11:13:13.904899+0000","last_fullsized":"2024-04-26T11:13:13.904899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:47.014768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905092+0000","last_change":"2024-04-26T11:13:12.490017+0000","last_active":"2024-04-26T11:13:13.905092+0000","last_peered":"2024-04-26T11:13:13.905092+0000","last_clean":"2024-04-26T11:13:13.905092+0000","last_became_active":"2024-04-26T11:13:12.488282+0000","last_became_peered":"2024-04-26T11:13:12.488282+0000","last_unstale":"2024-04-26T11:13:13.905092+0000","last_undegraded":"2024-04-26T11:13:13.905092+0000","last_fullsized":"2024-04-26T11:13:13.905092+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:20.176849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770666+0000","last_change":"2024-04-26T11:13:12.917763+0000","last_active":"2024-04-26T11:13:14.770666+0000","last_peered":"2024-04-26T11:13:14.770666+0000","last_clean":"2024-04-26T11:13:14.770666+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:13:14.770666+0000","last_undegraded":"2024-04-26T11:13:14.770666+0000","last_fullsized":"2024-04-26T11:13:14.770666+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905010+0000","last_change":"2024-04-26T11:13:12.491798+0000","last_active":"2024-04-26T11:13:13.905010+0000","last_peered":"2024-04-26T11:13:13.905010+0000","last_clean":"2024-04-26T11:13:13.905010+0000","last_became_active":"2024-04-26T11:13:12.490582+0000","last_became_peered":"2024-04-26T11:13:12.490582+0000","last_unstale":"2024-04-26T11:13:13.905010+0000","last_undegraded":"2024-04-26T11:13:13.905010+0000","last_fullsized":"2024-04-26T11:13:13.905010+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:46.082467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904998+0000","last_change":"2024-04-26T11:13:12.914549+0000","last_active":"2024-04-26T11:13:13.904998+0000","last_peered":"2024-04-26T11:13:13.904998+0000","last_clean":"2024-04-26T11:13:13.904998+0000","last_became_active":"2024-04-26T11:13:12.913041+0000","last_became_peered":"2024-04-26T11:13:12.913041+0000","last_unstale":"2024-04-26T11:13:13.904998+0000","last_undegraded":"2024-04-26T11:13:13.904998+0000","last_fullsized":"2024-04-26T11:13:13.904998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904654+0000","last_change":"2024-04-26T11:13:12.916942+0000","last_active":"2024-04-26T11:13:13.904654+0000","last_peered":"2024-04-26T11:13:13.904654+0000","last_clean":"2024-04-26T11:13:13.904654+0000","last_became_active":"2024-04-26T11:13:12.916144+0000","last_became_peered":"2024-04-26T11:13:12.916144+0000","last_unstale":"2024-04-26T11:13:13.904654+0000","last_undegraded":"2024-04-26T11:13:13.904654+0000","last_fullsized":"2024-04-26T11:13:13.904654+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:46.610126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904072+0000","last_change":"2024-04-26T11:13:12.913826+0000","last_active":"2024-04-26T11:13:13.904072+0000","last_peered":"2024-04-26T11:13:13.904072+0000","last_clean":"2024-04-26T11:13:13.904072+0000","last_became_active":"2024-04-26T11:13:12.912911+0000","last_became_peered":"2024-04-26T11:13:12.912911+0000","last_unstale":"2024-04-26T11:13:13.904072+0000","last_undegraded":"2024-04-26T11:13:13.904072+0000","last_fullsized":"2024-04-26T11:13:13.904072+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:10.887079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770469+0000","last_change":"2024-04-26T11:13:12.921818+0000","last_active":"2024-04-26T11:13:14.770469+0000","last_peered":"2024-04-26T11:13:14.770469+0000","last_clean":"2024-04-26T11:13:14.770469+0000","last_became_active":"2024-04-26T11:13:12.921526+0000","last_became_peered":"2024-04-26T11:13:12.921526+0000","last_unstale":"2024-04-26T11:13:14.770469+0000","last_undegraded":"2024-04-26T11:13:14.770469+0000","last_fullsized":"2024-04-26T11:13:14.770469+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:47.958725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904819+0000","last_change":"2024-04-26T11:13:12.912731+0000","last_active":"2024-04-26T11:13:13.904819+0000","last_peered":"2024-04-26T11:13:13.904819+0000","last_clean":"2024-04-26T11:13:13.904819+0000","last_became_active":"2024-04-26T11:13:12.911522+0000","last_became_peered":"2024-04-26T11:13:12.911522+0000","last_unstale":"2024-04-26T11:13:13.904819+0000","last_undegraded":"2024-04-26T11:13:13.904819+0000","last_fullsized":"2024-04-26T11:13:13.904819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:46.610126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770830+0000","last_change":"2024-04-26T11:13:12.919750+0000","last_active":"2024-04-26T11:13:14.770830+0000","last_peered":"2024-04-26T11:13:14.770830+0000","last_clean":"2024-04-26T11:13:14.770830+0000","last_became_active":"2024-04-26T11:13:12.919116+0000","last_became_peered":"2024-04-26T11:13:12.919116+0000","last_unstale":"2024-04-26T11:13:14.770830+0000","last_undegraded":"2024-04-26T11:13:14.770830+0000","last_fullsized":"2024-04-26T11:13:14.770830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:10.887079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":745472,"data_stored":637050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:13:21.692 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:13:22.057 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:22.059 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:13:22.069 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-26T11:13:20.452240+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":150,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86788,"kb_used_data":1604,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028732,"statfs":{"total":289910292480,"available":289821421568,"internally_reserved":0,"allocated":1642496,"data_stored":1322490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.970715"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771368+0000","last_change":"2024-04-26T11:13:12.919196+0000","last_active":"2024-04-26T11:13:14.771368+0000","last_peered":"2024-04-26T11:13:14.771368+0000","last_clean":"2024-04-26T11:13:14.771368+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:13:14.771368+0000","last_undegraded":"2024-04-26T11:13:14.771368+0000","last_fullsized":"2024-04-26T11:13:14.771368+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771085+0000","last_change":"2024-04-26T11:13:12.917670+0000","last_active":"2024-04-26T11:13:14.771085+0000","last_peered":"2024-04-26T11:13:14.771085+0000","last_clean":"2024-04-26T11:13:14.771085+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:13:14.771085+0000","last_undegraded":"2024-04-26T11:13:14.771085+0000","last_fullsized":"2024-04-26T11:13:14.771085+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905470+0000","last_change":"2024-04-26T11:13:12.922235+0000","last_active":"2024-04-26T11:13:13.905470+0000","last_peered":"2024-04-26T11:13:13.905470+0000","last_clean":"2024-04-26T11:13:13.905470+0000","last_became_active":"2024-04-26T11:13:12.919993+0000","last_became_peered":"2024-04-26T11:13:12.919993+0000","last_unstale":"2024-04-26T11:13:13.905470+0000","last_undegraded":"2024-04-26T11:13:13.905470+0000","last_fullsized":"2024-04-26T11:13:13.905470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:41.004462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905212+0000","last_change":"2024-04-26T11:13:12.916859+0000","last_active":"2024-04-26T11:13:13.905212+0000","last_peered":"2024-04-26T11:13:13.905212+0000","last_clean":"2024-04-26T11:13:13.905212+0000","last_became_active":"2024-04-26T11:13:12.915591+0000","last_became_peered":"2024-04-26T11:13:12.915591+0000","last_unstale":"2024-04-26T11:13:13.905212+0000","last_undegraded":"2024-04-26T11:13:13.905212+0000","last_fullsized":"2024-04-26T11:13:13.905212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:52.543148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770643+0000","last_change":"2024-04-26T11:13:12.917403+0000","last_active":"2024-04-26T11:13:14.770643+0000","last_peered":"2024-04-26T11:13:14.770643+0000","last_clean":"2024-04-26T11:13:14.770643+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:13:14.770643+0000","last_undegraded":"2024-04-26T11:13:14.770643+0000","last_fullsized":"2024-04-26T11:13:14.770643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:42.014955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904599+0000","last_change":"2024-04-26T11:13:12.918802+0000","last_active":"2024-04-26T11:13:13.904599+0000","last_peered":"2024-04-26T11:13:13.904599+0000","last_clean":"2024-04-26T11:13:13.904599+0000","last_became_active":"2024-04-26T11:13:12.917353+0000","last_became_peered":"2024-04-26T11:13:12.917353+0000","last_unstale":"2024-04-26T11:13:13.904599+0000","last_undegraded":"2024-04-26T11:13:13.904599+0000","last_fullsized":"2024-04-26T11:13:13.904599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:08.956085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904746+0000","last_change":"2024-04-26T11:13:12.916789+0000","last_active":"2024-04-26T11:13:13.904746+0000","last_peered":"2024-04-26T11:13:13.904746+0000","last_clean":"2024-04-26T11:13:13.904746+0000","last_became_active":"2024-04-26T11:13:12.914947+0000","last_became_peered":"2024-04-26T11:13:12.914947+0000","last_unstale":"2024-04-26T11:13:13.904746+0000","last_undegraded":"2024-04-26T11:13:13.904746+0000","last_fullsized":"2024-04-26T11:13:13.904746+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904343+0000","last_change":"2024-04-26T11:13:12.919968+0000","last_active":"2024-04-26T11:13:13.904343+0000","last_peered":"2024-04-26T11:13:13.904343+0000","last_clean":"2024-04-26T11:13:13.904343+0000","last_became_active":"2024-04-26T11:13:12.918600+0000","last_became_peered":"2024-04-26T11:13:12.918600+0000","last_unstale":"2024-04-26T11:13:13.904343+0000","last_undegraded":"2024-04-26T11:13:13.904343+0000","last_fullsized":"2024-04-26T11:13:13.904343+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:41.073901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904753+0000","last_change":"2024-04-26T11:13:12.914649+0000","last_active":"2024-04-26T11:13:13.904753+0000","last_peered":"2024-04-26T11:13:13.904753+0000","last_clean":"2024-04-26T11:13:13.904753+0000","last_became_active":"2024-04-26T11:13:12.914174+0000","last_became_peered":"2024-04-26T11:13:12.914174+0000","last_unstale":"2024-04-26T11:13:13.904753+0000","last_undegraded":"2024-04-26T11:13:13.904753+0000","last_fullsized":"2024-04-26T11:13:13.904753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:41.004462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771235+0000","last_change":"2024-04-26T11:13:12.918521+0000","last_active":"2024-04-26T11:13:14.771235+0000","last_peered":"2024-04-26T11:13:14.771235+0000","last_clean":"2024-04-26T11:13:14.771235+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:13:14.771235+0000","last_undegraded":"2024-04-26T11:13:14.771235+0000","last_fullsized":"2024-04-26T11:13:14.771235+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905226+0000","last_change":"2024-04-26T11:13:12.922456+0000","last_active":"2024-04-26T11:13:13.905226+0000","last_peered":"2024-04-26T11:13:13.905226+0000","last_clean":"2024-04-26T11:13:13.905226+0000","last_became_active":"2024-04-26T11:13:12.921230+0000","last_became_peered":"2024-04-26T11:13:12.921230+0000","last_unstale":"2024-04-26T11:13:13.905226+0000","last_undegraded":"2024-04-26T11:13:13.905226+0000","last_fullsized":"2024-04-26T11:13:13.905226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:55.318150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770399+0000","last_change":"2024-04-26T11:13:12.914082+0000","last_active":"2024-04-26T11:13:14.770399+0000","last_peered":"2024-04-26T11:13:14.770399+0000","last_clean":"2024-04-26T11:13:14.770399+0000","last_became_active":"2024-04-26T11:13:12.913374+0000","last_became_peered":"2024-04-26T11:13:12.913374+0000","last_unstale":"2024-04-26T11:13:14.770399+0000","last_undegraded":"2024-04-26T11:13:14.770399+0000","last_fullsized":"2024-04-26T11:13:14.770399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:52.543148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770460+0000","last_change":"2024-04-26T11:13:12.915484+0000","last_active":"2024-04-26T11:13:14.770460+0000","last_peered":"2024-04-26T11:13:14.770460+0000","last_clean":"2024-04-26T11:13:14.770460+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:13:14.770460+0000","last_undegraded":"2024-04-26T11:13:14.770460+0000","last_fullsized":"2024-04-26T11:13:14.770460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905148+0000","last_change":"2024-04-26T11:13:12.914318+0000","last_active":"2024-04-26T11:13:13.905148+0000","last_peered":"2024-04-26T11:13:13.905148+0000","last_clean":"2024-04-26T11:13:13.905148+0000","last_became_active":"2024-04-26T11:13:12.913437+0000","last_became_peered":"2024-04-26T11:13:12.913437+0000","last_unstale":"2024-04-26T11:13:13.905148+0000","last_undegraded":"2024-04-26T11:13:13.905148+0000","last_fullsized":"2024-04-26T11:13:13.905148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904484+0000","last_change":"2024-04-26T11:13:12.914523+0000","last_active":"2024-04-26T11:13:13.904484+0000","last_peered":"2024-04-26T11:13:13.904484+0000","last_clean":"2024-04-26T11:13:13.904484+0000","last_became_active":"2024-04-26T11:13:12.913241+0000","last_became_peered":"2024-04-26T11:13:12.913241+0000","last_unstale":"2024-04-26T11:13:13.904484+0000","last_undegraded":"2024-04-26T11:13:13.904484+0000","last_fullsized":"2024-04-26T11:13:13.904484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:10.887079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904389+0000","last_change":"2024-04-26T11:13:12.922145+0000","last_active":"2024-04-26T11:13:13.904389+0000","last_peered":"2024-04-26T11:13:13.904389+0000","last_clean":"2024-04-26T11:13:13.904389+0000","last_became_active":"2024-04-26T11:13:12.919048+0000","last_became_peered":"2024-04-26T11:13:12.919048+0000","last_unstale":"2024-04-26T11:13:13.904389+0000","last_undegraded":"2024-04-26T11:13:13.904389+0000","last_fullsized":"2024-04-26T11:13:13.904389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:47.958725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904823+0000","last_change":"2024-04-26T11:13:12.914484+0000","last_active":"2024-04-26T11:13:13.904823+0000","last_peered":"2024-04-26T11:13:13.904823+0000","last_clean":"2024-04-26T11:13:13.904823+0000","last_became_active":"2024-04-26T11:13:12.913596+0000","last_became_peered":"2024-04-26T11:13:12.913596+0000","last_unstale":"2024-04-26T11:13:13.904823+0000","last_undegraded":"2024-04-26T11:13:13.904823+0000","last_fullsized":"2024-04-26T11:13:13.904823+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:38.001491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771320+0000","last_change":"2024-04-26T11:13:12.918759+0000","last_active":"2024-04-26T11:13:14.771320+0000","last_peered":"2024-04-26T11:13:14.771320+0000","last_clean":"2024-04-26T11:13:14.771320+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:13:14.771320+0000","last_undegraded":"2024-04-26T11:13:14.771320+0000","last_fullsized":"2024-04-26T11:13:14.771320+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:55.002972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904592+0000","last_change":"2024-04-26T11:13:12.917334+0000","last_active":"2024-04-26T11:13:13.904592+0000","last_peered":"2024-04-26T11:13:13.904592+0000","last_clean":"2024-04-26T11:13:13.904592+0000","last_became_active":"2024-04-26T11:13:12.917010+0000","last_became_peered":"2024-04-26T11:13:12.917010+0000","last_unstale":"2024-04-26T11:13:13.904592+0000","last_undegraded":"2024-04-26T11:13:13.904592+0000","last_fullsized":"2024-04-26T11:13:13.904592+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:52.543148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905177+0000","last_change":"2024-04-26T11:13:12.917519+0000","last_active":"2024-04-26T11:13:13.905177+0000","last_peered":"2024-04-26T11:13:13.905177+0000","last_clean":"2024-04-26T11:13:13.905177+0000","last_became_active":"2024-04-26T11:13:12.916985+0000","last_became_peered":"2024-04-26T11:13:12.916985+0000","last_unstale":"2024-04-26T11:13:13.905177+0000","last_undegraded":"2024-04-26T11:13:13.905177+0000","last_fullsized":"2024-04-26T11:13:13.905177+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:38.001491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904702+0000","last_change":"2024-04-26T11:13:12.919641+0000","last_active":"2024-04-26T11:13:13.904702+0000","last_peered":"2024-04-26T11:13:13.904702+0000","last_clean":"2024-04-26T11:13:13.904702+0000","last_became_active":"2024-04-26T11:13:12.918830+0000","last_became_peered":"2024-04-26T11:13:12.918830+0000","last_unstale":"2024-04-26T11:13:13.904702+0000","last_undegraded":"2024-04-26T11:13:13.904702+0000","last_fullsized":"2024-04-26T11:13:13.904702+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:52.714816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770332+0000","last_change":"2024-04-26T11:13:12.914087+0000","last_active":"2024-04-26T11:13:14.770332+0000","last_peered":"2024-04-26T11:13:14.770332+0000","last_clean":"2024-04-26T11:13:14.770332+0000","last_became_active":"2024-04-26T11:13:12.913393+0000","last_became_peered":"2024-04-26T11:13:12.913393+0000","last_unstale":"2024-04-26T11:13:14.770332+0000","last_undegraded":"2024-04-26T11:13:14.770332+0000","last_fullsized":"2024-04-26T11:13:14.770332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:38.001491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.903953+0000","last_change":"2024-04-26T11:13:12.918407+0000","last_active":"2024-04-26T11:13:13.903953+0000","last_peered":"2024-04-26T11:13:13.903953+0000","last_clean":"2024-04-26T11:13:13.903953+0000","last_became_active":"2024-04-26T11:13:12.918176+0000","last_became_peered":"2024-04-26T11:13:12.918176+0000","last_unstale":"2024-04-26T11:13:13.903953+0000","last_undegraded":"2024-04-26T11:13:13.903953+0000","last_fullsized":"2024-04-26T11:13:13.903953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770185+0000","last_change":"2024-04-26T11:13:12.912756+0000","last_active":"2024-04-26T11:13:14.770185+0000","last_peered":"2024-04-26T11:13:14.770185+0000","last_clean":"2024-04-26T11:13:14.770185+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:13:14.770185+0000","last_undegraded":"2024-04-26T11:13:14.770185+0000","last_fullsized":"2024-04-26T11:13:14.770185+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:04.177831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771368+0000","last_change":"2024-04-26T11:13:12.920122+0000","last_active":"2024-04-26T11:13:14.771368+0000","last_peered":"2024-04-26T11:13:14.771368+0000","last_clean":"2024-04-26T11:13:14.771368+0000","last_became_active":"2024-04-26T11:13:12.919792+0000","last_became_peered":"2024-04-26T11:13:12.919792+0000","last_unstale":"2024-04-26T11:13:14.771368+0000","last_undegraded":"2024-04-26T11:13:14.771368+0000","last_fullsized":"2024-04-26T11:13:14.771368+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:54.809926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904864+0000","last_change":"2024-04-26T11:13:12.912803+0000","last_active":"2024-04-26T11:13:13.904864+0000","last_peered":"2024-04-26T11:13:13.904864+0000","last_clean":"2024-04-26T11:13:13.904864+0000","last_became_active":"2024-04-26T11:13:12.912254+0000","last_became_peered":"2024-04-26T11:13:12.912254+0000","last_unstale":"2024-04-26T11:13:13.904864+0000","last_undegraded":"2024-04-26T11:13:13.904864+0000","last_fullsized":"2024-04-26T11:13:13.904864+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:11.313582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905305+0000","last_change":"2024-04-26T11:13:12.921062+0000","last_active":"2024-04-26T11:13:13.905305+0000","last_peered":"2024-04-26T11:13:13.905305+0000","last_clean":"2024-04-26T11:13:13.905305+0000","last_became_active":"2024-04-26T11:13:12.918716+0000","last_became_peered":"2024-04-26T11:13:12.918716+0000","last_unstale":"2024-04-26T11:13:13.905305+0000","last_undegraded":"2024-04-26T11:13:13.905305+0000","last_fullsized":"2024-04-26T11:13:13.905305+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:55.576807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770220+0000","last_change":"2024-04-26T11:13:12.493425+0000","last_active":"2024-04-26T11:13:14.770220+0000","last_peered":"2024-04-26T11:13:14.770220+0000","last_clean":"2024-04-26T11:13:14.770220+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:13:14.770220+0000","last_undegraded":"2024-04-26T11:13:14.770220+0000","last_fullsized":"2024-04-26T11:13:14.770220+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:23.279580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771122+0000","last_change":"2024-04-26T11:13:12.918515+0000","last_active":"2024-04-26T11:13:14.771122+0000","last_peered":"2024-04-26T11:13:14.771122+0000","last_clean":"2024-04-26T11:13:14.771122+0000","last_became_active":"2024-04-26T11:13:12.918002+0000","last_became_peered":"2024-04-26T11:13:12.918002+0000","last_unstale":"2024-04-26T11:13:14.771122+0000","last_undegraded":"2024-04-26T11:13:14.771122+0000","last_fullsized":"2024-04-26T11:13:14.771122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:46.610126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904192+0000","last_change":"2024-04-26T11:13:12.490257+0000","last_active":"2024-04-26T11:13:13.904192+0000","last_peered":"2024-04-26T11:13:13.904192+0000","last_clean":"2024-04-26T11:13:13.904192+0000","last_became_active":"2024-04-26T11:13:12.488819+0000","last_became_peered":"2024-04-26T11:13:12.488819+0000","last_unstale":"2024-04-26T11:13:13.904192+0000","last_undegraded":"2024-04-26T11:13:13.904192+0000","last_fullsized":"2024-04-26T11:13:13.904192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:52.644533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904995+0000","last_change":"2024-04-26T11:13:12.915624+0000","last_active":"2024-04-26T11:13:13.904995+0000","last_peered":"2024-04-26T11:13:13.904995+0000","last_clean":"2024-04-26T11:13:13.904995+0000","last_became_active":"2024-04-26T11:13:12.915375+0000","last_became_peered":"2024-04-26T11:13:12.915375+0000","last_unstale":"2024-04-26T11:13:13.904995+0000","last_undegraded":"2024-04-26T11:13:13.904995+0000","last_fullsized":"2024-04-26T11:13:13.904995+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:28.908758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904382+0000","last_change":"2024-04-26T11:13:12.487990+0000","last_active":"2024-04-26T11:13:13.904382+0000","last_peered":"2024-04-26T11:13:13.904382+0000","last_clean":"2024-04-26T11:13:13.904382+0000","last_became_active":"2024-04-26T11:13:12.486848+0000","last_became_peered":"2024-04-26T11:13:12.486848+0000","last_unstale":"2024-04-26T11:13:13.904382+0000","last_undegraded":"2024-04-26T11:13:13.904382+0000","last_fullsized":"2024-04-26T11:13:13.904382+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:56.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771304+0000","last_change":"2024-04-26T11:13:12.917423+0000","last_active":"2024-04-26T11:13:14.771304+0000","last_peered":"2024-04-26T11:13:14.771304+0000","last_clean":"2024-04-26T11:13:14.771304+0000","last_became_active":"2024-04-26T11:13:12.916811+0000","last_became_peered":"2024-04-26T11:13:12.916811+0000","last_unstale":"2024-04-26T11:13:14.771304+0000","last_undegraded":"2024-04-26T11:13:14.771304+0000","last_fullsized":"2024-04-26T11:13:14.771304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:28.908758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905043+0000","last_change":"2024-04-26T11:13:12.490251+0000","last_active":"2024-04-26T11:13:13.905043+0000","last_peered":"2024-04-26T11:13:13.905043+0000","last_clean":"2024-04-26T11:13:13.905043+0000","last_became_active":"2024-04-26T11:13:12.489836+0000","last_became_peered":"2024-04-26T11:13:12.489836+0000","last_unstale":"2024-04-26T11:13:13.905043+0000","last_undegraded":"2024-04-26T11:13:13.905043+0000","last_fullsized":"2024-04-26T11:13:13.905043+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:42.000159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.903972+0000","last_change":"2024-04-26T11:13:12.912865+0000","last_active":"2024-04-26T11:13:13.903972+0000","last_peered":"2024-04-26T11:13:13.903972+0000","last_clean":"2024-04-26T11:13:13.903972+0000","last_became_active":"2024-04-26T11:13:12.912397+0000","last_became_peered":"2024-04-26T11:13:12.912397+0000","last_unstale":"2024-04-26T11:13:13.903972+0000","last_undegraded":"2024-04-26T11:13:13.903972+0000","last_fullsized":"2024-04-26T11:13:13.903972+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905218+0000","last_change":"2024-04-26T11:13:12.493118+0000","last_active":"2024-04-26T11:13:13.905218+0000","last_peered":"2024-04-26T11:13:13.905218+0000","last_clean":"2024-04-26T11:13:13.905218+0000","last_became_active":"2024-04-26T11:13:12.492799+0000","last_became_peered":"2024-04-26T11:13:12.492799+0000","last_unstale":"2024-04-26T11:13:13.905218+0000","last_undegraded":"2024-04-26T11:13:13.905218+0000","last_fullsized":"2024-04-26T11:13:13.905218+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:46.082467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904510+0000","last_change":"2024-04-26T11:13:12.918149+0000","last_active":"2024-04-26T11:13:13.904510+0000","last_peered":"2024-04-26T11:13:13.904510+0000","last_clean":"2024-04-26T11:13:13.904510+0000","last_became_active":"2024-04-26T11:13:12.917636+0000","last_became_peered":"2024-04-26T11:13:12.917636+0000","last_unstale":"2024-04-26T11:13:13.904510+0000","last_undegraded":"2024-04-26T11:13:13.904510+0000","last_fullsized":"2024-04-26T11:13:13.904510+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:20.837217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770906+0000","last_change":"2024-04-26T11:13:12.495785+0000","last_active":"2024-04-26T11:13:14.770906+0000","last_peered":"2024-04-26T11:13:14.770906+0000","last_clean":"2024-04-26T11:13:14.770906+0000","last_became_active":"2024-04-26T11:13:12.495527+0000","last_became_peered":"2024-04-26T11:13:12.495527+0000","last_unstale":"2024-04-26T11:13:14.770906+0000","last_undegraded":"2024-04-26T11:13:14.770906+0000","last_fullsized":"2024-04-26T11:13:14.770906+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:45.374565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904416+0000","last_change":"2024-04-26T11:13:12.913698+0000","last_active":"2024-04-26T11:13:13.904416+0000","last_peered":"2024-04-26T11:13:13.904416+0000","last_clean":"2024-04-26T11:13:13.904416+0000","last_became_active":"2024-04-26T11:13:12.913198+0000","last_became_peered":"2024-04-26T11:13:12.913198+0000","last_unstale":"2024-04-26T11:13:13.904416+0000","last_undegraded":"2024-04-26T11:13:13.904416+0000","last_fullsized":"2024-04-26T11:13:13.904416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905059+0000","last_change":"2024-04-26T11:13:12.492878+0000","last_active":"2024-04-26T11:13:13.905059+0000","last_peered":"2024-04-26T11:13:13.905059+0000","last_clean":"2024-04-26T11:13:13.905059+0000","last_became_active":"2024-04-26T11:13:12.491690+0000","last_became_peered":"2024-04-26T11:13:12.491690+0000","last_unstale":"2024-04-26T11:13:13.905059+0000","last_undegraded":"2024-04-26T11:13:13.905059+0000","last_fullsized":"2024-04-26T11:13:13.905059+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:12.581788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905197+0000","last_change":"2024-04-26T11:13:12.916914+0000","last_active":"2024-04-26T11:13:13.905197+0000","last_peered":"2024-04-26T11:13:13.905197+0000","last_clean":"2024-04-26T11:13:13.905197+0000","last_became_active":"2024-04-26T11:13:12.913900+0000","last_became_peered":"2024-04-26T11:13:12.913900+0000","last_unstale":"2024-04-26T11:13:13.905197+0000","last_undegraded":"2024-04-26T11:13:13.905197+0000","last_fullsized":"2024-04-26T11:13:13.905197+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:28.908758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905107+0000","last_change":"2024-04-26T11:13:12.493445+0000","last_active":"2024-04-26T11:13:13.905107+0000","last_peered":"2024-04-26T11:13:13.905107+0000","last_clean":"2024-04-26T11:13:13.905107+0000","last_became_active":"2024-04-26T11:13:12.493015+0000","last_became_peered":"2024-04-26T11:13:12.493015+0000","last_unstale":"2024-04-26T11:13:13.905107+0000","last_undegraded":"2024-04-26T11:13:13.905107+0000","last_fullsized":"2024-04-26T11:13:13.905107+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:17.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770711+0000","last_change":"2024-04-26T11:13:12.916685+0000","last_active":"2024-04-26T11:13:14.770711+0000","last_peered":"2024-04-26T11:13:14.770711+0000","last_clean":"2024-04-26T11:13:14.770711+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:13:14.770711+0000","last_undegraded":"2024-04-26T11:13:14.770711+0000","last_fullsized":"2024-04-26T11:13:14.770711+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904543+0000","last_change":"2024-04-26T11:13:12.491438+0000","last_active":"2024-04-26T11:13:13.904543+0000","last_peered":"2024-04-26T11:13:13.904543+0000","last_clean":"2024-04-26T11:13:13.904543+0000","last_became_active":"2024-04-26T11:13:12.490515+0000","last_became_peered":"2024-04-26T11:13:12.490515+0000","last_unstale":"2024-04-26T11:13:13.904543+0000","last_undegraded":"2024-04-26T11:13:13.904543+0000","last_fullsized":"2024-04-26T11:13:13.904543+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:11.480844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770974+0000","last_change":"2024-04-26T11:13:12.915238+0000","last_active":"2024-04-26T11:13:14.770974+0000","last_peered":"2024-04-26T11:13:14.770974+0000","last_clean":"2024-04-26T11:13:14.770974+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:13:14.770974+0000","last_undegraded":"2024-04-26T11:13:14.770974+0000","last_fullsized":"2024-04-26T11:13:14.770974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:48.068465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770266+0000","last_change":"2024-04-26T11:13:12.492682+0000","last_active":"2024-04-26T11:13:14.770266+0000","last_peered":"2024-04-26T11:13:14.770266+0000","last_clean":"2024-04-26T11:13:14.770266+0000","last_became_active":"2024-04-26T11:13:12.492346+0000","last_became_peered":"2024-04-26T11:13:12.492346+0000","last_unstale":"2024-04-26T11:13:14.770266+0000","last_undegraded":"2024-04-26T11:13:14.770266+0000","last_fullsized":"2024-04-26T11:13:14.770266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:28.034755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905121+0000","last_change":"2024-04-26T11:13:12.913671+0000","last_active":"2024-04-26T11:13:13.905121+0000","last_peered":"2024-04-26T11:13:13.905121+0000","last_clean":"2024-04-26T11:13:13.905121+0000","last_became_active":"2024-04-26T11:13:12.913264+0000","last_became_peered":"2024-04-26T11:13:12.913264+0000","last_unstale":"2024-04-26T11:13:13.905121+0000","last_undegraded":"2024-04-26T11:13:13.905121+0000","last_fullsized":"2024-04-26T11:13:13.905121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904759+0000","last_change":"2024-04-26T11:13:12.492802+0000","last_active":"2024-04-26T11:13:13.904759+0000","last_peered":"2024-04-26T11:13:13.904759+0000","last_clean":"2024-04-26T11:13:13.904759+0000","last_became_active":"2024-04-26T11:13:12.491774+0000","last_became_peered":"2024-04-26T11:13:12.491774+0000","last_unstale":"2024-04-26T11:13:13.904759+0000","last_undegraded":"2024-04-26T11:13:13.904759+0000","last_fullsized":"2024-04-26T11:13:13.904759+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:05.413010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905139+0000","last_change":"2024-04-26T11:13:12.915666+0000","last_active":"2024-04-26T11:13:13.905139+0000","last_peered":"2024-04-26T11:13:13.905139+0000","last_clean":"2024-04-26T11:13:13.905139+0000","last_became_active":"2024-04-26T11:13:12.915393+0000","last_became_peered":"2024-04-26T11:13:12.915393+0000","last_unstale":"2024-04-26T11:13:13.905139+0000","last_undegraded":"2024-04-26T11:13:13.905139+0000","last_fullsized":"2024-04-26T11:13:13.905139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905455+0000","last_change":"2024-04-26T11:13:12.491934+0000","last_active":"2024-04-26T11:13:13.905455+0000","last_peered":"2024-04-26T11:13:13.905455+0000","last_clean":"2024-04-26T11:13:13.905455+0000","last_became_active":"2024-04-26T11:13:12.491262+0000","last_became_peered":"2024-04-26T11:13:12.491262+0000","last_unstale":"2024-04-26T11:13:13.905455+0000","last_undegraded":"2024-04-26T11:13:13.905455+0000","last_fullsized":"2024-04-26T11:13:13.905455+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:11.480844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.769967+0000","last_change":"2024-04-26T11:13:12.920072+0000","last_active":"2024-04-26T11:13:14.769967+0000","last_peered":"2024-04-26T11:13:14.769967+0000","last_clean":"2024-04-26T11:13:14.769967+0000","last_became_active":"2024-04-26T11:13:12.919233+0000","last_became_peered":"2024-04-26T11:13:12.919233+0000","last_unstale":"2024-04-26T11:13:14.769967+0000","last_undegraded":"2024-04-26T11:13:14.769967+0000","last_fullsized":"2024-04-26T11:13:14.769967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:41.004462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771109+0000","last_change":"2024-04-26T11:13:12.493060+0000","last_active":"2024-04-26T11:13:14.771109+0000","last_peered":"2024-04-26T11:13:14.771109+0000","last_clean":"2024-04-26T11:13:14.771109+0000","last_became_active":"2024-04-26T11:13:12.492519+0000","last_became_peered":"2024-04-26T11:13:12.492519+0000","last_unstale":"2024-04-26T11:13:14.771109+0000","last_undegraded":"2024-04-26T11:13:14.771109+0000","last_fullsized":"2024-04-26T11:13:14.771109+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:48.928740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770525+0000","last_change":"2024-04-26T11:13:12.912207+0000","last_active":"2024-04-26T11:13:14.770525+0000","last_peered":"2024-04-26T11:13:14.770525+0000","last_clean":"2024-04-26T11:13:14.770525+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:13:14.770525+0000","last_undegraded":"2024-04-26T11:13:14.770525+0000","last_fullsized":"2024-04-26T11:13:14.770525+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905410+0000","last_change":"2024-04-26T11:13:12.492772+0000","last_active":"2024-04-26T11:13:13.905410+0000","last_peered":"2024-04-26T11:13:13.905410+0000","last_clean":"2024-04-26T11:13:13.905410+0000","last_became_active":"2024-04-26T11:13:12.491901+0000","last_became_peered":"2024-04-26T11:13:12.491901+0000","last_unstale":"2024-04-26T11:13:13.905410+0000","last_undegraded":"2024-04-26T11:13:13.905410+0000","last_fullsized":"2024-04-26T11:13:13.905410+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:45.693017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904852+0000","last_change":"2024-04-26T11:13:12.919749+0000","last_active":"2024-04-26T11:13:13.904852+0000","last_peered":"2024-04-26T11:13:13.904852+0000","last_clean":"2024-04-26T11:13:13.904852+0000","last_became_active":"2024-04-26T11:13:12.917479+0000","last_became_peered":"2024-04-26T11:13:12.917479+0000","last_unstale":"2024-04-26T11:13:13.904852+0000","last_undegraded":"2024-04-26T11:13:13.904852+0000","last_fullsized":"2024-04-26T11:13:13.904852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:12.483631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904944+0000","last_change":"2024-04-26T11:13:12.495144+0000","last_active":"2024-04-26T11:13:13.904944+0000","last_peered":"2024-04-26T11:13:13.904944+0000","last_clean":"2024-04-26T11:13:13.904944+0000","last_became_active":"2024-04-26T11:13:12.494510+0000","last_became_peered":"2024-04-26T11:13:12.494510+0000","last_unstale":"2024-04-26T11:13:13.904944+0000","last_undegraded":"2024-04-26T11:13:13.904944+0000","last_fullsized":"2024-04-26T11:13:13.904944+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:00.146717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904907+0000","last_change":"2024-04-26T11:13:12.913350+0000","last_active":"2024-04-26T11:13:13.904907+0000","last_peered":"2024-04-26T11:13:13.904907+0000","last_clean":"2024-04-26T11:13:13.904907+0000","last_became_active":"2024-04-26T11:13:12.912991+0000","last_became_peered":"2024-04-26T11:13:12.912991+0000","last_unstale":"2024-04-26T11:13:13.904907+0000","last_undegraded":"2024-04-26T11:13:13.904907+0000","last_fullsized":"2024-04-26T11:13:13.904907+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:54.809926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904432+0000","last_change":"2024-04-26T11:13:12.490343+0000","last_active":"2024-04-26T11:13:13.904432+0000","last_peered":"2024-04-26T11:13:13.904432+0000","last_clean":"2024-04-26T11:13:13.904432+0000","last_became_active":"2024-04-26T11:13:12.490027+0000","last_became_peered":"2024-04-26T11:13:12.490027+0000","last_unstale":"2024-04-26T11:13:13.904432+0000","last_undegraded":"2024-04-26T11:13:13.904432+0000","last_fullsized":"2024-04-26T11:13:13.904432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:45.693017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904814+0000","last_change":"2024-04-26T11:13:12.918774+0000","last_active":"2024-04-26T11:13:13.904814+0000","last_peered":"2024-04-26T11:13:13.904814+0000","last_clean":"2024-04-26T11:13:13.904814+0000","last_became_active":"2024-04-26T11:13:12.917269+0000","last_became_peered":"2024-04-26T11:13:12.917269+0000","last_unstale":"2024-04-26T11:13:13.904814+0000","last_undegraded":"2024-04-26T11:13:13.904814+0000","last_fullsized":"2024-04-26T11:13:13.904814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:33.358984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904745+0000","last_change":"2024-04-26T11:13:12.494689+0000","last_active":"2024-04-26T11:13:13.904745+0000","last_peered":"2024-04-26T11:13:13.904745+0000","last_clean":"2024-04-26T11:13:13.904745+0000","last_became_active":"2024-04-26T11:13:12.494236+0000","last_became_peered":"2024-04-26T11:13:12.494236+0000","last_unstale":"2024-04-26T11:13:13.904745+0000","last_undegraded":"2024-04-26T11:13:13.904745+0000","last_fullsized":"2024-04-26T11:13:13.904745+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:42.000159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905618+0000","last_change":"2024-04-26T11:13:12.919985+0000","last_active":"2024-04-26T11:13:13.905618+0000","last_peered":"2024-04-26T11:13:13.905618+0000","last_clean":"2024-04-26T11:13:13.905618+0000","last_became_active":"2024-04-26T11:13:12.916239+0000","last_became_peered":"2024-04-26T11:13:12.916239+0000","last_unstale":"2024-04-26T11:13:13.905618+0000","last_undegraded":"2024-04-26T11:13:13.905618+0000","last_fullsized":"2024-04-26T11:13:13.905618+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:54.809926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770064+0000","last_change":"2024-04-26T11:13:12.492856+0000","last_active":"2024-04-26T11:13:14.770064+0000","last_peered":"2024-04-26T11:13:14.770064+0000","last_clean":"2024-04-26T11:13:14.770064+0000","last_became_active":"2024-04-26T11:13:12.492412+0000","last_became_peered":"2024-04-26T11:13:12.492412+0000","last_unstale":"2024-04-26T11:13:14.770064+0000","last_undegraded":"2024-04-26T11:13:14.770064+0000","last_fullsized":"2024-04-26T11:13:14.770064+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:09.572402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905480+0000","last_change":"2024-04-26T11:13:12.920056+0000","last_active":"2024-04-26T11:13:13.905480+0000","last_peered":"2024-04-26T11:13:13.905480+0000","last_clean":"2024-04-26T11:13:13.905480+0000","last_became_active":"2024-04-26T11:13:12.919049+0000","last_became_peered":"2024-04-26T11:13:12.919049+0000","last_unstale":"2024-04-26T11:13:13.905480+0000","last_undegraded":"2024-04-26T11:13:13.905480+0000","last_fullsized":"2024-04-26T11:13:13.905480+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770130+0000","last_change":"2024-04-26T11:13:12.493217+0000","last_active":"2024-04-26T11:13:14.770130+0000","last_peered":"2024-04-26T11:13:14.770130+0000","last_clean":"2024-04-26T11:13:14.770130+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:13:14.770130+0000","last_undegraded":"2024-04-26T11:13:14.770130+0000","last_fullsized":"2024-04-26T11:13:14.770130+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:00.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904940+0000","last_change":"2024-04-26T11:13:12.914321+0000","last_active":"2024-04-26T11:13:13.904940+0000","last_peered":"2024-04-26T11:13:13.904940+0000","last_clean":"2024-04-26T11:13:13.904940+0000","last_became_active":"2024-04-26T11:13:12.913543+0000","last_became_peered":"2024-04-26T11:13:12.913543+0000","last_unstale":"2024-04-26T11:13:13.904940+0000","last_undegraded":"2024-04-26T11:13:13.904940+0000","last_fullsized":"2024-04-26T11:13:13.904940+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.903582+0000","last_change":"2024-04-26T11:13:08.113095+0000","last_active":"2024-04-26T11:13:12.903582+0000","last_peered":"2024-04-26T11:13:12.903582+0000","last_clean":"2024-04-26T11:13:12.903582+0000","last_became_active":"2024-04-26T11:13:08.112778+0000","last_became_peered":"2024-04-26T11:13:08.112778+0000","last_unstale":"2024-04-26T11:13:12.903582+0000","last_undegraded":"2024-04-26T11:13:12.903582+0000","last_fullsized":"2024-04-26T11:13:12.903582+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:41.705893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905517+0000","last_change":"2024-04-26T11:13:12.493960+0000","last_active":"2024-04-26T11:13:13.905517+0000","last_peered":"2024-04-26T11:13:13.905517+0000","last_clean":"2024-04-26T11:13:13.905517+0000","last_became_active":"2024-04-26T11:13:12.493087+0000","last_became_peered":"2024-04-26T11:13:12.493087+0000","last_unstale":"2024-04-26T11:13:13.905517+0000","last_undegraded":"2024-04-26T11:13:13.905517+0000","last_fullsized":"2024-04-26T11:13:13.905517+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:19.538082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770546+0000","last_change":"2024-04-26T11:13:12.917458+0000","last_active":"2024-04-26T11:13:14.770546+0000","last_peered":"2024-04-26T11:13:14.770546+0000","last_clean":"2024-04-26T11:13:14.770546+0000","last_became_active":"2024-04-26T11:13:12.916792+0000","last_became_peered":"2024-04-26T11:13:12.916792+0000","last_unstale":"2024-04-26T11:13:14.770546+0000","last_undegraded":"2024-04-26T11:13:14.770546+0000","last_fullsized":"2024-04-26T11:13:14.770546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:12.483631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.913665+0000","last_change":"2024-04-26T11:13:08.112744+0000","last_active":"2024-04-26T11:13:12.913665+0000","last_peered":"2024-04-26T11:13:12.913665+0000","last_clean":"2024-04-26T11:13:12.913665+0000","last_became_active":"2024-04-26T11:13:08.112498+0000","last_became_peered":"2024-04-26T11:13:08.112498+0000","last_unstale":"2024-04-26T11:13:12.913665+0000","last_undegraded":"2024-04-26T11:13:12.913665+0000","last_fullsized":"2024-04-26T11:13:12.913665+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:38.407116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904845+0000","last_change":"2024-04-26T11:13:12.494137+0000","last_active":"2024-04-26T11:13:13.904845+0000","last_peered":"2024-04-26T11:13:13.904845+0000","last_clean":"2024-04-26T11:13:13.904845+0000","last_became_active":"2024-04-26T11:13:12.493447+0000","last_became_peered":"2024-04-26T11:13:12.493447+0000","last_unstale":"2024-04-26T11:13:13.904845+0000","last_undegraded":"2024-04-26T11:13:13.904845+0000","last_fullsized":"2024-04-26T11:13:13.904845+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:52.644533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904572+0000","last_change":"2024-04-26T11:13:12.912553+0000","last_active":"2024-04-26T11:13:13.904572+0000","last_peered":"2024-04-26T11:13:13.904572+0000","last_clean":"2024-04-26T11:13:13.904572+0000","last_became_active":"2024-04-26T11:13:12.912022+0000","last_became_peered":"2024-04-26T11:13:12.912022+0000","last_unstale":"2024-04-26T11:13:13.904572+0000","last_undegraded":"2024-04-26T11:13:13.904572+0000","last_fullsized":"2024-04-26T11:13:13.904572+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.903369+0000","last_change":"2024-04-26T11:13:08.113650+0000","last_active":"2024-04-26T11:13:12.903369+0000","last_peered":"2024-04-26T11:13:12.903369+0000","last_clean":"2024-04-26T11:13:12.903369+0000","last_became_active":"2024-04-26T11:13:08.113394+0000","last_became_peered":"2024-04-26T11:13:08.113394+0000","last_unstale":"2024-04-26T11:13:12.903369+0000","last_undegraded":"2024-04-26T11:13:12.903369+0000","last_fullsized":"2024-04-26T11:13:12.903369+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:44.642172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770074+0000","last_change":"2024-04-26T11:13:12.492888+0000","last_active":"2024-04-26T11:13:14.770074+0000","last_peered":"2024-04-26T11:13:14.770074+0000","last_clean":"2024-04-26T11:13:14.770074+0000","last_became_active":"2024-04-26T11:13:12.492274+0000","last_became_peered":"2024-04-26T11:13:12.492274+0000","last_unstale":"2024-04-26T11:13:14.770074+0000","last_undegraded":"2024-04-26T11:13:14.770074+0000","last_fullsized":"2024-04-26T11:13:14.770074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:51.136157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905114+0000","last_change":"2024-04-26T11:13:12.914599+0000","last_active":"2024-04-26T11:13:13.905114+0000","last_peered":"2024-04-26T11:13:13.905114+0000","last_clean":"2024-04-26T11:13:13.905114+0000","last_became_active":"2024-04-26T11:13:12.913916+0000","last_became_peered":"2024-04-26T11:13:12.913916+0000","last_unstale":"2024-04-26T11:13:13.905114+0000","last_undegraded":"2024-04-26T11:13:13.905114+0000","last_fullsized":"2024-04-26T11:13:13.905114+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.915840+0000","last_change":"2024-04-26T11:13:08.112690+0000","last_active":"2024-04-26T11:13:12.915840+0000","last_peered":"2024-04-26T11:13:12.915840+0000","last_clean":"2024-04-26T11:13:12.915840+0000","last_became_active":"2024-04-26T11:13:08.112454+0000","last_became_peered":"2024-04-26T11:13:08.112454+0000","last_unstale":"2024-04-26T11:13:12.915840+0000","last_undegraded":"2024-04-26T11:13:12.915840+0000","last_fullsized":"2024-04-26T11:13:12.915840+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:41.011030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.913577+0000","last_change":"2024-04-26T11:13:08.113419+0000","last_active":"2024-04-26T11:13:12.913577+0000","last_peered":"2024-04-26T11:13:12.913577+0000","last_clean":"2024-04-26T11:13:12.913577+0000","last_became_active":"2024-04-26T11:13:08.113154+0000","last_became_peered":"2024-04-26T11:13:08.113154+0000","last_unstale":"2024-04-26T11:13:12.913577+0000","last_undegraded":"2024-04-26T11:13:12.913577+0000","last_fullsized":"2024-04-26T11:13:12.913577+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:36.482001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904292+0000","last_change":"2024-04-26T11:13:12.491278+0000","last_active":"2024-04-26T11:13:13.904292+0000","last_peered":"2024-04-26T11:13:13.904292+0000","last_clean":"2024-04-26T11:13:13.904292+0000","last_became_active":"2024-04-26T11:13:12.488223+0000","last_became_peered":"2024-04-26T11:13:12.488223+0000","last_unstale":"2024-04-26T11:13:13.904292+0000","last_undegraded":"2024-04-26T11:13:13.904292+0000","last_fullsized":"2024-04-26T11:13:13.904292+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:05.413010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905587+0000","last_change":"2024-04-26T11:13:12.920834+0000","last_active":"2024-04-26T11:13:13.905587+0000","last_peered":"2024-04-26T11:13:13.905587+0000","last_clean":"2024-04-26T11:13:13.905587+0000","last_became_active":"2024-04-26T11:13:12.917055+0000","last_became_peered":"2024-04-26T11:13:12.917055+0000","last_unstale":"2024-04-26T11:13:13.905587+0000","last_undegraded":"2024-04-26T11:13:13.905587+0000","last_fullsized":"2024-04-26T11:13:13.905587+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:11.313582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.913563+0000","last_change":"2024-04-26T11:13:08.113497+0000","last_active":"2024-04-26T11:13:12.913563+0000","last_peered":"2024-04-26T11:13:12.913563+0000","last_clean":"2024-04-26T11:13:12.913563+0000","last_became_active":"2024-04-26T11:13:08.113237+0000","last_became_peered":"2024-04-26T11:13:08.113237+0000","last_unstale":"2024-04-26T11:13:12.913563+0000","last_undegraded":"2024-04-26T11:13:12.913563+0000","last_fullsized":"2024-04-26T11:13:12.913563+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:52.240361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904041+0000","last_change":"2024-04-26T11:13:12.491936+0000","last_active":"2024-04-26T11:13:13.904041+0000","last_peered":"2024-04-26T11:13:13.904041+0000","last_clean":"2024-04-26T11:13:13.904041+0000","last_became_active":"2024-04-26T11:13:12.491533+0000","last_became_peered":"2024-04-26T11:13:12.491533+0000","last_unstale":"2024-04-26T11:13:13.904041+0000","last_undegraded":"2024-04-26T11:13:13.904041+0000","last_fullsized":"2024-04-26T11:13:13.904041+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:13.320025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771296+0000","last_change":"2024-04-26T11:13:12.918648+0000","last_active":"2024-04-26T11:13:14.771296+0000","last_peered":"2024-04-26T11:13:14.771296+0000","last_clean":"2024-04-26T11:13:14.771296+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:13:14.771296+0000","last_undegraded":"2024-04-26T11:13:14.771296+0000","last_fullsized":"2024-04-26T11:13:14.771296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.907846+0000","last_change":"2024-04-26T11:13:08.110433+0000","last_active":"2024-04-26T11:13:12.907846+0000","last_peered":"2024-04-26T11:13:12.907846+0000","last_clean":"2024-04-26T11:13:12.907846+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:13:12.907846+0000","last_undegraded":"2024-04-26T11:13:12.907846+0000","last_fullsized":"2024-04-26T11:13:12.907846+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904956+0000","last_change":"2024-04-26T11:13:12.491648+0000","last_active":"2024-04-26T11:13:13.904956+0000","last_peered":"2024-04-26T11:13:13.904956+0000","last_clean":"2024-04-26T11:13:13.904956+0000","last_became_active":"2024-04-26T11:13:12.488599+0000","last_became_peered":"2024-04-26T11:13:12.488599+0000","last_unstale":"2024-04-26T11:13:13.904956+0000","last_undegraded":"2024-04-26T11:13:13.904956+0000","last_fullsized":"2024-04-26T11:13:13.904956+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:45.374565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770640+0000","last_change":"2024-04-26T11:13:12.920065+0000","last_active":"2024-04-26T11:13:14.770640+0000","last_peered":"2024-04-26T11:13:14.770640+0000","last_clean":"2024-04-26T11:13:14.770640+0000","last_became_active":"2024-04-26T11:13:12.919741+0000","last_became_peered":"2024-04-26T11:13:12.919741+0000","last_unstale":"2024-04-26T11:13:14.770640+0000","last_undegraded":"2024-04-26T11:13:14.770640+0000","last_fullsized":"2024-04-26T11:13:14.770640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:20.837217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904894+0000","last_change":"2024-04-26T11:13:12.488576+0000","last_active":"2024-04-26T11:13:13.904894+0000","last_peered":"2024-04-26T11:13:13.904894+0000","last_clean":"2024-04-26T11:13:13.904894+0000","last_became_active":"2024-04-26T11:13:12.488248+0000","last_became_peered":"2024-04-26T11:13:12.488248+0000","last_unstale":"2024-04-26T11:13:13.904894+0000","last_undegraded":"2024-04-26T11:13:13.904894+0000","last_fullsized":"2024-04-26T11:13:13.904894+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:48.928740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.904393+0000","last_change":"2024-04-26T11:13:08.113157+0000","last_active":"2024-04-26T11:13:12.904393+0000","last_peered":"2024-04-26T11:13:12.904393+0000","last_clean":"2024-04-26T11:13:12.904393+0000","last_became_active":"2024-04-26T11:13:08.112788+0000","last_became_peered":"2024-04-26T11:13:08.112788+0000","last_unstale":"2024-04-26T11:13:12.904393+0000","last_undegraded":"2024-04-26T11:13:12.904393+0000","last_fullsized":"2024-04-26T11:13:12.904393+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:14.606433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904028+0000","last_change":"2024-04-26T11:13:12.919100+0000","last_active":"2024-04-26T11:13:13.904028+0000","last_peered":"2024-04-26T11:13:13.904028+0000","last_clean":"2024-04-26T11:13:13.904028+0000","last_became_active":"2024-04-26T11:13:12.918816+0000","last_became_peered":"2024-04-26T11:13:12.918816+0000","last_unstale":"2024-04-26T11:13:13.904028+0000","last_undegraded":"2024-04-26T11:13:13.904028+0000","last_fullsized":"2024-04-26T11:13:13.904028+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.915609+0000","last_change":"2024-04-26T11:13:08.113505+0000","last_active":"2024-04-26T11:13:12.915609+0000","last_peered":"2024-04-26T11:13:12.915609+0000","last_clean":"2024-04-26T11:13:12.915609+0000","last_became_active":"2024-04-26T11:13:08.113224+0000","last_became_peered":"2024-04-26T11:13:08.113224+0000","last_unstale":"2024-04-26T11:13:12.915609+0000","last_undegraded":"2024-04-26T11:13:12.915609+0000","last_fullsized":"2024-04-26T11:13:12.915609+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:16.157275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904844+0000","last_change":"2024-04-26T11:13:12.490249+0000","last_active":"2024-04-26T11:13:13.904844+0000","last_peered":"2024-04-26T11:13:13.904844+0000","last_clean":"2024-04-26T11:13:13.904844+0000","last_became_active":"2024-04-26T11:13:12.488836+0000","last_became_peered":"2024-04-26T11:13:12.488836+0000","last_unstale":"2024-04-26T11:13:13.904844+0000","last_undegraded":"2024-04-26T11:13:13.904844+0000","last_fullsized":"2024-04-26T11:13:13.904844+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:12.581788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770387+0000","last_change":"2024-04-26T11:13:12.913955+0000","last_active":"2024-04-26T11:13:14.770387+0000","last_peered":"2024-04-26T11:13:14.770387+0000","last_clean":"2024-04-26T11:13:14.770387+0000","last_became_active":"2024-04-26T11:13:12.913037+0000","last_became_peered":"2024-04-26T11:13:12.913037+0000","last_unstale":"2024-04-26T11:13:14.770387+0000","last_undegraded":"2024-04-26T11:13:14.770387+0000","last_fullsized":"2024-04-26T11:13:14.770387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:11.313582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770475+0000","last_change":"2024-04-26T11:13:12.493479+0000","last_active":"2024-04-26T11:13:14.770475+0000","last_peered":"2024-04-26T11:13:14.770475+0000","last_clean":"2024-04-26T11:13:14.770475+0000","last_became_active":"2024-04-26T11:13:12.493174+0000","last_became_peered":"2024-04-26T11:13:12.493174+0000","last_unstale":"2024-04-26T11:13:14.770475+0000","last_undegraded":"2024-04-26T11:13:14.770475+0000","last_fullsized":"2024-04-26T11:13:14.770475+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:05.413010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770803+0000","last_change":"2024-04-26T11:13:12.917812+0000","last_active":"2024-04-26T11:13:14.770803+0000","last_peered":"2024-04-26T11:13:14.770803+0000","last_clean":"2024-04-26T11:13:14.770803+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:13:14.770803+0000","last_undegraded":"2024-04-26T11:13:14.770803+0000","last_fullsized":"2024-04-26T11:13:14.770803+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904950+0000","last_change":"2024-04-26T11:13:12.493351+0000","last_active":"2024-04-26T11:13:13.904950+0000","last_peered":"2024-04-26T11:13:13.904950+0000","last_clean":"2024-04-26T11:13:13.904950+0000","last_became_active":"2024-04-26T11:13:12.492923+0000","last_became_peered":"2024-04-26T11:13:12.492923+0000","last_unstale":"2024-04-26T11:13:13.904950+0000","last_undegraded":"2024-04-26T11:13:13.904950+0000","last_fullsized":"2024-04-26T11:13:13.904950+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:53.444842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904852+0000","last_change":"2024-04-26T11:13:12.918383+0000","last_active":"2024-04-26T11:13:13.904852+0000","last_peered":"2024-04-26T11:13:13.904852+0000","last_clean":"2024-04-26T11:13:13.904852+0000","last_became_active":"2024-04-26T11:13:12.917098+0000","last_became_peered":"2024-04-26T11:13:12.917098+0000","last_unstale":"2024-04-26T11:13:13.904852+0000","last_undegraded":"2024-04-26T11:13:13.904852+0000","last_fullsized":"2024-04-26T11:13:13.904852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:43.397887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770971+0000","last_change":"2024-04-26T11:13:12.493387+0000","last_active":"2024-04-26T11:13:14.770971+0000","last_peered":"2024-04-26T11:13:14.770971+0000","last_clean":"2024-04-26T11:13:14.770971+0000","last_became_active":"2024-04-26T11:13:12.493158+0000","last_became_peered":"2024-04-26T11:13:12.493158+0000","last_unstale":"2024-04-26T11:13:14.770971+0000","last_undegraded":"2024-04-26T11:13:14.770971+0000","last_fullsized":"2024-04-26T11:13:14.770971+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:56.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904899+0000","last_change":"2024-04-26T11:13:12.920137+0000","last_active":"2024-04-26T11:13:13.904899+0000","last_peered":"2024-04-26T11:13:13.904899+0000","last_clean":"2024-04-26T11:13:13.904899+0000","last_became_active":"2024-04-26T11:13:12.919020+0000","last_became_peered":"2024-04-26T11:13:12.919020+0000","last_unstale":"2024-04-26T11:13:13.904899+0000","last_undegraded":"2024-04-26T11:13:13.904899+0000","last_fullsized":"2024-04-26T11:13:13.904899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:47.014768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905092+0000","last_change":"2024-04-26T11:13:12.490017+0000","last_active":"2024-04-26T11:13:13.905092+0000","last_peered":"2024-04-26T11:13:13.905092+0000","last_clean":"2024-04-26T11:13:13.905092+0000","last_became_active":"2024-04-26T11:13:12.488282+0000","last_became_peered":"2024-04-26T11:13:12.488282+0000","last_unstale":"2024-04-26T11:13:13.905092+0000","last_undegraded":"2024-04-26T11:13:13.905092+0000","last_fullsized":"2024-04-26T11:13:13.905092+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:20.176849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770666+0000","last_change":"2024-04-26T11:13:12.917763+0000","last_active":"2024-04-26T11:13:14.770666+0000","last_peered":"2024-04-26T11:13:14.770666+0000","last_clean":"2024-04-26T11:13:14.770666+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:13:14.770666+0000","last_undegraded":"2024-04-26T11:13:14.770666+0000","last_fullsized":"2024-04-26T11:13:14.770666+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905010+0000","last_change":"2024-04-26T11:13:12.491798+0000","last_active":"2024-04-26T11:13:13.905010+0000","last_peered":"2024-04-26T11:13:13.905010+0000","last_clean":"2024-04-26T11:13:13.905010+0000","last_became_active":"2024-04-26T11:13:12.490582+0000","last_became_peered":"2024-04-26T11:13:12.490582+0000","last_unstale":"2024-04-26T11:13:13.905010+0000","last_undegraded":"2024-04-26T11:13:13.905010+0000","last_fullsized":"2024-04-26T11:13:13.905010+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:46.082467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904998+0000","last_change":"2024-04-26T11:13:12.914549+0000","last_active":"2024-04-26T11:13:13.904998+0000","last_peered":"2024-04-26T11:13:13.904998+0000","last_clean":"2024-04-26T11:13:13.904998+0000","last_became_active":"2024-04-26T11:13:12.913041+0000","last_became_peered":"2024-04-26T11:13:12.913041+0000","last_unstale":"2024-04-26T11:13:13.904998+0000","last_undegraded":"2024-04-26T11:13:13.904998+0000","last_fullsized":"2024-04-26T11:13:13.904998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904654+0000","last_change":"2024-04-26T11:13:12.916942+0000","last_active":"2024-04-26T11:13:13.904654+0000","last_peered":"2024-04-26T11:13:13.904654+0000","last_clean":"2024-04-26T11:13:13.904654+0000","last_became_active":"2024-04-26T11:13:12.916144+0000","last_became_peered":"2024-04-26T11:13:12.916144+0000","last_unstale":"2024-04-26T11:13:13.904654+0000","last_undegraded":"2024-04-26T11:13:13.904654+0000","last_fullsized":"2024-04-26T11:13:13.904654+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:46.610126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904072+0000","last_change":"2024-04-26T11:13:12.913826+0000","last_active":"2024-04-26T11:13:13.904072+0000","last_peered":"2024-04-26T11:13:13.904072+0000","last_clean":"2024-04-26T11:13:13.904072+0000","last_became_active":"2024-04-26T11:13:12.912911+0000","last_became_peered":"2024-04-26T11:13:12.912911+0000","last_unstale":"2024-04-26T11:13:13.904072+0000","last_undegraded":"2024-04-26T11:13:13.904072+0000","last_fullsized":"2024-04-26T11:13:13.904072+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:10.887079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770469+0000","last_change":"2024-04-26T11:13:12.921818+0000","last_active":"2024-04-26T11:13:14.770469+0000","last_peered":"2024-04-26T11:13:14.770469+0000","last_clean":"2024-04-26T11:13:14.770469+0000","last_became_active":"2024-04-26T11:13:12.921526+0000","last_became_peered":"2024-04-26T11:13:12.921526+0000","last_unstale":"2024-04-26T11:13:14.770469+0000","last_undegraded":"2024-04-26T11:13:14.770469+0000","last_fullsized":"2024-04-26T11:13:14.770469+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:47.958725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904819+0000","last_change":"2024-04-26T11:13:12.912731+0000","last_active":"2024-04-26T11:13:13.904819+0000","last_peered":"2024-04-26T11:13:13.904819+0000","last_clean":"2024-04-26T11:13:13.904819+0000","last_became_active":"2024-04-26T11:13:12.911522+0000","last_became_peered":"2024-04-26T11:13:12.911522+0000","last_unstale":"2024-04-26T11:13:13.904819+0000","last_undegraded":"2024-04-26T11:13:13.904819+0000","last_fullsized":"2024-04-26T11:13:13.904819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:46.610126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770830+0000","last_change":"2024-04-26T11:13:12.919750+0000","last_active":"2024-04-26T11:13:14.770830+0000","last_peered":"2024-04-26T11:13:14.770830+0000","last_clean":"2024-04-26T11:13:14.770830+0000","last_became_active":"2024-04-26T11:13:12.919116+0000","last_became_peered":"2024-04-26T11:13:12.919116+0000","last_unstale":"2024-04-26T11:13:14.770830+0000","last_undegraded":"2024-04-26T11:13:14.770830+0000","last_fullsized":"2024-04-26T11:13:14.770830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:10.887079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":745472,"data_stored":637050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:13:22.077 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T11:13:22.077 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T11:13:22.078 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T11:13:22.078 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T11:13:22.079 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T11:13:22.515 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:22.527 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":40921},{"type":"v1","addr":"172.21.15.29:6801","nonce":40921}]},"active_addr":"172.21.15.29:6801/40921","active_change":"2024-04-26T11:13:04.445223+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":1490253984}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":2330269896}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":3642403206}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":3782235548}]}]} 2024-04-26T11:13:22.531 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T11:13:22.531 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T11:13:22.531 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:13:22.871 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:22.871 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":15,"fsid":"2b52ce04-9559-478f-9787-c3cc3b261c15","created":"2024-04-26T11:12:58.193418+0000","modified":"2024-04-26T11:13:13.900817+0000","last_up_change":"2024-04-26T11:13:06.102821+0000","last_in_change":"2024-04-26T11:12:59.116286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:13:06.502266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:13:06.913870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:13:11.430854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:13:11.859264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3496b3f-5972-47ff-a449-832f5055beac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":41434},{"type":"v1","addr":"172.21.15.72:6801","nonce":41434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":41434},{"type":"v1","addr":"172.21.15.72:6803","nonce":41434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":41434},{"type":"v1","addr":"172.21.15.72:6807","nonce":41434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":41434},{"type":"v1","addr":"172.21.15.72:6805","nonce":41434}]},"public_addr":"172.21.15.72:6801/41434","cluster_addr":"172.21.15.72:6803/41434","heartbeat_back_addr":"172.21.15.72:6807/41434","heartbeat_front_addr":"172.21.15.72:6805/41434","state":["exists","up"]},{"osd":1,"uuid":"4842abe1-e7b4-480f-85b3-11c8fa2123f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":41442},{"type":"v1","addr":"172.21.15.82:6801","nonce":41442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":41442},{"type":"v1","addr":"172.21.15.82:6803","nonce":41442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":41442},{"type":"v1","addr":"172.21.15.82:6807","nonce":41442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":41442},{"type":"v1","addr":"172.21.15.82:6805","nonce":41442}]},"public_addr":"172.21.15.82:6801/41442","cluster_addr":"172.21.15.82:6803/41442","heartbeat_back_addr":"172.21.15.82:6807/41442","heartbeat_front_addr":"172.21.15.82:6805/41442","state":["exists","up"]},{"osd":2,"uuid":"57b4a874-e4ce-42a9-a7fd-f9e0acf03cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":41571},{"type":"v1","addr":"172.21.15.122:6801","nonce":41571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":41571},{"type":"v1","addr":"172.21.15.122:6803","nonce":41571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":41571},{"type":"v1","addr":"172.21.15.122:6807","nonce":41571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":41571},{"type":"v1","addr":"172.21.15.122:6805","nonce":41571}]},"public_addr":"172.21.15.122:6801/41571","cluster_addr":"172.21.15.122:6803/41571","heartbeat_back_addr":"172.21.15.122:6807/41571","heartbeat_front_addr":"172.21.15.122:6805/41571","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.123925+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.145646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:05.101494+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:13:22.885 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T11:13:22.885 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:13:23.227 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:23.227 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":15,"fsid":"2b52ce04-9559-478f-9787-c3cc3b261c15","created":"2024-04-26T11:12:58.193418+0000","modified":"2024-04-26T11:13:13.900817+0000","last_up_change":"2024-04-26T11:13:06.102821+0000","last_in_change":"2024-04-26T11:12:59.116286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:13:06.502266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:13:06.913870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:13:11.430854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:13:11.859264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3496b3f-5972-47ff-a449-832f5055beac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":41434},{"type":"v1","addr":"172.21.15.72:6801","nonce":41434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":41434},{"type":"v1","addr":"172.21.15.72:6803","nonce":41434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":41434},{"type":"v1","addr":"172.21.15.72:6807","nonce":41434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":41434},{"type":"v1","addr":"172.21.15.72:6805","nonce":41434}]},"public_addr":"172.21.15.72:6801/41434","cluster_addr":"172.21.15.72:6803/41434","heartbeat_back_addr":"172.21.15.72:6807/41434","heartbeat_front_addr":"172.21.15.72:6805/41434","state":["exists","up"]},{"osd":1,"uuid":"4842abe1-e7b4-480f-85b3-11c8fa2123f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":41442},{"type":"v1","addr":"172.21.15.82:6801","nonce":41442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":41442},{"type":"v1","addr":"172.21.15.82:6803","nonce":41442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":41442},{"type":"v1","addr":"172.21.15.82:6807","nonce":41442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":41442},{"type":"v1","addr":"172.21.15.82:6805","nonce":41442}]},"public_addr":"172.21.15.82:6801/41442","cluster_addr":"172.21.15.82:6803/41442","heartbeat_back_addr":"172.21.15.82:6807/41442","heartbeat_front_addr":"172.21.15.82:6805/41442","state":["exists","up"]},{"osd":2,"uuid":"57b4a874-e4ce-42a9-a7fd-f9e0acf03cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":41571},{"type":"v1","addr":"172.21.15.122:6801","nonce":41571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":41571},{"type":"v1","addr":"172.21.15.122:6803","nonce":41571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":41571},{"type":"v1","addr":"172.21.15.122:6807","nonce":41571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":41571},{"type":"v1","addr":"172.21.15.122:6805","nonce":41571}]},"public_addr":"172.21.15.122:6801/41571","cluster_addr":"172.21.15.122:6803/41571","heartbeat_back_addr":"172.21.15.122:6807/41571","heartbeat_front_addr":"172.21.15.122:6805/41571","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.123925+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.145646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:05.101494+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:13:23.241 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T11:13:23.242 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T11:13:23.242 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T11:13:23.417 INFO:teuthology.orchestra.run.smithi029.stdout:34359738373 2024-04-26T11:13:23.417 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T11:13:23.425 INFO:teuthology.orchestra.run.smithi029.stdout:34359738374 2024-04-26T11:13:23.426 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T11:13:23.431 INFO:teuthology.orchestra.run.smithi029.stdout:34359738373 2024-04-26T11:13:23.431 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T11:13:23.787 INFO:teuthology.orchestra.run.smithi029.stdout:34359738372 2024-04-26T11:13:23.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.0 2024-04-26T11:13:23.829 INFO:teuthology.orchestra.run.smithi029.stdout:34359738373 2024-04-26T11:13:23.835 INFO:teuthology.orchestra.run.smithi029.stdout:34359738372 2024-04-26T11:13:23.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.1 2024-04-26T11:13:23.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.2 2024-04-26T11:13:24.802 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T11:13:24.845 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T11:13:24.851 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T11:13:25.176 INFO:teuthology.orchestra.run.smithi029.stdout:34359738373 2024-04-26T11:13:25.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.0 2024-04-26T11:13:25.191 DEBUG:teuthology.parallel:result is None 2024-04-26T11:13:25.216 INFO:teuthology.orchestra.run.smithi029.stdout:34359738374 2024-04-26T11:13:25.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.1 2024-04-26T11:13:25.231 DEBUG:teuthology.parallel:result is None 2024-04-26T11:13:25.246 INFO:teuthology.orchestra.run.smithi029.stdout:34359738373 2024-04-26T11:13:25.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.2 2024-04-26T11:13:25.260 DEBUG:teuthology.parallel:result is None 2024-04-26T11:13:25.260 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T11:13:25.261 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:13:25.648 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:25.649 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:13:25.659 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-26T11:13:24.453244+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86788,"kb_used_data":1604,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028732,"statfs":{"total":289910292480,"available":289821421568,"internally_reserved":0,"allocated":1642496,"data_stored":1322490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.550745"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771368+0000","last_change":"2024-04-26T11:13:12.919196+0000","last_active":"2024-04-26T11:13:14.771368+0000","last_peered":"2024-04-26T11:13:14.771368+0000","last_clean":"2024-04-26T11:13:14.771368+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:13:14.771368+0000","last_undegraded":"2024-04-26T11:13:14.771368+0000","last_fullsized":"2024-04-26T11:13:14.771368+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771085+0000","last_change":"2024-04-26T11:13:12.917670+0000","last_active":"2024-04-26T11:13:14.771085+0000","last_peered":"2024-04-26T11:13:14.771085+0000","last_clean":"2024-04-26T11:13:14.771085+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:13:14.771085+0000","last_undegraded":"2024-04-26T11:13:14.771085+0000","last_fullsized":"2024-04-26T11:13:14.771085+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905470+0000","last_change":"2024-04-26T11:13:12.922235+0000","last_active":"2024-04-26T11:13:13.905470+0000","last_peered":"2024-04-26T11:13:13.905470+0000","last_clean":"2024-04-26T11:13:13.905470+0000","last_became_active":"2024-04-26T11:13:12.919993+0000","last_became_peered":"2024-04-26T11:13:12.919993+0000","last_unstale":"2024-04-26T11:13:13.905470+0000","last_undegraded":"2024-04-26T11:13:13.905470+0000","last_fullsized":"2024-04-26T11:13:13.905470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:41.004462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905212+0000","last_change":"2024-04-26T11:13:12.916859+0000","last_active":"2024-04-26T11:13:13.905212+0000","last_peered":"2024-04-26T11:13:13.905212+0000","last_clean":"2024-04-26T11:13:13.905212+0000","last_became_active":"2024-04-26T11:13:12.915591+0000","last_became_peered":"2024-04-26T11:13:12.915591+0000","last_unstale":"2024-04-26T11:13:13.905212+0000","last_undegraded":"2024-04-26T11:13:13.905212+0000","last_fullsized":"2024-04-26T11:13:13.905212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:52.543148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770643+0000","last_change":"2024-04-26T11:13:12.917403+0000","last_active":"2024-04-26T11:13:14.770643+0000","last_peered":"2024-04-26T11:13:14.770643+0000","last_clean":"2024-04-26T11:13:14.770643+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:13:14.770643+0000","last_undegraded":"2024-04-26T11:13:14.770643+0000","last_fullsized":"2024-04-26T11:13:14.770643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:42.014955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904599+0000","last_change":"2024-04-26T11:13:12.918802+0000","last_active":"2024-04-26T11:13:13.904599+0000","last_peered":"2024-04-26T11:13:13.904599+0000","last_clean":"2024-04-26T11:13:13.904599+0000","last_became_active":"2024-04-26T11:13:12.917353+0000","last_became_peered":"2024-04-26T11:13:12.917353+0000","last_unstale":"2024-04-26T11:13:13.904599+0000","last_undegraded":"2024-04-26T11:13:13.904599+0000","last_fullsized":"2024-04-26T11:13:13.904599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:08.956085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904746+0000","last_change":"2024-04-26T11:13:12.916789+0000","last_active":"2024-04-26T11:13:13.904746+0000","last_peered":"2024-04-26T11:13:13.904746+0000","last_clean":"2024-04-26T11:13:13.904746+0000","last_became_active":"2024-04-26T11:13:12.914947+0000","last_became_peered":"2024-04-26T11:13:12.914947+0000","last_unstale":"2024-04-26T11:13:13.904746+0000","last_undegraded":"2024-04-26T11:13:13.904746+0000","last_fullsized":"2024-04-26T11:13:13.904746+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904343+0000","last_change":"2024-04-26T11:13:12.919968+0000","last_active":"2024-04-26T11:13:13.904343+0000","last_peered":"2024-04-26T11:13:13.904343+0000","last_clean":"2024-04-26T11:13:13.904343+0000","last_became_active":"2024-04-26T11:13:12.918600+0000","last_became_peered":"2024-04-26T11:13:12.918600+0000","last_unstale":"2024-04-26T11:13:13.904343+0000","last_undegraded":"2024-04-26T11:13:13.904343+0000","last_fullsized":"2024-04-26T11:13:13.904343+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:41.073901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904753+0000","last_change":"2024-04-26T11:13:12.914649+0000","last_active":"2024-04-26T11:13:13.904753+0000","last_peered":"2024-04-26T11:13:13.904753+0000","last_clean":"2024-04-26T11:13:13.904753+0000","last_became_active":"2024-04-26T11:13:12.914174+0000","last_became_peered":"2024-04-26T11:13:12.914174+0000","last_unstale":"2024-04-26T11:13:13.904753+0000","last_undegraded":"2024-04-26T11:13:13.904753+0000","last_fullsized":"2024-04-26T11:13:13.904753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:41.004462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771235+0000","last_change":"2024-04-26T11:13:12.918521+0000","last_active":"2024-04-26T11:13:14.771235+0000","last_peered":"2024-04-26T11:13:14.771235+0000","last_clean":"2024-04-26T11:13:14.771235+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:13:14.771235+0000","last_undegraded":"2024-04-26T11:13:14.771235+0000","last_fullsized":"2024-04-26T11:13:14.771235+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905226+0000","last_change":"2024-04-26T11:13:12.922456+0000","last_active":"2024-04-26T11:13:13.905226+0000","last_peered":"2024-04-26T11:13:13.905226+0000","last_clean":"2024-04-26T11:13:13.905226+0000","last_became_active":"2024-04-26T11:13:12.921230+0000","last_became_peered":"2024-04-26T11:13:12.921230+0000","last_unstale":"2024-04-26T11:13:13.905226+0000","last_undegraded":"2024-04-26T11:13:13.905226+0000","last_fullsized":"2024-04-26T11:13:13.905226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:55.318150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770399+0000","last_change":"2024-04-26T11:13:12.914082+0000","last_active":"2024-04-26T11:13:14.770399+0000","last_peered":"2024-04-26T11:13:14.770399+0000","last_clean":"2024-04-26T11:13:14.770399+0000","last_became_active":"2024-04-26T11:13:12.913374+0000","last_became_peered":"2024-04-26T11:13:12.913374+0000","last_unstale":"2024-04-26T11:13:14.770399+0000","last_undegraded":"2024-04-26T11:13:14.770399+0000","last_fullsized":"2024-04-26T11:13:14.770399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:52.543148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770460+0000","last_change":"2024-04-26T11:13:12.915484+0000","last_active":"2024-04-26T11:13:14.770460+0000","last_peered":"2024-04-26T11:13:14.770460+0000","last_clean":"2024-04-26T11:13:14.770460+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:13:14.770460+0000","last_undegraded":"2024-04-26T11:13:14.770460+0000","last_fullsized":"2024-04-26T11:13:14.770460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905148+0000","last_change":"2024-04-26T11:13:12.914318+0000","last_active":"2024-04-26T11:13:13.905148+0000","last_peered":"2024-04-26T11:13:13.905148+0000","last_clean":"2024-04-26T11:13:13.905148+0000","last_became_active":"2024-04-26T11:13:12.913437+0000","last_became_peered":"2024-04-26T11:13:12.913437+0000","last_unstale":"2024-04-26T11:13:13.905148+0000","last_undegraded":"2024-04-26T11:13:13.905148+0000","last_fullsized":"2024-04-26T11:13:13.905148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904484+0000","last_change":"2024-04-26T11:13:12.914523+0000","last_active":"2024-04-26T11:13:13.904484+0000","last_peered":"2024-04-26T11:13:13.904484+0000","last_clean":"2024-04-26T11:13:13.904484+0000","last_became_active":"2024-04-26T11:13:12.913241+0000","last_became_peered":"2024-04-26T11:13:12.913241+0000","last_unstale":"2024-04-26T11:13:13.904484+0000","last_undegraded":"2024-04-26T11:13:13.904484+0000","last_fullsized":"2024-04-26T11:13:13.904484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:10.887079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904389+0000","last_change":"2024-04-26T11:13:12.922145+0000","last_active":"2024-04-26T11:13:13.904389+0000","last_peered":"2024-04-26T11:13:13.904389+0000","last_clean":"2024-04-26T11:13:13.904389+0000","last_became_active":"2024-04-26T11:13:12.919048+0000","last_became_peered":"2024-04-26T11:13:12.919048+0000","last_unstale":"2024-04-26T11:13:13.904389+0000","last_undegraded":"2024-04-26T11:13:13.904389+0000","last_fullsized":"2024-04-26T11:13:13.904389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:47.958725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904823+0000","last_change":"2024-04-26T11:13:12.914484+0000","last_active":"2024-04-26T11:13:13.904823+0000","last_peered":"2024-04-26T11:13:13.904823+0000","last_clean":"2024-04-26T11:13:13.904823+0000","last_became_active":"2024-04-26T11:13:12.913596+0000","last_became_peered":"2024-04-26T11:13:12.913596+0000","last_unstale":"2024-04-26T11:13:13.904823+0000","last_undegraded":"2024-04-26T11:13:13.904823+0000","last_fullsized":"2024-04-26T11:13:13.904823+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:38.001491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771320+0000","last_change":"2024-04-26T11:13:12.918759+0000","last_active":"2024-04-26T11:13:14.771320+0000","last_peered":"2024-04-26T11:13:14.771320+0000","last_clean":"2024-04-26T11:13:14.771320+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:13:14.771320+0000","last_undegraded":"2024-04-26T11:13:14.771320+0000","last_fullsized":"2024-04-26T11:13:14.771320+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:55.002972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904592+0000","last_change":"2024-04-26T11:13:12.917334+0000","last_active":"2024-04-26T11:13:13.904592+0000","last_peered":"2024-04-26T11:13:13.904592+0000","last_clean":"2024-04-26T11:13:13.904592+0000","last_became_active":"2024-04-26T11:13:12.917010+0000","last_became_peered":"2024-04-26T11:13:12.917010+0000","last_unstale":"2024-04-26T11:13:13.904592+0000","last_undegraded":"2024-04-26T11:13:13.904592+0000","last_fullsized":"2024-04-26T11:13:13.904592+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:52.543148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905177+0000","last_change":"2024-04-26T11:13:12.917519+0000","last_active":"2024-04-26T11:13:13.905177+0000","last_peered":"2024-04-26T11:13:13.905177+0000","last_clean":"2024-04-26T11:13:13.905177+0000","last_became_active":"2024-04-26T11:13:12.916985+0000","last_became_peered":"2024-04-26T11:13:12.916985+0000","last_unstale":"2024-04-26T11:13:13.905177+0000","last_undegraded":"2024-04-26T11:13:13.905177+0000","last_fullsized":"2024-04-26T11:13:13.905177+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:38.001491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904702+0000","last_change":"2024-04-26T11:13:12.919641+0000","last_active":"2024-04-26T11:13:13.904702+0000","last_peered":"2024-04-26T11:13:13.904702+0000","last_clean":"2024-04-26T11:13:13.904702+0000","last_became_active":"2024-04-26T11:13:12.918830+0000","last_became_peered":"2024-04-26T11:13:12.918830+0000","last_unstale":"2024-04-26T11:13:13.904702+0000","last_undegraded":"2024-04-26T11:13:13.904702+0000","last_fullsized":"2024-04-26T11:13:13.904702+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:52.714816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770332+0000","last_change":"2024-04-26T11:13:12.914087+0000","last_active":"2024-04-26T11:13:14.770332+0000","last_peered":"2024-04-26T11:13:14.770332+0000","last_clean":"2024-04-26T11:13:14.770332+0000","last_became_active":"2024-04-26T11:13:12.913393+0000","last_became_peered":"2024-04-26T11:13:12.913393+0000","last_unstale":"2024-04-26T11:13:14.770332+0000","last_undegraded":"2024-04-26T11:13:14.770332+0000","last_fullsized":"2024-04-26T11:13:14.770332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:38.001491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.903953+0000","last_change":"2024-04-26T11:13:12.918407+0000","last_active":"2024-04-26T11:13:13.903953+0000","last_peered":"2024-04-26T11:13:13.903953+0000","last_clean":"2024-04-26T11:13:13.903953+0000","last_became_active":"2024-04-26T11:13:12.918176+0000","last_became_peered":"2024-04-26T11:13:12.918176+0000","last_unstale":"2024-04-26T11:13:13.903953+0000","last_undegraded":"2024-04-26T11:13:13.903953+0000","last_fullsized":"2024-04-26T11:13:13.903953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770185+0000","last_change":"2024-04-26T11:13:12.912756+0000","last_active":"2024-04-26T11:13:14.770185+0000","last_peered":"2024-04-26T11:13:14.770185+0000","last_clean":"2024-04-26T11:13:14.770185+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:13:14.770185+0000","last_undegraded":"2024-04-26T11:13:14.770185+0000","last_fullsized":"2024-04-26T11:13:14.770185+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:04.177831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771368+0000","last_change":"2024-04-26T11:13:12.920122+0000","last_active":"2024-04-26T11:13:14.771368+0000","last_peered":"2024-04-26T11:13:14.771368+0000","last_clean":"2024-04-26T11:13:14.771368+0000","last_became_active":"2024-04-26T11:13:12.919792+0000","last_became_peered":"2024-04-26T11:13:12.919792+0000","last_unstale":"2024-04-26T11:13:14.771368+0000","last_undegraded":"2024-04-26T11:13:14.771368+0000","last_fullsized":"2024-04-26T11:13:14.771368+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:54.809926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904864+0000","last_change":"2024-04-26T11:13:12.912803+0000","last_active":"2024-04-26T11:13:13.904864+0000","last_peered":"2024-04-26T11:13:13.904864+0000","last_clean":"2024-04-26T11:13:13.904864+0000","last_became_active":"2024-04-26T11:13:12.912254+0000","last_became_peered":"2024-04-26T11:13:12.912254+0000","last_unstale":"2024-04-26T11:13:13.904864+0000","last_undegraded":"2024-04-26T11:13:13.904864+0000","last_fullsized":"2024-04-26T11:13:13.904864+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:11.313582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905305+0000","last_change":"2024-04-26T11:13:12.921062+0000","last_active":"2024-04-26T11:13:13.905305+0000","last_peered":"2024-04-26T11:13:13.905305+0000","last_clean":"2024-04-26T11:13:13.905305+0000","last_became_active":"2024-04-26T11:13:12.918716+0000","last_became_peered":"2024-04-26T11:13:12.918716+0000","last_unstale":"2024-04-26T11:13:13.905305+0000","last_undegraded":"2024-04-26T11:13:13.905305+0000","last_fullsized":"2024-04-26T11:13:13.905305+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:55.576807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770220+0000","last_change":"2024-04-26T11:13:12.493425+0000","last_active":"2024-04-26T11:13:14.770220+0000","last_peered":"2024-04-26T11:13:14.770220+0000","last_clean":"2024-04-26T11:13:14.770220+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:13:14.770220+0000","last_undegraded":"2024-04-26T11:13:14.770220+0000","last_fullsized":"2024-04-26T11:13:14.770220+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:23.279580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771122+0000","last_change":"2024-04-26T11:13:12.918515+0000","last_active":"2024-04-26T11:13:14.771122+0000","last_peered":"2024-04-26T11:13:14.771122+0000","last_clean":"2024-04-26T11:13:14.771122+0000","last_became_active":"2024-04-26T11:13:12.918002+0000","last_became_peered":"2024-04-26T11:13:12.918002+0000","last_unstale":"2024-04-26T11:13:14.771122+0000","last_undegraded":"2024-04-26T11:13:14.771122+0000","last_fullsized":"2024-04-26T11:13:14.771122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:46.610126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904192+0000","last_change":"2024-04-26T11:13:12.490257+0000","last_active":"2024-04-26T11:13:13.904192+0000","last_peered":"2024-04-26T11:13:13.904192+0000","last_clean":"2024-04-26T11:13:13.904192+0000","last_became_active":"2024-04-26T11:13:12.488819+0000","last_became_peered":"2024-04-26T11:13:12.488819+0000","last_unstale":"2024-04-26T11:13:13.904192+0000","last_undegraded":"2024-04-26T11:13:13.904192+0000","last_fullsized":"2024-04-26T11:13:13.904192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:52.644533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904995+0000","last_change":"2024-04-26T11:13:12.915624+0000","last_active":"2024-04-26T11:13:13.904995+0000","last_peered":"2024-04-26T11:13:13.904995+0000","last_clean":"2024-04-26T11:13:13.904995+0000","last_became_active":"2024-04-26T11:13:12.915375+0000","last_became_peered":"2024-04-26T11:13:12.915375+0000","last_unstale":"2024-04-26T11:13:13.904995+0000","last_undegraded":"2024-04-26T11:13:13.904995+0000","last_fullsized":"2024-04-26T11:13:13.904995+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:28.908758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904382+0000","last_change":"2024-04-26T11:13:12.487990+0000","last_active":"2024-04-26T11:13:13.904382+0000","last_peered":"2024-04-26T11:13:13.904382+0000","last_clean":"2024-04-26T11:13:13.904382+0000","last_became_active":"2024-04-26T11:13:12.486848+0000","last_became_peered":"2024-04-26T11:13:12.486848+0000","last_unstale":"2024-04-26T11:13:13.904382+0000","last_undegraded":"2024-04-26T11:13:13.904382+0000","last_fullsized":"2024-04-26T11:13:13.904382+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:56.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771304+0000","last_change":"2024-04-26T11:13:12.917423+0000","last_active":"2024-04-26T11:13:14.771304+0000","last_peered":"2024-04-26T11:13:14.771304+0000","last_clean":"2024-04-26T11:13:14.771304+0000","last_became_active":"2024-04-26T11:13:12.916811+0000","last_became_peered":"2024-04-26T11:13:12.916811+0000","last_unstale":"2024-04-26T11:13:14.771304+0000","last_undegraded":"2024-04-26T11:13:14.771304+0000","last_fullsized":"2024-04-26T11:13:14.771304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:28.908758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905043+0000","last_change":"2024-04-26T11:13:12.490251+0000","last_active":"2024-04-26T11:13:13.905043+0000","last_peered":"2024-04-26T11:13:13.905043+0000","last_clean":"2024-04-26T11:13:13.905043+0000","last_became_active":"2024-04-26T11:13:12.489836+0000","last_became_peered":"2024-04-26T11:13:12.489836+0000","last_unstale":"2024-04-26T11:13:13.905043+0000","last_undegraded":"2024-04-26T11:13:13.905043+0000","last_fullsized":"2024-04-26T11:13:13.905043+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:42.000159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.903972+0000","last_change":"2024-04-26T11:13:12.912865+0000","last_active":"2024-04-26T11:13:13.903972+0000","last_peered":"2024-04-26T11:13:13.903972+0000","last_clean":"2024-04-26T11:13:13.903972+0000","last_became_active":"2024-04-26T11:13:12.912397+0000","last_became_peered":"2024-04-26T11:13:12.912397+0000","last_unstale":"2024-04-26T11:13:13.903972+0000","last_undegraded":"2024-04-26T11:13:13.903972+0000","last_fullsized":"2024-04-26T11:13:13.903972+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905218+0000","last_change":"2024-04-26T11:13:12.493118+0000","last_active":"2024-04-26T11:13:13.905218+0000","last_peered":"2024-04-26T11:13:13.905218+0000","last_clean":"2024-04-26T11:13:13.905218+0000","last_became_active":"2024-04-26T11:13:12.492799+0000","last_became_peered":"2024-04-26T11:13:12.492799+0000","last_unstale":"2024-04-26T11:13:13.905218+0000","last_undegraded":"2024-04-26T11:13:13.905218+0000","last_fullsized":"2024-04-26T11:13:13.905218+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:46.082467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904510+0000","last_change":"2024-04-26T11:13:12.918149+0000","last_active":"2024-04-26T11:13:13.904510+0000","last_peered":"2024-04-26T11:13:13.904510+0000","last_clean":"2024-04-26T11:13:13.904510+0000","last_became_active":"2024-04-26T11:13:12.917636+0000","last_became_peered":"2024-04-26T11:13:12.917636+0000","last_unstale":"2024-04-26T11:13:13.904510+0000","last_undegraded":"2024-04-26T11:13:13.904510+0000","last_fullsized":"2024-04-26T11:13:13.904510+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:20.837217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770906+0000","last_change":"2024-04-26T11:13:12.495785+0000","last_active":"2024-04-26T11:13:14.770906+0000","last_peered":"2024-04-26T11:13:14.770906+0000","last_clean":"2024-04-26T11:13:14.770906+0000","last_became_active":"2024-04-26T11:13:12.495527+0000","last_became_peered":"2024-04-26T11:13:12.495527+0000","last_unstale":"2024-04-26T11:13:14.770906+0000","last_undegraded":"2024-04-26T11:13:14.770906+0000","last_fullsized":"2024-04-26T11:13:14.770906+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:45.374565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904416+0000","last_change":"2024-04-26T11:13:12.913698+0000","last_active":"2024-04-26T11:13:13.904416+0000","last_peered":"2024-04-26T11:13:13.904416+0000","last_clean":"2024-04-26T11:13:13.904416+0000","last_became_active":"2024-04-26T11:13:12.913198+0000","last_became_peered":"2024-04-26T11:13:12.913198+0000","last_unstale":"2024-04-26T11:13:13.904416+0000","last_undegraded":"2024-04-26T11:13:13.904416+0000","last_fullsized":"2024-04-26T11:13:13.904416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905059+0000","last_change":"2024-04-26T11:13:12.492878+0000","last_active":"2024-04-26T11:13:13.905059+0000","last_peered":"2024-04-26T11:13:13.905059+0000","last_clean":"2024-04-26T11:13:13.905059+0000","last_became_active":"2024-04-26T11:13:12.491690+0000","last_became_peered":"2024-04-26T11:13:12.491690+0000","last_unstale":"2024-04-26T11:13:13.905059+0000","last_undegraded":"2024-04-26T11:13:13.905059+0000","last_fullsized":"2024-04-26T11:13:13.905059+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:12.581788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905197+0000","last_change":"2024-04-26T11:13:12.916914+0000","last_active":"2024-04-26T11:13:13.905197+0000","last_peered":"2024-04-26T11:13:13.905197+0000","last_clean":"2024-04-26T11:13:13.905197+0000","last_became_active":"2024-04-26T11:13:12.913900+0000","last_became_peered":"2024-04-26T11:13:12.913900+0000","last_unstale":"2024-04-26T11:13:13.905197+0000","last_undegraded":"2024-04-26T11:13:13.905197+0000","last_fullsized":"2024-04-26T11:13:13.905197+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:28.908758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905107+0000","last_change":"2024-04-26T11:13:12.493445+0000","last_active":"2024-04-26T11:13:13.905107+0000","last_peered":"2024-04-26T11:13:13.905107+0000","last_clean":"2024-04-26T11:13:13.905107+0000","last_became_active":"2024-04-26T11:13:12.493015+0000","last_became_peered":"2024-04-26T11:13:12.493015+0000","last_unstale":"2024-04-26T11:13:13.905107+0000","last_undegraded":"2024-04-26T11:13:13.905107+0000","last_fullsized":"2024-04-26T11:13:13.905107+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:17.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770711+0000","last_change":"2024-04-26T11:13:12.916685+0000","last_active":"2024-04-26T11:13:14.770711+0000","last_peered":"2024-04-26T11:13:14.770711+0000","last_clean":"2024-04-26T11:13:14.770711+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:13:14.770711+0000","last_undegraded":"2024-04-26T11:13:14.770711+0000","last_fullsized":"2024-04-26T11:13:14.770711+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904543+0000","last_change":"2024-04-26T11:13:12.491438+0000","last_active":"2024-04-26T11:13:13.904543+0000","last_peered":"2024-04-26T11:13:13.904543+0000","last_clean":"2024-04-26T11:13:13.904543+0000","last_became_active":"2024-04-26T11:13:12.490515+0000","last_became_peered":"2024-04-26T11:13:12.490515+0000","last_unstale":"2024-04-26T11:13:13.904543+0000","last_undegraded":"2024-04-26T11:13:13.904543+0000","last_fullsized":"2024-04-26T11:13:13.904543+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:11.480844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770974+0000","last_change":"2024-04-26T11:13:12.915238+0000","last_active":"2024-04-26T11:13:14.770974+0000","last_peered":"2024-04-26T11:13:14.770974+0000","last_clean":"2024-04-26T11:13:14.770974+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:13:14.770974+0000","last_undegraded":"2024-04-26T11:13:14.770974+0000","last_fullsized":"2024-04-26T11:13:14.770974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:48.068465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770266+0000","last_change":"2024-04-26T11:13:12.492682+0000","last_active":"2024-04-26T11:13:14.770266+0000","last_peered":"2024-04-26T11:13:14.770266+0000","last_clean":"2024-04-26T11:13:14.770266+0000","last_became_active":"2024-04-26T11:13:12.492346+0000","last_became_peered":"2024-04-26T11:13:12.492346+0000","last_unstale":"2024-04-26T11:13:14.770266+0000","last_undegraded":"2024-04-26T11:13:14.770266+0000","last_fullsized":"2024-04-26T11:13:14.770266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:28.034755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905121+0000","last_change":"2024-04-26T11:13:12.913671+0000","last_active":"2024-04-26T11:13:13.905121+0000","last_peered":"2024-04-26T11:13:13.905121+0000","last_clean":"2024-04-26T11:13:13.905121+0000","last_became_active":"2024-04-26T11:13:12.913264+0000","last_became_peered":"2024-04-26T11:13:12.913264+0000","last_unstale":"2024-04-26T11:13:13.905121+0000","last_undegraded":"2024-04-26T11:13:13.905121+0000","last_fullsized":"2024-04-26T11:13:13.905121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904759+0000","last_change":"2024-04-26T11:13:12.492802+0000","last_active":"2024-04-26T11:13:13.904759+0000","last_peered":"2024-04-26T11:13:13.904759+0000","last_clean":"2024-04-26T11:13:13.904759+0000","last_became_active":"2024-04-26T11:13:12.491774+0000","last_became_peered":"2024-04-26T11:13:12.491774+0000","last_unstale":"2024-04-26T11:13:13.904759+0000","last_undegraded":"2024-04-26T11:13:13.904759+0000","last_fullsized":"2024-04-26T11:13:13.904759+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:05.413010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905139+0000","last_change":"2024-04-26T11:13:12.915666+0000","last_active":"2024-04-26T11:13:13.905139+0000","last_peered":"2024-04-26T11:13:13.905139+0000","last_clean":"2024-04-26T11:13:13.905139+0000","last_became_active":"2024-04-26T11:13:12.915393+0000","last_became_peered":"2024-04-26T11:13:12.915393+0000","last_unstale":"2024-04-26T11:13:13.905139+0000","last_undegraded":"2024-04-26T11:13:13.905139+0000","last_fullsized":"2024-04-26T11:13:13.905139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905455+0000","last_change":"2024-04-26T11:13:12.491934+0000","last_active":"2024-04-26T11:13:13.905455+0000","last_peered":"2024-04-26T11:13:13.905455+0000","last_clean":"2024-04-26T11:13:13.905455+0000","last_became_active":"2024-04-26T11:13:12.491262+0000","last_became_peered":"2024-04-26T11:13:12.491262+0000","last_unstale":"2024-04-26T11:13:13.905455+0000","last_undegraded":"2024-04-26T11:13:13.905455+0000","last_fullsized":"2024-04-26T11:13:13.905455+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:11.480844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.769967+0000","last_change":"2024-04-26T11:13:12.920072+0000","last_active":"2024-04-26T11:13:14.769967+0000","last_peered":"2024-04-26T11:13:14.769967+0000","last_clean":"2024-04-26T11:13:14.769967+0000","last_became_active":"2024-04-26T11:13:12.919233+0000","last_became_peered":"2024-04-26T11:13:12.919233+0000","last_unstale":"2024-04-26T11:13:14.769967+0000","last_undegraded":"2024-04-26T11:13:14.769967+0000","last_fullsized":"2024-04-26T11:13:14.769967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:41.004462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771109+0000","last_change":"2024-04-26T11:13:12.493060+0000","last_active":"2024-04-26T11:13:14.771109+0000","last_peered":"2024-04-26T11:13:14.771109+0000","last_clean":"2024-04-26T11:13:14.771109+0000","last_became_active":"2024-04-26T11:13:12.492519+0000","last_became_peered":"2024-04-26T11:13:12.492519+0000","last_unstale":"2024-04-26T11:13:14.771109+0000","last_undegraded":"2024-04-26T11:13:14.771109+0000","last_fullsized":"2024-04-26T11:13:14.771109+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:48.928740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770525+0000","last_change":"2024-04-26T11:13:12.912207+0000","last_active":"2024-04-26T11:13:14.770525+0000","last_peered":"2024-04-26T11:13:14.770525+0000","last_clean":"2024-04-26T11:13:14.770525+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:13:14.770525+0000","last_undegraded":"2024-04-26T11:13:14.770525+0000","last_fullsized":"2024-04-26T11:13:14.770525+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905410+0000","last_change":"2024-04-26T11:13:12.492772+0000","last_active":"2024-04-26T11:13:13.905410+0000","last_peered":"2024-04-26T11:13:13.905410+0000","last_clean":"2024-04-26T11:13:13.905410+0000","last_became_active":"2024-04-26T11:13:12.491901+0000","last_became_peered":"2024-04-26T11:13:12.491901+0000","last_unstale":"2024-04-26T11:13:13.905410+0000","last_undegraded":"2024-04-26T11:13:13.905410+0000","last_fullsized":"2024-04-26T11:13:13.905410+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:45.693017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904852+0000","last_change":"2024-04-26T11:13:12.919749+0000","last_active":"2024-04-26T11:13:13.904852+0000","last_peered":"2024-04-26T11:13:13.904852+0000","last_clean":"2024-04-26T11:13:13.904852+0000","last_became_active":"2024-04-26T11:13:12.917479+0000","last_became_peered":"2024-04-26T11:13:12.917479+0000","last_unstale":"2024-04-26T11:13:13.904852+0000","last_undegraded":"2024-04-26T11:13:13.904852+0000","last_fullsized":"2024-04-26T11:13:13.904852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:12.483631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904944+0000","last_change":"2024-04-26T11:13:12.495144+0000","last_active":"2024-04-26T11:13:13.904944+0000","last_peered":"2024-04-26T11:13:13.904944+0000","last_clean":"2024-04-26T11:13:13.904944+0000","last_became_active":"2024-04-26T11:13:12.494510+0000","last_became_peered":"2024-04-26T11:13:12.494510+0000","last_unstale":"2024-04-26T11:13:13.904944+0000","last_undegraded":"2024-04-26T11:13:13.904944+0000","last_fullsized":"2024-04-26T11:13:13.904944+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:00.146717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904907+0000","last_change":"2024-04-26T11:13:12.913350+0000","last_active":"2024-04-26T11:13:13.904907+0000","last_peered":"2024-04-26T11:13:13.904907+0000","last_clean":"2024-04-26T11:13:13.904907+0000","last_became_active":"2024-04-26T11:13:12.912991+0000","last_became_peered":"2024-04-26T11:13:12.912991+0000","last_unstale":"2024-04-26T11:13:13.904907+0000","last_undegraded":"2024-04-26T11:13:13.904907+0000","last_fullsized":"2024-04-26T11:13:13.904907+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:54.809926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904432+0000","last_change":"2024-04-26T11:13:12.490343+0000","last_active":"2024-04-26T11:13:13.904432+0000","last_peered":"2024-04-26T11:13:13.904432+0000","last_clean":"2024-04-26T11:13:13.904432+0000","last_became_active":"2024-04-26T11:13:12.490027+0000","last_became_peered":"2024-04-26T11:13:12.490027+0000","last_unstale":"2024-04-26T11:13:13.904432+0000","last_undegraded":"2024-04-26T11:13:13.904432+0000","last_fullsized":"2024-04-26T11:13:13.904432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:45.693017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904814+0000","last_change":"2024-04-26T11:13:12.918774+0000","last_active":"2024-04-26T11:13:13.904814+0000","last_peered":"2024-04-26T11:13:13.904814+0000","last_clean":"2024-04-26T11:13:13.904814+0000","last_became_active":"2024-04-26T11:13:12.917269+0000","last_became_peered":"2024-04-26T11:13:12.917269+0000","last_unstale":"2024-04-26T11:13:13.904814+0000","last_undegraded":"2024-04-26T11:13:13.904814+0000","last_fullsized":"2024-04-26T11:13:13.904814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:33.358984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904745+0000","last_change":"2024-04-26T11:13:12.494689+0000","last_active":"2024-04-26T11:13:13.904745+0000","last_peered":"2024-04-26T11:13:13.904745+0000","last_clean":"2024-04-26T11:13:13.904745+0000","last_became_active":"2024-04-26T11:13:12.494236+0000","last_became_peered":"2024-04-26T11:13:12.494236+0000","last_unstale":"2024-04-26T11:13:13.904745+0000","last_undegraded":"2024-04-26T11:13:13.904745+0000","last_fullsized":"2024-04-26T11:13:13.904745+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:42.000159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905618+0000","last_change":"2024-04-26T11:13:12.919985+0000","last_active":"2024-04-26T11:13:13.905618+0000","last_peered":"2024-04-26T11:13:13.905618+0000","last_clean":"2024-04-26T11:13:13.905618+0000","last_became_active":"2024-04-26T11:13:12.916239+0000","last_became_peered":"2024-04-26T11:13:12.916239+0000","last_unstale":"2024-04-26T11:13:13.905618+0000","last_undegraded":"2024-04-26T11:13:13.905618+0000","last_fullsized":"2024-04-26T11:13:13.905618+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:54.809926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770064+0000","last_change":"2024-04-26T11:13:12.492856+0000","last_active":"2024-04-26T11:13:14.770064+0000","last_peered":"2024-04-26T11:13:14.770064+0000","last_clean":"2024-04-26T11:13:14.770064+0000","last_became_active":"2024-04-26T11:13:12.492412+0000","last_became_peered":"2024-04-26T11:13:12.492412+0000","last_unstale":"2024-04-26T11:13:14.770064+0000","last_undegraded":"2024-04-26T11:13:14.770064+0000","last_fullsized":"2024-04-26T11:13:14.770064+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:09.572402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905480+0000","last_change":"2024-04-26T11:13:12.920056+0000","last_active":"2024-04-26T11:13:13.905480+0000","last_peered":"2024-04-26T11:13:13.905480+0000","last_clean":"2024-04-26T11:13:13.905480+0000","last_became_active":"2024-04-26T11:13:12.919049+0000","last_became_peered":"2024-04-26T11:13:12.919049+0000","last_unstale":"2024-04-26T11:13:13.905480+0000","last_undegraded":"2024-04-26T11:13:13.905480+0000","last_fullsized":"2024-04-26T11:13:13.905480+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770130+0000","last_change":"2024-04-26T11:13:12.493217+0000","last_active":"2024-04-26T11:13:14.770130+0000","last_peered":"2024-04-26T11:13:14.770130+0000","last_clean":"2024-04-26T11:13:14.770130+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:13:14.770130+0000","last_undegraded":"2024-04-26T11:13:14.770130+0000","last_fullsized":"2024-04-26T11:13:14.770130+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:00.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904940+0000","last_change":"2024-04-26T11:13:12.914321+0000","last_active":"2024-04-26T11:13:13.904940+0000","last_peered":"2024-04-26T11:13:13.904940+0000","last_clean":"2024-04-26T11:13:13.904940+0000","last_became_active":"2024-04-26T11:13:12.913543+0000","last_became_peered":"2024-04-26T11:13:12.913543+0000","last_unstale":"2024-04-26T11:13:13.904940+0000","last_undegraded":"2024-04-26T11:13:13.904940+0000","last_fullsized":"2024-04-26T11:13:13.904940+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.903582+0000","last_change":"2024-04-26T11:13:08.113095+0000","last_active":"2024-04-26T11:13:12.903582+0000","last_peered":"2024-04-26T11:13:12.903582+0000","last_clean":"2024-04-26T11:13:12.903582+0000","last_became_active":"2024-04-26T11:13:08.112778+0000","last_became_peered":"2024-04-26T11:13:08.112778+0000","last_unstale":"2024-04-26T11:13:12.903582+0000","last_undegraded":"2024-04-26T11:13:12.903582+0000","last_fullsized":"2024-04-26T11:13:12.903582+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:41.705893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905517+0000","last_change":"2024-04-26T11:13:12.493960+0000","last_active":"2024-04-26T11:13:13.905517+0000","last_peered":"2024-04-26T11:13:13.905517+0000","last_clean":"2024-04-26T11:13:13.905517+0000","last_became_active":"2024-04-26T11:13:12.493087+0000","last_became_peered":"2024-04-26T11:13:12.493087+0000","last_unstale":"2024-04-26T11:13:13.905517+0000","last_undegraded":"2024-04-26T11:13:13.905517+0000","last_fullsized":"2024-04-26T11:13:13.905517+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:19.538082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770546+0000","last_change":"2024-04-26T11:13:12.917458+0000","last_active":"2024-04-26T11:13:14.770546+0000","last_peered":"2024-04-26T11:13:14.770546+0000","last_clean":"2024-04-26T11:13:14.770546+0000","last_became_active":"2024-04-26T11:13:12.916792+0000","last_became_peered":"2024-04-26T11:13:12.916792+0000","last_unstale":"2024-04-26T11:13:14.770546+0000","last_undegraded":"2024-04-26T11:13:14.770546+0000","last_fullsized":"2024-04-26T11:13:14.770546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:12.483631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.913665+0000","last_change":"2024-04-26T11:13:08.112744+0000","last_active":"2024-04-26T11:13:12.913665+0000","last_peered":"2024-04-26T11:13:12.913665+0000","last_clean":"2024-04-26T11:13:12.913665+0000","last_became_active":"2024-04-26T11:13:08.112498+0000","last_became_peered":"2024-04-26T11:13:08.112498+0000","last_unstale":"2024-04-26T11:13:12.913665+0000","last_undegraded":"2024-04-26T11:13:12.913665+0000","last_fullsized":"2024-04-26T11:13:12.913665+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:38.407116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904845+0000","last_change":"2024-04-26T11:13:12.494137+0000","last_active":"2024-04-26T11:13:13.904845+0000","last_peered":"2024-04-26T11:13:13.904845+0000","last_clean":"2024-04-26T11:13:13.904845+0000","last_became_active":"2024-04-26T11:13:12.493447+0000","last_became_peered":"2024-04-26T11:13:12.493447+0000","last_unstale":"2024-04-26T11:13:13.904845+0000","last_undegraded":"2024-04-26T11:13:13.904845+0000","last_fullsized":"2024-04-26T11:13:13.904845+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:52.644533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904572+0000","last_change":"2024-04-26T11:13:12.912553+0000","last_active":"2024-04-26T11:13:13.904572+0000","last_peered":"2024-04-26T11:13:13.904572+0000","last_clean":"2024-04-26T11:13:13.904572+0000","last_became_active":"2024-04-26T11:13:12.912022+0000","last_became_peered":"2024-04-26T11:13:12.912022+0000","last_unstale":"2024-04-26T11:13:13.904572+0000","last_undegraded":"2024-04-26T11:13:13.904572+0000","last_fullsized":"2024-04-26T11:13:13.904572+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.903369+0000","last_change":"2024-04-26T11:13:08.113650+0000","last_active":"2024-04-26T11:13:12.903369+0000","last_peered":"2024-04-26T11:13:12.903369+0000","last_clean":"2024-04-26T11:13:12.903369+0000","last_became_active":"2024-04-26T11:13:08.113394+0000","last_became_peered":"2024-04-26T11:13:08.113394+0000","last_unstale":"2024-04-26T11:13:12.903369+0000","last_undegraded":"2024-04-26T11:13:12.903369+0000","last_fullsized":"2024-04-26T11:13:12.903369+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:44.642172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770074+0000","last_change":"2024-04-26T11:13:12.492888+0000","last_active":"2024-04-26T11:13:14.770074+0000","last_peered":"2024-04-26T11:13:14.770074+0000","last_clean":"2024-04-26T11:13:14.770074+0000","last_became_active":"2024-04-26T11:13:12.492274+0000","last_became_peered":"2024-04-26T11:13:12.492274+0000","last_unstale":"2024-04-26T11:13:14.770074+0000","last_undegraded":"2024-04-26T11:13:14.770074+0000","last_fullsized":"2024-04-26T11:13:14.770074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:51.136157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905114+0000","last_change":"2024-04-26T11:13:12.914599+0000","last_active":"2024-04-26T11:13:13.905114+0000","last_peered":"2024-04-26T11:13:13.905114+0000","last_clean":"2024-04-26T11:13:13.905114+0000","last_became_active":"2024-04-26T11:13:12.913916+0000","last_became_peered":"2024-04-26T11:13:12.913916+0000","last_unstale":"2024-04-26T11:13:13.905114+0000","last_undegraded":"2024-04-26T11:13:13.905114+0000","last_fullsized":"2024-04-26T11:13:13.905114+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.915840+0000","last_change":"2024-04-26T11:13:08.112690+0000","last_active":"2024-04-26T11:13:12.915840+0000","last_peered":"2024-04-26T11:13:12.915840+0000","last_clean":"2024-04-26T11:13:12.915840+0000","last_became_active":"2024-04-26T11:13:08.112454+0000","last_became_peered":"2024-04-26T11:13:08.112454+0000","last_unstale":"2024-04-26T11:13:12.915840+0000","last_undegraded":"2024-04-26T11:13:12.915840+0000","last_fullsized":"2024-04-26T11:13:12.915840+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:41.011030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.913577+0000","last_change":"2024-04-26T11:13:08.113419+0000","last_active":"2024-04-26T11:13:12.913577+0000","last_peered":"2024-04-26T11:13:12.913577+0000","last_clean":"2024-04-26T11:13:12.913577+0000","last_became_active":"2024-04-26T11:13:08.113154+0000","last_became_peered":"2024-04-26T11:13:08.113154+0000","last_unstale":"2024-04-26T11:13:12.913577+0000","last_undegraded":"2024-04-26T11:13:12.913577+0000","last_fullsized":"2024-04-26T11:13:12.913577+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:36.482001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904292+0000","last_change":"2024-04-26T11:13:12.491278+0000","last_active":"2024-04-26T11:13:13.904292+0000","last_peered":"2024-04-26T11:13:13.904292+0000","last_clean":"2024-04-26T11:13:13.904292+0000","last_became_active":"2024-04-26T11:13:12.488223+0000","last_became_peered":"2024-04-26T11:13:12.488223+0000","last_unstale":"2024-04-26T11:13:13.904292+0000","last_undegraded":"2024-04-26T11:13:13.904292+0000","last_fullsized":"2024-04-26T11:13:13.904292+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:05.413010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905587+0000","last_change":"2024-04-26T11:13:12.920834+0000","last_active":"2024-04-26T11:13:13.905587+0000","last_peered":"2024-04-26T11:13:13.905587+0000","last_clean":"2024-04-26T11:13:13.905587+0000","last_became_active":"2024-04-26T11:13:12.917055+0000","last_became_peered":"2024-04-26T11:13:12.917055+0000","last_unstale":"2024-04-26T11:13:13.905587+0000","last_undegraded":"2024-04-26T11:13:13.905587+0000","last_fullsized":"2024-04-26T11:13:13.905587+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:11.313582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.913563+0000","last_change":"2024-04-26T11:13:08.113497+0000","last_active":"2024-04-26T11:13:12.913563+0000","last_peered":"2024-04-26T11:13:12.913563+0000","last_clean":"2024-04-26T11:13:12.913563+0000","last_became_active":"2024-04-26T11:13:08.113237+0000","last_became_peered":"2024-04-26T11:13:08.113237+0000","last_unstale":"2024-04-26T11:13:12.913563+0000","last_undegraded":"2024-04-26T11:13:12.913563+0000","last_fullsized":"2024-04-26T11:13:12.913563+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:52.240361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904041+0000","last_change":"2024-04-26T11:13:12.491936+0000","last_active":"2024-04-26T11:13:13.904041+0000","last_peered":"2024-04-26T11:13:13.904041+0000","last_clean":"2024-04-26T11:13:13.904041+0000","last_became_active":"2024-04-26T11:13:12.491533+0000","last_became_peered":"2024-04-26T11:13:12.491533+0000","last_unstale":"2024-04-26T11:13:13.904041+0000","last_undegraded":"2024-04-26T11:13:13.904041+0000","last_fullsized":"2024-04-26T11:13:13.904041+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:13.320025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771296+0000","last_change":"2024-04-26T11:13:12.918648+0000","last_active":"2024-04-26T11:13:14.771296+0000","last_peered":"2024-04-26T11:13:14.771296+0000","last_clean":"2024-04-26T11:13:14.771296+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:13:14.771296+0000","last_undegraded":"2024-04-26T11:13:14.771296+0000","last_fullsized":"2024-04-26T11:13:14.771296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.907846+0000","last_change":"2024-04-26T11:13:08.110433+0000","last_active":"2024-04-26T11:13:12.907846+0000","last_peered":"2024-04-26T11:13:12.907846+0000","last_clean":"2024-04-26T11:13:12.907846+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:13:12.907846+0000","last_undegraded":"2024-04-26T11:13:12.907846+0000","last_fullsized":"2024-04-26T11:13:12.907846+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904956+0000","last_change":"2024-04-26T11:13:12.491648+0000","last_active":"2024-04-26T11:13:13.904956+0000","last_peered":"2024-04-26T11:13:13.904956+0000","last_clean":"2024-04-26T11:13:13.904956+0000","last_became_active":"2024-04-26T11:13:12.488599+0000","last_became_peered":"2024-04-26T11:13:12.488599+0000","last_unstale":"2024-04-26T11:13:13.904956+0000","last_undegraded":"2024-04-26T11:13:13.904956+0000","last_fullsized":"2024-04-26T11:13:13.904956+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:45.374565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770640+0000","last_change":"2024-04-26T11:13:12.920065+0000","last_active":"2024-04-26T11:13:14.770640+0000","last_peered":"2024-04-26T11:13:14.770640+0000","last_clean":"2024-04-26T11:13:14.770640+0000","last_became_active":"2024-04-26T11:13:12.919741+0000","last_became_peered":"2024-04-26T11:13:12.919741+0000","last_unstale":"2024-04-26T11:13:14.770640+0000","last_undegraded":"2024-04-26T11:13:14.770640+0000","last_fullsized":"2024-04-26T11:13:14.770640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:20.837217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904894+0000","last_change":"2024-04-26T11:13:12.488576+0000","last_active":"2024-04-26T11:13:13.904894+0000","last_peered":"2024-04-26T11:13:13.904894+0000","last_clean":"2024-04-26T11:13:13.904894+0000","last_became_active":"2024-04-26T11:13:12.488248+0000","last_became_peered":"2024-04-26T11:13:12.488248+0000","last_unstale":"2024-04-26T11:13:13.904894+0000","last_undegraded":"2024-04-26T11:13:13.904894+0000","last_fullsized":"2024-04-26T11:13:13.904894+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:48.928740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.904393+0000","last_change":"2024-04-26T11:13:08.113157+0000","last_active":"2024-04-26T11:13:12.904393+0000","last_peered":"2024-04-26T11:13:12.904393+0000","last_clean":"2024-04-26T11:13:12.904393+0000","last_became_active":"2024-04-26T11:13:08.112788+0000","last_became_peered":"2024-04-26T11:13:08.112788+0000","last_unstale":"2024-04-26T11:13:12.904393+0000","last_undegraded":"2024-04-26T11:13:12.904393+0000","last_fullsized":"2024-04-26T11:13:12.904393+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:14.606433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904028+0000","last_change":"2024-04-26T11:13:12.919100+0000","last_active":"2024-04-26T11:13:13.904028+0000","last_peered":"2024-04-26T11:13:13.904028+0000","last_clean":"2024-04-26T11:13:13.904028+0000","last_became_active":"2024-04-26T11:13:12.918816+0000","last_became_peered":"2024-04-26T11:13:12.918816+0000","last_unstale":"2024-04-26T11:13:13.904028+0000","last_undegraded":"2024-04-26T11:13:13.904028+0000","last_fullsized":"2024-04-26T11:13:13.904028+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.915609+0000","last_change":"2024-04-26T11:13:08.113505+0000","last_active":"2024-04-26T11:13:12.915609+0000","last_peered":"2024-04-26T11:13:12.915609+0000","last_clean":"2024-04-26T11:13:12.915609+0000","last_became_active":"2024-04-26T11:13:08.113224+0000","last_became_peered":"2024-04-26T11:13:08.113224+0000","last_unstale":"2024-04-26T11:13:12.915609+0000","last_undegraded":"2024-04-26T11:13:12.915609+0000","last_fullsized":"2024-04-26T11:13:12.915609+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:16.157275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:16.455948+0000","last_change":"2024-04-26T11:13:12.490249+0000","last_active":"2024-04-26T11:13:16.455948+0000","last_peered":"2024-04-26T11:13:16.455948+0000","last_clean":"2024-04-26T11:13:16.455948+0000","last_became_active":"2024-04-26T11:13:12.488836+0000","last_became_peered":"2024-04-26T11:13:12.488836+0000","last_unstale":"2024-04-26T11:13:16.455948+0000","last_undegraded":"2024-04-26T11:13:16.455948+0000","last_fullsized":"2024-04-26T11:13:16.455948+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:12.581788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770387+0000","last_change":"2024-04-26T11:13:12.913955+0000","last_active":"2024-04-26T11:13:14.770387+0000","last_peered":"2024-04-26T11:13:14.770387+0000","last_clean":"2024-04-26T11:13:14.770387+0000","last_became_active":"2024-04-26T11:13:12.913037+0000","last_became_peered":"2024-04-26T11:13:12.913037+0000","last_unstale":"2024-04-26T11:13:14.770387+0000","last_undegraded":"2024-04-26T11:13:14.770387+0000","last_fullsized":"2024-04-26T11:13:14.770387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:11.313582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770475+0000","last_change":"2024-04-26T11:13:12.493479+0000","last_active":"2024-04-26T11:13:14.770475+0000","last_peered":"2024-04-26T11:13:14.770475+0000","last_clean":"2024-04-26T11:13:14.770475+0000","last_became_active":"2024-04-26T11:13:12.493174+0000","last_became_peered":"2024-04-26T11:13:12.493174+0000","last_unstale":"2024-04-26T11:13:14.770475+0000","last_undegraded":"2024-04-26T11:13:14.770475+0000","last_fullsized":"2024-04-26T11:13:14.770475+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:05.413010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770803+0000","last_change":"2024-04-26T11:13:12.917812+0000","last_active":"2024-04-26T11:13:14.770803+0000","last_peered":"2024-04-26T11:13:14.770803+0000","last_clean":"2024-04-26T11:13:14.770803+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:13:14.770803+0000","last_undegraded":"2024-04-26T11:13:14.770803+0000","last_fullsized":"2024-04-26T11:13:14.770803+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904950+0000","last_change":"2024-04-26T11:13:12.493351+0000","last_active":"2024-04-26T11:13:13.904950+0000","last_peered":"2024-04-26T11:13:13.904950+0000","last_clean":"2024-04-26T11:13:13.904950+0000","last_became_active":"2024-04-26T11:13:12.492923+0000","last_became_peered":"2024-04-26T11:13:12.492923+0000","last_unstale":"2024-04-26T11:13:13.904950+0000","last_undegraded":"2024-04-26T11:13:13.904950+0000","last_fullsized":"2024-04-26T11:13:13.904950+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:53.444842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904852+0000","last_change":"2024-04-26T11:13:12.918383+0000","last_active":"2024-04-26T11:13:13.904852+0000","last_peered":"2024-04-26T11:13:13.904852+0000","last_clean":"2024-04-26T11:13:13.904852+0000","last_became_active":"2024-04-26T11:13:12.917098+0000","last_became_peered":"2024-04-26T11:13:12.917098+0000","last_unstale":"2024-04-26T11:13:13.904852+0000","last_undegraded":"2024-04-26T11:13:13.904852+0000","last_fullsized":"2024-04-26T11:13:13.904852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:43.397887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770971+0000","last_change":"2024-04-26T11:13:12.493387+0000","last_active":"2024-04-26T11:13:14.770971+0000","last_peered":"2024-04-26T11:13:14.770971+0000","last_clean":"2024-04-26T11:13:14.770971+0000","last_became_active":"2024-04-26T11:13:12.493158+0000","last_became_peered":"2024-04-26T11:13:12.493158+0000","last_unstale":"2024-04-26T11:13:14.770971+0000","last_undegraded":"2024-04-26T11:13:14.770971+0000","last_fullsized":"2024-04-26T11:13:14.770971+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:56.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904899+0000","last_change":"2024-04-26T11:13:12.920137+0000","last_active":"2024-04-26T11:13:13.904899+0000","last_peered":"2024-04-26T11:13:13.904899+0000","last_clean":"2024-04-26T11:13:13.904899+0000","last_became_active":"2024-04-26T11:13:12.919020+0000","last_became_peered":"2024-04-26T11:13:12.919020+0000","last_unstale":"2024-04-26T11:13:13.904899+0000","last_undegraded":"2024-04-26T11:13:13.904899+0000","last_fullsized":"2024-04-26T11:13:13.904899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:47.014768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905092+0000","last_change":"2024-04-26T11:13:12.490017+0000","last_active":"2024-04-26T11:13:13.905092+0000","last_peered":"2024-04-26T11:13:13.905092+0000","last_clean":"2024-04-26T11:13:13.905092+0000","last_became_active":"2024-04-26T11:13:12.488282+0000","last_became_peered":"2024-04-26T11:13:12.488282+0000","last_unstale":"2024-04-26T11:13:13.905092+0000","last_undegraded":"2024-04-26T11:13:13.905092+0000","last_fullsized":"2024-04-26T11:13:13.905092+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:20.176849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770666+0000","last_change":"2024-04-26T11:13:12.917763+0000","last_active":"2024-04-26T11:13:14.770666+0000","last_peered":"2024-04-26T11:13:14.770666+0000","last_clean":"2024-04-26T11:13:14.770666+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:13:14.770666+0000","last_undegraded":"2024-04-26T11:13:14.770666+0000","last_fullsized":"2024-04-26T11:13:14.770666+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905010+0000","last_change":"2024-04-26T11:13:12.491798+0000","last_active":"2024-04-26T11:13:13.905010+0000","last_peered":"2024-04-26T11:13:13.905010+0000","last_clean":"2024-04-26T11:13:13.905010+0000","last_became_active":"2024-04-26T11:13:12.490582+0000","last_became_peered":"2024-04-26T11:13:12.490582+0000","last_unstale":"2024-04-26T11:13:13.905010+0000","last_undegraded":"2024-04-26T11:13:13.905010+0000","last_fullsized":"2024-04-26T11:13:13.905010+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:46.082467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904998+0000","last_change":"2024-04-26T11:13:12.914549+0000","last_active":"2024-04-26T11:13:13.904998+0000","last_peered":"2024-04-26T11:13:13.904998+0000","last_clean":"2024-04-26T11:13:13.904998+0000","last_became_active":"2024-04-26T11:13:12.913041+0000","last_became_peered":"2024-04-26T11:13:12.913041+0000","last_unstale":"2024-04-26T11:13:13.904998+0000","last_undegraded":"2024-04-26T11:13:13.904998+0000","last_fullsized":"2024-04-26T11:13:13.904998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904654+0000","last_change":"2024-04-26T11:13:12.916942+0000","last_active":"2024-04-26T11:13:13.904654+0000","last_peered":"2024-04-26T11:13:13.904654+0000","last_clean":"2024-04-26T11:13:13.904654+0000","last_became_active":"2024-04-26T11:13:12.916144+0000","last_became_peered":"2024-04-26T11:13:12.916144+0000","last_unstale":"2024-04-26T11:13:13.904654+0000","last_undegraded":"2024-04-26T11:13:13.904654+0000","last_fullsized":"2024-04-26T11:13:13.904654+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:46.610126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904072+0000","last_change":"2024-04-26T11:13:12.913826+0000","last_active":"2024-04-26T11:13:13.904072+0000","last_peered":"2024-04-26T11:13:13.904072+0000","last_clean":"2024-04-26T11:13:13.904072+0000","last_became_active":"2024-04-26T11:13:12.912911+0000","last_became_peered":"2024-04-26T11:13:12.912911+0000","last_unstale":"2024-04-26T11:13:13.904072+0000","last_undegraded":"2024-04-26T11:13:13.904072+0000","last_fullsized":"2024-04-26T11:13:13.904072+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:10.887079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770469+0000","last_change":"2024-04-26T11:13:12.921818+0000","last_active":"2024-04-26T11:13:14.770469+0000","last_peered":"2024-04-26T11:13:14.770469+0000","last_clean":"2024-04-26T11:13:14.770469+0000","last_became_active":"2024-04-26T11:13:12.921526+0000","last_became_peered":"2024-04-26T11:13:12.921526+0000","last_unstale":"2024-04-26T11:13:14.770469+0000","last_undegraded":"2024-04-26T11:13:14.770469+0000","last_fullsized":"2024-04-26T11:13:14.770469+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:47.958725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904819+0000","last_change":"2024-04-26T11:13:12.912731+0000","last_active":"2024-04-26T11:13:13.904819+0000","last_peered":"2024-04-26T11:13:13.904819+0000","last_clean":"2024-04-26T11:13:13.904819+0000","last_became_active":"2024-04-26T11:13:12.911522+0000","last_became_peered":"2024-04-26T11:13:12.911522+0000","last_unstale":"2024-04-26T11:13:13.904819+0000","last_undegraded":"2024-04-26T11:13:13.904819+0000","last_fullsized":"2024-04-26T11:13:13.904819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:46.610126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770830+0000","last_change":"2024-04-26T11:13:12.919750+0000","last_active":"2024-04-26T11:13:14.770830+0000","last_peered":"2024-04-26T11:13:14.770830+0000","last_clean":"2024-04-26T11:13:14.770830+0000","last_became_active":"2024-04-26T11:13:12.919116+0000","last_became_peered":"2024-04-26T11:13:12.919116+0000","last_unstale":"2024-04-26T11:13:14.770830+0000","last_undegraded":"2024-04-26T11:13:14.770830+0000","last_fullsized":"2024-04-26T11:13:14.770830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:10.887079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":745472,"data_stored":637050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:13:25.663 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:13:26.046 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:26.048 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:13:26.058 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-26T11:13:24.453244+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86788,"kb_used_data":1604,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028732,"statfs":{"total":289910292480,"available":289821421568,"internally_reserved":0,"allocated":1642496,"data_stored":1322490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.550745"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771368+0000","last_change":"2024-04-26T11:13:12.919196+0000","last_active":"2024-04-26T11:13:14.771368+0000","last_peered":"2024-04-26T11:13:14.771368+0000","last_clean":"2024-04-26T11:13:14.771368+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:13:14.771368+0000","last_undegraded":"2024-04-26T11:13:14.771368+0000","last_fullsized":"2024-04-26T11:13:14.771368+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771085+0000","last_change":"2024-04-26T11:13:12.917670+0000","last_active":"2024-04-26T11:13:14.771085+0000","last_peered":"2024-04-26T11:13:14.771085+0000","last_clean":"2024-04-26T11:13:14.771085+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:13:14.771085+0000","last_undegraded":"2024-04-26T11:13:14.771085+0000","last_fullsized":"2024-04-26T11:13:14.771085+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905470+0000","last_change":"2024-04-26T11:13:12.922235+0000","last_active":"2024-04-26T11:13:13.905470+0000","last_peered":"2024-04-26T11:13:13.905470+0000","last_clean":"2024-04-26T11:13:13.905470+0000","last_became_active":"2024-04-26T11:13:12.919993+0000","last_became_peered":"2024-04-26T11:13:12.919993+0000","last_unstale":"2024-04-26T11:13:13.905470+0000","last_undegraded":"2024-04-26T11:13:13.905470+0000","last_fullsized":"2024-04-26T11:13:13.905470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:41.004462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905212+0000","last_change":"2024-04-26T11:13:12.916859+0000","last_active":"2024-04-26T11:13:13.905212+0000","last_peered":"2024-04-26T11:13:13.905212+0000","last_clean":"2024-04-26T11:13:13.905212+0000","last_became_active":"2024-04-26T11:13:12.915591+0000","last_became_peered":"2024-04-26T11:13:12.915591+0000","last_unstale":"2024-04-26T11:13:13.905212+0000","last_undegraded":"2024-04-26T11:13:13.905212+0000","last_fullsized":"2024-04-26T11:13:13.905212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:52.543148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770643+0000","last_change":"2024-04-26T11:13:12.917403+0000","last_active":"2024-04-26T11:13:14.770643+0000","last_peered":"2024-04-26T11:13:14.770643+0000","last_clean":"2024-04-26T11:13:14.770643+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:13:14.770643+0000","last_undegraded":"2024-04-26T11:13:14.770643+0000","last_fullsized":"2024-04-26T11:13:14.770643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:42.014955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904599+0000","last_change":"2024-04-26T11:13:12.918802+0000","last_active":"2024-04-26T11:13:13.904599+0000","last_peered":"2024-04-26T11:13:13.904599+0000","last_clean":"2024-04-26T11:13:13.904599+0000","last_became_active":"2024-04-26T11:13:12.917353+0000","last_became_peered":"2024-04-26T11:13:12.917353+0000","last_unstale":"2024-04-26T11:13:13.904599+0000","last_undegraded":"2024-04-26T11:13:13.904599+0000","last_fullsized":"2024-04-26T11:13:13.904599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:08.956085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904746+0000","last_change":"2024-04-26T11:13:12.916789+0000","last_active":"2024-04-26T11:13:13.904746+0000","last_peered":"2024-04-26T11:13:13.904746+0000","last_clean":"2024-04-26T11:13:13.904746+0000","last_became_active":"2024-04-26T11:13:12.914947+0000","last_became_peered":"2024-04-26T11:13:12.914947+0000","last_unstale":"2024-04-26T11:13:13.904746+0000","last_undegraded":"2024-04-26T11:13:13.904746+0000","last_fullsized":"2024-04-26T11:13:13.904746+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904343+0000","last_change":"2024-04-26T11:13:12.919968+0000","last_active":"2024-04-26T11:13:13.904343+0000","last_peered":"2024-04-26T11:13:13.904343+0000","last_clean":"2024-04-26T11:13:13.904343+0000","last_became_active":"2024-04-26T11:13:12.918600+0000","last_became_peered":"2024-04-26T11:13:12.918600+0000","last_unstale":"2024-04-26T11:13:13.904343+0000","last_undegraded":"2024-04-26T11:13:13.904343+0000","last_fullsized":"2024-04-26T11:13:13.904343+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:41.073901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904753+0000","last_change":"2024-04-26T11:13:12.914649+0000","last_active":"2024-04-26T11:13:13.904753+0000","last_peered":"2024-04-26T11:13:13.904753+0000","last_clean":"2024-04-26T11:13:13.904753+0000","last_became_active":"2024-04-26T11:13:12.914174+0000","last_became_peered":"2024-04-26T11:13:12.914174+0000","last_unstale":"2024-04-26T11:13:13.904753+0000","last_undegraded":"2024-04-26T11:13:13.904753+0000","last_fullsized":"2024-04-26T11:13:13.904753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:41.004462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771235+0000","last_change":"2024-04-26T11:13:12.918521+0000","last_active":"2024-04-26T11:13:14.771235+0000","last_peered":"2024-04-26T11:13:14.771235+0000","last_clean":"2024-04-26T11:13:14.771235+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:13:14.771235+0000","last_undegraded":"2024-04-26T11:13:14.771235+0000","last_fullsized":"2024-04-26T11:13:14.771235+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905226+0000","last_change":"2024-04-26T11:13:12.922456+0000","last_active":"2024-04-26T11:13:13.905226+0000","last_peered":"2024-04-26T11:13:13.905226+0000","last_clean":"2024-04-26T11:13:13.905226+0000","last_became_active":"2024-04-26T11:13:12.921230+0000","last_became_peered":"2024-04-26T11:13:12.921230+0000","last_unstale":"2024-04-26T11:13:13.905226+0000","last_undegraded":"2024-04-26T11:13:13.905226+0000","last_fullsized":"2024-04-26T11:13:13.905226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:55.318150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770399+0000","last_change":"2024-04-26T11:13:12.914082+0000","last_active":"2024-04-26T11:13:14.770399+0000","last_peered":"2024-04-26T11:13:14.770399+0000","last_clean":"2024-04-26T11:13:14.770399+0000","last_became_active":"2024-04-26T11:13:12.913374+0000","last_became_peered":"2024-04-26T11:13:12.913374+0000","last_unstale":"2024-04-26T11:13:14.770399+0000","last_undegraded":"2024-04-26T11:13:14.770399+0000","last_fullsized":"2024-04-26T11:13:14.770399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:52.543148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770460+0000","last_change":"2024-04-26T11:13:12.915484+0000","last_active":"2024-04-26T11:13:14.770460+0000","last_peered":"2024-04-26T11:13:14.770460+0000","last_clean":"2024-04-26T11:13:14.770460+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:13:14.770460+0000","last_undegraded":"2024-04-26T11:13:14.770460+0000","last_fullsized":"2024-04-26T11:13:14.770460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905148+0000","last_change":"2024-04-26T11:13:12.914318+0000","last_active":"2024-04-26T11:13:13.905148+0000","last_peered":"2024-04-26T11:13:13.905148+0000","last_clean":"2024-04-26T11:13:13.905148+0000","last_became_active":"2024-04-26T11:13:12.913437+0000","last_became_peered":"2024-04-26T11:13:12.913437+0000","last_unstale":"2024-04-26T11:13:13.905148+0000","last_undegraded":"2024-04-26T11:13:13.905148+0000","last_fullsized":"2024-04-26T11:13:13.905148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904484+0000","last_change":"2024-04-26T11:13:12.914523+0000","last_active":"2024-04-26T11:13:13.904484+0000","last_peered":"2024-04-26T11:13:13.904484+0000","last_clean":"2024-04-26T11:13:13.904484+0000","last_became_active":"2024-04-26T11:13:12.913241+0000","last_became_peered":"2024-04-26T11:13:12.913241+0000","last_unstale":"2024-04-26T11:13:13.904484+0000","last_undegraded":"2024-04-26T11:13:13.904484+0000","last_fullsized":"2024-04-26T11:13:13.904484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:10.887079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904389+0000","last_change":"2024-04-26T11:13:12.922145+0000","last_active":"2024-04-26T11:13:13.904389+0000","last_peered":"2024-04-26T11:13:13.904389+0000","last_clean":"2024-04-26T11:13:13.904389+0000","last_became_active":"2024-04-26T11:13:12.919048+0000","last_became_peered":"2024-04-26T11:13:12.919048+0000","last_unstale":"2024-04-26T11:13:13.904389+0000","last_undegraded":"2024-04-26T11:13:13.904389+0000","last_fullsized":"2024-04-26T11:13:13.904389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:47.958725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904823+0000","last_change":"2024-04-26T11:13:12.914484+0000","last_active":"2024-04-26T11:13:13.904823+0000","last_peered":"2024-04-26T11:13:13.904823+0000","last_clean":"2024-04-26T11:13:13.904823+0000","last_became_active":"2024-04-26T11:13:12.913596+0000","last_became_peered":"2024-04-26T11:13:12.913596+0000","last_unstale":"2024-04-26T11:13:13.904823+0000","last_undegraded":"2024-04-26T11:13:13.904823+0000","last_fullsized":"2024-04-26T11:13:13.904823+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:38.001491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771320+0000","last_change":"2024-04-26T11:13:12.918759+0000","last_active":"2024-04-26T11:13:14.771320+0000","last_peered":"2024-04-26T11:13:14.771320+0000","last_clean":"2024-04-26T11:13:14.771320+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:13:14.771320+0000","last_undegraded":"2024-04-26T11:13:14.771320+0000","last_fullsized":"2024-04-26T11:13:14.771320+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:55.002972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904592+0000","last_change":"2024-04-26T11:13:12.917334+0000","last_active":"2024-04-26T11:13:13.904592+0000","last_peered":"2024-04-26T11:13:13.904592+0000","last_clean":"2024-04-26T11:13:13.904592+0000","last_became_active":"2024-04-26T11:13:12.917010+0000","last_became_peered":"2024-04-26T11:13:12.917010+0000","last_unstale":"2024-04-26T11:13:13.904592+0000","last_undegraded":"2024-04-26T11:13:13.904592+0000","last_fullsized":"2024-04-26T11:13:13.904592+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:52.543148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905177+0000","last_change":"2024-04-26T11:13:12.917519+0000","last_active":"2024-04-26T11:13:13.905177+0000","last_peered":"2024-04-26T11:13:13.905177+0000","last_clean":"2024-04-26T11:13:13.905177+0000","last_became_active":"2024-04-26T11:13:12.916985+0000","last_became_peered":"2024-04-26T11:13:12.916985+0000","last_unstale":"2024-04-26T11:13:13.905177+0000","last_undegraded":"2024-04-26T11:13:13.905177+0000","last_fullsized":"2024-04-26T11:13:13.905177+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:38.001491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904702+0000","last_change":"2024-04-26T11:13:12.919641+0000","last_active":"2024-04-26T11:13:13.904702+0000","last_peered":"2024-04-26T11:13:13.904702+0000","last_clean":"2024-04-26T11:13:13.904702+0000","last_became_active":"2024-04-26T11:13:12.918830+0000","last_became_peered":"2024-04-26T11:13:12.918830+0000","last_unstale":"2024-04-26T11:13:13.904702+0000","last_undegraded":"2024-04-26T11:13:13.904702+0000","last_fullsized":"2024-04-26T11:13:13.904702+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:52.714816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770332+0000","last_change":"2024-04-26T11:13:12.914087+0000","last_active":"2024-04-26T11:13:14.770332+0000","last_peered":"2024-04-26T11:13:14.770332+0000","last_clean":"2024-04-26T11:13:14.770332+0000","last_became_active":"2024-04-26T11:13:12.913393+0000","last_became_peered":"2024-04-26T11:13:12.913393+0000","last_unstale":"2024-04-26T11:13:14.770332+0000","last_undegraded":"2024-04-26T11:13:14.770332+0000","last_fullsized":"2024-04-26T11:13:14.770332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:38.001491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.903953+0000","last_change":"2024-04-26T11:13:12.918407+0000","last_active":"2024-04-26T11:13:13.903953+0000","last_peered":"2024-04-26T11:13:13.903953+0000","last_clean":"2024-04-26T11:13:13.903953+0000","last_became_active":"2024-04-26T11:13:12.918176+0000","last_became_peered":"2024-04-26T11:13:12.918176+0000","last_unstale":"2024-04-26T11:13:13.903953+0000","last_undegraded":"2024-04-26T11:13:13.903953+0000","last_fullsized":"2024-04-26T11:13:13.903953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770185+0000","last_change":"2024-04-26T11:13:12.912756+0000","last_active":"2024-04-26T11:13:14.770185+0000","last_peered":"2024-04-26T11:13:14.770185+0000","last_clean":"2024-04-26T11:13:14.770185+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:13:14.770185+0000","last_undegraded":"2024-04-26T11:13:14.770185+0000","last_fullsized":"2024-04-26T11:13:14.770185+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:04.177831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771368+0000","last_change":"2024-04-26T11:13:12.920122+0000","last_active":"2024-04-26T11:13:14.771368+0000","last_peered":"2024-04-26T11:13:14.771368+0000","last_clean":"2024-04-26T11:13:14.771368+0000","last_became_active":"2024-04-26T11:13:12.919792+0000","last_became_peered":"2024-04-26T11:13:12.919792+0000","last_unstale":"2024-04-26T11:13:14.771368+0000","last_undegraded":"2024-04-26T11:13:14.771368+0000","last_fullsized":"2024-04-26T11:13:14.771368+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:54.809926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904864+0000","last_change":"2024-04-26T11:13:12.912803+0000","last_active":"2024-04-26T11:13:13.904864+0000","last_peered":"2024-04-26T11:13:13.904864+0000","last_clean":"2024-04-26T11:13:13.904864+0000","last_became_active":"2024-04-26T11:13:12.912254+0000","last_became_peered":"2024-04-26T11:13:12.912254+0000","last_unstale":"2024-04-26T11:13:13.904864+0000","last_undegraded":"2024-04-26T11:13:13.904864+0000","last_fullsized":"2024-04-26T11:13:13.904864+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:11.313582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905305+0000","last_change":"2024-04-26T11:13:12.921062+0000","last_active":"2024-04-26T11:13:13.905305+0000","last_peered":"2024-04-26T11:13:13.905305+0000","last_clean":"2024-04-26T11:13:13.905305+0000","last_became_active":"2024-04-26T11:13:12.918716+0000","last_became_peered":"2024-04-26T11:13:12.918716+0000","last_unstale":"2024-04-26T11:13:13.905305+0000","last_undegraded":"2024-04-26T11:13:13.905305+0000","last_fullsized":"2024-04-26T11:13:13.905305+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:55.576807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770220+0000","last_change":"2024-04-26T11:13:12.493425+0000","last_active":"2024-04-26T11:13:14.770220+0000","last_peered":"2024-04-26T11:13:14.770220+0000","last_clean":"2024-04-26T11:13:14.770220+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:13:14.770220+0000","last_undegraded":"2024-04-26T11:13:14.770220+0000","last_fullsized":"2024-04-26T11:13:14.770220+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:23.279580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771122+0000","last_change":"2024-04-26T11:13:12.918515+0000","last_active":"2024-04-26T11:13:14.771122+0000","last_peered":"2024-04-26T11:13:14.771122+0000","last_clean":"2024-04-26T11:13:14.771122+0000","last_became_active":"2024-04-26T11:13:12.918002+0000","last_became_peered":"2024-04-26T11:13:12.918002+0000","last_unstale":"2024-04-26T11:13:14.771122+0000","last_undegraded":"2024-04-26T11:13:14.771122+0000","last_fullsized":"2024-04-26T11:13:14.771122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:46.610126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904192+0000","last_change":"2024-04-26T11:13:12.490257+0000","last_active":"2024-04-26T11:13:13.904192+0000","last_peered":"2024-04-26T11:13:13.904192+0000","last_clean":"2024-04-26T11:13:13.904192+0000","last_became_active":"2024-04-26T11:13:12.488819+0000","last_became_peered":"2024-04-26T11:13:12.488819+0000","last_unstale":"2024-04-26T11:13:13.904192+0000","last_undegraded":"2024-04-26T11:13:13.904192+0000","last_fullsized":"2024-04-26T11:13:13.904192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:52.644533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904995+0000","last_change":"2024-04-26T11:13:12.915624+0000","last_active":"2024-04-26T11:13:13.904995+0000","last_peered":"2024-04-26T11:13:13.904995+0000","last_clean":"2024-04-26T11:13:13.904995+0000","last_became_active":"2024-04-26T11:13:12.915375+0000","last_became_peered":"2024-04-26T11:13:12.915375+0000","last_unstale":"2024-04-26T11:13:13.904995+0000","last_undegraded":"2024-04-26T11:13:13.904995+0000","last_fullsized":"2024-04-26T11:13:13.904995+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:28.908758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904382+0000","last_change":"2024-04-26T11:13:12.487990+0000","last_active":"2024-04-26T11:13:13.904382+0000","last_peered":"2024-04-26T11:13:13.904382+0000","last_clean":"2024-04-26T11:13:13.904382+0000","last_became_active":"2024-04-26T11:13:12.486848+0000","last_became_peered":"2024-04-26T11:13:12.486848+0000","last_unstale":"2024-04-26T11:13:13.904382+0000","last_undegraded":"2024-04-26T11:13:13.904382+0000","last_fullsized":"2024-04-26T11:13:13.904382+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:56.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771304+0000","last_change":"2024-04-26T11:13:12.917423+0000","last_active":"2024-04-26T11:13:14.771304+0000","last_peered":"2024-04-26T11:13:14.771304+0000","last_clean":"2024-04-26T11:13:14.771304+0000","last_became_active":"2024-04-26T11:13:12.916811+0000","last_became_peered":"2024-04-26T11:13:12.916811+0000","last_unstale":"2024-04-26T11:13:14.771304+0000","last_undegraded":"2024-04-26T11:13:14.771304+0000","last_fullsized":"2024-04-26T11:13:14.771304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:28.908758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905043+0000","last_change":"2024-04-26T11:13:12.490251+0000","last_active":"2024-04-26T11:13:13.905043+0000","last_peered":"2024-04-26T11:13:13.905043+0000","last_clean":"2024-04-26T11:13:13.905043+0000","last_became_active":"2024-04-26T11:13:12.489836+0000","last_became_peered":"2024-04-26T11:13:12.489836+0000","last_unstale":"2024-04-26T11:13:13.905043+0000","last_undegraded":"2024-04-26T11:13:13.905043+0000","last_fullsized":"2024-04-26T11:13:13.905043+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:42.000159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.903972+0000","last_change":"2024-04-26T11:13:12.912865+0000","last_active":"2024-04-26T11:13:13.903972+0000","last_peered":"2024-04-26T11:13:13.903972+0000","last_clean":"2024-04-26T11:13:13.903972+0000","last_became_active":"2024-04-26T11:13:12.912397+0000","last_became_peered":"2024-04-26T11:13:12.912397+0000","last_unstale":"2024-04-26T11:13:13.903972+0000","last_undegraded":"2024-04-26T11:13:13.903972+0000","last_fullsized":"2024-04-26T11:13:13.903972+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905218+0000","last_change":"2024-04-26T11:13:12.493118+0000","last_active":"2024-04-26T11:13:13.905218+0000","last_peered":"2024-04-26T11:13:13.905218+0000","last_clean":"2024-04-26T11:13:13.905218+0000","last_became_active":"2024-04-26T11:13:12.492799+0000","last_became_peered":"2024-04-26T11:13:12.492799+0000","last_unstale":"2024-04-26T11:13:13.905218+0000","last_undegraded":"2024-04-26T11:13:13.905218+0000","last_fullsized":"2024-04-26T11:13:13.905218+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:46.082467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904510+0000","last_change":"2024-04-26T11:13:12.918149+0000","last_active":"2024-04-26T11:13:13.904510+0000","last_peered":"2024-04-26T11:13:13.904510+0000","last_clean":"2024-04-26T11:13:13.904510+0000","last_became_active":"2024-04-26T11:13:12.917636+0000","last_became_peered":"2024-04-26T11:13:12.917636+0000","last_unstale":"2024-04-26T11:13:13.904510+0000","last_undegraded":"2024-04-26T11:13:13.904510+0000","last_fullsized":"2024-04-26T11:13:13.904510+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:20.837217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770906+0000","last_change":"2024-04-26T11:13:12.495785+0000","last_active":"2024-04-26T11:13:14.770906+0000","last_peered":"2024-04-26T11:13:14.770906+0000","last_clean":"2024-04-26T11:13:14.770906+0000","last_became_active":"2024-04-26T11:13:12.495527+0000","last_became_peered":"2024-04-26T11:13:12.495527+0000","last_unstale":"2024-04-26T11:13:14.770906+0000","last_undegraded":"2024-04-26T11:13:14.770906+0000","last_fullsized":"2024-04-26T11:13:14.770906+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:45.374565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904416+0000","last_change":"2024-04-26T11:13:12.913698+0000","last_active":"2024-04-26T11:13:13.904416+0000","last_peered":"2024-04-26T11:13:13.904416+0000","last_clean":"2024-04-26T11:13:13.904416+0000","last_became_active":"2024-04-26T11:13:12.913198+0000","last_became_peered":"2024-04-26T11:13:12.913198+0000","last_unstale":"2024-04-26T11:13:13.904416+0000","last_undegraded":"2024-04-26T11:13:13.904416+0000","last_fullsized":"2024-04-26T11:13:13.904416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905059+0000","last_change":"2024-04-26T11:13:12.492878+0000","last_active":"2024-04-26T11:13:13.905059+0000","last_peered":"2024-04-26T11:13:13.905059+0000","last_clean":"2024-04-26T11:13:13.905059+0000","last_became_active":"2024-04-26T11:13:12.491690+0000","last_became_peered":"2024-04-26T11:13:12.491690+0000","last_unstale":"2024-04-26T11:13:13.905059+0000","last_undegraded":"2024-04-26T11:13:13.905059+0000","last_fullsized":"2024-04-26T11:13:13.905059+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:12.581788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905197+0000","last_change":"2024-04-26T11:13:12.916914+0000","last_active":"2024-04-26T11:13:13.905197+0000","last_peered":"2024-04-26T11:13:13.905197+0000","last_clean":"2024-04-26T11:13:13.905197+0000","last_became_active":"2024-04-26T11:13:12.913900+0000","last_became_peered":"2024-04-26T11:13:12.913900+0000","last_unstale":"2024-04-26T11:13:13.905197+0000","last_undegraded":"2024-04-26T11:13:13.905197+0000","last_fullsized":"2024-04-26T11:13:13.905197+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:28.908758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905107+0000","last_change":"2024-04-26T11:13:12.493445+0000","last_active":"2024-04-26T11:13:13.905107+0000","last_peered":"2024-04-26T11:13:13.905107+0000","last_clean":"2024-04-26T11:13:13.905107+0000","last_became_active":"2024-04-26T11:13:12.493015+0000","last_became_peered":"2024-04-26T11:13:12.493015+0000","last_unstale":"2024-04-26T11:13:13.905107+0000","last_undegraded":"2024-04-26T11:13:13.905107+0000","last_fullsized":"2024-04-26T11:13:13.905107+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:17.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770711+0000","last_change":"2024-04-26T11:13:12.916685+0000","last_active":"2024-04-26T11:13:14.770711+0000","last_peered":"2024-04-26T11:13:14.770711+0000","last_clean":"2024-04-26T11:13:14.770711+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:13:14.770711+0000","last_undegraded":"2024-04-26T11:13:14.770711+0000","last_fullsized":"2024-04-26T11:13:14.770711+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904543+0000","last_change":"2024-04-26T11:13:12.491438+0000","last_active":"2024-04-26T11:13:13.904543+0000","last_peered":"2024-04-26T11:13:13.904543+0000","last_clean":"2024-04-26T11:13:13.904543+0000","last_became_active":"2024-04-26T11:13:12.490515+0000","last_became_peered":"2024-04-26T11:13:12.490515+0000","last_unstale":"2024-04-26T11:13:13.904543+0000","last_undegraded":"2024-04-26T11:13:13.904543+0000","last_fullsized":"2024-04-26T11:13:13.904543+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:11.480844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770974+0000","last_change":"2024-04-26T11:13:12.915238+0000","last_active":"2024-04-26T11:13:14.770974+0000","last_peered":"2024-04-26T11:13:14.770974+0000","last_clean":"2024-04-26T11:13:14.770974+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:13:14.770974+0000","last_undegraded":"2024-04-26T11:13:14.770974+0000","last_fullsized":"2024-04-26T11:13:14.770974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:48.068465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770266+0000","last_change":"2024-04-26T11:13:12.492682+0000","last_active":"2024-04-26T11:13:14.770266+0000","last_peered":"2024-04-26T11:13:14.770266+0000","last_clean":"2024-04-26T11:13:14.770266+0000","last_became_active":"2024-04-26T11:13:12.492346+0000","last_became_peered":"2024-04-26T11:13:12.492346+0000","last_unstale":"2024-04-26T11:13:14.770266+0000","last_undegraded":"2024-04-26T11:13:14.770266+0000","last_fullsized":"2024-04-26T11:13:14.770266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:28.034755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905121+0000","last_change":"2024-04-26T11:13:12.913671+0000","last_active":"2024-04-26T11:13:13.905121+0000","last_peered":"2024-04-26T11:13:13.905121+0000","last_clean":"2024-04-26T11:13:13.905121+0000","last_became_active":"2024-04-26T11:13:12.913264+0000","last_became_peered":"2024-04-26T11:13:12.913264+0000","last_unstale":"2024-04-26T11:13:13.905121+0000","last_undegraded":"2024-04-26T11:13:13.905121+0000","last_fullsized":"2024-04-26T11:13:13.905121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904759+0000","last_change":"2024-04-26T11:13:12.492802+0000","last_active":"2024-04-26T11:13:13.904759+0000","last_peered":"2024-04-26T11:13:13.904759+0000","last_clean":"2024-04-26T11:13:13.904759+0000","last_became_active":"2024-04-26T11:13:12.491774+0000","last_became_peered":"2024-04-26T11:13:12.491774+0000","last_unstale":"2024-04-26T11:13:13.904759+0000","last_undegraded":"2024-04-26T11:13:13.904759+0000","last_fullsized":"2024-04-26T11:13:13.904759+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:05.413010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905139+0000","last_change":"2024-04-26T11:13:12.915666+0000","last_active":"2024-04-26T11:13:13.905139+0000","last_peered":"2024-04-26T11:13:13.905139+0000","last_clean":"2024-04-26T11:13:13.905139+0000","last_became_active":"2024-04-26T11:13:12.915393+0000","last_became_peered":"2024-04-26T11:13:12.915393+0000","last_unstale":"2024-04-26T11:13:13.905139+0000","last_undegraded":"2024-04-26T11:13:13.905139+0000","last_fullsized":"2024-04-26T11:13:13.905139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905455+0000","last_change":"2024-04-26T11:13:12.491934+0000","last_active":"2024-04-26T11:13:13.905455+0000","last_peered":"2024-04-26T11:13:13.905455+0000","last_clean":"2024-04-26T11:13:13.905455+0000","last_became_active":"2024-04-26T11:13:12.491262+0000","last_became_peered":"2024-04-26T11:13:12.491262+0000","last_unstale":"2024-04-26T11:13:13.905455+0000","last_undegraded":"2024-04-26T11:13:13.905455+0000","last_fullsized":"2024-04-26T11:13:13.905455+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:11.480844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.769967+0000","last_change":"2024-04-26T11:13:12.920072+0000","last_active":"2024-04-26T11:13:14.769967+0000","last_peered":"2024-04-26T11:13:14.769967+0000","last_clean":"2024-04-26T11:13:14.769967+0000","last_became_active":"2024-04-26T11:13:12.919233+0000","last_became_peered":"2024-04-26T11:13:12.919233+0000","last_unstale":"2024-04-26T11:13:14.769967+0000","last_undegraded":"2024-04-26T11:13:14.769967+0000","last_fullsized":"2024-04-26T11:13:14.769967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:41.004462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771109+0000","last_change":"2024-04-26T11:13:12.493060+0000","last_active":"2024-04-26T11:13:14.771109+0000","last_peered":"2024-04-26T11:13:14.771109+0000","last_clean":"2024-04-26T11:13:14.771109+0000","last_became_active":"2024-04-26T11:13:12.492519+0000","last_became_peered":"2024-04-26T11:13:12.492519+0000","last_unstale":"2024-04-26T11:13:14.771109+0000","last_undegraded":"2024-04-26T11:13:14.771109+0000","last_fullsized":"2024-04-26T11:13:14.771109+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:48.928740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770525+0000","last_change":"2024-04-26T11:13:12.912207+0000","last_active":"2024-04-26T11:13:14.770525+0000","last_peered":"2024-04-26T11:13:14.770525+0000","last_clean":"2024-04-26T11:13:14.770525+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:13:14.770525+0000","last_undegraded":"2024-04-26T11:13:14.770525+0000","last_fullsized":"2024-04-26T11:13:14.770525+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905410+0000","last_change":"2024-04-26T11:13:12.492772+0000","last_active":"2024-04-26T11:13:13.905410+0000","last_peered":"2024-04-26T11:13:13.905410+0000","last_clean":"2024-04-26T11:13:13.905410+0000","last_became_active":"2024-04-26T11:13:12.491901+0000","last_became_peered":"2024-04-26T11:13:12.491901+0000","last_unstale":"2024-04-26T11:13:13.905410+0000","last_undegraded":"2024-04-26T11:13:13.905410+0000","last_fullsized":"2024-04-26T11:13:13.905410+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:45.693017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904852+0000","last_change":"2024-04-26T11:13:12.919749+0000","last_active":"2024-04-26T11:13:13.904852+0000","last_peered":"2024-04-26T11:13:13.904852+0000","last_clean":"2024-04-26T11:13:13.904852+0000","last_became_active":"2024-04-26T11:13:12.917479+0000","last_became_peered":"2024-04-26T11:13:12.917479+0000","last_unstale":"2024-04-26T11:13:13.904852+0000","last_undegraded":"2024-04-26T11:13:13.904852+0000","last_fullsized":"2024-04-26T11:13:13.904852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:12.483631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904944+0000","last_change":"2024-04-26T11:13:12.495144+0000","last_active":"2024-04-26T11:13:13.904944+0000","last_peered":"2024-04-26T11:13:13.904944+0000","last_clean":"2024-04-26T11:13:13.904944+0000","last_became_active":"2024-04-26T11:13:12.494510+0000","last_became_peered":"2024-04-26T11:13:12.494510+0000","last_unstale":"2024-04-26T11:13:13.904944+0000","last_undegraded":"2024-04-26T11:13:13.904944+0000","last_fullsized":"2024-04-26T11:13:13.904944+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:00.146717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904907+0000","last_change":"2024-04-26T11:13:12.913350+0000","last_active":"2024-04-26T11:13:13.904907+0000","last_peered":"2024-04-26T11:13:13.904907+0000","last_clean":"2024-04-26T11:13:13.904907+0000","last_became_active":"2024-04-26T11:13:12.912991+0000","last_became_peered":"2024-04-26T11:13:12.912991+0000","last_unstale":"2024-04-26T11:13:13.904907+0000","last_undegraded":"2024-04-26T11:13:13.904907+0000","last_fullsized":"2024-04-26T11:13:13.904907+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:54.809926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904432+0000","last_change":"2024-04-26T11:13:12.490343+0000","last_active":"2024-04-26T11:13:13.904432+0000","last_peered":"2024-04-26T11:13:13.904432+0000","last_clean":"2024-04-26T11:13:13.904432+0000","last_became_active":"2024-04-26T11:13:12.490027+0000","last_became_peered":"2024-04-26T11:13:12.490027+0000","last_unstale":"2024-04-26T11:13:13.904432+0000","last_undegraded":"2024-04-26T11:13:13.904432+0000","last_fullsized":"2024-04-26T11:13:13.904432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:45.693017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904814+0000","last_change":"2024-04-26T11:13:12.918774+0000","last_active":"2024-04-26T11:13:13.904814+0000","last_peered":"2024-04-26T11:13:13.904814+0000","last_clean":"2024-04-26T11:13:13.904814+0000","last_became_active":"2024-04-26T11:13:12.917269+0000","last_became_peered":"2024-04-26T11:13:12.917269+0000","last_unstale":"2024-04-26T11:13:13.904814+0000","last_undegraded":"2024-04-26T11:13:13.904814+0000","last_fullsized":"2024-04-26T11:13:13.904814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:33.358984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904745+0000","last_change":"2024-04-26T11:13:12.494689+0000","last_active":"2024-04-26T11:13:13.904745+0000","last_peered":"2024-04-26T11:13:13.904745+0000","last_clean":"2024-04-26T11:13:13.904745+0000","last_became_active":"2024-04-26T11:13:12.494236+0000","last_became_peered":"2024-04-26T11:13:12.494236+0000","last_unstale":"2024-04-26T11:13:13.904745+0000","last_undegraded":"2024-04-26T11:13:13.904745+0000","last_fullsized":"2024-04-26T11:13:13.904745+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:42.000159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905618+0000","last_change":"2024-04-26T11:13:12.919985+0000","last_active":"2024-04-26T11:13:13.905618+0000","last_peered":"2024-04-26T11:13:13.905618+0000","last_clean":"2024-04-26T11:13:13.905618+0000","last_became_active":"2024-04-26T11:13:12.916239+0000","last_became_peered":"2024-04-26T11:13:12.916239+0000","last_unstale":"2024-04-26T11:13:13.905618+0000","last_undegraded":"2024-04-26T11:13:13.905618+0000","last_fullsized":"2024-04-26T11:13:13.905618+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:54.809926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770064+0000","last_change":"2024-04-26T11:13:12.492856+0000","last_active":"2024-04-26T11:13:14.770064+0000","last_peered":"2024-04-26T11:13:14.770064+0000","last_clean":"2024-04-26T11:13:14.770064+0000","last_became_active":"2024-04-26T11:13:12.492412+0000","last_became_peered":"2024-04-26T11:13:12.492412+0000","last_unstale":"2024-04-26T11:13:14.770064+0000","last_undegraded":"2024-04-26T11:13:14.770064+0000","last_fullsized":"2024-04-26T11:13:14.770064+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:09.572402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905480+0000","last_change":"2024-04-26T11:13:12.920056+0000","last_active":"2024-04-26T11:13:13.905480+0000","last_peered":"2024-04-26T11:13:13.905480+0000","last_clean":"2024-04-26T11:13:13.905480+0000","last_became_active":"2024-04-26T11:13:12.919049+0000","last_became_peered":"2024-04-26T11:13:12.919049+0000","last_unstale":"2024-04-26T11:13:13.905480+0000","last_undegraded":"2024-04-26T11:13:13.905480+0000","last_fullsized":"2024-04-26T11:13:13.905480+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770130+0000","last_change":"2024-04-26T11:13:12.493217+0000","last_active":"2024-04-26T11:13:14.770130+0000","last_peered":"2024-04-26T11:13:14.770130+0000","last_clean":"2024-04-26T11:13:14.770130+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:13:14.770130+0000","last_undegraded":"2024-04-26T11:13:14.770130+0000","last_fullsized":"2024-04-26T11:13:14.770130+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:00.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904940+0000","last_change":"2024-04-26T11:13:12.914321+0000","last_active":"2024-04-26T11:13:13.904940+0000","last_peered":"2024-04-26T11:13:13.904940+0000","last_clean":"2024-04-26T11:13:13.904940+0000","last_became_active":"2024-04-26T11:13:12.913543+0000","last_became_peered":"2024-04-26T11:13:12.913543+0000","last_unstale":"2024-04-26T11:13:13.904940+0000","last_undegraded":"2024-04-26T11:13:13.904940+0000","last_fullsized":"2024-04-26T11:13:13.904940+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.903582+0000","last_change":"2024-04-26T11:13:08.113095+0000","last_active":"2024-04-26T11:13:12.903582+0000","last_peered":"2024-04-26T11:13:12.903582+0000","last_clean":"2024-04-26T11:13:12.903582+0000","last_became_active":"2024-04-26T11:13:08.112778+0000","last_became_peered":"2024-04-26T11:13:08.112778+0000","last_unstale":"2024-04-26T11:13:12.903582+0000","last_undegraded":"2024-04-26T11:13:12.903582+0000","last_fullsized":"2024-04-26T11:13:12.903582+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:41.705893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905517+0000","last_change":"2024-04-26T11:13:12.493960+0000","last_active":"2024-04-26T11:13:13.905517+0000","last_peered":"2024-04-26T11:13:13.905517+0000","last_clean":"2024-04-26T11:13:13.905517+0000","last_became_active":"2024-04-26T11:13:12.493087+0000","last_became_peered":"2024-04-26T11:13:12.493087+0000","last_unstale":"2024-04-26T11:13:13.905517+0000","last_undegraded":"2024-04-26T11:13:13.905517+0000","last_fullsized":"2024-04-26T11:13:13.905517+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:19.538082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770546+0000","last_change":"2024-04-26T11:13:12.917458+0000","last_active":"2024-04-26T11:13:14.770546+0000","last_peered":"2024-04-26T11:13:14.770546+0000","last_clean":"2024-04-26T11:13:14.770546+0000","last_became_active":"2024-04-26T11:13:12.916792+0000","last_became_peered":"2024-04-26T11:13:12.916792+0000","last_unstale":"2024-04-26T11:13:14.770546+0000","last_undegraded":"2024-04-26T11:13:14.770546+0000","last_fullsized":"2024-04-26T11:13:14.770546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:12.483631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.913665+0000","last_change":"2024-04-26T11:13:08.112744+0000","last_active":"2024-04-26T11:13:12.913665+0000","last_peered":"2024-04-26T11:13:12.913665+0000","last_clean":"2024-04-26T11:13:12.913665+0000","last_became_active":"2024-04-26T11:13:08.112498+0000","last_became_peered":"2024-04-26T11:13:08.112498+0000","last_unstale":"2024-04-26T11:13:12.913665+0000","last_undegraded":"2024-04-26T11:13:12.913665+0000","last_fullsized":"2024-04-26T11:13:12.913665+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:38.407116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904845+0000","last_change":"2024-04-26T11:13:12.494137+0000","last_active":"2024-04-26T11:13:13.904845+0000","last_peered":"2024-04-26T11:13:13.904845+0000","last_clean":"2024-04-26T11:13:13.904845+0000","last_became_active":"2024-04-26T11:13:12.493447+0000","last_became_peered":"2024-04-26T11:13:12.493447+0000","last_unstale":"2024-04-26T11:13:13.904845+0000","last_undegraded":"2024-04-26T11:13:13.904845+0000","last_fullsized":"2024-04-26T11:13:13.904845+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:52.644533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904572+0000","last_change":"2024-04-26T11:13:12.912553+0000","last_active":"2024-04-26T11:13:13.904572+0000","last_peered":"2024-04-26T11:13:13.904572+0000","last_clean":"2024-04-26T11:13:13.904572+0000","last_became_active":"2024-04-26T11:13:12.912022+0000","last_became_peered":"2024-04-26T11:13:12.912022+0000","last_unstale":"2024-04-26T11:13:13.904572+0000","last_undegraded":"2024-04-26T11:13:13.904572+0000","last_fullsized":"2024-04-26T11:13:13.904572+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.903369+0000","last_change":"2024-04-26T11:13:08.113650+0000","last_active":"2024-04-26T11:13:12.903369+0000","last_peered":"2024-04-26T11:13:12.903369+0000","last_clean":"2024-04-26T11:13:12.903369+0000","last_became_active":"2024-04-26T11:13:08.113394+0000","last_became_peered":"2024-04-26T11:13:08.113394+0000","last_unstale":"2024-04-26T11:13:12.903369+0000","last_undegraded":"2024-04-26T11:13:12.903369+0000","last_fullsized":"2024-04-26T11:13:12.903369+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:44.642172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770074+0000","last_change":"2024-04-26T11:13:12.492888+0000","last_active":"2024-04-26T11:13:14.770074+0000","last_peered":"2024-04-26T11:13:14.770074+0000","last_clean":"2024-04-26T11:13:14.770074+0000","last_became_active":"2024-04-26T11:13:12.492274+0000","last_became_peered":"2024-04-26T11:13:12.492274+0000","last_unstale":"2024-04-26T11:13:14.770074+0000","last_undegraded":"2024-04-26T11:13:14.770074+0000","last_fullsized":"2024-04-26T11:13:14.770074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:51.136157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905114+0000","last_change":"2024-04-26T11:13:12.914599+0000","last_active":"2024-04-26T11:13:13.905114+0000","last_peered":"2024-04-26T11:13:13.905114+0000","last_clean":"2024-04-26T11:13:13.905114+0000","last_became_active":"2024-04-26T11:13:12.913916+0000","last_became_peered":"2024-04-26T11:13:12.913916+0000","last_unstale":"2024-04-26T11:13:13.905114+0000","last_undegraded":"2024-04-26T11:13:13.905114+0000","last_fullsized":"2024-04-26T11:13:13.905114+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.915840+0000","last_change":"2024-04-26T11:13:08.112690+0000","last_active":"2024-04-26T11:13:12.915840+0000","last_peered":"2024-04-26T11:13:12.915840+0000","last_clean":"2024-04-26T11:13:12.915840+0000","last_became_active":"2024-04-26T11:13:08.112454+0000","last_became_peered":"2024-04-26T11:13:08.112454+0000","last_unstale":"2024-04-26T11:13:12.915840+0000","last_undegraded":"2024-04-26T11:13:12.915840+0000","last_fullsized":"2024-04-26T11:13:12.915840+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:41.011030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.913577+0000","last_change":"2024-04-26T11:13:08.113419+0000","last_active":"2024-04-26T11:13:12.913577+0000","last_peered":"2024-04-26T11:13:12.913577+0000","last_clean":"2024-04-26T11:13:12.913577+0000","last_became_active":"2024-04-26T11:13:08.113154+0000","last_became_peered":"2024-04-26T11:13:08.113154+0000","last_unstale":"2024-04-26T11:13:12.913577+0000","last_undegraded":"2024-04-26T11:13:12.913577+0000","last_fullsized":"2024-04-26T11:13:12.913577+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:36.482001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904292+0000","last_change":"2024-04-26T11:13:12.491278+0000","last_active":"2024-04-26T11:13:13.904292+0000","last_peered":"2024-04-26T11:13:13.904292+0000","last_clean":"2024-04-26T11:13:13.904292+0000","last_became_active":"2024-04-26T11:13:12.488223+0000","last_became_peered":"2024-04-26T11:13:12.488223+0000","last_unstale":"2024-04-26T11:13:13.904292+0000","last_undegraded":"2024-04-26T11:13:13.904292+0000","last_fullsized":"2024-04-26T11:13:13.904292+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:05.413010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905587+0000","last_change":"2024-04-26T11:13:12.920834+0000","last_active":"2024-04-26T11:13:13.905587+0000","last_peered":"2024-04-26T11:13:13.905587+0000","last_clean":"2024-04-26T11:13:13.905587+0000","last_became_active":"2024-04-26T11:13:12.917055+0000","last_became_peered":"2024-04-26T11:13:12.917055+0000","last_unstale":"2024-04-26T11:13:13.905587+0000","last_undegraded":"2024-04-26T11:13:13.905587+0000","last_fullsized":"2024-04-26T11:13:13.905587+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:11.313582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.913563+0000","last_change":"2024-04-26T11:13:08.113497+0000","last_active":"2024-04-26T11:13:12.913563+0000","last_peered":"2024-04-26T11:13:12.913563+0000","last_clean":"2024-04-26T11:13:12.913563+0000","last_became_active":"2024-04-26T11:13:08.113237+0000","last_became_peered":"2024-04-26T11:13:08.113237+0000","last_unstale":"2024-04-26T11:13:12.913563+0000","last_undegraded":"2024-04-26T11:13:12.913563+0000","last_fullsized":"2024-04-26T11:13:12.913563+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:52.240361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904041+0000","last_change":"2024-04-26T11:13:12.491936+0000","last_active":"2024-04-26T11:13:13.904041+0000","last_peered":"2024-04-26T11:13:13.904041+0000","last_clean":"2024-04-26T11:13:13.904041+0000","last_became_active":"2024-04-26T11:13:12.491533+0000","last_became_peered":"2024-04-26T11:13:12.491533+0000","last_unstale":"2024-04-26T11:13:13.904041+0000","last_undegraded":"2024-04-26T11:13:13.904041+0000","last_fullsized":"2024-04-26T11:13:13.904041+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:13.320025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771296+0000","last_change":"2024-04-26T11:13:12.918648+0000","last_active":"2024-04-26T11:13:14.771296+0000","last_peered":"2024-04-26T11:13:14.771296+0000","last_clean":"2024-04-26T11:13:14.771296+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:13:14.771296+0000","last_undegraded":"2024-04-26T11:13:14.771296+0000","last_fullsized":"2024-04-26T11:13:14.771296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.907846+0000","last_change":"2024-04-26T11:13:08.110433+0000","last_active":"2024-04-26T11:13:12.907846+0000","last_peered":"2024-04-26T11:13:12.907846+0000","last_clean":"2024-04-26T11:13:12.907846+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:13:12.907846+0000","last_undegraded":"2024-04-26T11:13:12.907846+0000","last_fullsized":"2024-04-26T11:13:12.907846+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904956+0000","last_change":"2024-04-26T11:13:12.491648+0000","last_active":"2024-04-26T11:13:13.904956+0000","last_peered":"2024-04-26T11:13:13.904956+0000","last_clean":"2024-04-26T11:13:13.904956+0000","last_became_active":"2024-04-26T11:13:12.488599+0000","last_became_peered":"2024-04-26T11:13:12.488599+0000","last_unstale":"2024-04-26T11:13:13.904956+0000","last_undegraded":"2024-04-26T11:13:13.904956+0000","last_fullsized":"2024-04-26T11:13:13.904956+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:45.374565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770640+0000","last_change":"2024-04-26T11:13:12.920065+0000","last_active":"2024-04-26T11:13:14.770640+0000","last_peered":"2024-04-26T11:13:14.770640+0000","last_clean":"2024-04-26T11:13:14.770640+0000","last_became_active":"2024-04-26T11:13:12.919741+0000","last_became_peered":"2024-04-26T11:13:12.919741+0000","last_unstale":"2024-04-26T11:13:14.770640+0000","last_undegraded":"2024-04-26T11:13:14.770640+0000","last_fullsized":"2024-04-26T11:13:14.770640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:20.837217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904894+0000","last_change":"2024-04-26T11:13:12.488576+0000","last_active":"2024-04-26T11:13:13.904894+0000","last_peered":"2024-04-26T11:13:13.904894+0000","last_clean":"2024-04-26T11:13:13.904894+0000","last_became_active":"2024-04-26T11:13:12.488248+0000","last_became_peered":"2024-04-26T11:13:12.488248+0000","last_unstale":"2024-04-26T11:13:13.904894+0000","last_undegraded":"2024-04-26T11:13:13.904894+0000","last_fullsized":"2024-04-26T11:13:13.904894+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:48.928740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.904393+0000","last_change":"2024-04-26T11:13:08.113157+0000","last_active":"2024-04-26T11:13:12.904393+0000","last_peered":"2024-04-26T11:13:12.904393+0000","last_clean":"2024-04-26T11:13:12.904393+0000","last_became_active":"2024-04-26T11:13:08.112788+0000","last_became_peered":"2024-04-26T11:13:08.112788+0000","last_unstale":"2024-04-26T11:13:12.904393+0000","last_undegraded":"2024-04-26T11:13:12.904393+0000","last_fullsized":"2024-04-26T11:13:12.904393+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:14.606433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904028+0000","last_change":"2024-04-26T11:13:12.919100+0000","last_active":"2024-04-26T11:13:13.904028+0000","last_peered":"2024-04-26T11:13:13.904028+0000","last_clean":"2024-04-26T11:13:13.904028+0000","last_became_active":"2024-04-26T11:13:12.918816+0000","last_became_peered":"2024-04-26T11:13:12.918816+0000","last_unstale":"2024-04-26T11:13:13.904028+0000","last_undegraded":"2024-04-26T11:13:13.904028+0000","last_fullsized":"2024-04-26T11:13:13.904028+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.915609+0000","last_change":"2024-04-26T11:13:08.113505+0000","last_active":"2024-04-26T11:13:12.915609+0000","last_peered":"2024-04-26T11:13:12.915609+0000","last_clean":"2024-04-26T11:13:12.915609+0000","last_became_active":"2024-04-26T11:13:08.113224+0000","last_became_peered":"2024-04-26T11:13:08.113224+0000","last_unstale":"2024-04-26T11:13:12.915609+0000","last_undegraded":"2024-04-26T11:13:12.915609+0000","last_fullsized":"2024-04-26T11:13:12.915609+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:16.157275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:16.455948+0000","last_change":"2024-04-26T11:13:12.490249+0000","last_active":"2024-04-26T11:13:16.455948+0000","last_peered":"2024-04-26T11:13:16.455948+0000","last_clean":"2024-04-26T11:13:16.455948+0000","last_became_active":"2024-04-26T11:13:12.488836+0000","last_became_peered":"2024-04-26T11:13:12.488836+0000","last_unstale":"2024-04-26T11:13:16.455948+0000","last_undegraded":"2024-04-26T11:13:16.455948+0000","last_fullsized":"2024-04-26T11:13:16.455948+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:12.581788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770387+0000","last_change":"2024-04-26T11:13:12.913955+0000","last_active":"2024-04-26T11:13:14.770387+0000","last_peered":"2024-04-26T11:13:14.770387+0000","last_clean":"2024-04-26T11:13:14.770387+0000","last_became_active":"2024-04-26T11:13:12.913037+0000","last_became_peered":"2024-04-26T11:13:12.913037+0000","last_unstale":"2024-04-26T11:13:14.770387+0000","last_undegraded":"2024-04-26T11:13:14.770387+0000","last_fullsized":"2024-04-26T11:13:14.770387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:11.313582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770475+0000","last_change":"2024-04-26T11:13:12.493479+0000","last_active":"2024-04-26T11:13:14.770475+0000","last_peered":"2024-04-26T11:13:14.770475+0000","last_clean":"2024-04-26T11:13:14.770475+0000","last_became_active":"2024-04-26T11:13:12.493174+0000","last_became_peered":"2024-04-26T11:13:12.493174+0000","last_unstale":"2024-04-26T11:13:14.770475+0000","last_undegraded":"2024-04-26T11:13:14.770475+0000","last_fullsized":"2024-04-26T11:13:14.770475+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:05.413010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770803+0000","last_change":"2024-04-26T11:13:12.917812+0000","last_active":"2024-04-26T11:13:14.770803+0000","last_peered":"2024-04-26T11:13:14.770803+0000","last_clean":"2024-04-26T11:13:14.770803+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:13:14.770803+0000","last_undegraded":"2024-04-26T11:13:14.770803+0000","last_fullsized":"2024-04-26T11:13:14.770803+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904950+0000","last_change":"2024-04-26T11:13:12.493351+0000","last_active":"2024-04-26T11:13:13.904950+0000","last_peered":"2024-04-26T11:13:13.904950+0000","last_clean":"2024-04-26T11:13:13.904950+0000","last_became_active":"2024-04-26T11:13:12.492923+0000","last_became_peered":"2024-04-26T11:13:12.492923+0000","last_unstale":"2024-04-26T11:13:13.904950+0000","last_undegraded":"2024-04-26T11:13:13.904950+0000","last_fullsized":"2024-04-26T11:13:13.904950+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:53.444842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904852+0000","last_change":"2024-04-26T11:13:12.918383+0000","last_active":"2024-04-26T11:13:13.904852+0000","last_peered":"2024-04-26T11:13:13.904852+0000","last_clean":"2024-04-26T11:13:13.904852+0000","last_became_active":"2024-04-26T11:13:12.917098+0000","last_became_peered":"2024-04-26T11:13:12.917098+0000","last_unstale":"2024-04-26T11:13:13.904852+0000","last_undegraded":"2024-04-26T11:13:13.904852+0000","last_fullsized":"2024-04-26T11:13:13.904852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:43.397887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770971+0000","last_change":"2024-04-26T11:13:12.493387+0000","last_active":"2024-04-26T11:13:14.770971+0000","last_peered":"2024-04-26T11:13:14.770971+0000","last_clean":"2024-04-26T11:13:14.770971+0000","last_became_active":"2024-04-26T11:13:12.493158+0000","last_became_peered":"2024-04-26T11:13:12.493158+0000","last_unstale":"2024-04-26T11:13:14.770971+0000","last_undegraded":"2024-04-26T11:13:14.770971+0000","last_fullsized":"2024-04-26T11:13:14.770971+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:56.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904899+0000","last_change":"2024-04-26T11:13:12.920137+0000","last_active":"2024-04-26T11:13:13.904899+0000","last_peered":"2024-04-26T11:13:13.904899+0000","last_clean":"2024-04-26T11:13:13.904899+0000","last_became_active":"2024-04-26T11:13:12.919020+0000","last_became_peered":"2024-04-26T11:13:12.919020+0000","last_unstale":"2024-04-26T11:13:13.904899+0000","last_undegraded":"2024-04-26T11:13:13.904899+0000","last_fullsized":"2024-04-26T11:13:13.904899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:47.014768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905092+0000","last_change":"2024-04-26T11:13:12.490017+0000","last_active":"2024-04-26T11:13:13.905092+0000","last_peered":"2024-04-26T11:13:13.905092+0000","last_clean":"2024-04-26T11:13:13.905092+0000","last_became_active":"2024-04-26T11:13:12.488282+0000","last_became_peered":"2024-04-26T11:13:12.488282+0000","last_unstale":"2024-04-26T11:13:13.905092+0000","last_undegraded":"2024-04-26T11:13:13.905092+0000","last_fullsized":"2024-04-26T11:13:13.905092+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:20.176849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770666+0000","last_change":"2024-04-26T11:13:12.917763+0000","last_active":"2024-04-26T11:13:14.770666+0000","last_peered":"2024-04-26T11:13:14.770666+0000","last_clean":"2024-04-26T11:13:14.770666+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:13:14.770666+0000","last_undegraded":"2024-04-26T11:13:14.770666+0000","last_fullsized":"2024-04-26T11:13:14.770666+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905010+0000","last_change":"2024-04-26T11:13:12.491798+0000","last_active":"2024-04-26T11:13:13.905010+0000","last_peered":"2024-04-26T11:13:13.905010+0000","last_clean":"2024-04-26T11:13:13.905010+0000","last_became_active":"2024-04-26T11:13:12.490582+0000","last_became_peered":"2024-04-26T11:13:12.490582+0000","last_unstale":"2024-04-26T11:13:13.905010+0000","last_undegraded":"2024-04-26T11:13:13.905010+0000","last_fullsized":"2024-04-26T11:13:13.905010+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:46.082467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904998+0000","last_change":"2024-04-26T11:13:12.914549+0000","last_active":"2024-04-26T11:13:13.904998+0000","last_peered":"2024-04-26T11:13:13.904998+0000","last_clean":"2024-04-26T11:13:13.904998+0000","last_became_active":"2024-04-26T11:13:12.913041+0000","last_became_peered":"2024-04-26T11:13:12.913041+0000","last_unstale":"2024-04-26T11:13:13.904998+0000","last_undegraded":"2024-04-26T11:13:13.904998+0000","last_fullsized":"2024-04-26T11:13:13.904998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904654+0000","last_change":"2024-04-26T11:13:12.916942+0000","last_active":"2024-04-26T11:13:13.904654+0000","last_peered":"2024-04-26T11:13:13.904654+0000","last_clean":"2024-04-26T11:13:13.904654+0000","last_became_active":"2024-04-26T11:13:12.916144+0000","last_became_peered":"2024-04-26T11:13:12.916144+0000","last_unstale":"2024-04-26T11:13:13.904654+0000","last_undegraded":"2024-04-26T11:13:13.904654+0000","last_fullsized":"2024-04-26T11:13:13.904654+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:46.610126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904072+0000","last_change":"2024-04-26T11:13:12.913826+0000","last_active":"2024-04-26T11:13:13.904072+0000","last_peered":"2024-04-26T11:13:13.904072+0000","last_clean":"2024-04-26T11:13:13.904072+0000","last_became_active":"2024-04-26T11:13:12.912911+0000","last_became_peered":"2024-04-26T11:13:12.912911+0000","last_unstale":"2024-04-26T11:13:13.904072+0000","last_undegraded":"2024-04-26T11:13:13.904072+0000","last_fullsized":"2024-04-26T11:13:13.904072+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:10.887079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770469+0000","last_change":"2024-04-26T11:13:12.921818+0000","last_active":"2024-04-26T11:13:14.770469+0000","last_peered":"2024-04-26T11:13:14.770469+0000","last_clean":"2024-04-26T11:13:14.770469+0000","last_became_active":"2024-04-26T11:13:12.921526+0000","last_became_peered":"2024-04-26T11:13:12.921526+0000","last_unstale":"2024-04-26T11:13:14.770469+0000","last_undegraded":"2024-04-26T11:13:14.770469+0000","last_fullsized":"2024-04-26T11:13:14.770469+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:47.958725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904819+0000","last_change":"2024-04-26T11:13:12.912731+0000","last_active":"2024-04-26T11:13:13.904819+0000","last_peered":"2024-04-26T11:13:13.904819+0000","last_clean":"2024-04-26T11:13:13.904819+0000","last_became_active":"2024-04-26T11:13:12.911522+0000","last_became_peered":"2024-04-26T11:13:12.911522+0000","last_unstale":"2024-04-26T11:13:13.904819+0000","last_undegraded":"2024-04-26T11:13:13.904819+0000","last_fullsized":"2024-04-26T11:13:13.904819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:46.610126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770830+0000","last_change":"2024-04-26T11:13:12.919750+0000","last_active":"2024-04-26T11:13:14.770830+0000","last_peered":"2024-04-26T11:13:14.770830+0000","last_clean":"2024-04-26T11:13:14.770830+0000","last_became_active":"2024-04-26T11:13:12.919116+0000","last_became_peered":"2024-04-26T11:13:12.919116+0000","last_unstale":"2024-04-26T11:13:14.770830+0000","last_undegraded":"2024-04-26T11:13:14.770830+0000","last_fullsized":"2024-04-26T11:13:14.770830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:10.887079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":745472,"data_stored":637050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:13:26.062 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T11:13:26.062 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T11:13:26.062 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T11:13:26.063 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T11:13:26.481 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:26.481 INFO:teuthology.orchestra.run.smithi029.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T11:13:26.495 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T11:13:26.495 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:13:26.839 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:26.839 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":15,"fsid":"2b52ce04-9559-478f-9787-c3cc3b261c15","created":"2024-04-26T11:12:58.193418+0000","modified":"2024-04-26T11:13:13.900817+0000","last_up_change":"2024-04-26T11:13:06.102821+0000","last_in_change":"2024-04-26T11:12:59.116286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:13:06.502266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:13:06.913870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:13:11.430854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:13:11.859264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3496b3f-5972-47ff-a449-832f5055beac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":41434},{"type":"v1","addr":"172.21.15.72:6801","nonce":41434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":41434},{"type":"v1","addr":"172.21.15.72:6803","nonce":41434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":41434},{"type":"v1","addr":"172.21.15.72:6807","nonce":41434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":41434},{"type":"v1","addr":"172.21.15.72:6805","nonce":41434}]},"public_addr":"172.21.15.72:6801/41434","cluster_addr":"172.21.15.72:6803/41434","heartbeat_back_addr":"172.21.15.72:6807/41434","heartbeat_front_addr":"172.21.15.72:6805/41434","state":["exists","up"]},{"osd":1,"uuid":"4842abe1-e7b4-480f-85b3-11c8fa2123f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":41442},{"type":"v1","addr":"172.21.15.82:6801","nonce":41442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":41442},{"type":"v1","addr":"172.21.15.82:6803","nonce":41442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":41442},{"type":"v1","addr":"172.21.15.82:6807","nonce":41442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":41442},{"type":"v1","addr":"172.21.15.82:6805","nonce":41442}]},"public_addr":"172.21.15.82:6801/41442","cluster_addr":"172.21.15.82:6803/41442","heartbeat_back_addr":"172.21.15.82:6807/41442","heartbeat_front_addr":"172.21.15.82:6805/41442","state":["exists","up"]},{"osd":2,"uuid":"57b4a874-e4ce-42a9-a7fd-f9e0acf03cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":41571},{"type":"v1","addr":"172.21.15.122:6801","nonce":41571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":41571},{"type":"v1","addr":"172.21.15.122:6803","nonce":41571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":41571},{"type":"v1","addr":"172.21.15.122:6807","nonce":41571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":41571},{"type":"v1","addr":"172.21.15.122:6805","nonce":41571}]},"public_addr":"172.21.15.122:6801/41571","cluster_addr":"172.21.15.122:6803/41571","heartbeat_back_addr":"172.21.15.122:6807/41571","heartbeat_front_addr":"172.21.15.122:6805/41571","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.123925+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.145646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:05.101494+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:13:26.853 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T11:13:06.502266+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T11:13:06.913870+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T11:13:11.430854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T11:13:11.859264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T11:13:26.853 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T11:13:27.197 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-26T11:13:27.211 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T11:13:27.554 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2024-04-26T11:13:27.568 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T11:13:27.906 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-26T11:13:27.921 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T11:13:28.264 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-04-26T11:13:28.278 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T11:13:28.662 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:28.662 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T11:13:12.899864+0000","modified":"2024-04-26T11:13:15.909042+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6803/1340829810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1340829810},{"type":"v1","addr":"172.21.15.29:6803","nonce":1340829810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T11:13:28.665 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 6 2024-04-26T11:13:28.676 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:13:29.017 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:29.018 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":15,"fsid":"2b52ce04-9559-478f-9787-c3cc3b261c15","created":"2024-04-26T11:12:58.193418+0000","modified":"2024-04-26T11:13:13.900817+0000","last_up_change":"2024-04-26T11:13:06.102821+0000","last_in_change":"2024-04-26T11:12:59.116286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:13:06.502266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:13:06.913870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:13:11.430854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:13:11.859264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3496b3f-5972-47ff-a449-832f5055beac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":41434},{"type":"v1","addr":"172.21.15.72:6801","nonce":41434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":41434},{"type":"v1","addr":"172.21.15.72:6803","nonce":41434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":41434},{"type":"v1","addr":"172.21.15.72:6807","nonce":41434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":41434},{"type":"v1","addr":"172.21.15.72:6805","nonce":41434}]},"public_addr":"172.21.15.72:6801/41434","cluster_addr":"172.21.15.72:6803/41434","heartbeat_back_addr":"172.21.15.72:6807/41434","heartbeat_front_addr":"172.21.15.72:6805/41434","state":["exists","up"]},{"osd":1,"uuid":"4842abe1-e7b4-480f-85b3-11c8fa2123f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":41442},{"type":"v1","addr":"172.21.15.82:6801","nonce":41442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":41442},{"type":"v1","addr":"172.21.15.82:6803","nonce":41442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":41442},{"type":"v1","addr":"172.21.15.82:6807","nonce":41442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":41442},{"type":"v1","addr":"172.21.15.82:6805","nonce":41442}]},"public_addr":"172.21.15.82:6801/41442","cluster_addr":"172.21.15.82:6803/41442","heartbeat_back_addr":"172.21.15.82:6807/41442","heartbeat_front_addr":"172.21.15.82:6805/41442","state":["exists","up"]},{"osd":2,"uuid":"57b4a874-e4ce-42a9-a7fd-f9e0acf03cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":41571},{"type":"v1","addr":"172.21.15.122:6801","nonce":41571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":41571},{"type":"v1","addr":"172.21.15.122:6803","nonce":41571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":41571},{"type":"v1","addr":"172.21.15.122:6807","nonce":41571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":41571},{"type":"v1","addr":"172.21.15.122:6805","nonce":41571}]},"public_addr":"172.21.15.122:6801/41571","cluster_addr":"172.21.15.122:6803/41571","heartbeat_back_addr":"172.21.15.122:6807/41571","heartbeat_front_addr":"172.21.15.122:6805/41571","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.123925+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.145646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:05.101494+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:13:29.031 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T11:13:06.502266+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T11:13:06.913870+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T11:13:11.430854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T11:13:11.859264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T11:13:29.032 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T11:13:29.373 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-04-26T11:13:29.387 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T11:13:29.729 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 8 2024-04-26T11:13:29.746 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T11:13:30.089 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-04-26T11:13:30.103 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T11:13:30.444 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-04-26T11:13:30.459 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T11:13:30.846 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:30.846 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T11:13:12.899864+0000","modified":"2024-04-26T11:13:15.909042+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6803/1340829810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1340829810},{"type":"v1","addr":"172.21.15.29:6803","nonce":1340829810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T11:13:30.848 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 6 2024-04-26T11:13:30.860 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:13:31.204 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:31.204 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":15,"fsid":"2b52ce04-9559-478f-9787-c3cc3b261c15","created":"2024-04-26T11:12:58.193418+0000","modified":"2024-04-26T11:13:13.900817+0000","last_up_change":"2024-04-26T11:13:06.102821+0000","last_in_change":"2024-04-26T11:12:59.116286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:13:06.502266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:13:06.913870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:13:11.430854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:13:11.859264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3496b3f-5972-47ff-a449-832f5055beac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":41434},{"type":"v1","addr":"172.21.15.72:6801","nonce":41434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":41434},{"type":"v1","addr":"172.21.15.72:6803","nonce":41434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":41434},{"type":"v1","addr":"172.21.15.72:6807","nonce":41434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":41434},{"type":"v1","addr":"172.21.15.72:6805","nonce":41434}]},"public_addr":"172.21.15.72:6801/41434","cluster_addr":"172.21.15.72:6803/41434","heartbeat_back_addr":"172.21.15.72:6807/41434","heartbeat_front_addr":"172.21.15.72:6805/41434","state":["exists","up"]},{"osd":1,"uuid":"4842abe1-e7b4-480f-85b3-11c8fa2123f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":41442},{"type":"v1","addr":"172.21.15.82:6801","nonce":41442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":41442},{"type":"v1","addr":"172.21.15.82:6803","nonce":41442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":41442},{"type":"v1","addr":"172.21.15.82:6807","nonce":41442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":41442},{"type":"v1","addr":"172.21.15.82:6805","nonce":41442}]},"public_addr":"172.21.15.82:6801/41442","cluster_addr":"172.21.15.82:6803/41442","heartbeat_back_addr":"172.21.15.82:6807/41442","heartbeat_front_addr":"172.21.15.82:6805/41442","state":["exists","up"]},{"osd":2,"uuid":"57b4a874-e4ce-42a9-a7fd-f9e0acf03cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":41571},{"type":"v1","addr":"172.21.15.122:6801","nonce":41571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":41571},{"type":"v1","addr":"172.21.15.122:6803","nonce":41571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":41571},{"type":"v1","addr":"172.21.15.122:6807","nonce":41571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":41571},{"type":"v1","addr":"172.21.15.122:6805","nonce":41571}]},"public_addr":"172.21.15.122:6801/41571","cluster_addr":"172.21.15.122:6803/41571","heartbeat_back_addr":"172.21.15.122:6807/41571","heartbeat_front_addr":"172.21.15.122:6805/41571","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.123925+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.145646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:05.101494+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:13:31.218 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T11:13:31.610 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:31.610 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T11:13:12.899864+0000","modified":"2024-04-26T11:13:15.909042+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6803/1340829810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1340829810},{"type":"v1","addr":"172.21.15.29:6803","nonce":1340829810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T11:13:31.612 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 6 2024-04-26T11:13:31.724 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T11:13:12.899864+0000', 'modified': '2024-04-26T11:13:15.909042+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4193': {'gid': 4193, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.29:6803/1340829810', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6802', 'nonce': 1340829810}, {'type': 'v1', 'addr': '172.21.15.29:6803', 'nonce': 1340829810}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-26T11:13:31.809 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T11:13:31.809 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T11:13:31.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T11:13:31.960+0000 7f92a2ffd700 0 client.4465 ms_handle_reset on v2:172.21.15.29:6802/1340829810 2024-04-26T11:13:31.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-04-26T11:13:31.982+0000 7f92a2ffd700 0 client.4471 ms_handle_reset on v2:172.21.15.29:6802/1340829810 2024-04-26T11:13:31.985 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-26T11:13:31.985 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "2b52ce04-9559-478f-9787-c3cc3b261c15", 2024-04-26T11:13:31.985 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2024-04-26T11:13:31.985 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 4193, 2024-04-26T11:13:31.985 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-04-26T11:13:31.986 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-04-26T11:13:31.986 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-04-26T11:13:31.986 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 19.081715143, 2024-04-26T11:13:31.986 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 6, 2024-04-26T11:13:31.986 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 15, 2024-04-26T11:13:31.986 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 15, 2024-04-26T11:13:31.986 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 23.765170403999999 2024-04-26T11:13:31.986 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-26T11:13:32.003 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-26T11:13:32.060 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-26T11:13:32.060 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6'}} 2024-04-26T11:13:32.060 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-26T11:13:32.060 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-04-26T11:13:32.060 DEBUG:teuthology.orchestra.run.smithi029:> sync 2024-04-26T11:13:32.258 DEBUG:teuthology.orchestra.run.smithi072:> sync 2024-04-26T11:13:32.393 DEBUG:teuthology.orchestra.run.smithi082:> sync 2024-04-26T11:13:32.489 DEBUG:teuthology.orchestra.run.smithi122:> sync 2024-04-26T11:13:32.611 DEBUG:tasks.thrashosds:checking console status of smithi029 2024-04-26T11:13:32.611 DEBUG:teuthology.orchestra.console.smithi029:Waiting for login prompt 2024-04-26T11:13:32.611 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi029 2024-04-26T11:13:32.824 DEBUG:teuthology.orchestra.console.smithi029:expect before: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T11:13:32.824 DEBUG:teuthology.orchestra.console.smithi029:expect after: smithi029 login: 2024-04-26T11:13:32.877 DEBUG:teuthology.orchestra.console.smithi029:console disconnect output: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi029 login: [disconnect] 2024-04-26T11:13:32.979 DEBUG:tasks.thrashosds:checking console status of smithi072 2024-04-26T11:13:32.980 DEBUG:teuthology.orchestra.console.smithi072:Waiting for login prompt 2024-04-26T11:13:32.980 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi072 2024-04-26T11:13:33.125 DEBUG:teuthology.orchestra.console.smithi072:expect before: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T11:13:33.125 DEBUG:teuthology.orchestra.console.smithi072:expect after: smithi072 login: 2024-04-26T11:13:33.179 DEBUG:teuthology.orchestra.console.smithi072:console disconnect output: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi072 login: [disconnect] 2024-04-26T11:13:33.279 DEBUG:tasks.thrashosds:checking console status of smithi082 2024-04-26T11:13:33.280 DEBUG:teuthology.orchestra.console.smithi082:Waiting for login prompt 2024-04-26T11:13:33.280 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi082 2024-04-26T11:13:33.369 DEBUG:teuthology.orchestra.console.smithi082:expect before: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T11:13:33.369 DEBUG:teuthology.orchestra.console.smithi082:expect after: smithi082 login: 2024-04-26T11:13:33.421 DEBUG:teuthology.orchestra.console.smithi082:console disconnect output: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi082 login: [disconnect] 2024-04-26T11:13:33.522 DEBUG:tasks.thrashosds:checking console status of smithi122 2024-04-26T11:13:33.522 DEBUG:teuthology.orchestra.console.smithi122:Waiting for login prompt 2024-04-26T11:13:33.522 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi122 2024-04-26T11:13:33.681 DEBUG:teuthology.orchestra.console.smithi122:expect before: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T11:13:33.682 DEBUG:teuthology.orchestra.console.smithi122:expect after: smithi122 login: 2024-04-26T11:13:33.734 DEBUG:teuthology.orchestra.console.smithi122:console disconnect output: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi122 login: [disconnect] 2024-04-26T11:13:33.838 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-26T11:13:34.221 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-26T11:13:34.221 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T11:13:34.222 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:13:34.569 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:34.572 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:13:34.580 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-26T11:13:34.455489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86788,"kb_used_data":1604,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028732,"statfs":{"total":289910292480,"available":289821421568,"internally_reserved":0,"allocated":1642496,"data_stored":1322490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002753"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771368+0000","last_change":"2024-04-26T11:13:12.919196+0000","last_active":"2024-04-26T11:13:14.771368+0000","last_peered":"2024-04-26T11:13:14.771368+0000","last_clean":"2024-04-26T11:13:14.771368+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:13:14.771368+0000","last_undegraded":"2024-04-26T11:13:14.771368+0000","last_fullsized":"2024-04-26T11:13:14.771368+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771085+0000","last_change":"2024-04-26T11:13:12.917670+0000","last_active":"2024-04-26T11:13:14.771085+0000","last_peered":"2024-04-26T11:13:14.771085+0000","last_clean":"2024-04-26T11:13:14.771085+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:13:14.771085+0000","last_undegraded":"2024-04-26T11:13:14.771085+0000","last_fullsized":"2024-04-26T11:13:14.771085+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905470+0000","last_change":"2024-04-26T11:13:12.922235+0000","last_active":"2024-04-26T11:13:13.905470+0000","last_peered":"2024-04-26T11:13:13.905470+0000","last_clean":"2024-04-26T11:13:13.905470+0000","last_became_active":"2024-04-26T11:13:12.919993+0000","last_became_peered":"2024-04-26T11:13:12.919993+0000","last_unstale":"2024-04-26T11:13:13.905470+0000","last_undegraded":"2024-04-26T11:13:13.905470+0000","last_fullsized":"2024-04-26T11:13:13.905470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:41.004462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905212+0000","last_change":"2024-04-26T11:13:12.916859+0000","last_active":"2024-04-26T11:13:13.905212+0000","last_peered":"2024-04-26T11:13:13.905212+0000","last_clean":"2024-04-26T11:13:13.905212+0000","last_became_active":"2024-04-26T11:13:12.915591+0000","last_became_peered":"2024-04-26T11:13:12.915591+0000","last_unstale":"2024-04-26T11:13:13.905212+0000","last_undegraded":"2024-04-26T11:13:13.905212+0000","last_fullsized":"2024-04-26T11:13:13.905212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:52.543148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770643+0000","last_change":"2024-04-26T11:13:12.917403+0000","last_active":"2024-04-26T11:13:14.770643+0000","last_peered":"2024-04-26T11:13:14.770643+0000","last_clean":"2024-04-26T11:13:14.770643+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:13:14.770643+0000","last_undegraded":"2024-04-26T11:13:14.770643+0000","last_fullsized":"2024-04-26T11:13:14.770643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:42.014955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904599+0000","last_change":"2024-04-26T11:13:12.918802+0000","last_active":"2024-04-26T11:13:13.904599+0000","last_peered":"2024-04-26T11:13:13.904599+0000","last_clean":"2024-04-26T11:13:13.904599+0000","last_became_active":"2024-04-26T11:13:12.917353+0000","last_became_peered":"2024-04-26T11:13:12.917353+0000","last_unstale":"2024-04-26T11:13:13.904599+0000","last_undegraded":"2024-04-26T11:13:13.904599+0000","last_fullsized":"2024-04-26T11:13:13.904599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:08.956085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904746+0000","last_change":"2024-04-26T11:13:12.916789+0000","last_active":"2024-04-26T11:13:13.904746+0000","last_peered":"2024-04-26T11:13:13.904746+0000","last_clean":"2024-04-26T11:13:13.904746+0000","last_became_active":"2024-04-26T11:13:12.914947+0000","last_became_peered":"2024-04-26T11:13:12.914947+0000","last_unstale":"2024-04-26T11:13:13.904746+0000","last_undegraded":"2024-04-26T11:13:13.904746+0000","last_fullsized":"2024-04-26T11:13:13.904746+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904343+0000","last_change":"2024-04-26T11:13:12.919968+0000","last_active":"2024-04-26T11:13:13.904343+0000","last_peered":"2024-04-26T11:13:13.904343+0000","last_clean":"2024-04-26T11:13:13.904343+0000","last_became_active":"2024-04-26T11:13:12.918600+0000","last_became_peered":"2024-04-26T11:13:12.918600+0000","last_unstale":"2024-04-26T11:13:13.904343+0000","last_undegraded":"2024-04-26T11:13:13.904343+0000","last_fullsized":"2024-04-26T11:13:13.904343+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:41.073901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904753+0000","last_change":"2024-04-26T11:13:12.914649+0000","last_active":"2024-04-26T11:13:13.904753+0000","last_peered":"2024-04-26T11:13:13.904753+0000","last_clean":"2024-04-26T11:13:13.904753+0000","last_became_active":"2024-04-26T11:13:12.914174+0000","last_became_peered":"2024-04-26T11:13:12.914174+0000","last_unstale":"2024-04-26T11:13:13.904753+0000","last_undegraded":"2024-04-26T11:13:13.904753+0000","last_fullsized":"2024-04-26T11:13:13.904753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:41.004462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771235+0000","last_change":"2024-04-26T11:13:12.918521+0000","last_active":"2024-04-26T11:13:14.771235+0000","last_peered":"2024-04-26T11:13:14.771235+0000","last_clean":"2024-04-26T11:13:14.771235+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:13:14.771235+0000","last_undegraded":"2024-04-26T11:13:14.771235+0000","last_fullsized":"2024-04-26T11:13:14.771235+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905226+0000","last_change":"2024-04-26T11:13:12.922456+0000","last_active":"2024-04-26T11:13:13.905226+0000","last_peered":"2024-04-26T11:13:13.905226+0000","last_clean":"2024-04-26T11:13:13.905226+0000","last_became_active":"2024-04-26T11:13:12.921230+0000","last_became_peered":"2024-04-26T11:13:12.921230+0000","last_unstale":"2024-04-26T11:13:13.905226+0000","last_undegraded":"2024-04-26T11:13:13.905226+0000","last_fullsized":"2024-04-26T11:13:13.905226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:55.318150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770399+0000","last_change":"2024-04-26T11:13:12.914082+0000","last_active":"2024-04-26T11:13:14.770399+0000","last_peered":"2024-04-26T11:13:14.770399+0000","last_clean":"2024-04-26T11:13:14.770399+0000","last_became_active":"2024-04-26T11:13:12.913374+0000","last_became_peered":"2024-04-26T11:13:12.913374+0000","last_unstale":"2024-04-26T11:13:14.770399+0000","last_undegraded":"2024-04-26T11:13:14.770399+0000","last_fullsized":"2024-04-26T11:13:14.770399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:52.543148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770460+0000","last_change":"2024-04-26T11:13:12.915484+0000","last_active":"2024-04-26T11:13:14.770460+0000","last_peered":"2024-04-26T11:13:14.770460+0000","last_clean":"2024-04-26T11:13:14.770460+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:13:14.770460+0000","last_undegraded":"2024-04-26T11:13:14.770460+0000","last_fullsized":"2024-04-26T11:13:14.770460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905148+0000","last_change":"2024-04-26T11:13:12.914318+0000","last_active":"2024-04-26T11:13:13.905148+0000","last_peered":"2024-04-26T11:13:13.905148+0000","last_clean":"2024-04-26T11:13:13.905148+0000","last_became_active":"2024-04-26T11:13:12.913437+0000","last_became_peered":"2024-04-26T11:13:12.913437+0000","last_unstale":"2024-04-26T11:13:13.905148+0000","last_undegraded":"2024-04-26T11:13:13.905148+0000","last_fullsized":"2024-04-26T11:13:13.905148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904484+0000","last_change":"2024-04-26T11:13:12.914523+0000","last_active":"2024-04-26T11:13:13.904484+0000","last_peered":"2024-04-26T11:13:13.904484+0000","last_clean":"2024-04-26T11:13:13.904484+0000","last_became_active":"2024-04-26T11:13:12.913241+0000","last_became_peered":"2024-04-26T11:13:12.913241+0000","last_unstale":"2024-04-26T11:13:13.904484+0000","last_undegraded":"2024-04-26T11:13:13.904484+0000","last_fullsized":"2024-04-26T11:13:13.904484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:10.887079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904389+0000","last_change":"2024-04-26T11:13:12.922145+0000","last_active":"2024-04-26T11:13:13.904389+0000","last_peered":"2024-04-26T11:13:13.904389+0000","last_clean":"2024-04-26T11:13:13.904389+0000","last_became_active":"2024-04-26T11:13:12.919048+0000","last_became_peered":"2024-04-26T11:13:12.919048+0000","last_unstale":"2024-04-26T11:13:13.904389+0000","last_undegraded":"2024-04-26T11:13:13.904389+0000","last_fullsized":"2024-04-26T11:13:13.904389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:47.958725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904823+0000","last_change":"2024-04-26T11:13:12.914484+0000","last_active":"2024-04-26T11:13:13.904823+0000","last_peered":"2024-04-26T11:13:13.904823+0000","last_clean":"2024-04-26T11:13:13.904823+0000","last_became_active":"2024-04-26T11:13:12.913596+0000","last_became_peered":"2024-04-26T11:13:12.913596+0000","last_unstale":"2024-04-26T11:13:13.904823+0000","last_undegraded":"2024-04-26T11:13:13.904823+0000","last_fullsized":"2024-04-26T11:13:13.904823+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:38.001491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771320+0000","last_change":"2024-04-26T11:13:12.918759+0000","last_active":"2024-04-26T11:13:14.771320+0000","last_peered":"2024-04-26T11:13:14.771320+0000","last_clean":"2024-04-26T11:13:14.771320+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:13:14.771320+0000","last_undegraded":"2024-04-26T11:13:14.771320+0000","last_fullsized":"2024-04-26T11:13:14.771320+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:55.002972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904592+0000","last_change":"2024-04-26T11:13:12.917334+0000","last_active":"2024-04-26T11:13:13.904592+0000","last_peered":"2024-04-26T11:13:13.904592+0000","last_clean":"2024-04-26T11:13:13.904592+0000","last_became_active":"2024-04-26T11:13:12.917010+0000","last_became_peered":"2024-04-26T11:13:12.917010+0000","last_unstale":"2024-04-26T11:13:13.904592+0000","last_undegraded":"2024-04-26T11:13:13.904592+0000","last_fullsized":"2024-04-26T11:13:13.904592+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:52.543148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905177+0000","last_change":"2024-04-26T11:13:12.917519+0000","last_active":"2024-04-26T11:13:13.905177+0000","last_peered":"2024-04-26T11:13:13.905177+0000","last_clean":"2024-04-26T11:13:13.905177+0000","last_became_active":"2024-04-26T11:13:12.916985+0000","last_became_peered":"2024-04-26T11:13:12.916985+0000","last_unstale":"2024-04-26T11:13:13.905177+0000","last_undegraded":"2024-04-26T11:13:13.905177+0000","last_fullsized":"2024-04-26T11:13:13.905177+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:38.001491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904702+0000","last_change":"2024-04-26T11:13:12.919641+0000","last_active":"2024-04-26T11:13:13.904702+0000","last_peered":"2024-04-26T11:13:13.904702+0000","last_clean":"2024-04-26T11:13:13.904702+0000","last_became_active":"2024-04-26T11:13:12.918830+0000","last_became_peered":"2024-04-26T11:13:12.918830+0000","last_unstale":"2024-04-26T11:13:13.904702+0000","last_undegraded":"2024-04-26T11:13:13.904702+0000","last_fullsized":"2024-04-26T11:13:13.904702+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:52.714816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770332+0000","last_change":"2024-04-26T11:13:12.914087+0000","last_active":"2024-04-26T11:13:14.770332+0000","last_peered":"2024-04-26T11:13:14.770332+0000","last_clean":"2024-04-26T11:13:14.770332+0000","last_became_active":"2024-04-26T11:13:12.913393+0000","last_became_peered":"2024-04-26T11:13:12.913393+0000","last_unstale":"2024-04-26T11:13:14.770332+0000","last_undegraded":"2024-04-26T11:13:14.770332+0000","last_fullsized":"2024-04-26T11:13:14.770332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:38.001491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.903953+0000","last_change":"2024-04-26T11:13:12.918407+0000","last_active":"2024-04-26T11:13:13.903953+0000","last_peered":"2024-04-26T11:13:13.903953+0000","last_clean":"2024-04-26T11:13:13.903953+0000","last_became_active":"2024-04-26T11:13:12.918176+0000","last_became_peered":"2024-04-26T11:13:12.918176+0000","last_unstale":"2024-04-26T11:13:13.903953+0000","last_undegraded":"2024-04-26T11:13:13.903953+0000","last_fullsized":"2024-04-26T11:13:13.903953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770185+0000","last_change":"2024-04-26T11:13:12.912756+0000","last_active":"2024-04-26T11:13:14.770185+0000","last_peered":"2024-04-26T11:13:14.770185+0000","last_clean":"2024-04-26T11:13:14.770185+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:13:14.770185+0000","last_undegraded":"2024-04-26T11:13:14.770185+0000","last_fullsized":"2024-04-26T11:13:14.770185+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:04.177831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771368+0000","last_change":"2024-04-26T11:13:12.920122+0000","last_active":"2024-04-26T11:13:14.771368+0000","last_peered":"2024-04-26T11:13:14.771368+0000","last_clean":"2024-04-26T11:13:14.771368+0000","last_became_active":"2024-04-26T11:13:12.919792+0000","last_became_peered":"2024-04-26T11:13:12.919792+0000","last_unstale":"2024-04-26T11:13:14.771368+0000","last_undegraded":"2024-04-26T11:13:14.771368+0000","last_fullsized":"2024-04-26T11:13:14.771368+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:54.809926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904864+0000","last_change":"2024-04-26T11:13:12.912803+0000","last_active":"2024-04-26T11:13:13.904864+0000","last_peered":"2024-04-26T11:13:13.904864+0000","last_clean":"2024-04-26T11:13:13.904864+0000","last_became_active":"2024-04-26T11:13:12.912254+0000","last_became_peered":"2024-04-26T11:13:12.912254+0000","last_unstale":"2024-04-26T11:13:13.904864+0000","last_undegraded":"2024-04-26T11:13:13.904864+0000","last_fullsized":"2024-04-26T11:13:13.904864+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:11.313582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905305+0000","last_change":"2024-04-26T11:13:12.921062+0000","last_active":"2024-04-26T11:13:13.905305+0000","last_peered":"2024-04-26T11:13:13.905305+0000","last_clean":"2024-04-26T11:13:13.905305+0000","last_became_active":"2024-04-26T11:13:12.918716+0000","last_became_peered":"2024-04-26T11:13:12.918716+0000","last_unstale":"2024-04-26T11:13:13.905305+0000","last_undegraded":"2024-04-26T11:13:13.905305+0000","last_fullsized":"2024-04-26T11:13:13.905305+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:55.576807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770220+0000","last_change":"2024-04-26T11:13:12.493425+0000","last_active":"2024-04-26T11:13:14.770220+0000","last_peered":"2024-04-26T11:13:14.770220+0000","last_clean":"2024-04-26T11:13:14.770220+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:13:14.770220+0000","last_undegraded":"2024-04-26T11:13:14.770220+0000","last_fullsized":"2024-04-26T11:13:14.770220+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:23.279580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771122+0000","last_change":"2024-04-26T11:13:12.918515+0000","last_active":"2024-04-26T11:13:14.771122+0000","last_peered":"2024-04-26T11:13:14.771122+0000","last_clean":"2024-04-26T11:13:14.771122+0000","last_became_active":"2024-04-26T11:13:12.918002+0000","last_became_peered":"2024-04-26T11:13:12.918002+0000","last_unstale":"2024-04-26T11:13:14.771122+0000","last_undegraded":"2024-04-26T11:13:14.771122+0000","last_fullsized":"2024-04-26T11:13:14.771122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:46.610126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904192+0000","last_change":"2024-04-26T11:13:12.490257+0000","last_active":"2024-04-26T11:13:13.904192+0000","last_peered":"2024-04-26T11:13:13.904192+0000","last_clean":"2024-04-26T11:13:13.904192+0000","last_became_active":"2024-04-26T11:13:12.488819+0000","last_became_peered":"2024-04-26T11:13:12.488819+0000","last_unstale":"2024-04-26T11:13:13.904192+0000","last_undegraded":"2024-04-26T11:13:13.904192+0000","last_fullsized":"2024-04-26T11:13:13.904192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:52.644533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904995+0000","last_change":"2024-04-26T11:13:12.915624+0000","last_active":"2024-04-26T11:13:13.904995+0000","last_peered":"2024-04-26T11:13:13.904995+0000","last_clean":"2024-04-26T11:13:13.904995+0000","last_became_active":"2024-04-26T11:13:12.915375+0000","last_became_peered":"2024-04-26T11:13:12.915375+0000","last_unstale":"2024-04-26T11:13:13.904995+0000","last_undegraded":"2024-04-26T11:13:13.904995+0000","last_fullsized":"2024-04-26T11:13:13.904995+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:28.908758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904382+0000","last_change":"2024-04-26T11:13:12.487990+0000","last_active":"2024-04-26T11:13:13.904382+0000","last_peered":"2024-04-26T11:13:13.904382+0000","last_clean":"2024-04-26T11:13:13.904382+0000","last_became_active":"2024-04-26T11:13:12.486848+0000","last_became_peered":"2024-04-26T11:13:12.486848+0000","last_unstale":"2024-04-26T11:13:13.904382+0000","last_undegraded":"2024-04-26T11:13:13.904382+0000","last_fullsized":"2024-04-26T11:13:13.904382+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:56.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771304+0000","last_change":"2024-04-26T11:13:12.917423+0000","last_active":"2024-04-26T11:13:14.771304+0000","last_peered":"2024-04-26T11:13:14.771304+0000","last_clean":"2024-04-26T11:13:14.771304+0000","last_became_active":"2024-04-26T11:13:12.916811+0000","last_became_peered":"2024-04-26T11:13:12.916811+0000","last_unstale":"2024-04-26T11:13:14.771304+0000","last_undegraded":"2024-04-26T11:13:14.771304+0000","last_fullsized":"2024-04-26T11:13:14.771304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:28.908758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905043+0000","last_change":"2024-04-26T11:13:12.490251+0000","last_active":"2024-04-26T11:13:13.905043+0000","last_peered":"2024-04-26T11:13:13.905043+0000","last_clean":"2024-04-26T11:13:13.905043+0000","last_became_active":"2024-04-26T11:13:12.489836+0000","last_became_peered":"2024-04-26T11:13:12.489836+0000","last_unstale":"2024-04-26T11:13:13.905043+0000","last_undegraded":"2024-04-26T11:13:13.905043+0000","last_fullsized":"2024-04-26T11:13:13.905043+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:42.000159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.903972+0000","last_change":"2024-04-26T11:13:12.912865+0000","last_active":"2024-04-26T11:13:13.903972+0000","last_peered":"2024-04-26T11:13:13.903972+0000","last_clean":"2024-04-26T11:13:13.903972+0000","last_became_active":"2024-04-26T11:13:12.912397+0000","last_became_peered":"2024-04-26T11:13:12.912397+0000","last_unstale":"2024-04-26T11:13:13.903972+0000","last_undegraded":"2024-04-26T11:13:13.903972+0000","last_fullsized":"2024-04-26T11:13:13.903972+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905218+0000","last_change":"2024-04-26T11:13:12.493118+0000","last_active":"2024-04-26T11:13:13.905218+0000","last_peered":"2024-04-26T11:13:13.905218+0000","last_clean":"2024-04-26T11:13:13.905218+0000","last_became_active":"2024-04-26T11:13:12.492799+0000","last_became_peered":"2024-04-26T11:13:12.492799+0000","last_unstale":"2024-04-26T11:13:13.905218+0000","last_undegraded":"2024-04-26T11:13:13.905218+0000","last_fullsized":"2024-04-26T11:13:13.905218+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:46.082467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904510+0000","last_change":"2024-04-26T11:13:12.918149+0000","last_active":"2024-04-26T11:13:13.904510+0000","last_peered":"2024-04-26T11:13:13.904510+0000","last_clean":"2024-04-26T11:13:13.904510+0000","last_became_active":"2024-04-26T11:13:12.917636+0000","last_became_peered":"2024-04-26T11:13:12.917636+0000","last_unstale":"2024-04-26T11:13:13.904510+0000","last_undegraded":"2024-04-26T11:13:13.904510+0000","last_fullsized":"2024-04-26T11:13:13.904510+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:20.837217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770906+0000","last_change":"2024-04-26T11:13:12.495785+0000","last_active":"2024-04-26T11:13:14.770906+0000","last_peered":"2024-04-26T11:13:14.770906+0000","last_clean":"2024-04-26T11:13:14.770906+0000","last_became_active":"2024-04-26T11:13:12.495527+0000","last_became_peered":"2024-04-26T11:13:12.495527+0000","last_unstale":"2024-04-26T11:13:14.770906+0000","last_undegraded":"2024-04-26T11:13:14.770906+0000","last_fullsized":"2024-04-26T11:13:14.770906+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:45.374565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904416+0000","last_change":"2024-04-26T11:13:12.913698+0000","last_active":"2024-04-26T11:13:13.904416+0000","last_peered":"2024-04-26T11:13:13.904416+0000","last_clean":"2024-04-26T11:13:13.904416+0000","last_became_active":"2024-04-26T11:13:12.913198+0000","last_became_peered":"2024-04-26T11:13:12.913198+0000","last_unstale":"2024-04-26T11:13:13.904416+0000","last_undegraded":"2024-04-26T11:13:13.904416+0000","last_fullsized":"2024-04-26T11:13:13.904416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905059+0000","last_change":"2024-04-26T11:13:12.492878+0000","last_active":"2024-04-26T11:13:13.905059+0000","last_peered":"2024-04-26T11:13:13.905059+0000","last_clean":"2024-04-26T11:13:13.905059+0000","last_became_active":"2024-04-26T11:13:12.491690+0000","last_became_peered":"2024-04-26T11:13:12.491690+0000","last_unstale":"2024-04-26T11:13:13.905059+0000","last_undegraded":"2024-04-26T11:13:13.905059+0000","last_fullsized":"2024-04-26T11:13:13.905059+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:12.581788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905197+0000","last_change":"2024-04-26T11:13:12.916914+0000","last_active":"2024-04-26T11:13:13.905197+0000","last_peered":"2024-04-26T11:13:13.905197+0000","last_clean":"2024-04-26T11:13:13.905197+0000","last_became_active":"2024-04-26T11:13:12.913900+0000","last_became_peered":"2024-04-26T11:13:12.913900+0000","last_unstale":"2024-04-26T11:13:13.905197+0000","last_undegraded":"2024-04-26T11:13:13.905197+0000","last_fullsized":"2024-04-26T11:13:13.905197+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:28.908758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905107+0000","last_change":"2024-04-26T11:13:12.493445+0000","last_active":"2024-04-26T11:13:13.905107+0000","last_peered":"2024-04-26T11:13:13.905107+0000","last_clean":"2024-04-26T11:13:13.905107+0000","last_became_active":"2024-04-26T11:13:12.493015+0000","last_became_peered":"2024-04-26T11:13:12.493015+0000","last_unstale":"2024-04-26T11:13:13.905107+0000","last_undegraded":"2024-04-26T11:13:13.905107+0000","last_fullsized":"2024-04-26T11:13:13.905107+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:17.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770711+0000","last_change":"2024-04-26T11:13:12.916685+0000","last_active":"2024-04-26T11:13:14.770711+0000","last_peered":"2024-04-26T11:13:14.770711+0000","last_clean":"2024-04-26T11:13:14.770711+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:13:14.770711+0000","last_undegraded":"2024-04-26T11:13:14.770711+0000","last_fullsized":"2024-04-26T11:13:14.770711+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904543+0000","last_change":"2024-04-26T11:13:12.491438+0000","last_active":"2024-04-26T11:13:13.904543+0000","last_peered":"2024-04-26T11:13:13.904543+0000","last_clean":"2024-04-26T11:13:13.904543+0000","last_became_active":"2024-04-26T11:13:12.490515+0000","last_became_peered":"2024-04-26T11:13:12.490515+0000","last_unstale":"2024-04-26T11:13:13.904543+0000","last_undegraded":"2024-04-26T11:13:13.904543+0000","last_fullsized":"2024-04-26T11:13:13.904543+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:11.480844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770974+0000","last_change":"2024-04-26T11:13:12.915238+0000","last_active":"2024-04-26T11:13:14.770974+0000","last_peered":"2024-04-26T11:13:14.770974+0000","last_clean":"2024-04-26T11:13:14.770974+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:13:14.770974+0000","last_undegraded":"2024-04-26T11:13:14.770974+0000","last_fullsized":"2024-04-26T11:13:14.770974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:48.068465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770266+0000","last_change":"2024-04-26T11:13:12.492682+0000","last_active":"2024-04-26T11:13:14.770266+0000","last_peered":"2024-04-26T11:13:14.770266+0000","last_clean":"2024-04-26T11:13:14.770266+0000","last_became_active":"2024-04-26T11:13:12.492346+0000","last_became_peered":"2024-04-26T11:13:12.492346+0000","last_unstale":"2024-04-26T11:13:14.770266+0000","last_undegraded":"2024-04-26T11:13:14.770266+0000","last_fullsized":"2024-04-26T11:13:14.770266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:28.034755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905121+0000","last_change":"2024-04-26T11:13:12.913671+0000","last_active":"2024-04-26T11:13:13.905121+0000","last_peered":"2024-04-26T11:13:13.905121+0000","last_clean":"2024-04-26T11:13:13.905121+0000","last_became_active":"2024-04-26T11:13:12.913264+0000","last_became_peered":"2024-04-26T11:13:12.913264+0000","last_unstale":"2024-04-26T11:13:13.905121+0000","last_undegraded":"2024-04-26T11:13:13.905121+0000","last_fullsized":"2024-04-26T11:13:13.905121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904759+0000","last_change":"2024-04-26T11:13:12.492802+0000","last_active":"2024-04-26T11:13:13.904759+0000","last_peered":"2024-04-26T11:13:13.904759+0000","last_clean":"2024-04-26T11:13:13.904759+0000","last_became_active":"2024-04-26T11:13:12.491774+0000","last_became_peered":"2024-04-26T11:13:12.491774+0000","last_unstale":"2024-04-26T11:13:13.904759+0000","last_undegraded":"2024-04-26T11:13:13.904759+0000","last_fullsized":"2024-04-26T11:13:13.904759+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:05.413010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905139+0000","last_change":"2024-04-26T11:13:12.915666+0000","last_active":"2024-04-26T11:13:13.905139+0000","last_peered":"2024-04-26T11:13:13.905139+0000","last_clean":"2024-04-26T11:13:13.905139+0000","last_became_active":"2024-04-26T11:13:12.915393+0000","last_became_peered":"2024-04-26T11:13:12.915393+0000","last_unstale":"2024-04-26T11:13:13.905139+0000","last_undegraded":"2024-04-26T11:13:13.905139+0000","last_fullsized":"2024-04-26T11:13:13.905139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905455+0000","last_change":"2024-04-26T11:13:12.491934+0000","last_active":"2024-04-26T11:13:13.905455+0000","last_peered":"2024-04-26T11:13:13.905455+0000","last_clean":"2024-04-26T11:13:13.905455+0000","last_became_active":"2024-04-26T11:13:12.491262+0000","last_became_peered":"2024-04-26T11:13:12.491262+0000","last_unstale":"2024-04-26T11:13:13.905455+0000","last_undegraded":"2024-04-26T11:13:13.905455+0000","last_fullsized":"2024-04-26T11:13:13.905455+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:11.480844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.769967+0000","last_change":"2024-04-26T11:13:12.920072+0000","last_active":"2024-04-26T11:13:14.769967+0000","last_peered":"2024-04-26T11:13:14.769967+0000","last_clean":"2024-04-26T11:13:14.769967+0000","last_became_active":"2024-04-26T11:13:12.919233+0000","last_became_peered":"2024-04-26T11:13:12.919233+0000","last_unstale":"2024-04-26T11:13:14.769967+0000","last_undegraded":"2024-04-26T11:13:14.769967+0000","last_fullsized":"2024-04-26T11:13:14.769967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:41.004462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771109+0000","last_change":"2024-04-26T11:13:12.493060+0000","last_active":"2024-04-26T11:13:14.771109+0000","last_peered":"2024-04-26T11:13:14.771109+0000","last_clean":"2024-04-26T11:13:14.771109+0000","last_became_active":"2024-04-26T11:13:12.492519+0000","last_became_peered":"2024-04-26T11:13:12.492519+0000","last_unstale":"2024-04-26T11:13:14.771109+0000","last_undegraded":"2024-04-26T11:13:14.771109+0000","last_fullsized":"2024-04-26T11:13:14.771109+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:48.928740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770525+0000","last_change":"2024-04-26T11:13:12.912207+0000","last_active":"2024-04-26T11:13:14.770525+0000","last_peered":"2024-04-26T11:13:14.770525+0000","last_clean":"2024-04-26T11:13:14.770525+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:13:14.770525+0000","last_undegraded":"2024-04-26T11:13:14.770525+0000","last_fullsized":"2024-04-26T11:13:14.770525+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905410+0000","last_change":"2024-04-26T11:13:12.492772+0000","last_active":"2024-04-26T11:13:13.905410+0000","last_peered":"2024-04-26T11:13:13.905410+0000","last_clean":"2024-04-26T11:13:13.905410+0000","last_became_active":"2024-04-26T11:13:12.491901+0000","last_became_peered":"2024-04-26T11:13:12.491901+0000","last_unstale":"2024-04-26T11:13:13.905410+0000","last_undegraded":"2024-04-26T11:13:13.905410+0000","last_fullsized":"2024-04-26T11:13:13.905410+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:45.693017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904852+0000","last_change":"2024-04-26T11:13:12.919749+0000","last_active":"2024-04-26T11:13:13.904852+0000","last_peered":"2024-04-26T11:13:13.904852+0000","last_clean":"2024-04-26T11:13:13.904852+0000","last_became_active":"2024-04-26T11:13:12.917479+0000","last_became_peered":"2024-04-26T11:13:12.917479+0000","last_unstale":"2024-04-26T11:13:13.904852+0000","last_undegraded":"2024-04-26T11:13:13.904852+0000","last_fullsized":"2024-04-26T11:13:13.904852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:12.483631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904944+0000","last_change":"2024-04-26T11:13:12.495144+0000","last_active":"2024-04-26T11:13:13.904944+0000","last_peered":"2024-04-26T11:13:13.904944+0000","last_clean":"2024-04-26T11:13:13.904944+0000","last_became_active":"2024-04-26T11:13:12.494510+0000","last_became_peered":"2024-04-26T11:13:12.494510+0000","last_unstale":"2024-04-26T11:13:13.904944+0000","last_undegraded":"2024-04-26T11:13:13.904944+0000","last_fullsized":"2024-04-26T11:13:13.904944+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:00.146717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904907+0000","last_change":"2024-04-26T11:13:12.913350+0000","last_active":"2024-04-26T11:13:13.904907+0000","last_peered":"2024-04-26T11:13:13.904907+0000","last_clean":"2024-04-26T11:13:13.904907+0000","last_became_active":"2024-04-26T11:13:12.912991+0000","last_became_peered":"2024-04-26T11:13:12.912991+0000","last_unstale":"2024-04-26T11:13:13.904907+0000","last_undegraded":"2024-04-26T11:13:13.904907+0000","last_fullsized":"2024-04-26T11:13:13.904907+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:54.809926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904432+0000","last_change":"2024-04-26T11:13:12.490343+0000","last_active":"2024-04-26T11:13:13.904432+0000","last_peered":"2024-04-26T11:13:13.904432+0000","last_clean":"2024-04-26T11:13:13.904432+0000","last_became_active":"2024-04-26T11:13:12.490027+0000","last_became_peered":"2024-04-26T11:13:12.490027+0000","last_unstale":"2024-04-26T11:13:13.904432+0000","last_undegraded":"2024-04-26T11:13:13.904432+0000","last_fullsized":"2024-04-26T11:13:13.904432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:45.693017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904814+0000","last_change":"2024-04-26T11:13:12.918774+0000","last_active":"2024-04-26T11:13:13.904814+0000","last_peered":"2024-04-26T11:13:13.904814+0000","last_clean":"2024-04-26T11:13:13.904814+0000","last_became_active":"2024-04-26T11:13:12.917269+0000","last_became_peered":"2024-04-26T11:13:12.917269+0000","last_unstale":"2024-04-26T11:13:13.904814+0000","last_undegraded":"2024-04-26T11:13:13.904814+0000","last_fullsized":"2024-04-26T11:13:13.904814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:33.358984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904745+0000","last_change":"2024-04-26T11:13:12.494689+0000","last_active":"2024-04-26T11:13:13.904745+0000","last_peered":"2024-04-26T11:13:13.904745+0000","last_clean":"2024-04-26T11:13:13.904745+0000","last_became_active":"2024-04-26T11:13:12.494236+0000","last_became_peered":"2024-04-26T11:13:12.494236+0000","last_unstale":"2024-04-26T11:13:13.904745+0000","last_undegraded":"2024-04-26T11:13:13.904745+0000","last_fullsized":"2024-04-26T11:13:13.904745+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:42.000159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905618+0000","last_change":"2024-04-26T11:13:12.919985+0000","last_active":"2024-04-26T11:13:13.905618+0000","last_peered":"2024-04-26T11:13:13.905618+0000","last_clean":"2024-04-26T11:13:13.905618+0000","last_became_active":"2024-04-26T11:13:12.916239+0000","last_became_peered":"2024-04-26T11:13:12.916239+0000","last_unstale":"2024-04-26T11:13:13.905618+0000","last_undegraded":"2024-04-26T11:13:13.905618+0000","last_fullsized":"2024-04-26T11:13:13.905618+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:54.809926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770064+0000","last_change":"2024-04-26T11:13:12.492856+0000","last_active":"2024-04-26T11:13:14.770064+0000","last_peered":"2024-04-26T11:13:14.770064+0000","last_clean":"2024-04-26T11:13:14.770064+0000","last_became_active":"2024-04-26T11:13:12.492412+0000","last_became_peered":"2024-04-26T11:13:12.492412+0000","last_unstale":"2024-04-26T11:13:14.770064+0000","last_undegraded":"2024-04-26T11:13:14.770064+0000","last_fullsized":"2024-04-26T11:13:14.770064+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:09.572402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905480+0000","last_change":"2024-04-26T11:13:12.920056+0000","last_active":"2024-04-26T11:13:13.905480+0000","last_peered":"2024-04-26T11:13:13.905480+0000","last_clean":"2024-04-26T11:13:13.905480+0000","last_became_active":"2024-04-26T11:13:12.919049+0000","last_became_peered":"2024-04-26T11:13:12.919049+0000","last_unstale":"2024-04-26T11:13:13.905480+0000","last_undegraded":"2024-04-26T11:13:13.905480+0000","last_fullsized":"2024-04-26T11:13:13.905480+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770130+0000","last_change":"2024-04-26T11:13:12.493217+0000","last_active":"2024-04-26T11:13:14.770130+0000","last_peered":"2024-04-26T11:13:14.770130+0000","last_clean":"2024-04-26T11:13:14.770130+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:13:14.770130+0000","last_undegraded":"2024-04-26T11:13:14.770130+0000","last_fullsized":"2024-04-26T11:13:14.770130+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:00.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904940+0000","last_change":"2024-04-26T11:13:12.914321+0000","last_active":"2024-04-26T11:13:13.904940+0000","last_peered":"2024-04-26T11:13:13.904940+0000","last_clean":"2024-04-26T11:13:13.904940+0000","last_became_active":"2024-04-26T11:13:12.913543+0000","last_became_peered":"2024-04-26T11:13:12.913543+0000","last_unstale":"2024-04-26T11:13:13.904940+0000","last_undegraded":"2024-04-26T11:13:13.904940+0000","last_fullsized":"2024-04-26T11:13:13.904940+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.903582+0000","last_change":"2024-04-26T11:13:08.113095+0000","last_active":"2024-04-26T11:13:12.903582+0000","last_peered":"2024-04-26T11:13:12.903582+0000","last_clean":"2024-04-26T11:13:12.903582+0000","last_became_active":"2024-04-26T11:13:08.112778+0000","last_became_peered":"2024-04-26T11:13:08.112778+0000","last_unstale":"2024-04-26T11:13:12.903582+0000","last_undegraded":"2024-04-26T11:13:12.903582+0000","last_fullsized":"2024-04-26T11:13:12.903582+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:41.705893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905517+0000","last_change":"2024-04-26T11:13:12.493960+0000","last_active":"2024-04-26T11:13:13.905517+0000","last_peered":"2024-04-26T11:13:13.905517+0000","last_clean":"2024-04-26T11:13:13.905517+0000","last_became_active":"2024-04-26T11:13:12.493087+0000","last_became_peered":"2024-04-26T11:13:12.493087+0000","last_unstale":"2024-04-26T11:13:13.905517+0000","last_undegraded":"2024-04-26T11:13:13.905517+0000","last_fullsized":"2024-04-26T11:13:13.905517+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:19.538082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770546+0000","last_change":"2024-04-26T11:13:12.917458+0000","last_active":"2024-04-26T11:13:14.770546+0000","last_peered":"2024-04-26T11:13:14.770546+0000","last_clean":"2024-04-26T11:13:14.770546+0000","last_became_active":"2024-04-26T11:13:12.916792+0000","last_became_peered":"2024-04-26T11:13:12.916792+0000","last_unstale":"2024-04-26T11:13:14.770546+0000","last_undegraded":"2024-04-26T11:13:14.770546+0000","last_fullsized":"2024-04-26T11:13:14.770546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:12.483631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.913665+0000","last_change":"2024-04-26T11:13:08.112744+0000","last_active":"2024-04-26T11:13:12.913665+0000","last_peered":"2024-04-26T11:13:12.913665+0000","last_clean":"2024-04-26T11:13:12.913665+0000","last_became_active":"2024-04-26T11:13:08.112498+0000","last_became_peered":"2024-04-26T11:13:08.112498+0000","last_unstale":"2024-04-26T11:13:12.913665+0000","last_undegraded":"2024-04-26T11:13:12.913665+0000","last_fullsized":"2024-04-26T11:13:12.913665+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:38.407116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904845+0000","last_change":"2024-04-26T11:13:12.494137+0000","last_active":"2024-04-26T11:13:13.904845+0000","last_peered":"2024-04-26T11:13:13.904845+0000","last_clean":"2024-04-26T11:13:13.904845+0000","last_became_active":"2024-04-26T11:13:12.493447+0000","last_became_peered":"2024-04-26T11:13:12.493447+0000","last_unstale":"2024-04-26T11:13:13.904845+0000","last_undegraded":"2024-04-26T11:13:13.904845+0000","last_fullsized":"2024-04-26T11:13:13.904845+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:52.644533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904572+0000","last_change":"2024-04-26T11:13:12.912553+0000","last_active":"2024-04-26T11:13:13.904572+0000","last_peered":"2024-04-26T11:13:13.904572+0000","last_clean":"2024-04-26T11:13:13.904572+0000","last_became_active":"2024-04-26T11:13:12.912022+0000","last_became_peered":"2024-04-26T11:13:12.912022+0000","last_unstale":"2024-04-26T11:13:13.904572+0000","last_undegraded":"2024-04-26T11:13:13.904572+0000","last_fullsized":"2024-04-26T11:13:13.904572+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.903369+0000","last_change":"2024-04-26T11:13:08.113650+0000","last_active":"2024-04-26T11:13:12.903369+0000","last_peered":"2024-04-26T11:13:12.903369+0000","last_clean":"2024-04-26T11:13:12.903369+0000","last_became_active":"2024-04-26T11:13:08.113394+0000","last_became_peered":"2024-04-26T11:13:08.113394+0000","last_unstale":"2024-04-26T11:13:12.903369+0000","last_undegraded":"2024-04-26T11:13:12.903369+0000","last_fullsized":"2024-04-26T11:13:12.903369+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:44.642172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770074+0000","last_change":"2024-04-26T11:13:12.492888+0000","last_active":"2024-04-26T11:13:14.770074+0000","last_peered":"2024-04-26T11:13:14.770074+0000","last_clean":"2024-04-26T11:13:14.770074+0000","last_became_active":"2024-04-26T11:13:12.492274+0000","last_became_peered":"2024-04-26T11:13:12.492274+0000","last_unstale":"2024-04-26T11:13:14.770074+0000","last_undegraded":"2024-04-26T11:13:14.770074+0000","last_fullsized":"2024-04-26T11:13:14.770074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:51.136157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905114+0000","last_change":"2024-04-26T11:13:12.914599+0000","last_active":"2024-04-26T11:13:13.905114+0000","last_peered":"2024-04-26T11:13:13.905114+0000","last_clean":"2024-04-26T11:13:13.905114+0000","last_became_active":"2024-04-26T11:13:12.913916+0000","last_became_peered":"2024-04-26T11:13:12.913916+0000","last_unstale":"2024-04-26T11:13:13.905114+0000","last_undegraded":"2024-04-26T11:13:13.905114+0000","last_fullsized":"2024-04-26T11:13:13.905114+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.915840+0000","last_change":"2024-04-26T11:13:08.112690+0000","last_active":"2024-04-26T11:13:12.915840+0000","last_peered":"2024-04-26T11:13:12.915840+0000","last_clean":"2024-04-26T11:13:12.915840+0000","last_became_active":"2024-04-26T11:13:08.112454+0000","last_became_peered":"2024-04-26T11:13:08.112454+0000","last_unstale":"2024-04-26T11:13:12.915840+0000","last_undegraded":"2024-04-26T11:13:12.915840+0000","last_fullsized":"2024-04-26T11:13:12.915840+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:41.011030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.913577+0000","last_change":"2024-04-26T11:13:08.113419+0000","last_active":"2024-04-26T11:13:12.913577+0000","last_peered":"2024-04-26T11:13:12.913577+0000","last_clean":"2024-04-26T11:13:12.913577+0000","last_became_active":"2024-04-26T11:13:08.113154+0000","last_became_peered":"2024-04-26T11:13:08.113154+0000","last_unstale":"2024-04-26T11:13:12.913577+0000","last_undegraded":"2024-04-26T11:13:12.913577+0000","last_fullsized":"2024-04-26T11:13:12.913577+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:36.482001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904292+0000","last_change":"2024-04-26T11:13:12.491278+0000","last_active":"2024-04-26T11:13:13.904292+0000","last_peered":"2024-04-26T11:13:13.904292+0000","last_clean":"2024-04-26T11:13:13.904292+0000","last_became_active":"2024-04-26T11:13:12.488223+0000","last_became_peered":"2024-04-26T11:13:12.488223+0000","last_unstale":"2024-04-26T11:13:13.904292+0000","last_undegraded":"2024-04-26T11:13:13.904292+0000","last_fullsized":"2024-04-26T11:13:13.904292+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:05.413010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905587+0000","last_change":"2024-04-26T11:13:12.920834+0000","last_active":"2024-04-26T11:13:13.905587+0000","last_peered":"2024-04-26T11:13:13.905587+0000","last_clean":"2024-04-26T11:13:13.905587+0000","last_became_active":"2024-04-26T11:13:12.917055+0000","last_became_peered":"2024-04-26T11:13:12.917055+0000","last_unstale":"2024-04-26T11:13:13.905587+0000","last_undegraded":"2024-04-26T11:13:13.905587+0000","last_fullsized":"2024-04-26T11:13:13.905587+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:11.313582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.913563+0000","last_change":"2024-04-26T11:13:08.113497+0000","last_active":"2024-04-26T11:13:12.913563+0000","last_peered":"2024-04-26T11:13:12.913563+0000","last_clean":"2024-04-26T11:13:12.913563+0000","last_became_active":"2024-04-26T11:13:08.113237+0000","last_became_peered":"2024-04-26T11:13:08.113237+0000","last_unstale":"2024-04-26T11:13:12.913563+0000","last_undegraded":"2024-04-26T11:13:12.913563+0000","last_fullsized":"2024-04-26T11:13:12.913563+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:52.240361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904041+0000","last_change":"2024-04-26T11:13:12.491936+0000","last_active":"2024-04-26T11:13:13.904041+0000","last_peered":"2024-04-26T11:13:13.904041+0000","last_clean":"2024-04-26T11:13:13.904041+0000","last_became_active":"2024-04-26T11:13:12.491533+0000","last_became_peered":"2024-04-26T11:13:12.491533+0000","last_unstale":"2024-04-26T11:13:13.904041+0000","last_undegraded":"2024-04-26T11:13:13.904041+0000","last_fullsized":"2024-04-26T11:13:13.904041+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:13.320025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771296+0000","last_change":"2024-04-26T11:13:12.918648+0000","last_active":"2024-04-26T11:13:14.771296+0000","last_peered":"2024-04-26T11:13:14.771296+0000","last_clean":"2024-04-26T11:13:14.771296+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:13:14.771296+0000","last_undegraded":"2024-04-26T11:13:14.771296+0000","last_fullsized":"2024-04-26T11:13:14.771296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.907846+0000","last_change":"2024-04-26T11:13:08.110433+0000","last_active":"2024-04-26T11:13:12.907846+0000","last_peered":"2024-04-26T11:13:12.907846+0000","last_clean":"2024-04-26T11:13:12.907846+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:13:12.907846+0000","last_undegraded":"2024-04-26T11:13:12.907846+0000","last_fullsized":"2024-04-26T11:13:12.907846+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904956+0000","last_change":"2024-04-26T11:13:12.491648+0000","last_active":"2024-04-26T11:13:13.904956+0000","last_peered":"2024-04-26T11:13:13.904956+0000","last_clean":"2024-04-26T11:13:13.904956+0000","last_became_active":"2024-04-26T11:13:12.488599+0000","last_became_peered":"2024-04-26T11:13:12.488599+0000","last_unstale":"2024-04-26T11:13:13.904956+0000","last_undegraded":"2024-04-26T11:13:13.904956+0000","last_fullsized":"2024-04-26T11:13:13.904956+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:45.374565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770640+0000","last_change":"2024-04-26T11:13:12.920065+0000","last_active":"2024-04-26T11:13:14.770640+0000","last_peered":"2024-04-26T11:13:14.770640+0000","last_clean":"2024-04-26T11:13:14.770640+0000","last_became_active":"2024-04-26T11:13:12.919741+0000","last_became_peered":"2024-04-26T11:13:12.919741+0000","last_unstale":"2024-04-26T11:13:14.770640+0000","last_undegraded":"2024-04-26T11:13:14.770640+0000","last_fullsized":"2024-04-26T11:13:14.770640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:20.837217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904894+0000","last_change":"2024-04-26T11:13:12.488576+0000","last_active":"2024-04-26T11:13:13.904894+0000","last_peered":"2024-04-26T11:13:13.904894+0000","last_clean":"2024-04-26T11:13:13.904894+0000","last_became_active":"2024-04-26T11:13:12.488248+0000","last_became_peered":"2024-04-26T11:13:12.488248+0000","last_unstale":"2024-04-26T11:13:13.904894+0000","last_undegraded":"2024-04-26T11:13:13.904894+0000","last_fullsized":"2024-04-26T11:13:13.904894+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:48.928740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.904393+0000","last_change":"2024-04-26T11:13:08.113157+0000","last_active":"2024-04-26T11:13:12.904393+0000","last_peered":"2024-04-26T11:13:12.904393+0000","last_clean":"2024-04-26T11:13:12.904393+0000","last_became_active":"2024-04-26T11:13:08.112788+0000","last_became_peered":"2024-04-26T11:13:08.112788+0000","last_unstale":"2024-04-26T11:13:12.904393+0000","last_undegraded":"2024-04-26T11:13:12.904393+0000","last_fullsized":"2024-04-26T11:13:12.904393+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:14.606433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904028+0000","last_change":"2024-04-26T11:13:12.919100+0000","last_active":"2024-04-26T11:13:13.904028+0000","last_peered":"2024-04-26T11:13:13.904028+0000","last_clean":"2024-04-26T11:13:13.904028+0000","last_became_active":"2024-04-26T11:13:12.918816+0000","last_became_peered":"2024-04-26T11:13:12.918816+0000","last_unstale":"2024-04-26T11:13:13.904028+0000","last_undegraded":"2024-04-26T11:13:13.904028+0000","last_fullsized":"2024-04-26T11:13:13.904028+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.915609+0000","last_change":"2024-04-26T11:13:08.113505+0000","last_active":"2024-04-26T11:13:12.915609+0000","last_peered":"2024-04-26T11:13:12.915609+0000","last_clean":"2024-04-26T11:13:12.915609+0000","last_became_active":"2024-04-26T11:13:08.113224+0000","last_became_peered":"2024-04-26T11:13:08.113224+0000","last_unstale":"2024-04-26T11:13:12.915609+0000","last_undegraded":"2024-04-26T11:13:12.915609+0000","last_fullsized":"2024-04-26T11:13:12.915609+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:16.157275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:16.455948+0000","last_change":"2024-04-26T11:13:12.490249+0000","last_active":"2024-04-26T11:13:16.455948+0000","last_peered":"2024-04-26T11:13:16.455948+0000","last_clean":"2024-04-26T11:13:16.455948+0000","last_became_active":"2024-04-26T11:13:12.488836+0000","last_became_peered":"2024-04-26T11:13:12.488836+0000","last_unstale":"2024-04-26T11:13:16.455948+0000","last_undegraded":"2024-04-26T11:13:16.455948+0000","last_fullsized":"2024-04-26T11:13:16.455948+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:12.581788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770387+0000","last_change":"2024-04-26T11:13:12.913955+0000","last_active":"2024-04-26T11:13:14.770387+0000","last_peered":"2024-04-26T11:13:14.770387+0000","last_clean":"2024-04-26T11:13:14.770387+0000","last_became_active":"2024-04-26T11:13:12.913037+0000","last_became_peered":"2024-04-26T11:13:12.913037+0000","last_unstale":"2024-04-26T11:13:14.770387+0000","last_undegraded":"2024-04-26T11:13:14.770387+0000","last_fullsized":"2024-04-26T11:13:14.770387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:11.313582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770475+0000","last_change":"2024-04-26T11:13:12.493479+0000","last_active":"2024-04-26T11:13:14.770475+0000","last_peered":"2024-04-26T11:13:14.770475+0000","last_clean":"2024-04-26T11:13:14.770475+0000","last_became_active":"2024-04-26T11:13:12.493174+0000","last_became_peered":"2024-04-26T11:13:12.493174+0000","last_unstale":"2024-04-26T11:13:14.770475+0000","last_undegraded":"2024-04-26T11:13:14.770475+0000","last_fullsized":"2024-04-26T11:13:14.770475+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:05.413010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770803+0000","last_change":"2024-04-26T11:13:12.917812+0000","last_active":"2024-04-26T11:13:14.770803+0000","last_peered":"2024-04-26T11:13:14.770803+0000","last_clean":"2024-04-26T11:13:14.770803+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:13:14.770803+0000","last_undegraded":"2024-04-26T11:13:14.770803+0000","last_fullsized":"2024-04-26T11:13:14.770803+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904950+0000","last_change":"2024-04-26T11:13:12.493351+0000","last_active":"2024-04-26T11:13:13.904950+0000","last_peered":"2024-04-26T11:13:13.904950+0000","last_clean":"2024-04-26T11:13:13.904950+0000","last_became_active":"2024-04-26T11:13:12.492923+0000","last_became_peered":"2024-04-26T11:13:12.492923+0000","last_unstale":"2024-04-26T11:13:13.904950+0000","last_undegraded":"2024-04-26T11:13:13.904950+0000","last_fullsized":"2024-04-26T11:13:13.904950+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:53.444842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904852+0000","last_change":"2024-04-26T11:13:12.918383+0000","last_active":"2024-04-26T11:13:13.904852+0000","last_peered":"2024-04-26T11:13:13.904852+0000","last_clean":"2024-04-26T11:13:13.904852+0000","last_became_active":"2024-04-26T11:13:12.917098+0000","last_became_peered":"2024-04-26T11:13:12.917098+0000","last_unstale":"2024-04-26T11:13:13.904852+0000","last_undegraded":"2024-04-26T11:13:13.904852+0000","last_fullsized":"2024-04-26T11:13:13.904852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:43.397887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770971+0000","last_change":"2024-04-26T11:13:12.493387+0000","last_active":"2024-04-26T11:13:14.770971+0000","last_peered":"2024-04-26T11:13:14.770971+0000","last_clean":"2024-04-26T11:13:14.770971+0000","last_became_active":"2024-04-26T11:13:12.493158+0000","last_became_peered":"2024-04-26T11:13:12.493158+0000","last_unstale":"2024-04-26T11:13:14.770971+0000","last_undegraded":"2024-04-26T11:13:14.770971+0000","last_fullsized":"2024-04-26T11:13:14.770971+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:56.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904899+0000","last_change":"2024-04-26T11:13:12.920137+0000","last_active":"2024-04-26T11:13:13.904899+0000","last_peered":"2024-04-26T11:13:13.904899+0000","last_clean":"2024-04-26T11:13:13.904899+0000","last_became_active":"2024-04-26T11:13:12.919020+0000","last_became_peered":"2024-04-26T11:13:12.919020+0000","last_unstale":"2024-04-26T11:13:13.904899+0000","last_undegraded":"2024-04-26T11:13:13.904899+0000","last_fullsized":"2024-04-26T11:13:13.904899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:47.014768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905092+0000","last_change":"2024-04-26T11:13:12.490017+0000","last_active":"2024-04-26T11:13:13.905092+0000","last_peered":"2024-04-26T11:13:13.905092+0000","last_clean":"2024-04-26T11:13:13.905092+0000","last_became_active":"2024-04-26T11:13:12.488282+0000","last_became_peered":"2024-04-26T11:13:12.488282+0000","last_unstale":"2024-04-26T11:13:13.905092+0000","last_undegraded":"2024-04-26T11:13:13.905092+0000","last_fullsized":"2024-04-26T11:13:13.905092+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:20.176849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770666+0000","last_change":"2024-04-26T11:13:12.917763+0000","last_active":"2024-04-26T11:13:14.770666+0000","last_peered":"2024-04-26T11:13:14.770666+0000","last_clean":"2024-04-26T11:13:14.770666+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:13:14.770666+0000","last_undegraded":"2024-04-26T11:13:14.770666+0000","last_fullsized":"2024-04-26T11:13:14.770666+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905010+0000","last_change":"2024-04-26T11:13:12.491798+0000","last_active":"2024-04-26T11:13:13.905010+0000","last_peered":"2024-04-26T11:13:13.905010+0000","last_clean":"2024-04-26T11:13:13.905010+0000","last_became_active":"2024-04-26T11:13:12.490582+0000","last_became_peered":"2024-04-26T11:13:12.490582+0000","last_unstale":"2024-04-26T11:13:13.905010+0000","last_undegraded":"2024-04-26T11:13:13.905010+0000","last_fullsized":"2024-04-26T11:13:13.905010+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:46.082467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904998+0000","last_change":"2024-04-26T11:13:12.914549+0000","last_active":"2024-04-26T11:13:13.904998+0000","last_peered":"2024-04-26T11:13:13.904998+0000","last_clean":"2024-04-26T11:13:13.904998+0000","last_became_active":"2024-04-26T11:13:12.913041+0000","last_became_peered":"2024-04-26T11:13:12.913041+0000","last_unstale":"2024-04-26T11:13:13.904998+0000","last_undegraded":"2024-04-26T11:13:13.904998+0000","last_fullsized":"2024-04-26T11:13:13.904998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904654+0000","last_change":"2024-04-26T11:13:12.916942+0000","last_active":"2024-04-26T11:13:13.904654+0000","last_peered":"2024-04-26T11:13:13.904654+0000","last_clean":"2024-04-26T11:13:13.904654+0000","last_became_active":"2024-04-26T11:13:12.916144+0000","last_became_peered":"2024-04-26T11:13:12.916144+0000","last_unstale":"2024-04-26T11:13:13.904654+0000","last_undegraded":"2024-04-26T11:13:13.904654+0000","last_fullsized":"2024-04-26T11:13:13.904654+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:46.610126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904072+0000","last_change":"2024-04-26T11:13:12.913826+0000","last_active":"2024-04-26T11:13:13.904072+0000","last_peered":"2024-04-26T11:13:13.904072+0000","last_clean":"2024-04-26T11:13:13.904072+0000","last_became_active":"2024-04-26T11:13:12.912911+0000","last_became_peered":"2024-04-26T11:13:12.912911+0000","last_unstale":"2024-04-26T11:13:13.904072+0000","last_undegraded":"2024-04-26T11:13:13.904072+0000","last_fullsized":"2024-04-26T11:13:13.904072+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:10.887079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770469+0000","last_change":"2024-04-26T11:13:12.921818+0000","last_active":"2024-04-26T11:13:14.770469+0000","last_peered":"2024-04-26T11:13:14.770469+0000","last_clean":"2024-04-26T11:13:14.770469+0000","last_became_active":"2024-04-26T11:13:12.921526+0000","last_became_peered":"2024-04-26T11:13:12.921526+0000","last_unstale":"2024-04-26T11:13:14.770469+0000","last_undegraded":"2024-04-26T11:13:14.770469+0000","last_fullsized":"2024-04-26T11:13:14.770469+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:47.958725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904819+0000","last_change":"2024-04-26T11:13:12.912731+0000","last_active":"2024-04-26T11:13:13.904819+0000","last_peered":"2024-04-26T11:13:13.904819+0000","last_clean":"2024-04-26T11:13:13.904819+0000","last_became_active":"2024-04-26T11:13:12.911522+0000","last_became_peered":"2024-04-26T11:13:12.911522+0000","last_unstale":"2024-04-26T11:13:13.904819+0000","last_undegraded":"2024-04-26T11:13:13.904819+0000","last_fullsized":"2024-04-26T11:13:13.904819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:46.610126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770830+0000","last_change":"2024-04-26T11:13:12.919750+0000","last_active":"2024-04-26T11:13:14.770830+0000","last_peered":"2024-04-26T11:13:14.770830+0000","last_clean":"2024-04-26T11:13:14.770830+0000","last_became_active":"2024-04-26T11:13:12.919116+0000","last_became_peered":"2024-04-26T11:13:12.919116+0000","last_unstale":"2024-04-26T11:13:14.770830+0000","last_undegraded":"2024-04-26T11:13:14.770830+0000","last_fullsized":"2024-04-26T11:13:14.770830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:10.887079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":745472,"data_stored":637050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]}]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:13:34.585 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:13:34.964 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:34.966 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:13:34.976 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-26T11:13:34.455489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86788,"kb_used_data":1604,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283028732,"statfs":{"total":289910292480,"available":289821421568,"internally_reserved":0,"allocated":1642496,"data_stored":1322490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":87158098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002753"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771368+0000","last_change":"2024-04-26T11:13:12.919196+0000","last_active":"2024-04-26T11:13:14.771368+0000","last_peered":"2024-04-26T11:13:14.771368+0000","last_clean":"2024-04-26T11:13:14.771368+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:13:14.771368+0000","last_undegraded":"2024-04-26T11:13:14.771368+0000","last_fullsized":"2024-04-26T11:13:14.771368+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771085+0000","last_change":"2024-04-26T11:13:12.917670+0000","last_active":"2024-04-26T11:13:14.771085+0000","last_peered":"2024-04-26T11:13:14.771085+0000","last_clean":"2024-04-26T11:13:14.771085+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:13:14.771085+0000","last_undegraded":"2024-04-26T11:13:14.771085+0000","last_fullsized":"2024-04-26T11:13:14.771085+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905470+0000","last_change":"2024-04-26T11:13:12.922235+0000","last_active":"2024-04-26T11:13:13.905470+0000","last_peered":"2024-04-26T11:13:13.905470+0000","last_clean":"2024-04-26T11:13:13.905470+0000","last_became_active":"2024-04-26T11:13:12.919993+0000","last_became_peered":"2024-04-26T11:13:12.919993+0000","last_unstale":"2024-04-26T11:13:13.905470+0000","last_undegraded":"2024-04-26T11:13:13.905470+0000","last_fullsized":"2024-04-26T11:13:13.905470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:41.004462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905212+0000","last_change":"2024-04-26T11:13:12.916859+0000","last_active":"2024-04-26T11:13:13.905212+0000","last_peered":"2024-04-26T11:13:13.905212+0000","last_clean":"2024-04-26T11:13:13.905212+0000","last_became_active":"2024-04-26T11:13:12.915591+0000","last_became_peered":"2024-04-26T11:13:12.915591+0000","last_unstale":"2024-04-26T11:13:13.905212+0000","last_undegraded":"2024-04-26T11:13:13.905212+0000","last_fullsized":"2024-04-26T11:13:13.905212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:52.543148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770643+0000","last_change":"2024-04-26T11:13:12.917403+0000","last_active":"2024-04-26T11:13:14.770643+0000","last_peered":"2024-04-26T11:13:14.770643+0000","last_clean":"2024-04-26T11:13:14.770643+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:13:14.770643+0000","last_undegraded":"2024-04-26T11:13:14.770643+0000","last_fullsized":"2024-04-26T11:13:14.770643+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:42.014955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904599+0000","last_change":"2024-04-26T11:13:12.918802+0000","last_active":"2024-04-26T11:13:13.904599+0000","last_peered":"2024-04-26T11:13:13.904599+0000","last_clean":"2024-04-26T11:13:13.904599+0000","last_became_active":"2024-04-26T11:13:12.917353+0000","last_became_peered":"2024-04-26T11:13:12.917353+0000","last_unstale":"2024-04-26T11:13:13.904599+0000","last_undegraded":"2024-04-26T11:13:13.904599+0000","last_fullsized":"2024-04-26T11:13:13.904599+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:08.956085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904746+0000","last_change":"2024-04-26T11:13:12.916789+0000","last_active":"2024-04-26T11:13:13.904746+0000","last_peered":"2024-04-26T11:13:13.904746+0000","last_clean":"2024-04-26T11:13:13.904746+0000","last_became_active":"2024-04-26T11:13:12.914947+0000","last_became_peered":"2024-04-26T11:13:12.914947+0000","last_unstale":"2024-04-26T11:13:13.904746+0000","last_undegraded":"2024-04-26T11:13:13.904746+0000","last_fullsized":"2024-04-26T11:13:13.904746+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904343+0000","last_change":"2024-04-26T11:13:12.919968+0000","last_active":"2024-04-26T11:13:13.904343+0000","last_peered":"2024-04-26T11:13:13.904343+0000","last_clean":"2024-04-26T11:13:13.904343+0000","last_became_active":"2024-04-26T11:13:12.918600+0000","last_became_peered":"2024-04-26T11:13:12.918600+0000","last_unstale":"2024-04-26T11:13:13.904343+0000","last_undegraded":"2024-04-26T11:13:13.904343+0000","last_fullsized":"2024-04-26T11:13:13.904343+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:41.073901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904753+0000","last_change":"2024-04-26T11:13:12.914649+0000","last_active":"2024-04-26T11:13:13.904753+0000","last_peered":"2024-04-26T11:13:13.904753+0000","last_clean":"2024-04-26T11:13:13.904753+0000","last_became_active":"2024-04-26T11:13:12.914174+0000","last_became_peered":"2024-04-26T11:13:12.914174+0000","last_unstale":"2024-04-26T11:13:13.904753+0000","last_undegraded":"2024-04-26T11:13:13.904753+0000","last_fullsized":"2024-04-26T11:13:13.904753+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:41.004462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771235+0000","last_change":"2024-04-26T11:13:12.918521+0000","last_active":"2024-04-26T11:13:14.771235+0000","last_peered":"2024-04-26T11:13:14.771235+0000","last_clean":"2024-04-26T11:13:14.771235+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:13:14.771235+0000","last_undegraded":"2024-04-26T11:13:14.771235+0000","last_fullsized":"2024-04-26T11:13:14.771235+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905226+0000","last_change":"2024-04-26T11:13:12.922456+0000","last_active":"2024-04-26T11:13:13.905226+0000","last_peered":"2024-04-26T11:13:13.905226+0000","last_clean":"2024-04-26T11:13:13.905226+0000","last_became_active":"2024-04-26T11:13:12.921230+0000","last_became_peered":"2024-04-26T11:13:12.921230+0000","last_unstale":"2024-04-26T11:13:13.905226+0000","last_undegraded":"2024-04-26T11:13:13.905226+0000","last_fullsized":"2024-04-26T11:13:13.905226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:55.318150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770399+0000","last_change":"2024-04-26T11:13:12.914082+0000","last_active":"2024-04-26T11:13:14.770399+0000","last_peered":"2024-04-26T11:13:14.770399+0000","last_clean":"2024-04-26T11:13:14.770399+0000","last_became_active":"2024-04-26T11:13:12.913374+0000","last_became_peered":"2024-04-26T11:13:12.913374+0000","last_unstale":"2024-04-26T11:13:14.770399+0000","last_undegraded":"2024-04-26T11:13:14.770399+0000","last_fullsized":"2024-04-26T11:13:14.770399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:52.543148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770460+0000","last_change":"2024-04-26T11:13:12.915484+0000","last_active":"2024-04-26T11:13:14.770460+0000","last_peered":"2024-04-26T11:13:14.770460+0000","last_clean":"2024-04-26T11:13:14.770460+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:13:14.770460+0000","last_undegraded":"2024-04-26T11:13:14.770460+0000","last_fullsized":"2024-04-26T11:13:14.770460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905148+0000","last_change":"2024-04-26T11:13:12.914318+0000","last_active":"2024-04-26T11:13:13.905148+0000","last_peered":"2024-04-26T11:13:13.905148+0000","last_clean":"2024-04-26T11:13:13.905148+0000","last_became_active":"2024-04-26T11:13:12.913437+0000","last_became_peered":"2024-04-26T11:13:12.913437+0000","last_unstale":"2024-04-26T11:13:13.905148+0000","last_undegraded":"2024-04-26T11:13:13.905148+0000","last_fullsized":"2024-04-26T11:13:13.905148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904484+0000","last_change":"2024-04-26T11:13:12.914523+0000","last_active":"2024-04-26T11:13:13.904484+0000","last_peered":"2024-04-26T11:13:13.904484+0000","last_clean":"2024-04-26T11:13:13.904484+0000","last_became_active":"2024-04-26T11:13:12.913241+0000","last_became_peered":"2024-04-26T11:13:12.913241+0000","last_unstale":"2024-04-26T11:13:13.904484+0000","last_undegraded":"2024-04-26T11:13:13.904484+0000","last_fullsized":"2024-04-26T11:13:13.904484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:10.887079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904389+0000","last_change":"2024-04-26T11:13:12.922145+0000","last_active":"2024-04-26T11:13:13.904389+0000","last_peered":"2024-04-26T11:13:13.904389+0000","last_clean":"2024-04-26T11:13:13.904389+0000","last_became_active":"2024-04-26T11:13:12.919048+0000","last_became_peered":"2024-04-26T11:13:12.919048+0000","last_unstale":"2024-04-26T11:13:13.904389+0000","last_undegraded":"2024-04-26T11:13:13.904389+0000","last_fullsized":"2024-04-26T11:13:13.904389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:47.958725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904823+0000","last_change":"2024-04-26T11:13:12.914484+0000","last_active":"2024-04-26T11:13:13.904823+0000","last_peered":"2024-04-26T11:13:13.904823+0000","last_clean":"2024-04-26T11:13:13.904823+0000","last_became_active":"2024-04-26T11:13:12.913596+0000","last_became_peered":"2024-04-26T11:13:12.913596+0000","last_unstale":"2024-04-26T11:13:13.904823+0000","last_undegraded":"2024-04-26T11:13:13.904823+0000","last_fullsized":"2024-04-26T11:13:13.904823+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:38.001491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771320+0000","last_change":"2024-04-26T11:13:12.918759+0000","last_active":"2024-04-26T11:13:14.771320+0000","last_peered":"2024-04-26T11:13:14.771320+0000","last_clean":"2024-04-26T11:13:14.771320+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:13:14.771320+0000","last_undegraded":"2024-04-26T11:13:14.771320+0000","last_fullsized":"2024-04-26T11:13:14.771320+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:55.002972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904592+0000","last_change":"2024-04-26T11:13:12.917334+0000","last_active":"2024-04-26T11:13:13.904592+0000","last_peered":"2024-04-26T11:13:13.904592+0000","last_clean":"2024-04-26T11:13:13.904592+0000","last_became_active":"2024-04-26T11:13:12.917010+0000","last_became_peered":"2024-04-26T11:13:12.917010+0000","last_unstale":"2024-04-26T11:13:13.904592+0000","last_undegraded":"2024-04-26T11:13:13.904592+0000","last_fullsized":"2024-04-26T11:13:13.904592+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:52.543148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905177+0000","last_change":"2024-04-26T11:13:12.917519+0000","last_active":"2024-04-26T11:13:13.905177+0000","last_peered":"2024-04-26T11:13:13.905177+0000","last_clean":"2024-04-26T11:13:13.905177+0000","last_became_active":"2024-04-26T11:13:12.916985+0000","last_became_peered":"2024-04-26T11:13:12.916985+0000","last_unstale":"2024-04-26T11:13:13.905177+0000","last_undegraded":"2024-04-26T11:13:13.905177+0000","last_fullsized":"2024-04-26T11:13:13.905177+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:38.001491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904702+0000","last_change":"2024-04-26T11:13:12.919641+0000","last_active":"2024-04-26T11:13:13.904702+0000","last_peered":"2024-04-26T11:13:13.904702+0000","last_clean":"2024-04-26T11:13:13.904702+0000","last_became_active":"2024-04-26T11:13:12.918830+0000","last_became_peered":"2024-04-26T11:13:12.918830+0000","last_unstale":"2024-04-26T11:13:13.904702+0000","last_undegraded":"2024-04-26T11:13:13.904702+0000","last_fullsized":"2024-04-26T11:13:13.904702+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:52.714816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770332+0000","last_change":"2024-04-26T11:13:12.914087+0000","last_active":"2024-04-26T11:13:14.770332+0000","last_peered":"2024-04-26T11:13:14.770332+0000","last_clean":"2024-04-26T11:13:14.770332+0000","last_became_active":"2024-04-26T11:13:12.913393+0000","last_became_peered":"2024-04-26T11:13:12.913393+0000","last_unstale":"2024-04-26T11:13:14.770332+0000","last_undegraded":"2024-04-26T11:13:14.770332+0000","last_fullsized":"2024-04-26T11:13:14.770332+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:38.001491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.903953+0000","last_change":"2024-04-26T11:13:12.918407+0000","last_active":"2024-04-26T11:13:13.903953+0000","last_peered":"2024-04-26T11:13:13.903953+0000","last_clean":"2024-04-26T11:13:13.903953+0000","last_became_active":"2024-04-26T11:13:12.918176+0000","last_became_peered":"2024-04-26T11:13:12.918176+0000","last_unstale":"2024-04-26T11:13:13.903953+0000","last_undegraded":"2024-04-26T11:13:13.903953+0000","last_fullsized":"2024-04-26T11:13:13.903953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770185+0000","last_change":"2024-04-26T11:13:12.912756+0000","last_active":"2024-04-26T11:13:14.770185+0000","last_peered":"2024-04-26T11:13:14.770185+0000","last_clean":"2024-04-26T11:13:14.770185+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:13:14.770185+0000","last_undegraded":"2024-04-26T11:13:14.770185+0000","last_fullsized":"2024-04-26T11:13:14.770185+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:04.177831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771368+0000","last_change":"2024-04-26T11:13:12.920122+0000","last_active":"2024-04-26T11:13:14.771368+0000","last_peered":"2024-04-26T11:13:14.771368+0000","last_clean":"2024-04-26T11:13:14.771368+0000","last_became_active":"2024-04-26T11:13:12.919792+0000","last_became_peered":"2024-04-26T11:13:12.919792+0000","last_unstale":"2024-04-26T11:13:14.771368+0000","last_undegraded":"2024-04-26T11:13:14.771368+0000","last_fullsized":"2024-04-26T11:13:14.771368+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:54.809926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904864+0000","last_change":"2024-04-26T11:13:12.912803+0000","last_active":"2024-04-26T11:13:13.904864+0000","last_peered":"2024-04-26T11:13:13.904864+0000","last_clean":"2024-04-26T11:13:13.904864+0000","last_became_active":"2024-04-26T11:13:12.912254+0000","last_became_peered":"2024-04-26T11:13:12.912254+0000","last_unstale":"2024-04-26T11:13:13.904864+0000","last_undegraded":"2024-04-26T11:13:13.904864+0000","last_fullsized":"2024-04-26T11:13:13.904864+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:11.313582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905305+0000","last_change":"2024-04-26T11:13:12.921062+0000","last_active":"2024-04-26T11:13:13.905305+0000","last_peered":"2024-04-26T11:13:13.905305+0000","last_clean":"2024-04-26T11:13:13.905305+0000","last_became_active":"2024-04-26T11:13:12.918716+0000","last_became_peered":"2024-04-26T11:13:12.918716+0000","last_unstale":"2024-04-26T11:13:13.905305+0000","last_undegraded":"2024-04-26T11:13:13.905305+0000","last_fullsized":"2024-04-26T11:13:13.905305+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:55.576807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770220+0000","last_change":"2024-04-26T11:13:12.493425+0000","last_active":"2024-04-26T11:13:14.770220+0000","last_peered":"2024-04-26T11:13:14.770220+0000","last_clean":"2024-04-26T11:13:14.770220+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:13:14.770220+0000","last_undegraded":"2024-04-26T11:13:14.770220+0000","last_fullsized":"2024-04-26T11:13:14.770220+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:23.279580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771122+0000","last_change":"2024-04-26T11:13:12.918515+0000","last_active":"2024-04-26T11:13:14.771122+0000","last_peered":"2024-04-26T11:13:14.771122+0000","last_clean":"2024-04-26T11:13:14.771122+0000","last_became_active":"2024-04-26T11:13:12.918002+0000","last_became_peered":"2024-04-26T11:13:12.918002+0000","last_unstale":"2024-04-26T11:13:14.771122+0000","last_undegraded":"2024-04-26T11:13:14.771122+0000","last_fullsized":"2024-04-26T11:13:14.771122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:46.610126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904192+0000","last_change":"2024-04-26T11:13:12.490257+0000","last_active":"2024-04-26T11:13:13.904192+0000","last_peered":"2024-04-26T11:13:13.904192+0000","last_clean":"2024-04-26T11:13:13.904192+0000","last_became_active":"2024-04-26T11:13:12.488819+0000","last_became_peered":"2024-04-26T11:13:12.488819+0000","last_unstale":"2024-04-26T11:13:13.904192+0000","last_undegraded":"2024-04-26T11:13:13.904192+0000","last_fullsized":"2024-04-26T11:13:13.904192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:52.644533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904995+0000","last_change":"2024-04-26T11:13:12.915624+0000","last_active":"2024-04-26T11:13:13.904995+0000","last_peered":"2024-04-26T11:13:13.904995+0000","last_clean":"2024-04-26T11:13:13.904995+0000","last_became_active":"2024-04-26T11:13:12.915375+0000","last_became_peered":"2024-04-26T11:13:12.915375+0000","last_unstale":"2024-04-26T11:13:13.904995+0000","last_undegraded":"2024-04-26T11:13:13.904995+0000","last_fullsized":"2024-04-26T11:13:13.904995+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:28.908758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904382+0000","last_change":"2024-04-26T11:13:12.487990+0000","last_active":"2024-04-26T11:13:13.904382+0000","last_peered":"2024-04-26T11:13:13.904382+0000","last_clean":"2024-04-26T11:13:13.904382+0000","last_became_active":"2024-04-26T11:13:12.486848+0000","last_became_peered":"2024-04-26T11:13:12.486848+0000","last_unstale":"2024-04-26T11:13:13.904382+0000","last_undegraded":"2024-04-26T11:13:13.904382+0000","last_fullsized":"2024-04-26T11:13:13.904382+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:56.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771304+0000","last_change":"2024-04-26T11:13:12.917423+0000","last_active":"2024-04-26T11:13:14.771304+0000","last_peered":"2024-04-26T11:13:14.771304+0000","last_clean":"2024-04-26T11:13:14.771304+0000","last_became_active":"2024-04-26T11:13:12.916811+0000","last_became_peered":"2024-04-26T11:13:12.916811+0000","last_unstale":"2024-04-26T11:13:14.771304+0000","last_undegraded":"2024-04-26T11:13:14.771304+0000","last_fullsized":"2024-04-26T11:13:14.771304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:28.908758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905043+0000","last_change":"2024-04-26T11:13:12.490251+0000","last_active":"2024-04-26T11:13:13.905043+0000","last_peered":"2024-04-26T11:13:13.905043+0000","last_clean":"2024-04-26T11:13:13.905043+0000","last_became_active":"2024-04-26T11:13:12.489836+0000","last_became_peered":"2024-04-26T11:13:12.489836+0000","last_unstale":"2024-04-26T11:13:13.905043+0000","last_undegraded":"2024-04-26T11:13:13.905043+0000","last_fullsized":"2024-04-26T11:13:13.905043+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:42.000159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.903972+0000","last_change":"2024-04-26T11:13:12.912865+0000","last_active":"2024-04-26T11:13:13.903972+0000","last_peered":"2024-04-26T11:13:13.903972+0000","last_clean":"2024-04-26T11:13:13.903972+0000","last_became_active":"2024-04-26T11:13:12.912397+0000","last_became_peered":"2024-04-26T11:13:12.912397+0000","last_unstale":"2024-04-26T11:13:13.903972+0000","last_undegraded":"2024-04-26T11:13:13.903972+0000","last_fullsized":"2024-04-26T11:13:13.903972+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905218+0000","last_change":"2024-04-26T11:13:12.493118+0000","last_active":"2024-04-26T11:13:13.905218+0000","last_peered":"2024-04-26T11:13:13.905218+0000","last_clean":"2024-04-26T11:13:13.905218+0000","last_became_active":"2024-04-26T11:13:12.492799+0000","last_became_peered":"2024-04-26T11:13:12.492799+0000","last_unstale":"2024-04-26T11:13:13.905218+0000","last_undegraded":"2024-04-26T11:13:13.905218+0000","last_fullsized":"2024-04-26T11:13:13.905218+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:46.082467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904510+0000","last_change":"2024-04-26T11:13:12.918149+0000","last_active":"2024-04-26T11:13:13.904510+0000","last_peered":"2024-04-26T11:13:13.904510+0000","last_clean":"2024-04-26T11:13:13.904510+0000","last_became_active":"2024-04-26T11:13:12.917636+0000","last_became_peered":"2024-04-26T11:13:12.917636+0000","last_unstale":"2024-04-26T11:13:13.904510+0000","last_undegraded":"2024-04-26T11:13:13.904510+0000","last_fullsized":"2024-04-26T11:13:13.904510+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:20.837217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770906+0000","last_change":"2024-04-26T11:13:12.495785+0000","last_active":"2024-04-26T11:13:14.770906+0000","last_peered":"2024-04-26T11:13:14.770906+0000","last_clean":"2024-04-26T11:13:14.770906+0000","last_became_active":"2024-04-26T11:13:12.495527+0000","last_became_peered":"2024-04-26T11:13:12.495527+0000","last_unstale":"2024-04-26T11:13:14.770906+0000","last_undegraded":"2024-04-26T11:13:14.770906+0000","last_fullsized":"2024-04-26T11:13:14.770906+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:45.374565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904416+0000","last_change":"2024-04-26T11:13:12.913698+0000","last_active":"2024-04-26T11:13:13.904416+0000","last_peered":"2024-04-26T11:13:13.904416+0000","last_clean":"2024-04-26T11:13:13.904416+0000","last_became_active":"2024-04-26T11:13:12.913198+0000","last_became_peered":"2024-04-26T11:13:12.913198+0000","last_unstale":"2024-04-26T11:13:13.904416+0000","last_undegraded":"2024-04-26T11:13:13.904416+0000","last_fullsized":"2024-04-26T11:13:13.904416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905059+0000","last_change":"2024-04-26T11:13:12.492878+0000","last_active":"2024-04-26T11:13:13.905059+0000","last_peered":"2024-04-26T11:13:13.905059+0000","last_clean":"2024-04-26T11:13:13.905059+0000","last_became_active":"2024-04-26T11:13:12.491690+0000","last_became_peered":"2024-04-26T11:13:12.491690+0000","last_unstale":"2024-04-26T11:13:13.905059+0000","last_undegraded":"2024-04-26T11:13:13.905059+0000","last_fullsized":"2024-04-26T11:13:13.905059+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:12.581788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905197+0000","last_change":"2024-04-26T11:13:12.916914+0000","last_active":"2024-04-26T11:13:13.905197+0000","last_peered":"2024-04-26T11:13:13.905197+0000","last_clean":"2024-04-26T11:13:13.905197+0000","last_became_active":"2024-04-26T11:13:12.913900+0000","last_became_peered":"2024-04-26T11:13:12.913900+0000","last_unstale":"2024-04-26T11:13:13.905197+0000","last_undegraded":"2024-04-26T11:13:13.905197+0000","last_fullsized":"2024-04-26T11:13:13.905197+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:28.908758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905107+0000","last_change":"2024-04-26T11:13:12.493445+0000","last_active":"2024-04-26T11:13:13.905107+0000","last_peered":"2024-04-26T11:13:13.905107+0000","last_clean":"2024-04-26T11:13:13.905107+0000","last_became_active":"2024-04-26T11:13:12.493015+0000","last_became_peered":"2024-04-26T11:13:12.493015+0000","last_unstale":"2024-04-26T11:13:13.905107+0000","last_undegraded":"2024-04-26T11:13:13.905107+0000","last_fullsized":"2024-04-26T11:13:13.905107+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:17.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770711+0000","last_change":"2024-04-26T11:13:12.916685+0000","last_active":"2024-04-26T11:13:14.770711+0000","last_peered":"2024-04-26T11:13:14.770711+0000","last_clean":"2024-04-26T11:13:14.770711+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:13:14.770711+0000","last_undegraded":"2024-04-26T11:13:14.770711+0000","last_fullsized":"2024-04-26T11:13:14.770711+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904543+0000","last_change":"2024-04-26T11:13:12.491438+0000","last_active":"2024-04-26T11:13:13.904543+0000","last_peered":"2024-04-26T11:13:13.904543+0000","last_clean":"2024-04-26T11:13:13.904543+0000","last_became_active":"2024-04-26T11:13:12.490515+0000","last_became_peered":"2024-04-26T11:13:12.490515+0000","last_unstale":"2024-04-26T11:13:13.904543+0000","last_undegraded":"2024-04-26T11:13:13.904543+0000","last_fullsized":"2024-04-26T11:13:13.904543+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:11.480844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770974+0000","last_change":"2024-04-26T11:13:12.915238+0000","last_active":"2024-04-26T11:13:14.770974+0000","last_peered":"2024-04-26T11:13:14.770974+0000","last_clean":"2024-04-26T11:13:14.770974+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:13:14.770974+0000","last_undegraded":"2024-04-26T11:13:14.770974+0000","last_fullsized":"2024-04-26T11:13:14.770974+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:48.068465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770266+0000","last_change":"2024-04-26T11:13:12.492682+0000","last_active":"2024-04-26T11:13:14.770266+0000","last_peered":"2024-04-26T11:13:14.770266+0000","last_clean":"2024-04-26T11:13:14.770266+0000","last_became_active":"2024-04-26T11:13:12.492346+0000","last_became_peered":"2024-04-26T11:13:12.492346+0000","last_unstale":"2024-04-26T11:13:14.770266+0000","last_undegraded":"2024-04-26T11:13:14.770266+0000","last_fullsized":"2024-04-26T11:13:14.770266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:28.034755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905121+0000","last_change":"2024-04-26T11:13:12.913671+0000","last_active":"2024-04-26T11:13:13.905121+0000","last_peered":"2024-04-26T11:13:13.905121+0000","last_clean":"2024-04-26T11:13:13.905121+0000","last_became_active":"2024-04-26T11:13:12.913264+0000","last_became_peered":"2024-04-26T11:13:12.913264+0000","last_unstale":"2024-04-26T11:13:13.905121+0000","last_undegraded":"2024-04-26T11:13:13.905121+0000","last_fullsized":"2024-04-26T11:13:13.905121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904759+0000","last_change":"2024-04-26T11:13:12.492802+0000","last_active":"2024-04-26T11:13:13.904759+0000","last_peered":"2024-04-26T11:13:13.904759+0000","last_clean":"2024-04-26T11:13:13.904759+0000","last_became_active":"2024-04-26T11:13:12.491774+0000","last_became_peered":"2024-04-26T11:13:12.491774+0000","last_unstale":"2024-04-26T11:13:13.904759+0000","last_undegraded":"2024-04-26T11:13:13.904759+0000","last_fullsized":"2024-04-26T11:13:13.904759+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:05.413010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905139+0000","last_change":"2024-04-26T11:13:12.915666+0000","last_active":"2024-04-26T11:13:13.905139+0000","last_peered":"2024-04-26T11:13:13.905139+0000","last_clean":"2024-04-26T11:13:13.905139+0000","last_became_active":"2024-04-26T11:13:12.915393+0000","last_became_peered":"2024-04-26T11:13:12.915393+0000","last_unstale":"2024-04-26T11:13:13.905139+0000","last_undegraded":"2024-04-26T11:13:13.905139+0000","last_fullsized":"2024-04-26T11:13:13.905139+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905455+0000","last_change":"2024-04-26T11:13:12.491934+0000","last_active":"2024-04-26T11:13:13.905455+0000","last_peered":"2024-04-26T11:13:13.905455+0000","last_clean":"2024-04-26T11:13:13.905455+0000","last_became_active":"2024-04-26T11:13:12.491262+0000","last_became_peered":"2024-04-26T11:13:12.491262+0000","last_unstale":"2024-04-26T11:13:13.905455+0000","last_undegraded":"2024-04-26T11:13:13.905455+0000","last_fullsized":"2024-04-26T11:13:13.905455+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:11.480844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.769967+0000","last_change":"2024-04-26T11:13:12.920072+0000","last_active":"2024-04-26T11:13:14.769967+0000","last_peered":"2024-04-26T11:13:14.769967+0000","last_clean":"2024-04-26T11:13:14.769967+0000","last_became_active":"2024-04-26T11:13:12.919233+0000","last_became_peered":"2024-04-26T11:13:12.919233+0000","last_unstale":"2024-04-26T11:13:14.769967+0000","last_undegraded":"2024-04-26T11:13:14.769967+0000","last_fullsized":"2024-04-26T11:13:14.769967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:41.004462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771109+0000","last_change":"2024-04-26T11:13:12.493060+0000","last_active":"2024-04-26T11:13:14.771109+0000","last_peered":"2024-04-26T11:13:14.771109+0000","last_clean":"2024-04-26T11:13:14.771109+0000","last_became_active":"2024-04-26T11:13:12.492519+0000","last_became_peered":"2024-04-26T11:13:12.492519+0000","last_unstale":"2024-04-26T11:13:14.771109+0000","last_undegraded":"2024-04-26T11:13:14.771109+0000","last_fullsized":"2024-04-26T11:13:14.771109+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:48.928740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770525+0000","last_change":"2024-04-26T11:13:12.912207+0000","last_active":"2024-04-26T11:13:14.770525+0000","last_peered":"2024-04-26T11:13:14.770525+0000","last_clean":"2024-04-26T11:13:14.770525+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:13:14.770525+0000","last_undegraded":"2024-04-26T11:13:14.770525+0000","last_fullsized":"2024-04-26T11:13:14.770525+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905410+0000","last_change":"2024-04-26T11:13:12.492772+0000","last_active":"2024-04-26T11:13:13.905410+0000","last_peered":"2024-04-26T11:13:13.905410+0000","last_clean":"2024-04-26T11:13:13.905410+0000","last_became_active":"2024-04-26T11:13:12.491901+0000","last_became_peered":"2024-04-26T11:13:12.491901+0000","last_unstale":"2024-04-26T11:13:13.905410+0000","last_undegraded":"2024-04-26T11:13:13.905410+0000","last_fullsized":"2024-04-26T11:13:13.905410+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:45.693017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904852+0000","last_change":"2024-04-26T11:13:12.919749+0000","last_active":"2024-04-26T11:13:13.904852+0000","last_peered":"2024-04-26T11:13:13.904852+0000","last_clean":"2024-04-26T11:13:13.904852+0000","last_became_active":"2024-04-26T11:13:12.917479+0000","last_became_peered":"2024-04-26T11:13:12.917479+0000","last_unstale":"2024-04-26T11:13:13.904852+0000","last_undegraded":"2024-04-26T11:13:13.904852+0000","last_fullsized":"2024-04-26T11:13:13.904852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:12.483631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904944+0000","last_change":"2024-04-26T11:13:12.495144+0000","last_active":"2024-04-26T11:13:13.904944+0000","last_peered":"2024-04-26T11:13:13.904944+0000","last_clean":"2024-04-26T11:13:13.904944+0000","last_became_active":"2024-04-26T11:13:12.494510+0000","last_became_peered":"2024-04-26T11:13:12.494510+0000","last_unstale":"2024-04-26T11:13:13.904944+0000","last_undegraded":"2024-04-26T11:13:13.904944+0000","last_fullsized":"2024-04-26T11:13:13.904944+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:00.146717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904907+0000","last_change":"2024-04-26T11:13:12.913350+0000","last_active":"2024-04-26T11:13:13.904907+0000","last_peered":"2024-04-26T11:13:13.904907+0000","last_clean":"2024-04-26T11:13:13.904907+0000","last_became_active":"2024-04-26T11:13:12.912991+0000","last_became_peered":"2024-04-26T11:13:12.912991+0000","last_unstale":"2024-04-26T11:13:13.904907+0000","last_undegraded":"2024-04-26T11:13:13.904907+0000","last_fullsized":"2024-04-26T11:13:13.904907+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:54.809926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904432+0000","last_change":"2024-04-26T11:13:12.490343+0000","last_active":"2024-04-26T11:13:13.904432+0000","last_peered":"2024-04-26T11:13:13.904432+0000","last_clean":"2024-04-26T11:13:13.904432+0000","last_became_active":"2024-04-26T11:13:12.490027+0000","last_became_peered":"2024-04-26T11:13:12.490027+0000","last_unstale":"2024-04-26T11:13:13.904432+0000","last_undegraded":"2024-04-26T11:13:13.904432+0000","last_fullsized":"2024-04-26T11:13:13.904432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:45.693017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904814+0000","last_change":"2024-04-26T11:13:12.918774+0000","last_active":"2024-04-26T11:13:13.904814+0000","last_peered":"2024-04-26T11:13:13.904814+0000","last_clean":"2024-04-26T11:13:13.904814+0000","last_became_active":"2024-04-26T11:13:12.917269+0000","last_became_peered":"2024-04-26T11:13:12.917269+0000","last_unstale":"2024-04-26T11:13:13.904814+0000","last_undegraded":"2024-04-26T11:13:13.904814+0000","last_fullsized":"2024-04-26T11:13:13.904814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:33.358984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904745+0000","last_change":"2024-04-26T11:13:12.494689+0000","last_active":"2024-04-26T11:13:13.904745+0000","last_peered":"2024-04-26T11:13:13.904745+0000","last_clean":"2024-04-26T11:13:13.904745+0000","last_became_active":"2024-04-26T11:13:12.494236+0000","last_became_peered":"2024-04-26T11:13:12.494236+0000","last_unstale":"2024-04-26T11:13:13.904745+0000","last_undegraded":"2024-04-26T11:13:13.904745+0000","last_fullsized":"2024-04-26T11:13:13.904745+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:42.000159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905618+0000","last_change":"2024-04-26T11:13:12.919985+0000","last_active":"2024-04-26T11:13:13.905618+0000","last_peered":"2024-04-26T11:13:13.905618+0000","last_clean":"2024-04-26T11:13:13.905618+0000","last_became_active":"2024-04-26T11:13:12.916239+0000","last_became_peered":"2024-04-26T11:13:12.916239+0000","last_unstale":"2024-04-26T11:13:13.905618+0000","last_undegraded":"2024-04-26T11:13:13.905618+0000","last_fullsized":"2024-04-26T11:13:13.905618+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:54.809926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770064+0000","last_change":"2024-04-26T11:13:12.492856+0000","last_active":"2024-04-26T11:13:14.770064+0000","last_peered":"2024-04-26T11:13:14.770064+0000","last_clean":"2024-04-26T11:13:14.770064+0000","last_became_active":"2024-04-26T11:13:12.492412+0000","last_became_peered":"2024-04-26T11:13:12.492412+0000","last_unstale":"2024-04-26T11:13:14.770064+0000","last_undegraded":"2024-04-26T11:13:14.770064+0000","last_fullsized":"2024-04-26T11:13:14.770064+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:09.572402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905480+0000","last_change":"2024-04-26T11:13:12.920056+0000","last_active":"2024-04-26T11:13:13.905480+0000","last_peered":"2024-04-26T11:13:13.905480+0000","last_clean":"2024-04-26T11:13:13.905480+0000","last_became_active":"2024-04-26T11:13:12.919049+0000","last_became_peered":"2024-04-26T11:13:12.919049+0000","last_unstale":"2024-04-26T11:13:13.905480+0000","last_undegraded":"2024-04-26T11:13:13.905480+0000","last_fullsized":"2024-04-26T11:13:13.905480+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770130+0000","last_change":"2024-04-26T11:13:12.493217+0000","last_active":"2024-04-26T11:13:14.770130+0000","last_peered":"2024-04-26T11:13:14.770130+0000","last_clean":"2024-04-26T11:13:14.770130+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:13:14.770130+0000","last_undegraded":"2024-04-26T11:13:14.770130+0000","last_fullsized":"2024-04-26T11:13:14.770130+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:00.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904940+0000","last_change":"2024-04-26T11:13:12.914321+0000","last_active":"2024-04-26T11:13:13.904940+0000","last_peered":"2024-04-26T11:13:13.904940+0000","last_clean":"2024-04-26T11:13:13.904940+0000","last_became_active":"2024-04-26T11:13:12.913543+0000","last_became_peered":"2024-04-26T11:13:12.913543+0000","last_unstale":"2024-04-26T11:13:13.904940+0000","last_undegraded":"2024-04-26T11:13:13.904940+0000","last_fullsized":"2024-04-26T11:13:13.904940+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.903582+0000","last_change":"2024-04-26T11:13:08.113095+0000","last_active":"2024-04-26T11:13:12.903582+0000","last_peered":"2024-04-26T11:13:12.903582+0000","last_clean":"2024-04-26T11:13:12.903582+0000","last_became_active":"2024-04-26T11:13:08.112778+0000","last_became_peered":"2024-04-26T11:13:08.112778+0000","last_unstale":"2024-04-26T11:13:12.903582+0000","last_undegraded":"2024-04-26T11:13:12.903582+0000","last_fullsized":"2024-04-26T11:13:12.903582+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:41.705893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905517+0000","last_change":"2024-04-26T11:13:12.493960+0000","last_active":"2024-04-26T11:13:13.905517+0000","last_peered":"2024-04-26T11:13:13.905517+0000","last_clean":"2024-04-26T11:13:13.905517+0000","last_became_active":"2024-04-26T11:13:12.493087+0000","last_became_peered":"2024-04-26T11:13:12.493087+0000","last_unstale":"2024-04-26T11:13:13.905517+0000","last_undegraded":"2024-04-26T11:13:13.905517+0000","last_fullsized":"2024-04-26T11:13:13.905517+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:19.538082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770546+0000","last_change":"2024-04-26T11:13:12.917458+0000","last_active":"2024-04-26T11:13:14.770546+0000","last_peered":"2024-04-26T11:13:14.770546+0000","last_clean":"2024-04-26T11:13:14.770546+0000","last_became_active":"2024-04-26T11:13:12.916792+0000","last_became_peered":"2024-04-26T11:13:12.916792+0000","last_unstale":"2024-04-26T11:13:14.770546+0000","last_undegraded":"2024-04-26T11:13:14.770546+0000","last_fullsized":"2024-04-26T11:13:14.770546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:12.483631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.913665+0000","last_change":"2024-04-26T11:13:08.112744+0000","last_active":"2024-04-26T11:13:12.913665+0000","last_peered":"2024-04-26T11:13:12.913665+0000","last_clean":"2024-04-26T11:13:12.913665+0000","last_became_active":"2024-04-26T11:13:08.112498+0000","last_became_peered":"2024-04-26T11:13:08.112498+0000","last_unstale":"2024-04-26T11:13:12.913665+0000","last_undegraded":"2024-04-26T11:13:12.913665+0000","last_fullsized":"2024-04-26T11:13:12.913665+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:38.407116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904845+0000","last_change":"2024-04-26T11:13:12.494137+0000","last_active":"2024-04-26T11:13:13.904845+0000","last_peered":"2024-04-26T11:13:13.904845+0000","last_clean":"2024-04-26T11:13:13.904845+0000","last_became_active":"2024-04-26T11:13:12.493447+0000","last_became_peered":"2024-04-26T11:13:12.493447+0000","last_unstale":"2024-04-26T11:13:13.904845+0000","last_undegraded":"2024-04-26T11:13:13.904845+0000","last_fullsized":"2024-04-26T11:13:13.904845+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:52.644533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904572+0000","last_change":"2024-04-26T11:13:12.912553+0000","last_active":"2024-04-26T11:13:13.904572+0000","last_peered":"2024-04-26T11:13:13.904572+0000","last_clean":"2024-04-26T11:13:13.904572+0000","last_became_active":"2024-04-26T11:13:12.912022+0000","last_became_peered":"2024-04-26T11:13:12.912022+0000","last_unstale":"2024-04-26T11:13:13.904572+0000","last_undegraded":"2024-04-26T11:13:13.904572+0000","last_fullsized":"2024-04-26T11:13:13.904572+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.903369+0000","last_change":"2024-04-26T11:13:08.113650+0000","last_active":"2024-04-26T11:13:12.903369+0000","last_peered":"2024-04-26T11:13:12.903369+0000","last_clean":"2024-04-26T11:13:12.903369+0000","last_became_active":"2024-04-26T11:13:08.113394+0000","last_became_peered":"2024-04-26T11:13:08.113394+0000","last_unstale":"2024-04-26T11:13:12.903369+0000","last_undegraded":"2024-04-26T11:13:12.903369+0000","last_fullsized":"2024-04-26T11:13:12.903369+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:44.642172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770074+0000","last_change":"2024-04-26T11:13:12.492888+0000","last_active":"2024-04-26T11:13:14.770074+0000","last_peered":"2024-04-26T11:13:14.770074+0000","last_clean":"2024-04-26T11:13:14.770074+0000","last_became_active":"2024-04-26T11:13:12.492274+0000","last_became_peered":"2024-04-26T11:13:12.492274+0000","last_unstale":"2024-04-26T11:13:14.770074+0000","last_undegraded":"2024-04-26T11:13:14.770074+0000","last_fullsized":"2024-04-26T11:13:14.770074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:51.136157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905114+0000","last_change":"2024-04-26T11:13:12.914599+0000","last_active":"2024-04-26T11:13:13.905114+0000","last_peered":"2024-04-26T11:13:13.905114+0000","last_clean":"2024-04-26T11:13:13.905114+0000","last_became_active":"2024-04-26T11:13:12.913916+0000","last_became_peered":"2024-04-26T11:13:12.913916+0000","last_unstale":"2024-04-26T11:13:13.905114+0000","last_undegraded":"2024-04-26T11:13:13.905114+0000","last_fullsized":"2024-04-26T11:13:13.905114+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.915840+0000","last_change":"2024-04-26T11:13:08.112690+0000","last_active":"2024-04-26T11:13:12.915840+0000","last_peered":"2024-04-26T11:13:12.915840+0000","last_clean":"2024-04-26T11:13:12.915840+0000","last_became_active":"2024-04-26T11:13:08.112454+0000","last_became_peered":"2024-04-26T11:13:08.112454+0000","last_unstale":"2024-04-26T11:13:12.915840+0000","last_undegraded":"2024-04-26T11:13:12.915840+0000","last_fullsized":"2024-04-26T11:13:12.915840+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:41.011030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.913577+0000","last_change":"2024-04-26T11:13:08.113419+0000","last_active":"2024-04-26T11:13:12.913577+0000","last_peered":"2024-04-26T11:13:12.913577+0000","last_clean":"2024-04-26T11:13:12.913577+0000","last_became_active":"2024-04-26T11:13:08.113154+0000","last_became_peered":"2024-04-26T11:13:08.113154+0000","last_unstale":"2024-04-26T11:13:12.913577+0000","last_undegraded":"2024-04-26T11:13:12.913577+0000","last_fullsized":"2024-04-26T11:13:12.913577+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:36.482001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904292+0000","last_change":"2024-04-26T11:13:12.491278+0000","last_active":"2024-04-26T11:13:13.904292+0000","last_peered":"2024-04-26T11:13:13.904292+0000","last_clean":"2024-04-26T11:13:13.904292+0000","last_became_active":"2024-04-26T11:13:12.488223+0000","last_became_peered":"2024-04-26T11:13:12.488223+0000","last_unstale":"2024-04-26T11:13:13.904292+0000","last_undegraded":"2024-04-26T11:13:13.904292+0000","last_fullsized":"2024-04-26T11:13:13.904292+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:05.413010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905587+0000","last_change":"2024-04-26T11:13:12.920834+0000","last_active":"2024-04-26T11:13:13.905587+0000","last_peered":"2024-04-26T11:13:13.905587+0000","last_clean":"2024-04-26T11:13:13.905587+0000","last_became_active":"2024-04-26T11:13:12.917055+0000","last_became_peered":"2024-04-26T11:13:12.917055+0000","last_unstale":"2024-04-26T11:13:13.905587+0000","last_undegraded":"2024-04-26T11:13:13.905587+0000","last_fullsized":"2024-04-26T11:13:13.905587+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:11.313582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.913563+0000","last_change":"2024-04-26T11:13:08.113497+0000","last_active":"2024-04-26T11:13:12.913563+0000","last_peered":"2024-04-26T11:13:12.913563+0000","last_clean":"2024-04-26T11:13:12.913563+0000","last_became_active":"2024-04-26T11:13:08.113237+0000","last_became_peered":"2024-04-26T11:13:08.113237+0000","last_unstale":"2024-04-26T11:13:12.913563+0000","last_undegraded":"2024-04-26T11:13:12.913563+0000","last_fullsized":"2024-04-26T11:13:12.913563+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:52.240361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904041+0000","last_change":"2024-04-26T11:13:12.491936+0000","last_active":"2024-04-26T11:13:13.904041+0000","last_peered":"2024-04-26T11:13:13.904041+0000","last_clean":"2024-04-26T11:13:13.904041+0000","last_became_active":"2024-04-26T11:13:12.491533+0000","last_became_peered":"2024-04-26T11:13:12.491533+0000","last_unstale":"2024-04-26T11:13:13.904041+0000","last_undegraded":"2024-04-26T11:13:13.904041+0000","last_fullsized":"2024-04-26T11:13:13.904041+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:13.320025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.771296+0000","last_change":"2024-04-26T11:13:12.918648+0000","last_active":"2024-04-26T11:13:14.771296+0000","last_peered":"2024-04-26T11:13:14.771296+0000","last_clean":"2024-04-26T11:13:14.771296+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:13:14.771296+0000","last_undegraded":"2024-04-26T11:13:14.771296+0000","last_fullsized":"2024-04-26T11:13:14.771296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.907846+0000","last_change":"2024-04-26T11:13:08.110433+0000","last_active":"2024-04-26T11:13:12.907846+0000","last_peered":"2024-04-26T11:13:12.907846+0000","last_clean":"2024-04-26T11:13:12.907846+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:13:12.907846+0000","last_undegraded":"2024-04-26T11:13:12.907846+0000","last_fullsized":"2024-04-26T11:13:12.907846+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904956+0000","last_change":"2024-04-26T11:13:12.491648+0000","last_active":"2024-04-26T11:13:13.904956+0000","last_peered":"2024-04-26T11:13:13.904956+0000","last_clean":"2024-04-26T11:13:13.904956+0000","last_became_active":"2024-04-26T11:13:12.488599+0000","last_became_peered":"2024-04-26T11:13:12.488599+0000","last_unstale":"2024-04-26T11:13:13.904956+0000","last_undegraded":"2024-04-26T11:13:13.904956+0000","last_fullsized":"2024-04-26T11:13:13.904956+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:45.374565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770640+0000","last_change":"2024-04-26T11:13:12.920065+0000","last_active":"2024-04-26T11:13:14.770640+0000","last_peered":"2024-04-26T11:13:14.770640+0000","last_clean":"2024-04-26T11:13:14.770640+0000","last_became_active":"2024-04-26T11:13:12.919741+0000","last_became_peered":"2024-04-26T11:13:12.919741+0000","last_unstale":"2024-04-26T11:13:14.770640+0000","last_undegraded":"2024-04-26T11:13:14.770640+0000","last_fullsized":"2024-04-26T11:13:14.770640+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:20.837217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904894+0000","last_change":"2024-04-26T11:13:12.488576+0000","last_active":"2024-04-26T11:13:13.904894+0000","last_peered":"2024-04-26T11:13:13.904894+0000","last_clean":"2024-04-26T11:13:13.904894+0000","last_became_active":"2024-04-26T11:13:12.488248+0000","last_became_peered":"2024-04-26T11:13:12.488248+0000","last_unstale":"2024-04-26T11:13:13.904894+0000","last_undegraded":"2024-04-26T11:13:13.904894+0000","last_fullsized":"2024-04-26T11:13:13.904894+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:48.928740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.904393+0000","last_change":"2024-04-26T11:13:08.113157+0000","last_active":"2024-04-26T11:13:12.904393+0000","last_peered":"2024-04-26T11:13:12.904393+0000","last_clean":"2024-04-26T11:13:12.904393+0000","last_became_active":"2024-04-26T11:13:08.112788+0000","last_became_peered":"2024-04-26T11:13:08.112788+0000","last_unstale":"2024-04-26T11:13:12.904393+0000","last_undegraded":"2024-04-26T11:13:12.904393+0000","last_fullsized":"2024-04-26T11:13:12.904393+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:14.606433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904028+0000","last_change":"2024-04-26T11:13:12.919100+0000","last_active":"2024-04-26T11:13:13.904028+0000","last_peered":"2024-04-26T11:13:13.904028+0000","last_clean":"2024-04-26T11:13:13.904028+0000","last_became_active":"2024-04-26T11:13:12.918816+0000","last_became_peered":"2024-04-26T11:13:12.918816+0000","last_unstale":"2024-04-26T11:13:13.904028+0000","last_undegraded":"2024-04-26T11:13:13.904028+0000","last_fullsized":"2024-04-26T11:13:13.904028+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:13:12.915609+0000","last_change":"2024-04-26T11:13:08.113505+0000","last_active":"2024-04-26T11:13:12.915609+0000","last_peered":"2024-04-26T11:13:12.915609+0000","last_clean":"2024-04-26T11:13:12.915609+0000","last_became_active":"2024-04-26T11:13:08.113224+0000","last_became_peered":"2024-04-26T11:13:08.113224+0000","last_unstale":"2024-04-26T11:13:12.915609+0000","last_undegraded":"2024-04-26T11:13:12.915609+0000","last_fullsized":"2024-04-26T11:13:12.915609+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:16.157275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:16.455948+0000","last_change":"2024-04-26T11:13:12.490249+0000","last_active":"2024-04-26T11:13:16.455948+0000","last_peered":"2024-04-26T11:13:16.455948+0000","last_clean":"2024-04-26T11:13:16.455948+0000","last_became_active":"2024-04-26T11:13:12.488836+0000","last_became_peered":"2024-04-26T11:13:12.488836+0000","last_unstale":"2024-04-26T11:13:16.455948+0000","last_undegraded":"2024-04-26T11:13:16.455948+0000","last_fullsized":"2024-04-26T11:13:16.455948+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:12.581788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770387+0000","last_change":"2024-04-26T11:13:12.913955+0000","last_active":"2024-04-26T11:13:14.770387+0000","last_peered":"2024-04-26T11:13:14.770387+0000","last_clean":"2024-04-26T11:13:14.770387+0000","last_became_active":"2024-04-26T11:13:12.913037+0000","last_became_peered":"2024-04-26T11:13:12.913037+0000","last_unstale":"2024-04-26T11:13:14.770387+0000","last_undegraded":"2024-04-26T11:13:14.770387+0000","last_fullsized":"2024-04-26T11:13:14.770387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:11.313582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770475+0000","last_change":"2024-04-26T11:13:12.493479+0000","last_active":"2024-04-26T11:13:14.770475+0000","last_peered":"2024-04-26T11:13:14.770475+0000","last_clean":"2024-04-26T11:13:14.770475+0000","last_became_active":"2024-04-26T11:13:12.493174+0000","last_became_peered":"2024-04-26T11:13:12.493174+0000","last_unstale":"2024-04-26T11:13:14.770475+0000","last_undegraded":"2024-04-26T11:13:14.770475+0000","last_fullsized":"2024-04-26T11:13:14.770475+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:05.413010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770803+0000","last_change":"2024-04-26T11:13:12.917812+0000","last_active":"2024-04-26T11:13:14.770803+0000","last_peered":"2024-04-26T11:13:14.770803+0000","last_clean":"2024-04-26T11:13:14.770803+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:13:14.770803+0000","last_undegraded":"2024-04-26T11:13:14.770803+0000","last_fullsized":"2024-04-26T11:13:14.770803+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904950+0000","last_change":"2024-04-26T11:13:12.493351+0000","last_active":"2024-04-26T11:13:13.904950+0000","last_peered":"2024-04-26T11:13:13.904950+0000","last_clean":"2024-04-26T11:13:13.904950+0000","last_became_active":"2024-04-26T11:13:12.492923+0000","last_became_peered":"2024-04-26T11:13:12.492923+0000","last_unstale":"2024-04-26T11:13:13.904950+0000","last_undegraded":"2024-04-26T11:13:13.904950+0000","last_fullsized":"2024-04-26T11:13:13.904950+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:53.444842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904852+0000","last_change":"2024-04-26T11:13:12.918383+0000","last_active":"2024-04-26T11:13:13.904852+0000","last_peered":"2024-04-26T11:13:13.904852+0000","last_clean":"2024-04-26T11:13:13.904852+0000","last_became_active":"2024-04-26T11:13:12.917098+0000","last_became_peered":"2024-04-26T11:13:12.917098+0000","last_unstale":"2024-04-26T11:13:13.904852+0000","last_undegraded":"2024-04-26T11:13:13.904852+0000","last_fullsized":"2024-04-26T11:13:13.904852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:43.397887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770971+0000","last_change":"2024-04-26T11:13:12.493387+0000","last_active":"2024-04-26T11:13:14.770971+0000","last_peered":"2024-04-26T11:13:14.770971+0000","last_clean":"2024-04-26T11:13:14.770971+0000","last_became_active":"2024-04-26T11:13:12.493158+0000","last_became_peered":"2024-04-26T11:13:12.493158+0000","last_unstale":"2024-04-26T11:13:14.770971+0000","last_undegraded":"2024-04-26T11:13:14.770971+0000","last_fullsized":"2024-04-26T11:13:14.770971+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:56.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904899+0000","last_change":"2024-04-26T11:13:12.920137+0000","last_active":"2024-04-26T11:13:13.904899+0000","last_peered":"2024-04-26T11:13:13.904899+0000","last_clean":"2024-04-26T11:13:13.904899+0000","last_became_active":"2024-04-26T11:13:12.919020+0000","last_became_peered":"2024-04-26T11:13:12.919020+0000","last_unstale":"2024-04-26T11:13:13.904899+0000","last_undegraded":"2024-04-26T11:13:13.904899+0000","last_fullsized":"2024-04-26T11:13:13.904899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:47.014768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905092+0000","last_change":"2024-04-26T11:13:12.490017+0000","last_active":"2024-04-26T11:13:13.905092+0000","last_peered":"2024-04-26T11:13:13.905092+0000","last_clean":"2024-04-26T11:13:13.905092+0000","last_became_active":"2024-04-26T11:13:12.488282+0000","last_became_peered":"2024-04-26T11:13:12.488282+0000","last_unstale":"2024-04-26T11:13:13.905092+0000","last_undegraded":"2024-04-26T11:13:13.905092+0000","last_fullsized":"2024-04-26T11:13:13.905092+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:20.176849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770666+0000","last_change":"2024-04-26T11:13:12.917763+0000","last_active":"2024-04-26T11:13:14.770666+0000","last_peered":"2024-04-26T11:13:14.770666+0000","last_clean":"2024-04-26T11:13:14.770666+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:13:14.770666+0000","last_undegraded":"2024-04-26T11:13:14.770666+0000","last_fullsized":"2024-04-26T11:13:14.770666+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.905010+0000","last_change":"2024-04-26T11:13:12.491798+0000","last_active":"2024-04-26T11:13:13.905010+0000","last_peered":"2024-04-26T11:13:13.905010+0000","last_clean":"2024-04-26T11:13:13.905010+0000","last_became_active":"2024-04-26T11:13:12.490582+0000","last_became_peered":"2024-04-26T11:13:12.490582+0000","last_unstale":"2024-04-26T11:13:13.905010+0000","last_undegraded":"2024-04-26T11:13:13.905010+0000","last_fullsized":"2024-04-26T11:13:13.905010+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:46.082467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904998+0000","last_change":"2024-04-26T11:13:12.914549+0000","last_active":"2024-04-26T11:13:13.904998+0000","last_peered":"2024-04-26T11:13:13.904998+0000","last_clean":"2024-04-26T11:13:13.904998+0000","last_became_active":"2024-04-26T11:13:12.913041+0000","last_became_peered":"2024-04-26T11:13:12.913041+0000","last_unstale":"2024-04-26T11:13:13.904998+0000","last_undegraded":"2024-04-26T11:13:13.904998+0000","last_fullsized":"2024-04-26T11:13:13.904998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904654+0000","last_change":"2024-04-26T11:13:12.916942+0000","last_active":"2024-04-26T11:13:13.904654+0000","last_peered":"2024-04-26T11:13:13.904654+0000","last_clean":"2024-04-26T11:13:13.904654+0000","last_became_active":"2024-04-26T11:13:12.916144+0000","last_became_peered":"2024-04-26T11:13:12.916144+0000","last_unstale":"2024-04-26T11:13:13.904654+0000","last_undegraded":"2024-04-26T11:13:13.904654+0000","last_fullsized":"2024-04-26T11:13:13.904654+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:46.610126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904072+0000","last_change":"2024-04-26T11:13:12.913826+0000","last_active":"2024-04-26T11:13:13.904072+0000","last_peered":"2024-04-26T11:13:13.904072+0000","last_clean":"2024-04-26T11:13:13.904072+0000","last_became_active":"2024-04-26T11:13:12.912911+0000","last_became_peered":"2024-04-26T11:13:12.912911+0000","last_unstale":"2024-04-26T11:13:13.904072+0000","last_undegraded":"2024-04-26T11:13:13.904072+0000","last_fullsized":"2024-04-26T11:13:13.904072+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:10.887079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770469+0000","last_change":"2024-04-26T11:13:12.921818+0000","last_active":"2024-04-26T11:13:14.770469+0000","last_peered":"2024-04-26T11:13:14.770469+0000","last_clean":"2024-04-26T11:13:14.770469+0000","last_became_active":"2024-04-26T11:13:12.921526+0000","last_became_peered":"2024-04-26T11:13:12.921526+0000","last_unstale":"2024-04-26T11:13:14.770469+0000","last_undegraded":"2024-04-26T11:13:14.770469+0000","last_fullsized":"2024-04-26T11:13:14.770469+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:47.958725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:13.904819+0000","last_change":"2024-04-26T11:13:12.912731+0000","last_active":"2024-04-26T11:13:13.904819+0000","last_peered":"2024-04-26T11:13:13.904819+0000","last_clean":"2024-04-26T11:13:13.904819+0000","last_became_active":"2024-04-26T11:13:12.911522+0000","last_became_peered":"2024-04-26T11:13:12.911522+0000","last_unstale":"2024-04-26T11:13:13.904819+0000","last_undegraded":"2024-04-26T11:13:13.904819+0000","last_fullsized":"2024-04-26T11:13:13.904819+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:46.610126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T11:13:14.770830+0000","last_change":"2024-04-26T11:13:12.919750+0000","last_active":"2024-04-26T11:13:14.770830+0000","last_peered":"2024-04-26T11:13:14.770830+0000","last_clean":"2024-04-26T11:13:14.770830+0000","last_became_active":"2024-04-26T11:13:12.919116+0000","last_became_peered":"2024-04-26T11:13:12.919116+0000","last_unstale":"2024-04-26T11:13:14.770830+0000","last_undegraded":"2024-04-26T11:13:14.770830+0000","last_fullsized":"2024-04-26T11:13:14.770830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:10.887079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":745472,"data_stored":637050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]}]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:13:34.981 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T11:13:34.981 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-26T11:13:35.362 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 15 2024-04-26T11:13:35.362 INFO:teuthology.orchestra.run.smithi029.stdout:fsid 2b52ce04-9559-478f-9787-c3cc3b261c15 2024-04-26T11:13:35.362 INFO:teuthology.orchestra.run.smithi029.stdout:created 2024-04-26T11:12:58.193418+0000 2024-04-26T11:13:35.362 INFO:teuthology.orchestra.run.smithi029.stdout:modified 2024-04-26T11:13:13.900817+0000 2024-04-26T11:13:35.362 INFO:teuthology.orchestra.run.smithi029.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-26T11:13:35.363 INFO:teuthology.orchestra.run.smithi029.stdout:crush_version 4 2024-04-26T11:13:35.363 INFO:teuthology.orchestra.run.smithi029.stdout:full_ratio 0.95 2024-04-26T11:13:35.364 INFO:teuthology.orchestra.run.smithi029.stdout:backfillfull_ratio 0.9 2024-04-26T11:13:35.364 INFO:teuthology.orchestra.run.smithi029.stdout:nearfull_ratio 0.85 2024-04-26T11:13:35.364 INFO:teuthology.orchestra.run.smithi029.stdout:require_min_compat_client luminous 2024-04-26T11:13:35.364 INFO:teuthology.orchestra.run.smithi029.stdout:min_compat_client jewel 2024-04-26T11:13:35.364 INFO:teuthology.orchestra.run.smithi029.stdout:require_osd_release reef 2024-04-26T11:13:35.364 INFO:teuthology.orchestra.run.smithi029.stdout:stretch_mode_enabled false 2024-04-26T11:13:35.364 INFO:teuthology.orchestra.run.smithi029.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-04-26T11:13:35.364 INFO:teuthology.orchestra.run.smithi029.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-04-26T11:13:35.364 INFO:teuthology.orchestra.run.smithi029.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 14 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-04-26T11:13:35.364 INFO:teuthology.orchestra.run.smithi029.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 15 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-04-26T11:13:35.364 INFO:teuthology.orchestra.run.smithi029.stdout:max_osd 3 2024-04-26T11:13:35.364 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.72:6800/41434,v1:172.21.15.72:6801/41434] [v2:172.21.15.72:6802/41434,v1:172.21.15.72:6803/41434] exists,up c3496b3f-5972-47ff-a449-832f5055beac 2024-04-26T11:13:35.364 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6800/41442,v1:172.21.15.82:6801/41442] [v2:172.21.15.82:6802/41442,v1:172.21.15.82:6803/41442] exists,up 4842abe1-e7b4-480f-85b3-11c8fa2123f1 2024-04-26T11:13:35.364 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6800/41571,v1:172.21.15.122:6801/41571] [v2:172.21.15.122:6802/41571,v1:172.21.15.122:6803/41571] exists,up 57b4a874-e4ce-42a9-a7fd-f9e0acf03cec 2024-04-26T11:13:35.376 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.72:6800/41434,v1:172.21.15.72:6801/41434] [v2:172.21.15.72:6802/41434,v1:172.21.15.72:6803/41434] exists,up c3496b3f-5972-47ff-a449-832f5055beac', 'osd.1 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6800/41442,v1:172.21.15.82:6801/41442] [v2:172.21.15.82:6802/41442,v1:172.21.15.82:6803/41442] exists,up 4842abe1-e7b4-480f-85b3-11c8fa2123f1', 'osd.2 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6800/41571,v1:172.21.15.122:6801/41571] [v2:172.21.15.122:6802/41571,v1:172.21.15.122:6803/41571] exists,up 57b4a874-e4ce-42a9-a7fd-f9e0acf03cec'] 2024-04-26T11:13:35.376 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-26T11:13:35.502 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-26T11:13:35.502 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mon.a", 2024-04-26T11:13:35.502 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster": "ceph", 2024-04-26T11:13:35.502 INFO:teuthology.orchestra.run.smithi029.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-26T11:13:35.502 INFO:teuthology.orchestra.run.smithi029.stdout: "admin_socket_mode": "", 2024-04-26T11:13:35.502 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-26T11:13:35.502 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_client_required": "cephx, none", 2024-04-26T11:13:35.503 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_cluster_required": "cephx", 2024-04-26T11:13:35.503 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_debug": "true", 2024-04-26T11:13:35.503 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-26T11:13:35.503 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-26T11:13:35.503 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_service_required": "cephx", 2024-04-26T11:13:35.503 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-26T11:13:35.503 INFO:teuthology.orchestra.run.smithi029.stdout: "auth_supported": "cephx", 2024-04-26T11:13:35.503 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_aio": "true", 2024-04-26T11:13:35.503 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-26T11:13:35.503 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_aio_poll_ms": "250", 2024-04-26T11:13:35.503 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_aio_reap_max": "16", 2024-04-26T11:13:35.503 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_async_discard": "false", 2024-04-26T11:13:35.503 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_block_size": "4096", 2024-04-26T11:13:35.503 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_debug_aio": "false", 2024-04-26T11:13:35.503 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-26T11:13:35.504 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-26T11:13:35.504 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_debug_inflight_ios": "false", 2024-04-26T11:13:35.504 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_enable_discard": "false", 2024-04-26T11:13:35.504 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_flock_retry": "3", 2024-04-26T11:13:35.504 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-26T11:13:35.504 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_inject_crash": "0", 2024-04-26T11:13:35.504 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-26T11:13:35.504 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_ioring": "false", 2024-04-26T11:13:35.504 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_ioring_hipri": "false", 2024-04-26T11:13:35.504 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-26T11:13:35.504 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-26T11:13:35.504 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-26T11:13:35.504 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-26T11:13:35.504 INFO:teuthology.orchestra.run.smithi029.stdout: "bdev_type": "", 2024-04-26T11:13:35.504 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_alloc_size": "1048576", 2024-04-26T11:13:35.505 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_allocator": "hybrid", 2024-04-26T11:13:35.505 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_buffered_io": "true", 2024-04-26T11:13:35.505 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_check_for_zeros": "false", 2024-04-26T11:13:35.505 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-26T11:13:35.505 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-26T11:13:35.505 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_compact_log_sync": "false", 2024-04-26T11:13:35.505 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-26T11:13:35.505 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-26T11:13:35.505 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-26T11:13:35.505 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-26T11:13:35.505 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_max_log_runway": "4194304", 2024-04-26T11:13:35.505 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_max_prefetch": "1048576", 2024-04-26T11:13:35.505 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_min_flush_size": "524288", 2024-04-26T11:13:35.506 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_min_log_runway": "1048576", 2024-04-26T11:13:35.506 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_replay_recovery": "false", 2024-04-26T11:13:35.506 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-26T11:13:35.506 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-26T11:13:35.506 INFO:teuthology.orchestra.run.smithi029.stdout: "bluefs_sync_write": "false", 2024-04-26T11:13:35.506 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-26T11:13:35.506 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-26T11:13:35.506 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-26T11:13:35.506 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_allocation_from_file": "true", 2024-04-26T11:13:35.506 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_allocator": "hybrid", 2024-04-26T11:13:35.506 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-26T11:13:35.506 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-26T11:13:35.506 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-26T11:13:35.506 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-26T11:13:35.506 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-26T11:13:35.507 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-26T11:13:35.507 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-26T11:13:35.507 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_block_create": "true", 2024-04-26T11:13:35.507 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_block_db_create": "false", 2024-04-26T11:13:35.507 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_block_db_path": "", 2024-04-26T11:13:35.507 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_block_db_size": "0", 2024-04-26T11:13:35.507 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_block_path": "", 2024-04-26T11:13:35.507 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_block_preallocate_file": "false", 2024-04-26T11:13:35.507 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_block_size": "107374182400", 2024-04-26T11:13:35.507 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_block_wal_create": "false", 2024-04-26T11:13:35.507 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_block_wal_path": "", 2024-04-26T11:13:35.507 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_block_wal_size": "100663296", 2024-04-26T11:13:35.507 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_bluefs": "true", 2024-04-26T11:13:35.507 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-26T11:13:35.508 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-26T11:13:35.508 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-26T11:13:35.508 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-26T11:13:35.508 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T11:13:35.508 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T11:13:35.508 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-26T11:13:35.508 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T11:13:35.508 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_autotune": "true", 2024-04-26T11:13:35.508 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-26T11:13:35.508 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-26T11:13:35.508 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-26T11:13:35.508 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-26T11:13:35.508 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_size": "0", 2024-04-26T11:13:35.508 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-26T11:13:35.508 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-26T11:13:35.509 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-26T11:13:35.509 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-26T11:13:35.509 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cache_type": "2q", 2024-04-26T11:13:35.509 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-26T11:13:35.509 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_clone_cow": "true", 2024-04-26T11:13:35.509 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-26T11:13:35.509 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-26T11:13:35.509 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-26T11:13:35.509 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-26T11:13:35.509 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-26T11:13:35.509 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-26T11:13:35.509 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-26T11:13:35.509 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_compression_mode": "none", 2024-04-26T11:13:35.509 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-26T11:13:35.510 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_csum_type": "crc32c", 2024-04-26T11:13:35.510 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-26T11:13:35.510 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_freelist": "false", 2024-04-26T11:13:35.510 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-26T11:13:35.510 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-26T11:13:35.510 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_inject_bug21040": "false", 2024-04-26T11:13:35.510 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-26T11:13:35.510 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-26T11:13:35.510 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-26T11:13:35.510 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-26T11:13:35.510 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-26T11:13:35.510 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-26T11:13:35.510 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-26T11:13:35.510 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-26T11:13:35.510 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-26T11:13:35.511 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-26T11:13:35.511 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-26T11:13:35.511 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_small_allocations": "0", 2024-04-26T11:13:35.511 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-26T11:13:35.511 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_default_buffered_read": "true", 2024-04-26T11:13:35.511 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_default_buffered_write": "false", 2024-04-26T11:13:35.511 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-26T11:13:35.511 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-26T11:13:35.511 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-26T11:13:35.511 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-26T11:13:35.511 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-26T11:13:35.511 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-26T11:13:35.511 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-26T11:13:35.511 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-26T11:13:35.511 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fail_eio": "false", 2024-04-26T11:13:35.512 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-26T11:13:35.512 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-26T11:13:35.512 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-26T11:13:35.512 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-26T11:13:35.512 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-26T11:13:35.512 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-26T11:13:35.512 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_on_mount": "false", 2024-04-26T11:13:35.512 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-26T11:13:35.512 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_on_umount": "false", 2024-04-26T11:13:35.512 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-26T11:13:35.512 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-26T11:13:35.512 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-26T11:13:35.512 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-26T11:13:35.512 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-26T11:13:35.512 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-26T11:13:35.513 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-26T11:13:35.513 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-26T11:13:35.513 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_ignore_data_csum": "false", 2024-04-26T11:13:35.513 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-26T11:13:35.513 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-26T11:13:35.513 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-26T11:13:35.513 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-26T11:13:35.513 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_log_op_age": "5.000000", 2024-04-26T11:13:35.513 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_max_alloc_size": "0", 2024-04-26T11:13:35.513 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_max_blob_size": "0", 2024-04-26T11:13:35.513 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-26T11:13:35.513 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-26T11:13:35.513 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-26T11:13:35.513 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_max_deferred_txc": "32", 2024-04-26T11:13:35.514 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_min_alloc_size": "0", 2024-04-26T11:13:35.514 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-26T11:13:35.514 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-26T11:13:35.515 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_nid_prealloc": "1024", 2024-04-26T11:13:35.515 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-26T11:13:35.516 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-26T11:13:35.516 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-26T11:13:35.516 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-26T11:13:35.516 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_retry_disk_reads": "3", 2024-04-26T11:13:35.516 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_rocksdb_cf": "true", 2024-04-26T11:13:35.516 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-26T11:13:35.516 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-26T11:13:35.516 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-26T11:13:35.516 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-26T11:13:35.516 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-26T11:13:35.516 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-26T11:13:35.516 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_spdk_mem": "512", 2024-04-26T11:13:35.516 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-26T11:13:35.516 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-26T11:13:35.517 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-26T11:13:35.517 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-26T11:13:35.517 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-26T11:13:35.517 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-26T11:13:35.517 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-26T11:13:35.517 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_tracing": "false", 2024-04-26T11:13:35.517 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-26T11:13:35.517 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-26T11:13:35.517 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-26T11:13:35.517 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-26T11:13:35.517 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-26T11:13:35.517 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-26T11:13:35.517 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-26T11:13:35.518 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-26T11:13:35.518 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-26T11:13:35.518 INFO:teuthology.orchestra.run.smithi029.stdout: "bluestore_zero_block_detection": "false", 2024-04-26T11:13:35.518 INFO:teuthology.orchestra.run.smithi029.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-26T11:13:35.518 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-26T11:13:35.518 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-26T11:13:35.518 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-26T11:13:35.518 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-26T11:13:35.518 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-26T11:13:35.518 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-26T11:13:35.518 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-26T11:13:35.518 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-26T11:13:35.518 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-26T11:13:35.519 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-26T11:13:35.519 INFO:teuthology.orchestra.run.smithi029.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-26T11:13:35.519 INFO:teuthology.orchestra.run.smithi029.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-26T11:13:35.519 INFO:teuthology.orchestra.run.smithi029.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-26T11:13:35.519 INFO:teuthology.orchestra.run.smithi029.stdout: "cephx_cluster_require_signatures": "false", 2024-04-26T11:13:35.519 INFO:teuthology.orchestra.run.smithi029.stdout: "cephx_cluster_require_version": "2", 2024-04-26T11:13:35.519 INFO:teuthology.orchestra.run.smithi029.stdout: "cephx_require_signatures": "false", 2024-04-26T11:13:35.519 INFO:teuthology.orchestra.run.smithi029.stdout: "cephx_require_version": "2", 2024-04-26T11:13:35.519 INFO:teuthology.orchestra.run.smithi029.stdout: "cephx_service_require_signatures": "false", 2024-04-26T11:13:35.519 INFO:teuthology.orchestra.run.smithi029.stdout: "cephx_service_require_version": "2", 2024-04-26T11:13:35.522 INFO:teuthology.orchestra.run.smithi029.stdout: "cephx_sign_messages": "true", 2024-04-26T11:13:35.522 INFO:teuthology.orchestra.run.smithi029.stdout: "chdir": "", 2024-04-26T11:13:35.522 INFO:teuthology.orchestra.run.smithi029.stdout: "client_acl_type": "", 2024-04-26T11:13:35.522 INFO:teuthology.orchestra.run.smithi029.stdout: "client_asio_thread_count": "2", 2024-04-26T11:13:35.522 INFO:teuthology.orchestra.run.smithi029.stdout: "client_cache_mid": "0.750000", 2024-04-26T11:13:35.523 INFO:teuthology.orchestra.run.smithi029.stdout: "client_cache_size": "16384", 2024-04-26T11:13:35.523 INFO:teuthology.orchestra.run.smithi029.stdout: "client_caps_release_delay": "5", 2024-04-26T11:13:35.523 INFO:teuthology.orchestra.run.smithi029.stdout: "client_check_pool_perm": "true", 2024-04-26T11:13:35.523 INFO:teuthology.orchestra.run.smithi029.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-26T11:13:35.523 INFO:teuthology.orchestra.run.smithi029.stdout: "client_debug_force_sync_read": "false", 2024-04-26T11:13:35.523 INFO:teuthology.orchestra.run.smithi029.stdout: "client_debug_getattr_caps": "false", 2024-04-26T11:13:35.523 INFO:teuthology.orchestra.run.smithi029.stdout: "client_debug_inject_tick_delay": "0", 2024-04-26T11:13:35.523 INFO:teuthology.orchestra.run.smithi029.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-26T11:13:35.523 INFO:teuthology.orchestra.run.smithi029.stdout: "client_die_on_failed_remount": "false", 2024-04-26T11:13:35.523 INFO:teuthology.orchestra.run.smithi029.stdout: "client_dirsize_rbytes": "true", 2024-04-26T11:13:35.523 INFO:teuthology.orchestra.run.smithi029.stdout: "client_force_lazyio": "false", 2024-04-26T11:13:35.523 INFO:teuthology.orchestra.run.smithi029.stdout: "client_fs": "", 2024-04-26T11:13:35.523 INFO:teuthology.orchestra.run.smithi029.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-26T11:13:35.523 INFO:teuthology.orchestra.run.smithi029.stdout: "client_inject_release_failure": "false", 2024-04-26T11:13:35.523 INFO:teuthology.orchestra.run.smithi029.stdout: "client_max_inline_size": "4096", 2024-04-26T11:13:35.524 INFO:teuthology.orchestra.run.smithi029.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-26T11:13:35.524 INFO:teuthology.orchestra.run.smithi029.stdout: "client_mds_namespace": "", 2024-04-26T11:13:35.524 INFO:teuthology.orchestra.run.smithi029.stdout: "client_metadata": "", 2024-04-26T11:13:35.524 INFO:teuthology.orchestra.run.smithi029.stdout: "client_mount_gid": "-1", 2024-04-26T11:13:35.524 INFO:teuthology.orchestra.run.smithi029.stdout: "client_mount_timeout": "300", 2024-04-26T11:13:35.524 INFO:teuthology.orchestra.run.smithi029.stdout: "client_mount_uid": "-1", 2024-04-26T11:13:35.524 INFO:teuthology.orchestra.run.smithi029.stdout: "client_mountpoint": "/", 2024-04-26T11:13:35.524 INFO:teuthology.orchestra.run.smithi029.stdout: "client_notify_timeout": "10", 2024-04-26T11:13:35.524 INFO:teuthology.orchestra.run.smithi029.stdout: "client_oc": "true", 2024-04-26T11:13:35.524 INFO:teuthology.orchestra.run.smithi029.stdout: "client_oc_max_dirty": "104857600", 2024-04-26T11:13:35.524 INFO:teuthology.orchestra.run.smithi029.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-26T11:13:35.524 INFO:teuthology.orchestra.run.smithi029.stdout: "client_oc_max_objects": "1000", 2024-04-26T11:13:35.524 INFO:teuthology.orchestra.run.smithi029.stdout: "client_oc_size": "209715200", 2024-04-26T11:13:35.524 INFO:teuthology.orchestra.run.smithi029.stdout: "client_oc_target_dirty": "8388608", 2024-04-26T11:13:35.524 INFO:teuthology.orchestra.run.smithi029.stdout: "client_permissions": "true", 2024-04-26T11:13:35.525 INFO:teuthology.orchestra.run.smithi029.stdout: "client_quota": "true", 2024-04-26T11:13:35.525 INFO:teuthology.orchestra.run.smithi029.stdout: "client_quota_df": "true", 2024-04-26T11:13:35.525 INFO:teuthology.orchestra.run.smithi029.stdout: "client_readahead_max_bytes": "0", 2024-04-26T11:13:35.525 INFO:teuthology.orchestra.run.smithi029.stdout: "client_readahead_max_periods": "4", 2024-04-26T11:13:35.525 INFO:teuthology.orchestra.run.smithi029.stdout: "client_readahead_min": "131072", 2024-04-26T11:13:35.525 INFO:teuthology.orchestra.run.smithi029.stdout: "client_reconnect_stale": "false", 2024-04-26T11:13:35.525 INFO:teuthology.orchestra.run.smithi029.stdout: "client_shutdown_timeout": "30", 2024-04-26T11:13:35.525 INFO:teuthology.orchestra.run.smithi029.stdout: "client_snapdir": ".snap", 2024-04-26T11:13:35.525 INFO:teuthology.orchestra.run.smithi029.stdout: "client_tick_interval": "1", 2024-04-26T11:13:35.525 INFO:teuthology.orchestra.run.smithi029.stdout: "client_trace": "", 2024-04-26T11:13:35.525 INFO:teuthology.orchestra.run.smithi029.stdout: "client_try_dentry_invalidate": "false", 2024-04-26T11:13:35.525 INFO:teuthology.orchestra.run.smithi029.stdout: "client_use_faked_inos": "false", 2024-04-26T11:13:35.525 INFO:teuthology.orchestra.run.smithi029.stdout: "client_use_random_mds": "false", 2024-04-26T11:13:35.525 INFO:teuthology.orchestra.run.smithi029.stdout: "clog_to_graylog": "false", 2024-04-26T11:13:35.526 INFO:teuthology.orchestra.run.smithi029.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-26T11:13:35.526 INFO:teuthology.orchestra.run.smithi029.stdout: "clog_to_graylog_port": "12201", 2024-04-26T11:13:35.526 INFO:teuthology.orchestra.run.smithi029.stdout: "clog_to_monitors": "default=true", 2024-04-26T11:13:35.526 INFO:teuthology.orchestra.run.smithi029.stdout: "clog_to_syslog": "false", 2024-04-26T11:13:35.526 INFO:teuthology.orchestra.run.smithi029.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-26T11:13:35.526 INFO:teuthology.orchestra.run.smithi029.stdout: "clog_to_syslog_level": "info", 2024-04-26T11:13:35.526 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "-", 2024-04-26T11:13:35.526 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_network": "", 2024-04-26T11:13:35.526 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_network_interface": "", 2024-04-26T11:13:35.526 INFO:teuthology.orchestra.run.smithi029.stdout: "compressor_zlib_isal": "false", 2024-04-26T11:13:35.526 INFO:teuthology.orchestra.run.smithi029.stdout: "compressor_zlib_level": "5", 2024-04-26T11:13:35.526 INFO:teuthology.orchestra.run.smithi029.stdout: "compressor_zlib_winsize": "-15", 2024-04-26T11:13:35.526 INFO:teuthology.orchestra.run.smithi029.stdout: "compressor_zstd_level": "1", 2024-04-26T11:13:35.526 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-26T11:13:35.526 INFO:teuthology.orchestra.run.smithi029.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-26T11:13:35.527 INFO:teuthology.orchestra.run.smithi029.stdout: "crimson_alien_op_num_threads": "6", 2024-04-26T11:13:35.527 INFO:teuthology.orchestra.run.smithi029.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-26T11:13:35.527 INFO:teuthology.orchestra.run.smithi029.stdout: "crimson_osd_obc_lru_size": "10", 2024-04-26T11:13:35.527 INFO:teuthology.orchestra.run.smithi029.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-26T11:13:35.527 INFO:teuthology.orchestra.run.smithi029.stdout: "crimson_seastar_smp": "1", 2024-04-26T11:13:35.527 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_location": "", 2024-04-26T11:13:35.527 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_location_hook": "", 2024-04-26T11:13:35.527 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_location_hook_timeout": "10", 2024-04-26T11:13:35.527 INFO:teuthology.orchestra.run.smithi029.stdout: "daemonize": "false", 2024-04-26T11:13:35.527 INFO:teuthology.orchestra.run.smithi029.stdout: "daos_pool": "tank", 2024-04-26T11:13:35.527 INFO:teuthology.orchestra.run.smithi029.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-26T11:13:35.527 INFO:teuthology.orchestra.run.smithi029.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-26T11:13:35.527 INFO:teuthology.orchestra.run.smithi029.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-26T11:13:35.527 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_alienstore": "0/5", 2024-04-26T11:13:35.528 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_allow_any_pool_priority": "false", 2024-04-26T11:13:35.528 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_asok": "1/5", 2024-04-26T11:13:35.528 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_asok_assert_abort": "false", 2024-04-26T11:13:35.528 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_asserts_on_shutdown": "true", 2024-04-26T11:13:35.528 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_auth": "20/20", 2024-04-26T11:13:35.528 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_bdev": "1/3", 2024-04-26T11:13:35.528 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_bluefs": "1/5", 2024-04-26T11:13:35.528 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_bluestore": "1/5", 2024-04-26T11:13:35.528 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_buffer": "0/1", 2024-04-26T11:13:35.528 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_ceph_exporter": "1/5", 2024-04-26T11:13:35.528 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_cephfs_mirror": "0/5", 2024-04-26T11:13:35.528 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_cephsqlite": "0/5", 2024-04-26T11:13:35.528 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_client": "0/5", 2024-04-26T11:13:35.528 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_compressor": "1/5", 2024-04-26T11:13:35.528 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_context": "0/1", 2024-04-26T11:13:35.529 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_crush": "1/1", 2024-04-26T11:13:35.529 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_crypto": "1/5", 2024-04-26T11:13:35.529 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_cyanstore": "0/5", 2024-04-26T11:13:35.529 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_deliberately_leak_memory": "false", 2024-04-26T11:13:35.529 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_disable_randomized_ping": "false", 2024-04-26T11:13:35.529 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_dpdk": "1/5", 2024-04-26T11:13:35.529 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_eventtrace": "1/5", 2024-04-26T11:13:35.529 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_filer": "0/1", 2024-04-26T11:13:35.529 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_filestore": "1/3", 2024-04-26T11:13:35.530 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_finisher": "1/1", 2024-04-26T11:13:35.530 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_fuse": "1/5", 2024-04-26T11:13:35.530 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_heartbeat_testing_span": "0", 2024-04-26T11:13:35.530 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_heartbeatmap": "1/5", 2024-04-26T11:13:35.530 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-26T11:13:35.530 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_javaclient": "1/5", 2024-04-26T11:13:35.530 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_journal": "1/3", 2024-04-26T11:13:35.530 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_journaler": "0/5", 2024-04-26T11:13:35.530 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_kstore": "1/5", 2024-04-26T11:13:35.530 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_leveldb": "4/5", 2024-04-26T11:13:35.530 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_lockdep": "0/1", 2024-04-26T11:13:35.530 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_mclock": "1/5", 2024-04-26T11:13:35.530 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_mds": "1/5", 2024-04-26T11:13:35.530 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_mds_balancer": "1/5", 2024-04-26T11:13:35.531 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_mds_locker": "1/5", 2024-04-26T11:13:35.531 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_mds_log": "1/5", 2024-04-26T11:13:35.531 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_mds_log_expire": "1/5", 2024-04-26T11:13:35.531 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_mds_migrator": "1/5", 2024-04-26T11:13:35.531 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_memstore": "1/5", 2024-04-26T11:13:35.531 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_mgr": "2/5", 2024-04-26T11:13:35.531 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_mgrc": "1/5", 2024-04-26T11:13:35.531 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_mon": "20/20", 2024-04-26T11:13:35.531 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_monc": "0/10", 2024-04-26T11:13:35.531 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_ms": "1/1", 2024-04-26T11:13:35.531 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_none": "0/5", 2024-04-26T11:13:35.531 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_objclass": "0/5", 2024-04-26T11:13:35.531 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_objectcacher": "0/5", 2024-04-26T11:13:35.532 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_objecter": "0/1", 2024-04-26T11:13:35.532 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_optracker": "0/5", 2024-04-26T11:13:35.532 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_osd": "1/5", 2024-04-26T11:13:35.532 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_paxos": "20/20", 2024-04-26T11:13:35.532 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_perfcounter": "1/5", 2024-04-26T11:13:35.532 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_prioritycache": "1/5", 2024-04-26T11:13:35.532 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_rados": "0/5", 2024-04-26T11:13:35.532 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_rbd": "0/5", 2024-04-26T11:13:35.532 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_rbd_mirror": "0/5", 2024-04-26T11:13:35.532 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_rbd_pwl": "0/5", 2024-04-26T11:13:35.532 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_rbd_replay": "0/5", 2024-04-26T11:13:35.532 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_refs": "0/0", 2024-04-26T11:13:35.532 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_reserver": "1/1", 2024-04-26T11:13:35.532 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_rgw": "1/5", 2024-04-26T11:13:35.532 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_rgw_access": "1/5", 2024-04-26T11:13:35.533 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_rgw_datacache": "1/5", 2024-04-26T11:13:35.533 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_rgw_dbstore": "1/5", 2024-04-26T11:13:35.533 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_rgw_flight": "1/5", 2024-04-26T11:13:35.533 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_rgw_sync": "1/5", 2024-04-26T11:13:35.533 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_rocksdb": "4/5", 2024-04-26T11:13:35.533 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore": "0/5", 2024-04-26T11:13:35.533 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_backref": "0/5", 2024-04-26T11:13:35.533 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_cache": "0/5", 2024-04-26T11:13:35.533 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_cleaner": "0/5", 2024-04-26T11:13:35.533 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_device": "0/5", 2024-04-26T11:13:35.533 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_epm": "0/5", 2024-04-26T11:13:35.533 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-26T11:13:35.533 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_journal": "0/5", 2024-04-26T11:13:35.533 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_lba": "0/5", 2024-04-26T11:13:35.533 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_odata": "0/5", 2024-04-26T11:13:35.533 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_omap": "0/5", 2024-04-26T11:13:35.534 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_onode": "0/5", 2024-04-26T11:13:35.534 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_t": "0/5", 2024-04-26T11:13:35.534 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_seastore_tm": "0/5", 2024-04-26T11:13:35.534 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_striper": "0/1", 2024-04-26T11:13:35.534 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_test": "0/5", 2024-04-26T11:13:35.534 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_throttle": "1/1", 2024-04-26T11:13:35.534 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_timer": "0/1", 2024-04-26T11:13:35.534 INFO:teuthology.orchestra.run.smithi029.stdout: "debug_tp": "0/5", 2024-04-26T11:13:35.534 INFO:teuthology.orchestra.run.smithi029.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-26T11:13:35.534 INFO:teuthology.orchestra.run.smithi029.stdout: "device_failure_prediction_mode": "none", 2024-04-26T11:13:35.534 INFO:teuthology.orchestra.run.smithi029.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-26T11:13:35.534 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-04-26T11:13:35.534 INFO:teuthology.orchestra.run.smithi029.stdout: "err_to_graylog": "false", 2024-04-26T11:13:35.535 INFO:teuthology.orchestra.run.smithi029.stdout: "err_to_journald": "false", 2024-04-26T11:13:35.535 INFO:teuthology.orchestra.run.smithi029.stdout: "err_to_stderr": "true", 2024-04-26T11:13:35.535 INFO:teuthology.orchestra.run.smithi029.stdout: "err_to_syslog": "false", 2024-04-26T11:13:35.535 INFO:teuthology.orchestra.run.smithi029.stdout: "event_tracing": "false", 2024-04-26T11:13:35.535 INFO:teuthology.orchestra.run.smithi029.stdout: "exporter_addr": "0.0.0.0", 2024-04-26T11:13:35.535 INFO:teuthology.orchestra.run.smithi029.stdout: "exporter_http_port": "9926", 2024-04-26T11:13:35.535 INFO:teuthology.orchestra.run.smithi029.stdout: "exporter_prio_limit": "5", 2024-04-26T11:13:35.535 INFO:teuthology.orchestra.run.smithi029.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-26T11:13:35.535 INFO:teuthology.orchestra.run.smithi029.stdout: "exporter_sort_metrics": "true", 2024-04-26T11:13:35.535 INFO:teuthology.orchestra.run.smithi029.stdout: "exporter_stats_period": "5", 2024-04-26T11:13:35.535 INFO:teuthology.orchestra.run.smithi029.stdout: "fake_statfs_for_testing": "0", 2024-04-26T11:13:35.535 INFO:teuthology.orchestra.run.smithi029.stdout: "fatal_signal_handlers": "true", 2024-04-26T11:13:35.535 INFO:teuthology.orchestra.run.smithi029.stdout: "filer_max_purge_ops": "10", 2024-04-26T11:13:35.535 INFO:teuthology.orchestra.run.smithi029.stdout: "filer_max_truncate_ops": "128", 2024-04-26T11:13:35.535 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_apply_finisher_threads": "1", 2024-04-26T11:13:35.536 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_blackhole": "false", 2024-04-26T11:13:35.536 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_btrfs_clone_range": "true", 2024-04-26T11:13:35.536 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_btrfs_snap": "true", 2024-04-26T11:13:35.536 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_caller_concurrency": "10", 2024-04-26T11:13:35.536 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_collect_device_partition_information": "true", 2024-04-26T11:13:35.536 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_commit_timeout": "600.000000", 2024-04-26T11:13:35.536 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_debug_inject_read_err": "false", 2024-04-26T11:13:35.536 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_debug_omap_check": "false", 2024-04-26T11:13:35.536 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-26T11:13:35.536 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_debug_verify_split": "false", 2024-04-26T11:13:35.536 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_dump_file": "", 2024-04-26T11:13:35.536 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-26T11:13:35.536 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-26T11:13:35.536 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_fadvise": "true", 2024-04-26T11:13:35.537 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_fail_eio": "true", 2024-04-26T11:13:35.537 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_fd_cache_shards": "16", 2024-04-26T11:13:35.537 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_fd_cache_size": "128", 2024-04-26T11:13:35.537 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_fiemap": "false", 2024-04-26T11:13:35.537 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_fiemap_threshold": "4096", 2024-04-26T11:13:35.537 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-26T11:13:35.537 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-26T11:13:35.537 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_inject_stall": "0", 2024-04-26T11:13:35.537 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_journal_parallel": "false", 2024-04-26T11:13:35.537 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_journal_trailing": "false", 2024-04-26T11:13:35.538 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_journal_writeahead": "false", 2024-04-26T11:13:35.538 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_kill_at": "0", 2024-04-26T11:13:35.538 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-26T11:13:35.538 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-26T11:13:35.538 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-26T11:13:35.538 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-26T11:13:35.538 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-26T11:13:35.538 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_inline_xattrs": "0", 2024-04-26T11:13:35.538 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-26T11:13:35.538 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-26T11:13:35.538 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-26T11:13:35.539 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-26T11:13:35.539 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_xattr_value_size": "0", 2024-04-26T11:13:35.539 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-26T11:13:35.539 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-26T11:13:35.539 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-26T11:13:35.539 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_merge_threshold": "-10", 2024-04-26T11:13:35.539 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-26T11:13:35.539 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_odsync_write": "false", 2024-04-26T11:13:35.539 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_omap_backend": "rocksdb", 2024-04-26T11:13:35.539 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_omap_backend_path": "", 2024-04-26T11:13:35.539 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-26T11:13:35.539 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-26T11:13:35.539 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-26T11:13:35.540 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_op_thread_timeout": "60", 2024-04-26T11:13:35.540 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_op_threads": "2", 2024-04-26T11:13:35.540 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_punch_hole": "false", 2024-04-26T11:13:35.540 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-26T11:13:35.540 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-26T11:13:35.540 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-26T11:13:35.540 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-26T11:13:35.540 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-26T11:13:35.540 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-26T11:13:35.540 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-26T11:13:35.540 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-26T11:13:35.541 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-26T11:13:35.541 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_queue_max_ops": "50", 2024-04-26T11:13:35.541 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-26T11:13:35.541 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_seek_data_hole": "false", 2024-04-26T11:13:35.541 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_sloppy_crc": "false", 2024-04-26T11:13:35.541 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-26T11:13:35.541 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_splice": "false", 2024-04-26T11:13:35.541 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_split_multiple": "2", 2024-04-26T11:13:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_split_rand_factor": "20", 2024-04-26T11:13:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_update_to": "1000", 2024-04-26T11:13:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-26T11:13:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-26T11:13:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-26T11:13:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-26T11:13:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-26T11:13:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-26T11:13:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_enable": "true", 2024-04-26T11:13:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-26T11:13:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-26T11:13:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-26T11:13:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-26T11:13:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-26T11:13:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-26T11:13:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_xfs_extsize": "false", 2024-04-26T11:13:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: "filestore_zfs_snap": "false", 2024-04-26T11:13:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: "fio_dir": "/tmp/fio", 2024-04-26T11:13:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: "fsid": "2b52ce04-9559-478f-9787-c3cc3b261c15", 2024-04-26T11:13:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_allow_other": "true", 2024-04-26T11:13:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_atomic_o_trunc": "true", 2024-04-26T11:13:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_big_writes": "true", 2024-04-26T11:13:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_debug": "false", 2024-04-26T11:13:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_default_permissions": "false", 2024-04-26T11:13:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_disable_pagecache": "false", 2024-04-26T11:13:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_max_write": "0", 2024-04-26T11:13:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_multithreaded": "true", 2024-04-26T11:13:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_require_active_mds": "true", 2024-04-26T11:13:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_set_user_groups": "true", 2024-04-26T11:13:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_splice_move": "true", 2024-04-26T11:13:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_splice_read": "true", 2024-04-26T11:13:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_splice_write": "true", 2024-04-26T11:13:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-26T11:13:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: "fuse_use_invalidate_cb": "true", 2024-04-26T11:13:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-26T11:13:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: "gss_target_name": "ceph", 2024-04-26T11:13:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_file": "", 2024-04-26T11:13:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_inject_failure": "0", 2024-04-26T11:13:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_interval": "5", 2024-04-26T11:13:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: "host": "smithi029", 2024-04-26T11:13:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-26T11:13:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-26T11:13:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-26T11:13:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-26T11:13:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-26T11:13:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-26T11:13:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-26T11:13:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-26T11:13:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-26T11:13:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-26T11:13:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-26T11:13:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-26T11:13:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-26T11:13:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: "inject_early_sigterm": "false", 2024-04-26T11:13:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: "jaeger_agent_port": "6799", 2024-04-26T11:13:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: "jaeger_tracing_enable": "false", 2024-04-26T11:13:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_aio": "true", 2024-04-26T11:13:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_align_min_size": "65536", 2024-04-26T11:13:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_block_align": "true", 2024-04-26T11:13:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_block_size": "4096", 2024-04-26T11:13:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_dio": "true", 2024-04-26T11:13:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_discard": "false", 2024-04-26T11:13:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_force_aio": "false", 2024-04-26T11:13:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_ignore_corruption": "false", 2024-04-26T11:13:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_max_write_bytes": "10485760", 2024-04-26T11:13:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_max_write_entries": "100", 2024-04-26T11:13:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_replay_from": "0", 2024-04-26T11:13:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-26T11:13:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-26T11:13:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-26T11:13:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-26T11:13:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_write_header_frequency": "0", 2024-04-26T11:13:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: "journal_zero_on_create": "false", 2024-04-26T11:13:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: "journaler_prefetch_periods": "10", 2024-04-26T11:13:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: "journaler_prezero_periods": "5", 2024-04-26T11:13:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: "journaler_write_head_interval": "15", 2024-04-26T11:13:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: "key": "", 2024-04-26T11:13:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: "keyfile": "", 2024-04-26T11:13:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-26T11:13:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: "kstore_backend": "rocksdb", 2024-04-26T11:13:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: "kstore_default_stripe_size": "65536", 2024-04-26T11:13:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: "kstore_fsck_on_mount": "false", 2024-04-26T11:13:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-26T11:13:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: "kstore_max_bytes": "67108864", 2024-04-26T11:13:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: "kstore_max_ops": "512", 2024-04-26T11:13:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: "kstore_nid_prealloc": "1024", 2024-04-26T11:13:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: "kstore_onode_map_size": "1024", 2024-04-26T11:13:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-26T11:13:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: "kstore_sync_submit_transaction": "false", 2024-04-26T11:13:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: "kstore_sync_transaction": "false", 2024-04-26T11:13:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: "leveldb_block_size": "65536", 2024-04-26T11:13:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: "leveldb_bloom_size": "0", 2024-04-26T11:13:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: "leveldb_cache_size": "536870912", 2024-04-26T11:13:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: "leveldb_compact_on_mount": "false", 2024-04-26T11:13:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: "leveldb_compression": "false", 2024-04-26T11:13:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: "leveldb_log": "", 2024-04-26T11:13:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: "leveldb_log_to_ceph_log": "true", 2024-04-26T11:13:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: "leveldb_max_open_files": "0", 2024-04-26T11:13:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: "leveldb_paranoid": "false", 2024-04-26T11:13:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: "leveldb_write_buffer_size": "33554432", 2024-04-26T11:13:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: "librados_thread_count": "2", 2024-04-26T11:13:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: "lockdep": "false", 2024-04-26T11:13:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: "lockdep_force_backtrace": "false", 2024-04-26T11:13:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: "log_coarse_timestamps": "true", 2024-04-26T11:13:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-26T11:13:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: "log_flush_on_exit": "false", 2024-04-26T11:13:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: "log_graylog_host": "127.0.0.1", 2024-04-26T11:13:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: "log_graylog_port": "12201", 2024-04-26T11:13:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: "log_max_new": "1000", 2024-04-26T11:13:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: "log_max_recent": "10000", 2024-04-26T11:13:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: "log_stderr_prefix": "", 2024-04-26T11:13:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: "log_stop_at_utilization": "0.970000", 2024-04-26T11:13:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": "true", 2024-04-26T11:13:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_graylog": "false", 2024-04-26T11:13:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_journald": "false", 2024-04-26T11:13:35.550 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_stderr": "false", 2024-04-26T11:13:35.550 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_syslog": "false", 2024-04-26T11:13:35.550 INFO:teuthology.orchestra.run.smithi029.stdout: "max_rotating_auth_attempts": "10", 2024-04-26T11:13:35.550 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-26T11:13:35.550 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_action_on_write_error": "1", 2024-04-26T11:13:35.551 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_alternate_name_max": "8192", 2024-04-26T11:13:35.551 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_asio_thread_count": "2", 2024-04-26T11:13:35.551 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_export_pin": "true", 2024-04-26T11:13:35.551 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_fragment_dirs": "true", 2024-04-26T11:13:35.551 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-26T11:13:35.551 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_fragment_interval": "5", 2024-04-26T11:13:35.551 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-26T11:13:35.552 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-26T11:13:35.552 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_interval": "10", 2024-04-26T11:13:35.552 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_max": "-1", 2024-04-26T11:13:35.552 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_max_until": "-1", 2024-04-26T11:13:35.552 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_merge_size": "50", 2024-04-26T11:13:35.552 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_midchunk": "0.300000", 2024-04-26T11:13:35.552 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-26T11:13:35.552 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_min_start": "0.200000", 2024-04-26T11:13:35.552 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_minchunk": "0.001000", 2024-04-26T11:13:35.553 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_mode": "0", 2024-04-26T11:13:35.553 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_need_max": "1.200000", 2024-04-26T11:13:35.553 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_need_min": "0.800000", 2024-04-26T11:13:35.553 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-26T11:13:35.553 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-26T11:13:35.553 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_split_bits": "3", 2024-04-26T11:13:35.553 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-26T11:13:35.553 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_split_size": "10000", 2024-04-26T11:13:35.553 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-26T11:13:35.553 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_target_decay": "10.000000", 2024-04-26T11:13:35.553 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-26T11:13:35.553 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_beacon_grace": "15.000000", 2024-04-26T11:13:35.553 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_beacon_interval": "4.000000", 2024-04-26T11:13:35.553 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-26T11:13:35.553 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-26T11:13:35.554 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_cache_mid": "0.700000", 2024-04-26T11:13:35.554 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_cache_release_free_interval": "10", 2024-04-26T11:13:35.554 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_cache_reservation": "0.050000", 2024-04-26T11:13:35.554 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-26T11:13:35.554 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_cache_trim_interval": "1", 2024-04-26T11:13:35.554 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_cache_trim_threshold": "262144", 2024-04-26T11:13:35.554 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-26T11:13:35.554 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-26T11:13:35.554 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-26T11:13:35.554 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_client_prealloc_inos": "1000", 2024-04-26T11:13:35.554 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-26T11:13:35.554 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_connect_bootstrapping": "false", 2024-04-26T11:13:35.554 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_damage_table_max_entries": "10000", 2024-04-26T11:13:35.554 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-26T11:13:35.555 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_debug_auth_pins": "false", 2024-04-26T11:13:35.555 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_debug_frag": "false", 2024-04-26T11:13:35.555 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_debug_scatterstat": "false", 2024-04-26T11:13:35.555 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_debug_subtrees": "false", 2024-04-26T11:13:35.555 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_decay_halflife": "5.000000", 2024-04-26T11:13:35.555 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_default_dir_hash": "2", 2024-04-26T11:13:35.555 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_defer_session_stale": "true", 2024-04-26T11:13:35.555 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_deny_all_reconnect": "false", 2024-04-26T11:13:35.555 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_dir_keys_per_op": "16384", 2024-04-26T11:13:35.555 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_dir_max_commit_size": "10", 2024-04-26T11:13:35.555 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_dir_max_entries": "0", 2024-04-26T11:13:35.555 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_dir_prefetch": "true", 2024-04-26T11:13:35.555 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-26T11:13:35.555 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-26T11:13:35.555 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_dump_cache_on_map": "false", 2024-04-26T11:13:35.556 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-26T11:13:35.556 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-26T11:13:35.556 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_early_reply": "true", 2024-04-26T11:13:35.556 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_enable_op_tracker": "true", 2024-04-26T11:13:35.556 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_enforce_unique_name": "true", 2024-04-26T11:13:35.556 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-26T11:13:35.556 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-26T11:13:35.556 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_export_ephemeral_random": "true", 2024-04-26T11:13:35.556 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-26T11:13:35.556 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-26T11:13:35.556 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-26T11:13:35.556 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-26T11:13:35.556 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-26T11:13:35.556 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-26T11:13:35.557 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-26T11:13:35.557 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-26T11:13:35.557 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_health_summarize_threshold": "10", 2024-04-26T11:13:35.557 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-26T11:13:35.557 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-26T11:13:35.557 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_inject_health_dummy": "false", 2024-04-26T11:13:35.557 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-26T11:13:35.557 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_inject_migrator_session_race": "false", 2024-04-26T11:13:35.557 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-26T11:13:35.557 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-26T11:13:35.557 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-26T11:13:35.557 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_join_fs": "", 2024-04-26T11:13:35.557 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_journal_format": "1", 2024-04-26T11:13:35.557 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_kill_create_at": "0", 2024-04-26T11:13:35.557 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_kill_export_at": "0", 2024-04-26T11:13:35.558 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_kill_import_at": "0", 2024-04-26T11:13:35.558 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_kill_journal_at": "0", 2024-04-26T11:13:35.558 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_kill_journal_expire_at": "0", 2024-04-26T11:13:35.558 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_kill_journal_replay_at": "0", 2024-04-26T11:13:35.558 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_kill_link_at": "0", 2024-04-26T11:13:35.558 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_kill_mdstable_at": "0", 2024-04-26T11:13:35.558 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_kill_openc_at": "0", 2024-04-26T11:13:35.558 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_kill_rename_at": "0", 2024-04-26T11:13:35.558 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-26T11:13:35.558 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_log_events_per_segment": "1024", 2024-04-26T11:13:35.558 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_log_max_events": "-1", 2024-04-26T11:13:35.558 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_log_max_segments": "128", 2024-04-26T11:13:35.558 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_log_pause": "false", 2024-04-26T11:13:35.558 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_log_segment_size": "0", 2024-04-26T11:13:35.558 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-26T11:13:35.559 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_log_warn_factor": "2.000000", 2024-04-26T11:13:35.559 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_max_caps_per_client": "1048576", 2024-04-26T11:13:35.559 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_max_completed_flushes": "100000", 2024-04-26T11:13:35.559 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_max_completed_requests": "100000", 2024-04-26T11:13:35.559 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_max_export_size": "20971520", 2024-04-26T11:13:35.559 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_max_file_recover": "32", 2024-04-26T11:13:35.559 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_max_purge_files": "64", 2024-04-26T11:13:35.559 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_max_purge_ops": "8192", 2024-04-26T11:13:35.559 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-26T11:13:35.559 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-26T11:13:35.559 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_max_snaps_per_dir": "100", 2024-04-26T11:13:35.559 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_metrics_update_interval": "2", 2024-04-26T11:13:35.560 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_min_caps_per_client": "100", 2024-04-26T11:13:35.560 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_min_caps_working_set": "10000", 2024-04-26T11:13:35.560 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-26T11:13:35.560 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_numa_node": "-1", 2024-04-26T11:13:35.560 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-26T11:13:35.560 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_op_complaint_time": "30.000000", 2024-04-26T11:13:35.560 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_op_history_duration": "600", 2024-04-26T11:13:35.560 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_op_history_size": "20", 2024-04-26T11:13:35.560 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_op_history_slow_op_size": "20", 2024-04-26T11:13:35.560 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-26T11:13:35.561 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_op_log_threshold": "5", 2024-04-26T11:13:35.561 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_ping_grace": "15", 2024-04-26T11:13:35.561 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_ping_interval": "5", 2024-04-26T11:13:35.561 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-26T11:13:35.561 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-26T11:13:35.561 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_recall_max_caps": "30000", 2024-04-26T11:13:35.561 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-26T11:13:35.561 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-26T11:13:35.561 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-26T11:13:35.561 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_recall_warning_threshold": "262144", 2024-04-26T11:13:35.561 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-26T11:13:35.561 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_replay_interval": "1.000000", 2024-04-26T11:13:35.561 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-26T11:13:35.561 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-26T11:13:35.561 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_root_ino_gid": "0", 2024-04-26T11:13:35.562 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_root_ino_uid": "0", 2024-04-26T11:13:35.562 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-26T11:13:35.562 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-26T11:13:35.562 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-26T11:13:35.562 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-26T11:13:35.562 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-26T11:13:35.562 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-26T11:13:35.562 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-26T11:13:35.562 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-26T11:13:35.562 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-26T11:13:35.562 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-26T11:13:35.562 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_shutdown_check": "0", 2024-04-26T11:13:35.562 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_skip_ino": "0", 2024-04-26T11:13:35.562 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-26T11:13:35.562 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_snap_max_uid": "4294967294", 2024-04-26T11:13:35.563 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_snap_min_uid": "0", 2024-04-26T11:13:35.563 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_snap_rstat": "false", 2024-04-26T11:13:35.563 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_standby_replay_damaged": "false", 2024-04-26T11:13:35.563 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_symlink_recovery": "true", 2024-04-26T11:13:35.563 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-26T11:13:35.563 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_thrash_exports": "0", 2024-04-26T11:13:35.563 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_thrash_fragments": "0", 2024-04-26T11:13:35.563 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_tick_interval": "5.000000", 2024-04-26T11:13:35.563 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_valgrind_exit": "false", 2024-04-26T11:13:35.563 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_verify_backtrace": "1", 2024-04-26T11:13:35.563 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_verify_scatter": "false", 2024-04-26T11:13:35.563 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-26T11:13:35.563 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_wipe_sessions": "false", 2024-04-26T11:13:35.563 INFO:teuthology.orchestra.run.smithi029.stdout: "mempool_debug": "false", 2024-04-26T11:13:35.563 INFO:teuthology.orchestra.run.smithi029.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-26T11:13:35.564 INFO:teuthology.orchestra.run.smithi029.stdout: "memstore_device_bytes": "1073741824", 2024-04-26T11:13:35.564 INFO:teuthology.orchestra.run.smithi029.stdout: "memstore_page_set": "false", 2024-04-26T11:13:35.564 INFO:teuthology.orchestra.run.smithi029.stdout: "memstore_page_size": "65536", 2024-04-26T11:13:35.564 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_client_bytes": "134217728", 2024-04-26T11:13:35.564 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_client_messages": "512", 2024-04-26T11:13:35.564 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-26T11:13:35.564 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-26T11:13:35.564 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-26T11:13:35.564 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-26T11:13:35.564 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_disabled_modules": "", 2024-04-26T11:13:35.564 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-26T11:13:35.564 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_max_pg_num_change": "128", 2024-04-26T11:13:35.564 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_mds_bytes": "134217728", 2024-04-26T11:13:35.564 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_mds_messages": "128", 2024-04-26T11:13:35.564 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-26T11:13:35.565 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_mon_bytes": "134217728", 2024-04-26T11:13:35.565 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_mon_messages": "128", 2024-04-26T11:13:35.565 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_osd_bytes": "536870912", 2024-04-26T11:13:35.565 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_osd_messages": "8192", 2024-04-26T11:13:35.565 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_pool": "true", 2024-04-26T11:13:35.565 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-26T11:13:35.565 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_standby_modules": "true", 2024-04-26T11:13:35.565 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_stats_period": "5", 2024-04-26T11:13:35.565 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_stats_threshold": "5", 2024-04-26T11:13:35.565 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_tick_period": "2", 2024-04-26T11:13:35.565 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-26T11:13:35.565 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-26T11:13:35.565 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_allow_pool_delete": "true", 2024-04-26T11:13:35.565 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_allow_pool_size_one": "true", 2024-04-26T11:13:35.566 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_auth_validate_all_caps": "true", 2024-04-26T11:13:35.566 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-26T11:13:35.566 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-26T11:13:35.566 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_client_bytes": "104857600", 2024-04-26T11:13:35.566 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_client_directed_command_retry": "2", 2024-04-26T11:13:35.566 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-26T11:13:35.566 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-26T11:13:35.566 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-26T11:13:35.566 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-26T11:13:35.566 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_client_hunt_parallel": "3", 2024-04-26T11:13:35.566 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_client_log_interval": "1.000000", 2024-04-26T11:13:35.566 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-26T11:13:35.566 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_client_ping_interval": "10.000000", 2024-04-26T11:13:35.566 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-26T11:13:35.566 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-26T11:13:35.567 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-26T11:13:35.567 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-26T11:13:35.567 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cluster_log_file_level": "debug", 2024-04-26T11:13:35.567 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cluster_log_to_file": "true", 2024-04-26T11:13:35.567 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-26T11:13:35.567 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-26T11:13:35.567 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-26T11:13:35.567 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cluster_log_to_journald": "false", 2024-04-26T11:13:35.567 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-26T11:13:35.567 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-26T11:13:35.567 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-26T11:13:35.567 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-26T11:13:35.567 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_compact_on_bootstrap": "false", 2024-04-26T11:13:35.567 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_compact_on_start": "false", 2024-04-26T11:13:35.567 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_compact_on_trim": "true", 2024-04-26T11:13:35.568 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-26T11:13:35.568 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-26T11:13:35.568 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-26T11:13:35.568 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_cpu_threads": "4", 2024-04-26T11:13:35.568 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_crush_min_required_version": "hammer", 2024-04-26T11:13:35.568 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_daemon_bytes": "419430400", 2024-04-26T11:13:35.568 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-26T11:13:35.568 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_data_avail_crit": "5", 2024-04-26T11:13:35.568 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_data_avail_warn": "5", 2024-04-26T11:13:35.568 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_data_size_warn": "16106127360", 2024-04-26T11:13:35.568 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-26T11:13:35.568 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-26T11:13:35.568 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_debug_dump_json": "false", 2024-04-26T11:13:35.568 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-26T11:13:35.568 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_debug_dump_transactions": "false", 2024-04-26T11:13:35.569 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_debug_extra_checks": "false", 2024-04-26T11:13:35.569 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-26T11:13:35.569 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-26T11:13:35.569 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_debug_no_require_quincy": "false", 2024-04-26T11:13:35.569 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_debug_no_require_reef": "false", 2024-04-26T11:13:35.569 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-26T11:13:35.569 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-26T11:13:35.569 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-26T11:13:35.569 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_down_mkfs_grace": "120", 2024-04-26T11:13:35.569 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_election_default_strategy": "1", 2024-04-26T11:13:35.569 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_election_timeout": "5.000000", 2024-04-26T11:13:35.569 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-26T11:13:35.569 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_elector_ping_divisor": "2", 2024-04-26T11:13:35.569 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-26T11:13:35.570 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_enable_op_tracker": "true", 2024-04-26T11:13:35.570 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_fake_pool_delete": "false", 2024-04-26T11:13:35.570 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_force_quorum_join": "false", 2024-04-26T11:13:35.570 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_globalid_prealloc": "10000", 2024-04-26T11:13:35.570 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_health_detail_to_clog": "false", 2024-04-26T11:13:35.570 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_health_log_update_period": "5", 2024-04-26T11:13:35.570 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_health_max_detail": "50", 2024-04-26T11:13:35.570 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_health_to_clog": "true", 2024-04-26T11:13:35.570 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_health_to_clog_interval": "600", 2024-04-26T11:13:35.570 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-26T11:13:35.570 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_host": "172.21.15.29,[v2:172.21.15.29:3301,v1:172.21.15.29:6790],[v2:172.21.15.29:3302,v1:172.21.15.29:6791]", 2024-04-26T11:13:35.570 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_host_override": "", 2024-04-26T11:13:35.570 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_initial_members": "", 2024-04-26T11:13:35.571 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-26T11:13:35.571 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-26T11:13:35.571 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-26T11:13:35.571 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-26T11:13:35.571 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-26T11:13:35.571 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_lease": "5.000000", 2024-04-26T11:13:35.571 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-26T11:13:35.571 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-26T11:13:35.571 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_log_full_interval": "50", 2024-04-26T11:13:35.571 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_log_max": "10000", 2024-04-26T11:13:35.571 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_log_max_summary": "50", 2024-04-26T11:13:35.571 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-26T11:13:35.571 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_max_log_epochs": "500", 2024-04-26T11:13:35.572 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-26T11:13:35.572 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-26T11:13:35.572 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_max_osd": "10000", 2024-04-26T11:13:35.572 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_max_pg_per_osd": "10000", 2024-04-26T11:13:35.572 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_max_pool_pg_num": "65536", 2024-04-26T11:13:35.572 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-26T11:13:35.572 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-26T11:13:35.572 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_mds_force_trim_to": "0", 2024-04-26T11:13:35.572 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_mds_skip_sanity": "false", 2024-04-26T11:13:35.572 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_memory_autotune": "true", 2024-04-26T11:13:35.572 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_memory_target": "2147483648", 2024-04-26T11:13:35.572 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_mgr_beacon_grace": "30", 2024-04-26T11:13:35.572 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-26T11:13:35.572 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_mgr_digest_period": "5", 2024-04-26T11:13:35.573 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_mgr_inactive_grace": "60", 2024-04-26T11:13:35.573 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-26T11:13:35.573 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-26T11:13:35.573 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_min_osdmap_epochs": "500", 2024-04-26T11:13:35.573 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_op_complaint_time": "30", 2024-04-26T11:13:35.573 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_op_history_duration": "600", 2024-04-26T11:13:35.573 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_op_history_size": "20", 2024-04-26T11:13:35.573 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_op_history_slow_op_size": "20", 2024-04-26T11:13:35.573 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-26T11:13:35.573 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_op_log_threshold": "5", 2024-04-26T11:13:35.573 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-26T11:13:35.573 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-26T11:13:35.573 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-26T11:13:35.573 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_auto_mark_in": "false", 2024-04-26T11:13:35.573 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-26T11:13:35.573 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-26T11:13:35.574 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-26T11:13:35.574 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_cache_size": "500", 2024-04-26T11:13:35.574 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-26T11:13:35.574 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-26T11:13:35.574 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-26T11:13:35.574 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_down_out_interval": "600", 2024-04-26T11:13:35.574 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-26T11:13:35.574 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-26T11:13:35.574 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_force_trim_to": "0", 2024-04-26T11:13:35.574 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-26T11:13:35.574 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-26T11:13:35.574 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-26T11:13:35.574 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-26T11:13:35.574 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-26T11:13:35.575 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-26T11:13:35.575 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-26T11:13:35.575 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-26T11:13:35.575 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_min_down_reporters": "2", 2024-04-26T11:13:35.575 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-26T11:13:35.575 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-26T11:13:35.575 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-26T11:13:35.575 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-26T11:13:35.575 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-26T11:13:35.575 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-26T11:13:35.575 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_report_timeout": "900", 2024-04-26T11:13:35.575 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-26T11:13:35.575 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-26T11:13:35.575 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-26T11:13:35.575 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-26T11:13:35.576 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-26T11:13:35.576 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-26T11:13:35.576 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-26T11:13:35.576 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-26T11:13:35.576 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-26T11:13:35.576 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_pg_stuck_threshold": "60", 2024-04-26T11:13:35.576 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-26T11:13:35.576 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-26T11:13:35.576 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-26T11:13:35.576 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-26T11:13:35.576 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-26T11:13:35.576 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-26T11:13:35.576 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_probe_timeout": "2.000000", 2024-04-26T11:13:35.576 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_reweight_max_change": "0.050000", 2024-04-26T11:13:35.576 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_reweight_max_osds": "4", 2024-04-26T11:13:35.576 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-26T11:13:35.577 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-26T11:13:35.577 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-26T11:13:35.577 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-26T11:13:35.577 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-26T11:13:35.577 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_scrub_interval": "86400", 2024-04-26T11:13:35.577 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_scrub_max_keys": "100", 2024-04-26T11:13:35.577 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_scrub_timeout": "300", 2024-04-26T11:13:35.577 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_session_timeout": "300", 2024-04-26T11:13:35.577 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_smart_report_timeout": "5", 2024-04-26T11:13:35.577 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_stat_smooth_intervals": "6", 2024-04-26T11:13:35.577 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-26T11:13:35.577 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_stretch_pool_min_size": "2", 2024-04-26T11:13:35.577 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_stretch_pool_size": "4", 2024-04-26T11:13:35.577 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-26T11:13:35.577 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-26T11:13:35.578 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_sync_debug": "false", 2024-04-26T11:13:35.578 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-26T11:13:35.578 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-26T11:13:35.578 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_sync_provider_kill_at": "0", 2024-04-26T11:13:35.578 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_sync_requester_kill_at": "0", 2024-04-26T11:13:35.578 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_sync_timeout": "60.000000", 2024-04-26T11:13:35.578 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_target_pg_per_osd": "100", 2024-04-26T11:13:35.578 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_tick_interval": "5", 2024-04-26T11:13:35.578 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_timecheck_interval": "300.000000", 2024-04-26T11:13:35.578 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-26T11:13:35.578 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_use_min_delay_socket": "false", 2024-04-26T11:13:35.578 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_older_version_delay": "604800", 2024-04-26T11:13:35.578 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-26T11:13:35.578 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-26T11:13:35.579 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-26T11:13:35.579 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-26T11:13:35.579 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-26T11:13:35.579 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-26T11:13:35.579 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-26T11:13:35.579 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_misplaced": "false", 2024-04-26T11:13:35.579 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-26T11:13:35.579 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_older_version": "true", 2024-04-26T11:13:35.579 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-26T11:13:35.579 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-26T11:13:35.579 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-26T11:13:35.579 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-26T11:13:35.579 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-26T11:13:35.579 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-26T11:13:35.579 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-26T11:13:35.580 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-26T11:13:35.580 INFO:teuthology.orchestra.run.smithi029.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-26T11:13:35.580 INFO:teuthology.orchestra.run.smithi029.stdout: "monmap": "", 2024-04-26T11:13:35.580 INFO:teuthology.orchestra.run.smithi029.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T11:13:35.580 INFO:teuthology.orchestra.run.smithi029.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-26T11:13:35.580 INFO:teuthology.orchestra.run.smithi029.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-26T11:13:35.580 INFO:teuthology.orchestra.run.smithi029.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T11:13:35.580 INFO:teuthology.orchestra.run.smithi029.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-26T11:13:35.580 INFO:teuthology.orchestra.run.smithi029.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-26T11:13:35.580 INFO:teuthology.orchestra.run.smithi029.stdout: "motr_tracing_enabled": "false", 2024-04-26T11:13:35.580 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_op_threads": "3", 2024-04-26T11:13:35.580 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-26T11:13:35.580 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_cm": "false", 2024-04-26T11:13:35.580 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_device_name": "", 2024-04-26T11:13:35.580 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_dscp": "96", 2024-04-26T11:13:35.581 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-26T11:13:35.581 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-26T11:13:35.581 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_local_gid": "", 2024-04-26T11:13:35.581 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-26T11:13:35.581 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_port_num": "1", 2024-04-26T11:13:35.581 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-26T11:13:35.581 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-26T11:13:35.581 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-26T11:13:35.581 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-26T11:13:35.581 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_sl": "3", 2024-04-26T11:13:35.581 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_support_srq": "true", 2024-04-26T11:13:35.581 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_rdma_type": "ib", 2024-04-26T11:13:35.581 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_async_reap_threshold": "5", 2024-04-26T11:13:35.581 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_bind_before_connect": "false", 2024-04-26T11:13:35.582 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_bind_ipv4": "true", 2024-04-26T11:13:35.582 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_bind_ipv6": "false", 2024-04-26T11:13:35.582 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_bind_msgr1": "true", 2024-04-26T11:13:35.582 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_bind_msgr2": "true", 2024-04-26T11:13:35.582 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_bind_port_max": "7568", 2024-04-26T11:13:35.582 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_bind_port_min": "6800", 2024-04-26T11:13:35.582 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-26T11:13:35.582 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_bind_retry_count": "3", 2024-04-26T11:13:35.582 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_bind_retry_delay": "5", 2024-04-26T11:13:35.582 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_blackhole_client": "false", 2024-04-26T11:13:35.582 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_blackhole_mds": "false", 2024-04-26T11:13:35.582 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_blackhole_mgr": "false", 2024-04-26T11:13:35.582 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_blackhole_mon": "false", 2024-04-26T11:13:35.582 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_blackhole_osd": "false", 2024-04-26T11:13:35.582 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_client_mode": "crc secure", 2024-04-26T11:13:35.583 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_cluster_mode": "crc secure", 2024-04-26T11:13:35.583 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_cluster_type": "", 2024-04-26T11:13:35.583 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_compress_secure": "false", 2024-04-26T11:13:35.583 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_connection_idle_timeout": "900", 2024-04-26T11:13:35.583 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_connection_ready_timeout": "10", 2024-04-26T11:13:35.583 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_crc_data": "true", 2024-04-26T11:13:35.583 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_crc_header": "true", 2024-04-26T11:13:35.583 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_die_on_bad_msg": "false", 2024-04-26T11:13:35.583 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_die_on_bug": "true", 2024-04-26T11:13:35.583 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_die_on_old_message": "true", 2024-04-26T11:13:35.583 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_die_on_skipped_message": "false", 2024-04-26T11:13:35.583 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-26T11:13:35.583 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-26T11:13:35.583 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_coremask": "0xF", 2024-04-26T11:13:35.583 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-26T11:13:35.584 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-26T11:13:35.584 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_enable_tso": "true", 2024-04-26T11:13:35.584 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-26T11:13:35.584 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-26T11:13:35.584 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_hugepages": "", 2024-04-26T11:13:35.584 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-26T11:13:35.584 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-26T11:13:35.584 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_lro": "true", 2024-04-26T11:13:35.584 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_memory_channel": "4", 2024-04-26T11:13:35.584 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-26T11:13:35.584 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_pmd": "", 2024-04-26T11:13:35.584 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_port_id": "0", 2024-04-26T11:13:35.584 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-26T11:13:35.584 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-26T11:13:35.584 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_dump_on_send": "false", 2024-04-26T11:13:35.585 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_initial_backoff": "0.200000", 2024-04-26T11:13:35.585 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_inject_delay_max": "1.000000", 2024-04-26T11:13:35.585 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-26T11:13:35.585 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_inject_delay_type": "", 2024-04-26T11:13:35.585 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-26T11:13:35.585 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_inject_network_congestion": "0", 2024-04-26T11:13:35.585 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_inject_socket_failures": "0", 2024-04-26T11:13:35.585 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_learn_addr_from_peer": "true", 2024-04-26T11:13:35.585 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_max_accept_failures": "4", 2024-04-26T11:13:35.585 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_max_backoff": "15.000000", 2024-04-26T11:13:35.585 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_mon_client_mode": "secure crc", 2024-04-26T11:13:35.585 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-26T11:13:35.585 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_mon_service_mode": "secure crc", 2024-04-26T11:13:35.585 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_osd_compress_min_size": "1024", 2024-04-26T11:13:35.585 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_osd_compress_mode": "none", 2024-04-26T11:13:35.586 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-26T11:13:35.586 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-26T11:13:35.586 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_pq_min_cost": "65536", 2024-04-26T11:13:35.586 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_public_type": "", 2024-04-26T11:13:35.586 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_service_mode": "crc secure", 2024-04-26T11:13:35.586 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_tcp_listen_backlog": "512", 2024-04-26T11:13:35.586 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_tcp_nodelay": "true", 2024-04-26T11:13:35.586 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-26T11:13:35.586 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_tcp_rcvbuf": "0", 2024-04-26T11:13:35.586 INFO:teuthology.orchestra.run.smithi029.stdout: "ms_type": "async+posix", 2024-04-26T11:13:35.586 INFO:teuthology.orchestra.run.smithi029.stdout: "no_config_file": "false", 2024-04-26T11:13:35.586 INFO:teuthology.orchestra.run.smithi029.stdout: "objecter_completion_locks_per_session": "32", 2024-04-26T11:13:35.586 INFO:teuthology.orchestra.run.smithi029.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-26T11:13:35.586 INFO:teuthology.orchestra.run.smithi029.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-26T11:13:35.587 INFO:teuthology.orchestra.run.smithi029.stdout: "objecter_inflight_ops": "1024", 2024-04-26T11:13:35.587 INFO:teuthology.orchestra.run.smithi029.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-26T11:13:35.587 INFO:teuthology.orchestra.run.smithi029.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-26T11:13:35.587 INFO:teuthology.orchestra.run.smithi029.stdout: "objecter_tick_interval": "5.000000", 2024-04-26T11:13:35.587 INFO:teuthology.orchestra.run.smithi029.stdout: "objecter_timeout": "10.000000", 2024-04-26T11:13:35.587 INFO:teuthology.orchestra.run.smithi029.stdout: "objectstore_blackhole": "false", 2024-04-26T11:13:35.587 INFO:teuthology.orchestra.run.smithi029.stdout: "openssl_engine_opts": "", 2024-04-26T11:13:35.587 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_agent_delay_time": "5.000000", 2024-04-26T11:13:35.587 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_agent_hist_halflife": "1000", 2024-04-26T11:13:35.587 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_agent_max_low_ops": "2", 2024-04-26T11:13:35.587 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_agent_max_ops": "4", 2024-04-26T11:13:35.587 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-26T11:13:35.587 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-26T11:13:35.587 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_agent_slop": "0.020000", 2024-04-26T11:13:35.587 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-26T11:13:35.588 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-26T11:13:35.588 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_asio_thread_count": "2", 2024-04-26T11:13:35.588 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_async_recovery_min_cost": "100", 2024-04-26T11:13:35.588 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-26T11:13:35.588 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-26T11:13:35.588 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_backfill_scan_max": "512", 2024-04-26T11:13:35.588 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_backfill_scan_min": "64", 2024-04-26T11:13:35.588 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_backoff_on_degraded": "false", 2024-04-26T11:13:35.588 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_backoff_on_peering": "false", 2024-04-26T11:13:35.588 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_backoff_on_unfound": "true", 2024-04-26T11:13:35.588 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_beacon_report_interval": "300", 2024-04-26T11:13:35.588 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_bench_duration": "30", 2024-04-26T11:13:35.588 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-26T11:13:35.588 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_bench_max_block_size": "67108864", 2024-04-26T11:13:35.588 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-26T11:13:35.588 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_blkin_trace_all": "false", 2024-04-26T11:13:35.589 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-26T11:13:35.589 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-26T11:13:35.589 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-26T11:13:35.589 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-26T11:13:35.589 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_check_for_log_corruption": "false", 2024-04-26T11:13:35.589 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-26T11:13:35.589 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T11:13:35.589 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-04-26T11:13:35.589 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T11:13:35.589 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_class_update_on_start": "true", 2024-04-26T11:13:35.589 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_client_message_cap": "256", 2024-04-26T11:13:35.589 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_client_message_size_cap": "524288000", 2024-04-26T11:13:35.589 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_client_op_priority": "63", 2024-04-26T11:13:35.589 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_client_watch_timeout": "30", 2024-04-26T11:13:35.589 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_command_max_records": "256", 2024-04-26T11:13:35.590 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_compact_on_start": "false", 2024-04-26T11:13:35.590 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-26T11:13:35.590 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-26T11:13:35.590 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-26T11:13:35.590 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_crush_update_on_start": "true", 2024-04-26T11:13:35.590 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_crush_update_weight_set": "true", 2024-04-26T11:13:35.590 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-26T11:13:35.590 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-26T11:13:35.590 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-26T11:13:35.590 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-26T11:13:35.590 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-26T11:13:35.590 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_feed_pullee": "-1", 2024-04-26T11:13:35.590 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-26T11:13:35.590 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-26T11:13:35.590 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-26T11:13:35.591 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_misdirected_ops": "false", 2024-04-26T11:13:35.591 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_no_acting_change": "false", 2024-04-26T11:13:35.591 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_no_purge_strays": "false", 2024-04-26T11:13:35.591 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_op_order": "false", 2024-04-26T11:13:35.591 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-26T11:13:35.591 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-26T11:13:35.591 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-26T11:13:35.591 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-26T11:13:35.591 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_shutdown": "false", 2024-04-26T11:13:35.591 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-26T11:13:35.591 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-26T11:13:35.591 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-26T11:13:35.591 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-26T11:13:35.591 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_verify_snaps": "false", 2024-04-26T11:13:35.592 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-26T11:13:35.592 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-26T11:13:35.592 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_deep_scrub_keys": "1024", 2024-04-26T11:13:35.592 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-26T11:13:35.592 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-26T11:13:35.592 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-26T11:13:35.592 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_deep_scrub_stride": "524288", 2024-04-26T11:13:35.592 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-26T11:13:35.592 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-26T11:13:35.592 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_default_notify_timeout": "30", 2024-04-26T11:13:35.592 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_delete_sleep": "0.000000", 2024-04-26T11:13:35.592 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-26T11:13:35.592 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-26T11:13:35.592 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-26T11:13:35.592 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_discard_disconnected_ops": "true", 2024-04-26T11:13:35.593 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_enable_op_tracker": "true", 2024-04-26T11:13:35.593 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-26T11:13:35.593 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-26T11:13:35.593 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-26T11:13:35.593 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-26T11:13:35.593 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_fast_info": "true", 2024-04-26T11:13:35.593 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_fast_shutdown": "true", 2024-04-26T11:13:35.593 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-26T11:13:35.593 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-26T11:13:35.593 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-26T11:13:35.593 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-26T11:13:35.593 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-26T11:13:35.593 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_function_tracing": "false", 2024-04-26T11:13:35.593 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_heartbeat_grace": "20", 2024-04-26T11:13:35.593 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_heartbeat_interval": "6", 2024-04-26T11:13:35.594 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-26T11:13:35.594 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_heartbeat_min_peers": "10", 2024-04-26T11:13:35.594 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_heartbeat_min_size": "2000", 2024-04-26T11:13:35.594 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_heartbeat_stale": "600", 2024-04-26T11:13:35.594 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-26T11:13:35.594 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_hit_set_max_size": "100000", 2024-04-26T11:13:35.594 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_hit_set_min_size": "1000", 2024-04-26T11:13:35.594 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-26T11:13:35.594 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-26T11:13:35.594 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-26T11:13:35.594 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-26T11:13:35.594 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-26T11:13:35.594 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-26T11:13:35.594 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_journal_size": "5120", 2024-04-26T11:13:35.594 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_kill_backfill_at": "0", 2024-04-26T11:13:35.595 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-26T11:13:35.595 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_map_cache_size": "50", 2024-04-26T11:13:35.595 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_map_dedup": "true", 2024-04-26T11:13:35.595 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_map_message_max": "40", 2024-04-26T11:13:35.595 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-26T11:13:35.595 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_map_share_max_epochs": "40", 2024-04-26T11:13:35.595 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_attr_name_len": "100", 2024-04-26T11:13:35.595 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_attr_size": "0", 2024-04-26T11:13:35.595 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_backfills": "1", 2024-04-26T11:13:35.595 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_markdown_count": "5", 2024-04-26T11:13:35.595 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_markdown_period": "600", 2024-04-26T11:13:35.595 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_object_name_len": "2048", 2024-04-26T11:13:35.595 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_object_namespace_len": "256", 2024-04-26T11:13:35.595 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_object_size": "134217728", 2024-04-26T11:13:35.595 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-26T11:13:35.596 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-26T11:13:35.596 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_pg_blocked_by": "16", 2024-04-26T11:13:35.596 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_pg_log_entries": "10000", 2024-04-26T11:13:35.596 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-26T11:13:35.596 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_pgls": "1024", 2024-04-26T11:13:35.596 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_push_cost": "8388608", 2024-04-26T11:13:35.596 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_push_objects": "10", 2024-04-26T11:13:35.596 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_scrubs": "3", 2024-04-26T11:13:35.596 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-26T11:13:35.596 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_trimming_pgs": "2", 2024-04-26T11:13:35.596 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_write_op_reply_len": "64", 2024-04-26T11:13:35.596 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_max_write_size": "90", 2024-04-26T11:13:35.596 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-26T11:13:35.596 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-26T11:13:35.596 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-26T11:13:35.597 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-26T11:13:35.597 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-26T11:13:35.597 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-26T11:13:35.597 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-26T11:13:35.597 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-26T11:13:35.597 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_profile": "balanced", 2024-04-26T11:13:35.597 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-26T11:13:35.597 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-26T11:13:35.597 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-26T11:13:35.597 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-26T11:13:35.597 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-26T11:13:35.597 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-26T11:13:35.597 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-26T11:13:35.597 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-26T11:13:35.597 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-26T11:13:35.598 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-26T11:13:35.598 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-26T11:13:35.598 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_memory_base": "805306368", 2024-04-26T11:13:35.598 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_memory_cache_min": "134217728", 2024-04-26T11:13:35.598 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-26T11:13:35.598 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-26T11:13:35.598 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_memory_target": "4294967296", 2024-04-26T11:13:35.598 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_memory_target_autotune": "false", 2024-04-26T11:13:35.598 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-26T11:13:35.598 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_min_pg_log_entries": "250", 2024-04-26T11:13:35.598 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_min_recovery_priority": "0", 2024-04-26T11:13:35.598 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-26T11:13:35.598 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-26T11:13:35.598 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mon_report_interval": "5", 2024-04-26T11:13:35.598 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-26T11:13:35.599 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-26T11:13:35.599 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_num_cache_shards": "32", 2024-04-26T11:13:35.599 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_num_op_tracker_shard": "32", 2024-04-26T11:13:35.599 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_numa_auto_affinity": "true", 2024-04-26T11:13:35.599 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_numa_node": "-1", 2024-04-26T11:13:35.599 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_numa_prefer_iface": "true", 2024-04-26T11:13:35.599 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-26T11:13:35.599 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_objecter_finishers": "1", 2024-04-26T11:13:35.599 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_objectstore": "bluestore", 2024-04-26T11:13:35.599 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_objectstore_fuse": "false", 2024-04-26T11:13:35.599 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_objectstore_tracing": "false", 2024-04-26T11:13:35.599 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_complaint_time": "30.000000", 2024-04-26T11:13:35.599 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_history_duration": "600", 2024-04-26T11:13:35.599 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_history_size": "20", 2024-04-26T11:13:35.599 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_history_slow_op_size": "20", 2024-04-26T11:13:35.600 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-26T11:13:35.600 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_log_threshold": "5", 2024-04-26T11:13:35.600 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_num_shards": "0", 2024-04-26T11:13:35.600 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_num_shards_hdd": "5", 2024-04-26T11:13:35.600 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_num_shards_ssd": "8", 2024-04-26T11:13:35.600 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-26T11:13:35.600 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-26T11:13:35.600 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-26T11:13:35.600 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-26T11:13:35.600 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_pq_min_cost": "65536", 2024-04-26T11:13:35.600 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-26T11:13:35.600 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_queue_cut_off": "high", 2024-04-26T11:13:35.600 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-26T11:13:35.600 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_op_thread_timeout": "15", 2024-04-26T11:13:35.600 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_open_classes_on_start": "true", 2024-04-26T11:13:35.601 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_os_flags": "0", 2024-04-26T11:13:35.601 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_peering_op_priority": "255", 2024-04-26T11:13:35.601 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pg_delete_cost": "1048576", 2024-04-26T11:13:35.601 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pg_delete_priority": "5", 2024-04-26T11:13:35.601 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-26T11:13:35.601 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-26T11:13:35.601 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-26T11:13:35.601 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pg_log_trim_max": "10000", 2024-04-26T11:13:35.601 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pg_log_trim_min": "100", 2024-04-26T11:13:35.601 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-26T11:13:35.601 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-26T11:13:35.601 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pg_stat_report_interval_max": "500", 2024-04-26T11:13:35.601 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-26T11:13:35.601 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-26T11:13:35.601 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-26T11:13:35.602 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-26T11:13:35.602 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-26T11:13:35.602 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-26T11:13:35.602 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_crimson": "false", 2024-04-26T11:13:35.602 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-26T11:13:35.602 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-26T11:13:35.602 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-26T11:13:35.602 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-26T11:13:35.602 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-26T11:13:35.602 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-26T11:13:35.602 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-26T11:13:35.602 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-26T11:13:35.602 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_flags": "0", 2024-04-26T11:13:35.602 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-26T11:13:35.602 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_min_size": "0", 2024-04-26T11:13:35.603 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-26T11:13:35.603 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_pg_num": "32", 2024-04-26T11:13:35.603 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_pgp_num": "0", 2024-04-26T11:13:35.603 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-26T11:13:35.603 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_size": "2", 2024-04-26T11:13:35.603 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_default_type": "replicated", 2024-04-26T11:13:35.603 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-26T11:13:35.603 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-26T11:13:35.603 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_push_per_object_cost": "1000", 2024-04-26T11:13:35.603 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-26T11:13:35.603 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recover_clone_overlap": "true", 2024-04-26T11:13:35.603 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-26T11:13:35.603 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_cost": "20971520", 2024-04-26T11:13:35.603 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-26T11:13:35.603 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_max_active": "0", 2024-04-26T11:13:35.604 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-26T11:13:35.604 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-26T11:13:35.604 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-26T11:13:35.604 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-26T11:13:35.604 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_max_single_start": "1", 2024-04-26T11:13:35.604 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_op_priority": "3", 2024-04-26T11:13:35.604 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-26T11:13:35.604 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_priority": "5", 2024-04-26T11:13:35.604 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-26T11:13:35.604 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_sleep": "0.000000", 2024-04-26T11:13:35.604 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-26T11:13:35.604 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-26T11:13:35.604 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-26T11:13:35.604 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_repair_during_recovery": "false", 2024-04-26T11:13:35.605 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_requested_scrub_priority": "120", 2024-04-26T11:13:35.605 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-26T11:13:35.605 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-26T11:13:35.605 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_auto_repair": "false", 2024-04-26T11:13:35.605 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-26T11:13:35.605 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-26T11:13:35.605 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_begin_hour": "0", 2024-04-26T11:13:35.605 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_begin_week_day": "0", 2024-04-26T11:13:35.605 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_chunk_max": "25", 2024-04-26T11:13:35.605 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_chunk_min": "5", 2024-04-26T11:13:35.605 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_cost": "52428800", 2024-04-26T11:13:35.605 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_during_recovery": "false", 2024-04-26T11:13:35.605 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_end_hour": "0", 2024-04-26T11:13:35.605 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_end_week_day": "0", 2024-04-26T11:13:35.606 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_event_cost": "4096", 2024-04-26T11:13:35.606 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-26T11:13:35.606 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-26T11:13:35.606 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_invalid_stats": "true", 2024-04-26T11:13:35.606 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-26T11:13:35.606 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-26T11:13:35.606 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_max_preemptions": "5", 2024-04-26T11:13:35.606 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-26T11:13:35.606 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_priority": "5", 2024-04-26T11:13:35.606 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_reservation_timeout": "5000", 2024-04-26T11:13:35.606 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_sleep": "0.000000", 2024-04-26T11:13:35.606 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_scrub_slow_reservation_response": "2200", 2024-04-26T11:13:35.606 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-26T11:13:35.606 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-26T11:13:35.606 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-26T11:13:35.607 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_skip_data_digest": "false", 2024-04-26T11:13:35.607 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_smart_report_timeout": "5", 2024-04-26T11:13:35.607 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_snap_trim_cost": "1048576", 2024-04-26T11:13:35.607 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_snap_trim_priority": "5", 2024-04-26T11:13:35.607 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-26T11:13:35.607 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-26T11:13:35.607 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-26T11:13:35.607 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-26T11:13:35.607 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-26T11:13:35.607 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-26T11:13:35.607 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-26T11:13:35.607 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_target_transaction_size": "30", 2024-04-26T11:13:35.607 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-26T11:13:35.607 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-26T11:13:35.608 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-26T11:13:35.608 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-26T11:13:35.608 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-26T11:13:35.608 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-26T11:13:35.608 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-26T11:13:35.608 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-26T11:13:35.608 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-26T11:13:35.608 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-26T11:13:35.608 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_tracing": "false", 2024-04-26T11:13:35.608 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_use_stale_snap": "false", 2024-04-26T11:13:35.608 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-26T11:13:35.608 INFO:teuthology.orchestra.run.smithi029.stdout: "osdc_blkin_trace_all": "false", 2024-04-26T11:13:35.608 INFO:teuthology.orchestra.run.smithi029.stdout: "paxos_kill_at": "0", 2024-04-26T11:13:35.608 INFO:teuthology.orchestra.run.smithi029.stdout: "paxos_max_join_drift": "10", 2024-04-26T11:13:35.608 INFO:teuthology.orchestra.run.smithi029.stdout: "paxos_min": "500", 2024-04-26T11:13:35.609 INFO:teuthology.orchestra.run.smithi029.stdout: "paxos_min_wait": "0.050000", 2024-04-26T11:13:35.609 INFO:teuthology.orchestra.run.smithi029.stdout: "paxos_propose_interval": "1.000000", 2024-04-26T11:13:35.609 INFO:teuthology.orchestra.run.smithi029.stdout: "paxos_service_trim_max": "500", 2024-04-26T11:13:35.609 INFO:teuthology.orchestra.run.smithi029.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-26T11:13:35.609 INFO:teuthology.orchestra.run.smithi029.stdout: "paxos_service_trim_min": "250", 2024-04-26T11:13:35.609 INFO:teuthology.orchestra.run.smithi029.stdout: "paxos_stash_full_interval": "25", 2024-04-26T11:13:35.609 INFO:teuthology.orchestra.run.smithi029.stdout: "paxos_trim_max": "500", 2024-04-26T11:13:35.609 INFO:teuthology.orchestra.run.smithi029.stdout: "paxos_trim_min": "250", 2024-04-26T11:13:35.609 INFO:teuthology.orchestra.run.smithi029.stdout: "perf": "true", 2024-04-26T11:13:35.609 INFO:teuthology.orchestra.run.smithi029.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-26T11:13:35.609 INFO:teuthology.orchestra.run.smithi029.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-26T11:13:35.609 INFO:teuthology.orchestra.run.smithi029.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-04-26T11:13:35.609 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "-", 2024-04-26T11:13:35.609 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrv": "", 2024-04-26T11:13:35.610 INFO:teuthology.orchestra.run.smithi029.stdout: "public_bind_addr": "-", 2024-04-26T11:13:35.610 INFO:teuthology.orchestra.run.smithi029.stdout: "public_network": "", 2024-04-26T11:13:35.610 INFO:teuthology.orchestra.run.smithi029.stdout: "public_network_interface": "", 2024-04-26T11:13:35.610 INFO:teuthology.orchestra.run.smithi029.stdout: "qat_compressor_enabled": "false", 2024-04-26T11:13:35.610 INFO:teuthology.orchestra.run.smithi029.stdout: "qat_compressor_session_max_number": "256", 2024-04-26T11:13:35.610 INFO:teuthology.orchestra.run.smithi029.stdout: "rados_mon_op_timeout": "0", 2024-04-26T11:13:35.610 INFO:teuthology.orchestra.run.smithi029.stdout: "rados_osd_op_timeout": "0", 2024-04-26T11:13:35.610 INFO:teuthology.orchestra.run.smithi029.stdout: "rados_tracing": "false", 2024-04-26T11:13:35.610 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_atime_update_interval": "60", 2024-04-26T11:13:35.610 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-26T11:13:35.610 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_balance_parent_reads": "false", 2024-04-26T11:13:35.610 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_balance_snap_reads": "false", 2024-04-26T11:13:35.610 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_blkin_trace_all": "false", 2024-04-26T11:13:35.610 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-26T11:13:35.610 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-26T11:13:35.611 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_cache": "true", 2024-04-26T11:13:35.611 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-26T11:13:35.611 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-26T11:13:35.611 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-26T11:13:35.611 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-26T11:13:35.611 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_cache_policy": "writearound", 2024-04-26T11:13:35.611 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_cache_size": "33554432", 2024-04-26T11:13:35.611 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-26T11:13:35.611 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-26T11:13:35.611 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_clone_copy_on_read": "false", 2024-04-26T11:13:35.611 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_compression_hint": "none", 2024-04-26T11:13:35.611 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_concurrent_management_ops": "10", 2024-04-26T11:13:35.611 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-26T11:13:35.611 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_default_clone_format": "auto", 2024-04-26T11:13:35.612 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_default_data_pool": "", 2024-04-26T11:13:35.612 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_default_features": "61", 2024-04-26T11:13:35.612 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_default_format": "2", 2024-04-26T11:13:35.612 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_default_map_options": "", 2024-04-26T11:13:35.612 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_default_order": "22", 2024-04-26T11:13:35.612 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_default_pool": "rbd", 2024-04-26T11:13:35.612 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-26T11:13:35.612 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_default_stripe_count": "0", 2024-04-26T11:13:35.612 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_default_stripe_unit": "0", 2024-04-26T11:13:35.612 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-26T11:13:35.612 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-26T11:13:35.612 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-26T11:13:35.612 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_enable_alloc_hint": "true", 2024-04-26T11:13:35.612 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-26T11:13:35.612 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_io_scheduler": "simple", 2024-04-26T11:13:35.613 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-26T11:13:35.613 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-26T11:13:35.613 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-26T11:13:35.613 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-26T11:13:35.613 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-26T11:13:35.613 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-26T11:13:35.613 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-26T11:13:35.613 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-26T11:13:35.613 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-26T11:13:35.613 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_journal_order": "24", 2024-04-26T11:13:35.613 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_journal_pool": "", 2024-04-26T11:13:35.613 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_journal_splay_width": "4", 2024-04-26T11:13:35.613 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_localize_parent_reads": "false", 2024-04-26T11:13:35.613 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_localize_snap_reads": "false", 2024-04-26T11:13:35.613 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-26T11:13:35.614 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-26T11:13:35.614 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-26T11:13:35.614 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-26T11:13:35.614 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-26T11:13:35.614 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-26T11:13:35.614 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-26T11:13:35.614 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-26T11:13:35.614 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-26T11:13:35.614 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-26T11:13:35.614 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-26T11:13:35.614 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-26T11:13:35.614 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-26T11:13:35.614 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-26T11:13:35.614 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-26T11:13:35.614 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-26T11:13:35.615 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-26T11:13:35.615 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-26T11:13:35.615 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-26T11:13:35.615 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-26T11:13:35.615 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-26T11:13:35.615 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-26T11:13:35.615 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-26T11:13:35.615 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-26T11:13:35.615 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-26T11:13:35.615 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-26T11:13:35.615 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-26T11:13:35.615 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-26T11:13:35.615 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-26T11:13:35.615 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-26T11:13:35.615 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-26T11:13:35.616 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_mtime_update_interval": "60", 2024-04-26T11:13:35.616 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_non_blocking_aio": "true", 2024-04-26T11:13:35.616 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_op_thread_timeout": "60", 2024-04-26T11:13:35.616 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_op_threads": "1", 2024-04-26T11:13:35.616 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_parent_cache_enabled": "false", 2024-04-26T11:13:35.616 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-26T11:13:35.616 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-26T11:13:35.616 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-26T11:13:35.616 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_plugins": "", 2024-04-26T11:13:35.616 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_bps_burst": "0", 2024-04-26T11:13:35.616 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-26T11:13:35.616 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_bps_limit": "0", 2024-04-26T11:13:35.616 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_exclude_ops": "0", 2024-04-26T11:13:35.616 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_iops_burst": "0", 2024-04-26T11:13:35.616 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-26T11:13:35.617 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_iops_limit": "0", 2024-04-26T11:13:35.617 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-26T11:13:35.617 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-26T11:13:35.617 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-26T11:13:35.617 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-26T11:13:35.617 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-26T11:13:35.617 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-26T11:13:35.617 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-26T11:13:35.617 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-26T11:13:35.617 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-26T11:13:35.617 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-26T11:13:35.617 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-26T11:13:35.617 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-26T11:13:35.617 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-26T11:13:35.617 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-26T11:13:35.618 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_read_from_replica_policy": "default", 2024-04-26T11:13:35.618 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-26T11:13:35.618 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-26T11:13:35.618 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-26T11:13:35.618 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-26T11:13:35.618 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_skip_partial_discard": "true", 2024-04-26T11:13:35.618 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-26T11:13:35.618 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_tracing": "false", 2024-04-26T11:13:35.618 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_validate_names": "true", 2024-04-26T11:13:35.618 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_validate_pool": "true", 2024-04-26T11:13:35.618 INFO:teuthology.orchestra.run.smithi029.stdout: "restapi_base_url": "", 2024-04-26T11:13:35.618 INFO:teuthology.orchestra.run.smithi029.stdout: "restapi_log_level": "", 2024-04-26T11:13:35.618 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_acl_grants_max_num": "100", 2024-04-26T11:13:35.618 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_admin_entry": "admin", 2024-04-26T11:13:35.619 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-26T11:13:35.619 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_backend_store": "rados", 2024-04-26T11:13:35.619 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_barbican_url": "", 2024-04-26T11:13:35.619 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_beast_enable_async": "true", 2024-04-26T11:13:35.619 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-26T11:13:35.619 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-26T11:13:35.619 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-26T11:13:35.619 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-26T11:13:35.619 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-26T11:13:35.619 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-26T11:13:35.619 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-26T11:13:35.619 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_cache_enabled": "true", 2024-04-26T11:13:35.619 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_cache_expiry_interval": "900", 2024-04-26T11:13:35.619 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_cache_lru_size": "10000", 2024-04-26T11:13:35.619 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_config_store": "rados", 2024-04-26T11:13:35.620 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_content_length_compat": "false", 2024-04-26T11:13:35.620 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_copy_obj_progress": "true", 2024-04-26T11:13:35.620 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-26T11:13:35.620 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_cors_rules_max_num": "100", 2024-04-26T11:13:35.620 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_cross_domain_policy": "", 2024-04-26T11:13:35.620 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-26T11:13:35.620 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_kmip_addr": "", 2024-04-26T11:13:35.620 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-26T11:13:35.620 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-26T11:13:35.620 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-26T11:13:35.620 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-26T11:13:35.620 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_kmip_password": "", 2024-04-26T11:13:35.620 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-26T11:13:35.620 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_kmip_username": "", 2024-04-26T11:13:35.620 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_require_ssl": "true", 2024-04-26T11:13:35.620 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-26T11:13:35.621 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-26T11:13:35.621 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-26T11:13:35.621 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-26T11:13:35.621 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-26T11:13:35.621 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-26T11:13:35.621 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-26T11:13:35.621 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-26T11:13:35.621 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-26T11:13:35.621 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-26T11:13:35.621 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-26T11:13:35.621 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-26T11:13:35.621 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-26T11:13:35.621 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-26T11:13:35.622 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-26T11:13:35.622 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_vault_addr": "", 2024-04-26T11:13:35.622 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_vault_auth": "token", 2024-04-26T11:13:35.622 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_vault_namespace": "", 2024-04-26T11:13:35.622 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_vault_prefix": "", 2024-04-26T11:13:35.622 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-26T11:13:35.622 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-26T11:13:35.622 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-26T11:13:35.622 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-26T11:13:35.622 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_vault_token_file": "", 2024-04-26T11:13:35.622 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-26T11:13:35.622 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_curl_buffersize": "524288", 2024-04-26T11:13:35.622 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-26T11:13:35.622 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_curl_low_speed_time": "300", 2024-04-26T11:13:35.622 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-26T11:13:35.623 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-26T11:13:35.623 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-26T11:13:35.623 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-26T11:13:35.623 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-26T11:13:35.623 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-26T11:13:35.623 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-26T11:13:35.623 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-26T11:13:35.623 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-26T11:13:35.623 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-26T11:13:35.623 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-26T11:13:35.623 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_data_log_changes_size": "1000", 2024-04-26T11:13:35.623 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_data_log_num_shards": "128", 2024-04-26T11:13:35.623 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-26T11:13:35.623 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_data_log_window": "30", 2024-04-26T11:13:35.624 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-26T11:13:35.624 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-26T11:13:35.624 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-26T11:13:35.624 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-26T11:13:35.624 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-26T11:13:35.624 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-26T11:13:35.624 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-26T11:13:35.624 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-26T11:13:35.624 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-26T11:13:35.624 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-26T11:13:35.624 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-26T11:13:35.624 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-26T11:13:35.624 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-26T11:13:35.624 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-26T11:13:35.624 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-26T11:13:35.625 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-26T11:13:35.625 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-26T11:13:35.625 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-26T11:13:35.625 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-26T11:13:35.625 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-26T11:13:35.625 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-26T11:13:35.625 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-26T11:13:35.625 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-26T11:13:35.625 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-26T11:13:35.625 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dns_name": "", 2024-04-26T11:13:35.625 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dns_s3website_name": "", 2024-04-26T11:13:35.625 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_dynamic_resharding": "true", 2024-04-26T11:13:35.625 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-26T11:13:35.625 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_enable_gc_threads": "true", 2024-04-26T11:13:35.625 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_enable_lc_threads": "true", 2024-04-26T11:13:35.626 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_enable_ops_log": "false", 2024-04-26T11:13:35.626 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_enable_quota_threads": "true", 2024-04-26T11:13:35.626 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_enable_static_website": "false", 2024-04-26T11:13:35.626 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_enable_usage_log": "false", 2024-04-26T11:13:35.626 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_enforce_swift_acls": "true", 2024-04-26T11:13:35.626 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_exit_timeout_secs": "120", 2024-04-26T11:13:35.626 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_expose_bucket": "false", 2024-04-26T11:13:35.626 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_extended_http_attrs": "", 2024-04-26T11:13:35.626 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_filter": "none", 2024-04-26T11:13:35.626 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-26T11:13:35.626 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_frontends": "beast port=7480", 2024-04-26T11:13:35.626 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-26T11:13:35.626 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_gc_max_deferred": "50", 2024-04-26T11:13:35.626 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-26T11:13:35.626 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_gc_max_objs": "32", 2024-04-26T11:13:35.627 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-26T11:13:35.627 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-26T11:13:35.627 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-26T11:13:35.627 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-26T11:13:35.627 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_gc_processor_period": "3600", 2024-04-26T11:13:35.627 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-26T11:13:35.627 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-26T11:13:35.627 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-26T11:13:35.627 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-26T11:13:35.627 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_init_timeout": "300", 2024-04-26T11:13:35.627 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-26T11:13:35.627 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-26T11:13:35.627 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-26T11:13:35.627 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-26T11:13:35.627 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_admin_domain": "", 2024-04-26T11:13:35.628 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_admin_password": "", 2024-04-26T11:13:35.628 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_admin_password_path": "", 2024-04-26T11:13:35.628 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_admin_project": "", 2024-04-26T11:13:35.628 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_admin_tenant": "", 2024-04-26T11:13:35.628 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_admin_token": "", 2024-04-26T11:13:35.628 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_admin_token_path": "", 2024-04-26T11:13:35.628 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_admin_user": "", 2024-04-26T11:13:35.628 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_api_version": "2", 2024-04-26T11:13:35.628 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_barbican_domain": "", 2024-04-26T11:13:35.628 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_barbican_password": "", 2024-04-26T11:13:35.628 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_barbican_project": "", 2024-04-26T11:13:35.628 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-26T11:13:35.628 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_barbican_user": "", 2024-04-26T11:13:35.628 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-26T11:13:35.628 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-26T11:13:35.629 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-26T11:13:35.629 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-26T11:13:35.629 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-26T11:13:35.629 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_url": "", 2024-04-26T11:13:35.629 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-26T11:13:35.629 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_lc_debug_interval": "-1", 2024-04-26T11:13:35.629 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_lc_lock_max_time": "90", 2024-04-26T11:13:35.629 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_lc_max_objs": "32", 2024-04-26T11:13:35.629 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_lc_max_rules": "1000", 2024-04-26T11:13:35.629 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_lc_max_worker": "3", 2024-04-26T11:13:35.629 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-26T11:13:35.629 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_lc_thread_delay": "0", 2024-04-26T11:13:35.629 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-26T11:13:35.629 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_ldap_dnattr": "uid", 2024-04-26T11:13:35.629 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-26T11:13:35.630 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_ldap_searchfilter": "", 2024-04-26T11:13:35.630 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-26T11:13:35.630 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_ldap_uri": "ldaps://", 2024-04-26T11:13:35.630 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-26T11:13:35.630 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-26T11:13:35.630 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-26T11:13:35.630 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_log_http_headers": "", 2024-04-26T11:13:35.630 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-26T11:13:35.630 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-26T11:13:35.630 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_log_object_name_utc": "false", 2024-04-26T11:13:35.630 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-04-26T11:13:35.630 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_attr_name_len": "0", 2024-04-26T11:13:35.630 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_attr_size": "0", 2024-04-26T11:13:35.630 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-26T11:13:35.631 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_chunk_size": "4194304", 2024-04-26T11:13:35.631 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-26T11:13:35.631 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-26T11:13:35.631 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-26T11:13:35.631 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_listing_results": "1000", 2024-04-26T11:13:35.631 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_notify_retries": "10", 2024-04-26T11:13:35.631 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-26T11:13:35.631 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_put_param_size": "1048576", 2024-04-26T11:13:35.631 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_put_size": "5368709120", 2024-04-26T11:13:35.631 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_max_slo_entries": "1000", 2024-04-26T11:13:35.631 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_md_log_max_shards": "64", 2024-04-26T11:13:35.631 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-26T11:13:35.631 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-26T11:13:35.631 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-26T11:13:35.632 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-26T11:13:35.632 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_mp_lock_max_time": "600", 2024-04-26T11:13:35.632 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-26T11:13:35.632 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-26T11:13:35.632 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-26T11:13:35.632 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-26T11:13:35.632 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-26T11:13:35.632 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-26T11:13:35.632 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-26T11:13:35.632 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-26T11:13:35.632 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_max_gc": "300", 2024-04-26T11:13:35.632 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-26T11:13:35.632 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-26T11:13:35.632 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-26T11:13:35.633 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-26T11:13:35.633 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-26T11:13:35.633 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-26T11:13:35.633 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-26T11:13:35.633 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_num_async_rados_threads": "32", 2024-04-26T11:13:35.633 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_num_control_oids": "8", 2024-04-26T11:13:35.633 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_numa_node": "-1", 2024-04-26T11:13:35.633 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-26T11:13:35.633 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-26T11:13:35.633 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_objexp_chunk_size": "100", 2024-04-26T11:13:35.633 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_objexp_gc_interval": "600", 2024-04-26T11:13:35.633 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-26T11:13:35.633 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-26T11:13:35.633 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-26T11:13:35.633 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_op_thread_timeout": "600", 2024-04-26T11:13:35.634 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_op_tracing": "false", 2024-04-26T11:13:35.634 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_opa_token": "", 2024-04-26T11:13:35.634 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_opa_url": "", 2024-04-26T11:13:35.634 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_opa_verify_ssl": "true", 2024-04-26T11:13:35.634 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-26T11:13:35.634 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-26T11:13:35.634 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_ops_log_rados": "false", 2024-04-26T11:13:35.634 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_ops_log_socket_path": "", 2024-04-26T11:13:35.634 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-26T11:13:35.634 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-26T11:13:35.634 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-26T11:13:35.634 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_period_push_interval": "2.000000", 2024-04-26T11:13:35.634 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-26T11:13:35.634 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-26T11:13:35.634 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-26T11:13:35.635 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_print_continue": "true", 2024-04-26T11:13:35.635 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-26T11:13:35.635 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-26T11:13:35.635 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-26T11:13:35.635 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-26T11:13:35.635 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-26T11:13:35.635 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_rados_tracing": "false", 2024-04-26T11:13:35.635 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_realm": "", 2024-04-26T11:13:35.635 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_realm_id": "", 2024-04-26T11:13:35.635 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-26T11:13:35.635 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_region": "", 2024-04-26T11:13:35.635 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-26T11:13:35.635 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-26T11:13:35.635 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-26T11:13:35.635 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-26T11:13:35.636 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_request_uri": "", 2024-04-26T11:13:35.636 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_reshard_batch_size": "64", 2024-04-26T11:13:35.636 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-26T11:13:35.636 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_reshard_max_aio": "128", 2024-04-26T11:13:35.636 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_reshard_num_logs": "16", 2024-04-26T11:13:35.636 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_reshard_thread_interval": "600", 2024-04-26T11:13:35.636 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_resolve_cname": "false", 2024-04-26T11:13:35.636 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-26T11:13:35.636 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_run_sync_thread": "true", 2024-04-26T11:13:35.636 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-26T11:13:35.636 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-26T11:13:35.636 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-26T11:13:35.636 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-26T11:13:35.636 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-26T11:13:35.636 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-26T11:13:35.637 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-26T11:13:35.637 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-26T11:13:35.637 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_scheduler_type": "throttler", 2024-04-26T11:13:35.637 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_script_uri": "", 2024-04-26T11:13:35.637 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_service_provider_name": "", 2024-04-26T11:13:35.637 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-26T11:13:35.637 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sts_client_id": "", 2024-04-26T11:13:35.637 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sts_client_secret": "", 2024-04-26T11:13:35.637 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sts_entry": "sts", 2024-04-26T11:13:35.637 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sts_key": "sts", 2024-04-26T11:13:35.637 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-26T11:13:35.637 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sts_min_session_duration": "900", 2024-04-26T11:13:35.637 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sts_token_introspection_url": "", 2024-04-26T11:13:35.637 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_swift_account_in_url": "false", 2024-04-26T11:13:35.637 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_swift_auth_entry": "auth", 2024-04-26T11:13:35.638 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_swift_auth_url": "", 2024-04-26T11:13:35.638 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_swift_custom_header": "", 2024-04-26T11:13:35.638 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-26T11:13:35.638 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_swift_need_stats": "true", 2024-04-26T11:13:35.638 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_swift_tenant_name": "", 2024-04-26T11:13:35.638 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_swift_token_expiration": "86400", 2024-04-26T11:13:35.638 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_swift_url": "", 2024-04-26T11:13:35.638 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_swift_url_prefix": "swift", 2024-04-26T11:13:35.638 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-26T11:13:35.638 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-26T11:13:35.638 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-26T11:13:35.638 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sync_lease_period": "120", 2024-04-26T11:13:35.638 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-26T11:13:35.638 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-26T11:13:35.639 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-26T11:13:35.639 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-26T11:13:35.639 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-26T11:13:35.639 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-26T11:13:35.639 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-26T11:13:35.639 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-26T11:13:35.639 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-26T11:13:35.639 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_thread_pool_size": "512", 2024-04-26T11:13:35.639 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_torrent_comment": "", 2024-04-26T11:13:35.639 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_torrent_createby": "", 2024-04-26T11:13:35.639 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_torrent_encoding": "", 2024-04-26T11:13:35.639 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_torrent_flag": "false", 2024-04-26T11:13:35.639 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_torrent_origin": "", 2024-04-26T11:13:35.639 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-26T11:13:35.640 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_torrent_tracker": "", 2024-04-26T11:13:35.640 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_trust_forwarded_https": "false", 2024-04-26T11:13:35.640 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-26T11:13:35.640 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-26T11:13:35.640 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_usage_max_shards": "32", 2024-04-26T11:13:35.640 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_usage_max_user_shards": "1", 2024-04-26T11:13:35.640 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_use_opa_authz": "false", 2024-04-26T11:13:35.640 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-26T11:13:35.640 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-26T11:13:35.640 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_user_max_buckets": "1000", 2024-04-26T11:13:35.640 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_user_policies_max_num": "100", 2024-04-26T11:13:35.640 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-26T11:13:35.640 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-26T11:13:35.640 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-26T11:13:35.641 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-26T11:13:35.641 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_user_unique_email": "true", 2024-04-26T11:13:35.641 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_verify_ssl": "true", 2024-04-26T11:13:35.641 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-26T11:13:35.641 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_zone": "", 2024-04-26T11:13:35.641 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_zone_id": "", 2024-04-26T11:13:35.641 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-26T11:13:35.641 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_zonegroup": "", 2024-04-26T11:13:35.641 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_zonegroup_id": "", 2024-04-26T11:13:35.641 INFO:teuthology.orchestra.run.smithi029.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-26T11:13:35.641 INFO:teuthology.orchestra.run.smithi029.stdout: "rgwlc_auto_session_clear": "true", 2024-04-26T11:13:35.641 INFO:teuthology.orchestra.run.smithi029.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-26T11:13:35.641 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_block_size": "4096", 2024-04-26T11:13:35.641 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-26T11:13:35.641 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-26T11:13:35.642 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-26T11:13:35.642 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-26T11:13:35.642 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-26T11:13:35.642 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_cache_size": "536870912", 2024-04-26T11:13:35.642 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-26T11:13:35.642 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-26T11:13:35.642 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-26T11:13:35.642 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-26T11:13:35.642 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-26T11:13:35.642 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-26T11:13:35.642 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-26T11:13:35.642 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-26T11:13:35.642 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_index_type": "binary_search", 2024-04-26T11:13:35.642 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-26T11:13:35.643 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-26T11:13:35.643 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_partition_filters": "false", 2024-04-26T11:13:35.643 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_perf": "false", 2024-04-26T11:13:35.643 INFO:teuthology.orchestra.run.smithi029.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-26T11:13:35.643 INFO:teuthology.orchestra.run.smithi029.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-26T11:13:35.643 INFO:teuthology.orchestra.run.smithi029.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-26T11:13:35.643 INFO:teuthology.orchestra.run.smithi029.stdout: "run_dir": "/var/run/ceph", 2024-04-26T11:13:35.643 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_block_create": "true", 2024-04-26T11:13:35.643 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_cache_lru_size": "67108864", 2024-04-26T11:13:35.643 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-26T11:13:35.643 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_default_max_object_size": "16777216", 2024-04-26T11:13:35.643 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-26T11:13:35.643 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_device_size": "53687091200", 2024-04-26T11:13:35.643 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_journal_batch_capacity": "16", 2024-04-26T11:13:35.643 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-26T11:13:35.644 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-26T11:13:35.644 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-26T11:13:35.644 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_main_device_type": "SSD", 2024-04-26T11:13:35.644 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-26T11:13:35.644 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-26T11:13:35.644 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-26T11:13:35.644 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-26T11:13:35.644 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-26T11:13:35.644 INFO:teuthology.orchestra.run.smithi029.stdout: "seastore_segment_size": "67108864", 2024-04-26T11:13:35.644 INFO:teuthology.orchestra.run.smithi029.stdout: "set_keepcaps": "false", 2024-04-26T11:13:35.644 INFO:teuthology.orchestra.run.smithi029.stdout: "setgroup": "", 2024-04-26T11:13:35.644 INFO:teuthology.orchestra.run.smithi029.stdout: "setuser": "", 2024-04-26T11:13:35.644 INFO:teuthology.orchestra.run.smithi029.stdout: "setuser_match_path": "", 2024-04-26T11:13:35.644 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-26T11:13:35.644 INFO:teuthology.orchestra.run.smithi029.stdout: "thp": "false", 2024-04-26T11:13:35.645 INFO:teuthology.orchestra.run.smithi029.stdout: "threadpool_default_timeout": "60", 2024-04-26T11:13:35.645 INFO:teuthology.orchestra.run.smithi029.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-26T11:13:35.645 INFO:teuthology.orchestra.run.smithi029.stdout: "throttler_perf_counter": "true" 2024-04-26T11:13:35.645 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-26T11:13:35.647 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-26T11:13:35.786 INFO:teuthology.orchestra.run.smithi029.stdout:mon.a: {} 2024-04-26T11:13:35.796 INFO:teuthology.orchestra.run.smithi029.stdout:mon.b: {} 2024-04-26T11:13:35.805 INFO:teuthology.orchestra.run.smithi029.stdout:mon.c: {} 2024-04-26T11:13:35.806 INFO:teuthology.orchestra.run.smithi029.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T11:13:35.807 INFO:teuthology.orchestra.run.smithi029.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T11:13:35.807 INFO:teuthology.orchestra.run.smithi029.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T11:13:35.818 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-04-26T11:13:35.818 INFO:teuthology.run_tasks:Running task radosbench... 2024-04-26T11:13:35.829 INFO:tasks.radosbench:Beginning radosbench... 2024-04-26T11:13:35.829 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-04-26T11:13:35.830 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2024-04-26T11:13:35.830 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-26T11:13:35.830 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T11:13:35.830 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:13:35.831 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-26T11:13:35.831 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T11:13:35.831 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T11:13:35.831 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-26T11:13:35.831 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-26T11:13:35.832 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-26T11:13:35.832 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:13:35.832 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-26T11:13:35.832 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:13:35.833 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-26T11:13:35.833 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:13:35.835 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:35.831+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:35.934 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:35.932+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:35.970 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:13:35.971 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:13:35.971 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:13:35.971 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:13:35.972 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:13:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-26T11:13:35.972 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:13:35.981 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:13:35.994 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:13:36.011 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:13:36.031 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:13:36.032 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:13:36.032 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:13:36.032 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:13:36.034 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:36.032+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:36.108 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:36.108 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:36.117 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:13:36.135 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:36.133+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:36.236 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:36.234+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:36.284 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:36.285 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:36.293 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'unique_pool_0' created 2024-04-26T11:13:36.293 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:13:36.299 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:13:36.306 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-04-26T11:13:36.340 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:36.338+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:36.438 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:36.438 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:36.438 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:36.436+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:36.448 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:13:36.540 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:36.539+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:36.573 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:36.574 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:36.583 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:13:36.641 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:36.639+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:36.709 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:36.709 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:36.719 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:13:36.742 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:36.741+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:36.843 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:36.842+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:36.852 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:36.853 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:36.862 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:13:36.944 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:36.943+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:36.990 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:36.990 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:37.000 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:13:37.085 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:37.084+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:37.145 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:37.144+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:37.166 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:37.166 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:37.176 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:13:37.247 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:37.245+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:37.300 INFO:teuthology.orchestra.run.smithi029.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-04-26T11:13:37.316 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:37.316 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:37.327 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:13:37.347 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:37.347+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:37.449 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:37.447+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:37.493 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:37.493 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:37.502 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:13:37.550 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:37.549+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:37.650 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:37.649+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:37.668 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:37.669 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:37.678 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:13:37.751 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:37.750+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:37.818 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:37.818 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:37.828 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:13:37.852 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:37.850+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:37.952 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:37.950+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:37.954 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:37.954 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:37.964 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:13:38.043 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:13:38.053 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:38.052+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:38.131 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:38.131 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:38.142 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:13:38.188 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:38.187+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:38.207 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:13:38.227 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:13:38.247 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:13:38.248 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:13:38.248 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:13:38.248 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:13:38.254 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:38.253+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:38.277 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:13:38.278 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:13:38.278 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:13:38.278 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:13:38.287 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:13:38.308 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:13:38.315 DEBUG:teuthology.orchestra.run.smithi029:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 60 write' 2024-04-26T11:13:38.355 INFO:teuthology.run_tasks:Running task admin_socket... 2024-04-26T11:13:38.366 DEBUG:tasks.admin_socket:Running admin socket tests on client.0 2024-04-26T11:13:38.366 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -- /home/ubuntu/cephtest/admin_socket_client.0 && while test '!' -e /var/run/ceph/ceph-client.0.asok ; do sleep 1 ; done 2024-04-26T11:13:38.372 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:38.371+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:38.410 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:hints = 1 2024-04-26T11:13:38.410 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 60 seconds or 0 objects 2024-04-26T11:13:38.410 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:Object prefix: benchmark_data_smithi029_44842 2024-04-26T11:13:38.410 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-26T11:13:38.410 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 0 0 0 0 0 0 - 0 2024-04-26T11:13:38.455 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:38.454+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:38.469 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:13:38.469 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:13:38.469 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:13:38.469 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:13:38.469 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:13:38.483 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:13:38.557 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:38.555+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:38.658 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:38.657+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:38.697 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:13:38.697 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:13:38.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:13:38.698 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:13:38.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.698 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4157.0:85 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'55, mlcod=10'50)", 2024-04-26T11:13:38.698 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:08.197697+0000", 2024-04-26T11:13:38.698 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.496249129999999, 2024-04-26T11:13:38.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0071669739999999996, 2024-04-26T11:13:38.698 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:38.698 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:38.698 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:38.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:38.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:08.197697+0000", 2024-04-26T11:13:38.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:38.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:08.197697+0000", 2024-04-26T11:13:38.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:38.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:08.197697+0000", 2024-04-26T11:13:38.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:38.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:38.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:08.197704+0000", 2024-04-26T11:13:38.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3490000000000003e-06 2024-04-26T11:13:38.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:38.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:08.197717+0000", 2024-04-26T11:13:38.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2706e-05 2024-04-26T11:13:38.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:38.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:08.197723+0000", 2024-04-26T11:13:38.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6409999999999996e-06 2024-04-26T11:13:38.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:08.199389+0000", 2024-04-26T11:13:38.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001666128 2024-04-26T11:13:38.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:38.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:08.199415+0000", 2024-04-26T11:13:38.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5154e-05 2024-04-26T11:13:38.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:38.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:08.204833+0000", 2024-04-26T11:13:38.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054186939999999999 2024-04-26T11:13:38.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:38.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:08.204864+0000", 2024-04-26T11:13:38.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1208999999999999e-05 2024-04-26T11:13:38.702 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.702 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:38.702 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.702 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:38.702 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.905682+0000", 2024-04-26T11:13:38.702 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.788264435999999, 2024-04-26T11:13:38.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017168134000000002, 2024-04-26T11:13:38.702 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:38.702 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:38.702 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:38.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:38.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905682+0000", 2024-04-26T11:13:38.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:38.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905682+0000", 2024-04-26T11:13:38.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:38.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905681+0000", 2024-04-26T11:13:38.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:13:38.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:38.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905689+0000", 2024-04-26T11:13:38.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7830000000000004e-06 2024-04-26T11:13:38.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:38.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905703+0000", 2024-04-26T11:13:38.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3322000000000001e-05 2024-04-26T11:13:38.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:38.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905717+0000", 2024-04-26T11:13:38.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4562000000000001e-05 2024-04-26T11:13:38.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906126+0000", 2024-04-26T11:13:38.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040896900000000002 2024-04-26T11:13:38.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:13:38.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906133+0000", 2024-04-26T11:13:38.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6370000000000002e-06 2024-04-26T11:13:38.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.914252+0000", 2024-04-26T11:13:38.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0081192529999999999 2024-04-26T11:13:38.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:38.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.914675+0000", 2024-04-26T11:13:38.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00042322399999999999 2024-04-26T11:13:38.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:38.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915080+0000", 2024-04-26T11:13:38.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040486899999999998 2024-04-26T11:13:38.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:38.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.917940+0000", 2024-04-26T11:13:38.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0028593400000000001 2024-04-26T11:13:38.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:38.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.922776+0000", 2024-04-26T11:13:38.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048359420000000002 2024-04-26T11:13:38.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:38.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.922825+0000", 2024-04-26T11:13:38.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9048999999999997e-05 2024-04-26T11:13:38.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:38.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.922850+0000", 2024-04-26T11:13:38.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5689000000000001e-05 2024-04-26T11:13:38.708 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.708 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:38.708 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.708 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:38.708 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906087+0000", 2024-04-26T11:13:38.708 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.787859138000002, 2024-04-26T11:13:38.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010623062000000001, 2024-04-26T11:13:38.708 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:38.708 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:38.708 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:38.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:38.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906087+0000", 2024-04-26T11:13:38.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:38.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906087+0000", 2024-04-26T11:13:38.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:38.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906087+0000", 2024-04-26T11:13:38.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:38.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:38.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906094+0000", 2024-04-26T11:13:38.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4429999999999997e-06 2024-04-26T11:13:38.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:38.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906105+0000", 2024-04-26T11:13:38.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0737000000000001e-05 2024-04-26T11:13:38.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:38.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906114+0000", 2024-04-26T11:13:38.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2199999999999998e-06 2024-04-26T11:13:38.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906188+0000", 2024-04-26T11:13:38.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3900999999999996e-05 2024-04-26T11:13:38.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:13:38.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906193+0000", 2024-04-26T11:13:38.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1089999999999997e-06 2024-04-26T11:13:38.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.908258+0000", 2024-04-26T11:13:38.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020653680000000002 2024-04-26T11:13:38.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:38.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.909106+0000", 2024-04-26T11:13:38.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084725899999999995 2024-04-26T11:13:38.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:38.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.909461+0000", 2024-04-26T11:13:38.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035572099999999998 2024-04-26T11:13:38.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:38.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.913823+0000", 2024-04-26T11:13:38.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043620830000000001 2024-04-26T11:13:38.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:38.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.916613+0000", 2024-04-26T11:13:38.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027896710000000001 2024-04-26T11:13:38.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:38.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.916665+0000", 2024-04-26T11:13:38.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2403e-05 2024-04-26T11:13:38.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:38.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.916711+0000", 2024-04-26T11:13:38.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5055000000000001e-05 2024-04-26T11:13:38.714 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.714 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:38.714 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.714 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:38.714 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906121+0000", 2024-04-26T11:13:38.714 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.787825613999999, 2024-04-26T11:13:38.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015092059, 2024-04-26T11:13:38.714 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:38.714 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:38.714 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:38.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:38.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906121+0000", 2024-04-26T11:13:38.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:38.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906121+0000", 2024-04-26T11:13:38.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:38.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906121+0000", 2024-04-26T11:13:38.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:38.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:38.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906124+0000", 2024-04-26T11:13:38.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6009999999999999e-06 2024-04-26T11:13:38.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:38.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906130+0000", 2024-04-26T11:13:38.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3010000000000003e-06 2024-04-26T11:13:38.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:38.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906136+0000", 2024-04-26T11:13:38.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1370000000000001e-06 2024-04-26T11:13:38.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906289+0000", 2024-04-26T11:13:38.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000153299 2024-04-26T11:13:38.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:13:38.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906296+0000", 2024-04-26T11:13:38.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9829999999999999e-06 2024-04-26T11:13:38.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.910345+0000", 2024-04-26T11:13:38.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040495510000000002 2024-04-26T11:13:38.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:38.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.910479+0000", 2024-04-26T11:13:38.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013406 2024-04-26T11:13:38.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:38.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.910881+0000", 2024-04-26T11:13:38.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040128800000000002 2024-04-26T11:13:38.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:38.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.913427+0000", 2024-04-26T11:13:38.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025464440000000001 2024-04-26T11:13:38.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:38.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921131+0000", 2024-04-26T11:13:38.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0077034399999999998 2024-04-26T11:13:38.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:38.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921175+0000", 2024-04-26T11:13:38.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4811000000000002e-05 2024-04-26T11:13:38.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:38.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921213+0000", 2024-04-26T11:13:38.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7607000000000001e-05 2024-04-26T11:13:38.720 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.720 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:38.720 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.720 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:26 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:38.720 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906148+0000", 2024-04-26T11:13:38.720 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.787799096000001, 2024-04-26T11:13:38.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017103547, 2024-04-26T11:13:38.720 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:38.720 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:38.720 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:38.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:38.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906148+0000", 2024-04-26T11:13:38.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:38.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906148+0000", 2024-04-26T11:13:38.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:38.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906147+0000", 2024-04-26T11:13:38.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:38.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:38.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906152+0000", 2024-04-26T11:13:38.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2530000000000004e-06 2024-04-26T11:13:38.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:38.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906160+0000", 2024-04-26T11:13:38.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.605e-06 2024-04-26T11:13:38.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:38.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906165+0000", 2024-04-26T11:13:38.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4689999999999996e-06 2024-04-26T11:13:38.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906223+0000", 2024-04-26T11:13:38.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7578999999999999e-05 2024-04-26T11:13:38.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:38.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906228+0000", 2024-04-26T11:13:38.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.485e-06 2024-04-26T11:13:38.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915364+0000", 2024-04-26T11:13:38.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0091359230000000007 2024-04-26T11:13:38.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:38.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915433+0000", 2024-04-26T11:13:38.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8913999999999998e-05 2024-04-26T11:13:38.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:38.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915517+0000", 2024-04-26T11:13:38.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4023000000000005e-05 2024-04-26T11:13:38.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:38.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.918856+0000", 2024-04-26T11:13:38.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0033382469999999999 2024-04-26T11:13:38.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:38.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923141+0000", 2024-04-26T11:13:38.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0042854779999999997 2024-04-26T11:13:38.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:38.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923209+0000", 2024-04-26T11:13:38.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8122999999999998e-05 2024-04-26T11:13:38.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:38.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923251+0000", 2024-04-26T11:13:38.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1919999999999998e-05 2024-04-26T11:13:38.726 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.726 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:38.726 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.726 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:38.726 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906186+0000", 2024-04-26T11:13:38.726 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.787760680000002, 2024-04-26T11:13:38.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015189243999999999, 2024-04-26T11:13:38.726 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:38.726 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:38.726 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:38.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:38.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906186+0000", 2024-04-26T11:13:38.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:38.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906186+0000", 2024-04-26T11:13:38.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:38.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906185+0000", 2024-04-26T11:13:38.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:38.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:38.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906190+0000", 2024-04-26T11:13:38.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7169999999999999e-06 2024-04-26T11:13:38.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:38.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906197+0000", 2024-04-26T11:13:38.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7519999999999999e-06 2024-04-26T11:13:38.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:38.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906206+0000", 2024-04-26T11:13:38.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0790000000000007e-06 2024-04-26T11:13:38.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906254+0000", 2024-04-26T11:13:38.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8248999999999998e-05 2024-04-26T11:13:38.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:38.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906258+0000", 2024-04-26T11:13:38.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1799999999999998e-06 2024-04-26T11:13:38.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.912492+0000", 2024-04-26T11:13:38.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062335560000000003 2024-04-26T11:13:38.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:38.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.912603+0000", 2024-04-26T11:13:38.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111597 2024-04-26T11:13:38.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:38.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.912734+0000", 2024-04-26T11:13:38.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013028700000000001 2024-04-26T11:13:38.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:38.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915693+0000", 2024-04-26T11:13:38.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0029589460000000001 2024-04-26T11:13:38.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:38.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921316+0000", 2024-04-26T11:13:38.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0056232130000000002 2024-04-26T11:13:38.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:38.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921346+0000", 2024-04-26T11:13:38.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0011000000000001e-05 2024-04-26T11:13:38.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:38.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921375+0000", 2024-04-26T11:13:38.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9254000000000001e-05 2024-04-26T11:13:38.732 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.732 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:38.732 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.732 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:38.733 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906220+0000", 2024-04-26T11:13:38.733 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.787726876000001, 2024-04-26T11:13:38.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0151527, 2024-04-26T11:13:38.733 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:38.733 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:38.733 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:38.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:38.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906220+0000", 2024-04-26T11:13:38.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:38.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906220+0000", 2024-04-26T11:13:38.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:38.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906219+0000", 2024-04-26T11:13:38.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:38.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:38.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906233+0000", 2024-04-26T11:13:38.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3848e-05 2024-04-26T11:13:38.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:38.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906241+0000", 2024-04-26T11:13:38.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5979999999999999e-06 2024-04-26T11:13:38.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:38.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906250+0000", 2024-04-26T11:13:38.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1619999999999997e-06 2024-04-26T11:13:38.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906593+0000", 2024-04-26T11:13:38.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00034324900000000001 2024-04-26T11:13:38.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:38.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906598+0000", 2024-04-26T11:13:38.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8729999999999998e-06 2024-04-26T11:13:38.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.911534+0000", 2024-04-26T11:13:38.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049357869999999996 2024-04-26T11:13:38.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:38.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.911637+0000", 2024-04-26T11:13:38.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103071 2024-04-26T11:13:38.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:38.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.911781+0000", 2024-04-26T11:13:38.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000144499 2024-04-26T11:13:38.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:38.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.913870+0000", 2024-04-26T11:13:38.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020884369999999998 2024-04-26T11:13:38.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:38.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921293+0000", 2024-04-26T11:13:38.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0074231810000000001 2024-04-26T11:13:38.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:38.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921328+0000", 2024-04-26T11:13:38.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4606e-05 2024-04-26T11:13:38.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:38.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921372+0000", 2024-04-26T11:13:38.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4909e-05 2024-04-26T11:13:38.741 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.741 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:38.741 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.741 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:38.742 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906402+0000", 2024-04-26T11:13:38.742 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.787545044000002, 2024-04-26T11:13:38.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017555191000000001, 2024-04-26T11:13:38.742 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:38.742 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:38.742 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:38.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:38.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906402+0000", 2024-04-26T11:13:38.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:38.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906402+0000", 2024-04-26T11:13:38.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:38.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906401+0000", 2024-04-26T11:13:38.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:38.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:38.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906407+0000", 2024-04-26T11:13:38.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2689999999999996e-06 2024-04-26T11:13:38.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:38.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906416+0000", 2024-04-26T11:13:38.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5080000000000005e-06 2024-04-26T11:13:38.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:38.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906422+0000", 2024-04-26T11:13:38.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9460000000000003e-06 2024-04-26T11:13:38.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906459+0000", 2024-04-26T11:13:38.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6998000000000001e-05 2024-04-26T11:13:38.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:38.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906463+0000", 2024-04-26T11:13:38.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.374e-06 2024-04-26T11:13:38.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915821+0000", 2024-04-26T11:13:38.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0093578050000000003 2024-04-26T11:13:38.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:38.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.916209+0000", 2024-04-26T11:13:38.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00038876999999999998 2024-04-26T11:13:38.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:38.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.916349+0000", 2024-04-26T11:13:38.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013992900000000001 2024-04-26T11:13:38.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:38.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.920269+0000", 2024-04-26T11:13:38.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003919133 2024-04-26T11:13:38.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:38.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923899+0000", 2024-04-26T11:13:38.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003630716 2024-04-26T11:13:38.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:38.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923932+0000", 2024-04-26T11:13:38.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2471999999999997e-05 2024-04-26T11:13:38.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:38.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923957+0000", 2024-04-26T11:13:38.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5038999999999999e-05 2024-04-26T11:13:38.748 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.748 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:38.748 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.748 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:38.748 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906431+0000", 2024-04-26T11:13:38.748 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.787515933000002, 2024-04-26T11:13:38.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012314960999999999, 2024-04-26T11:13:38.748 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:38.748 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:13:38.748 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:38.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:38.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906431+0000", 2024-04-26T11:13:38.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:38.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906431+0000", 2024-04-26T11:13:38.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:38.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906430+0000", 2024-04-26T11:13:38.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:38.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:38.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906433+0000", 2024-04-26T11:13:38.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689999999999999e-06 2024-04-26T11:13:38.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:38.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906441+0000", 2024-04-26T11:13:38.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.892e-06 2024-04-26T11:13:38.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:38.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906447+0000", 2024-04-26T11:13:38.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6019999999999999e-06 2024-04-26T11:13:38.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906594+0000", 2024-04-26T11:13:38.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014745399999999999 2024-04-26T11:13:38.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:13:38.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906600+0000", 2024-04-26T11:13:38.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6130000000000003e-06 2024-04-26T11:13:38.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.910337+0000", 2024-04-26T11:13:38.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037378229999999999 2024-04-26T11:13:38.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:38.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.910449+0000", 2024-04-26T11:13:38.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011138500000000001 2024-04-26T11:13:38.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:38.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.918746+0000", 2024-04-26T11:13:38.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082967549999999994 2024-04-26T11:13:38.752 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.752 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:38.752 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.753 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:32 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:38.753 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906458+0000", 2024-04-26T11:13:38.753 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.787488814, 2024-04-26T11:13:38.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079107889999999997, 2024-04-26T11:13:38.753 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:38.753 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:13:38.753 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:38.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:38.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906458+0000", 2024-04-26T11:13:38.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:38.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906458+0000", 2024-04-26T11:13:38.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:38.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906457+0000", 2024-04-26T11:13:38.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:38.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:38.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906467+0000", 2024-04-26T11:13:38.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2040000000000003e-06 2024-04-26T11:13:38.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:38.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906474+0000", 2024-04-26T11:13:38.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0600000000000002e-06 2024-04-26T11:13:38.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:38.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906479+0000", 2024-04-26T11:13:38.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1390000000000003e-06 2024-04-26T11:13:38.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.907153+0000", 2024-04-26T11:13:38.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00067468900000000002 2024-04-26T11:13:38.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:38.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.907373+0000", 2024-04-26T11:13:38.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00021952500000000001 2024-04-26T11:13:38.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:38.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.914369+0000", 2024-04-26T11:13:38.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0069956150000000002 2024-04-26T11:13:38.756 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.756 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:38.756 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.757 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:172 5.4 5:296435d4:::benchmark_data_smithi029_44842_object171:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T11:13:38.757 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:38.450738+0000", 2024-04-26T11:13:38.757 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.243208173, 2024-04-26T11:13:38.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0073446199999999996, 2024-04-26T11:13:38.757 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:38.757 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:38.757 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:38.757 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:38.757 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:38.757 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 172 2024-04-26T11:13:38.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.757 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:38.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:38.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.450738+0000", 2024-04-26T11:13:38.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:38.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.450738+0000", 2024-04-26T11:13:38.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:38.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.450738+0000", 2024-04-26T11:13:38.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:38.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:38.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.450798+0000", 2024-04-26T11:13:38.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0044000000000003e-05 2024-04-26T11:13:38.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:38.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.450806+0000", 2024-04-26T11:13:38.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3140000000000004e-06 2024-04-26T11:13:38.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:38.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.450812+0000", 2024-04-26T11:13:38.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5729999999999998e-06 2024-04-26T11:13:38.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.451181+0000", 2024-04-26T11:13:38.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036915 2024-04-26T11:13:38.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:38.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.451305+0000", 2024-04-26T11:13:38.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012421599999999999 2024-04-26T11:13:38.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:38.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.451468+0000", 2024-04-26T11:13:38.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016290099999999999 2024-04-26T11:13:38.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:38.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.453021+0000", 2024-04-26T11:13:38.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001553189 2024-04-26T11:13:38.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:38.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.458007+0000", 2024-04-26T11:13:38.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049861890000000002 2024-04-26T11:13:38.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:38.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.458050+0000", 2024-04-26T11:13:38.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2261000000000001e-05 2024-04-26T11:13:38.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:38.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.458083+0000", 2024-04-26T11:13:38.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3287000000000002e-05 2024-04-26T11:13:38.762 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.762 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:38.762 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.762 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:530 5.8 5:145d8280:::benchmark_data_smithi029_44842_object529:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T11:13:38.762 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:38.529188+0000", 2024-04-26T11:13:38.763 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.16475811100000001, 2024-04-26T11:13:38.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0077130899999999997, 2024-04-26T11:13:38.763 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:38.763 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:38.763 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:38.763 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:38.763 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:38.763 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 530 2024-04-26T11:13:38.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.763 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:38.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:38.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529188+0000", 2024-04-26T11:13:38.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:38.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529188+0000", 2024-04-26T11:13:38.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:38.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529188+0000", 2024-04-26T11:13:38.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:38.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:38.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529286+0000", 2024-04-26T11:13:38.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7950999999999998e-05 2024-04-26T11:13:38.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:38.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529294+0000", 2024-04-26T11:13:38.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7130000000000005e-06 2024-04-26T11:13:38.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:38.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529298+0000", 2024-04-26T11:13:38.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6489999999999999e-06 2024-04-26T11:13:38.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529332+0000", 2024-04-26T11:13:38.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3448000000000002e-05 2024-04-26T11:13:38.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:38.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529450+0000", 2024-04-26T11:13:38.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000118039 2024-04-26T11:13:38.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:38.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529556+0000", 2024-04-26T11:13:38.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106574 2024-04-26T11:13:38.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:38.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.533559+0000", 2024-04-26T11:13:38.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040028060000000002 2024-04-26T11:13:38.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:38.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.536772+0000", 2024-04-26T11:13:38.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0032133769999999999 2024-04-26T11:13:38.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:38.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.536843+0000", 2024-04-26T11:13:38.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1073000000000002e-05 2024-04-26T11:13:38.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:38.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.536902+0000", 2024-04-26T11:13:38.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8100999999999998e-05 2024-04-26T11:13:38.768 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.768 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:38.768 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.768 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:532 5.8 5:1949fe18:::benchmark_data_smithi029_44842_object531:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T11:13:38.768 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:38.529304+0000", 2024-04-26T11:13:38.768 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.16464216300000001, 2024-04-26T11:13:38.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076800230000000002, 2024-04-26T11:13:38.768 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:38.768 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:38.769 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:38.769 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:38.769 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:38.769 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 532 2024-04-26T11:13:38.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.769 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:38.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:38.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529304+0000", 2024-04-26T11:13:38.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:38.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529304+0000", 2024-04-26T11:13:38.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:38.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529304+0000", 2024-04-26T11:13:38.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:38.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:38.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529408+0000", 2024-04-26T11:13:38.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103569 2024-04-26T11:13:38.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:38.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529415+0000", 2024-04-26T11:13:38.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3969999999999997e-06 2024-04-26T11:13:38.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:38.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529421+0000", 2024-04-26T11:13:38.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1759999999999998e-06 2024-04-26T11:13:38.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529894+0000", 2024-04-26T11:13:38.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00047291800000000001 2024-04-26T11:13:38.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:38.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529971+0000", 2024-04-26T11:13:38.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6543000000000002e-05 2024-04-26T11:13:38.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:38.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.530058+0000", 2024-04-26T11:13:38.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7602999999999995e-05 2024-04-26T11:13:38.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:38.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.533562+0000", 2024-04-26T11:13:38.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035036059999999998 2024-04-26T11:13:38.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:38.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.536932+0000", 2024-04-26T11:13:38.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003370166 2024-04-26T11:13:38.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:38.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.536964+0000", 2024-04-26T11:13:38.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2094999999999997e-05 2024-04-26T11:13:38.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:38.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.536984+0000", 2024-04-26T11:13:38.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0429e-05 2024-04-26T11:13:38.773 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.773 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:38.774 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.774 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:538 5.b 5:d21848fb:::benchmark_data_smithi029_44842_object537:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T11:13:38.774 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:38.529686+0000", 2024-04-26T11:13:38.774 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.16426012200000001, 2024-04-26T11:13:38.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076899109999999998, 2024-04-26T11:13:38.774 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:38.774 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:38.774 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:38.774 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:38.774 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:38.774 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 538 2024-04-26T11:13:38.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.775 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:38.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:38.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529686+0000", 2024-04-26T11:13:38.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:38.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529686+0000", 2024-04-26T11:13:38.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:38.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529686+0000", 2024-04-26T11:13:38.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:38.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:38.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529793+0000", 2024-04-26T11:13:38.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107608 2024-04-26T11:13:38.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:38.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529803+0000", 2024-04-26T11:13:38.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8169999999999994e-06 2024-04-26T11:13:38.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:38.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529811+0000", 2024-04-26T11:13:38.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0220000000000004e-06 2024-04-26T11:13:38.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529851+0000", 2024-04-26T11:13:38.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9928999999999997e-05 2024-04-26T11:13:38.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:38.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.529979+0000", 2024-04-26T11:13:38.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012768 2024-04-26T11:13:38.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:38.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.530118+0000", 2024-04-26T11:13:38.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013893600000000001 2024-04-26T11:13:38.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:38.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.531315+0000", 2024-04-26T11:13:38.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011973820000000001 2024-04-26T11:13:38.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:38.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.537307+0000", 2024-04-26T11:13:38.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059920729999999997 2024-04-26T11:13:38.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:38.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.537345+0000", 2024-04-26T11:13:38.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8145000000000002e-05 2024-04-26T11:13:38.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:38.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.537376+0000", 2024-04-26T11:13:38.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1115000000000003e-05 2024-04-26T11:13:38.779 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.779 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:38.779 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.779 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:589 5.b 5:dc8ac169:::benchmark_data_smithi029_44842_object588:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T11:13:38.779 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:38.544315+0000", 2024-04-26T11:13:38.780 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.149632085, 2024-04-26T11:13:38.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00754158, 2024-04-26T11:13:38.780 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:38.780 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:38.780 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:38.780 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:38.780 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:38.780 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 589 2024-04-26T11:13:38.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.780 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:38.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:38.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544315+0000", 2024-04-26T11:13:38.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:38.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544315+0000", 2024-04-26T11:13:38.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:38.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544314+0000", 2024-04-26T11:13:38.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:38.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:38.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544416+0000", 2024-04-26T11:13:38.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102181 2024-04-26T11:13:38.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:38.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544426+0000", 2024-04-26T11:13:38.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3710000000000006e-06 2024-04-26T11:13:38.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:38.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544433+0000", 2024-04-26T11:13:38.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.905e-06 2024-04-26T11:13:38.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544881+0000", 2024-04-26T11:13:38.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000448486 2024-04-26T11:13:38.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:38.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.545016+0000", 2024-04-26T11:13:38.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013542799999999999 2024-04-26T11:13:38.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:38.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.545191+0000", 2024-04-26T11:13:38.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017431599999999999 2024-04-26T11:13:38.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:38.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.546790+0000", 2024-04-26T11:13:38.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001598915 2024-04-26T11:13:38.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:38.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.551782+0000", 2024-04-26T11:13:38.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049925999999999998 2024-04-26T11:13:38.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:38.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.551821+0000", 2024-04-26T11:13:38.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9124e-05 2024-04-26T11:13:38.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:38.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.551856+0000", 2024-04-26T11:13:38.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4721000000000002e-05 2024-04-26T11:13:38.785 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.785 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:38.785 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.785 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:590 5.8 5:154addba:::benchmark_data_smithi029_44842_object589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T11:13:38.785 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:38.544659+0000", 2024-04-26T11:13:38.785 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.149287486, 2024-04-26T11:13:38.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0071725440000000003, 2024-04-26T11:13:38.785 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:38.785 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:38.785 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:38.786 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:38.786 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:38.786 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 590 2024-04-26T11:13:38.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.786 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:38.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:38.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544659+0000", 2024-04-26T11:13:38.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:38.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544659+0000", 2024-04-26T11:13:38.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:38.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544658+0000", 2024-04-26T11:13:38.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:38.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:38.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544682+0000", 2024-04-26T11:13:38.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.376e-05 2024-04-26T11:13:38.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:38.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544690+0000", 2024-04-26T11:13:38.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4599999999999997e-06 2024-04-26T11:13:38.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:38.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544696+0000", 2024-04-26T11:13:38.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.37e-06 2024-04-26T11:13:38.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544751+0000", 2024-04-26T11:13:38.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4651999999999998e-05 2024-04-26T11:13:38.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:38.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544869+0000", 2024-04-26T11:13:38.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011781999999999999 2024-04-26T11:13:38.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:38.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.545015+0000", 2024-04-26T11:13:38.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014659499999999999 2024-04-26T11:13:38.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:38.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.546778+0000", 2024-04-26T11:13:38.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001763115 2024-04-26T11:13:38.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:38.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.551737+0000", 2024-04-26T11:13:38.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004958306 2024-04-26T11:13:38.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:38.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.551791+0000", 2024-04-26T11:13:38.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4536000000000001e-05 2024-04-26T11:13:38.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:38.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.551832+0000", 2024-04-26T11:13:38.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0599999999999998e-05 2024-04-26T11:13:38.791 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.791 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:38.791 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.791 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:592 5.b 5:dfca492b:::benchmark_data_smithi029_44842_object591:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T11:13:38.791 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:38.544711+0000", 2024-04-26T11:13:38.791 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.14923589300000001, 2024-04-26T11:13:38.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0080972820000000008, 2024-04-26T11:13:38.791 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:38.791 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:38.791 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:38.791 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:38.791 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:38.792 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 592 2024-04-26T11:13:38.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.792 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:38.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:38.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544711+0000", 2024-04-26T11:13:38.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:38.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544711+0000", 2024-04-26T11:13:38.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:38.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544710+0000", 2024-04-26T11:13:38.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:38.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:38.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544821+0000", 2024-04-26T11:13:38.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011072499999999999 2024-04-26T11:13:38.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:38.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544829+0000", 2024-04-26T11:13:38.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8679999999999999e-06 2024-04-26T11:13:38.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:38.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544835+0000", 2024-04-26T11:13:38.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2020000000000001e-06 2024-04-26T11:13:38.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.545572+0000", 2024-04-26T11:13:38.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000737639 2024-04-26T11:13:38.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:38.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.545740+0000", 2024-04-26T11:13:38.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000168016 2024-04-26T11:13:38.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:38.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.545927+0000", 2024-04-26T11:13:38.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000186515 2024-04-26T11:13:38.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:38.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.547029+0000", 2024-04-26T11:13:38.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001102142 2024-04-26T11:13:38.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:38.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.552757+0000", 2024-04-26T11:13:38.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057276920000000004 2024-04-26T11:13:38.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:38.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.552784+0000", 2024-04-26T11:13:38.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7246999999999998e-05 2024-04-26T11:13:38.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:38.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.552808+0000", 2024-04-26T11:13:38.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4006e-05 2024-04-26T11:13:38.796 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.796 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:38.796 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.796 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:593 5.e 5:74896a0f:::benchmark_data_smithi029_44842_object592:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T11:13:38.797 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:38.544841+0000", 2024-04-26T11:13:38.797 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.14910572999999999, 2024-04-26T11:13:38.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0073173329999999997, 2024-04-26T11:13:38.797 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:38.797 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:38.797 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:38.797 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:38.797 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:38.797 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 593 2024-04-26T11:13:38.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.797 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:38.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:38.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544841+0000", 2024-04-26T11:13:38.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:38.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544841+0000", 2024-04-26T11:13:38.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:38.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544840+0000", 2024-04-26T11:13:38.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:38.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:38.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544981+0000", 2024-04-26T11:13:38.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014055400000000001 2024-04-26T11:13:38.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:38.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544988+0000", 2024-04-26T11:13:38.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.34e-06 2024-04-26T11:13:38.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:38.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.544994+0000", 2024-04-26T11:13:38.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.015e-06 2024-04-26T11:13:38.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.545093+0000", 2024-04-26T11:13:38.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8751000000000004e-05 2024-04-26T11:13:38.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:38.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.545184+0000", 2024-04-26T11:13:38.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0570999999999997e-05 2024-04-26T11:13:38.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:38.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.545314+0000", 2024-04-26T11:13:38.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013012599999999999 2024-04-26T11:13:38.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:38.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.546877+0000", 2024-04-26T11:13:38.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0015633190000000001 2024-04-26T11:13:38.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:38.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.552082+0000", 2024-04-26T11:13:38.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005204991 2024-04-26T11:13:38.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:38.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.552124+0000", 2024-04-26T11:13:38.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2422000000000001e-05 2024-04-26T11:13:38.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:38.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.552158+0000", 2024-04-26T11:13:38.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3800000000000002e-05 2024-04-26T11:13:38.802 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.802 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:38.802 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.802 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:594 5.b 5:d53d22e2:::benchmark_data_smithi029_44842_object593:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T11:13:38.802 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:38.545003+0000", 2024-04-26T11:13:38.802 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.14894369099999999, 2024-04-26T11:13:38.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0078595330000000001, 2024-04-26T11:13:38.802 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:38.802 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:38.802 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:38.802 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:38.803 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:38.803 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 594 2024-04-26T11:13:38.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.803 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:38.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:38.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.545003+0000", 2024-04-26T11:13:38.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:38.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.545003+0000", 2024-04-26T11:13:38.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:38.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.545002+0000", 2024-04-26T11:13:38.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:38.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:38.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.545109+0000", 2024-04-26T11:13:38.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106279 2024-04-26T11:13:38.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:38.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.545114+0000", 2024-04-26T11:13:38.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4319999999999998e-06 2024-04-26T11:13:38.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:38.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.545119+0000", 2024-04-26T11:13:38.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6469999999999997e-06 2024-04-26T11:13:38.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.546240+0000", 2024-04-26T11:13:38.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011214879999999999 2024-04-26T11:13:38.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:38.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.546351+0000", 2024-04-26T11:13:38.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000110401 2024-04-26T11:13:38.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:38.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.546450+0000", 2024-04-26T11:13:38.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9364000000000006e-05 2024-04-26T11:13:38.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:38.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.547502+0000", 2024-04-26T11:13:38.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001052201 2024-04-26T11:13:38.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:38.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.552814+0000", 2024-04-26T11:13:38.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053113969999999998 2024-04-26T11:13:38.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:38.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.552834+0000", 2024-04-26T11:13:38.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0440000000000001e-05 2024-04-26T11:13:38.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:38.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.552862+0000", 2024-04-26T11:13:38.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8456999999999999e-05 2024-04-26T11:13:38.807 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.807 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:38.807 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.808 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:680 5.8 5:19479d3b:::benchmark_data_smithi029_44842_object679:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T11:13:38.808 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:38.563484+0000", 2024-04-26T11:13:38.808 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.13046294, 2024-04-26T11:13:38.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0078261200000000006, 2024-04-26T11:13:38.808 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:38.808 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:38.808 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:38.808 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:38.808 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:38.808 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 680 2024-04-26T11:13:38.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.808 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:38.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:38.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.563484+0000", 2024-04-26T11:13:38.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:38.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.563484+0000", 2024-04-26T11:13:38.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:38.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:38.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.563483+0000", 2024-04-26T11:13:38.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:38.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:38.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.563612+0000", 2024-04-26T11:13:38.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012950599999999999 2024-04-26T11:13:38.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:38.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.563623+0000", 2024-04-26T11:13:38.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0988000000000001e-05 2024-04-26T11:13:38.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:38.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.563631+0000", 2024-04-26T11:13:38.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5050000000000001e-06 2024-04-26T11:13:38.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:38.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.563686+0000", 2024-04-26T11:13:38.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5686000000000002e-05 2024-04-26T11:13:38.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:38.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.563765+0000", 2024-04-26T11:13:38.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9056999999999999e-05 2024-04-26T11:13:38.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:38.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.563842+0000", 2024-04-26T11:13:38.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6627999999999999e-05 2024-04-26T11:13:38.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:38.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.565861+0000", 2024-04-26T11:13:38.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002019219 2024-04-26T11:13:38.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:38.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.571246+0000", 2024-04-26T11:13:38.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053842710000000004 2024-04-26T11:13:38.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:38.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.571279+0000", 2024-04-26T11:13:38.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3494999999999997e-05 2024-04-26T11:13:38.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:38.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:38.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:38.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:38.571310+0000", 2024-04-26T11:13:38.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0712e-05 2024-04-26T11:13:38.813 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.813 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:38.813 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.813 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:38.813 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:38.813 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:13:38.815 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:13:38.816 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:38.812+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:38.915 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:38.915+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:39.012 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:13:39.012 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:13:39.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.012 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:3043 5.9 5:990eea97:::benchmark_data_smithi029_44842_object3042:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T11:13:39.012 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:39.007060+0000", 2024-04-26T11:13:39.013 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0032070850000000001, 2024-04-26T11:13:39.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032463280000000001, 2024-04-26T11:13:39.013 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.013 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:39.013 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:39.013 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:39.013 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:39.013 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3043 2024-04-26T11:13:39.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.013 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.007060+0000", 2024-04-26T11:13:39.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.007060+0000", 2024-04-26T11:13:39.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.007059+0000", 2024-04-26T11:13:39.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.007302+0000", 2024-04-26T11:13:39.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00024246099999999999 2024-04-26T11:13:39.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.007312+0000", 2024-04-26T11:13:39.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7739999999999999e-06 2024-04-26T11:13:39.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.007319+0000", 2024-04-26T11:13:39.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3470000000000001e-06 2024-04-26T11:13:39.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.007354+0000", 2024-04-26T11:13:39.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4743000000000003e-05 2024-04-26T11:13:39.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.007510+0000", 2024-04-26T11:13:39.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000156541 2024-04-26T11:13:39.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:39.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.007596+0000", 2024-04-26T11:13:39.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5514999999999997e-05 2024-04-26T11:13:39.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:39.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.008176+0000", 2024-04-26T11:13:39.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00058042900000000004 2024-04-26T11:13:39.017 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.017 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.017 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.017 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:3051 5.f 5:fbcd47ff:::benchmark_data_smithi029_44842_object3050:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T11:13:39.017 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:39.008512+0000", 2024-04-26T11:13:39.017 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.001754795, 2024-04-26T11:13:39.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001913262, 2024-04-26T11:13:39.018 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.018 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:39.018 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:39.018 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:39.018 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:39.018 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3051 2024-04-26T11:13:39.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.018 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.008512+0000", 2024-04-26T11:13:39.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.008512+0000", 2024-04-26T11:13:39.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.008511+0000", 2024-04-26T11:13:39.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.008571+0000", 2024-04-26T11:13:39.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9808000000000001e-05 2024-04-26T11:13:39.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.008580+0000", 2024-04-26T11:13:39.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7469999999999994e-06 2024-04-26T11:13:39.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.008585+0000", 2024-04-26T11:13:39.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1590000000000001e-06 2024-04-26T11:13:39.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.008613+0000", 2024-04-26T11:13:39.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.758e-05 2024-04-26T11:13:39.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.008692+0000", 2024-04-26T11:13:39.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9423000000000002e-05 2024-04-26T11:13:39.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:39.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.008786+0000", 2024-04-26T11:13:39.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4067999999999995e-05 2024-04-26T11:13:39.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:39.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009625+0000", 2024-04-26T11:13:39.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00083840300000000004 2024-04-26T11:13:39.022 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.022 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.022 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.022 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:3054 5.1 5:87017c02:::benchmark_data_smithi029_44842_object3053:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T11:13:39.022 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:39.009002+0000", 2024-04-26T11:13:39.022 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.001264565, 2024-04-26T11:13:39.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0015358520000000001, 2024-04-26T11:13:39.022 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.022 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:39.023 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:39.023 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:39.023 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:39.023 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3054 2024-04-26T11:13:39.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.024 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009002+0000", 2024-04-26T11:13:39.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009002+0000", 2024-04-26T11:13:39.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009002+0000", 2024-04-26T11:13:39.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009077+0000", 2024-04-26T11:13:39.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5413000000000005e-05 2024-04-26T11:13:39.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009087+0000", 2024-04-26T11:13:39.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7380000000000006e-06 2024-04-26T11:13:39.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009094+0000", 2024-04-26T11:13:39.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.25e-06 2024-04-26T11:13:39.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009143+0000", 2024-04-26T11:13:39.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.897e-05 2024-04-26T11:13:39.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009253+0000", 2024-04-26T11:13:39.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000109978 2024-04-26T11:13:39.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:39.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009335+0000", 2024-04-26T11:13:39.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1650999999999995e-05 2024-04-26T11:13:39.027 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.027 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.027 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.027 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:3055 5.2 5:4024a876:::benchmark_data_smithi029_44842_object3054:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T11:13:39.027 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:39.009125+0000", 2024-04-26T11:13:39.027 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0011417790000000001, 2024-04-26T11:13:39.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001501123, 2024-04-26T11:13:39.028 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.028 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:39.028 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:39.028 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:39.028 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:39.028 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3055 2024-04-26T11:13:39.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.028 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009125+0000", 2024-04-26T11:13:39.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009125+0000", 2024-04-26T11:13:39.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009125+0000", 2024-04-26T11:13:39.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009209+0000", 2024-04-26T11:13:39.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4662999999999999e-05 2024-04-26T11:13:39.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009218+0000", 2024-04-26T11:13:39.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8859999999999993e-06 2024-04-26T11:13:39.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009225+0000", 2024-04-26T11:13:39.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:13:39.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009256+0000", 2024-04-26T11:13:39.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1279000000000003e-05 2024-04-26T11:13:39.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009333+0000", 2024-04-26T11:13:39.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7074000000000001e-05 2024-04-26T11:13:39.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:39.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009412+0000", 2024-04-26T11:13:39.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9203999999999996e-05 2024-04-26T11:13:39.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:39.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.010080+0000", 2024-04-26T11:13:39.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00066776699999999999 2024-04-26T11:13:39.032 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.032 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.032 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.032 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:3059 5.9 5:9eec87ba:::benchmark_data_smithi029_44842_object3058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T11:13:39.032 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:39.009563+0000", 2024-04-26T11:13:39.033 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00070427499999999997, 2024-04-26T11:13:39.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011507220000000001, 2024-04-26T11:13:39.033 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.033 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:39.033 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:39.033 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:39.033 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:39.033 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3059 2024-04-26T11:13:39.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.033 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009563+0000", 2024-04-26T11:13:39.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009563+0000", 2024-04-26T11:13:39.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009562+0000", 2024-04-26T11:13:39.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009694+0000", 2024-04-26T11:13:39.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013186900000000001 2024-04-26T11:13:39.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009708+0000", 2024-04-26T11:13:39.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4195e-05 2024-04-26T11:13:39.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009715+0000", 2024-04-26T11:13:39.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4290000000000004e-06 2024-04-26T11:13:39.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009754+0000", 2024-04-26T11:13:39.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8342e-05 2024-04-26T11:13:39.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009882+0000", 2024-04-26T11:13:39.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012871700000000001 2024-04-26T11:13:39.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:39.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009986+0000", 2024-04-26T11:13:39.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000103241 2024-04-26T11:13:39.037 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.037 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.037 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.037 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:3060 5.1 5:8ef36c84:::benchmark_data_smithi029_44842_object3059:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T11:13:39.037 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:39.009729+0000", 2024-04-26T11:13:39.037 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00053770900000000004, 2024-04-26T11:13:39.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0010726010000000001, 2024-04-26T11:13:39.037 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.037 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:39.038 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:39.038 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:39.038 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:39.038 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3060 2024-04-26T11:13:39.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.038 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009729+0000", 2024-04-26T11:13:39.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009729+0000", 2024-04-26T11:13:39.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009729+0000", 2024-04-26T11:13:39.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009784+0000", 2024-04-26T11:13:39.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5729999999999997e-05 2024-04-26T11:13:39.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009791+0000", 2024-04-26T11:13:39.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9539999999999998e-06 2024-04-26T11:13:39.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009796+0000", 2024-04-26T11:13:39.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0869999999999997e-06 2024-04-26T11:13:39.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.010326+0000", 2024-04-26T11:13:39.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00052975699999999995 2024-04-26T11:13:39.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.010446+0000", 2024-04-26T11:13:39.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119788 2024-04-26T11:13:39.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:39.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.010582+0000", 2024-04-26T11:13:39.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000135754 2024-04-26T11:13:39.041 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.041 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.041 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.042 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:3062 5.1 5.eb9473d1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T11:13:39.042 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:39.009805+0000", 2024-04-26T11:13:39.042 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00046151500000000002, 2024-04-26T11:13:39.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001077967, 2024-04-26T11:13:39.042 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.042 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2024-04-26T11:13:39.042 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:39.042 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:39.042 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:39.042 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3062 2024-04-26T11:13:39.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.042 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009805+0000", 2024-04-26T11:13:39.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009805+0000", 2024-04-26T11:13:39.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009805+0000", 2024-04-26T11:13:39.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009951+0000", 2024-04-26T11:13:39.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014648600000000001 2024-04-26T11:13:39.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009965+0000", 2024-04-26T11:13:39.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3688e-05 2024-04-26T11:13:39.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009972+0000", 2024-04-26T11:13:39.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.559e-06 2024-04-26T11:13:39.045 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.045 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.045 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.045 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:3063 5.f 5:f53090f8:::benchmark_data_smithi029_44842_object3062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T11:13:39.045 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:39.009978+0000", 2024-04-26T11:13:39.045 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00028857200000000001, 2024-04-26T11:13:39.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00095758400000000004, 2024-04-26T11:13:39.045 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.045 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:39.045 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:39.046 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:39.046 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:39.046 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3063 2024-04-26T11:13:39.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.046 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009978+0000", 2024-04-26T11:13:39.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009978+0000", 2024-04-26T11:13:39.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.009978+0000", 2024-04-26T11:13:39.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.010010+0000", 2024-04-26T11:13:39.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2378000000000001e-05 2024-04-26T11:13:39.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.010017+0000", 2024-04-26T11:13:39.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6050000000000003e-06 2024-04-26T11:13:39.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.010023+0000", 2024-04-26T11:13:39.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8150000000000002e-06 2024-04-26T11:13:39.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.010069+0000", 2024-04-26T11:13:39.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6044999999999997e-05 2024-04-26T11:13:39.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.010204+0000", 2024-04-26T11:13:39.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000135535 2024-04-26T11:13:39.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:39.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.010310+0000", 2024-04-26T11:13:39.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000105856 2024-04-26T11:13:39.049 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.049 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.049 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.049 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4534.0:3058 5.6 e18/16 5:619d4484:::benchmark_data_smithi029_44842_object3057:head v 18'216, mlcod=18'214)", 2024-04-26T11:13:39.049 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:39.010125+0000", 2024-04-26T11:13:39.049 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00014188699999999999, 2024-04-26T11:13:39.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089611300000000003, 2024-04-26T11:13:39.050 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.050 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:39.050 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.010125+0000", 2024-04-26T11:13:39.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.010125+0000", 2024-04-26T11:13:39.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.010124+0000", 2024-04-26T11:13:39.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.010186+0000", 2024-04-26T11:13:39.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1910999999999997e-05 2024-04-26T11:13:39.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.010192+0000", 2024-04-26T11:13:39.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0970000000000002e-06 2024-04-26T11:13:39.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.010198+0000", 2024-04-26T11:13:39.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0340000000000004e-06 2024-04-26T11:13:39.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.010237+0000", 2024-04-26T11:13:39.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9295999999999998e-05 2024-04-26T11:13:39.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.010256+0000", 2024-04-26T11:13:39.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9335e-05 2024-04-26T11:13:39.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:39.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.010999+0000", 2024-04-26T11:13:39.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00074272200000000002 2024-04-26T11:13:39.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:39.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:39.011021+0000", 2024-04-26T11:13:39.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2268000000000001e-05 2024-04-26T11:13:39.053 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.053 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.053 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.054 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.054 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-26T11:13:39.054 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 9 2024-04-26T11:13:39.054 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:13:39.055 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:39.053+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:39.056 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:13:39.156 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:39.154+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:39.236 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:13:39.236 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:13:39.236 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:13:39.236 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:13:39.236 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:13:39.251 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:13:39.295 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:39.293+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:39.303 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is set 2024-04-26T11:13:39.358 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:39.356+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:39.385 DEBUG:tasks.admin_socket:Testing objecter_requests with config {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}', 'branch': 'reef'} 2024-04-26T11:13:39.385 DEBUG:teuthology.orchestra.run.smithi029:> wget -q -O /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests -- 'http://git.ceph.com/?p=ceph.git;a=blob_plain;f=src/test/admin_socket/objecter_requests;hb=reef' && chmod u=rx -- /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-04-26T11:13:39.410 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 1 16 5198 5182 323.858 323.875 0.00389817 0.00307913 2024-04-26T11:13:39.433 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:13:39.433 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:13:39.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:13:39.433 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:13:39.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.433 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4157.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T11:13:39.433 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:08.416327+0000", 2024-04-26T11:13:39.433 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.01133372, 2024-04-26T11:13:39.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010043714, 2024-04-26T11:13:39.434 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.434 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:39.434 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:39.434 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4157", 2024-04-26T11:13:39.434 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2330269896", 2024-04-26T11:13:39.434 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 141 2024-04-26T11:13:39.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.434 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:08.416327+0000", 2024-04-26T11:13:39.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:08.416327+0000", 2024-04-26T11:13:39.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:08.416327+0000", 2024-04-26T11:13:39.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:08.416331+0000", 2024-04-26T11:13:39.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4059999999999998e-06 2024-04-26T11:13:39.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:08.416334+0000", 2024-04-26T11:13:39.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1540000000000002e-06 2024-04-26T11:13:39.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:08.416337+0000", 2024-04-26T11:13:39.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6690000000000002e-06 2024-04-26T11:13:39.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:08.424798+0000", 2024-04-26T11:13:39.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0084609539999999997 2024-04-26T11:13:39.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:08.424846+0000", 2024-04-26T11:13:39.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8139000000000001e-05 2024-04-26T11:13:39.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:39.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:08.424929+0000", 2024-04-26T11:13:39.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3541000000000005e-05 2024-04-26T11:13:39.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:08.425414+0000", 2024-04-26T11:13:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000484668 2024-04-26T11:13:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:08.426296+0000", 2024-04-26T11:13:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000881582 2024-04-26T11:13:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:08.426337+0000", 2024-04-26T11:13:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1467999999999997e-05 2024-04-26T11:13:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:08.426371+0000", 2024-04-26T11:13:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3423000000000002e-05 2024-04-26T11:13:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905603+0000", 2024-04-26T11:13:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.522057838999999, 2024-04-26T11:13:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016623645999999999, 2024-04-26T11:13:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905603+0000", 2024-04-26T11:13:39.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905603+0000", 2024-04-26T11:13:39.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905601+0000", 2024-04-26T11:13:39.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:13:39.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905609+0000", 2024-04-26T11:13:39.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3679999999999996e-06 2024-04-26T11:13:39.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905617+0000", 2024-04-26T11:13:39.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4309999999999994e-06 2024-04-26T11:13:39.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905626+0000", 2024-04-26T11:13:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9840000000000007e-06 2024-04-26T11:13:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905677+0000", 2024-04-26T11:13:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0305e-05 2024-04-26T11:13:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:13:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905684+0000", 2024-04-26T11:13:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0129999999999996e-06 2024-04-26T11:13:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.914734+0000", 2024-04-26T11:13:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090507199999999999 2024-04-26T11:13:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.914927+0000", 2024-04-26T11:13:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019310599999999999 2024-04-26T11:13:39.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:39.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.915592+0000", 2024-04-26T11:13:39.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00066429800000000002 2024-04-26T11:13:39.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:39.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.921998+0000", 2024-04-26T11:13:39.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064060469999999998 2024-04-26T11:13:39.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922072+0000", 2024-04-26T11:13:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3899999999999994e-05 2024-04-26T11:13:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922185+0000", 2024-04-26T11:13:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011294900000000001 2024-04-26T11:13:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922226+0000", 2024-04-26T11:13:39.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1777000000000003e-05 2024-04-26T11:13:39.448 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.448 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.448 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.448 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:39.448 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905638+0000", 2024-04-26T11:13:39.448 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.522022234000001, 2024-04-26T11:13:39.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019821874, 2024-04-26T11:13:39.448 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.448 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905638+0000", 2024-04-26T11:13:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905638+0000", 2024-04-26T11:13:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905638+0000", 2024-04-26T11:13:39.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905642+0000", 2024-04-26T11:13:39.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9759999999999997e-06 2024-04-26T11:13:39.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905647+0000", 2024-04-26T11:13:39.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5949999999999998e-06 2024-04-26T11:13:39.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905651+0000", 2024-04-26T11:13:39.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.924e-06 2024-04-26T11:13:39.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905752+0000", 2024-04-26T11:13:39.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000101 2024-04-26T11:13:39.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:39.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905758+0000", 2024-04-26T11:13:39.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:13:39.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922256+0000", 2024-04-26T11:13:39.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016497947999999998 2024-04-26T11:13:39.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922369+0000", 2024-04-26T11:13:39.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000113213 2024-04-26T11:13:39.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:39.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922505+0000", 2024-04-26T11:13:39.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000135635 2024-04-26T11:13:39.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:39.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925373+0000", 2024-04-26T11:13:39.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002868013 2024-04-26T11:13:39.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:39.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925402+0000", 2024-04-26T11:13:39.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.898e-05 2024-04-26T11:13:39.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:39.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925430+0000", 2024-04-26T11:13:39.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7739999999999999e-05 2024-04-26T11:13:39.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925460+0000", 2024-04-26T11:13:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0582e-05 2024-04-26T11:13:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905672+0000", 2024-04-26T11:13:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.521988402000002, 2024-04-26T11:13:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019920424999999999, 2024-04-26T11:13:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905672+0000", 2024-04-26T11:13:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905672+0000", 2024-04-26T11:13:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905672+0000", 2024-04-26T11:13:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905689+0000", 2024-04-26T11:13:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6929e-05 2024-04-26T11:13:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905694+0000", 2024-04-26T11:13:39.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3839999999999996e-06 2024-04-26T11:13:39.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905698+0000", 2024-04-26T11:13:39.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1450000000000001e-06 2024-04-26T11:13:39.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905812+0000", 2024-04-26T11:13:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000113807 2024-04-26T11:13:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905817+0000", 2024-04-26T11:13:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.203e-06 2024-04-26T11:13:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922934+0000", 2024-04-26T11:13:39.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017116681000000002 2024-04-26T11:13:39.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923094+0000", 2024-04-26T11:13:39.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000159667 2024-04-26T11:13:39.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:39.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923233+0000", 2024-04-26T11:13:39.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013987 2024-04-26T11:13:39.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:39.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925378+0000", 2024-04-26T11:13:39.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002144389 2024-04-26T11:13:39.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:39.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925510+0000", 2024-04-26T11:13:39.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013231399999999999 2024-04-26T11:13:39.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:39.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925559+0000", 2024-04-26T11:13:39.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8958000000000001e-05 2024-04-26T11:13:39.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:39.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925593+0000", 2024-04-26T11:13:39.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3488999999999997e-05 2024-04-26T11:13:39.462 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.462 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.462 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.463 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:39.463 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905702+0000", 2024-04-26T11:13:39.463 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.521958568999999, 2024-04-26T11:13:39.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.01999043, 2024-04-26T11:13:39.463 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.463 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:39.463 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905702+0000", 2024-04-26T11:13:39.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905702+0000", 2024-04-26T11:13:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905702+0000", 2024-04-26T11:13:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905704+0000", 2024-04-26T11:13:39.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6699999999999998e-06 2024-04-26T11:13:39.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905708+0000", 2024-04-26T11:13:39.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3000000000000002e-06 2024-04-26T11:13:39.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905712+0000", 2024-04-26T11:13:39.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.425e-06 2024-04-26T11:13:39.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905855+0000", 2024-04-26T11:13:39.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014253200000000001 2024-04-26T11:13:39.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:39.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905858+0000", 2024-04-26T11:13:39.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.822e-06 2024-04-26T11:13:39.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923510+0000", 2024-04-26T11:13:39.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017651394000000001 2024-04-26T11:13:39.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923578+0000", 2024-04-26T11:13:39.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8283999999999999e-05 2024-04-26T11:13:39.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:39.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923710+0000", 2024-04-26T11:13:39.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013175200000000001 2024-04-26T11:13:39.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:39.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925607+0000", 2024-04-26T11:13:39.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001897648 2024-04-26T11:13:39.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:39.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925644+0000", 2024-04-26T11:13:39.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6658e-05 2024-04-26T11:13:39.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:39.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925673+0000", 2024-04-26T11:13:39.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8566999999999999e-05 2024-04-26T11:13:39.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:39.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925692+0000", 2024-04-26T11:13:39.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9720000000000001e-05 2024-04-26T11:13:39.469 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.469 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.469 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.470 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:39.470 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905731+0000", 2024-04-26T11:13:39.470 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.521929590999999, 2024-04-26T11:13:39.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020112349000000002, 2024-04-26T11:13:39.470 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.470 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:39.470 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905731+0000", 2024-04-26T11:13:39.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905731+0000", 2024-04-26T11:13:39.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905731+0000", 2024-04-26T11:13:39.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905734+0000", 2024-04-26T11:13:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2329999999999998e-06 2024-04-26T11:13:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905740+0000", 2024-04-26T11:13:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4300000000000003e-06 2024-04-26T11:13:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905752+0000", 2024-04-26T11:13:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1987000000000001e-05 2024-04-26T11:13:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905894+0000", 2024-04-26T11:13:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000141858 2024-04-26T11:13:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905898+0000", 2024-04-26T11:13:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3599999999999998e-06 2024-04-26T11:13:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924011+0000", 2024-04-26T11:13:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018113066000000001 2024-04-26T11:13:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924100+0000", 2024-04-26T11:13:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8894999999999995e-05 2024-04-26T11:13:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924188+0000", 2024-04-26T11:13:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7903000000000002e-05 2024-04-26T11:13:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925616+0000", 2024-04-26T11:13:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014277319999999999 2024-04-26T11:13:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925741+0000", 2024-04-26T11:13:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012525899999999999 2024-04-26T11:13:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925804+0000", 2024-04-26T11:13:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2954999999999996e-05 2024-04-26T11:13:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925843+0000", 2024-04-26T11:13:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9096e-05 2024-04-26T11:13:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905757+0000", 2024-04-26T11:13:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.521903611999999, 2024-04-26T11:13:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020224836999999999, 2024-04-26T11:13:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905757+0000", 2024-04-26T11:13:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905757+0000", 2024-04-26T11:13:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905757+0000", 2024-04-26T11:13:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905760+0000", 2024-04-26T11:13:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2219999999999998e-06 2024-04-26T11:13:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905766+0000", 2024-04-26T11:13:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0820000000000004e-06 2024-04-26T11:13:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905771+0000", 2024-04-26T11:13:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1159999999999998e-06 2024-04-26T11:13:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905930+0000", 2024-04-26T11:13:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015876200000000001 2024-04-26T11:13:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905933+0000", 2024-04-26T11:13:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0359999999999998e-06 2024-04-26T11:13:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924368+0000", 2024-04-26T11:13:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0184355 2024-04-26T11:13:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924415+0000", 2024-04-26T11:13:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7098000000000002e-05 2024-04-26T11:13:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924506+0000", 2024-04-26T11:13:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1090999999999999e-05 2024-04-26T11:13:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925622+0000", 2024-04-26T11:13:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011159480000000001 2024-04-26T11:13:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925927+0000", 2024-04-26T11:13:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00030507899999999998 2024-04-26T11:13:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925958+0000", 2024-04-26T11:13:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0534999999999998e-05 2024-04-26T11:13:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925982+0000", 2024-04-26T11:13:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3782999999999999e-05 2024-04-26T11:13:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905814+0000", 2024-04-26T11:13:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.521846474, 2024-04-26T11:13:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020271001, 2024-04-26T11:13:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905814+0000", 2024-04-26T11:13:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905814+0000", 2024-04-26T11:13:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905813+0000", 2024-04-26T11:13:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905821+0000", 2024-04-26T11:13:39.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1280000000000008e-06 2024-04-26T11:13:39.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905832+0000", 2024-04-26T11:13:39.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1318000000000001e-05 2024-04-26T11:13:39.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905842+0000", 2024-04-26T11:13:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0101e-05 2024-04-26T11:13:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905970+0000", 2024-04-26T11:13:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012764499999999999 2024-04-26T11:13:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905977+0000", 2024-04-26T11:13:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5019999999999998e-06 2024-04-26T11:13:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924672+0000", 2024-04-26T11:13:39.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018694908999999999 2024-04-26T11:13:39.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924754+0000", 2024-04-26T11:13:39.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2167000000000001e-05 2024-04-26T11:13:39.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924834+0000", 2024-04-26T11:13:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0313000000000002e-05 2024-04-26T11:13:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925860+0000", 2024-04-26T11:13:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0010255869999999999 2024-04-26T11:13:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926020+0000", 2024-04-26T11:13:39.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000160588 2024-04-26T11:13:39.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:39.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926054+0000", 2024-04-26T11:13:39.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3748999999999998e-05 2024-04-26T11:13:39.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:39.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926085+0000", 2024-04-26T11:13:39.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1111000000000001e-05 2024-04-26T11:13:39.490 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.491 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.491 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.491 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:39.491 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905851+0000", 2024-04-26T11:13:39.491 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.521809385000001, 2024-04-26T11:13:39.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020308667999999998, 2024-04-26T11:13:39.491 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.491 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:39.491 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905851+0000", 2024-04-26T11:13:39.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905851+0000", 2024-04-26T11:13:39.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905851+0000", 2024-04-26T11:13:39.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905855+0000", 2024-04-26T11:13:39.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3120000000000004e-06 2024-04-26T11:13:39.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905861+0000", 2024-04-26T11:13:39.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9399999999999999e-06 2024-04-26T11:13:39.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905865+0000", 2024-04-26T11:13:39.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9079999999999997e-06 2024-04-26T11:13:39.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906003+0000", 2024-04-26T11:13:39.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013821800000000001 2024-04-26T11:13:39.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:39.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906007+0000", 2024-04-26T11:13:39.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9670000000000003e-06 2024-04-26T11:13:39.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925040+0000", 2024-04-26T11:13:39.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019032613 2024-04-26T11:13:39.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925107+0000", 2024-04-26T11:13:39.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7185000000000001e-05 2024-04-26T11:13:39.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:39.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925195+0000", 2024-04-26T11:13:39.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8515000000000002e-05 2024-04-26T11:13:39.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:39.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926094+0000", 2024-04-26T11:13:39.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089852300000000003 2024-04-26T11:13:39.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:39.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926116+0000", 2024-04-26T11:13:39.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1951e-05 2024-04-26T11:13:39.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:39.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926142+0000", 2024-04-26T11:13:39.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6667000000000001e-05 2024-04-26T11:13:39.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:39.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926160+0000", 2024-04-26T11:13:39.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7339000000000001e-05 2024-04-26T11:13:39.498 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.498 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.498 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.498 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:39.498 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905890+0000", 2024-04-26T11:13:39.498 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.521770483000001, 2024-04-26T11:13:39.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017722176999999999, 2024-04-26T11:13:39.498 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.498 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:39.498 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905890+0000", 2024-04-26T11:13:39.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905890+0000", 2024-04-26T11:13:39.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905890+0000", 2024-04-26T11:13:39.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905893+0000", 2024-04-26T11:13:39.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9160000000000001e-06 2024-04-26T11:13:39.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905899+0000", 2024-04-26T11:13:39.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6810000000000001e-06 2024-04-26T11:13:39.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905904+0000", 2024-04-26T11:13:39.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2009999999999998e-06 2024-04-26T11:13:39.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905956+0000", 2024-04-26T11:13:39.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1505999999999998e-05 2024-04-26T11:13:39.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:13:39.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905962+0000", 2024-04-26T11:13:39.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1539999999999999e-06 2024-04-26T11:13:39.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918151+0000", 2024-04-26T11:13:39.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012189046 2024-04-26T11:13:39.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918261+0000", 2024-04-26T11:13:39.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000110258 2024-04-26T11:13:39.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:39.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918423+0000", 2024-04-26T11:13:39.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000162027 2024-04-26T11:13:39.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:39.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923237+0000", 2024-04-26T11:13:39.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048139519999999998 2024-04-26T11:13:39.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:39.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923530+0000", 2024-04-26T11:13:39.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00029218799999999997 2024-04-26T11:13:39.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:39.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923576+0000", 2024-04-26T11:13:39.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6545999999999998e-05 2024-04-26T11:13:39.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:39.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923612+0000", 2024-04-26T11:13:39.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6171000000000003e-05 2024-04-26T11:13:39.505 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.505 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.505 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.505 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:39.505 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905914+0000", 2024-04-26T11:13:39.505 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.521746596, 2024-04-26T11:13:39.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017543897999999999, 2024-04-26T11:13:39.505 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.505 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:39.506 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905914+0000", 2024-04-26T11:13:39.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905914+0000", 2024-04-26T11:13:39.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905914+0000", 2024-04-26T11:13:39.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905917+0000", 2024-04-26T11:13:39.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4359999999999998e-06 2024-04-26T11:13:39.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905925+0000", 2024-04-26T11:13:39.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0779999999999996e-06 2024-04-26T11:13:39.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905932+0000", 2024-04-26T11:13:39.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3810000000000001e-06 2024-04-26T11:13:39.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905979+0000", 2024-04-26T11:13:39.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6264000000000003e-05 2024-04-26T11:13:39.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:13:39.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905983+0000", 2024-04-26T11:13:39.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8909999999999997e-06 2024-04-26T11:13:39.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.914254+0000", 2024-04-26T11:13:39.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082715619999999997 2024-04-26T11:13:39.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.914410+0000", 2024-04-26T11:13:39.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015563 2024-04-26T11:13:39.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:39.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.914633+0000", 2024-04-26T11:13:39.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022336 2024-04-26T11:13:39.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:39.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920212+0000", 2024-04-26T11:13:39.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055787349999999996 2024-04-26T11:13:39.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:39.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923369+0000", 2024-04-26T11:13:39.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0031574060000000002 2024-04-26T11:13:39.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:39.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923419+0000", 2024-04-26T11:13:39.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9527000000000002e-05 2024-04-26T11:13:39.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:39.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923458+0000", 2024-04-26T11:13:39.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9005999999999999e-05 2024-04-26T11:13:39.512 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.512 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.512 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.512 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:31 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:39.512 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905953+0000", 2024-04-26T11:13:39.512 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.521707699, 2024-04-26T11:13:39.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018731343000000001, 2024-04-26T11:13:39.512 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.513 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:39.513 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905953+0000", 2024-04-26T11:13:39.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905953+0000", 2024-04-26T11:13:39.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905952+0000", 2024-04-26T11:13:39.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905966+0000", 2024-04-26T11:13:39.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3281999999999999e-05 2024-04-26T11:13:39.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905973+0000", 2024-04-26T11:13:39.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4109999999999999e-06 2024-04-26T11:13:39.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905979+0000", 2024-04-26T11:13:39.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2949999999999999e-06 2024-04-26T11:13:39.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906013+0000", 2024-04-26T11:13:39.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3844000000000003e-05 2024-04-26T11:13:39.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:39.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906017+0000", 2024-04-26T11:13:39.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4419999999999998e-06 2024-04-26T11:13:39.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918937+0000", 2024-04-26T11:13:39.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012920403 2024-04-26T11:13:39.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.919018+0000", 2024-04-26T11:13:39.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1540999999999997e-05 2024-04-26T11:13:39.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:39.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.919765+0000", 2024-04-26T11:13:39.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00074620299999999997 2024-04-26T11:13:39.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:39.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923650+0000", 2024-04-26T11:13:39.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038853820000000002 2024-04-26T11:13:39.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:39.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924619+0000", 2024-04-26T11:13:39.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00096863899999999998 2024-04-26T11:13:39.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:39.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924649+0000", 2024-04-26T11:13:39.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9879e-05 2024-04-26T11:13:39.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:39.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924684+0000", 2024-04-26T11:13:39.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5611999999999997e-05 2024-04-26T11:13:39.519 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.519 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.519 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.519 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:39.519 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905987+0000", 2024-04-26T11:13:39.519 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.521674039000001, 2024-04-26T11:13:39.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018241182000000002, 2024-04-26T11:13:39.520 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.520 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:39.520 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905987+0000", 2024-04-26T11:13:39.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905987+0000", 2024-04-26T11:13:39.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905986+0000", 2024-04-26T11:13:39.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905990+0000", 2024-04-26T11:13:39.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.755e-06 2024-04-26T11:13:39.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905995+0000", 2024-04-26T11:13:39.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4999999999999999e-06 2024-04-26T11:13:39.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906000+0000", 2024-04-26T11:13:39.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8949999999999997e-06 2024-04-26T11:13:39.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906038+0000", 2024-04-26T11:13:39.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7762999999999997e-05 2024-04-26T11:13:39.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:39.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906042+0000", 2024-04-26T11:13:39.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6890000000000002e-06 2024-04-26T11:13:39.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922401+0000", 2024-04-26T11:13:39.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358973999999998 2024-04-26T11:13:39.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922482+0000", 2024-04-26T11:13:39.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1711000000000004e-05 2024-04-26T11:13:39.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:39.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922607+0000", 2024-04-26T11:13:39.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000124955 2024-04-26T11:13:39.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:39.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924016+0000", 2024-04-26T11:13:39.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014086490000000001 2024-04-26T11:13:39.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:39.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924154+0000", 2024-04-26T11:13:39.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013777599999999999 2024-04-26T11:13:39.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:39.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924196+0000", 2024-04-26T11:13:39.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2647e-05 2024-04-26T11:13:39.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:39.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924228+0000", 2024-04-26T11:13:39.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1372999999999999e-05 2024-04-26T11:13:39.526 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.526 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.526 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.526 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:39.526 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906018+0000", 2024-04-26T11:13:39.526 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.521642129, 2024-04-26T11:13:39.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017151182000000001, 2024-04-26T11:13:39.527 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.527 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:39.527 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906018+0000", 2024-04-26T11:13:39.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906018+0000", 2024-04-26T11:13:39.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906018+0000", 2024-04-26T11:13:39.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906027+0000", 2024-04-26T11:13:39.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9190000000000005e-06 2024-04-26T11:13:39.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906033+0000", 2024-04-26T11:13:39.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1419999999999998e-06 2024-04-26T11:13:39.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906039+0000", 2024-04-26T11:13:39.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.156e-06 2024-04-26T11:13:39.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906075+0000", 2024-04-26T11:13:39.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5608999999999997e-05 2024-04-26T11:13:39.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:13:39.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906080+0000", 2024-04-26T11:13:39.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.276e-06 2024-04-26T11:13:39.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918535+0000", 2024-04-26T11:13:39.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012455061999999999 2024-04-26T11:13:39.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918624+0000", 2024-04-26T11:13:39.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.878e-05 2024-04-26T11:13:39.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:39.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918748+0000", 2024-04-26T11:13:39.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012453799999999999 2024-04-26T11:13:39.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:39.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922172+0000", 2024-04-26T11:13:39.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034232580000000002 2024-04-26T11:13:39.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:39.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923079+0000", 2024-04-26T11:13:39.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00090687899999999998 2024-04-26T11:13:39.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:39.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923129+0000", 2024-04-26T11:13:39.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0773999999999999e-05 2024-04-26T11:13:39.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:39.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923170+0000", 2024-04-26T11:13:39.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0238999999999999e-05 2024-04-26T11:13:39.533 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.533 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.533 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.533 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:39.533 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906048+0000", 2024-04-26T11:13:39.534 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.521612609999998, 2024-04-26T11:13:39.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018763734000000001, 2024-04-26T11:13:39.534 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.534 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:39.534 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906048+0000", 2024-04-26T11:13:39.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906048+0000", 2024-04-26T11:13:39.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906047+0000", 2024-04-26T11:13:39.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906051+0000", 2024-04-26T11:13:39.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.799e-06 2024-04-26T11:13:39.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906058+0000", 2024-04-26T11:13:39.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4470000000000003e-06 2024-04-26T11:13:39.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906064+0000", 2024-04-26T11:13:39.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1319999999999999e-06 2024-04-26T11:13:39.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906092+0000", 2024-04-26T11:13:39.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7939000000000001e-05 2024-04-26T11:13:39.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:39.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906097+0000", 2024-04-26T11:13:39.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.741e-06 2024-04-26T11:13:39.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920571+0000", 2024-04-26T11:13:39.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014474526 2024-04-26T11:13:39.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920675+0000", 2024-04-26T11:13:39.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000103644 2024-04-26T11:13:39.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:39.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920803+0000", 2024-04-26T11:13:39.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012879699999999999 2024-04-26T11:13:39.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:39.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923655+0000", 2024-04-26T11:13:39.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028517379999999999 2024-04-26T11:13:39.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:39.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924728+0000", 2024-04-26T11:13:39.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0010732199999999999 2024-04-26T11:13:39.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:39.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924775+0000", 2024-04-26T11:13:39.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6168999999999998e-05 2024-04-26T11:13:39.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:39.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924812+0000", 2024-04-26T11:13:39.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7070000000000003e-05 2024-04-26T11:13:39.541 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.541 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.541 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.541 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:39.541 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906072+0000", 2024-04-26T11:13:39.541 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.521588906000002, 2024-04-26T11:13:39.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016458922000000001, 2024-04-26T11:13:39.542 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.542 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:39.542 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906072+0000", 2024-04-26T11:13:39.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906072+0000", 2024-04-26T11:13:39.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906071+0000", 2024-04-26T11:13:39.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906074+0000", 2024-04-26T11:13:39.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9289999999999998e-06 2024-04-26T11:13:39.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906081+0000", 2024-04-26T11:13:39.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8950000000000001e-06 2024-04-26T11:13:39.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906086+0000", 2024-04-26T11:13:39.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7979999999999996e-06 2024-04-26T11:13:39.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906138+0000", 2024-04-26T11:13:39.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1820999999999997e-05 2024-04-26T11:13:39.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:13:39.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906140+0000", 2024-04-26T11:13:39.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.706e-06 2024-04-26T11:13:39.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.916004+0000", 2024-04-26T11:13:39.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098632700000000004 2024-04-26T11:13:39.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.916126+0000", 2024-04-26T11:13:39.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012214300000000001 2024-04-26T11:13:39.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:39.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.916259+0000", 2024-04-26T11:13:39.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013354999999999999 2024-04-26T11:13:39.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:39.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922337+0000", 2024-04-26T11:13:39.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060773600000000004 2024-04-26T11:13:39.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:39.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922447+0000", 2024-04-26T11:13:39.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011003800000000001 2024-04-26T11:13:39.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:39.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922492+0000", 2024-04-26T11:13:39.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5185000000000002e-05 2024-04-26T11:13:39.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:39.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922531+0000", 2024-04-26T11:13:39.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8652999999999997e-05 2024-04-26T11:13:39.548 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.548 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.548 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.548 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:39.548 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906123+0000", 2024-04-26T11:13:39.548 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.521537737999999, 2024-04-26T11:13:39.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018987535999999999, 2024-04-26T11:13:39.549 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.549 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:39.549 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906123+0000", 2024-04-26T11:13:39.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906123+0000", 2024-04-26T11:13:39.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906122+0000", 2024-04-26T11:13:39.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:39.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906136+0000", 2024-04-26T11:13:39.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4527e-05 2024-04-26T11:13:39.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906148+0000", 2024-04-26T11:13:39.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2332e-05 2024-04-26T11:13:39.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906157+0000", 2024-04-26T11:13:39.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0129999999999999e-06 2024-04-26T11:13:39.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906187+0000", 2024-04-26T11:13:39.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9748e-05 2024-04-26T11:13:39.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:39.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906190+0000", 2024-04-26T11:13:39.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0290000000000001e-06 2024-04-26T11:13:39.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.921242+0000", 2024-04-26T11:13:39.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015052100000000001 2024-04-26T11:13:39.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.921750+0000", 2024-04-26T11:13:39.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00050746299999999999 2024-04-26T11:13:39.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:39.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.921915+0000", 2024-04-26T11:13:39.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016514700000000001 2024-04-26T11:13:39.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:39.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923673+0000", 2024-04-26T11:13:39.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001757836 2024-04-26T11:13:39.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:39.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925039+0000", 2024-04-26T11:13:39.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001366396 2024-04-26T11:13:39.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:39.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925077+0000", 2024-04-26T11:13:39.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7595999999999997e-05 2024-04-26T11:13:39.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:39.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925110+0000", 2024-04-26T11:13:39.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3531999999999997e-05 2024-04-26T11:13:39.555 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.555 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.555 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.555 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:21 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:39.555 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906168+0000", 2024-04-26T11:13:39.555 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.521492099, 2024-04-26T11:13:39.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346383, 2024-04-26T11:13:39.556 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.556 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:39.556 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906168+0000", 2024-04-26T11:13:39.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906168+0000", 2024-04-26T11:13:39.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906168+0000", 2024-04-26T11:13:39.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906183+0000", 2024-04-26T11:13:39.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5597e-05 2024-04-26T11:13:39.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906201+0000", 2024-04-26T11:13:39.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7949e-05 2024-04-26T11:13:39.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906208+0000", 2024-04-26T11:13:39.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0990000000000001e-06 2024-04-26T11:13:39.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906233+0000", 2024-04-26T11:13:39.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4351000000000001e-05 2024-04-26T11:13:39.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:39.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906235+0000", 2024-04-26T11:13:39.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4169999999999999e-06 2024-04-26T11:13:39.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.919842+0000", 2024-04-26T11:13:39.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013606337 2024-04-26T11:13:39.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920004+0000", 2024-04-26T11:13:39.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016249799999999999 2024-04-26T11:13:39.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:39.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920157+0000", 2024-04-26T11:13:39.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015337400000000001 2024-04-26T11:13:39.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:39.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922705+0000", 2024-04-26T11:13:39.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0025479330000000001 2024-04-26T11:13:39.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:39.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923419+0000", 2024-04-26T11:13:39.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00071332999999999998 2024-04-26T11:13:39.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:39.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923467+0000", 2024-04-26T11:13:39.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8556000000000001e-05 2024-04-26T11:13:39.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:39.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923515+0000", 2024-04-26T11:13:39.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7540999999999998e-05 2024-04-26T11:13:39.562 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.562 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.562 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.562 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:39.562 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906218+0000", 2024-04-26T11:13:39.562 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.521442903000001, 2024-04-26T11:13:39.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018831681999999999, 2024-04-26T11:13:39.563 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.563 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:39.563 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906218+0000", 2024-04-26T11:13:39.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906218+0000", 2024-04-26T11:13:39.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906217+0000", 2024-04-26T11:13:39.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906221+0000", 2024-04-26T11:13:39.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1760000000000003e-06 2024-04-26T11:13:39.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906228+0000", 2024-04-26T11:13:39.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9800000000000001e-06 2024-04-26T11:13:39.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906234+0000", 2024-04-26T11:13:39.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9320000000000001e-06 2024-04-26T11:13:39.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906264+0000", 2024-04-26T11:13:39.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9518000000000001e-05 2024-04-26T11:13:39.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:13:39.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906268+0000", 2024-04-26T11:13:39.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2939999999999999e-06 2024-04-26T11:13:39.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922451+0000", 2024-04-26T11:13:39.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016183288000000001 2024-04-26T11:13:39.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922567+0000", 2024-04-26T11:13:39.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000115313 2024-04-26T11:13:39.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:39.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922684+0000", 2024-04-26T11:13:39.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117419 2024-04-26T11:13:39.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:39.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924129+0000", 2024-04-26T11:13:39.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001444753 2024-04-26T11:13:39.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:39.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924979+0000", 2024-04-26T11:13:39.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00084985900000000001 2024-04-26T11:13:39.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:39.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925012+0000", 2024-04-26T11:13:39.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3352999999999997e-05 2024-04-26T11:13:39.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:39.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925049+0000", 2024-04-26T11:13:39.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7354999999999997e-05 2024-04-26T11:13:39.569 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.569 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.569 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.569 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:39.569 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906243+0000", 2024-04-26T11:13:39.569 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.521417524, 2024-04-26T11:13:39.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018983739999999999, 2024-04-26T11:13:39.569 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:39.570 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:13:39.570 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:39.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:39.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906243+0000", 2024-04-26T11:13:39.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:39.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906243+0000", 2024-04-26T11:13:39.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:39.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:39.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906243+0000", 2024-04-26T11:13:39.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:39.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906245+0000", 2024-04-26T11:13:39.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9189999999999999e-06 2024-04-26T11:13:39.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:39.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906252+0000", 2024-04-26T11:13:39.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:13:39.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.572 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906258+0000", 2024-04-26T11:13:39.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.728e-06 2024-04-26T11:13:39.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.572 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906290+0000", 2024-04-26T11:13:39.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2400000000000001e-05 2024-04-26T11:13:39.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:39.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906293+0000", 2024-04-26T11:13:39.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1769999999999998e-06 2024-04-26T11:13:39.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:39.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922664+0000", 2024-04-26T11:13:39.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016370663000000001 2024-04-26T11:13:39.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:39.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922923+0000", 2024-04-26T11:13:39.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025853200000000001 2024-04-26T11:13:39.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:39.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:39.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:39.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925227+0000", 2024-04-26T11:13:39.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023042570000000001 2024-04-26T11:13:39.574 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.574 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.574 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.574 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:39.574 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:39.575 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:13:39.577 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:13:39.578 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:39.575+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:39.676 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:39.674+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:39.772 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:13:39.773 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:13:39.773 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.773 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:7037 5.5 5:a26dd192:::benchmark_data_smithi029_44842_object7036:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:39.773 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.767033+0000", 2024-04-26T11:13:39.773 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0035696970000000001, 2024-04-26T11:13:39.773 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0036001750000000002, 2024-04-26T11:13:39.773 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:39.773 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:39.773 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:39.773 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:39.773 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:39.773 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 7037 2024-04-26T11:13:39.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.774 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:39.774 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.774 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:39.774 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.767033+0000", 2024-04-26T11:13:39.774 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:39.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.774 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.774 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:39.774 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.767033+0000", 2024-04-26T11:13:39.774 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:39.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.774 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.775 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:39.775 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.767032+0000", 2024-04-26T11:13:39.775 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:39.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.775 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.775 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:39.775 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.767126+0000", 2024-04-26T11:13:39.775 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4032999999999999e-05 2024-04-26T11:13:39.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.775 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.775 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:39.775 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.767136+0000", 2024-04-26T11:13:39.775 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0373e-05 2024-04-26T11:13:39.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.775 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.776 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.776 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.767144+0000", 2024-04-26T11:13:39.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4769999999999997e-06 2024-04-26T11:13:39.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.776 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:39.776 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.767217+0000", 2024-04-26T11:13:39.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3598999999999998e-05 2024-04-26T11:13:39.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.776 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:39.776 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.767355+0000", 2024-04-26T11:13:39.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000137193 2024-04-26T11:13:39.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.777 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:39.777 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.767454+0000", 2024-04-26T11:13:39.777 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.9905e-05 2024-04-26T11:13:39.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.777 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:39.777 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.769199+0000", 2024-04-26T11:13:39.777 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0017449200000000001 2024-04-26T11:13:39.777 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:39.777 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:39.777 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:39.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.778 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:7044 5.5 5:a737566a:::benchmark_data_smithi029_44842_object7043:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:39.778 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.767341+0000", 2024-04-26T11:13:39.778 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.003261332, 2024-04-26T11:13:39.778 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0033979069999999999, 2024-04-26T11:13:39.778 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:39.778 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:39.778 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:39.778 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:39.778 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:39.778 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 7044 2024-04-26T11:13:39.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.778 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:39.778 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.778 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:39.779 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.767341+0000", 2024-04-26T11:13:39.779 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:39.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.779 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:39.779 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.767341+0000", 2024-04-26T11:13:39.779 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:39.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.779 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:39.779 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.767341+0000", 2024-04-26T11:13:39.779 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.780 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:39.780 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.767522+0000", 2024-04-26T11:13:39.780 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00018111200000000001 2024-04-26T11:13:39.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.780 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:39.780 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.767530+0000", 2024-04-26T11:13:39.780 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.8259999999999999e-06 2024-04-26T11:13:39.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.780 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.780 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.767537+0000", 2024-04-26T11:13:39.780 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9129999999999997e-06 2024-04-26T11:13:39.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.781 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:39.781 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.767869+0000", 2024-04-26T11:13:39.781 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00033122099999999998 2024-04-26T11:13:39.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.781 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.781 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:39.782 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.767951+0000", 2024-04-26T11:13:39.782 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2287999999999995e-05 2024-04-26T11:13:39.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.782 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:39.782 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768066+0000", 2024-04-26T11:13:39.782 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000115492 2024-04-26T11:13:39.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.782 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:39.782 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770617+0000", 2024-04-26T11:13:39.782 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0025508649999999998 2024-04-26T11:13:39.782 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:39.782 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:39.783 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:39.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.783 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.783 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:7050 5.5 5:ae9763da:::benchmark_data_smithi029_44842_object7049:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:39.783 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.767642+0000", 2024-04-26T11:13:39.783 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0029600630000000002, 2024-04-26T11:13:39.783 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0032281950000000001, 2024-04-26T11:13:39.783 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:39.783 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:39.783 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:39.783 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:39.783 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:39.783 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 7050 2024-04-26T11:13:39.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.783 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:39.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.784 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:39.784 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.767642+0000", 2024-04-26T11:13:39.784 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:39.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.784 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:39.784 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.767642+0000", 2024-04-26T11:13:39.784 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:39.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.784 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:39.784 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.767642+0000", 2024-04-26T11:13:39.785 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:39.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.785 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:39.785 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.767763+0000", 2024-04-26T11:13:39.785 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000121438 2024-04-26T11:13:39.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.785 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:39.785 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.767773+0000", 2024-04-26T11:13:39.785 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3640000000000005e-06 2024-04-26T11:13:39.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.785 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.785 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.767780+0000", 2024-04-26T11:13:39.786 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7740000000000004e-06 2024-04-26T11:13:39.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.786 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:39.786 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768419+0000", 2024-04-26T11:13:39.786 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00063824300000000004 2024-04-26T11:13:39.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.786 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:39.786 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768501+0000", 2024-04-26T11:13:39.786 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2408000000000001e-05 2024-04-26T11:13:39.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.787 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.787 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:39.787 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768580+0000", 2024-04-26T11:13:39.787 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8839999999999997e-05 2024-04-26T11:13:39.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.787 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.787 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:39.787 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770836+0000", 2024-04-26T11:13:39.787 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022562770000000001 2024-04-26T11:13:39.788 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:39.788 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:39.788 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:39.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.788 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:7041 5.b e19/16 5:ddc29897:::benchmark_data_smithi029_44842_object7040:head v 19'440, mlcod=19'437)", 2024-04-26T11:13:39.788 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.768366+0000", 2024-04-26T11:13:39.788 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0022369960000000002, 2024-04-26T11:13:39.788 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0025966930000000002, 2024-04-26T11:13:39.788 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:39.788 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:39.788 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:39.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.788 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:39.789 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768366+0000", 2024-04-26T11:13:39.789 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:39.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.789 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:39.789 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768366+0000", 2024-04-26T11:13:39.789 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:39.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.789 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:39.790 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768365+0000", 2024-04-26T11:13:39.790 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.790 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:39.790 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768441+0000", 2024-04-26T11:13:39.790 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5727000000000002e-05 2024-04-26T11:13:39.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.790 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:39.791 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768448+0000", 2024-04-26T11:13:39.791 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9360000000000002e-06 2024-04-26T11:13:39.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.791 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.791 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768457+0000", 2024-04-26T11:13:39.791 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2110000000000004e-06 2024-04-26T11:13:39.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.791 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:39.791 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768488+0000", 2024-04-26T11:13:39.791 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0722999999999997e-05 2024-04-26T11:13:39.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.792 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:39.792 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768504+0000", 2024-04-26T11:13:39.792 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6742e-05 2024-04-26T11:13:39.792 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:39.792 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:39.792 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:39.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.792 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.792 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:7048 5.0 e19/16 5:04a5d03a:::benchmark_data_smithi029_44842_object7047:head v 19'451, mlcod=19'449)", 2024-04-26T11:13:39.792 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.768638+0000", 2024-04-26T11:13:39.792 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0019646189999999999, 2024-04-26T11:13:39.792 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0023862509999999998, 2024-04-26T11:13:39.792 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:39.792 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:39.793 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:39.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.793 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:39.793 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768638+0000", 2024-04-26T11:13:39.793 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:39.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.793 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:39.793 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768638+0000", 2024-04-26T11:13:39.793 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:39.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.793 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:39.793 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768637+0000", 2024-04-26T11:13:39.794 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.794 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:39.794 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768687+0000", 2024-04-26T11:13:39.794 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.9953000000000001e-05 2024-04-26T11:13:39.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.794 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:39.794 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768727+0000", 2024-04-26T11:13:39.794 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0046000000000002e-05 2024-04-26T11:13:39.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.794 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.794 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768741+0000", 2024-04-26T11:13:39.795 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3838e-05 2024-04-26T11:13:39.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.795 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:39.795 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768779+0000", 2024-04-26T11:13:39.795 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7908999999999999e-05 2024-04-26T11:13:39.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.795 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:39.795 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768791+0000", 2024-04-26T11:13:39.795 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2029e-05 2024-04-26T11:13:39.795 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:39.795 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:39.795 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:39.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.796 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:7049 5.8 e19/16 5:18576449:::benchmark_data_smithi029_44842_object7048:head v 19'466, mlcod=19'463)", 2024-04-26T11:13:39.796 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.768765+0000", 2024-04-26T11:13:39.796 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0018376690000000001, 2024-04-26T11:13:39.796 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0023413850000000001, 2024-04-26T11:13:39.796 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:39.796 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:39.796 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:39.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.796 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:39.796 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768765+0000", 2024-04-26T11:13:39.796 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:39.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.797 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:39.797 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768765+0000", 2024-04-26T11:13:39.797 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:39.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.797 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.797 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:39.797 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768764+0000", 2024-04-26T11:13:39.797 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.797 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.797 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:39.797 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768803+0000", 2024-04-26T11:13:39.797 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8717999999999998e-05 2024-04-26T11:13:39.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.798 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.798 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:39.798 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768814+0000", 2024-04-26T11:13:39.798 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0552e-05 2024-04-26T11:13:39.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.798 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.798 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.798 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768819+0000", 2024-04-26T11:13:39.798 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1939999999999997e-06 2024-04-26T11:13:39.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.798 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.798 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:39.798 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768857+0000", 2024-04-26T11:13:39.798 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7802000000000002e-05 2024-04-26T11:13:39.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.799 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:39.799 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.768868+0000", 2024-04-26T11:13:39.799 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1421e-05 2024-04-26T11:13:39.799 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:39.799 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:39.799 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:39.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.799 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:7052 5.3 5:c4069450:::benchmark_data_smithi029_44842_object7051:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:39.799 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.769219+0000", 2024-04-26T11:13:39.799 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0013840079999999999, 2024-04-26T11:13:39.799 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019801649999999999, 2024-04-26T11:13:39.799 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:39.799 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:39.800 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:39.800 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:39.800 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:39.800 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 7052 2024-04-26T11:13:39.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.800 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:39.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.800 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:39.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.769219+0000", 2024-04-26T11:13:39.800 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:39.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.800 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:39.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.769219+0000", 2024-04-26T11:13:39.800 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:39.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.801 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:39.801 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.769218+0000", 2024-04-26T11:13:39.801 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:39.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.801 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:39.801 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.769290+0000", 2024-04-26T11:13:39.801 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2631000000000003e-05 2024-04-26T11:13:39.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.801 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:39.801 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.769298+0000", 2024-04-26T11:13:39.802 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3409999999999997e-06 2024-04-26T11:13:39.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.802 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.802 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.769302+0000", 2024-04-26T11:13:39.802 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.391e-06 2024-04-26T11:13:39.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.802 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:39.802 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.769333+0000", 2024-04-26T11:13:39.802 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0723999999999999e-05 2024-04-26T11:13:39.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.802 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:39.803 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.769408+0000", 2024-04-26T11:13:39.803 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4667999999999997e-05 2024-04-26T11:13:39.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.803 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:39.803 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.769490+0000", 2024-04-26T11:13:39.803 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2569000000000002e-05 2024-04-26T11:13:39.803 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:39.803 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:39.803 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:39.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.803 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:7056 5.3 5:c0602280:::benchmark_data_smithi029_44842_object7055:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:39.803 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.770320+0000", 2024-04-26T11:13:39.804 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00028280699999999999, 2024-04-26T11:13:39.804 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00096913100000000003, 2024-04-26T11:13:39.804 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:39.804 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:39.804 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:39.804 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:39.804 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:39.804 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 7056 2024-04-26T11:13:39.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.804 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:39.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.804 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:39.804 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770320+0000", 2024-04-26T11:13:39.804 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:39.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.805 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:39.805 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770320+0000", 2024-04-26T11:13:39.805 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:39.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.805 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:39.805 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770319+0000", 2024-04-26T11:13:39.805 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.805 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:39.805 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770484+0000", 2024-04-26T11:13:39.805 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00016510799999999999 2024-04-26T11:13:39.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.806 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.806 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:39.806 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770493+0000", 2024-04-26T11:13:39.806 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4330000000000004e-06 2024-04-26T11:13:39.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.806 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.806 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.806 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770498+0000", 2024-04-26T11:13:39.806 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8189999999999997e-06 2024-04-26T11:13:39.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.806 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.806 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:39.806 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770538+0000", 2024-04-26T11:13:39.806 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9107999999999999e-05 2024-04-26T11:13:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770676+0000", 2024-04-26T11:13:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013847100000000001 2024-04-26T11:13:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770833+0000", 2024-04-26T11:13:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015692500000000001 2024-04-26T11:13:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.808 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.808 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:7053 5.e e19/16 5:730f33d3:::benchmark_data_smithi029_44842_object7052:head v 19'412, mlcod=19'410)", 2024-04-26T11:13:39.808 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.770518+0000", 2024-04-26T11:13:39.808 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.4728999999999995e-05, 2024-04-26T11:13:39.808 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00082986400000000004, 2024-04-26T11:13:39.808 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:39.808 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:39.808 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:39.808 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.808 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:39.808 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770518+0000", 2024-04-26T11:13:39.808 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:39.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.808 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.808 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:39.809 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770518+0000", 2024-04-26T11:13:39.809 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:39.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.809 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.809 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:39.809 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770517+0000", 2024-04-26T11:13:39.809 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.809 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.809 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:39.809 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770575+0000", 2024-04-26T11:13:39.809 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7507999999999999e-05 2024-04-26T11:13:39.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.809 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.809 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:39.810 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770584+0000", 2024-04-26T11:13:39.810 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3689999999999996e-06 2024-04-26T11:13:39.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.810 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.810 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.810 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770589+0000", 2024-04-26T11:13:39.810 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1499999999999998e-06 2024-04-26T11:13:39.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.810 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.810 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:39.810 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770618+0000", 2024-04-26T11:13:39.810 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9167e-05 2024-04-26T11:13:39.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.811 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:39.811 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770637+0000", 2024-04-26T11:13:39.811 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8291000000000002e-05 2024-04-26T11:13:39.811 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:39.811 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:39.811 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:39.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.811 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:7057 5.8 e19/16 5:1b0d6d74:::benchmark_data_smithi029_44842_object7056:head v 19'467, mlcod=19'463)", 2024-04-26T11:13:39.811 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.770763+0000", 2024-04-26T11:13:39.811 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9998398, 2024-04-26T11:13:39.811 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00062859199999999997, 2024-04-26T11:13:39.811 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:39.811 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:39.812 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:39.812 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.812 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:39.812 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770763+0000", 2024-04-26T11:13:39.812 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:39.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.812 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.812 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:39.812 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770763+0000", 2024-04-26T11:13:39.812 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:39.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.812 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.812 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:39.812 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770762+0000", 2024-04-26T11:13:39.812 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.813 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.813 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:39.813 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770826+0000", 2024-04-26T11:13:39.813 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3928000000000002e-05 2024-04-26T11:13:39.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.813 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.813 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:39.813 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770834+0000", 2024-04-26T11:13:39.813 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7419999999999997e-06 2024-04-26T11:13:39.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.813 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.813 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.813 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770839+0000", 2024-04-26T11:13:39.813 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0440000000000003e-06 2024-04-26T11:13:39.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.814 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.814 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:39.814 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770875+0000", 2024-04-26T11:13:39.814 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5457999999999998e-05 2024-04-26T11:13:39.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.814 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.814 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:39.814 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770890+0000", 2024-04-26T11:13:39.814 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5537999999999999e-05 2024-04-26T11:13:39.814 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:39.814 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:39.814 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:39.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.815 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.815 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:7058 5.5 5:ad8ae3c8:::benchmark_data_smithi029_44842_object7057:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:39.815 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.771052+0000", 2024-04-26T11:13:39.815 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9995503, 2024-04-26T11:13:39.815 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037718400000000003, 2024-04-26T11:13:39.815 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:39.815 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:39.815 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:39.815 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:39.815 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:39.815 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 7058 2024-04-26T11:13:39.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.815 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:39.815 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.816 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:39.816 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.771052+0000", 2024-04-26T11:13:39.816 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:39.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.816 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.816 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:39.816 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.771052+0000", 2024-04-26T11:13:39.816 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:39.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.816 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.816 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:39.816 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.771051+0000", 2024-04-26T11:13:39.816 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:39.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.816 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.817 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:39.817 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.771151+0000", 2024-04-26T11:13:39.817 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.9574999999999994e-05 2024-04-26T11:13:39.817 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.817 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.817 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:39.817 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.771159+0000", 2024-04-26T11:13:39.817 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5310000000000004e-06 2024-04-26T11:13:39.817 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.817 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.817 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:39.817 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.771163+0000", 2024-04-26T11:13:39.817 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8099999999999997e-06 2024-04-26T11:13:39.817 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.817 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.771206+0000", 2024-04-26T11:13:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2131e-05 2024-04-26T11:13:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.771329+0000", 2024-04-26T11:13:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012381299999999999 2024-04-26T11:13:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:13:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 11 2024-04-26T11:13:39.818 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:13:39.820 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:39.819+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:39.820 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:13:39.921 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:39.919+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:40.006 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:13:40.006 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:13:40.006 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:13:40.006 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:13:40.006 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:13:40.021 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:13:40.022 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:40.021+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:40.123 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:40.121+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:40.155 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --admin-daemon /var/run/ceph/ceph-client.0.asok objecter_requests 2024-04-26T11:13:40.209 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:13:40.209 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:13:40.209 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:13:40.209 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:13:40.209 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.209 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:40.209 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:12.906196+0000", 2024-04-26T11:13:40.209 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 27.298912669, 2024-04-26T11:13:40.209 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0082657200000000007, 2024-04-26T11:13:40.209 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:40.210 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:40.210 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:40.210 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.210 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:40.210 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.906196+0000", 2024-04-26T11:13:40.210 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.210 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.210 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.210 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:40.210 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.906196+0000", 2024-04-26T11:13:40.210 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.210 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.210 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.211 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:40.211 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.906195+0000", 2024-04-26T11:13:40.211 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:40.211 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.211 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.211 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:40.211 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.906201+0000", 2024-04-26T11:13:40.211 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8549999999999998e-06 2024-04-26T11:13:40.211 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.211 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.211 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:40.211 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.906208+0000", 2024-04-26T11:13:40.211 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5989999999999998e-06 2024-04-26T11:13:40.211 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.211 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.212 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:40.212 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.906216+0000", 2024-04-26T11:13:40.212 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9140000000000008e-06 2024-04-26T11:13:40.212 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.212 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.212 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:40.212 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.907200+0000", 2024-04-26T11:13:40.212 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00098491099999999999 2024-04-26T11:13:40.212 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.212 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.212 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:40.212 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.907275+0000", 2024-04-26T11:13:40.212 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.483e-05 2024-04-26T11:13:40.212 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.213 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.213 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:40.213 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.907396+0000", 2024-04-26T11:13:40.213 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000120969 2024-04-26T11:13:40.213 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.213 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.213 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:40.213 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.908547+0000", 2024-04-26T11:13:40.213 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0011511970000000001 2024-04-26T11:13:40.213 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.213 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.213 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:40.213 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.914387+0000", 2024-04-26T11:13:40.213 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0058390359999999997 2024-04-26T11:13:40.213 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.214 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.214 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:40.214 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.914419+0000", 2024-04-26T11:13:40.214 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2308000000000003e-05 2024-04-26T11:13:40.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.214 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.214 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:40.214 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.914462+0000", 2024-04-26T11:13:40.214 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2796000000000002e-05 2024-04-26T11:13:40.214 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.214 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:40.214 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.214 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.215 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:20 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:40.215 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:12.906220+0000", 2024-04-26T11:13:40.215 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 27.298888300000002, 2024-04-26T11:13:40.215 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0086464330000000002, 2024-04-26T11:13:40.215 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:40.215 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:40.215 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:40.215 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.215 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:40.215 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.906220+0000", 2024-04-26T11:13:40.215 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.215 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.215 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.215 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:40.216 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.906220+0000", 2024-04-26T11:13:40.216 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.216 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.216 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.216 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:40.216 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.906220+0000", 2024-04-26T11:13:40.216 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:40.216 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.216 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.216 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:40.216 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.906224+0000", 2024-04-26T11:13:40.216 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8550000000000004e-06 2024-04-26T11:13:40.216 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.216 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.216 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:40.217 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.906230+0000", 2024-04-26T11:13:40.217 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.964e-06 2024-04-26T11:13:40.217 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.217 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.217 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:40.217 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.906234+0000", 2024-04-26T11:13:40.217 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7960000000000003e-06 2024-04-26T11:13:40.217 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.217 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.217 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:40.217 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.907214+0000", 2024-04-26T11:13:40.217 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00097952900000000003 2024-04-26T11:13:40.217 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.217 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.218 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:40.218 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.907320+0000", 2024-04-26T11:13:40.218 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105859 2024-04-26T11:13:40.218 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.218 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.218 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:40.218 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.907442+0000", 2024-04-26T11:13:40.218 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000122125 2024-04-26T11:13:40.218 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.218 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.218 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:40.218 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.908553+0000", 2024-04-26T11:13:40.218 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00111093 2024-04-26T11:13:40.218 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.219 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.219 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:40.219 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.914759+0000", 2024-04-26T11:13:40.219 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0062061080000000001 2024-04-26T11:13:40.219 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.219 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.219 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:40.219 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.914810+0000", 2024-04-26T11:13:40.219 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1368e-05 2024-04-26T11:13:40.219 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.219 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.219 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:40.219 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.914867+0000", 2024-04-26T11:13:40.219 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6359e-05 2024-04-26T11:13:40.219 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.220 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:40.220 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.220 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.220 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.220 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(mds.0.3:30 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:40.220 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:12.906286+0000", 2024-04-26T11:13:40.220 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 27.298822598000001, 2024-04-26T11:13:40.220 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0090377730000000007, 2024-04-26T11:13:40.220 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:40.220 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:40.220 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:40.220 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.220 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:40.220 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.906286+0000", 2024-04-26T11:13:40.220 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.221 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.221 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.221 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:40.221 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.906286+0000", 2024-04-26T11:13:40.221 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.221 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.221 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.221 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:40.221 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.906286+0000", 2024-04-26T11:13:40.221 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:40.221 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.221 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.221 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:40.221 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.906290+0000", 2024-04-26T11:13:40.222 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2130000000000002e-06 2024-04-26T11:13:40.222 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.222 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.222 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:40.222 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.906303+0000", 2024-04-26T11:13:40.222 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3431000000000001e-05 2024-04-26T11:13:40.222 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.222 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.222 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:40.222 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.906310+0000", 2024-04-26T11:13:40.222 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4869999999999999e-06 2024-04-26T11:13:40.222 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.222 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.223 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:40.223 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.907776+0000", 2024-04-26T11:13:40.223 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0014660039999999999 2024-04-26T11:13:40.223 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.223 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.223 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:40.223 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.907872+0000", 2024-04-26T11:13:40.223 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6212999999999995e-05 2024-04-26T11:13:40.223 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.223 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.223 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:40.223 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:12.915324+0000", 2024-04-26T11:13:40.223 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0074518190000000002 2024-04-26T11:13:40.223 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.223 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:40.224 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.224 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.224 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.224 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:30 5.c 5:3d1e831e:::benchmark_data_smithi029_44842_object29:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T11:13:40.224 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:38.415790+0000", 2024-04-26T11:13:40.224 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 1.78931902, 2024-04-26T11:13:40.224 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0088360560000000001, 2024-04-26T11:13:40.224 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:40.224 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:40.225 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:40.225 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:40.225 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:40.225 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 30 2024-04-26T11:13:40.226 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.226 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:40.226 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.226 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:40.226 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.415790+0000", 2024-04-26T11:13:40.226 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.226 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.226 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.227 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:40.227 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.415790+0000", 2024-04-26T11:13:40.227 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.227 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.227 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.227 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:40.227 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.415789+0000", 2024-04-26T11:13:40.227 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:40.227 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.227 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.227 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:40.227 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.415905+0000", 2024-04-26T11:13:40.227 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011623199999999999 2024-04-26T11:13:40.227 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.227 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.228 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:40.228 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.415919+0000", 2024-04-26T11:13:40.228 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.345e-05 2024-04-26T11:13:40.228 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.228 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.228 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:40.228 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.415926+0000", 2024-04-26T11:13:40.228 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6459999999999993e-06 2024-04-26T11:13:40.228 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.228 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.228 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:40.228 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.415967+0000", 2024-04-26T11:13:40.228 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1029000000000003e-05 2024-04-26T11:13:40.228 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.229 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.229 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:40.229 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.416091+0000", 2024-04-26T11:13:40.229 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000123542 2024-04-26T11:13:40.229 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.229 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.229 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:40.229 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.416222+0000", 2024-04-26T11:13:40.229 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131555 2024-04-26T11:13:40.229 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.229 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.229 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:40.229 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.417677+0000", 2024-04-26T11:13:40.229 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0014545649999999999 2024-04-26T11:13:40.230 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.230 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.230 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:40.230 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.424579+0000", 2024-04-26T11:13:40.230 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069014879999999999 2024-04-26T11:13:40.230 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.230 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.230 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:40.230 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.424606+0000", 2024-04-26T11:13:40.230 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7189e-05 2024-04-26T11:13:40.230 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.230 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.230 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:40.231 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.424626+0000", 2024-04-26T11:13:40.231 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9899e-05 2024-04-26T11:13:40.231 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.231 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:40.231 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.231 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.231 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.231 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:33 5.3 5:cfc3f8eb:::benchmark_data_smithi029_44842_object32:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T11:13:40.231 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:38.416293+0000", 2024-04-26T11:13:40.231 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 1.788815965, 2024-04-26T11:13:40.231 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0083107400000000005, 2024-04-26T11:13:40.231 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:40.231 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:40.231 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:40.231 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:40.232 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:40.232 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 33 2024-04-26T11:13:40.232 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.232 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:40.232 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.232 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:40.232 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.416293+0000", 2024-04-26T11:13:40.232 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.232 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.232 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.232 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:40.233 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.416293+0000", 2024-04-26T11:13:40.233 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.233 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.233 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.233 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:40.233 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.416292+0000", 2024-04-26T11:13:40.233 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:40.233 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.233 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.233 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:40.233 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.416346+0000", 2024-04-26T11:13:40.233 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3950999999999999e-05 2024-04-26T11:13:40.233 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.234 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.234 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:40.234 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.416354+0000", 2024-04-26T11:13:40.234 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6589999999999996e-06 2024-04-26T11:13:40.234 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.234 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.234 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:40.234 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.416360+0000", 2024-04-26T11:13:40.234 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3839999999999996e-06 2024-04-26T11:13:40.234 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.235 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.235 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:40.235 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.416393+0000", 2024-04-26T11:13:40.235 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3238000000000003e-05 2024-04-26T11:13:40.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.235 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.235 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:40.235 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.416473+0000", 2024-04-26T11:13:40.235 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0296999999999994e-05 2024-04-26T11:13:40.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.235 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.235 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:40.235 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.416548+0000", 2024-04-26T11:13:40.235 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5050999999999997e-05 2024-04-26T11:13:40.236 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.236 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.236 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:40.236 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.417785+0000", 2024-04-26T11:13:40.236 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0012370390000000001 2024-04-26T11:13:40.236 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.236 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.236 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:40.236 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.424554+0000", 2024-04-26T11:13:40.237 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0067681670000000003 2024-04-26T11:13:40.237 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.237 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.237 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:40.237 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.424581+0000", 2024-04-26T11:13:40.237 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7620999999999999e-05 2024-04-26T11:13:40.237 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.237 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.237 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:40.237 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:38.424603+0000", 2024-04-26T11:13:40.237 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2067999999999999e-05 2024-04-26T11:13:40.237 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.237 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:40.237 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.237 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.238 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.238 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:6296 5.3 5:cfdb39ac:::benchmark_data_smithi029_44842_object6295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:40.238 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.618525+0000", 2024-04-26T11:13:40.238 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.58658380799999998, 2024-04-26T11:13:40.238 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.013011356999999999, 2024-04-26T11:13:40.238 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:40.238 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:40.238 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:40.238 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:40.238 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:40.238 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 6296 2024-04-26T11:13:40.238 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.238 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:40.239 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.239 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:40.239 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.618525+0000", 2024-04-26T11:13:40.239 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.239 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.239 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:40.239 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.618525+0000", 2024-04-26T11:13:40.239 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.239 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.239 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:40.239 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.618524+0000", 2024-04-26T11:13:40.239 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:40.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.240 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.240 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:40.240 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.618562+0000", 2024-04-26T11:13:40.240 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7410000000000003e-05 2024-04-26T11:13:40.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.240 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.240 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:40.240 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.618570+0000", 2024-04-26T11:13:40.240 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9670000000000001e-06 2024-04-26T11:13:40.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.240 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.240 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:40.240 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.618576+0000", 2024-04-26T11:13:40.240 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0449999999999997e-06 2024-04-26T11:13:40.241 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.241 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.241 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:40.241 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.619346+0000", 2024-04-26T11:13:40.241 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00077031500000000004 2024-04-26T11:13:40.241 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.241 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.241 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:40.241 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.619464+0000", 2024-04-26T11:13:40.241 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000117854 2024-04-26T11:13:40.241 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.241 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.241 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:40.241 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.619622+0000", 2024-04-26T11:13:40.242 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015853300000000001 2024-04-26T11:13:40.242 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.242 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.242 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:40.242 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.622658+0000", 2024-04-26T11:13:40.242 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0030353189999999999 2024-04-26T11:13:40.242 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.242 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.242 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:40.242 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.631483+0000", 2024-04-26T11:13:40.242 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0088249629999999999 2024-04-26T11:13:40.242 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.242 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.242 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:40.243 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.631513+0000", 2024-04-26T11:13:40.243 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0552999999999997e-05 2024-04-26T11:13:40.243 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.243 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.243 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:40.243 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.631536+0000", 2024-04-26T11:13:40.243 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3008000000000001e-05 2024-04-26T11:13:40.243 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.243 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:40.243 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.243 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.243 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.243 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:6297 5.3 5:cf99edcf:::benchmark_data_smithi029_44842_object6296:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:40.244 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.618584+0000", 2024-04-26T11:13:40.244 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.58652477800000002, 2024-04-26T11:13:40.244 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.013036865999999999, 2024-04-26T11:13:40.244 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:40.244 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:40.244 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:40.244 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:40.244 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:40.244 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 6297 2024-04-26T11:13:40.244 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.244 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:40.244 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.245 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:40.245 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.618584+0000", 2024-04-26T11:13:40.245 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.245 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.245 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.245 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:40.245 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.618584+0000", 2024-04-26T11:13:40.245 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.245 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.245 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.245 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:40.245 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.618583+0000", 2024-04-26T11:13:40.245 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:40.245 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.246 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.246 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:40.246 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.618611+0000", 2024-04-26T11:13:40.246 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7557999999999999e-05 2024-04-26T11:13:40.246 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.246 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.246 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:40.246 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.618622+0000", 2024-04-26T11:13:40.246 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1365999999999999e-05 2024-04-26T11:13:40.246 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.246 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.246 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:40.246 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.618630+0000", 2024-04-26T11:13:40.246 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0239999999999997e-06 2024-04-26T11:13:40.247 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.247 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.247 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:40.247 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.620559+0000", 2024-04-26T11:13:40.247 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019292339999999999 2024-04-26T11:13:40.247 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.247 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.247 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:40.247 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.620674+0000", 2024-04-26T11:13:40.247 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000114888 2024-04-26T11:13:40.247 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.247 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.247 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:40.247 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.620920+0000", 2024-04-26T11:13:40.247 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00024578300000000001 2024-04-26T11:13:40.248 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.248 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.248 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:40.248 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.622770+0000", 2024-04-26T11:13:40.248 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0018500599999999999 2024-04-26T11:13:40.248 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.248 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.248 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:40.248 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.631561+0000", 2024-04-26T11:13:40.248 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0087910030000000004 2024-04-26T11:13:40.248 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.248 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.248 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:40.248 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.631592+0000", 2024-04-26T11:13:40.249 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1137999999999999e-05 2024-04-26T11:13:40.249 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.249 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.249 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:40.249 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.631621+0000", 2024-04-26T11:13:40.249 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8370000000000001e-05 2024-04-26T11:13:40.249 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.249 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:40.249 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.249 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.249 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.249 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:6305 5.5 5:acabf149:::benchmark_data_smithi029_44842_object6304:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:40.249 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.619714+0000", 2024-04-26T11:13:40.249 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.58539486100000004, 2024-04-26T11:13:40.249 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011829841000000001, 2024-04-26T11:13:40.250 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:40.250 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:40.250 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:40.250 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:40.250 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:40.250 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 6305 2024-04-26T11:13:40.250 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.250 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:40.250 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.250 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:40.250 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.619714+0000", 2024-04-26T11:13:40.250 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.250 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.250 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.251 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:40.251 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.619714+0000", 2024-04-26T11:13:40.251 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.251 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.251 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:40.251 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.619713+0000", 2024-04-26T11:13:40.251 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:40.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.251 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.251 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:40.251 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.619802+0000", 2024-04-26T11:13:40.251 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.844e-05 2024-04-26T11:13:40.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.252 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.252 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:40.252 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.619811+0000", 2024-04-26T11:13:40.252 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4450000000000002e-06 2024-04-26T11:13:40.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.252 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.252 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:40.252 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.619818+0000", 2024-04-26T11:13:40.252 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8090000000000004e-06 2024-04-26T11:13:40.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.252 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.252 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:40.252 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.620440+0000", 2024-04-26T11:13:40.252 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00062161300000000003 2024-04-26T11:13:40.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.253 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.253 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:40.253 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.620558+0000", 2024-04-26T11:13:40.253 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000118182 2024-04-26T11:13:40.253 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.253 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.253 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:40.253 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.620802+0000", 2024-04-26T11:13:40.253 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00024447200000000003 2024-04-26T11:13:40.253 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.253 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.253 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:40.253 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.622743+0000", 2024-04-26T11:13:40.253 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019411929999999999 2024-04-26T11:13:40.253 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.254 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.254 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:40.254 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.631482+0000", 2024-04-26T11:13:40.254 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0087384730000000001 2024-04-26T11:13:40.254 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.254 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.254 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:40.254 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.631511+0000", 2024-04-26T11:13:40.254 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9132000000000002e-05 2024-04-26T11:13:40.254 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.254 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.254 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:40.254 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.631544+0000", 2024-04-26T11:13:40.255 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2577999999999999e-05 2024-04-26T11:13:40.255 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.255 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:40.255 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.255 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.255 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.255 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:6320 5.3 5:c6abbb3f:::benchmark_data_smithi029_44842_object6319:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:40.255 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.623546+0000", 2024-04-26T11:13:40.255 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.58156209800000003, 2024-04-26T11:13:40.255 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0081701659999999995, 2024-04-26T11:13:40.255 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:40.255 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:40.255 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:40.255 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:40.255 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:40.256 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 6320 2024-04-26T11:13:40.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.256 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:40.256 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.256 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:40.256 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.623546+0000", 2024-04-26T11:13:40.256 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.256 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.256 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:40.256 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.623546+0000", 2024-04-26T11:13:40.256 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.256 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.257 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:40.257 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.623545+0000", 2024-04-26T11:13:40.257 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:40.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.257 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.257 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:40.257 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.623629+0000", 2024-04-26T11:13:40.257 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3572000000000006e-05 2024-04-26T11:13:40.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.257 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.257 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:40.257 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.623638+0000", 2024-04-26T11:13:40.257 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5979999999999997e-06 2024-04-26T11:13:40.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.258 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.258 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:40.258 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.623644+0000", 2024-04-26T11:13:40.258 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6320000000000002e-06 2024-04-26T11:13:40.258 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.258 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.258 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:40.258 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.623687+0000", 2024-04-26T11:13:40.258 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2487000000000002e-05 2024-04-26T11:13:40.258 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.258 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.258 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:40.258 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.623820+0000", 2024-04-26T11:13:40.258 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000133127 2024-04-26T11:13:40.258 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.259 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.259 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:40.259 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.623980+0000", 2024-04-26T11:13:40.259 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00016056100000000001 2024-04-26T11:13:40.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.259 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.259 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:40.259 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.625461+0000", 2024-04-26T11:13:40.259 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001480784 2024-04-26T11:13:40.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.259 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.259 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:40.259 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.631657+0000", 2024-04-26T11:13:40.259 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0061955580000000003 2024-04-26T11:13:40.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.260 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.260 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:40.260 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.631693+0000", 2024-04-26T11:13:40.260 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6282000000000003e-05 2024-04-26T11:13:40.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.260 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.260 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:40.260 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.631717+0000", 2024-04-26T11:13:40.260 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3688000000000001e-05 2024-04-26T11:13:40.260 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.260 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:40.260 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.261 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.261 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:7057 5.8 e19/16 5:1b0d6d74:::benchmark_data_smithi029_44842_object7056:head v 19'467, mlcod=19'463)", 2024-04-26T11:13:40.261 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.770763+0000", 2024-04-26T11:13:40.261 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.43434576000000003, 2024-04-26T11:13:40.261 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011857968, 2024-04-26T11:13:40.261 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:40.261 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:40.261 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:40.261 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.261 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:40.261 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770763+0000", 2024-04-26T11:13:40.261 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.261 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.261 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:40.262 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770763+0000", 2024-04-26T11:13:40.262 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.262 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.262 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:40.262 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770762+0000", 2024-04-26T11:13:40.262 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:40.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.262 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.262 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:40.262 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770826+0000", 2024-04-26T11:13:40.262 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3928000000000002e-05 2024-04-26T11:13:40.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.263 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.263 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:40.263 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770834+0000", 2024-04-26T11:13:40.263 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7419999999999997e-06 2024-04-26T11:13:40.263 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.263 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.263 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:40.263 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770839+0000", 2024-04-26T11:13:40.263 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0440000000000003e-06 2024-04-26T11:13:40.263 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.263 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.263 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:40.263 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770875+0000", 2024-04-26T11:13:40.263 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5457999999999998e-05 2024-04-26T11:13:40.263 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.264 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.264 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:40.264 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770890+0000", 2024-04-26T11:13:40.264 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5537999999999999e-05 2024-04-26T11:13:40.264 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.264 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.264 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:40.264 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.782593+0000", 2024-04-26T11:13:40.264 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011702414 2024-04-26T11:13:40.264 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.264 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.264 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:40.264 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.782621+0000", 2024-04-26T11:13:40.264 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8197000000000001e-05 2024-04-26T11:13:40.264 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.265 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:40.265 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.265 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.265 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.265 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:7063 5.8 e19/16 5:14ea871e:::benchmark_data_smithi029_44842_object7062:head v 19'468, mlcod=19'465)", 2024-04-26T11:13:40.265 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.773370+0000", 2024-04-26T11:13:40.265 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.431738654, 2024-04-26T11:13:40.265 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0092770909999999995, 2024-04-26T11:13:40.265 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:40.265 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:40.265 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:40.265 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.265 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:40.265 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.773370+0000", 2024-04-26T11:13:40.266 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.266 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.266 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.266 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:40.266 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.773370+0000", 2024-04-26T11:13:40.266 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.266 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.266 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.266 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:40.266 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.773369+0000", 2024-04-26T11:13:40.266 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:40.266 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.266 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.266 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:40.267 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.773472+0000", 2024-04-26T11:13:40.267 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010264000000000001 2024-04-26T11:13:40.267 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.267 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.267 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:40.267 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.773480+0000", 2024-04-26T11:13:40.267 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3999999999999992e-06 2024-04-26T11:13:40.267 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.267 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.267 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:40.267 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.773486+0000", 2024-04-26T11:13:40.267 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9059999999999999e-06 2024-04-26T11:13:40.267 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.268 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.268 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:40.268 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.773520+0000", 2024-04-26T11:13:40.268 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3748999999999998e-05 2024-04-26T11:13:40.268 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.268 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.268 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:40.268 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.773541+0000", 2024-04-26T11:13:40.268 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0786000000000001e-05 2024-04-26T11:13:40.268 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.268 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.268 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:40.268 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.782624+0000", 2024-04-26T11:13:40.268 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0090831920000000003 2024-04-26T11:13:40.268 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.269 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.269 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:40.269 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.782647+0000", 2024-04-26T11:13:40.269 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3042000000000001e-05 2024-04-26T11:13:40.269 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.269 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:40.269 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.269 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.269 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.269 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:7071 5.8 e19/16 5:1b75697f:::benchmark_data_smithi029_44842_object7070:head v 19'469, mlcod=19'465)", 2024-04-26T11:13:40.269 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.774426+0000", 2024-04-26T11:13:40.269 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.43068263499999998, 2024-04-26T11:13:40.269 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0082458589999999995, 2024-04-26T11:13:40.269 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:40.270 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:40.270 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:40.270 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.270 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:40.270 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.774426+0000", 2024-04-26T11:13:40.270 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.270 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.271 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.271 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:40.271 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.774426+0000", 2024-04-26T11:13:40.271 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.271 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.271 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.271 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:40.272 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.774426+0000", 2024-04-26T11:13:40.272 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:40.272 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.272 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.272 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:40.272 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.774494+0000", 2024-04-26T11:13:40.272 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8084999999999996e-05 2024-04-26T11:13:40.272 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.272 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.272 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:40.272 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.774505+0000", 2024-04-26T11:13:40.272 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1001e-05 2024-04-26T11:13:40.272 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.273 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.273 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:40.273 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.774509+0000", 2024-04-26T11:13:40.273 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2810000000000002e-06 2024-04-26T11:13:40.273 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.273 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.273 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:40.273 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.774538+0000", 2024-04-26T11:13:40.273 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9110000000000001e-05 2024-04-26T11:13:40.273 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.273 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.273 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:40.273 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.774556+0000", 2024-04-26T11:13:40.273 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8102e-05 2024-04-26T11:13:40.274 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.274 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.274 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:40.274 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.782649+0000", 2024-04-26T11:13:40.274 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0080929520000000005 2024-04-26T11:13:40.274 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.274 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.274 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:40.274 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.782672+0000", 2024-04-26T11:13:40.274 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2668e-05 2024-04-26T11:13:40.274 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.274 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:40.274 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.274 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.275 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.275 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:8075 5.b e19/16 5:d6469e12:::benchmark_data_smithi029_44842_object8074:head v 19'510, mlcod=19'508)", 2024-04-26T11:13:40.275 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.984159+0000", 2024-04-26T11:13:40.275 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.220950068, 2024-04-26T11:13:40.275 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.010975554, 2024-04-26T11:13:40.275 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:40.275 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:40.275 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:40.275 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.275 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:40.275 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.984159+0000", 2024-04-26T11:13:40.275 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.275 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.275 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.275 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:40.276 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.984159+0000", 2024-04-26T11:13:40.276 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.276 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.276 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.276 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:40.276 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.984158+0000", 2024-04-26T11:13:40.276 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:40.276 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.276 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.276 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:40.276 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.984184+0000", 2024-04-26T11:13:40.276 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6270000000000001e-05 2024-04-26T11:13:40.276 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.276 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.276 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:40.277 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.984195+0000", 2024-04-26T11:13:40.277 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1381e-05 2024-04-26T11:13:40.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.277 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.277 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:40.277 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.984202+0000", 2024-04-26T11:13:40.277 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2269999999999998e-06 2024-04-26T11:13:40.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.277 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.277 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:40.277 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.984236+0000", 2024-04-26T11:13:40.277 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4721000000000002e-05 2024-04-26T11:13:40.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.277 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.277 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:40.278 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.984255+0000", 2024-04-26T11:13:40.278 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8349999999999999e-05 2024-04-26T11:13:40.278 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.278 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.278 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:40.278 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.995090+0000", 2024-04-26T11:13:40.278 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.010835067 2024-04-26T11:13:40.278 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.278 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.278 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:40.278 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.995134+0000", 2024-04-26T11:13:40.278 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4208000000000001e-05 2024-04-26T11:13:40.278 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.278 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:40.279 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.279 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.279 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.279 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:8084 5.b e19/16 5:d9ae26e8:::benchmark_data_smithi029_44842_object8083:head v 19'511, mlcod=19'508)", 2024-04-26T11:13:40.279 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.986746+0000", 2024-04-26T11:13:40.279 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.218362525, 2024-04-26T11:13:40.279 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0084314119999999992, 2024-04-26T11:13:40.279 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:40.279 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:40.279 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:40.279 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.279 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:40.279 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.986746+0000", 2024-04-26T11:13:40.279 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.280 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.280 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:40.280 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.986746+0000", 2024-04-26T11:13:40.280 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.280 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.280 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:40.280 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.986745+0000", 2024-04-26T11:13:40.280 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:40.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.280 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.280 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:40.280 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.986804+0000", 2024-04-26T11:13:40.280 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8318e-05 2024-04-26T11:13:40.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.281 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.281 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:40.281 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.986812+0000", 2024-04-26T11:13:40.281 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7919999999999998e-06 2024-04-26T11:13:40.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.281 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.281 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:40.281 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.986819+0000", 2024-04-26T11:13:40.281 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:13:40.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.281 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.281 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:40.281 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.986869+0000", 2024-04-26T11:13:40.282 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.9384e-05 2024-04-26T11:13:40.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.282 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.282 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:40.282 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.986886+0000", 2024-04-26T11:13:40.282 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7424000000000001e-05 2024-04-26T11:13:40.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.282 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.282 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:40.282 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.995137+0000", 2024-04-26T11:13:40.282 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0082507210000000008 2024-04-26T11:13:40.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.282 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.282 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:40.283 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.995177+0000", 2024-04-26T11:13:40.283 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0670000000000002e-05 2024-04-26T11:13:40.283 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.283 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:40.283 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.283 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.283 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:8119 5.4 e19/16 5:236ef8ee:::benchmark_data_smithi029_44842_object8118:head v 19'504, mlcod=19'501)", 2024-04-26T11:13:40.283 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.993623+0000", 2024-04-26T11:13:40.283 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.21148568500000001, 2024-04-26T11:13:40.283 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.012556217, 2024-04-26T11:13:40.283 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:40.283 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:40.283 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:40.283 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.284 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:40.284 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.993623+0000", 2024-04-26T11:13:40.284 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.284 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.284 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:40.284 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.993623+0000", 2024-04-26T11:13:40.284 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.284 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.284 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:40.284 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.993622+0000", 2024-04-26T11:13:40.284 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:40.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.285 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.285 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:40.285 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.993685+0000", 2024-04-26T11:13:40.285 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2333000000000001e-05 2024-04-26T11:13:40.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.285 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.285 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:40.285 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.993693+0000", 2024-04-26T11:13:40.285 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3469999999999999e-06 2024-04-26T11:13:40.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.285 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.285 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:40.285 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.993699+0000", 2024-04-26T11:13:40.286 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1290000000000001e-06 2024-04-26T11:13:40.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.286 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.286 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:40.286 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.993788+0000", 2024-04-26T11:13:40.286 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.8442999999999993e-05 2024-04-26T11:13:40.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.286 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.286 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:40.286 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.993807+0000", 2024-04-26T11:13:40.286 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9196999999999999e-05 2024-04-26T11:13:40.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.287 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.287 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:40.287 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:40.006149+0000", 2024-04-26T11:13:40.287 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.012342027 2024-04-26T11:13:40.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.287 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.287 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:40.287 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:40.006179+0000", 2024-04-26T11:13:40.287 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0273999999999998e-05 2024-04-26T11:13:40.287 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.287 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:40.287 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.287 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.288 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:8131 5.4 e19/16 5:246ac140:::benchmark_data_smithi029_44842_object8130:head v 19'505, mlcod=19'502)", 2024-04-26T11:13:40.288 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.996151+0000", 2024-04-26T11:13:40.288 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.208957223, 2024-04-26T11:13:40.288 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.010050699999999999, 2024-04-26T11:13:40.288 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:40.288 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:40.288 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:40.288 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.288 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:40.288 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.996151+0000", 2024-04-26T11:13:40.288 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.288 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.288 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:40.288 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.996151+0000", 2024-04-26T11:13:40.289 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.289 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.289 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:40.289 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.996151+0000", 2024-04-26T11:13:40.289 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:40.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.289 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.289 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:40.289 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.996326+0000", 2024-04-26T11:13:40.289 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017513500000000001 2024-04-26T11:13:40.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.289 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.289 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:40.290 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.996333+0000", 2024-04-26T11:13:40.290 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0600000000000002e-06 2024-04-26T11:13:40.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.290 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:40.290 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.996340+0000", 2024-04-26T11:13:40.290 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.002e-06 2024-04-26T11:13:40.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.290 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:40.290 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.996545+0000", 2024-04-26T11:13:40.290 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00020515799999999999 2024-04-26T11:13:40.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.290 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:40.291 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.996556+0000", 2024-04-26T11:13:40.291 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1215e-05 2024-04-26T11:13:40.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.291 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.291 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:40.291 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:40.006181+0000", 2024-04-26T11:13:40.291 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0096248670000000005 2024-04-26T11:13:40.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.291 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.291 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:40.291 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:40.006202+0000", 2024-04-26T11:13:40.291 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0811000000000001e-05 2024-04-26T11:13:40.291 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.291 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:40.292 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.292 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.292 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:8137 5.4 e19/16 5:2e8ff912:::benchmark_data_smithi029_44842_object8136:head v 19'506, mlcod=19'502)", 2024-04-26T11:13:40.292 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.997100+0000", 2024-04-26T11:13:40.292 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.208008848, 2024-04-26T11:13:40.292 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0091245460000000007, 2024-04-26T11:13:40.292 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:40.292 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:40.292 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:40.292 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.292 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:40.292 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997100+0000", 2024-04-26T11:13:40.292 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.293 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.293 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:40.293 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997100+0000", 2024-04-26T11:13:40.293 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.293 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.293 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:40.293 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997099+0000", 2024-04-26T11:13:40.293 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:40.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.293 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.293 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:40.293 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997166+0000", 2024-04-26T11:13:40.293 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6403999999999996e-05 2024-04-26T11:13:40.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.294 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.294 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:40.294 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997175+0000", 2024-04-26T11:13:40.294 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2990000000000002e-06 2024-04-26T11:13:40.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.294 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.294 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:40.294 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997184+0000", 2024-04-26T11:13:40.294 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3749999999999992e-06 2024-04-26T11:13:40.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.294 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.294 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:40.294 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997221+0000", 2024-04-26T11:13:40.295 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6616000000000003e-05 2024-04-26T11:13:40.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.295 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.295 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:40.295 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997242+0000", 2024-04-26T11:13:40.295 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1154000000000001e-05 2024-04-26T11:13:40.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.295 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.295 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:40.295 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:40.006204+0000", 2024-04-26T11:13:40.295 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089623429999999994 2024-04-26T11:13:40.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.295 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.295 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:40.296 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:40.006224+0000", 2024-04-26T11:13:40.296 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9913000000000001e-05 2024-04-26T11:13:40.296 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.296 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:40.296 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.296 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.296 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:8141 5.a 5:5ba24e8a:::benchmark_data_smithi029_44842_object8140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:40.296 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.997283+0000", 2024-04-26T11:13:40.296 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.20782581999999999, 2024-04-26T11:13:40.296 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0086299159999999996, 2024-04-26T11:13:40.296 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:40.296 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:40.296 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:40.296 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:40.297 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:40.297 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 8141 2024-04-26T11:13:40.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.297 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:40.297 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.297 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:40.297 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997283+0000", 2024-04-26T11:13:40.297 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.297 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.297 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:40.297 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997283+0000", 2024-04-26T11:13:40.297 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.298 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.298 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:40.298 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997282+0000", 2024-04-26T11:13:40.298 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:40.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.298 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.298 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:40.298 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997351+0000", 2024-04-26T11:13:40.298 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9517000000000005e-05 2024-04-26T11:13:40.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.298 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.298 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:40.298 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997363+0000", 2024-04-26T11:13:40.298 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1479e-05 2024-04-26T11:13:40.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.299 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.299 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:40.299 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997371+0000", 2024-04-26T11:13:40.299 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6899999999999992e-06 2024-04-26T11:13:40.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.299 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.299 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:40.299 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997413+0000", 2024-04-26T11:13:40.299 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2240999999999998e-05 2024-04-26T11:13:40.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.299 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.299 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:40.299 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997547+0000", 2024-04-26T11:13:40.299 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013407 2024-04-26T11:13:40.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.300 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.300 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:40.300 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997683+0000", 2024-04-26T11:13:40.300 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013636 2024-04-26T11:13:40.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.300 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.300 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:40.300 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:40.001692+0000", 2024-04-26T11:13:40.300 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.004008246 2024-04-26T11:13:40.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.300 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.300 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:40.300 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:40.005821+0000", 2024-04-26T11:13:40.301 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0041289849999999999 2024-04-26T11:13:40.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.301 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.301 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:40.301 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:40.005873+0000", 2024-04-26T11:13:40.301 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2086000000000002e-05 2024-04-26T11:13:40.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.302 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.302 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:40.302 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:40.005913+0000", 2024-04-26T11:13:40.302 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0024999999999997e-05 2024-04-26T11:13:40.302 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.302 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:40.302 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.302 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.302 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:8134 5.1 e19/16 5:8133523f:::benchmark_data_smithi029_44842_object8133:head v 19'513, mlcod=19'510)", 2024-04-26T11:13:40.302 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.997607+0000", 2024-04-26T11:13:40.303 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.20750148900000001, 2024-04-26T11:13:40.303 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0082029379999999999, 2024-04-26T11:13:40.303 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:40.303 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:40.303 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:40.303 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.303 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:40.303 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997607+0000", 2024-04-26T11:13:40.303 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.303 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.303 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:40.303 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997607+0000", 2024-04-26T11:13:40.303 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.304 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.304 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:40.304 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997607+0000", 2024-04-26T11:13:40.304 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:40.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.304 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.304 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:40.304 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997662+0000", 2024-04-26T11:13:40.304 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5541999999999998e-05 2024-04-26T11:13:40.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.304 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.304 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:40.304 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997671+0000", 2024-04-26T11:13:40.304 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9299999999999992e-06 2024-04-26T11:13:40.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.305 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:40.305 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997677+0000", 2024-04-26T11:13:40.305 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9950000000000002e-06 2024-04-26T11:13:40.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.305 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:40.305 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997710+0000", 2024-04-26T11:13:40.305 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3469000000000001e-05 2024-04-26T11:13:40.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.305 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:40.305 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997730+0000", 2024-04-26T11:13:40.306 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9324e-05 2024-04-26T11:13:40.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.306 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.306 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:40.306 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:40.005781+0000", 2024-04-26T11:13:40.306 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0080507410000000001 2024-04-26T11:13:40.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.306 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.306 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:40.306 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:40.005810+0000", 2024-04-26T11:13:40.306 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9465999999999999e-05 2024-04-26T11:13:40.306 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.306 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:40.306 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.307 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.307 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:8142 5.c 5:3968da4b:::benchmark_data_smithi029_44842_object8141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:40.307 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.997747+0000", 2024-04-26T11:13:40.307 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.20736200299999999, 2024-04-26T11:13:40.307 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0081758279999999996, 2024-04-26T11:13:40.307 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:40.307 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:40.307 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:40.307 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:40.307 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:40.307 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 8142 2024-04-26T11:13:40.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.307 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:40.308 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.308 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:40.308 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997747+0000", 2024-04-26T11:13:40.308 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.308 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.308 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.308 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:40.308 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997747+0000", 2024-04-26T11:13:40.308 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:40.308 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.308 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.308 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:40.308 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.997746+0000", 2024-04-26T11:13:40.308 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:40.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.309 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.309 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:40.309 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.998063+0000", 2024-04-26T11:13:40.309 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00031713299999999999 2024-04-26T11:13:40.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.309 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.309 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:40.309 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.998077+0000", 2024-04-26T11:13:40.309 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4239999999999999e-05 2024-04-26T11:13:40.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.309 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.309 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:40.309 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.998085+0000", 2024-04-26T11:13:40.310 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5220000000000001e-06 2024-04-26T11:13:40.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.310 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.310 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:40.310 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.998124+0000", 2024-04-26T11:13:40.310 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8869999999999999e-05 2024-04-26T11:13:40.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.310 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.310 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:40.310 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.998229+0000", 2024-04-26T11:13:40.310 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105586 2024-04-26T11:13:40.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.310 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.310 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:40.311 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.998357+0000", 2024-04-26T11:13:40.311 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000128355 2024-04-26T11:13:40.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.311 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.311 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:40.311 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:40.005649+0000", 2024-04-26T11:13:40.311 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0072920019999999997 2024-04-26T11:13:40.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.311 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.311 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:40.311 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:40.005842+0000", 2024-04-26T11:13:40.311 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000192783 2024-04-26T11:13:40.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.311 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.311 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:40.312 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:40.005888+0000", 2024-04-26T11:13:40.312 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5640999999999999e-05 2024-04-26T11:13:40.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:40.312 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:40.312 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:40.312 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:40.005922+0000", 2024-04-26T11:13:40.312 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4482e-05 2024-04-26T11:13:40.312 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.312 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:40.312 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.312 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:40.312 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:40.312 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:13:40.313 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:13:40.314 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:40.311+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:40.315 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:13:40.328 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-26T11:13:40.329 INFO:teuthology.orchestra.run.smithi029.stdout: "ops": [ 2024-04-26T11:13:40.329 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:40.329 INFO:teuthology.orchestra.run.smithi029.stdout: "tid": 9585, 2024-04-26T11:13:40.329 INFO:teuthology.orchestra.run.smithi029.stdout: "pg": "5.2563c2c1", 2024-04-26T11:13:40.329 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 0, 2024-04-26T11:13:40.329 INFO:teuthology.orchestra.run.smithi029.stdout: "object_id": "benchmark_data_smithi029_44842_object9584", 2024-04-26T11:13:40.329 INFO:teuthology.orchestra.run.smithi029.stdout: "object_locator": "@5", 2024-04-26T11:13:40.329 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_id": "benchmark_data_smithi029_44842_object9584", 2024-04-26T11:13:40.329 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_locator": "@5", 2024-04-26T11:13:40.329 INFO:teuthology.orchestra.run.smithi029.stdout: "paused": 0, 2024-04-26T11:13:40.329 INFO:teuthology.orchestra.run.smithi029.stdout: "used_replica": 0, 2024-04-26T11:13:40.330 INFO:teuthology.orchestra.run.smithi029.stdout: "precalc_pgid": 0, 2024-04-26T11:13:40.330 INFO:teuthology.orchestra.run.smithi029.stdout: "last_sent": "655.607869s", 2024-04-26T11:13:40.330 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0019999670000000001, 2024-04-26T11:13:40.330 INFO:teuthology.orchestra.run.smithi029.stdout: "attempts": 1, 2024-04-26T11:13:40.330 INFO:teuthology.orchestra.run.smithi029.stdout: "snapid": "head", 2024-04-26T11:13:40.330 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_context": "0=[]", 2024-04-26T11:13:40.330 INFO:teuthology.orchestra.run.smithi029.stdout: "mtime": "2024-04-26T11:13:40.326063+0000", 2024-04-26T11:13:40.330 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_ops": [ 2024-04-26T11:13:40.330 INFO:teuthology.orchestra.run.smithi029.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T11:13:40.330 INFO:teuthology.orchestra.run.smithi029.stdout: "write 0~65536 in=65536b" 2024-04-26T11:13:40.330 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:40.330 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:40.330 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:40.331 INFO:teuthology.orchestra.run.smithi029.stdout: "tid": 9586, 2024-04-26T11:13:40.331 INFO:teuthology.orchestra.run.smithi029.stdout: "pg": "5.d6fdee72", 2024-04-26T11:13:40.331 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 0, 2024-04-26T11:13:40.331 INFO:teuthology.orchestra.run.smithi029.stdout: "object_id": "benchmark_data_smithi029_44842_object9585", 2024-04-26T11:13:40.331 INFO:teuthology.orchestra.run.smithi029.stdout: "object_locator": "@5", 2024-04-26T11:13:40.331 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_id": "benchmark_data_smithi029_44842_object9585", 2024-04-26T11:13:40.331 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_locator": "@5", 2024-04-26T11:13:40.331 INFO:teuthology.orchestra.run.smithi029.stdout: "paused": 0, 2024-04-26T11:13:40.331 INFO:teuthology.orchestra.run.smithi029.stdout: "used_replica": 0, 2024-04-26T11:13:40.331 INFO:teuthology.orchestra.run.smithi029.stdout: "precalc_pgid": 0, 2024-04-26T11:13:40.331 INFO:teuthology.orchestra.run.smithi029.stdout: "last_sent": "655.608869s", 2024-04-26T11:13:40.331 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.00099998300000000008, 2024-04-26T11:13:40.331 INFO:teuthology.orchestra.run.smithi029.stdout: "attempts": 1, 2024-04-26T11:13:40.331 INFO:teuthology.orchestra.run.smithi029.stdout: "snapid": "head", 2024-04-26T11:13:40.332 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_context": "0=[]", 2024-04-26T11:13:40.332 INFO:teuthology.orchestra.run.smithi029.stdout: "mtime": "2024-04-26T11:13:40.326153+0000", 2024-04-26T11:13:40.332 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_ops": [ 2024-04-26T11:13:40.332 INFO:teuthology.orchestra.run.smithi029.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T11:13:40.332 INFO:teuthology.orchestra.run.smithi029.stdout: "write 0~65536 in=65536b" 2024-04-26T11:13:40.332 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:40.332 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:40.332 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:40.332 INFO:teuthology.orchestra.run.smithi029.stdout: "tid": 9587, 2024-04-26T11:13:40.333 INFO:teuthology.orchestra.run.smithi029.stdout: "pg": "5.25270a92", 2024-04-26T11:13:40.333 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 0, 2024-04-26T11:13:40.333 INFO:teuthology.orchestra.run.smithi029.stdout: "object_id": "benchmark_data_smithi029_44842_object9586", 2024-04-26T11:13:40.333 INFO:teuthology.orchestra.run.smithi029.stdout: "object_locator": "@5", 2024-04-26T11:13:40.333 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_id": "benchmark_data_smithi029_44842_object9586", 2024-04-26T11:13:40.333 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_locator": "@5", 2024-04-26T11:13:40.333 INFO:teuthology.orchestra.run.smithi029.stdout: "paused": 0, 2024-04-26T11:13:40.333 INFO:teuthology.orchestra.run.smithi029.stdout: "used_replica": 0, 2024-04-26T11:13:40.333 INFO:teuthology.orchestra.run.smithi029.stdout: "precalc_pgid": 0, 2024-04-26T11:13:40.333 INFO:teuthology.orchestra.run.smithi029.stdout: "last_sent": "655.608869s", 2024-04-26T11:13:40.333 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.00099998300000000008, 2024-04-26T11:13:40.334 INFO:teuthology.orchestra.run.smithi029.stdout: "attempts": 1, 2024-04-26T11:13:40.334 INFO:teuthology.orchestra.run.smithi029.stdout: "snapid": "head", 2024-04-26T11:13:40.334 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_context": "0=[]", 2024-04-26T11:13:40.334 INFO:teuthology.orchestra.run.smithi029.stdout: "mtime": "2024-04-26T11:13:40.326383+0000", 2024-04-26T11:13:40.334 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_ops": [ 2024-04-26T11:13:40.334 INFO:teuthology.orchestra.run.smithi029.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T11:13:40.334 INFO:teuthology.orchestra.run.smithi029.stdout: "write 0~65536 in=65536b" 2024-04-26T11:13:40.334 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:40.334 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:40.334 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:40.334 INFO:teuthology.orchestra.run.smithi029.stdout: "tid": 9593, 2024-04-26T11:13:40.334 INFO:teuthology.orchestra.run.smithi029.stdout: "pg": "5.10fe82c1", 2024-04-26T11:13:40.334 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 0, 2024-04-26T11:13:40.334 INFO:teuthology.orchestra.run.smithi029.stdout: "object_id": "benchmark_data_smithi029_44842_object9592", 2024-04-26T11:13:40.335 INFO:teuthology.orchestra.run.smithi029.stdout: "object_locator": "@5", 2024-04-26T11:13:40.335 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_id": "benchmark_data_smithi029_44842_object9592", 2024-04-26T11:13:40.335 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_locator": "@5", 2024-04-26T11:13:40.335 INFO:teuthology.orchestra.run.smithi029.stdout: "paused": 0, 2024-04-26T11:13:40.335 INFO:teuthology.orchestra.run.smithi029.stdout: "used_replica": 0, 2024-04-26T11:13:40.335 INFO:teuthology.orchestra.run.smithi029.stdout: "precalc_pgid": 0, 2024-04-26T11:13:40.335 INFO:teuthology.orchestra.run.smithi029.stdout: "last_sent": "655.609869s", 2024-04-26T11:13:40.335 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0, 2024-04-26T11:13:40.335 INFO:teuthology.orchestra.run.smithi029.stdout: "attempts": 1, 2024-04-26T11:13:40.335 INFO:teuthology.orchestra.run.smithi029.stdout: "snapid": "head", 2024-04-26T11:13:40.335 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_context": "0=[]", 2024-04-26T11:13:40.335 INFO:teuthology.orchestra.run.smithi029.stdout: "mtime": "2024-04-26T11:13:40.327673+0000", 2024-04-26T11:13:40.335 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_ops": [ 2024-04-26T11:13:40.335 INFO:teuthology.orchestra.run.smithi029.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T11:13:40.336 INFO:teuthology.orchestra.run.smithi029.stdout: "write 0~65536 in=65536b" 2024-04-26T11:13:40.336 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:40.336 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:40.336 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:40.336 INFO:teuthology.orchestra.run.smithi029.stdout: "tid": 9594, 2024-04-26T11:13:40.336 INFO:teuthology.orchestra.run.smithi029.stdout: "pg": "5.d9759b77", 2024-04-26T11:13:40.336 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 0, 2024-04-26T11:13:40.336 INFO:teuthology.orchestra.run.smithi029.stdout: "object_id": "benchmark_data_smithi029_44842_object9593", 2024-04-26T11:13:40.336 INFO:teuthology.orchestra.run.smithi029.stdout: "object_locator": "@5", 2024-04-26T11:13:40.336 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_id": "benchmark_data_smithi029_44842_object9593", 2024-04-26T11:13:40.337 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_locator": "@5", 2024-04-26T11:13:40.337 INFO:teuthology.orchestra.run.smithi029.stdout: "paused": 0, 2024-04-26T11:13:40.337 INFO:teuthology.orchestra.run.smithi029.stdout: "used_replica": 0, 2024-04-26T11:13:40.337 INFO:teuthology.orchestra.run.smithi029.stdout: "precalc_pgid": 0, 2024-04-26T11:13:40.337 INFO:teuthology.orchestra.run.smithi029.stdout: "last_sent": "655.609869s", 2024-04-26T11:13:40.337 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0, 2024-04-26T11:13:40.337 INFO:teuthology.orchestra.run.smithi029.stdout: "attempts": 1, 2024-04-26T11:13:40.337 INFO:teuthology.orchestra.run.smithi029.stdout: "snapid": "head", 2024-04-26T11:13:40.337 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_context": "0=[]", 2024-04-26T11:13:40.337 INFO:teuthology.orchestra.run.smithi029.stdout: "mtime": "2024-04-26T11:13:40.327750+0000", 2024-04-26T11:13:40.337 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_ops": [ 2024-04-26T11:13:40.337 INFO:teuthology.orchestra.run.smithi029.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T11:13:40.337 INFO:teuthology.orchestra.run.smithi029.stdout: "write 0~65536 in=65536b" 2024-04-26T11:13:40.337 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:40.337 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:40.338 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:40.338 INFO:teuthology.orchestra.run.smithi029.stdout: "tid": 9578, 2024-04-26T11:13:40.338 INFO:teuthology.orchestra.run.smithi029.stdout: "pg": "5.299683bc", 2024-04-26T11:13:40.338 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2024-04-26T11:13:40.338 INFO:teuthology.orchestra.run.smithi029.stdout: "object_id": "benchmark_data_smithi029_44842_object9577", 2024-04-26T11:13:40.338 INFO:teuthology.orchestra.run.smithi029.stdout: "object_locator": "@5", 2024-04-26T11:13:40.338 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_id": "benchmark_data_smithi029_44842_object9577", 2024-04-26T11:13:40.338 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_locator": "@5", 2024-04-26T11:13:40.338 INFO:teuthology.orchestra.run.smithi029.stdout: "paused": 0, 2024-04-26T11:13:40.338 INFO:teuthology.orchestra.run.smithi029.stdout: "used_replica": 0, 2024-04-26T11:13:40.338 INFO:teuthology.orchestra.run.smithi029.stdout: "precalc_pgid": 0, 2024-04-26T11:13:40.338 INFO:teuthology.orchestra.run.smithi029.stdout: "last_sent": "655.606869s", 2024-04-26T11:13:40.338 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0029999509999999998, 2024-04-26T11:13:40.338 INFO:teuthology.orchestra.run.smithi029.stdout: "attempts": 1, 2024-04-26T11:13:40.339 INFO:teuthology.orchestra.run.smithi029.stdout: "snapid": "head", 2024-04-26T11:13:40.339 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_context": "0=[]", 2024-04-26T11:13:40.339 INFO:teuthology.orchestra.run.smithi029.stdout: "mtime": "2024-04-26T11:13:40.324535+0000", 2024-04-26T11:13:40.339 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_ops": [ 2024-04-26T11:13:40.339 INFO:teuthology.orchestra.run.smithi029.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T11:13:40.339 INFO:teuthology.orchestra.run.smithi029.stdout: "write 0~65536 in=65536b" 2024-04-26T11:13:40.339 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:40.339 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:40.339 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:40.339 INFO:teuthology.orchestra.run.smithi029.stdout: "tid": 9580, 2024-04-26T11:13:40.339 INFO:teuthology.orchestra.run.smithi029.stdout: "pg": "5.bbe5c116", 2024-04-26T11:13:40.339 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2024-04-26T11:13:40.339 INFO:teuthology.orchestra.run.smithi029.stdout: "object_id": "benchmark_data_smithi029_44842_object9579", 2024-04-26T11:13:40.339 INFO:teuthology.orchestra.run.smithi029.stdout: "object_locator": "@5", 2024-04-26T11:13:40.340 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_id": "benchmark_data_smithi029_44842_object9579", 2024-04-26T11:13:40.340 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_locator": "@5", 2024-04-26T11:13:40.340 INFO:teuthology.orchestra.run.smithi029.stdout: "paused": 0, 2024-04-26T11:13:40.340 INFO:teuthology.orchestra.run.smithi029.stdout: "used_replica": 0, 2024-04-26T11:13:40.340 INFO:teuthology.orchestra.run.smithi029.stdout: "precalc_pgid": 0, 2024-04-26T11:13:40.340 INFO:teuthology.orchestra.run.smithi029.stdout: "last_sent": "655.606869s", 2024-04-26T11:13:40.340 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0029999509999999998, 2024-04-26T11:13:40.340 INFO:teuthology.orchestra.run.smithi029.stdout: "attempts": 1, 2024-04-26T11:13:40.340 INFO:teuthology.orchestra.run.smithi029.stdout: "snapid": "head", 2024-04-26T11:13:40.340 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_context": "0=[]", 2024-04-26T11:13:40.340 INFO:teuthology.orchestra.run.smithi029.stdout: "mtime": "2024-04-26T11:13:40.324919+0000", 2024-04-26T11:13:40.340 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_ops": [ 2024-04-26T11:13:40.340 INFO:teuthology.orchestra.run.smithi029.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T11:13:40.341 INFO:teuthology.orchestra.run.smithi029.stdout: "write 0~65536 in=65536b" 2024-04-26T11:13:40.341 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:40.341 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:40.341 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:40.341 INFO:teuthology.orchestra.run.smithi029.stdout: "tid": 9581, 2024-04-26T11:13:40.341 INFO:teuthology.orchestra.run.smithi029.stdout: "pg": "5.eba9c7a", 2024-04-26T11:13:40.341 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2024-04-26T11:13:40.341 INFO:teuthology.orchestra.run.smithi029.stdout: "object_id": "benchmark_data_smithi029_44842_object9580", 2024-04-26T11:13:40.341 INFO:teuthology.orchestra.run.smithi029.stdout: "object_locator": "@5", 2024-04-26T11:13:40.341 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_id": "benchmark_data_smithi029_44842_object9580", 2024-04-26T11:13:40.341 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_locator": "@5", 2024-04-26T11:13:40.341 INFO:teuthology.orchestra.run.smithi029.stdout: "paused": 0, 2024-04-26T11:13:40.341 INFO:teuthology.orchestra.run.smithi029.stdout: "used_replica": 0, 2024-04-26T11:13:40.341 INFO:teuthology.orchestra.run.smithi029.stdout: "precalc_pgid": 0, 2024-04-26T11:13:40.341 INFO:teuthology.orchestra.run.smithi029.stdout: "last_sent": "655.606869s", 2024-04-26T11:13:40.342 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0029999509999999998, 2024-04-26T11:13:40.342 INFO:teuthology.orchestra.run.smithi029.stdout: "attempts": 1, 2024-04-26T11:13:40.342 INFO:teuthology.orchestra.run.smithi029.stdout: "snapid": "head", 2024-04-26T11:13:40.342 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_context": "0=[]", 2024-04-26T11:13:40.342 INFO:teuthology.orchestra.run.smithi029.stdout: "mtime": "2024-04-26T11:13:40.324926+0000", 2024-04-26T11:13:40.342 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_ops": [ 2024-04-26T11:13:40.342 INFO:teuthology.orchestra.run.smithi029.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T11:13:40.342 INFO:teuthology.orchestra.run.smithi029.stdout: "write 0~65536 in=65536b" 2024-04-26T11:13:40.342 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:40.342 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:40.342 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:40.342 INFO:teuthology.orchestra.run.smithi029.stdout: "tid": 9584, 2024-04-26T11:13:40.342 INFO:teuthology.orchestra.run.smithi029.stdout: "pg": "5.d79cc3d6", 2024-04-26T11:13:40.342 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2024-04-26T11:13:40.343 INFO:teuthology.orchestra.run.smithi029.stdout: "object_id": "benchmark_data_smithi029_44842_object9583", 2024-04-26T11:13:40.343 INFO:teuthology.orchestra.run.smithi029.stdout: "object_locator": "@5", 2024-04-26T11:13:40.343 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_id": "benchmark_data_smithi029_44842_object9583", 2024-04-26T11:13:40.343 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_locator": "@5", 2024-04-26T11:13:40.343 INFO:teuthology.orchestra.run.smithi029.stdout: "paused": 0, 2024-04-26T11:13:40.343 INFO:teuthology.orchestra.run.smithi029.stdout: "used_replica": 0, 2024-04-26T11:13:40.343 INFO:teuthology.orchestra.run.smithi029.stdout: "precalc_pgid": 0, 2024-04-26T11:13:40.343 INFO:teuthology.orchestra.run.smithi029.stdout: "last_sent": "655.607869s", 2024-04-26T11:13:40.343 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0019999670000000001, 2024-04-26T11:13:40.343 INFO:teuthology.orchestra.run.smithi029.stdout: "attempts": 1, 2024-04-26T11:13:40.343 INFO:teuthology.orchestra.run.smithi029.stdout: "snapid": "head", 2024-04-26T11:13:40.344 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_context": "0=[]", 2024-04-26T11:13:40.344 INFO:teuthology.orchestra.run.smithi029.stdout: "mtime": "2024-04-26T11:13:40.325153+0000", 2024-04-26T11:13:40.344 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_ops": [ 2024-04-26T11:13:40.344 INFO:teuthology.orchestra.run.smithi029.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T11:13:40.344 INFO:teuthology.orchestra.run.smithi029.stdout: "write 0~65536 in=65536b" 2024-04-26T11:13:40.344 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:40.344 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:40.344 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:40.344 INFO:teuthology.orchestra.run.smithi029.stdout: "tid": 9588, 2024-04-26T11:13:40.344 INFO:teuthology.orchestra.run.smithi029.stdout: "pg": "5.13a5efea", 2024-04-26T11:13:40.344 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2024-04-26T11:13:40.344 INFO:teuthology.orchestra.run.smithi029.stdout: "object_id": "benchmark_data_smithi029_44842_object9587", 2024-04-26T11:13:40.344 INFO:teuthology.orchestra.run.smithi029.stdout: "object_locator": "@5", 2024-04-26T11:13:40.344 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_id": "benchmark_data_smithi029_44842_object9587", 2024-04-26T11:13:40.344 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_locator": "@5", 2024-04-26T11:13:40.345 INFO:teuthology.orchestra.run.smithi029.stdout: "paused": 0, 2024-04-26T11:13:40.345 INFO:teuthology.orchestra.run.smithi029.stdout: "used_replica": 0, 2024-04-26T11:13:40.345 INFO:teuthology.orchestra.run.smithi029.stdout: "precalc_pgid": 0, 2024-04-26T11:13:40.345 INFO:teuthology.orchestra.run.smithi029.stdout: "last_sent": "655.608869s", 2024-04-26T11:13:40.345 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.00099998300000000008, 2024-04-26T11:13:40.345 INFO:teuthology.orchestra.run.smithi029.stdout: "attempts": 1, 2024-04-26T11:13:40.345 INFO:teuthology.orchestra.run.smithi029.stdout: "snapid": "head", 2024-04-26T11:13:40.345 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_context": "0=[]", 2024-04-26T11:13:40.345 INFO:teuthology.orchestra.run.smithi029.stdout: "mtime": "2024-04-26T11:13:40.326460+0000", 2024-04-26T11:13:40.345 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_ops": [ 2024-04-26T11:13:40.345 INFO:teuthology.orchestra.run.smithi029.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T11:13:40.345 INFO:teuthology.orchestra.run.smithi029.stdout: "write 0~65536 in=65536b" 2024-04-26T11:13:40.345 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:40.345 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:40.345 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:40.346 INFO:teuthology.orchestra.run.smithi029.stdout: "tid": 9589, 2024-04-26T11:13:40.346 INFO:teuthology.orchestra.run.smithi029.stdout: "pg": "5.cab9e18a", 2024-04-26T11:13:40.346 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2024-04-26T11:13:40.346 INFO:teuthology.orchestra.run.smithi029.stdout: "object_id": "benchmark_data_smithi029_44842_object9588", 2024-04-26T11:13:40.346 INFO:teuthology.orchestra.run.smithi029.stdout: "object_locator": "@5", 2024-04-26T11:13:40.346 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_id": "benchmark_data_smithi029_44842_object9588", 2024-04-26T11:13:40.346 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_locator": "@5", 2024-04-26T11:13:40.346 INFO:teuthology.orchestra.run.smithi029.stdout: "paused": 0, 2024-04-26T11:13:40.346 INFO:teuthology.orchestra.run.smithi029.stdout: "used_replica": 0, 2024-04-26T11:13:40.346 INFO:teuthology.orchestra.run.smithi029.stdout: "precalc_pgid": 0, 2024-04-26T11:13:40.346 INFO:teuthology.orchestra.run.smithi029.stdout: "last_sent": "655.608869s", 2024-04-26T11:13:40.346 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.00099998300000000008, 2024-04-26T11:13:40.347 INFO:teuthology.orchestra.run.smithi029.stdout: "attempts": 1, 2024-04-26T11:13:40.347 INFO:teuthology.orchestra.run.smithi029.stdout: "snapid": "head", 2024-04-26T11:13:40.347 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_context": "0=[]", 2024-04-26T11:13:40.347 INFO:teuthology.orchestra.run.smithi029.stdout: "mtime": "2024-04-26T11:13:40.326471+0000", 2024-04-26T11:13:40.347 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_ops": [ 2024-04-26T11:13:40.347 INFO:teuthology.orchestra.run.smithi029.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T11:13:40.347 INFO:teuthology.orchestra.run.smithi029.stdout: "write 0~65536 in=65536b" 2024-04-26T11:13:40.347 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:40.347 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:40.347 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:40.347 INFO:teuthology.orchestra.run.smithi029.stdout: "tid": 9590, 2024-04-26T11:13:40.347 INFO:teuthology.orchestra.run.smithi029.stdout: "pg": "5.b7f73e3", 2024-04-26T11:13:40.347 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2024-04-26T11:13:40.347 INFO:teuthology.orchestra.run.smithi029.stdout: "object_id": "benchmark_data_smithi029_44842_object9589", 2024-04-26T11:13:40.347 INFO:teuthology.orchestra.run.smithi029.stdout: "object_locator": "@5", 2024-04-26T11:13:40.348 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_id": "benchmark_data_smithi029_44842_object9589", 2024-04-26T11:13:40.348 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_locator": "@5", 2024-04-26T11:13:40.348 INFO:teuthology.orchestra.run.smithi029.stdout: "paused": 0, 2024-04-26T11:13:40.348 INFO:teuthology.orchestra.run.smithi029.stdout: "used_replica": 0, 2024-04-26T11:13:40.348 INFO:teuthology.orchestra.run.smithi029.stdout: "precalc_pgid": 0, 2024-04-26T11:13:40.348 INFO:teuthology.orchestra.run.smithi029.stdout: "last_sent": "655.608869s", 2024-04-26T11:13:40.348 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.00099998300000000008, 2024-04-26T11:13:40.348 INFO:teuthology.orchestra.run.smithi029.stdout: "attempts": 1, 2024-04-26T11:13:40.348 INFO:teuthology.orchestra.run.smithi029.stdout: "snapid": "head", 2024-04-26T11:13:40.349 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_context": "0=[]", 2024-04-26T11:13:40.349 INFO:teuthology.orchestra.run.smithi029.stdout: "mtime": "2024-04-26T11:13:40.326553+0000", 2024-04-26T11:13:40.349 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_ops": [ 2024-04-26T11:13:40.349 INFO:teuthology.orchestra.run.smithi029.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T11:13:40.349 INFO:teuthology.orchestra.run.smithi029.stdout: "write 0~65536 in=65536b" 2024-04-26T11:13:40.349 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:40.349 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:40.349 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:40.349 INFO:teuthology.orchestra.run.smithi029.stdout: "tid": 9591, 2024-04-26T11:13:40.349 INFO:teuthology.orchestra.run.smithi029.stdout: "pg": "5.10fadb9c", 2024-04-26T11:13:40.349 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2024-04-26T11:13:40.349 INFO:teuthology.orchestra.run.smithi029.stdout: "object_id": "benchmark_data_smithi029_44842_object9590", 2024-04-26T11:13:40.349 INFO:teuthology.orchestra.run.smithi029.stdout: "object_locator": "@5", 2024-04-26T11:13:40.349 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_id": "benchmark_data_smithi029_44842_object9590", 2024-04-26T11:13:40.350 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_locator": "@5", 2024-04-26T11:13:40.350 INFO:teuthology.orchestra.run.smithi029.stdout: "paused": 0, 2024-04-26T11:13:40.350 INFO:teuthology.orchestra.run.smithi029.stdout: "used_replica": 0, 2024-04-26T11:13:40.350 INFO:teuthology.orchestra.run.smithi029.stdout: "precalc_pgid": 0, 2024-04-26T11:13:40.350 INFO:teuthology.orchestra.run.smithi029.stdout: "last_sent": "655.608869s", 2024-04-26T11:13:40.350 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.00099998300000000008, 2024-04-26T11:13:40.350 INFO:teuthology.orchestra.run.smithi029.stdout: "attempts": 1, 2024-04-26T11:13:40.350 INFO:teuthology.orchestra.run.smithi029.stdout: "snapid": "head", 2024-04-26T11:13:40.350 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_context": "0=[]", 2024-04-26T11:13:40.350 INFO:teuthology.orchestra.run.smithi029.stdout: "mtime": "2024-04-26T11:13:40.326573+0000", 2024-04-26T11:13:40.350 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_ops": [ 2024-04-26T11:13:40.350 INFO:teuthology.orchestra.run.smithi029.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T11:13:40.350 INFO:teuthology.orchestra.run.smithi029.stdout: "write 0~65536 in=65536b" 2024-04-26T11:13:40.350 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:40.351 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:40.351 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:40.351 INFO:teuthology.orchestra.run.smithi029.stdout: "tid": 9579, 2024-04-26T11:13:40.351 INFO:teuthology.orchestra.run.smithi029.stdout: "pg": "5.8e707714", 2024-04-26T11:13:40.351 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 2, 2024-04-26T11:13:40.351 INFO:teuthology.orchestra.run.smithi029.stdout: "object_id": "benchmark_data_smithi029_44842_object9578", 2024-04-26T11:13:40.351 INFO:teuthology.orchestra.run.smithi029.stdout: "object_locator": "@5", 2024-04-26T11:13:40.351 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_id": "benchmark_data_smithi029_44842_object9578", 2024-04-26T11:13:40.351 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_locator": "@5", 2024-04-26T11:13:40.351 INFO:teuthology.orchestra.run.smithi029.stdout: "paused": 0, 2024-04-26T11:13:40.351 INFO:teuthology.orchestra.run.smithi029.stdout: "used_replica": 0, 2024-04-26T11:13:40.351 INFO:teuthology.orchestra.run.smithi029.stdout: "precalc_pgid": 0, 2024-04-26T11:13:40.351 INFO:teuthology.orchestra.run.smithi029.stdout: "last_sent": "655.606869s", 2024-04-26T11:13:40.351 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0029999509999999998, 2024-04-26T11:13:40.352 INFO:teuthology.orchestra.run.smithi029.stdout: "attempts": 1, 2024-04-26T11:13:40.352 INFO:teuthology.orchestra.run.smithi029.stdout: "snapid": "head", 2024-04-26T11:13:40.352 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_context": "0=[]", 2024-04-26T11:13:40.352 INFO:teuthology.orchestra.run.smithi029.stdout: "mtime": "2024-04-26T11:13:40.324906+0000", 2024-04-26T11:13:40.352 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_ops": [ 2024-04-26T11:13:40.352 INFO:teuthology.orchestra.run.smithi029.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T11:13:40.352 INFO:teuthology.orchestra.run.smithi029.stdout: "write 0~65536 in=65536b" 2024-04-26T11:13:40.352 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:40.352 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:40.352 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:40.352 INFO:teuthology.orchestra.run.smithi029.stdout: "tid": 9583, 2024-04-26T11:13:40.352 INFO:teuthology.orchestra.run.smithi029.stdout: "pg": "5.eb84d3b", 2024-04-26T11:13:40.352 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 2, 2024-04-26T11:13:40.352 INFO:teuthology.orchestra.run.smithi029.stdout: "object_id": "benchmark_data_smithi029_44842_object9582", 2024-04-26T11:13:40.352 INFO:teuthology.orchestra.run.smithi029.stdout: "object_locator": "@5", 2024-04-26T11:13:40.353 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_id": "benchmark_data_smithi029_44842_object9582", 2024-04-26T11:13:40.353 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_locator": "@5", 2024-04-26T11:13:40.353 INFO:teuthology.orchestra.run.smithi029.stdout: "paused": 0, 2024-04-26T11:13:40.353 INFO:teuthology.orchestra.run.smithi029.stdout: "used_replica": 0, 2024-04-26T11:13:40.353 INFO:teuthology.orchestra.run.smithi029.stdout: "precalc_pgid": 0, 2024-04-26T11:13:40.353 INFO:teuthology.orchestra.run.smithi029.stdout: "last_sent": "655.606869s", 2024-04-26T11:13:40.353 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0.0029999509999999998, 2024-04-26T11:13:40.353 INFO:teuthology.orchestra.run.smithi029.stdout: "attempts": 1, 2024-04-26T11:13:40.353 INFO:teuthology.orchestra.run.smithi029.stdout: "snapid": "head", 2024-04-26T11:13:40.353 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_context": "0=[]", 2024-04-26T11:13:40.353 INFO:teuthology.orchestra.run.smithi029.stdout: "mtime": "2024-04-26T11:13:40.324954+0000", 2024-04-26T11:13:40.353 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_ops": [ 2024-04-26T11:13:40.353 INFO:teuthology.orchestra.run.smithi029.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T11:13:40.353 INFO:teuthology.orchestra.run.smithi029.stdout: "write 0~65536 in=65536b" 2024-04-26T11:13:40.353 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:40.354 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:40.354 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:40.354 INFO:teuthology.orchestra.run.smithi029.stdout: "tid": 9592, 2024-04-26T11:13:40.354 INFO:teuthology.orchestra.run.smithi029.stdout: "pg": "5.e7b8399e", 2024-04-26T11:13:40.354 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 2, 2024-04-26T11:13:40.354 INFO:teuthology.orchestra.run.smithi029.stdout: "object_id": "benchmark_data_smithi029_44842_object9591", 2024-04-26T11:13:40.354 INFO:teuthology.orchestra.run.smithi029.stdout: "object_locator": "@5", 2024-04-26T11:13:40.354 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_id": "benchmark_data_smithi029_44842_object9591", 2024-04-26T11:13:40.354 INFO:teuthology.orchestra.run.smithi029.stdout: "target_object_locator": "@5", 2024-04-26T11:13:40.354 INFO:teuthology.orchestra.run.smithi029.stdout: "paused": 0, 2024-04-26T11:13:40.354 INFO:teuthology.orchestra.run.smithi029.stdout: "used_replica": 0, 2024-04-26T11:13:40.354 INFO:teuthology.orchestra.run.smithi029.stdout: "precalc_pgid": 0, 2024-04-26T11:13:40.354 INFO:teuthology.orchestra.run.smithi029.stdout: "last_sent": "655.609869s", 2024-04-26T11:13:40.354 INFO:teuthology.orchestra.run.smithi029.stdout: "age": 0, 2024-04-26T11:13:40.355 INFO:teuthology.orchestra.run.smithi029.stdout: "attempts": 1, 2024-04-26T11:13:40.355 INFO:teuthology.orchestra.run.smithi029.stdout: "snapid": "head", 2024-04-26T11:13:40.355 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_context": "0=[]", 2024-04-26T11:13:40.355 INFO:teuthology.orchestra.run.smithi029.stdout: "mtime": "2024-04-26T11:13:40.327628+0000", 2024-04-26T11:13:40.355 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_ops": [ 2024-04-26T11:13:40.355 INFO:teuthology.orchestra.run.smithi029.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T11:13:40.355 INFO:teuthology.orchestra.run.smithi029.stdout: "write 0~65536 in=65536b" 2024-04-26T11:13:40.355 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:40.355 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:40.355 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-04-26T11:13:40.355 INFO:teuthology.orchestra.run.smithi029.stdout: "linger_ops": [], 2024-04-26T11:13:40.355 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_ops": [], 2024-04-26T11:13:40.356 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_stat_ops": [], 2024-04-26T11:13:40.356 INFO:teuthology.orchestra.run.smithi029.stdout: "statfs_ops": [], 2024-04-26T11:13:40.356 INFO:teuthology.orchestra.run.smithi029.stdout: "command_ops": [] 2024-04-26T11:13:40.356 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-26T11:13:40.357 DEBUG:tasks.admin_socket:admin socket command objecter_requests returned { "ops": [ { "tid": 9585, "pg": "5.2563c2c1", "osd": 0, "object_id": "benchmark_data_smithi029_44842_object9584", "object_locator": "@5", "target_object_id": "benchmark_data_smithi029_44842_object9584", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "655.607869s", "age": 0.0019999670000000001, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T11:13:40.326063+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9586, "pg": "5.d6fdee72", "osd": 0, "object_id": "benchmark_data_smithi029_44842_object9585", "object_locator": "@5", "target_object_id": "benchmark_data_smithi029_44842_object9585", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "655.608869s", "age": 0.00099998300000000008, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T11:13:40.326153+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9587, "pg": "5.25270a92", "osd": 0, "object_id": "benchmark_data_smithi029_44842_object9586", "object_locator": "@5", "target_object_id": "benchmark_data_smithi029_44842_object9586", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "655.608869s", "age": 0.00099998300000000008, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T11:13:40.326383+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9593, "pg": "5.10fe82c1", "osd": 0, "object_id": "benchmark_data_smithi029_44842_object9592", "object_locator": "@5", "target_object_id": "benchmark_data_smithi029_44842_object9592", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "655.609869s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T11:13:40.327673+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9594, "pg": "5.d9759b77", "osd": 0, "object_id": "benchmark_data_smithi029_44842_object9593", "object_locator": "@5", "target_object_id": "benchmark_data_smithi029_44842_object9593", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "655.609869s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T11:13:40.327750+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9578, "pg": "5.299683bc", "osd": 1, "object_id": "benchmark_data_smithi029_44842_object9577", "object_locator": "@5", "target_object_id": "benchmark_data_smithi029_44842_object9577", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "655.606869s", "age": 0.0029999509999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T11:13:40.324535+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9580, "pg": "5.bbe5c116", "osd": 1, "object_id": "benchmark_data_smithi029_44842_object9579", "object_locator": "@5", "target_object_id": "benchmark_data_smithi029_44842_object9579", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "655.606869s", "age": 0.0029999509999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T11:13:40.324919+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9581, "pg": "5.eba9c7a", "osd": 1, "object_id": "benchmark_data_smithi029_44842_object9580", "object_locator": "@5", "target_object_id": "benchmark_data_smithi029_44842_object9580", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "655.606869s", "age": 0.0029999509999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T11:13:40.324926+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9584, "pg": "5.d79cc3d6", "osd": 1, "object_id": "benchmark_data_smithi029_44842_object9583", "object_locator": "@5", "target_object_id": "benchmark_data_smithi029_44842_object9583", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "655.607869s", "age": 0.0019999670000000001, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T11:13:40.325153+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9588, "pg": "5.13a5efea", "osd": 1, "object_id": "benchmark_data_smithi029_44842_object9587", "object_locator": "@5", "target_object_id": "benchmark_data_smithi029_44842_object9587", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "655.608869s", "age": 0.00099998300000000008, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T11:13:40.326460+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9589, "pg": "5.cab9e18a", "osd": 1, "object_id": "benchmark_data_smithi029_44842_object9588", "object_locator": "@5", "target_object_id": "benchmark_data_smithi029_44842_object9588", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "655.608869s", "age": 0.00099998300000000008, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T11:13:40.326471+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9590, "pg": "5.b7f73e3", "osd": 1, "object_id": "benchmark_data_smithi029_44842_object9589", "object_locator": "@5", "target_object_id": "benchmark_data_smithi029_44842_object9589", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "655.608869s", "age": 0.00099998300000000008, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T11:13:40.326553+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9591, "pg": "5.10fadb9c", "osd": 1, "object_id": "benchmark_data_smithi029_44842_object9590", "object_locator": "@5", "target_object_id": "benchmark_data_smithi029_44842_object9590", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "655.608869s", "age": 0.00099998300000000008, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T11:13:40.326573+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9579, "pg": "5.8e707714", "osd": 2, "object_id": "benchmark_data_smithi029_44842_object9578", "object_locator": "@5", "target_object_id": "benchmark_data_smithi029_44842_object9578", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "655.606869s", "age": 0.0029999509999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T11:13:40.324906+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9583, "pg": "5.eb84d3b", "osd": 2, "object_id": "benchmark_data_smithi029_44842_object9582", "object_locator": "@5", "target_object_id": "benchmark_data_smithi029_44842_object9582", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "655.606869s", "age": 0.0029999509999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T11:13:40.324954+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9592, "pg": "5.e7b8399e", "osd": 2, "object_id": "benchmark_data_smithi029_44842_object9591", "object_locator": "@5", "target_object_id": "benchmark_data_smithi029_44842_object9591", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "655.609869s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T11:13:40.327628+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] } ], "linger_ops": [], "pool_ops": [], "pool_stat_ops": [], "statfs_ops": [], "command_ops": [] } 2024-04-26T11:13:40.358 DEBUG:teuthology.orchestra.run.smithi029:> /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-04-26T11:13:40.410 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 2 16 9986 9970 311.542 299.25 0.0031224 0.00320557 2024-04-26T11:13:40.414 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:40.413+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:40.445 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf -- /home/ubuntu/cephtest/admin_socket_client.0 2024-04-26T11:13:40.470 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:13:40.489 DEBUG:teuthology.parallel:result is None 2024-04-26T11:13:40.489 DEBUG:teuthology.run_tasks:Unwinding manager radosbench 2024-04-26T11:13:40.498 INFO:tasks.radosbench:joining radosbench (timing out after 2100s) 2024-04-26T11:13:40.499 INFO:teuthology.orchestra.run:waiting for 2100 2024-04-26T11:13:40.499 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:13:40.500 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:13:40.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.500 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:10307 5.0 5:05ae1a6c:::benchmark_data_smithi029_44842_object10306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:40.500 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:40.486822+0000", 2024-04-26T11:13:40.500 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0022148100000000002, 2024-04-26T11:13:40.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022441850000000001, 2024-04-26T11:13:40.500 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:40.500 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:40.500 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:40.500 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:40.500 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:40.501 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10307 2024-04-26T11:13:40.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.501 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:40.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:40.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.486822+0000", 2024-04-26T11:13:40.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:40.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:40.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.486822+0000", 2024-04-26T11:13:40.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:40.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:40.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.486821+0000", 2024-04-26T11:13:40.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:40.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:40.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.486886+0000", 2024-04-26T11:13:40.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5178999999999994e-05 2024-04-26T11:13:40.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:40.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.486902+0000", 2024-04-26T11:13:40.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5176e-05 2024-04-26T11:13:40.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:40.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.486910+0000", 2024-04-26T11:13:40.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0420000000000003e-06 2024-04-26T11:13:40.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:40.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.486936+0000", 2024-04-26T11:13:40.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6393999999999998e-05 2024-04-26T11:13:40.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:40.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.487011+0000", 2024-04-26T11:13:40.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5350000000000002e-05 2024-04-26T11:13:40.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:40.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.487118+0000", 2024-04-26T11:13:40.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106451 2024-04-26T11:13:40.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:40.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.488721+0000", 2024-04-26T11:13:40.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0016035940000000001 2024-04-26T11:13:40.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:40.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.489027+0000", 2024-04-26T11:13:40.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030571400000000001 2024-04-26T11:13:40.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:40.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.489062+0000", 2024-04-26T11:13:40.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4353000000000001e-05 2024-04-26T11:13:40.505 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:10311 5.8 5:19998b38:::benchmark_data_smithi029_44842_object10310:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:40.487071+0000", 2024-04-26T11:13:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0019662719999999998, 2024-04-26T11:13:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021135279999999999, 2024-04-26T11:13:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10311 2024-04-26T11:13:40.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.487071+0000", 2024-04-26T11:13:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.487071+0000", 2024-04-26T11:13:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.487070+0000", 2024-04-26T11:13:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.487119+0000", 2024-04-26T11:13:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9107000000000003e-05 2024-04-26T11:13:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.487132+0000", 2024-04-26T11:13:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2733e-05 2024-04-26T11:13:40.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.487140+0000", 2024-04-26T11:13:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2060000000000007e-06 2024-04-26T11:13:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.487174+0000", 2024-04-26T11:13:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4079999999999999e-05 2024-04-26T11:13:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.487313+0000", 2024-04-26T11:13:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013946299999999999 2024-04-26T11:13:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.487445+0000", 2024-04-26T11:13:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013216200000000001 2024-04-26T11:13:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.488834+0000", 2024-04-26T11:13:40.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001388783 2024-04-26T11:13:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.489173+0000", 2024-04-26T11:13:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00033823099999999998 2024-04-26T11:13:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.489196+0000", 2024-04-26T11:13:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3289999999999999e-05 2024-04-26T11:13:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:10312 5.d 5:b9a334ab:::benchmark_data_smithi029_44842_object10311:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:40.488925+0000", 2024-04-26T11:13:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.000111641, 2024-04-26T11:13:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00039603300000000001, 2024-04-26T11:13:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:40.512 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10312 2024-04-26T11:13:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.488925+0000", 2024-04-26T11:13:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.488925+0000", 2024-04-26T11:13:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:40.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.488924+0000", 2024-04-26T11:13:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.489002+0000", 2024-04-26T11:13:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7055e-05 2024-04-26T11:13:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.489009+0000", 2024-04-26T11:13:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3339999999999996e-06 2024-04-26T11:13:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.489015+0000", 2024-04-26T11:13:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2269999999999998e-06 2024-04-26T11:13:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.489055+0000", 2024-04-26T11:13:40.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9813e-05 2024-04-26T11:13:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.489155+0000", 2024-04-26T11:13:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100048 2024-04-26T11:13:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.489247+0000", 2024-04-26T11:13:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1605000000000001e-05 2024-04-26T11:13:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:40.516 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:10313 5.4 5:2e973d47:::benchmark_data_smithi029_44842_object10312:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:40.489221+0000", 2024-04-26T11:13:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9998159, 2024-04-26T11:13:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000190476, 2024-04-26T11:13:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:13:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 10313 2024-04-26T11:13:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:40.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.489221+0000", 2024-04-26T11:13:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.489221+0000", 2024-04-26T11:13:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.489220+0000", 2024-04-26T11:13:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:40.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.489292+0000", 2024-04-26T11:13:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1097e-05 2024-04-26T11:13:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.489298+0000", 2024-04-26T11:13:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7479999999999996e-06 2024-04-26T11:13:40.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.489304+0000", 2024-04-26T11:13:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5110000000000003e-06 2024-04-26T11:13:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.489337+0000", 2024-04-26T11:13:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3540000000000001e-05 2024-04-26T11:13:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.489413+0000", 2024-04-26T11:13:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5537999999999994e-05 2024-04-26T11:13:40.520 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:40.521 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:40.521 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:40.521 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:40.521 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:13:40.521 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 4 2024-04-26T11:13:40.521 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:13:40.521 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:13:40.522 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:13:40.523 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:40.520+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:40.523 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:13:40.523 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:13:40.523 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:13:40.524 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:13:40.623 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:40.621+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:40.724 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:40.722+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:40.733 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:40.734 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:40.747 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:13:40.826 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:40.823+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:40.913 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:40.913 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:40.925 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:13:40.926 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:40.924+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:40.982 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T11:13:40.983 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:13:40.983 INFO:tasks.thrashosds.thrasher:Reweighting osd 0 to 0.897263969260777 2024-04-26T11:13:40.983 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 0.897263969260777 2024-04-26T11:13:41.028 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:41.026+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:41.097 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:41.097 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:41.111 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:13:41.152 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:41.150+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:41.230 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:41.228+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:41.316 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:13:41.329 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:41.329 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:41.330 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:41.330+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:41.345 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:13:41.410 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 3 16 13821 13805 287.584 239.688 0.00847386 0.00347308 2024-04-26T11:13:41.431 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:41.430+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:41.532 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:41.530+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:41.561 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:41.561 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:41.576 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:13:41.633 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:41.631+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:41.736 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:41.733+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:41.763 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:41.763 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:41.778 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:13:41.863 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:41.861+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:41.936 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:41.934+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:41.999 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:41.999 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:42.010 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:13:42.038 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:42.036+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:42.139 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:42.137+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:42.228 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:42.228 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:42.241 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:42.239+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:42.242 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:13:42.309 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:13:42.309 INFO:teuthology.orchestra.run.smithi029.stderr:reweighted osd.0 to 0.897264 (e5b3) 2024-04-26T11:13:42.342 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:42.340+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:42.410 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 4 16 17323 17307 270.402 218.875 0.00296108 0.00369497 2024-04-26T11:13:42.411 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:42.411 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:42.426 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:13:42.468 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:42.466+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:42.526 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:13:42.544 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:42.542+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:42.625 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:42.626 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:42.640 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:13:42.645 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:42.644+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:42.685 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:13:42.707 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:13:42.729 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:13:42.730 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:13:42.730 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:13:42.730 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:13:42.747 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:42.745+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:42.845 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:13:42.845 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:13:42.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:13:42.845 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:13:42.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.845 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:42.846 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.905682+0000", 2024-04-26T11:13:42.846 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.936243342000001, 2024-04-26T11:13:42.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017168134000000002, 2024-04-26T11:13:42.846 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:42.846 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:42.846 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:42.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:42.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905682+0000", 2024-04-26T11:13:42.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905682+0000", 2024-04-26T11:13:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905681+0000", 2024-04-26T11:13:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:13:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905689+0000", 2024-04-26T11:13:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7830000000000004e-06 2024-04-26T11:13:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905703+0000", 2024-04-26T11:13:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3322000000000001e-05 2024-04-26T11:13:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905717+0000", 2024-04-26T11:13:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4562000000000001e-05 2024-04-26T11:13:42.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906126+0000", 2024-04-26T11:13:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040896900000000002 2024-04-26T11:13:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:13:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906133+0000", 2024-04-26T11:13:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6370000000000002e-06 2024-04-26T11:13:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.914252+0000", 2024-04-26T11:13:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0081192529999999999 2024-04-26T11:13:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.914675+0000", 2024-04-26T11:13:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00042322399999999999 2024-04-26T11:13:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915080+0000", 2024-04-26T11:13:42.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040486899999999998 2024-04-26T11:13:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.917940+0000", 2024-04-26T11:13:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0028593400000000001 2024-04-26T11:13:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.922776+0000", 2024-04-26T11:13:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048359420000000002 2024-04-26T11:13:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:42.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.922825+0000", 2024-04-26T11:13:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9048999999999997e-05 2024-04-26T11:13:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.922850+0000", 2024-04-26T11:13:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5689000000000001e-05 2024-04-26T11:13:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:15 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906087+0000", 2024-04-26T11:13:42.855 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.935838044, 2024-04-26T11:13:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010623062000000001, 2024-04-26T11:13:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906087+0000", 2024-04-26T11:13:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906087+0000", 2024-04-26T11:13:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906087+0000", 2024-04-26T11:13:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906094+0000", 2024-04-26T11:13:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4429999999999997e-06 2024-04-26T11:13:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906105+0000", 2024-04-26T11:13:42.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0737000000000001e-05 2024-04-26T11:13:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906114+0000", 2024-04-26T11:13:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2199999999999998e-06 2024-04-26T11:13:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906188+0000", 2024-04-26T11:13:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3900999999999996e-05 2024-04-26T11:13:42.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:13:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906193+0000", 2024-04-26T11:13:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1089999999999997e-06 2024-04-26T11:13:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.908258+0000", 2024-04-26T11:13:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020653680000000002 2024-04-26T11:13:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.909106+0000", 2024-04-26T11:13:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084725899999999995 2024-04-26T11:13:42.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.909461+0000", 2024-04-26T11:13:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035572099999999998 2024-04-26T11:13:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.913823+0000", 2024-04-26T11:13:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043620830000000001 2024-04-26T11:13:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.916613+0000", 2024-04-26T11:13:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027896710000000001 2024-04-26T11:13:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.916665+0000", 2024-04-26T11:13:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2403e-05 2024-04-26T11:13:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.916711+0000", 2024-04-26T11:13:42.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5055000000000001e-05 2024-04-26T11:13:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906121+0000", 2024-04-26T11:13:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.935804520000001, 2024-04-26T11:13:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015092059, 2024-04-26T11:13:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:42.862 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906121+0000", 2024-04-26T11:13:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906121+0000", 2024-04-26T11:13:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906121+0000", 2024-04-26T11:13:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906124+0000", 2024-04-26T11:13:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6009999999999999e-06 2024-04-26T11:13:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:42.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906130+0000", 2024-04-26T11:13:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3010000000000003e-06 2024-04-26T11:13:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906136+0000", 2024-04-26T11:13:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1370000000000001e-06 2024-04-26T11:13:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906289+0000", 2024-04-26T11:13:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000153299 2024-04-26T11:13:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:13:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906296+0000", 2024-04-26T11:13:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9829999999999999e-06 2024-04-26T11:13:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.910345+0000", 2024-04-26T11:13:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040495510000000002 2024-04-26T11:13:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.910479+0000", 2024-04-26T11:13:42.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013406 2024-04-26T11:13:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.910881+0000", 2024-04-26T11:13:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040128800000000002 2024-04-26T11:13:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.913427+0000", 2024-04-26T11:13:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025464440000000001 2024-04-26T11:13:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:42.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921131+0000", 2024-04-26T11:13:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0077034399999999998 2024-04-26T11:13:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921175+0000", 2024-04-26T11:13:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4811000000000002e-05 2024-04-26T11:13:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921213+0000", 2024-04-26T11:13:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7607000000000001e-05 2024-04-26T11:13:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:42.868 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:26 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906148+0000", 2024-04-26T11:13:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.935778001999999, 2024-04-26T11:13:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017103547, 2024-04-26T11:13:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906148+0000", 2024-04-26T11:13:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906148+0000", 2024-04-26T11:13:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906147+0000", 2024-04-26T11:13:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906152+0000", 2024-04-26T11:13:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2530000000000004e-06 2024-04-26T11:13:42.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906160+0000", 2024-04-26T11:13:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.605e-06 2024-04-26T11:13:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906165+0000", 2024-04-26T11:13:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4689999999999996e-06 2024-04-26T11:13:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906223+0000", 2024-04-26T11:13:42.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7578999999999999e-05 2024-04-26T11:13:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906228+0000", 2024-04-26T11:13:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.485e-06 2024-04-26T11:13:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915364+0000", 2024-04-26T11:13:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0091359230000000007 2024-04-26T11:13:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915433+0000", 2024-04-26T11:13:42.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8913999999999998e-05 2024-04-26T11:13:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915517+0000", 2024-04-26T11:13:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4023000000000005e-05 2024-04-26T11:13:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.918856+0000", 2024-04-26T11:13:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0033382469999999999 2024-04-26T11:13:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923141+0000", 2024-04-26T11:13:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0042854779999999997 2024-04-26T11:13:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923209+0000", 2024-04-26T11:13:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8122999999999998e-05 2024-04-26T11:13:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923251+0000", 2024-04-26T11:13:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1919999999999998e-05 2024-04-26T11:13:42.874 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906186+0000", 2024-04-26T11:13:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.935739586, 2024-04-26T11:13:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015189243999999999, 2024-04-26T11:13:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906186+0000", 2024-04-26T11:13:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906186+0000", 2024-04-26T11:13:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906185+0000", 2024-04-26T11:13:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906190+0000", 2024-04-26T11:13:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7169999999999999e-06 2024-04-26T11:13:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906197+0000", 2024-04-26T11:13:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7519999999999999e-06 2024-04-26T11:13:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:42.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906206+0000", 2024-04-26T11:13:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0790000000000007e-06 2024-04-26T11:13:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906254+0000", 2024-04-26T11:13:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8248999999999998e-05 2024-04-26T11:13:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906258+0000", 2024-04-26T11:13:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1799999999999998e-06 2024-04-26T11:13:42.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.912492+0000", 2024-04-26T11:13:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062335560000000003 2024-04-26T11:13:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.912603+0000", 2024-04-26T11:13:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111597 2024-04-26T11:13:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.912734+0000", 2024-04-26T11:13:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013028700000000001 2024-04-26T11:13:42.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915693+0000", 2024-04-26T11:13:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0029589460000000001 2024-04-26T11:13:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921316+0000", 2024-04-26T11:13:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0056232130000000002 2024-04-26T11:13:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921346+0000", 2024-04-26T11:13:42.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0011000000000001e-05 2024-04-26T11:13:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921375+0000", 2024-04-26T11:13:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9254000000000001e-05 2024-04-26T11:13:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906220+0000", 2024-04-26T11:13:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.935705781999999, 2024-04-26T11:13:42.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0151527, 2024-04-26T11:13:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906220+0000", 2024-04-26T11:13:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906220+0000", 2024-04-26T11:13:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906219+0000", 2024-04-26T11:13:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906233+0000", 2024-04-26T11:13:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3848e-05 2024-04-26T11:13:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:42.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906241+0000", 2024-04-26T11:13:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5979999999999999e-06 2024-04-26T11:13:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906250+0000", 2024-04-26T11:13:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1619999999999997e-06 2024-04-26T11:13:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906593+0000", 2024-04-26T11:13:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00034324900000000001 2024-04-26T11:13:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906598+0000", 2024-04-26T11:13:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8729999999999998e-06 2024-04-26T11:13:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.911534+0000", 2024-04-26T11:13:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049357869999999996 2024-04-26T11:13:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.911637+0000", 2024-04-26T11:13:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103071 2024-04-26T11:13:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.911781+0000", 2024-04-26T11:13:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000144499 2024-04-26T11:13:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.913870+0000", 2024-04-26T11:13:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020884369999999998 2024-04-26T11:13:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921293+0000", 2024-04-26T11:13:42.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0074231810000000001 2024-04-26T11:13:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921328+0000", 2024-04-26T11:13:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4606e-05 2024-04-26T11:13:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921372+0000", 2024-04-26T11:13:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4909e-05 2024-04-26T11:13:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906402+0000", 2024-04-26T11:13:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.93552395, 2024-04-26T11:13:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017555191000000001, 2024-04-26T11:13:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906402+0000", 2024-04-26T11:13:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906402+0000", 2024-04-26T11:13:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906401+0000", 2024-04-26T11:13:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906407+0000", 2024-04-26T11:13:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2689999999999996e-06 2024-04-26T11:13:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906416+0000", 2024-04-26T11:13:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5080000000000005e-06 2024-04-26T11:13:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906422+0000", 2024-04-26T11:13:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9460000000000003e-06 2024-04-26T11:13:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906459+0000", 2024-04-26T11:13:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6998000000000001e-05 2024-04-26T11:13:42.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906463+0000", 2024-04-26T11:13:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.374e-06 2024-04-26T11:13:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915821+0000", 2024-04-26T11:13:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0093578050000000003 2024-04-26T11:13:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.916209+0000", 2024-04-26T11:13:42.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00038876999999999998 2024-04-26T11:13:42.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:42.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.916349+0000", 2024-04-26T11:13:42.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013992900000000001 2024-04-26T11:13:42.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:42.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.920269+0000", 2024-04-26T11:13:42.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003919133 2024-04-26T11:13:42.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:42.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923899+0000", 2024-04-26T11:13:42.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003630716 2024-04-26T11:13:42.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:42.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923932+0000", 2024-04-26T11:13:42.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2471999999999997e-05 2024-04-26T11:13:42.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:42.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923957+0000", 2024-04-26T11:13:42.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5038999999999999e-05 2024-04-26T11:13:42.893 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.893 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:42.893 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.894 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:27 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:42.894 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906431+0000", 2024-04-26T11:13:42.894 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 29.935494839, 2024-04-26T11:13:42.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012314960999999999, 2024-04-26T11:13:42.894 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:42.894 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:13:42.894 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:42.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:42.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906431+0000", 2024-04-26T11:13:42.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:42.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906431+0000", 2024-04-26T11:13:42.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:42.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906430+0000", 2024-04-26T11:13:42.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:42.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:42.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906433+0000", 2024-04-26T11:13:42.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689999999999999e-06 2024-04-26T11:13:42.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:42.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906441+0000", 2024-04-26T11:13:42.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.892e-06 2024-04-26T11:13:42.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:42.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906447+0000", 2024-04-26T11:13:42.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6019999999999999e-06 2024-04-26T11:13:42.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906594+0000", 2024-04-26T11:13:42.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014745399999999999 2024-04-26T11:13:42.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:13:42.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906600+0000", 2024-04-26T11:13:42.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6130000000000003e-06 2024-04-26T11:13:42.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.910337+0000", 2024-04-26T11:13:42.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037378229999999999 2024-04-26T11:13:42.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:42.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.910449+0000", 2024-04-26T11:13:42.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011138500000000001 2024-04-26T11:13:42.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:42.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.918746+0000", 2024-04-26T11:13:42.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082967549999999994 2024-04-26T11:13:42.899 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.899 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:42.899 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.899 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:7057 5.8 5:1b0d6d74:::benchmark_data_smithi029_44842_object7056:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:42.899 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:39.770409+0000", 2024-04-26T11:13:42.899 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.071516167, 2024-04-26T11:13:42.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012375283000000001, 2024-04-26T11:13:42.899 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:42.899 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:42.899 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:42.900 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:42.900 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:42.900 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 7057 2024-04-26T11:13:42.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.900 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:42.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:42.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.770409+0000", 2024-04-26T11:13:42.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:42.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.770409+0000", 2024-04-26T11:13:42.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:42.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.770409+0000", 2024-04-26T11:13:42.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:42.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:42.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.770474+0000", 2024-04-26T11:13:42.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5312000000000001e-05 2024-04-26T11:13:42.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:42.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.770483+0000", 2024-04-26T11:13:42.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6670000000000002e-06 2024-04-26T11:13:42.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:42.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.770489+0000", 2024-04-26T11:13:42.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7259999999999999e-06 2024-04-26T11:13:42.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.770511+0000", 2024-04-26T11:13:42.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2835000000000001e-05 2024-04-26T11:13:42.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:42.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.770615+0000", 2024-04-26T11:13:42.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010379599999999999 2024-04-26T11:13:42.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:42.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.770709+0000", 2024-04-26T11:13:42.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4220000000000003e-05 2024-04-26T11:13:42.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:42.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.771459+0000", 2024-04-26T11:13:42.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00074918499999999998 2024-04-26T11:13:42.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:42.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.782738+0000", 2024-04-26T11:13:42.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011279854000000001 2024-04-26T11:13:42.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:42.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.782765+0000", 2024-04-26T11:13:42.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6431000000000002e-05 2024-04-26T11:13:42.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:42.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.782785+0000", 2024-04-26T11:13:42.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9721999999999999e-05 2024-04-26T11:13:42.904 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.904 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:42.904 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.905 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:7063 5.8 5:14ea871e:::benchmark_data_smithi029_44842_object7062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:42.905 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:39.772861+0000", 2024-04-26T11:13:42.905 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.0690641799999998, 2024-04-26T11:13:42.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010002136999999999, 2024-04-26T11:13:42.905 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:42.905 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:42.905 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:42.905 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:42.905 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:42.905 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 7063 2024-04-26T11:13:42.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.905 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:42.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:42.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.772861+0000", 2024-04-26T11:13:42.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:42.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.772861+0000", 2024-04-26T11:13:42.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:42.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.772861+0000", 2024-04-26T11:13:42.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:42.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:42.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.773032+0000", 2024-04-26T11:13:42.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017169 2024-04-26T11:13:42.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:42.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.773038+0000", 2024-04-26T11:13:42.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5210000000000002e-06 2024-04-26T11:13:42.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:42.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.773042+0000", 2024-04-26T11:13:42.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8850000000000001e-06 2024-04-26T11:13:42.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.773074+0000", 2024-04-26T11:13:42.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2023000000000002e-05 2024-04-26T11:13:42.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:42.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.773186+0000", 2024-04-26T11:13:42.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011163999999999999 2024-04-26T11:13:42.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:42.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.773316+0000", 2024-04-26T11:13:42.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013027700000000001 2024-04-26T11:13:42.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:42.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.774314+0000", 2024-04-26T11:13:42.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00099860899999999991 2024-04-26T11:13:42.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:42.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.782816+0000", 2024-04-26T11:13:42.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0085014960000000007 2024-04-26T11:13:42.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:42.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.782847+0000", 2024-04-26T11:13:42.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0559000000000003e-05 2024-04-26T11:13:42.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:42.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.782863+0000", 2024-04-26T11:13:42.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6952999999999998e-05 2024-04-26T11:13:42.910 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.910 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:42.910 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.910 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:7071 5.8 5:1b75697f:::benchmark_data_smithi029_44842_object7070:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:42.910 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:39.773284+0000", 2024-04-26T11:13:42.910 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.0686419749999998, 2024-04-26T11:13:42.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096562850000000006, 2024-04-26T11:13:42.911 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:42.911 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:42.911 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:42.911 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:42.911 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:42.911 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 7071 2024-04-26T11:13:42.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.911 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:42.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:42.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.773284+0000", 2024-04-26T11:13:42.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:42.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.773284+0000", 2024-04-26T11:13:42.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:42.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.773283+0000", 2024-04-26T11:13:42.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:42.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:42.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.773414+0000", 2024-04-26T11:13:42.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000131161 2024-04-26T11:13:42.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:42.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.773423+0000", 2024-04-26T11:13:42.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5130000000000002e-06 2024-04-26T11:13:42.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:42.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.773431+0000", 2024-04-26T11:13:42.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3000000000000004e-06 2024-04-26T11:13:42.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.773676+0000", 2024-04-26T11:13:42.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024522999999999998 2024-04-26T11:13:42.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:42.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.773797+0000", 2024-04-26T11:13:42.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120474 2024-04-26T11:13:42.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:42.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.773930+0000", 2024-04-26T11:13:42.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013393699999999999 2024-04-26T11:13:42.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:42.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.774640+0000", 2024-04-26T11:13:42.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000709696 2024-04-26T11:13:42.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:42.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.782893+0000", 2024-04-26T11:13:42.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082525159999999997 2024-04-26T11:13:42.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:42.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.782917+0000", 2024-04-26T11:13:42.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4012e-05 2024-04-26T11:13:42.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:42.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.782940+0000", 2024-04-26T11:13:42.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.315e-05 2024-04-26T11:13:42.916 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.916 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:42.916 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.916 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:8075 5.b 5:d6469e12:::benchmark_data_smithi029_44842_object8074:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:42.916 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:39.983590+0000", 2024-04-26T11:13:42.916 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 2.8583351659999998, 2024-04-26T11:13:42.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011738508999999999, 2024-04-26T11:13:42.916 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:42.916 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:42.916 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:42.916 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:42.916 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:42.917 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 8075 2024-04-26T11:13:42.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.917 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:42.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:42.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.983590+0000", 2024-04-26T11:13:42.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:42.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.983590+0000", 2024-04-26T11:13:42.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:42.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.983590+0000", 2024-04-26T11:13:42.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:42.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:42.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.983667+0000", 2024-04-26T11:13:42.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7782999999999997e-05 2024-04-26T11:13:42.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:42.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.983676+0000", 2024-04-26T11:13:42.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8079999999999994e-06 2024-04-26T11:13:42.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:42.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.983683+0000", 2024-04-26T11:13:42.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7689999999999999e-06 2024-04-26T11:13:42.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.983713+0000", 2024-04-26T11:13:42.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9768999999999999e-05 2024-04-26T11:13:42.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:42.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.983812+0000", 2024-04-26T11:13:42.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9190000000000004e-05 2024-04-26T11:13:42.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:42.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.983911+0000", 2024-04-26T11:13:42.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8663e-05 2024-04-26T11:13:42.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:42.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.984587+0000", 2024-04-26T11:13:42.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00067663100000000002 2024-04-26T11:13:42.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:42.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.995248+0000", 2024-04-26T11:13:42.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010660431999999999 2024-04-26T11:13:42.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:42.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.995294+0000", 2024-04-26T11:13:42.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6615e-05 2024-04-26T11:13:42.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:42.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.995329+0000", 2024-04-26T11:13:42.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4560000000000001e-05 2024-04-26T11:13:42.921 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.921 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:42.921 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.922 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:8084 5.b 5:d9ae26e8:::benchmark_data_smithi029_44842_object8083:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:42.922 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:39.986296+0000", 2024-04-26T11:13:42.922 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 2.8556297000000002, 2024-04-26T11:13:42.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0091519700000000006, 2024-04-26T11:13:42.922 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:42.922 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:42.922 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:42.922 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:42.922 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:42.922 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 8084 2024-04-26T11:13:42.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.922 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:42.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:42.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.986296+0000", 2024-04-26T11:13:42.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:42.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.986296+0000", 2024-04-26T11:13:42.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:42.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.986295+0000", 2024-04-26T11:13:42.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:42.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.986348+0000", 2024-04-26T11:13:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3049e-05 2024-04-26T11:13:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.986357+0000", 2024-04-26T11:13:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6510000000000007e-06 2024-04-26T11:13:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:42.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.986362+0000", 2024-04-26T11:13:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9810000000000003e-06 2024-04-26T11:13:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.986396+0000", 2024-04-26T11:13:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4552999999999999e-05 2024-04-26T11:13:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.986517+0000", 2024-04-26T11:13:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012106 2024-04-26T11:13:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.986650+0000", 2024-04-26T11:13:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013271100000000001 2024-04-26T11:13:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.987712+0000", 2024-04-26T11:13:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010615220000000001 2024-04-26T11:13:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.995374+0000", 2024-04-26T11:13:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0076627029999999999 2024-04-26T11:13:42.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.995416+0000", 2024-04-26T11:13:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1316999999999998e-05 2024-04-26T11:13:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.995448+0000", 2024-04-26T11:13:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2044e-05 2024-04-26T11:13:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.928 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:8086 5.b 5:d280b17e:::benchmark_data_smithi029_44842_object8085:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:42.928 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:39.986458+0000", 2024-04-26T11:13:42.928 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 2.8554677879999999, 2024-04-26T11:13:42.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0091310939999999993, 2024-04-26T11:13:42.928 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:42.928 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:42.928 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:42.928 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:42.928 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:42.928 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 8086 2024-04-26T11:13:42.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.929 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:42.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:42.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.986458+0000", 2024-04-26T11:13:42.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:42.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.986458+0000", 2024-04-26T11:13:42.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:42.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.986457+0000", 2024-04-26T11:13:42.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:42.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:42.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.986539+0000", 2024-04-26T11:13:42.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1434000000000007e-05 2024-04-26T11:13:42.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.986547+0000", 2024-04-26T11:13:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4379999999999995e-06 2024-04-26T11:13:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.986554+0000", 2024-04-26T11:13:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8109999999999997e-06 2024-04-26T11:13:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.987102+0000", 2024-04-26T11:13:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00054855400000000003 2024-04-26T11:13:42.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:42.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.987216+0000", 2024-04-26T11:13:42.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011353600000000001 2024-04-26T11:13:42.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:42.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.987358+0000", 2024-04-26T11:13:42.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000142497 2024-04-26T11:13:42.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:42.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.987977+0000", 2024-04-26T11:13:42.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00061901100000000004 2024-04-26T11:13:42.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:42.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.995493+0000", 2024-04-26T11:13:42.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0075161050000000004 2024-04-26T11:13:42.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:42.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.995556+0000", 2024-04-26T11:13:42.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2502999999999994e-05 2024-04-26T11:13:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.995589+0000", 2024-04-26T11:13:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2814000000000001e-05 2024-04-26T11:13:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:8119 5.4 5:236ef8ee:::benchmark_data_smithi029_44842_object8118:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:39.992640+0000", 2024-04-26T11:13:42.934 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 2.8492856880000001, 2024-04-26T11:13:42.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013768594, 2024-04-26T11:13:42.935 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:42.935 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:42.935 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:42.935 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:42.935 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:42.935 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 8119 2024-04-26T11:13:42.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.935 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:42.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:42.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.992640+0000", 2024-04-26T11:13:42.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:42.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.992640+0000", 2024-04-26T11:13:42.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:42.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.992640+0000", 2024-04-26T11:13:42.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:42.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:42.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.992688+0000", 2024-04-26T11:13:42.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8065000000000001e-05 2024-04-26T11:13:42.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:42.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.992692+0000", 2024-04-26T11:13:42.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4880000000000001e-06 2024-04-26T11:13:42.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:42.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.992696+0000", 2024-04-26T11:13:42.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1819999999999999e-06 2024-04-26T11:13:42.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.993369+0000", 2024-04-26T11:13:42.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000672319 2024-04-26T11:13:42.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:42.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.993457+0000", 2024-04-26T11:13:42.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8163000000000003e-05 2024-04-26T11:13:42.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:42.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.993571+0000", 2024-04-26T11:13:42.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011461800000000001 2024-04-26T11:13:42.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:42.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.994133+0000", 2024-04-26T11:13:42.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056142200000000001 2024-04-26T11:13:42.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:42.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.006320+0000", 2024-04-26T11:13:42.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012186901999999999 2024-04-26T11:13:42.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:42.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.006369+0000", 2024-04-26T11:13:42.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9107999999999998e-05 2024-04-26T11:13:42.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:42.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.006408+0000", 2024-04-26T11:13:42.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9610999999999997e-05 2024-04-26T11:13:42.940 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.940 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:42.940 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.940 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:8131 5.4 5:246ac140:::benchmark_data_smithi029_44842_object8130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:42.940 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:39.995466+0000", 2024-04-26T11:13:42.940 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 2.846459071, 2024-04-26T11:13:42.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011027514, 2024-04-26T11:13:42.941 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:42.941 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:42.941 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:42.941 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:42.941 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:42.941 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 8131 2024-04-26T11:13:42.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.941 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:42.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:42.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.995466+0000", 2024-04-26T11:13:42.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:42.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.995466+0000", 2024-04-26T11:13:42.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:42.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.995466+0000", 2024-04-26T11:13:42.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:42.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:42.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.995541+0000", 2024-04-26T11:13:42.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5097000000000003e-05 2024-04-26T11:13:42.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:42.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.995549+0000", 2024-04-26T11:13:42.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1829999999999994e-06 2024-04-26T11:13:42.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:42.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.995555+0000", 2024-04-26T11:13:42.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1399999999999997e-06 2024-04-26T11:13:42.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.995783+0000", 2024-04-26T11:13:42.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000227538 2024-04-26T11:13:42.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:42.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.995927+0000", 2024-04-26T11:13:42.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014418100000000001 2024-04-26T11:13:42.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:42.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.996090+0000", 2024-04-26T11:13:42.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000162857 2024-04-26T11:13:42.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:42.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.997385+0000", 2024-04-26T11:13:42.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012955919999999999 2024-04-26T11:13:42.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:42.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.006447+0000", 2024-04-26T11:13:42.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0090611159999999993 2024-04-26T11:13:42.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:42.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.006474+0000", 2024-04-26T11:13:42.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7169e-05 2024-04-26T11:13:42.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:42.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.006494+0000", 2024-04-26T11:13:42.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0275000000000002e-05 2024-04-26T11:13:42.945 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.946 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:42.946 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.946 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:8137 5.4 5:2e8ff912:::benchmark_data_smithi029_44842_object8136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:42.946 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:39.995976+0000", 2024-04-26T11:13:42.946 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 2.8459494640000003, 2024-04-26T11:13:42.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010704696, 2024-04-26T11:13:42.946 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:42.946 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:42.946 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:42.946 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:42.946 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:42.946 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 8137 2024-04-26T11:13:42.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.947 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:42.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:42.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.995976+0000", 2024-04-26T11:13:42.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:42.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.995976+0000", 2024-04-26T11:13:42.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:42.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.995975+0000", 2024-04-26T11:13:42.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:42.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:42.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.996047+0000", 2024-04-26T11:13:42.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1588999999999995e-05 2024-04-26T11:13:42.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:42.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.996057+0000", 2024-04-26T11:13:42.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0338e-05 2024-04-26T11:13:42.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:42.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.996070+0000", 2024-04-26T11:13:42.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2721000000000001e-05 2024-04-26T11:13:42.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.996861+0000", 2024-04-26T11:13:42.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00079130200000000002 2024-04-26T11:13:42.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:42.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.996949+0000", 2024-04-26T11:13:42.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8008000000000002e-05 2024-04-26T11:13:42.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:42.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.997031+0000", 2024-04-26T11:13:42.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1515999999999997e-05 2024-04-26T11:13:42.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:42.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.997615+0000", 2024-04-26T11:13:42.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00058406699999999996 2024-04-26T11:13:42.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:42.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.006563+0000", 2024-04-26T11:13:42.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089476810000000007 2024-04-26T11:13:42.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:42.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.006629+0000", 2024-04-26T11:13:42.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6460999999999999e-05 2024-04-26T11:13:42.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:42.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.006681+0000", 2024-04-26T11:13:42.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1770000000000001e-05 2024-04-26T11:13:42.951 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.951 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:42.951 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.952 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:8140 5.e 5:715c5390:::benchmark_data_smithi029_44842_object8139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:42.952 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:39.997068+0000", 2024-04-26T11:13:42.952 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 2.8448577099999999, 2024-04-26T11:13:42.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0086403190000000005, 2024-04-26T11:13:42.952 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:42.952 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:42.952 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:42.952 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:42.952 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:42.952 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 8140 2024-04-26T11:13:42.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.952 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:42.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:42.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.997068+0000", 2024-04-26T11:13:42.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:42.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.997068+0000", 2024-04-26T11:13:42.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:42.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.997067+0000", 2024-04-26T11:13:42.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:42.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:42.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.997147+0000", 2024-04-26T11:13:42.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9963999999999995e-05 2024-04-26T11:13:42.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:42.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.997159+0000", 2024-04-26T11:13:42.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2156e-05 2024-04-26T11:13:42.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:42.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.997164+0000", 2024-04-26T11:13:42.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4140000000000002e-06 2024-04-26T11:13:42.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.997190+0000", 2024-04-26T11:13:42.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5749e-05 2024-04-26T11:13:42.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:42.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.997316+0000", 2024-04-26T11:13:42.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012534199999999999 2024-04-26T11:13:42.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:42.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.997443+0000", 2024-04-26T11:13:42.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012747400000000001 2024-04-26T11:13:42.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:42.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.998135+0000", 2024-04-26T11:13:42.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00069233399999999996 2024-04-26T11:13:42.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:42.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.005622+0000", 2024-04-26T11:13:42.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0074864839999999998 2024-04-26T11:13:42.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:42.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.005669+0000", 2024-04-26T11:13:42.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7346999999999999e-05 2024-04-26T11:13:42.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:42.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.005708+0000", 2024-04-26T11:13:42.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8894999999999999e-05 2024-04-26T11:13:42.957 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.957 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:42.957 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.957 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:8143 5.b 5:d1ca924a:::benchmark_data_smithi029_44842_object8142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:42.957 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:39.997826+0000", 2024-04-26T11:13:42.957 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 2.8440993839999997, 2024-04-26T11:13:42.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0083597629999999992, 2024-04-26T11:13:42.958 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:42.958 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:42.958 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:42.958 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:42.958 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:42.958 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 8143 2024-04-26T11:13:42.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.958 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:42.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:42.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.997826+0000", 2024-04-26T11:13:42.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:42.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.997826+0000", 2024-04-26T11:13:42.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:42.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.997826+0000", 2024-04-26T11:13:42.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:42.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:42.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.997888+0000", 2024-04-26T11:13:42.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2280999999999995e-05 2024-04-26T11:13:42.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:42.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.997899+0000", 2024-04-26T11:13:42.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1248e-05 2024-04-26T11:13:42.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:42.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.997906+0000", 2024-04-26T11:13:42.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5880000000000003e-06 2024-04-26T11:13:42.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.997937+0000", 2024-04-26T11:13:42.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0945000000000003e-05 2024-04-26T11:13:42.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:42.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.998023+0000", 2024-04-26T11:13:42.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6298999999999995e-05 2024-04-26T11:13:42.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:42.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.998108+0000", 2024-04-26T11:13:42.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5134000000000002e-05 2024-04-26T11:13:42.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:42.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:39.998735+0000", 2024-04-26T11:13:42.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00062662700000000004 2024-04-26T11:13:42.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:42.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.006107+0000", 2024-04-26T11:13:42.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0073727439999999997 2024-04-26T11:13:42.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:42.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.006150+0000", 2024-04-26T11:13:42.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3059000000000002e-05 2024-04-26T11:13:42.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:42.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.006186+0000", 2024-04-26T11:13:42.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5429000000000002e-05 2024-04-26T11:13:42.963 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.964 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:42.964 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.964 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:8976 5.b 5:d5d12f13:::benchmark_data_smithi029_44842_object8975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:42.964 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:40.191722+0000", 2024-04-26T11:13:42.964 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 2.6502031860000002, 2024-04-26T11:13:42.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087165060000000006, 2024-04-26T11:13:42.964 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:42.964 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:42.964 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:42.964 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:42.964 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:42.964 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 8976 2024-04-26T11:13:42.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.965 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:42.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:42.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.191722+0000", 2024-04-26T11:13:42.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:42.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.191722+0000", 2024-04-26T11:13:42.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:42.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:42.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.191722+0000", 2024-04-26T11:13:42.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:42.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:42.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.191805+0000", 2024-04-26T11:13:42.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3577000000000003e-05 2024-04-26T11:13:42.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:42.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.191811+0000", 2024-04-26T11:13:42.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2780000000000001e-06 2024-04-26T11:13:42.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:42.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.191815+0000", 2024-04-26T11:13:42.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8489999999999999e-06 2024-04-26T11:13:42.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:42.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.191868+0000", 2024-04-26T11:13:42.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3702999999999997e-05 2024-04-26T11:13:42.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:42.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.191989+0000", 2024-04-26T11:13:42.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012099699999999999 2024-04-26T11:13:42.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:42.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.192128+0000", 2024-04-26T11:13:42.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000138381 2024-04-26T11:13:42.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:42.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.192861+0000", 2024-04-26T11:13:42.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00073386499999999999 2024-04-26T11:13:42.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:42.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.200381+0000", 2024-04-26T11:13:42.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0075197939999999998 2024-04-26T11:13:42.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:42.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.200408+0000", 2024-04-26T11:13:42.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6655000000000001e-05 2024-04-26T11:13:42.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:42.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:42.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:42.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:40.200439+0000", 2024-04-26T11:13:42.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0902999999999999e-05 2024-04-26T11:13:42.969 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.969 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:42.969 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.969 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:42.969 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:42.969 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:13:42.971 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:42.968+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:42.971 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:13:43.071 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:43.070+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:43.144 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:13:43.144 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:13:43.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.144 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:19696 5.7 5:e8415b90:::benchmark_data_smithi029_44842_object19695:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T11:13:43.144 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:43.139267+0000", 2024-04-26T11:13:43.144 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.002668419, 2024-04-26T11:13:43.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027013359999999999, 2024-04-26T11:13:43.144 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.144 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:43.144 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:43.144 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:43.145 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:43.145 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 19696 2024-04-26T11:13:43.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.145 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.139267+0000", 2024-04-26T11:13:43.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.139267+0000", 2024-04-26T11:13:43.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.139266+0000", 2024-04-26T11:13:43.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:43.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.139370+0000", 2024-04-26T11:13:43.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010359800000000001 2024-04-26T11:13:43.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.139380+0000", 2024-04-26T11:13:43.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6940000000000007e-06 2024-04-26T11:13:43.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.139387+0000", 2024-04-26T11:13:43.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.131e-06 2024-04-26T11:13:43.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.139422+0000", 2024-04-26T11:13:43.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5698999999999998e-05 2024-04-26T11:13:43.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.139517+0000", 2024-04-26T11:13:43.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4353999999999998e-05 2024-04-26T11:13:43.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:43.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.139598+0000", 2024-04-26T11:13:43.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1433000000000005e-05 2024-04-26T11:13:43.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:43.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.140957+0000", 2024-04-26T11:13:43.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013584510000000001 2024-04-26T11:13:43.148 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.148 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.149 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.149 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:19699 5.2 5:45f3e085:::benchmark_data_smithi029_44842_object19698:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T11:13:43.149 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:43.140434+0000", 2024-04-26T11:13:43.149 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0015014519999999999, 2024-04-26T11:13:43.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0016349489999999999, 2024-04-26T11:13:43.149 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.149 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:43.149 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:43.149 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:43.149 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:43.149 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 19699 2024-04-26T11:13:43.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.150 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.140434+0000", 2024-04-26T11:13:43.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.140434+0000", 2024-04-26T11:13:43.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.140433+0000", 2024-04-26T11:13:43.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:43.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.140516+0000", 2024-04-26T11:13:43.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3100000000000001e-05 2024-04-26T11:13:43.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.140528+0000", 2024-04-26T11:13:43.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1382e-05 2024-04-26T11:13:43.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.140536+0000", 2024-04-26T11:13:43.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9810000000000003e-06 2024-04-26T11:13:43.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.140577+0000", 2024-04-26T11:13:43.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1430000000000001e-05 2024-04-26T11:13:43.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.140695+0000", 2024-04-26T11:13:43.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117718 2024-04-26T11:13:43.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:43.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.140804+0000", 2024-04-26T11:13:43.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010924100000000001 2024-04-26T11:13:43.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:43.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.142022+0000", 2024-04-26T11:13:43.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001217968 2024-04-26T11:13:43.153 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.153 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.153 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.153 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:19700 5.2 5:49e05f06:::benchmark_data_smithi029_44842_object19699:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T11:13:43.153 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:43.140547+0000", 2024-04-26T11:13:43.154 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.001388577, 2024-04-26T11:13:43.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0016174819999999999, 2024-04-26T11:13:43.154 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.154 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:43.154 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:43.154 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:43.154 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:43.154 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 19700 2024-04-26T11:13:43.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.154 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.140547+0000", 2024-04-26T11:13:43.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.140547+0000", 2024-04-26T11:13:43.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.140546+0000", 2024-04-26T11:13:43.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.140632+0000", 2024-04-26T11:13:43.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5839000000000003e-05 2024-04-26T11:13:43.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.140642+0000", 2024-04-26T11:13:43.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.024e-05 2024-04-26T11:13:43.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.140650+0000", 2024-04-26T11:13:43.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3390000000000004e-06 2024-04-26T11:13:43.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.141401+0000", 2024-04-26T11:13:43.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00075111100000000005 2024-04-26T11:13:43.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.141474+0000", 2024-04-26T11:13:43.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3065000000000006e-05 2024-04-26T11:13:43.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:43.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.141549+0000", 2024-04-26T11:13:43.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4812000000000001e-05 2024-04-26T11:13:43.157 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.157 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.158 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.158 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4534.0:19704 5.d e20/16 5:b74100a9:::benchmark_data_smithi029_44842_object19703:head v 20'1219, mlcod=20'1217)", 2024-04-26T11:13:43.158 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:43.141733+0000", 2024-04-26T11:13:43.158 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00020246500000000001, 2024-04-26T11:13:43.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00051530800000000002, 2024-04-26T11:13:43.158 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.158 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:13:43.158 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.141733+0000", 2024-04-26T11:13:43.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.141733+0000", 2024-04-26T11:13:43.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.141732+0000", 2024-04-26T11:13:43.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.141805+0000", 2024-04-26T11:13:43.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2200000000000007e-05 2024-04-26T11:13:43.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.141812+0000", 2024-04-26T11:13:43.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2620000000000001e-06 2024-04-26T11:13:43.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.141818+0000", 2024-04-26T11:13:43.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1299999999999998e-06 2024-04-26T11:13:43.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.141849+0000", 2024-04-26T11:13:43.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0935000000000001e-05 2024-04-26T11:13:43.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.141868+0000", 2024-04-26T11:13:43.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8715e-05 2024-04-26T11:13:43.161 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.161 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.161 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.161 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:19708 5.9 5:996bf976:::benchmark_data_smithi029_44842_object19707:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T11:13:43.162 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:43.141864+0000", 2024-04-26T11:13:43.162 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 7.1316999999999995e-05, 2024-04-26T11:13:43.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00047167599999999997, 2024-04-26T11:13:43.162 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.162 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:43.162 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:43.162 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:43.162 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:43.162 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 19708 2024-04-26T11:13:43.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.162 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.141864+0000", 2024-04-26T11:13:43.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.141864+0000", 2024-04-26T11:13:43.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.141863+0000", 2024-04-26T11:13:43.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:43.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.141948+0000", 2024-04-26T11:13:43.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4400000000000005e-05 2024-04-26T11:13:43.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.141957+0000", 2024-04-26T11:13:43.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0410000000000003e-06 2024-04-26T11:13:43.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.141962+0000", 2024-04-26T11:13:43.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3489999999999999e-06 2024-04-26T11:13:43.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.141993+0000", 2024-04-26T11:13:43.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0837000000000003e-05 2024-04-26T11:13:43.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.142104+0000", 2024-04-26T11:13:43.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111289 2024-04-26T11:13:43.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:43.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.142189+0000", 2024-04-26T11:13:43.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4985e-05 2024-04-26T11:13:43.165 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.165 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.165 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.166 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4534.0:19705 5.c e20/16 5:396fad10:::benchmark_data_smithi029_44842_object19704:head v 20'1211, mlcod=20'1207)", 2024-04-26T11:13:43.166 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:43.141925+0000", 2024-04-26T11:13:43.166 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.0638e-05, 2024-04-26T11:13:43.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00048876699999999998, 2024-04-26T11:13:43.166 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.166 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:13:43.166 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.141925+0000", 2024-04-26T11:13:43.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.141925+0000", 2024-04-26T11:13:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.141924+0000", 2024-04-26T11:13:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.142002+0000", 2024-04-26T11:13:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8034999999999994e-05 2024-04-26T11:13:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.142011+0000", 2024-04-26T11:13:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2509999999999994e-06 2024-04-26T11:13:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.142016+0000", 2024-04-26T11:13:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8680000000000004e-06 2024-04-26T11:13:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.142042+0000", 2024-04-26T11:13:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5995000000000001e-05 2024-04-26T11:13:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.142053+0000", 2024-04-26T11:13:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1056000000000001e-05 2024-04-26T11:13:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:19709 5.2 5:4210cf87:::benchmark_data_smithi029_44842_object19708:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T11:13:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:43.141999+0000", 2024-04-26T11:13:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9999366, 2024-04-26T11:13:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00048974499999999998, 2024-04-26T11:13:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 19709 2024-04-26T11:13:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.141999+0000", 2024-04-26T11:13:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.141999+0000", 2024-04-26T11:13:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.141998+0000", 2024-04-26T11:13:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.142083+0000", 2024-04-26T11:13:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5189e-05 2024-04-26T11:13:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.142093+0000", 2024-04-26T11:13:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0040999999999999e-05 2024-04-26T11:13:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.142100+0000", 2024-04-26T11:13:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5860000000000001e-06 2024-04-26T11:13:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.142134+0000", 2024-04-26T11:13:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4449999999999997e-05 2024-04-26T11:13:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.142243+0000", 2024-04-26T11:13:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000108459 2024-04-26T11:13:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.142423+0000", 2024-04-26T11:13:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018020699999999999 2024-04-26T11:13:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-26T11:13:43.174 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 7 2024-04-26T11:13:43.174 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:13:43.175 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:13:43.176 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:43.173+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:43.276 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:43.274+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:43.377 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:43.375+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:43.383 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:13:43.383 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:13:43.384 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:13:43.384 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:13:43.384 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:13:43.395 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:13:43.410 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 5 16 20505 20489 256.094 198.875 0.00332788 0.00390085 2024-04-26T11:13:43.478 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:43.476+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:43.579 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:43.577+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:43.611 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:13:43.611 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:13:43.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:13:43.611 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:13:43.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.612 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:43.612 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905603+0000", 2024-04-26T11:13:43.612 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.701875511000001, 2024-04-26T11:13:43.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016623645999999999, 2024-04-26T11:13:43.612 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.612 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:43.612 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905603+0000", 2024-04-26T11:13:43.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905603+0000", 2024-04-26T11:13:43.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905601+0000", 2024-04-26T11:13:43.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:13:43.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905609+0000", 2024-04-26T11:13:43.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3679999999999996e-06 2024-04-26T11:13:43.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905617+0000", 2024-04-26T11:13:43.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4309999999999994e-06 2024-04-26T11:13:43.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905626+0000", 2024-04-26T11:13:43.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9840000000000007e-06 2024-04-26T11:13:43.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905677+0000", 2024-04-26T11:13:43.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0305e-05 2024-04-26T11:13:43.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:13:43.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905684+0000", 2024-04-26T11:13:43.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0129999999999996e-06 2024-04-26T11:13:43.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.914734+0000", 2024-04-26T11:13:43.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090507199999999999 2024-04-26T11:13:43.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.914927+0000", 2024-04-26T11:13:43.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019310599999999999 2024-04-26T11:13:43.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:43.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.915592+0000", 2024-04-26T11:13:43.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00066429800000000002 2024-04-26T11:13:43.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:43.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.921998+0000", 2024-04-26T11:13:43.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064060469999999998 2024-04-26T11:13:43.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:43.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922072+0000", 2024-04-26T11:13:43.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3899999999999994e-05 2024-04-26T11:13:43.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:43.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922185+0000", 2024-04-26T11:13:43.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011294900000000001 2024-04-26T11:13:43.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:43.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922226+0000", 2024-04-26T11:13:43.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1777000000000003e-05 2024-04-26T11:13:43.618 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.618 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.618 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.618 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:43.618 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905638+0000", 2024-04-26T11:13:43.618 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.701839906, 2024-04-26T11:13:43.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019821874, 2024-04-26T11:13:43.618 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.618 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:43.619 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905638+0000", 2024-04-26T11:13:43.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905638+0000", 2024-04-26T11:13:43.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905638+0000", 2024-04-26T11:13:43.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905642+0000", 2024-04-26T11:13:43.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9759999999999997e-06 2024-04-26T11:13:43.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905647+0000", 2024-04-26T11:13:43.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5949999999999998e-06 2024-04-26T11:13:43.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905651+0000", 2024-04-26T11:13:43.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.924e-06 2024-04-26T11:13:43.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905752+0000", 2024-04-26T11:13:43.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000101 2024-04-26T11:13:43.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:43.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905758+0000", 2024-04-26T11:13:43.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:13:43.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922256+0000", 2024-04-26T11:13:43.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016497947999999998 2024-04-26T11:13:43.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922369+0000", 2024-04-26T11:13:43.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000113213 2024-04-26T11:13:43.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:43.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922505+0000", 2024-04-26T11:13:43.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000135635 2024-04-26T11:13:43.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:43.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925373+0000", 2024-04-26T11:13:43.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002868013 2024-04-26T11:13:43.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:43.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925402+0000", 2024-04-26T11:13:43.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.898e-05 2024-04-26T11:13:43.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:43.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925430+0000", 2024-04-26T11:13:43.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7739999999999999e-05 2024-04-26T11:13:43.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:43.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925460+0000", 2024-04-26T11:13:43.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0582e-05 2024-04-26T11:13:43.624 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.624 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.624 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.625 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:43.625 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905672+0000", 2024-04-26T11:13:43.625 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.701806074, 2024-04-26T11:13:43.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019920424999999999, 2024-04-26T11:13:43.625 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.625 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:43.625 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905672+0000", 2024-04-26T11:13:43.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905672+0000", 2024-04-26T11:13:43.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905672+0000", 2024-04-26T11:13:43.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905689+0000", 2024-04-26T11:13:43.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6929e-05 2024-04-26T11:13:43.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905694+0000", 2024-04-26T11:13:43.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3839999999999996e-06 2024-04-26T11:13:43.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905698+0000", 2024-04-26T11:13:43.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1450000000000001e-06 2024-04-26T11:13:43.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905812+0000", 2024-04-26T11:13:43.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000113807 2024-04-26T11:13:43.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:43.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905817+0000", 2024-04-26T11:13:43.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.203e-06 2024-04-26T11:13:43.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922934+0000", 2024-04-26T11:13:43.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017116681000000002 2024-04-26T11:13:43.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923094+0000", 2024-04-26T11:13:43.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000159667 2024-04-26T11:13:43.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:43.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923233+0000", 2024-04-26T11:13:43.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013987 2024-04-26T11:13:43.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:43.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925378+0000", 2024-04-26T11:13:43.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002144389 2024-04-26T11:13:43.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:43.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925510+0000", 2024-04-26T11:13:43.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013231399999999999 2024-04-26T11:13:43.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:43.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925559+0000", 2024-04-26T11:13:43.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8958000000000001e-05 2024-04-26T11:13:43.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:43.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925593+0000", 2024-04-26T11:13:43.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3488999999999997e-05 2024-04-26T11:13:43.631 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.631 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.631 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.631 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:43.631 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905702+0000", 2024-04-26T11:13:43.631 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.701776241000001, 2024-04-26T11:13:43.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.01999043, 2024-04-26T11:13:43.631 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.631 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:43.631 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905702+0000", 2024-04-26T11:13:43.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905702+0000", 2024-04-26T11:13:43.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905702+0000", 2024-04-26T11:13:43.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905704+0000", 2024-04-26T11:13:43.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6699999999999998e-06 2024-04-26T11:13:43.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905708+0000", 2024-04-26T11:13:43.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3000000000000002e-06 2024-04-26T11:13:43.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905712+0000", 2024-04-26T11:13:43.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.425e-06 2024-04-26T11:13:43.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905855+0000", 2024-04-26T11:13:43.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014253200000000001 2024-04-26T11:13:43.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:43.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905858+0000", 2024-04-26T11:13:43.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.822e-06 2024-04-26T11:13:43.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923510+0000", 2024-04-26T11:13:43.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017651394000000001 2024-04-26T11:13:43.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923578+0000", 2024-04-26T11:13:43.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8283999999999999e-05 2024-04-26T11:13:43.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:43.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923710+0000", 2024-04-26T11:13:43.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013175200000000001 2024-04-26T11:13:43.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:43.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925607+0000", 2024-04-26T11:13:43.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001897648 2024-04-26T11:13:43.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:43.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925644+0000", 2024-04-26T11:13:43.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6658e-05 2024-04-26T11:13:43.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:43.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925673+0000", 2024-04-26T11:13:43.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8566999999999999e-05 2024-04-26T11:13:43.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:43.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925692+0000", 2024-04-26T11:13:43.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9720000000000001e-05 2024-04-26T11:13:43.636 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.637 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.637 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.637 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:43.637 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905731+0000", 2024-04-26T11:13:43.637 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.701747263000001, 2024-04-26T11:13:43.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020112349000000002, 2024-04-26T11:13:43.637 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.637 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:43.637 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905731+0000", 2024-04-26T11:13:43.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905731+0000", 2024-04-26T11:13:43.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905731+0000", 2024-04-26T11:13:43.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905734+0000", 2024-04-26T11:13:43.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2329999999999998e-06 2024-04-26T11:13:43.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905740+0000", 2024-04-26T11:13:43.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4300000000000003e-06 2024-04-26T11:13:43.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905752+0000", 2024-04-26T11:13:43.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1987000000000001e-05 2024-04-26T11:13:43.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905894+0000", 2024-04-26T11:13:43.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000141858 2024-04-26T11:13:43.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:43.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905898+0000", 2024-04-26T11:13:43.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3599999999999998e-06 2024-04-26T11:13:43.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924011+0000", 2024-04-26T11:13:43.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018113066000000001 2024-04-26T11:13:43.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924100+0000", 2024-04-26T11:13:43.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8894999999999995e-05 2024-04-26T11:13:43.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:43.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924188+0000", 2024-04-26T11:13:43.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7903000000000002e-05 2024-04-26T11:13:43.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:43.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925616+0000", 2024-04-26T11:13:43.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014277319999999999 2024-04-26T11:13:43.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:43.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925741+0000", 2024-04-26T11:13:43.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012525899999999999 2024-04-26T11:13:43.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:43.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925804+0000", 2024-04-26T11:13:43.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2954999999999996e-05 2024-04-26T11:13:43.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:43.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925843+0000", 2024-04-26T11:13:43.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9096e-05 2024-04-26T11:13:43.643 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.643 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.643 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.643 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:43.643 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905757+0000", 2024-04-26T11:13:43.643 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.701721284000001, 2024-04-26T11:13:43.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020224836999999999, 2024-04-26T11:13:43.643 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.643 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:43.643 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905757+0000", 2024-04-26T11:13:43.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905757+0000", 2024-04-26T11:13:43.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905757+0000", 2024-04-26T11:13:43.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905760+0000", 2024-04-26T11:13:43.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2219999999999998e-06 2024-04-26T11:13:43.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905766+0000", 2024-04-26T11:13:43.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0820000000000004e-06 2024-04-26T11:13:43.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905771+0000", 2024-04-26T11:13:43.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1159999999999998e-06 2024-04-26T11:13:43.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905930+0000", 2024-04-26T11:13:43.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015876200000000001 2024-04-26T11:13:43.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:43.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905933+0000", 2024-04-26T11:13:43.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0359999999999998e-06 2024-04-26T11:13:43.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924368+0000", 2024-04-26T11:13:43.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0184355 2024-04-26T11:13:43.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924415+0000", 2024-04-26T11:13:43.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7098000000000002e-05 2024-04-26T11:13:43.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:43.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924506+0000", 2024-04-26T11:13:43.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1090999999999999e-05 2024-04-26T11:13:43.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:43.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925622+0000", 2024-04-26T11:13:43.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011159480000000001 2024-04-26T11:13:43.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:43.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925927+0000", 2024-04-26T11:13:43.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00030507899999999998 2024-04-26T11:13:43.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:43.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925958+0000", 2024-04-26T11:13:43.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0534999999999998e-05 2024-04-26T11:13:43.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:43.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925982+0000", 2024-04-26T11:13:43.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3782999999999999e-05 2024-04-26T11:13:43.649 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.649 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.650 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.650 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:43.650 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905814+0000", 2024-04-26T11:13:43.650 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.701664145999999, 2024-04-26T11:13:43.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020271001, 2024-04-26T11:13:43.650 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.650 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:43.650 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905814+0000", 2024-04-26T11:13:43.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905814+0000", 2024-04-26T11:13:43.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905813+0000", 2024-04-26T11:13:43.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:43.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905821+0000", 2024-04-26T11:13:43.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1280000000000008e-06 2024-04-26T11:13:43.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905832+0000", 2024-04-26T11:13:43.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1318000000000001e-05 2024-04-26T11:13:43.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905842+0000", 2024-04-26T11:13:43.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0101e-05 2024-04-26T11:13:43.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905970+0000", 2024-04-26T11:13:43.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012764499999999999 2024-04-26T11:13:43.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:43.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905977+0000", 2024-04-26T11:13:43.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5019999999999998e-06 2024-04-26T11:13:43.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924672+0000", 2024-04-26T11:13:43.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018694908999999999 2024-04-26T11:13:43.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924754+0000", 2024-04-26T11:13:43.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2167000000000001e-05 2024-04-26T11:13:43.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:43.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924834+0000", 2024-04-26T11:13:43.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0313000000000002e-05 2024-04-26T11:13:43.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:43.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925860+0000", 2024-04-26T11:13:43.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0010255869999999999 2024-04-26T11:13:43.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:43.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926020+0000", 2024-04-26T11:13:43.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000160588 2024-04-26T11:13:43.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:43.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926054+0000", 2024-04-26T11:13:43.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3748999999999998e-05 2024-04-26T11:13:43.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:43.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926085+0000", 2024-04-26T11:13:43.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1111000000000001e-05 2024-04-26T11:13:43.656 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.656 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.656 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.656 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:43.656 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905851+0000", 2024-04-26T11:13:43.656 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.701627057, 2024-04-26T11:13:43.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020308667999999998, 2024-04-26T11:13:43.656 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.656 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:43.656 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905851+0000", 2024-04-26T11:13:43.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905851+0000", 2024-04-26T11:13:43.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905851+0000", 2024-04-26T11:13:43.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905855+0000", 2024-04-26T11:13:43.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3120000000000004e-06 2024-04-26T11:13:43.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905861+0000", 2024-04-26T11:13:43.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9399999999999999e-06 2024-04-26T11:13:43.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905865+0000", 2024-04-26T11:13:43.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9079999999999997e-06 2024-04-26T11:13:43.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906003+0000", 2024-04-26T11:13:43.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013821800000000001 2024-04-26T11:13:43.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:43.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906007+0000", 2024-04-26T11:13:43.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9670000000000003e-06 2024-04-26T11:13:43.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925040+0000", 2024-04-26T11:13:43.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019032613 2024-04-26T11:13:43.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925107+0000", 2024-04-26T11:13:43.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7185000000000001e-05 2024-04-26T11:13:43.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:43.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925195+0000", 2024-04-26T11:13:43.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8515000000000002e-05 2024-04-26T11:13:43.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:43.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926094+0000", 2024-04-26T11:13:43.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089852300000000003 2024-04-26T11:13:43.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:43.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926116+0000", 2024-04-26T11:13:43.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1951e-05 2024-04-26T11:13:43.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:43.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926142+0000", 2024-04-26T11:13:43.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6667000000000001e-05 2024-04-26T11:13:43.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:43.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926160+0000", 2024-04-26T11:13:43.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7339000000000001e-05 2024-04-26T11:13:43.662 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.662 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.662 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.663 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:43.663 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905890+0000", 2024-04-26T11:13:43.663 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.701588155, 2024-04-26T11:13:43.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017722176999999999, 2024-04-26T11:13:43.663 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.663 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:43.663 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905890+0000", 2024-04-26T11:13:43.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905890+0000", 2024-04-26T11:13:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905890+0000", 2024-04-26T11:13:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905893+0000", 2024-04-26T11:13:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9160000000000001e-06 2024-04-26T11:13:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905899+0000", 2024-04-26T11:13:43.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6810000000000001e-06 2024-04-26T11:13:43.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905904+0000", 2024-04-26T11:13:43.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2009999999999998e-06 2024-04-26T11:13:43.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905956+0000", 2024-04-26T11:13:43.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1505999999999998e-05 2024-04-26T11:13:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:13:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905962+0000", 2024-04-26T11:13:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1539999999999999e-06 2024-04-26T11:13:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918151+0000", 2024-04-26T11:13:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012189046 2024-04-26T11:13:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918261+0000", 2024-04-26T11:13:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000110258 2024-04-26T11:13:43.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:43.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918423+0000", 2024-04-26T11:13:43.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000162027 2024-04-26T11:13:43.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:43.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923237+0000", 2024-04-26T11:13:43.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048139519999999998 2024-04-26T11:13:43.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:43.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923530+0000", 2024-04-26T11:13:43.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00029218799999999997 2024-04-26T11:13:43.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:43.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923576+0000", 2024-04-26T11:13:43.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6545999999999998e-05 2024-04-26T11:13:43.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:43.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923612+0000", 2024-04-26T11:13:43.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6171000000000003e-05 2024-04-26T11:13:43.669 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.669 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.669 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.669 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:43.669 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905914+0000", 2024-04-26T11:13:43.669 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.701564267999998, 2024-04-26T11:13:43.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017543897999999999, 2024-04-26T11:13:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905914+0000", 2024-04-26T11:13:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905914+0000", 2024-04-26T11:13:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905914+0000", 2024-04-26T11:13:43.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905917+0000", 2024-04-26T11:13:43.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4359999999999998e-06 2024-04-26T11:13:43.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905925+0000", 2024-04-26T11:13:43.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0779999999999996e-06 2024-04-26T11:13:43.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905932+0000", 2024-04-26T11:13:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3810000000000001e-06 2024-04-26T11:13:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905979+0000", 2024-04-26T11:13:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6264000000000003e-05 2024-04-26T11:13:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:13:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905983+0000", 2024-04-26T11:13:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8909999999999997e-06 2024-04-26T11:13:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.914254+0000", 2024-04-26T11:13:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082715619999999997 2024-04-26T11:13:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.914410+0000", 2024-04-26T11:13:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015563 2024-04-26T11:13:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.914633+0000", 2024-04-26T11:13:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022336 2024-04-26T11:13:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:43.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920212+0000", 2024-04-26T11:13:43.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055787349999999996 2024-04-26T11:13:43.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:43.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923369+0000", 2024-04-26T11:13:43.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0031574060000000002 2024-04-26T11:13:43.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:43.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923419+0000", 2024-04-26T11:13:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9527000000000002e-05 2024-04-26T11:13:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923458+0000", 2024-04-26T11:13:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9005999999999999e-05 2024-04-26T11:13:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:31 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905953+0000", 2024-04-26T11:13:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.701525370999999, 2024-04-26T11:13:43.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018731343000000001, 2024-04-26T11:13:43.676 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.676 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:43.676 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905953+0000", 2024-04-26T11:13:43.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905953+0000", 2024-04-26T11:13:43.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905952+0000", 2024-04-26T11:13:43.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905966+0000", 2024-04-26T11:13:43.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3281999999999999e-05 2024-04-26T11:13:43.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905973+0000", 2024-04-26T11:13:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4109999999999999e-06 2024-04-26T11:13:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905979+0000", 2024-04-26T11:13:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2949999999999999e-06 2024-04-26T11:13:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906013+0000", 2024-04-26T11:13:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3844000000000003e-05 2024-04-26T11:13:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906017+0000", 2024-04-26T11:13:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4419999999999998e-06 2024-04-26T11:13:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918937+0000", 2024-04-26T11:13:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012920403 2024-04-26T11:13:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.919018+0000", 2024-04-26T11:13:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1540999999999997e-05 2024-04-26T11:13:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:43.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.919765+0000", 2024-04-26T11:13:43.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00074620299999999997 2024-04-26T11:13:43.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:43.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923650+0000", 2024-04-26T11:13:43.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038853820000000002 2024-04-26T11:13:43.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:43.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924619+0000", 2024-04-26T11:13:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00096863899999999998 2024-04-26T11:13:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924649+0000", 2024-04-26T11:13:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9879e-05 2024-04-26T11:13:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924684+0000", 2024-04-26T11:13:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5611999999999997e-05 2024-04-26T11:13:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.682 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:43.682 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905987+0000", 2024-04-26T11:13:43.682 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.701491710999999, 2024-04-26T11:13:43.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018241182000000002, 2024-04-26T11:13:43.682 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.682 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:43.682 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905987+0000", 2024-04-26T11:13:43.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905987+0000", 2024-04-26T11:13:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905986+0000", 2024-04-26T11:13:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905990+0000", 2024-04-26T11:13:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.755e-06 2024-04-26T11:13:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905995+0000", 2024-04-26T11:13:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4999999999999999e-06 2024-04-26T11:13:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906000+0000", 2024-04-26T11:13:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8949999999999997e-06 2024-04-26T11:13:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906038+0000", 2024-04-26T11:13:43.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7762999999999997e-05 2024-04-26T11:13:43.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:43.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906042+0000", 2024-04-26T11:13:43.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6890000000000002e-06 2024-04-26T11:13:43.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922401+0000", 2024-04-26T11:13:43.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358973999999998 2024-04-26T11:13:43.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922482+0000", 2024-04-26T11:13:43.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1711000000000004e-05 2024-04-26T11:13:43.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:43.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922607+0000", 2024-04-26T11:13:43.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000124955 2024-04-26T11:13:43.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:43.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924016+0000", 2024-04-26T11:13:43.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014086490000000001 2024-04-26T11:13:43.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924154+0000", 2024-04-26T11:13:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013777599999999999 2024-04-26T11:13:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924196+0000", 2024-04-26T11:13:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2647e-05 2024-04-26T11:13:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924228+0000", 2024-04-26T11:13:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1372999999999999e-05 2024-04-26T11:13:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906018+0000", 2024-04-26T11:13:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.701459800999999, 2024-04-26T11:13:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017151182000000001, 2024-04-26T11:13:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906018+0000", 2024-04-26T11:13:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906018+0000", 2024-04-26T11:13:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906018+0000", 2024-04-26T11:13:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906027+0000", 2024-04-26T11:13:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9190000000000005e-06 2024-04-26T11:13:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906033+0000", 2024-04-26T11:13:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1419999999999998e-06 2024-04-26T11:13:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906039+0000", 2024-04-26T11:13:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.156e-06 2024-04-26T11:13:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906075+0000", 2024-04-26T11:13:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5608999999999997e-05 2024-04-26T11:13:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:13:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906080+0000", 2024-04-26T11:13:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.276e-06 2024-04-26T11:13:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918535+0000", 2024-04-26T11:13:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012455061999999999 2024-04-26T11:13:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918624+0000", 2024-04-26T11:13:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.878e-05 2024-04-26T11:13:43.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:43.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918748+0000", 2024-04-26T11:13:43.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012453799999999999 2024-04-26T11:13:43.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:43.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922172+0000", 2024-04-26T11:13:43.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034232580000000002 2024-04-26T11:13:43.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:43.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923079+0000", 2024-04-26T11:13:43.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00090687899999999998 2024-04-26T11:13:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923129+0000", 2024-04-26T11:13:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0773999999999999e-05 2024-04-26T11:13:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923170+0000", 2024-04-26T11:13:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0238999999999999e-05 2024-04-26T11:13:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906048+0000", 2024-04-26T11:13:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.701430282, 2024-04-26T11:13:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018763734000000001, 2024-04-26T11:13:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906048+0000", 2024-04-26T11:13:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906048+0000", 2024-04-26T11:13:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906047+0000", 2024-04-26T11:13:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906051+0000", 2024-04-26T11:13:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.799e-06 2024-04-26T11:13:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906058+0000", 2024-04-26T11:13:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4470000000000003e-06 2024-04-26T11:13:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906064+0000", 2024-04-26T11:13:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1319999999999999e-06 2024-04-26T11:13:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906092+0000", 2024-04-26T11:13:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7939000000000001e-05 2024-04-26T11:13:43.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:43.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906097+0000", 2024-04-26T11:13:43.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.741e-06 2024-04-26T11:13:43.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920571+0000", 2024-04-26T11:13:43.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014474526 2024-04-26T11:13:43.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920675+0000", 2024-04-26T11:13:43.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000103644 2024-04-26T11:13:43.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:43.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920803+0000", 2024-04-26T11:13:43.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012879699999999999 2024-04-26T11:13:43.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:43.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923655+0000", 2024-04-26T11:13:43.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028517379999999999 2024-04-26T11:13:43.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:43.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924728+0000", 2024-04-26T11:13:43.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0010732199999999999 2024-04-26T11:13:43.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:43.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924775+0000", 2024-04-26T11:13:43.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6168999999999998e-05 2024-04-26T11:13:43.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:43.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924812+0000", 2024-04-26T11:13:43.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7070000000000003e-05 2024-04-26T11:13:43.699 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.699 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.699 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.700 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:43.700 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906072+0000", 2024-04-26T11:13:43.700 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.701406578, 2024-04-26T11:13:43.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016458922000000001, 2024-04-26T11:13:43.700 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.700 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:43.700 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906072+0000", 2024-04-26T11:13:43.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906072+0000", 2024-04-26T11:13:43.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906071+0000", 2024-04-26T11:13:43.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906074+0000", 2024-04-26T11:13:43.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9289999999999998e-06 2024-04-26T11:13:43.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906081+0000", 2024-04-26T11:13:43.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8950000000000001e-06 2024-04-26T11:13:43.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906086+0000", 2024-04-26T11:13:43.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7979999999999996e-06 2024-04-26T11:13:43.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906138+0000", 2024-04-26T11:13:43.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1820999999999997e-05 2024-04-26T11:13:43.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:13:43.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906140+0000", 2024-04-26T11:13:43.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.706e-06 2024-04-26T11:13:43.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.916004+0000", 2024-04-26T11:13:43.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098632700000000004 2024-04-26T11:13:43.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.916126+0000", 2024-04-26T11:13:43.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012214300000000001 2024-04-26T11:13:43.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:43.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.916259+0000", 2024-04-26T11:13:43.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013354999999999999 2024-04-26T11:13:43.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:43.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922337+0000", 2024-04-26T11:13:43.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060773600000000004 2024-04-26T11:13:43.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:43.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922447+0000", 2024-04-26T11:13:43.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011003800000000001 2024-04-26T11:13:43.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:43.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922492+0000", 2024-04-26T11:13:43.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5185000000000002e-05 2024-04-26T11:13:43.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:43.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922531+0000", 2024-04-26T11:13:43.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8652999999999997e-05 2024-04-26T11:13:43.705 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.705 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.705 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.706 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:43.706 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906123+0000", 2024-04-26T11:13:43.706 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.701355410000001, 2024-04-26T11:13:43.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018987535999999999, 2024-04-26T11:13:43.706 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.706 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:43.706 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906123+0000", 2024-04-26T11:13:43.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906123+0000", 2024-04-26T11:13:43.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906122+0000", 2024-04-26T11:13:43.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:43.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906136+0000", 2024-04-26T11:13:43.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4527e-05 2024-04-26T11:13:43.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906148+0000", 2024-04-26T11:13:43.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2332e-05 2024-04-26T11:13:43.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906157+0000", 2024-04-26T11:13:43.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0129999999999999e-06 2024-04-26T11:13:43.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906187+0000", 2024-04-26T11:13:43.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9748e-05 2024-04-26T11:13:43.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:43.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906190+0000", 2024-04-26T11:13:43.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0290000000000001e-06 2024-04-26T11:13:43.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.921242+0000", 2024-04-26T11:13:43.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015052100000000001 2024-04-26T11:13:43.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.921750+0000", 2024-04-26T11:13:43.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00050746299999999999 2024-04-26T11:13:43.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:43.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.921915+0000", 2024-04-26T11:13:43.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016514700000000001 2024-04-26T11:13:43.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:43.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923673+0000", 2024-04-26T11:13:43.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001757836 2024-04-26T11:13:43.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:43.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925039+0000", 2024-04-26T11:13:43.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001366396 2024-04-26T11:13:43.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:43.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925077+0000", 2024-04-26T11:13:43.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7595999999999997e-05 2024-04-26T11:13:43.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:43.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925110+0000", 2024-04-26T11:13:43.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3531999999999997e-05 2024-04-26T11:13:43.711 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.711 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.711 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.712 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:21 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:43.712 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906168+0000", 2024-04-26T11:13:43.712 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.701309770999998, 2024-04-26T11:13:43.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346383, 2024-04-26T11:13:43.712 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.712 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:43.712 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906168+0000", 2024-04-26T11:13:43.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906168+0000", 2024-04-26T11:13:43.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906168+0000", 2024-04-26T11:13:43.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906183+0000", 2024-04-26T11:13:43.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5597e-05 2024-04-26T11:13:43.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906201+0000", 2024-04-26T11:13:43.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7949e-05 2024-04-26T11:13:43.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906208+0000", 2024-04-26T11:13:43.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0990000000000001e-06 2024-04-26T11:13:43.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906233+0000", 2024-04-26T11:13:43.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4351000000000001e-05 2024-04-26T11:13:43.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:43.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906235+0000", 2024-04-26T11:13:43.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4169999999999999e-06 2024-04-26T11:13:43.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.919842+0000", 2024-04-26T11:13:43.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013606337 2024-04-26T11:13:43.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920004+0000", 2024-04-26T11:13:43.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016249799999999999 2024-04-26T11:13:43.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:43.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920157+0000", 2024-04-26T11:13:43.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015337400000000001 2024-04-26T11:13:43.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:43.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922705+0000", 2024-04-26T11:13:43.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0025479330000000001 2024-04-26T11:13:43.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:43.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923419+0000", 2024-04-26T11:13:43.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00071332999999999998 2024-04-26T11:13:43.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:43.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923467+0000", 2024-04-26T11:13:43.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8556000000000001e-05 2024-04-26T11:13:43.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:43.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923515+0000", 2024-04-26T11:13:43.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7540999999999998e-05 2024-04-26T11:13:43.718 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.718 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.718 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.718 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:43.718 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906218+0000", 2024-04-26T11:13:43.718 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.701260574999999, 2024-04-26T11:13:43.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018831681999999999, 2024-04-26T11:13:43.719 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.719 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:43.719 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906218+0000", 2024-04-26T11:13:43.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906218+0000", 2024-04-26T11:13:43.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906217+0000", 2024-04-26T11:13:43.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906221+0000", 2024-04-26T11:13:43.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1760000000000003e-06 2024-04-26T11:13:43.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906228+0000", 2024-04-26T11:13:43.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9800000000000001e-06 2024-04-26T11:13:43.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906234+0000", 2024-04-26T11:13:43.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9320000000000001e-06 2024-04-26T11:13:43.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906264+0000", 2024-04-26T11:13:43.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9518000000000001e-05 2024-04-26T11:13:43.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:13:43.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906268+0000", 2024-04-26T11:13:43.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2939999999999999e-06 2024-04-26T11:13:43.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922451+0000", 2024-04-26T11:13:43.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016183288000000001 2024-04-26T11:13:43.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922567+0000", 2024-04-26T11:13:43.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000115313 2024-04-26T11:13:43.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:43.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922684+0000", 2024-04-26T11:13:43.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117419 2024-04-26T11:13:43.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:43.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924129+0000", 2024-04-26T11:13:43.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001444753 2024-04-26T11:13:43.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:43.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924979+0000", 2024-04-26T11:13:43.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00084985900000000001 2024-04-26T11:13:43.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:43.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925012+0000", 2024-04-26T11:13:43.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3352999999999997e-05 2024-04-26T11:13:43.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:43.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925049+0000", 2024-04-26T11:13:43.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7354999999999997e-05 2024-04-26T11:13:43.725 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.725 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.725 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.725 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:43.725 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906243+0000", 2024-04-26T11:13:43.725 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.701235195999999, 2024-04-26T11:13:43.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018983739999999999, 2024-04-26T11:13:43.725 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.726 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:13:43.726 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906243+0000", 2024-04-26T11:13:43.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906243+0000", 2024-04-26T11:13:43.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906243+0000", 2024-04-26T11:13:43.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906245+0000", 2024-04-26T11:13:43.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9189999999999999e-06 2024-04-26T11:13:43.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906252+0000", 2024-04-26T11:13:43.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:13:43.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906258+0000", 2024-04-26T11:13:43.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.728e-06 2024-04-26T11:13:43.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906290+0000", 2024-04-26T11:13:43.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2400000000000001e-05 2024-04-26T11:13:43.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:43.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906293+0000", 2024-04-26T11:13:43.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1769999999999998e-06 2024-04-26T11:13:43.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922664+0000", 2024-04-26T11:13:43.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016370663000000001 2024-04-26T11:13:43.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922923+0000", 2024-04-26T11:13:43.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025853200000000001 2024-04-26T11:13:43.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:43.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925227+0000", 2024-04-26T11:13:43.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023042570000000001 2024-04-26T11:13:43.730 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.730 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.730 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.730 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:20314 5.2 5:43aadba9:::benchmark_data_smithi029_44842_object20313:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:43.730 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:43.342792+0000", 2024-04-26T11:13:43.730 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.26468656899999998, 2024-04-26T11:13:43.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014798617, 2024-04-26T11:13:43.730 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:43.731 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:43.731 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:43.731 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:43.731 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:43.731 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 20314 2024-04-26T11:13:43.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.731 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:43.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:43.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.342792+0000", 2024-04-26T11:13:43.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:43.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.342792+0000", 2024-04-26T11:13:43.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:43.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:43.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.342791+0000", 2024-04-26T11:13:43.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:43.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:43.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.342846+0000", 2024-04-26T11:13:43.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4935999999999997e-05 2024-04-26T11:13:43.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:43.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.342855+0000", 2024-04-26T11:13:43.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.448e-06 2024-04-26T11:13:43.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.342861+0000", 2024-04-26T11:13:43.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.502e-06 2024-04-26T11:13:43.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:43.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.342887+0000", 2024-04-26T11:13:43.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6704e-05 2024-04-26T11:13:43.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:43.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.342977+0000", 2024-04-26T11:13:43.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9622000000000004e-05 2024-04-26T11:13:43.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:43.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.343073+0000", 2024-04-26T11:13:43.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5722000000000003e-05 2024-04-26T11:13:43.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:43.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.345559+0000", 2024-04-26T11:13:43.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024860400000000001 2024-04-26T11:13:43.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:43.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.357515+0000", 2024-04-26T11:13:43.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011956346 2024-04-26T11:13:43.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:43.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.357558+0000", 2024-04-26T11:13:43.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3377000000000002e-05 2024-04-26T11:13:43.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:43.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:43.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:43.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.357590+0000", 2024-04-26T11:13:43.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1810999999999997e-05 2024-04-26T11:13:43.736 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.736 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.736 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.736 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:43.736 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:43.736 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:13:43.738 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:13:43.738 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:43.735+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:43.838 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:43.836+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:43.923 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:13:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:13:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:22139 5.8 e21/16 5:196cd9f3:::benchmark_data_smithi029_44842_object22138:head v 21'1387, mlcod=21'1385)", 2024-04-26T11:13:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:43.921666+0000", 2024-04-26T11:13:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00067346500000000004, 2024-04-26T11:13:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00069110899999999997, 2024-04-26T11:13:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:43.924 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921666+0000", 2024-04-26T11:13:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921666+0000", 2024-04-26T11:13:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921665+0000", 2024-04-26T11:13:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.925 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921726+0000", 2024-04-26T11:13:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1347999999999996e-05 2024-04-26T11:13:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921736+0000", 2024-04-26T11:13:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.5650000000000007e-06 2024-04-26T11:13:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921742+0000", 2024-04-26T11:13:43.926 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4729999999999997e-06 2024-04-26T11:13:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921773+0000", 2024-04-26T11:13:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0116000000000001e-05 2024-04-26T11:13:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921789+0000", 2024-04-26T11:13:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6053999999999999e-05 2024-04-26T11:13:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:43.927 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:22132 5.0 e21/16 5:0868362f:::benchmark_data_smithi029_44842_object22131:head v 21'1390, mlcod=21'1388)", 2024-04-26T11:13:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:43.920352+0000", 2024-04-26T11:13:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0019873270000000001, 2024-04-26T11:13:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002047536, 2024-04-26T11:13:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.920352+0000", 2024-04-26T11:13:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.928 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.920352+0000", 2024-04-26T11:13:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.920351+0000", 2024-04-26T11:13:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.920418+0000", 2024-04-26T11:13:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6497999999999999e-05 2024-04-26T11:13:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.929 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.920424+0000", 2024-04-26T11:13:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9070000000000004e-06 2024-04-26T11:13:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.920427+0000", 2024-04-26T11:13:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.354e-06 2024-04-26T11:13:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.920459+0000", 2024-04-26T11:13:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1463e-05 2024-04-26T11:13:43.930 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.920479+0000", 2024-04-26T11:13:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0035e-05 2024-04-26T11:13:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:43.931 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:22133 5.c 5:3a5d20f0:::benchmark_data_smithi029_44842_object22132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:43.920561+0000", 2024-04-26T11:13:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0017779740000000001, 2024-04-26T11:13:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00187693, 2024-04-26T11:13:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:43.932 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 22133 2024-04-26T11:13:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.920561+0000", 2024-04-26T11:13:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.920561+0000", 2024-04-26T11:13:43.933 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.920560+0000", 2024-04-26T11:13:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.920625+0000", 2024-04-26T11:13:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4647000000000006e-05 2024-04-26T11:13:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:43.934 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.920635+0000", 2024-04-26T11:13:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0508e-05 2024-04-26T11:13:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.920643+0000", 2024-04-26T11:13:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2509999999999997e-06 2024-04-26T11:13:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.920674+0000", 2024-04-26T11:13:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0905999999999999e-05 2024-04-26T11:13:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:43.935 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.920785+0000", 2024-04-26T11:13:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011173199999999999 2024-04-26T11:13:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.920869+0000", 2024-04-26T11:13:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4087999999999999e-05 2024-04-26T11:13:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.922095+0000", 2024-04-26T11:13:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001225329 2024-04-26T11:13:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:43.936 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:22137 5.3 5:c53d99b9:::benchmark_data_smithi029_44842_object22136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:43.920967+0000", 2024-04-26T11:13:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0013723190000000001, 2024-04-26T11:13:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001528983, 2024-04-26T11:13:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 22137 2024-04-26T11:13:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.937 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.920967+0000", 2024-04-26T11:13:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.920967+0000", 2024-04-26T11:13:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.920966+0000", 2024-04-26T11:13:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.938 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921116+0000", 2024-04-26T11:13:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014971900000000001 2024-04-26T11:13:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921127+0000", 2024-04-26T11:13:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1035e-05 2024-04-26T11:13:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921134+0000", 2024-04-26T11:13:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.905e-06 2024-04-26T11:13:43.939 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921162+0000", 2024-04-26T11:13:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8711999999999999e-05 2024-04-26T11:13:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921242+0000", 2024-04-26T11:13:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0082999999999999e-05 2024-04-26T11:13:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:43.940 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921330+0000", 2024-04-26T11:13:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7928000000000002e-05 2024-04-26T11:13:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:22134 5.0 e21/16 5:0fabb2cc:::benchmark_data_smithi029_44842_object22133:head v 21'1391, mlcod=21'1388)", 2024-04-26T11:13:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:43.921224+0000", 2024-04-26T11:13:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0011148499999999999, 2024-04-26T11:13:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0013231199999999999, 2024-04-26T11:13:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:43.941 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921224+0000", 2024-04-26T11:13:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921224+0000", 2024-04-26T11:13:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921224+0000", 2024-04-26T11:13:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.942 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921281+0000", 2024-04-26T11:13:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7234000000000001e-05 2024-04-26T11:13:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921290+0000", 2024-04-26T11:13:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4420000000000004e-06 2024-04-26T11:13:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921296+0000", 2024-04-26T11:13:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1919999999999996e-06 2024-04-26T11:13:43.943 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921327+0000", 2024-04-26T11:13:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1578000000000002e-05 2024-04-26T11:13:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921344+0000", 2024-04-26T11:13:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7187999999999999e-05 2024-04-26T11:13:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.944 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:22138 5.e e21/16 5:7258aab2:::benchmark_data_smithi029_44842_object22137:head v 21'1365, mlcod=21'1362)", 2024-04-26T11:13:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:43.921418+0000", 2024-04-26T11:13:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00092072400000000004, 2024-04-26T11:13:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001173685, 2024-04-26T11:13:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921418+0000", 2024-04-26T11:13:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:43.945 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921418+0000", 2024-04-26T11:13:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921418+0000", 2024-04-26T11:13:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921512+0000", 2024-04-26T11:13:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3924000000000004e-05 2024-04-26T11:13:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.946 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921524+0000", 2024-04-26T11:13:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2787e-05 2024-04-26T11:13:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921531+0000", 2024-04-26T11:13:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9199999999999998e-06 2024-04-26T11:13:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921577+0000", 2024-04-26T11:13:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5459e-05 2024-04-26T11:13:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.947 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921595+0000", 2024-04-26T11:13:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7689e-05 2024-04-26T11:13:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:22136 5.1 e21/16 5:8f1f04bd:::benchmark_data_smithi029_44842_object22135:head v 21'1409, mlcod=21'1407)", 2024-04-26T11:13:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:43.921437+0000", 2024-04-26T11:13:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00090219400000000004, 2024-04-26T11:13:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0011896680000000001, 2024-04-26T11:13:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921437+0000", 2024-04-26T11:13:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921437+0000", 2024-04-26T11:13:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:43.949 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921437+0000", 2024-04-26T11:13:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921549+0000", 2024-04-26T11:13:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011290000000000001 2024-04-26T11:13:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921557+0000", 2024-04-26T11:13:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6850000000000001e-06 2024-04-26T11:13:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.950 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921563+0000", 2024-04-26T11:13:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0120000000000002e-06 2024-04-26T11:13:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921604+0000", 2024-04-26T11:13:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1282000000000002e-05 2024-04-26T11:13:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.921624+0000", 2024-04-26T11:13:43.951 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9264999999999999e-05 2024-04-26T11:13:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:13:43.952 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 7 2024-04-26T11:13:43.952 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:13:43.954 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:13:43.954 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:43.951+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:44.054 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:44.053+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:44.154 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:44.153+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:44.179 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:13:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:13:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:13:44.179 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:13:44.179 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:13:44.195 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:13:44.255 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:44.254+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:44.322 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:13:44.357 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:44.355+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:44.375 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:13:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:13:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:13:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:13:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.375 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:6296 5.3 5:cfdb39ac:::benchmark_data_smithi029_44842_object6295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.618525+0000", 2024-04-26T11:13:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.7530279430000002, 2024-04-26T11:13:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.013011356999999999, 2024-04-26T11:13:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 6296 2024-04-26T11:13:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:44.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.618525+0000", 2024-04-26T11:13:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.618525+0000", 2024-04-26T11:13:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.618524+0000", 2024-04-26T11:13:44.377 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.618562+0000", 2024-04-26T11:13:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7410000000000003e-05 2024-04-26T11:13:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.618570+0000", 2024-04-26T11:13:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9670000000000001e-06 2024-04-26T11:13:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.378 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.618576+0000", 2024-04-26T11:13:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0449999999999997e-06 2024-04-26T11:13:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.619346+0000", 2024-04-26T11:13:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00077031500000000004 2024-04-26T11:13:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:44.379 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.619464+0000", 2024-04-26T11:13:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000117854 2024-04-26T11:13:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.619622+0000", 2024-04-26T11:13:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015853300000000001 2024-04-26T11:13:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.622658+0000", 2024-04-26T11:13:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0030353189999999999 2024-04-26T11:13:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.631483+0000", 2024-04-26T11:13:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0088249629999999999 2024-04-26T11:13:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.631513+0000", 2024-04-26T11:13:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0552999999999997e-05 2024-04-26T11:13:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:44.381 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.631536+0000", 2024-04-26T11:13:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3008000000000001e-05 2024-04-26T11:13:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:6297 5.3 5:cf99edcf:::benchmark_data_smithi029_44842_object6296:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.618584+0000", 2024-04-26T11:13:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.7529689130000001, 2024-04-26T11:13:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.013036865999999999, 2024-04-26T11:13:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:44.382 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 6297 2024-04-26T11:13:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.618584+0000", 2024-04-26T11:13:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.383 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.618584+0000", 2024-04-26T11:13:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.618583+0000", 2024-04-26T11:13:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.618611+0000", 2024-04-26T11:13:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7557999999999999e-05 2024-04-26T11:13:44.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.618622+0000", 2024-04-26T11:13:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1365999999999999e-05 2024-04-26T11:13:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.618630+0000", 2024-04-26T11:13:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0239999999999997e-06 2024-04-26T11:13:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.385 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.620559+0000", 2024-04-26T11:13:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019292339999999999 2024-04-26T11:13:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.620674+0000", 2024-04-26T11:13:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000114888 2024-04-26T11:13:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.386 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.620920+0000", 2024-04-26T11:13:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00024578300000000001 2024-04-26T11:13:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.622770+0000", 2024-04-26T11:13:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0018500599999999999 2024-04-26T11:13:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.631561+0000", 2024-04-26T11:13:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0087910030000000004 2024-04-26T11:13:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.631592+0000", 2024-04-26T11:13:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1137999999999999e-05 2024-04-26T11:13:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.631621+0000", 2024-04-26T11:13:44.388 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8370000000000001e-05 2024-04-26T11:13:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:6305 5.5 5:acabf149:::benchmark_data_smithi029_44842_object6304:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T11:13:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.619714+0000", 2024-04-26T11:13:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.751838996, 2024-04-26T11:13:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011829841000000001, 2024-04-26T11:13:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:44.389 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 6305 2024-04-26T11:13:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.619714+0000", 2024-04-26T11:13:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.619714+0000", 2024-04-26T11:13:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.619713+0000", 2024-04-26T11:13:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.619802+0000", 2024-04-26T11:13:44.391 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.844e-05 2024-04-26T11:13:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.619811+0000", 2024-04-26T11:13:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4450000000000002e-06 2024-04-26T11:13:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.619818+0000", 2024-04-26T11:13:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8090000000000004e-06 2024-04-26T11:13:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.392 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.620440+0000", 2024-04-26T11:13:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00062161300000000003 2024-04-26T11:13:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.620558+0000", 2024-04-26T11:13:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000118182 2024-04-26T11:13:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.620802+0000", 2024-04-26T11:13:44.393 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00024447200000000003 2024-04-26T11:13:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.622743+0000", 2024-04-26T11:13:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019411929999999999 2024-04-26T11:13:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.631482+0000", 2024-04-26T11:13:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0087384730000000001 2024-04-26T11:13:44.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.631511+0000", 2024-04-26T11:13:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9132000000000002e-05 2024-04-26T11:13:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.631544+0000", 2024-04-26T11:13:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2577999999999999e-05 2024-04-26T11:13:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:7057 5.8 e19/16 5:1b0d6d74:::benchmark_data_smithi029_44842_object7056:head v 19'467, mlcod=19'463)", 2024-04-26T11:13:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.770763+0000", 2024-04-26T11:13:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.6007898950000001, 2024-04-26T11:13:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011857968, 2024-04-26T11:13:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770763+0000", 2024-04-26T11:13:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770763+0000", 2024-04-26T11:13:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770762+0000", 2024-04-26T11:13:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.397 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770826+0000", 2024-04-26T11:13:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3928000000000002e-05 2024-04-26T11:13:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770834+0000", 2024-04-26T11:13:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7419999999999997e-06 2024-04-26T11:13:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770839+0000", 2024-04-26T11:13:44.398 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0440000000000003e-06 2024-04-26T11:13:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770875+0000", 2024-04-26T11:13:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5457999999999998e-05 2024-04-26T11:13:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.770890+0000", 2024-04-26T11:13:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5537999999999999e-05 2024-04-26T11:13:44.399 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.782593+0000", 2024-04-26T11:13:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011702414 2024-04-26T11:13:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.782621+0000", 2024-04-26T11:13:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8197000000000001e-05 2024-04-26T11:13:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:8119 5.4 e19/16 5:236ef8ee:::benchmark_data_smithi029_44842_object8118:head v 19'504, mlcod=19'501)", 2024-04-26T11:13:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:39.993623+0000", 2024-04-26T11:13:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.3779298200000003, 2024-04-26T11:13:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.012556217, 2024-04-26T11:13:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.993623+0000", 2024-04-26T11:13:44.401 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.993623+0000", 2024-04-26T11:13:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.993622+0000", 2024-04-26T11:13:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.402 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.993685+0000", 2024-04-26T11:13:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2333000000000001e-05 2024-04-26T11:13:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.993693+0000", 2024-04-26T11:13:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3469999999999999e-06 2024-04-26T11:13:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.993699+0000", 2024-04-26T11:13:44.403 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1290000000000001e-06 2024-04-26T11:13:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.993788+0000", 2024-04-26T11:13:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.8442999999999993e-05 2024-04-26T11:13:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:39.993807+0000", 2024-04-26T11:13:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9196999999999999e-05 2024-04-26T11:13:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.404 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:40.006149+0000", 2024-04-26T11:13:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.012342027 2024-04-26T11:13:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:40.006179+0000", 2024-04-26T11:13:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0273999999999998e-05 2024-04-26T11:13:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:18846 5.3 5:c95f8f7f:::benchmark_data_smithi029_44842_object18845:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T11:13:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:42.872799+0000", 2024-04-26T11:13:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 1.4987542010000001, 2024-04-26T11:13:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.014816975, 2024-04-26T11:13:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.406 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 18846 2024-04-26T11:13:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.872799+0000", 2024-04-26T11:13:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.872799+0000", 2024-04-26T11:13:44.407 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.872798+0000", 2024-04-26T11:13:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.872859+0000", 2024-04-26T11:13:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1165000000000001e-05 2024-04-26T11:13:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.408 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.872864+0000", 2024-04-26T11:13:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4989999999999996e-06 2024-04-26T11:13:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.872867+0000", 2024-04-26T11:13:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3280000000000002e-06 2024-04-26T11:13:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:44.409 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.877233+0000", 2024-04-26T11:13:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.004366361 2024-04-26T11:13:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.877306+0000", 2024-04-26T11:13:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2935000000000006e-05 2024-04-26T11:13:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.877392+0000", 2024-04-26T11:13:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5982000000000004e-05 2024-04-26T11:13:44.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.882799+0000", 2024-04-26T11:13:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0054068930000000003 2024-04-26T11:13:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.887562+0000", 2024-04-26T11:13:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0047625080000000004 2024-04-26T11:13:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.411 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.887593+0000", 2024-04-26T11:13:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0868999999999999e-05 2024-04-26T11:13:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.887615+0000", 2024-04-26T11:13:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2849000000000001e-05 2024-04-26T11:13:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.412 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:18848 5.3 5:c502f67d:::benchmark_data_smithi029_44842_object18847:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T11:13:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:42.872993+0000", 2024-04-26T11:13:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 1.498559346, 2024-04-26T11:13:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.014682486999999999, 2024-04-26T11:13:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 18848 2024-04-26T11:13:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:44.413 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.872993+0000", 2024-04-26T11:13:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.872993+0000", 2024-04-26T11:13:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:44.414 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.872993+0000", 2024-04-26T11:13:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.873055+0000", 2024-04-26T11:13:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2243999999999996e-05 2024-04-26T11:13:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.873060+0000", 2024-04-26T11:13:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2739999999999998e-06 2024-04-26T11:13:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.415 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.873064+0000", 2024-04-26T11:13:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0599999999999999e-06 2024-04-26T11:13:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.879904+0000", 2024-04-26T11:13:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0068406609999999996 2024-04-26T11:13:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:44.416 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.880040+0000", 2024-04-26T11:13:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013589400000000001 2024-04-26T11:13:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.880181+0000", 2024-04-26T11:13:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014134600000000001 2024-04-26T11:13:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.883242+0000", 2024-04-26T11:13:44.417 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0030607389999999998 2024-04-26T11:13:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.887636+0000", 2024-04-26T11:13:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0043937910000000002 2024-04-26T11:13:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.887659+0000", 2024-04-26T11:13:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3027000000000002e-05 2024-04-26T11:13:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.418 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.887676+0000", 2024-04-26T11:13:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6880000000000001e-05 2024-04-26T11:13:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:18854 5.3 5:c9f544d2:::benchmark_data_smithi029_44842_object18853:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T11:13:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:42.875830+0000", 2024-04-26T11:13:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 1.4957227930000001, 2024-04-26T11:13:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.014783163, 2024-04-26T11:13:44.419 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 18854 2024-04-26T11:13:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.875830+0000", 2024-04-26T11:13:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.420 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.875830+0000", 2024-04-26T11:13:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.875829+0000", 2024-04-26T11:13:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.875898+0000", 2024-04-26T11:13:44.421 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8206000000000004e-05 2024-04-26T11:13:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.875904+0000", 2024-04-26T11:13:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6309999999999997e-06 2024-04-26T11:13:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.875910+0000", 2024-04-26T11:13:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9309999999999996e-06 2024-04-26T11:13:44.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.880816+0000", 2024-04-26T11:13:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0049059280000000004 2024-04-26T11:13:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.880885+0000", 2024-04-26T11:13:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9401999999999997e-05 2024-04-26T11:13:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.423 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.880962+0000", 2024-04-26T11:13:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7065999999999997e-05 2024-04-26T11:13:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.883260+0000", 2024-04-26T11:13:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022976120000000001 2024-04-26T11:13:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.890549+0000", 2024-04-26T11:13:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0072887050000000004 2024-04-26T11:13:44.424 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.890580+0000", 2024-04-26T11:13:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1380000000000001e-05 2024-04-26T11:13:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.890613+0000", 2024-04-26T11:13:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2913000000000001e-05 2024-04-26T11:13:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:44.425 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:18862 5.3 5:cda4cefc:::benchmark_data_smithi029_44842_object18861:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T11:13:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:42.880741+0000", 2024-04-26T11:13:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 1.4908120440000001, 2024-04-26T11:13:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.012722560000000001, 2024-04-26T11:13:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 18862 2024-04-26T11:13:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.880741+0000", 2024-04-26T11:13:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.880741+0000", 2024-04-26T11:13:44.427 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.880740+0000", 2024-04-26T11:13:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.880816+0000", 2024-04-26T11:13:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6003999999999999e-05 2024-04-26T11:13:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.428 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.880823+0000", 2024-04-26T11:13:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9709999999999998e-06 2024-04-26T11:13:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.880827+0000", 2024-04-26T11:13:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4839999999999998e-06 2024-04-26T11:13:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.881549+0000", 2024-04-26T11:13:44.429 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00072117600000000002 2024-04-26T11:13:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.881666+0000", 2024-04-26T11:13:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000117515 2024-04-26T11:13:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.881795+0000", 2024-04-26T11:13:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012837499999999999 2024-04-26T11:13:44.430 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.883269+0000", 2024-04-26T11:13:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0014746340000000001 2024-04-26T11:13:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.893376+0000", 2024-04-26T11:13:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.010107311000000001 2024-04-26T11:13:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:44.431 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.893423+0000", 2024-04-26T11:13:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6316000000000002e-05 2024-04-26T11:13:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.893463+0000", 2024-04-26T11:13:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0448000000000003e-05 2024-04-26T11:13:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.432 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:18866 5.c 5:3938a1a3:::benchmark_data_smithi029_44842_object18865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T11:13:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:42.881564+0000", 2024-04-26T11:13:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 1.489988732, 2024-04-26T11:13:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.012577491, 2024-04-26T11:13:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 18866 2024-04-26T11:13:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:44.433 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.881564+0000", 2024-04-26T11:13:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.881564+0000", 2024-04-26T11:13:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.881563+0000", 2024-04-26T11:13:44.434 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.881620+0000", 2024-04-26T11:13:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.702e-05 2024-04-26T11:13:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.881632+0000", 2024-04-26T11:13:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1691999999999999e-05 2024-04-26T11:13:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.435 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.881639+0000", 2024-04-26T11:13:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6390000000000003e-06 2024-04-26T11:13:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.882046+0000", 2024-04-26T11:13:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00040762699999999998 2024-04-26T11:13:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.882132+0000", 2024-04-26T11:13:44.436 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6164999999999999e-05 2024-04-26T11:13:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.882209+0000", 2024-04-26T11:13:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6738999999999998e-05 2024-04-26T11:13:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.884032+0000", 2024-04-26T11:13:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001822827 2024-04-26T11:13:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.437 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.894078+0000", 2024-04-26T11:13:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.010045558 2024-04-26T11:13:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.894107+0000", 2024-04-26T11:13:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9335999999999998e-05 2024-04-26T11:13:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:44.438 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.894141+0000", 2024-04-26T11:13:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4539000000000003e-05 2024-04-26T11:13:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:19977 5.3 5:cee2b022:::benchmark_data_smithi029_44842_object19976:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T11:13:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:43.226725+0000", 2024-04-26T11:13:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 1.1448281220000001, 2024-04-26T11:13:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011813438000000001, 2024-04-26T11:13:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:44.439 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 19977 2024-04-26T11:13:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.226725+0000", 2024-04-26T11:13:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.440 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.226725+0000", 2024-04-26T11:13:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.226724+0000", 2024-04-26T11:13:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:44.441 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.226753+0000", 2024-04-26T11:13:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9709999999999998e-05 2024-04-26T11:13:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.226764+0000", 2024-04-26T11:13:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0584000000000001e-05 2024-04-26T11:13:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.226769+0000", 2024-04-26T11:13:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3650000000000003e-06 2024-04-26T11:13:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.442 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.226803+0000", 2024-04-26T11:13:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3516999999999998e-05 2024-04-26T11:13:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.226939+0000", 2024-04-26T11:13:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013595400000000001 2024-04-26T11:13:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:44.443 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.227078+0000", 2024-04-26T11:13:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013917899999999999 2024-04-26T11:13:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.228432+0000", 2024-04-26T11:13:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001353911 2024-04-26T11:13:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.238464+0000", 2024-04-26T11:13:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.010031834 2024-04-26T11:13:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.238506+0000", 2024-04-26T11:13:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1811999999999999e-05 2024-04-26T11:13:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.238538+0000", 2024-04-26T11:13:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2400000000000001e-05 2024-04-26T11:13:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:20313 5.3 5:ccd97309:::benchmark_data_smithi029_44842_object20312:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:43.342517+0000", 2024-04-26T11:13:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 1.0290357210000001, 2024-04-26T11:13:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011843823, 2024-04-26T11:13:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 20313 2024-04-26T11:13:44.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.342517+0000", 2024-04-26T11:13:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.342517+0000", 2024-04-26T11:13:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.447 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.342516+0000", 2024-04-26T11:13:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.342575+0000", 2024-04-26T11:13:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9305999999999998e-05 2024-04-26T11:13:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:44.448 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.342587+0000", 2024-04-26T11:13:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1569000000000001e-05 2024-04-26T11:13:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.342595+0000", 2024-04-26T11:13:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4020000000000002e-06 2024-04-26T11:13:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.342634+0000", 2024-04-26T11:13:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8722e-05 2024-04-26T11:13:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.449 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.342773+0000", 2024-04-26T11:13:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013910300000000001 2024-04-26T11:13:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.342912+0000", 2024-04-26T11:13:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013843899999999999 2024-04-26T11:13:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.450 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.345780+0000", 2024-04-26T11:13:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00286806 2024-04-26T11:13:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.354258+0000", 2024-04-26T11:13:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0084786489999999996 2024-04-26T11:13:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.354320+0000", 2024-04-26T11:13:44.451 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1785000000000006e-05 2024-04-26T11:13:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.354361+0000", 2024-04-26T11:13:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0688000000000001e-05 2024-04-26T11:13:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:20317 5.3 5:c8d247a8:::benchmark_data_smithi029_44842_object20316:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:44.452 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:43.342907+0000", 2024-04-26T11:13:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 1.028645708, 2024-04-26T11:13:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.013361530999999999, 2024-04-26T11:13:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 20317 2024-04-26T11:13:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:44.453 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.342907+0000", 2024-04-26T11:13:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.342907+0000", 2024-04-26T11:13:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.454 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.342906+0000", 2024-04-26T11:13:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.343036+0000", 2024-04-26T11:13:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956600000000001 2024-04-26T11:13:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.343043+0000", 2024-04-26T11:13:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5599999999999996e-06 2024-04-26T11:13:44.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.343049+0000", 2024-04-26T11:13:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4909999999999996e-06 2024-04-26T11:13:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.343827+0000", 2024-04-26T11:13:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00077799599999999998 2024-04-26T11:13:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.456 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.343950+0000", 2024-04-26T11:13:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012344100000000001 2024-04-26T11:13:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.344094+0000", 2024-04-26T11:13:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000143146 2024-04-26T11:13:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.346109+0000", 2024-04-26T11:13:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020150810000000002 2024-04-26T11:13:44.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.356185+0000", 2024-04-26T11:13:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.010076241 2024-04-26T11:13:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.356232+0000", 2024-04-26T11:13:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6742000000000001e-05 2024-04-26T11:13:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.458 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.356269+0000", 2024-04-26T11:13:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6940999999999997e-05 2024-04-26T11:13:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:20323 5.6 5:6b8e6637:::benchmark_data_smithi029_44842_object20322:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:43.344676+0000", 2024-04-26T11:13:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 1.026876948, 2024-04-26T11:13:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.012344826999999999, 2024-04-26T11:13:44.459 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 20323 2024-04-26T11:13:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.344676+0000", 2024-04-26T11:13:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.344676+0000", 2024-04-26T11:13:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.344675+0000", 2024-04-26T11:13:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:44.461 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.344722+0000", 2024-04-26T11:13:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6706000000000003e-05 2024-04-26T11:13:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.344727+0000", 2024-04-26T11:13:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.9930000000000003e-06 2024-04-26T11:13:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.344731+0000", 2024-04-26T11:13:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5080000000000001e-06 2024-04-26T11:13:44.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.345807+0000", 2024-04-26T11:13:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001076659 2024-04-26T11:13:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.345889+0000", 2024-04-26T11:13:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.1349999999999999e-05 2024-04-26T11:13:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:44.463 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.345985+0000", 2024-04-26T11:13:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6700000000000006e-05 2024-04-26T11:13:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.347577+0000", 2024-04-26T11:13:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001591503 2024-04-26T11:13:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.356943+0000", 2024-04-26T11:13:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0093658100000000005 2024-04-26T11:13:44.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.356987+0000", 2024-04-26T11:13:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4032999999999997e-05 2024-04-26T11:13:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.357021+0000", 2024-04-26T11:13:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4017999999999999e-05 2024-04-26T11:13:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.465 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:20451 5.6 5:60194e7e:::benchmark_data_smithi029_44842_object20450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:43.387012+0000", 2024-04-26T11:13:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.98454049700000001, 2024-04-26T11:13:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011662706, 2024-04-26T11:13:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:44.466 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 20451 2024-04-26T11:13:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.387012+0000", 2024-04-26T11:13:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:44.467 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.387012+0000", 2024-04-26T11:13:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.387012+0000", 2024-04-26T11:13:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.387069+0000", 2024-04-26T11:13:44.468 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7571999999999997e-05 2024-04-26T11:13:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.387078+0000", 2024-04-26T11:13:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.8270000000000004e-06 2024-04-26T11:13:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.387083+0000", 2024-04-26T11:13:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1209999999999998e-06 2024-04-26T11:13:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.387121+0000", 2024-04-26T11:13:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7858000000000002e-05 2024-04-26T11:13:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.387253+0000", 2024-04-26T11:13:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000132156 2024-04-26T11:13:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:44.470 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.387381+0000", 2024-04-26T11:13:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000127744 2024-04-26T11:13:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.393201+0000", 2024-04-26T11:13:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0058196630000000001 2024-04-26T11:13:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.398591+0000", 2024-04-26T11:13:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.005390031 2024-04-26T11:13:44.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.398637+0000", 2024-04-26T11:13:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6003e-05 2024-04-26T11:13:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.398675+0000", 2024-04-26T11:13:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8334999999999998e-05 2024-04-26T11:13:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:20462 5.6 5:6a9fc703:::benchmark_data_smithi029_44842_object20461:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:43.389728+0000", 2024-04-26T11:13:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.98182474500000005, 2024-04-26T11:13:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011797006000000001, 2024-04-26T11:13:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 20462 2024-04-26T11:13:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.473 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.389728+0000", 2024-04-26T11:13:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.389728+0000", 2024-04-26T11:13:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.389727+0000", 2024-04-26T11:13:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.389754+0000", 2024-04-26T11:13:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6880999999999999e-05 2024-04-26T11:13:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:44.475 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.389783+0000", 2024-04-26T11:13:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8768999999999998e-05 2024-04-26T11:13:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.389792+0000", 2024-04-26T11:13:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.901e-06 2024-04-26T11:13:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.393246+0000", 2024-04-26T11:13:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003453996 2024-04-26T11:13:44.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.393377+0000", 2024-04-26T11:13:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013160099999999999 2024-04-26T11:13:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.393520+0000", 2024-04-26T11:13:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014289399999999999 2024-04-26T11:13:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.477 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.395946+0000", 2024-04-26T11:13:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0024253180000000001 2024-04-26T11:13:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.401442+0000", 2024-04-26T11:13:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0054964159999999996 2024-04-26T11:13:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.401490+0000", 2024-04-26T11:13:44.478 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8168999999999999e-05 2024-04-26T11:13:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.401525+0000", 2024-04-26T11:13:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4856e-05 2024-04-26T11:13:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:20594 5.3 5:c4751220:::benchmark_data_smithi029_44842_object20593:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:44.479 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:43.435880+0000", 2024-04-26T11:13:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.93567287499999996, 2024-04-26T11:13:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011563291999999999, 2024-04-26T11:13:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 20594 2024-04-26T11:13:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.480 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.435880+0000", 2024-04-26T11:13:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.435880+0000", 2024-04-26T11:13:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.435879+0000", 2024-04-26T11:13:44.481 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.435929+0000", 2024-04-26T11:13:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.9872e-05 2024-04-26T11:13:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.435938+0000", 2024-04-26T11:13:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.0629999999999995e-06 2024-04-26T11:13:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.482 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.435946+0000", 2024-04-26T11:13:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7479999999999993e-06 2024-04-26T11:13:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.444067+0000", 2024-04-26T11:13:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0081211749999999996 2024-04-26T11:13:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.444168+0000", 2024-04-26T11:13:44.483 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010136699999999999 2024-04-26T11:13:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.444251+0000", 2024-04-26T11:13:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2366000000000004e-05 2024-04-26T11:13:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.446763+0000", 2024-04-26T11:13:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0025121459999999998 2024-04-26T11:13:44.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.447392+0000", 2024-04-26T11:13:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00062942300000000005 2024-04-26T11:13:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.447419+0000", 2024-04-26T11:13:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6806000000000001e-05 2024-04-26T11:13:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:44.485 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.447443+0000", 2024-04-26T11:13:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4017000000000001e-05 2024-04-26T11:13:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:21448 5.c 5:3a8590fe:::benchmark_data_smithi029_44842_object21447:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:43.697483+0000", 2024-04-26T11:13:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.67406933199999997, 2024-04-26T11:13:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.012146875, 2024-04-26T11:13:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 21448 2024-04-26T11:13:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.697483+0000", 2024-04-26T11:13:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.487 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.697483+0000", 2024-04-26T11:13:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:44.489 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.697483+0000", 2024-04-26T11:13:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.697505+0000", 2024-04-26T11:13:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2444999999999999e-05 2024-04-26T11:13:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.697512+0000", 2024-04-26T11:13:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3239999999999997e-06 2024-04-26T11:13:44.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.697518+0000", 2024-04-26T11:13:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3940000000000004e-06 2024-04-26T11:13:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.698882+0000", 2024-04-26T11:13:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0013642839999999999 2024-04-26T11:13:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.491 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.699010+0000", 2024-04-26T11:13:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012775500000000001 2024-04-26T11:13:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.699131+0000", 2024-04-26T11:13:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012086099999999999 2024-04-26T11:13:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.703363+0000", 2024-04-26T11:13:44.492 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.004232474 2024-04-26T11:13:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.709566+0000", 2024-04-26T11:13:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0062023699999999996 2024-04-26T11:13:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.709593+0000", 2024-04-26T11:13:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7056999999999999e-05 2024-04-26T11:13:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.493 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.709630+0000", 2024-04-26T11:13:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7582e-05 2024-04-26T11:13:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:21456 5.3 5:c1f77013:::benchmark_data_smithi029_44842_object21455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:43.697951+0000", 2024-04-26T11:13:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.67360130299999998, 2024-04-26T11:13:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.012751728, 2024-04-26T11:13:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 21456 2024-04-26T11:13:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.697951+0000", 2024-04-26T11:13:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.697951+0000", 2024-04-26T11:13:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.697951+0000", 2024-04-26T11:13:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:44.496 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.697998+0000", 2024-04-26T11:13:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7054e-05 2024-04-26T11:13:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.698011+0000", 2024-04-26T11:13:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3776e-05 2024-04-26T11:13:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.698019+0000", 2024-04-26T11:13:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3649999999999998e-06 2024-04-26T11:13:44.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.698978+0000", 2024-04-26T11:13:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00095951700000000001 2024-04-26T11:13:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.699059+0000", 2024-04-26T11:13:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0369000000000003e-05 2024-04-26T11:13:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.498 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.699158+0000", 2024-04-26T11:13:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.9075999999999998e-05 2024-04-26T11:13:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.702966+0000", 2024-04-26T11:13:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0038077599999999999 2024-04-26T11:13:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.710621+0000", 2024-04-26T11:13:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0076552149999999999 2024-04-26T11:13:44.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.710662+0000", 2024-04-26T11:13:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1606000000000001e-05 2024-04-26T11:13:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.710703+0000", 2024-04-26T11:13:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0794000000000003e-05 2024-04-26T11:13:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.500 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:22393 5.c 5:3268b4fb:::benchmark_data_smithi029_44842_object22392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:44.007624+0000", 2024-04-26T11:13:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.36392898400000001, 2024-04-26T11:13:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011930146000000001, 2024-04-26T11:13:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:44.501 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 22393 2024-04-26T11:13:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.007624+0000", 2024-04-26T11:13:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.007624+0000", 2024-04-26T11:13:44.502 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.007623+0000", 2024-04-26T11:13:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.007657+0000", 2024-04-26T11:13:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3665999999999999e-05 2024-04-26T11:13:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.503 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.007664+0000", 2024-04-26T11:13:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6730000000000003e-06 2024-04-26T11:13:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.007669+0000", 2024-04-26T11:13:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.276e-06 2024-04-26T11:13:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:44.504 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.010611+0000", 2024-04-26T11:13:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0029424730000000001 2024-04-26T11:13:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.010727+0000", 2024-04-26T11:13:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000115722 2024-04-26T11:13:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.010860+0000", 2024-04-26T11:13:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013275299999999999 2024-04-26T11:13:44.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.013799+0000", 2024-04-26T11:13:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0029394690000000001 2024-04-26T11:13:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.019461+0000", 2024-04-26T11:13:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0056615570000000002 2024-04-26T11:13:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.506 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.019515+0000", 2024-04-26T11:13:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4008000000000002e-05 2024-04-26T11:13:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.019554+0000", 2024-04-26T11:13:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8946000000000003e-05 2024-04-26T11:13:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:44.507 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:44.507 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:13:44.509 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 6 16 23703 23687 246.721 199.875 0.00836653 0.00404992 2024-04-26T11:13:44.509 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:44.508+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:44.510 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:13:44.610 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:44.607+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:44.684 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:13:44.684 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:13:44.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.684 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:24535 5.e 5:79901526:::benchmark_data_smithi029_44842_object24534:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:44.684 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:44.677334+0000", 2024-04-26T11:13:44.684 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0048606880000000002, 2024-04-26T11:13:44.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048809830000000002, 2024-04-26T11:13:44.684 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:44.684 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:44.684 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:44.684 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:44.685 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.685 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 24535 2024-04-26T11:13:44.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.685 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:44.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:44.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.677334+0000", 2024-04-26T11:13:44.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:44.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:44.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.677334+0000", 2024-04-26T11:13:44.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:44.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:44.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.677333+0000", 2024-04-26T11:13:44.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:44.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:44.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.677434+0000", 2024-04-26T11:13:44.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010144 2024-04-26T11:13:44.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:44.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.677445+0000", 2024-04-26T11:13:44.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1021e-05 2024-04-26T11:13:44.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.677450+0000", 2024-04-26T11:13:44.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7149999999999997e-06 2024-04-26T11:13:44.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:44.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.677482+0000", 2024-04-26T11:13:44.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1943000000000002e-05 2024-04-26T11:13:44.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:44.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.677593+0000", 2024-04-26T11:13:44.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011146600000000001 2024-04-26T11:13:44.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:44.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.677716+0000", 2024-04-26T11:13:44.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0001228 2024-04-26T11:13:44.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:44.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.679579+0000", 2024-04-26T11:13:44.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018631019999999999 2024-04-26T11:13:44.688 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:44.688 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:44.688 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:44.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.689 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:24539 5.4 5:20112db8:::benchmark_data_smithi029_44842_object24538:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:44.689 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:44.679663+0000", 2024-04-26T11:13:44.689 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0025315030000000001, 2024-04-26T11:13:44.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002605422, 2024-04-26T11:13:44.689 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:44.689 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:44.689 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:44.689 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:44.689 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.689 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 24539 2024-04-26T11:13:44.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.689 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:44.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:44.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.679663+0000", 2024-04-26T11:13:44.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:44.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:44.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.679663+0000", 2024-04-26T11:13:44.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:44.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:44.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.679662+0000", 2024-04-26T11:13:44.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:44.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:44.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.679717+0000", 2024-04-26T11:13:44.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5099999999999998e-05 2024-04-26T11:13:44.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:44.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.679722+0000", 2024-04-26T11:13:44.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6639999999999997e-06 2024-04-26T11:13:44.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.679726+0000", 2024-04-26T11:13:44.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6169999999999998e-06 2024-04-26T11:13:44.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:44.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.679756+0000", 2024-04-26T11:13:44.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0920999999999998e-05 2024-04-26T11:13:44.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:44.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.679830+0000", 2024-04-26T11:13:44.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3508000000000002e-05 2024-04-26T11:13:44.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:44.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.679924+0000", 2024-04-26T11:13:44.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3679999999999998e-05 2024-04-26T11:13:44.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:44.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.681080+0000", 2024-04-26T11:13:44.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011558269999999999 2024-04-26T11:13:44.693 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:44.693 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:44.693 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:44.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.693 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:24540 5.b 5:d18af673:::benchmark_data_smithi029_44842_object24539:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:44.693 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:44.679747+0000", 2024-04-26T11:13:44.693 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0024475730000000002, 2024-04-26T11:13:44.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025959669999999998, 2024-04-26T11:13:44.693 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:44.693 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:44.694 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:44.694 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:44.694 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.694 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 24540 2024-04-26T11:13:44.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.694 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:44.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:44.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.679747+0000", 2024-04-26T11:13:44.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:44.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:44.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.679747+0000", 2024-04-26T11:13:44.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:44.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:44.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.679746+0000", 2024-04-26T11:13:44.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:44.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:44.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.679812+0000", 2024-04-26T11:13:44.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5617000000000006e-05 2024-04-26T11:13:44.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:44.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.679819+0000", 2024-04-26T11:13:44.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5820000000000004e-06 2024-04-26T11:13:44.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.679825+0000", 2024-04-26T11:13:44.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9569999999999999e-06 2024-04-26T11:13:44.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:44.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.679861+0000", 2024-04-26T11:13:44.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5716000000000002e-05 2024-04-26T11:13:44.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:44.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.679973+0000", 2024-04-26T11:13:44.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011179399999999999 2024-04-26T11:13:44.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:44.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.680123+0000", 2024-04-26T11:13:44.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000150235 2024-04-26T11:13:44.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:44.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.681304+0000", 2024-04-26T11:13:44.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001180906 2024-04-26T11:13:44.697 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:24541 5.8 5:19e66d2a:::benchmark_data_smithi029_44842_object24540:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:44.681121+0000", 2024-04-26T11:13:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.001072854, 2024-04-26T11:13:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001269486, 2024-04-26T11:13:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 24541 2024-04-26T11:13:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.681121+0000", 2024-04-26T11:13:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.681121+0000", 2024-04-26T11:13:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:44.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.681121+0000", 2024-04-26T11:13:44.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.681214+0000", 2024-04-26T11:13:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3418999999999994e-05 2024-04-26T11:13:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.681222+0000", 2024-04-26T11:13:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8280000000000003e-06 2024-04-26T11:13:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.681227+0000", 2024-04-26T11:13:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3720000000000004e-06 2024-04-26T11:13:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.681257+0000", 2024-04-26T11:13:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9677000000000001e-05 2024-04-26T11:13:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.681339+0000", 2024-04-26T11:13:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1898999999999996e-05 2024-04-26T11:13:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:44.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.681416+0000", 2024-04-26T11:13:44.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7321000000000001e-05 2024-04-26T11:13:44.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:44.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.682318+0000", 2024-04-26T11:13:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00090172099999999997 2024-04-26T11:13:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:24521 5.b 5:d54f889b:::benchmark_data_smithi029_44842_object24520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:44.673202+0000", 2024-04-26T11:13:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0089926780000000005, 2024-04-26T11:13:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092352679999999996, 2024-04-26T11:13:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 24521 2024-04-26T11:13:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.673202+0000", 2024-04-26T11:13:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.673202+0000", 2024-04-26T11:13:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.673201+0000", 2024-04-26T11:13:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.673253+0000", 2024-04-26T11:13:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1950000000000002e-05 2024-04-26T11:13:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.673260+0000", 2024-04-26T11:13:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7689999999999999e-06 2024-04-26T11:13:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.673266+0000", 2024-04-26T11:13:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0140000000000004e-06 2024-04-26T11:13:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.674036+0000", 2024-04-26T11:13:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00077076100000000002 2024-04-26T11:13:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.674108+0000", 2024-04-26T11:13:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1447999999999998e-05 2024-04-26T11:13:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.674183+0000", 2024-04-26T11:13:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4831000000000002e-05 2024-04-26T11:13:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.676716+0000", 2024-04-26T11:13:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025330779999999998 2024-04-26T11:13:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:24527 5.8 5:149f0a2d:::benchmark_data_smithi029_44842_object24526:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:44.674945+0000", 2024-04-26T11:13:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0072487560000000003, 2024-04-26T11:13:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0075370460000000004, 2024-04-26T11:13:44.709 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 24527 2024-04-26T11:13:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.674945+0000", 2024-04-26T11:13:44.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.674945+0000", 2024-04-26T11:13:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.674945+0000", 2024-04-26T11:13:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.675076+0000", 2024-04-26T11:13:44.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013135999999999999 2024-04-26T11:13:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.675086+0000", 2024-04-26T11:13:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0203999999999999e-05 2024-04-26T11:13:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.675093+0000", 2024-04-26T11:13:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3589999999999996e-06 2024-04-26T11:13:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:44.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.675117+0000", 2024-04-26T11:13:44.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4485999999999999e-05 2024-04-26T11:13:44.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:44.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.675263+0000", 2024-04-26T11:13:44.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014582399999999999 2024-04-26T11:13:44.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.675396+0000", 2024-04-26T11:13:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013270099999999999 2024-04-26T11:13:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.676744+0000", 2024-04-26T11:13:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013487410000000001 2024-04-26T11:13:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:24530 5.4 5:267ea751:::benchmark_data_smithi029_44842_object24529:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:44.675134+0000", 2024-04-26T11:13:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0070603810000000001, 2024-04-26T11:13:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0073963789999999998, 2024-04-26T11:13:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 24530 2024-04-26T11:13:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:44.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.675134+0000", 2024-04-26T11:13:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.675134+0000", 2024-04-26T11:13:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.675133+0000", 2024-04-26T11:13:44.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.675293+0000", 2024-04-26T11:13:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000159901 2024-04-26T11:13:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.675301+0000", 2024-04-26T11:13:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0900000000000005e-06 2024-04-26T11:13:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.675313+0000", 2024-04-26T11:13:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1348999999999999e-05 2024-04-26T11:13:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.675352+0000", 2024-04-26T11:13:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9026999999999998e-05 2024-04-26T11:13:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.675466+0000", 2024-04-26T11:13:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000114227 2024-04-26T11:13:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.675607+0000", 2024-04-26T11:13:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000141595 2024-04-26T11:13:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.679205+0000", 2024-04-26T11:13:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003597776 2024-04-26T11:13:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.719 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:24534 5.b 5:d2cf152b:::benchmark_data_smithi029_44842_object24533:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:44.676732+0000", 2024-04-26T11:13:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0054626919999999999, 2024-04-26T11:13:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058435580000000004, 2024-04-26T11:13:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 24534 2024-04-26T11:13:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.676732+0000", 2024-04-26T11:13:44.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.676732+0000", 2024-04-26T11:13:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.676731+0000", 2024-04-26T11:13:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.676792+0000", 2024-04-26T11:13:44.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1298999999999997e-05 2024-04-26T11:13:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.676798+0000", 2024-04-26T11:13:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8619999999999999e-06 2024-04-26T11:13:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.676803+0000", 2024-04-26T11:13:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.49e-06 2024-04-26T11:13:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:44.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.676839+0000", 2024-04-26T11:13:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5219999999999998e-05 2024-04-26T11:13:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.676958+0000", 2024-04-26T11:13:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000119546 2024-04-26T11:13:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.677097+0000", 2024-04-26T11:13:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013883600000000001 2024-04-26T11:13:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:44.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:44.679482+0000", 2024-04-26T11:13:44.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023848580000000001 2024-04-26T11:13:44.724 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:44.724 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:44.724 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:44.724 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:44.724 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:13:44.724 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 8 2024-04-26T11:13:44.724 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:13:44.726 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:13:44.726 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:44.723+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:44.742 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:13:44.826 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:44.825+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:44.900 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:13:44.921 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:13:44.927 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:44.925+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:44.941 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:13:44.942 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:44.942 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:44.942 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:13:44.943 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:13:44.943 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:13:44.957 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:13:45.040 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:45.039+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:45.129 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:45.127+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:45.163 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:45.164 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:45.176 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:13:45.230 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:45.229+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:45.320 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:13:45.331 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:45.329+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:45.351 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:45.352 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:45.367 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:13:45.410 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 7 16 26852 26836 239.59 196.812 0.00292125 0.00417108 2024-04-26T11:13:45.431 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:45.430+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:45.532 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:45.530+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:45.574 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:45.574 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:45.588 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:13:45.633 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:45.632+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:45.734 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:45.732+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:45.760 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:45.760 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:45.773 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:13:45.834 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:45.834+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:45.935 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:45.933+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:45.958 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:45.958 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:45.973 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:13:46.057 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:46.055+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:46.137 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:46.135+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:46.197 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:46.197 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:46.212 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:13:46.239 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:46.237+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:46.340 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:46.338+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:46.410 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 8 16 29805 29789 232.709 184.562 0.00913871 0.00429356 2024-04-26T11:13:46.438 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:46.438 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:46.441 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:46.439+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:46.455 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:13:46.542 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:46.541+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:46.626 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:46.626 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:46.640 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:13:46.643 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:46.641+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:46.743 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:46.743+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:46.808 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:46.808 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:46.822 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:13:46.867 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:46.865+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:46.945 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:46.943+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:46.955 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:13:46.991 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:46.991 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:47.006 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:13:47.046 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:47.045+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:47.111 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:13:47.131 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:13:47.149 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:47.146+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:47.152 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:13:47.153 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:13:47.154 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:13:47.154 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:13:47.172 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:13:47.173 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:13:47.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.173 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4534.0:31977 5.c e22/16 5:31208c4a:::benchmark_data_smithi029_44842_object31976:head v 22'1989, mlcod=22'1986)", 2024-04-26T11:13:47.173 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:47.168043+0000", 2024-04-26T11:13:47.173 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.002011115, 2024-04-26T11:13:47.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0020114030000000001, 2024-04-26T11:13:47.173 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.173 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:47.173 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.168043+0000", 2024-04-26T11:13:47.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.168043+0000", 2024-04-26T11:13:47.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.168043+0000", 2024-04-26T11:13:47.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:47.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.168105+0000", 2024-04-26T11:13:47.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2106000000000005e-05 2024-04-26T11:13:47.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.168110+0000", 2024-04-26T11:13:47.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5789999999999997e-06 2024-04-26T11:13:47.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.168113+0000", 2024-04-26T11:13:47.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2329999999999998e-06 2024-04-26T11:13:47.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.168139+0000", 2024-04-26T11:13:47.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5598000000000001e-05 2024-04-26T11:13:47.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.168150+0000", 2024-04-26T11:13:47.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.137e-05 2024-04-26T11:13:47.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:47.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.170021+0000", 2024-04-26T11:13:47.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018709359999999999 2024-04-26T11:13:47.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:47.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.170055+0000", 2024-04-26T11:13:47.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3849000000000001e-05 2024-04-26T11:13:47.177 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.177 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.177 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.177 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4534.0:31969 5.d e22/16 5:b0dbff11:::benchmark_data_smithi029_44842_object31968:head v 22'1952, mlcod=22'1949)", 2024-04-26T11:13:47.177 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:47.168875+0000", 2024-04-26T11:13:47.177 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0011796070000000001, 2024-04-26T11:13:47.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0012443350000000001, 2024-04-26T11:13:47.177 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.177 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:13:47.177 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.168875+0000", 2024-04-26T11:13:47.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.168875+0000", 2024-04-26T11:13:47.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.168874+0000", 2024-04-26T11:13:47.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:47.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.168976+0000", 2024-04-26T11:13:47.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010220100000000001 2024-04-26T11:13:47.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.168988+0000", 2024-04-26T11:13:47.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1793999999999999e-05 2024-04-26T11:13:47.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.168997+0000", 2024-04-26T11:13:47.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6389999999999998e-06 2024-04-26T11:13:47.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.169026+0000", 2024-04-26T11:13:47.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9646e-05 2024-04-26T11:13:47.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.169039+0000", 2024-04-26T11:13:47.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2367e-05 2024-04-26T11:13:47.181 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.181 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.181 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.181 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:31966 5.9 5:90a38b8a:::benchmark_data_smithi029_44842_object31965:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:47.181 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:47.165472+0000", 2024-04-26T11:13:47.181 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0045822019999999996, 2024-04-26T11:13:47.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004687325, 2024-04-26T11:13:47.182 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.182 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:47.182 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:47.182 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:47.182 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:47.182 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 31966 2024-04-26T11:13:47.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.182 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165472+0000", 2024-04-26T11:13:47.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165472+0000", 2024-04-26T11:13:47.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165472+0000", 2024-04-26T11:13:47.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:47.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165532+0000", 2024-04-26T11:13:47.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0319000000000003e-05 2024-04-26T11:13:47.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165542+0000", 2024-04-26T11:13:47.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9569999999999997e-06 2024-04-26T11:13:47.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165550+0000", 2024-04-26T11:13:47.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7079999999999997e-06 2024-04-26T11:13:47.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165653+0000", 2024-04-26T11:13:47.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000103958 2024-04-26T11:13:47.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165778+0000", 2024-04-26T11:13:47.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000124783 2024-04-26T11:13:47.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:47.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165878+0000", 2024-04-26T11:13:47.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9424000000000002e-05 2024-04-26T11:13:47.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:47.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.168567+0000", 2024-04-26T11:13:47.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026892019999999999 2024-04-26T11:13:47.185 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.185 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.186 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.186 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:31968 5.f 5:ffd87137:::benchmark_data_smithi029_44842_object31967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:47.187 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:47.165616+0000", 2024-04-26T11:13:47.187 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0044387289999999998, 2024-04-26T11:13:47.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045960339999999997, 2024-04-26T11:13:47.187 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.187 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:47.187 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:47.187 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:47.187 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:47.187 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 31968 2024-04-26T11:13:47.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.187 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165616+0000", 2024-04-26T11:13:47.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165616+0000", 2024-04-26T11:13:47.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165615+0000", 2024-04-26T11:13:47.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:47.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165757+0000", 2024-04-26T11:13:47.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014217599999999999 2024-04-26T11:13:47.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165766+0000", 2024-04-26T11:13:47.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9439999999999994e-06 2024-04-26T11:13:47.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165775+0000", 2024-04-26T11:13:47.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9879999999999993e-06 2024-04-26T11:13:47.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165807+0000", 2024-04-26T11:13:47.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1640999999999997e-05 2024-04-26T11:13:47.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165901+0000", 2024-04-26T11:13:47.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3851000000000007e-05 2024-04-26T11:13:47.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:47.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165981+0000", 2024-04-26T11:13:47.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0692999999999995e-05 2024-04-26T11:13:47.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:47.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.169702+0000", 2024-04-26T11:13:47.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037209209999999999 2024-04-26T11:13:47.191 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.191 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.192 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.192 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:31970 5.1 5:8bc5af4d:::benchmark_data_smithi029_44842_object31969:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:47.192 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:47.165785+0000", 2024-04-26T11:13:47.192 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.004269864, 2024-04-26T11:13:47.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045083010000000001, 2024-04-26T11:13:47.192 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.192 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:47.192 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:47.192 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:47.192 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:47.192 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 31970 2024-04-26T11:13:47.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.193 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165785+0000", 2024-04-26T11:13:47.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165785+0000", 2024-04-26T11:13:47.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165784+0000", 2024-04-26T11:13:47.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:47.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165882+0000", 2024-04-26T11:13:47.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8276999999999994e-05 2024-04-26T11:13:47.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165891+0000", 2024-04-26T11:13:47.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2819999999999996e-06 2024-04-26T11:13:47.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165897+0000", 2024-04-26T11:13:47.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6290000000000004e-06 2024-04-26T11:13:47.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.165934+0000", 2024-04-26T11:13:47.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6987999999999999e-05 2024-04-26T11:13:47.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.166063+0000", 2024-04-26T11:13:47.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012891399999999999 2024-04-26T11:13:47.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:47.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.166191+0000", 2024-04-26T11:13:47.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012837499999999999 2024-04-26T11:13:47.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:47.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.169663+0000", 2024-04-26T11:13:47.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034716479999999999 2024-04-26T11:13:47.196 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.196 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.196 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.197 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:31978 5.7 5:e4428a65:::benchmark_data_smithi029_44842_object31977:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:47.197 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:47.166884+0000", 2024-04-26T11:13:47.197 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.003170941, 2024-04-26T11:13:47.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003456345, 2024-04-26T11:13:47.197 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.197 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:47.197 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:47.197 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:47.197 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:47.197 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 31978 2024-04-26T11:13:47.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.197 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.166884+0000", 2024-04-26T11:13:47.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.166884+0000", 2024-04-26T11:13:47.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.166883+0000", 2024-04-26T11:13:47.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:47.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.166948+0000", 2024-04-26T11:13:47.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5258000000000004e-05 2024-04-26T11:13:47.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.166958+0000", 2024-04-26T11:13:47.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0326000000000001e-05 2024-04-26T11:13:47.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.166966+0000", 2024-04-26T11:13:47.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3880000000000002e-06 2024-04-26T11:13:47.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.167099+0000", 2024-04-26T11:13:47.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133101 2024-04-26T11:13:47.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.167240+0000", 2024-04-26T11:13:47.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000140741 2024-04-26T11:13:47.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:47.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.167330+0000", 2024-04-26T11:13:47.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9936000000000001e-05 2024-04-26T11:13:47.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:47.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:47.169986+0000", 2024-04-26T11:13:47.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026568310000000001 2024-04-26T11:13:47.201 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.201 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.201 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.201 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.202 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-26T11:13:47.202 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 6 2024-04-26T11:13:47.202 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:13:47.203 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:13:47.247 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:47.245+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:47.323 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T11:13:47.323 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:13:47.323 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-26T11:13:47.323 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T11:13:47.332 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:13:47.348 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:47.346+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:47.410 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 9 16 32677 32661 226.795 179.5 0.00453935 0.00440602 2024-04-26T11:13:47.415 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:13:47.415 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:13:47.415 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:13:47.415 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:13:47.415 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:13:47.430 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:13:47.448 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:47.447+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:47.549 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:47.547+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:47.607 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:13:47.607 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:13:47.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:13:47.607 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:13:47.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.607 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:47.607 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905603+0000", 2024-04-26T11:13:47.607 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.697052354, 2024-04-26T11:13:47.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016623645999999999, 2024-04-26T11:13:47.608 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.608 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:47.608 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905603+0000", 2024-04-26T11:13:47.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905603+0000", 2024-04-26T11:13:47.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905601+0000", 2024-04-26T11:13:47.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:13:47.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905609+0000", 2024-04-26T11:13:47.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3679999999999996e-06 2024-04-26T11:13:47.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905617+0000", 2024-04-26T11:13:47.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4309999999999994e-06 2024-04-26T11:13:47.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905626+0000", 2024-04-26T11:13:47.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9840000000000007e-06 2024-04-26T11:13:47.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905677+0000", 2024-04-26T11:13:47.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0305e-05 2024-04-26T11:13:47.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:13:47.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905684+0000", 2024-04-26T11:13:47.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0129999999999996e-06 2024-04-26T11:13:47.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.914734+0000", 2024-04-26T11:13:47.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090507199999999999 2024-04-26T11:13:47.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.914927+0000", 2024-04-26T11:13:47.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019310599999999999 2024-04-26T11:13:47.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:47.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.915592+0000", 2024-04-26T11:13:47.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00066429800000000002 2024-04-26T11:13:47.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:47.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.921998+0000", 2024-04-26T11:13:47.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064060469999999998 2024-04-26T11:13:47.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:47.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922072+0000", 2024-04-26T11:13:47.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3899999999999994e-05 2024-04-26T11:13:47.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:47.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922185+0000", 2024-04-26T11:13:47.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011294900000000001 2024-04-26T11:13:47.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:47.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922226+0000", 2024-04-26T11:13:47.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1777000000000003e-05 2024-04-26T11:13:47.613 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.613 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.613 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.614 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:47.614 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905638+0000", 2024-04-26T11:13:47.614 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.697016748999999, 2024-04-26T11:13:47.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019821874, 2024-04-26T11:13:47.614 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.614 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:47.614 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905638+0000", 2024-04-26T11:13:47.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905638+0000", 2024-04-26T11:13:47.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905638+0000", 2024-04-26T11:13:47.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:47.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905642+0000", 2024-04-26T11:13:47.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9759999999999997e-06 2024-04-26T11:13:47.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905647+0000", 2024-04-26T11:13:47.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5949999999999998e-06 2024-04-26T11:13:47.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905651+0000", 2024-04-26T11:13:47.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.924e-06 2024-04-26T11:13:47.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905752+0000", 2024-04-26T11:13:47.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000101 2024-04-26T11:13:47.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:47.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905758+0000", 2024-04-26T11:13:47.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:13:47.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922256+0000", 2024-04-26T11:13:47.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016497947999999998 2024-04-26T11:13:47.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922369+0000", 2024-04-26T11:13:47.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000113213 2024-04-26T11:13:47.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:47.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922505+0000", 2024-04-26T11:13:47.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000135635 2024-04-26T11:13:47.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:47.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925373+0000", 2024-04-26T11:13:47.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002868013 2024-04-26T11:13:47.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:47.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925402+0000", 2024-04-26T11:13:47.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.898e-05 2024-04-26T11:13:47.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:47.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925430+0000", 2024-04-26T11:13:47.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7739999999999999e-05 2024-04-26T11:13:47.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:47.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925460+0000", 2024-04-26T11:13:47.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0582e-05 2024-04-26T11:13:47.619 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.619 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.619 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.620 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:47.620 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905672+0000", 2024-04-26T11:13:47.620 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.696982917, 2024-04-26T11:13:47.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019920424999999999, 2024-04-26T11:13:47.620 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.620 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:47.620 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905672+0000", 2024-04-26T11:13:47.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905672+0000", 2024-04-26T11:13:47.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905672+0000", 2024-04-26T11:13:47.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:47.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905689+0000", 2024-04-26T11:13:47.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6929e-05 2024-04-26T11:13:47.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905694+0000", 2024-04-26T11:13:47.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3839999999999996e-06 2024-04-26T11:13:47.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905698+0000", 2024-04-26T11:13:47.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1450000000000001e-06 2024-04-26T11:13:47.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905812+0000", 2024-04-26T11:13:47.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000113807 2024-04-26T11:13:47.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:47.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905817+0000", 2024-04-26T11:13:47.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.203e-06 2024-04-26T11:13:47.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922934+0000", 2024-04-26T11:13:47.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017116681000000002 2024-04-26T11:13:47.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923094+0000", 2024-04-26T11:13:47.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000159667 2024-04-26T11:13:47.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:47.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923233+0000", 2024-04-26T11:13:47.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013987 2024-04-26T11:13:47.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:47.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925378+0000", 2024-04-26T11:13:47.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002144389 2024-04-26T11:13:47.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:47.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925510+0000", 2024-04-26T11:13:47.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013231399999999999 2024-04-26T11:13:47.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:47.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925559+0000", 2024-04-26T11:13:47.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8958000000000001e-05 2024-04-26T11:13:47.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:47.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925593+0000", 2024-04-26T11:13:47.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3488999999999997e-05 2024-04-26T11:13:47.625 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.625 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.625 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.626 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:47.626 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905702+0000", 2024-04-26T11:13:47.626 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.696953084, 2024-04-26T11:13:47.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.01999043, 2024-04-26T11:13:47.626 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.626 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:47.626 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905702+0000", 2024-04-26T11:13:47.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905702+0000", 2024-04-26T11:13:47.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905702+0000", 2024-04-26T11:13:47.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:47.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905704+0000", 2024-04-26T11:13:47.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6699999999999998e-06 2024-04-26T11:13:47.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905708+0000", 2024-04-26T11:13:47.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3000000000000002e-06 2024-04-26T11:13:47.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905712+0000", 2024-04-26T11:13:47.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.425e-06 2024-04-26T11:13:47.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905855+0000", 2024-04-26T11:13:47.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014253200000000001 2024-04-26T11:13:47.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:47.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905858+0000", 2024-04-26T11:13:47.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.822e-06 2024-04-26T11:13:47.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923510+0000", 2024-04-26T11:13:47.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017651394000000001 2024-04-26T11:13:47.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923578+0000", 2024-04-26T11:13:47.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8283999999999999e-05 2024-04-26T11:13:47.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:47.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923710+0000", 2024-04-26T11:13:47.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013175200000000001 2024-04-26T11:13:47.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:47.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925607+0000", 2024-04-26T11:13:47.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001897648 2024-04-26T11:13:47.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:47.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925644+0000", 2024-04-26T11:13:47.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6658e-05 2024-04-26T11:13:47.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:47.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925673+0000", 2024-04-26T11:13:47.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8566999999999999e-05 2024-04-26T11:13:47.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:47.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925692+0000", 2024-04-26T11:13:47.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9720000000000001e-05 2024-04-26T11:13:47.631 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.632 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.632 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.632 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:47.632 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905731+0000", 2024-04-26T11:13:47.632 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.696924105999997, 2024-04-26T11:13:47.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020112349000000002, 2024-04-26T11:13:47.632 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.632 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:47.632 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905731+0000", 2024-04-26T11:13:47.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905731+0000", 2024-04-26T11:13:47.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905731+0000", 2024-04-26T11:13:47.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:47.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905734+0000", 2024-04-26T11:13:47.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2329999999999998e-06 2024-04-26T11:13:47.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905740+0000", 2024-04-26T11:13:47.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4300000000000003e-06 2024-04-26T11:13:47.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905752+0000", 2024-04-26T11:13:47.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1987000000000001e-05 2024-04-26T11:13:47.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905894+0000", 2024-04-26T11:13:47.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000141858 2024-04-26T11:13:47.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:47.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905898+0000", 2024-04-26T11:13:47.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3599999999999998e-06 2024-04-26T11:13:47.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924011+0000", 2024-04-26T11:13:47.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018113066000000001 2024-04-26T11:13:47.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924100+0000", 2024-04-26T11:13:47.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8894999999999995e-05 2024-04-26T11:13:47.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:47.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924188+0000", 2024-04-26T11:13:47.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7903000000000002e-05 2024-04-26T11:13:47.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:47.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925616+0000", 2024-04-26T11:13:47.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014277319999999999 2024-04-26T11:13:47.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:47.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925741+0000", 2024-04-26T11:13:47.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012525899999999999 2024-04-26T11:13:47.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:47.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925804+0000", 2024-04-26T11:13:47.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2954999999999996e-05 2024-04-26T11:13:47.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:47.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925843+0000", 2024-04-26T11:13:47.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9096e-05 2024-04-26T11:13:47.638 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.638 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.638 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.638 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:47.638 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905757+0000", 2024-04-26T11:13:47.638 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.696898126999997, 2024-04-26T11:13:47.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020224836999999999, 2024-04-26T11:13:47.638 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.639 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:47.639 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905757+0000", 2024-04-26T11:13:47.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905757+0000", 2024-04-26T11:13:47.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905757+0000", 2024-04-26T11:13:47.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:47.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905760+0000", 2024-04-26T11:13:47.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2219999999999998e-06 2024-04-26T11:13:47.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905766+0000", 2024-04-26T11:13:47.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0820000000000004e-06 2024-04-26T11:13:47.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905771+0000", 2024-04-26T11:13:47.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1159999999999998e-06 2024-04-26T11:13:47.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905930+0000", 2024-04-26T11:13:47.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015876200000000001 2024-04-26T11:13:47.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:47.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905933+0000", 2024-04-26T11:13:47.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0359999999999998e-06 2024-04-26T11:13:47.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924368+0000", 2024-04-26T11:13:47.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0184355 2024-04-26T11:13:47.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924415+0000", 2024-04-26T11:13:47.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7098000000000002e-05 2024-04-26T11:13:47.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:47.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924506+0000", 2024-04-26T11:13:47.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1090999999999999e-05 2024-04-26T11:13:47.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:47.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925622+0000", 2024-04-26T11:13:47.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011159480000000001 2024-04-26T11:13:47.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:47.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925927+0000", 2024-04-26T11:13:47.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00030507899999999998 2024-04-26T11:13:47.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:47.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925958+0000", 2024-04-26T11:13:47.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0534999999999998e-05 2024-04-26T11:13:47.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:47.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925982+0000", 2024-04-26T11:13:47.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3782999999999999e-05 2024-04-26T11:13:47.644 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.644 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.644 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.644 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:47.645 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905814+0000", 2024-04-26T11:13:47.645 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.696840989000002, 2024-04-26T11:13:47.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020271001, 2024-04-26T11:13:47.645 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.645 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:47.645 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905814+0000", 2024-04-26T11:13:47.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905814+0000", 2024-04-26T11:13:47.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905813+0000", 2024-04-26T11:13:47.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:47.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905821+0000", 2024-04-26T11:13:47.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1280000000000008e-06 2024-04-26T11:13:47.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905832+0000", 2024-04-26T11:13:47.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1318000000000001e-05 2024-04-26T11:13:47.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905842+0000", 2024-04-26T11:13:47.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0101e-05 2024-04-26T11:13:47.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905970+0000", 2024-04-26T11:13:47.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012764499999999999 2024-04-26T11:13:47.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:47.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905977+0000", 2024-04-26T11:13:47.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5019999999999998e-06 2024-04-26T11:13:47.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924672+0000", 2024-04-26T11:13:47.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018694908999999999 2024-04-26T11:13:47.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924754+0000", 2024-04-26T11:13:47.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2167000000000001e-05 2024-04-26T11:13:47.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:47.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924834+0000", 2024-04-26T11:13:47.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0313000000000002e-05 2024-04-26T11:13:47.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:47.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925860+0000", 2024-04-26T11:13:47.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0010255869999999999 2024-04-26T11:13:47.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:47.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926020+0000", 2024-04-26T11:13:47.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000160588 2024-04-26T11:13:47.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:47.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926054+0000", 2024-04-26T11:13:47.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3748999999999998e-05 2024-04-26T11:13:47.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:47.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926085+0000", 2024-04-26T11:13:47.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1111000000000001e-05 2024-04-26T11:13:47.650 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.650 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.650 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.651 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:47.651 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905851+0000", 2024-04-26T11:13:47.651 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.696803899999999, 2024-04-26T11:13:47.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020308667999999998, 2024-04-26T11:13:47.651 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.651 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:47.651 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905851+0000", 2024-04-26T11:13:47.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905851+0000", 2024-04-26T11:13:47.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905851+0000", 2024-04-26T11:13:47.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:47.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905855+0000", 2024-04-26T11:13:47.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3120000000000004e-06 2024-04-26T11:13:47.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905861+0000", 2024-04-26T11:13:47.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9399999999999999e-06 2024-04-26T11:13:47.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905865+0000", 2024-04-26T11:13:47.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9079999999999997e-06 2024-04-26T11:13:47.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906003+0000", 2024-04-26T11:13:47.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013821800000000001 2024-04-26T11:13:47.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:47.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906007+0000", 2024-04-26T11:13:47.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9670000000000003e-06 2024-04-26T11:13:47.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925040+0000", 2024-04-26T11:13:47.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019032613 2024-04-26T11:13:47.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925107+0000", 2024-04-26T11:13:47.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7185000000000001e-05 2024-04-26T11:13:47.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:47.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925195+0000", 2024-04-26T11:13:47.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8515000000000002e-05 2024-04-26T11:13:47.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:47.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926094+0000", 2024-04-26T11:13:47.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089852300000000003 2024-04-26T11:13:47.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:47.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926116+0000", 2024-04-26T11:13:47.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1951e-05 2024-04-26T11:13:47.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:47.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926142+0000", 2024-04-26T11:13:47.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6667000000000001e-05 2024-04-26T11:13:47.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:47.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926160+0000", 2024-04-26T11:13:47.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7339000000000001e-05 2024-04-26T11:13:47.656 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.657 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.657 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.657 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:47.657 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905890+0000", 2024-04-26T11:13:47.657 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.696764997999999, 2024-04-26T11:13:47.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017722176999999999, 2024-04-26T11:13:47.657 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.657 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:47.657 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905890+0000", 2024-04-26T11:13:47.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905890+0000", 2024-04-26T11:13:47.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905890+0000", 2024-04-26T11:13:47.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:47.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905893+0000", 2024-04-26T11:13:47.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9160000000000001e-06 2024-04-26T11:13:47.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905899+0000", 2024-04-26T11:13:47.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6810000000000001e-06 2024-04-26T11:13:47.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905904+0000", 2024-04-26T11:13:47.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2009999999999998e-06 2024-04-26T11:13:47.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905956+0000", 2024-04-26T11:13:47.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1505999999999998e-05 2024-04-26T11:13:47.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:13:47.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905962+0000", 2024-04-26T11:13:47.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1539999999999999e-06 2024-04-26T11:13:47.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918151+0000", 2024-04-26T11:13:47.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012189046 2024-04-26T11:13:47.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918261+0000", 2024-04-26T11:13:47.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000110258 2024-04-26T11:13:47.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:47.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918423+0000", 2024-04-26T11:13:47.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000162027 2024-04-26T11:13:47.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:47.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923237+0000", 2024-04-26T11:13:47.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048139519999999998 2024-04-26T11:13:47.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:47.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923530+0000", 2024-04-26T11:13:47.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00029218799999999997 2024-04-26T11:13:47.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:47.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923576+0000", 2024-04-26T11:13:47.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6545999999999998e-05 2024-04-26T11:13:47.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:47.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923612+0000", 2024-04-26T11:13:47.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6171000000000003e-05 2024-04-26T11:13:47.663 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.663 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.663 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.663 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:47.663 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905914+0000", 2024-04-26T11:13:47.663 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.696741111000001, 2024-04-26T11:13:47.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017543897999999999, 2024-04-26T11:13:47.663 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.663 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:47.663 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905914+0000", 2024-04-26T11:13:47.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905914+0000", 2024-04-26T11:13:47.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905914+0000", 2024-04-26T11:13:47.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:47.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905917+0000", 2024-04-26T11:13:47.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4359999999999998e-06 2024-04-26T11:13:47.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905925+0000", 2024-04-26T11:13:47.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0779999999999996e-06 2024-04-26T11:13:47.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905932+0000", 2024-04-26T11:13:47.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3810000000000001e-06 2024-04-26T11:13:47.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905979+0000", 2024-04-26T11:13:47.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6264000000000003e-05 2024-04-26T11:13:47.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:13:47.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905983+0000", 2024-04-26T11:13:47.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8909999999999997e-06 2024-04-26T11:13:47.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.914254+0000", 2024-04-26T11:13:47.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082715619999999997 2024-04-26T11:13:47.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.914410+0000", 2024-04-26T11:13:47.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015563 2024-04-26T11:13:47.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:47.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.914633+0000", 2024-04-26T11:13:47.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022336 2024-04-26T11:13:47.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:47.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920212+0000", 2024-04-26T11:13:47.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055787349999999996 2024-04-26T11:13:47.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:47.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923369+0000", 2024-04-26T11:13:47.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0031574060000000002 2024-04-26T11:13:47.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:47.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923419+0000", 2024-04-26T11:13:47.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9527000000000002e-05 2024-04-26T11:13:47.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:47.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923458+0000", 2024-04-26T11:13:47.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9005999999999999e-05 2024-04-26T11:13:47.669 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.669 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.669 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.669 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:31 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:47.669 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905953+0000", 2024-04-26T11:13:47.669 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.696702213999998, 2024-04-26T11:13:47.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018731343000000001, 2024-04-26T11:13:47.669 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.669 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:47.669 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905953+0000", 2024-04-26T11:13:47.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905953+0000", 2024-04-26T11:13:47.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905952+0000", 2024-04-26T11:13:47.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:47.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905966+0000", 2024-04-26T11:13:47.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3281999999999999e-05 2024-04-26T11:13:47.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905973+0000", 2024-04-26T11:13:47.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4109999999999999e-06 2024-04-26T11:13:47.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905979+0000", 2024-04-26T11:13:47.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2949999999999999e-06 2024-04-26T11:13:47.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906013+0000", 2024-04-26T11:13:47.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3844000000000003e-05 2024-04-26T11:13:47.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:47.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906017+0000", 2024-04-26T11:13:47.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4419999999999998e-06 2024-04-26T11:13:47.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918937+0000", 2024-04-26T11:13:47.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012920403 2024-04-26T11:13:47.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.919018+0000", 2024-04-26T11:13:47.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1540999999999997e-05 2024-04-26T11:13:47.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:47.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.919765+0000", 2024-04-26T11:13:47.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00074620299999999997 2024-04-26T11:13:47.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:47.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923650+0000", 2024-04-26T11:13:47.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038853820000000002 2024-04-26T11:13:47.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:47.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924619+0000", 2024-04-26T11:13:47.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00096863899999999998 2024-04-26T11:13:47.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:47.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924649+0000", 2024-04-26T11:13:47.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9879e-05 2024-04-26T11:13:47.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:47.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924684+0000", 2024-04-26T11:13:47.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5611999999999997e-05 2024-04-26T11:13:47.675 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.675 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.675 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.675 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:47.675 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905987+0000", 2024-04-26T11:13:47.675 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.696668553999999, 2024-04-26T11:13:47.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018241182000000002, 2024-04-26T11:13:47.676 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.676 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:47.676 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905987+0000", 2024-04-26T11:13:47.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905987+0000", 2024-04-26T11:13:47.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905986+0000", 2024-04-26T11:13:47.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:47.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905990+0000", 2024-04-26T11:13:47.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.755e-06 2024-04-26T11:13:47.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905995+0000", 2024-04-26T11:13:47.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4999999999999999e-06 2024-04-26T11:13:47.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906000+0000", 2024-04-26T11:13:47.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8949999999999997e-06 2024-04-26T11:13:47.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906038+0000", 2024-04-26T11:13:47.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7762999999999997e-05 2024-04-26T11:13:47.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:47.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906042+0000", 2024-04-26T11:13:47.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6890000000000002e-06 2024-04-26T11:13:47.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922401+0000", 2024-04-26T11:13:47.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358973999999998 2024-04-26T11:13:47.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922482+0000", 2024-04-26T11:13:47.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1711000000000004e-05 2024-04-26T11:13:47.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:47.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922607+0000", 2024-04-26T11:13:47.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000124955 2024-04-26T11:13:47.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:47.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924016+0000", 2024-04-26T11:13:47.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014086490000000001 2024-04-26T11:13:47.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:47.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924154+0000", 2024-04-26T11:13:47.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013777599999999999 2024-04-26T11:13:47.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:47.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924196+0000", 2024-04-26T11:13:47.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2647e-05 2024-04-26T11:13:47.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:47.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924228+0000", 2024-04-26T11:13:47.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1372999999999999e-05 2024-04-26T11:13:47.681 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.681 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.681 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.681 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:47.682 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906018+0000", 2024-04-26T11:13:47.682 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.696636644000002, 2024-04-26T11:13:47.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017151182000000001, 2024-04-26T11:13:47.682 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.682 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:47.682 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906018+0000", 2024-04-26T11:13:47.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906018+0000", 2024-04-26T11:13:47.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906018+0000", 2024-04-26T11:13:47.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:47.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906027+0000", 2024-04-26T11:13:47.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9190000000000005e-06 2024-04-26T11:13:47.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906033+0000", 2024-04-26T11:13:47.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1419999999999998e-06 2024-04-26T11:13:47.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906039+0000", 2024-04-26T11:13:47.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.156e-06 2024-04-26T11:13:47.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906075+0000", 2024-04-26T11:13:47.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5608999999999997e-05 2024-04-26T11:13:47.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:13:47.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906080+0000", 2024-04-26T11:13:47.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.276e-06 2024-04-26T11:13:47.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918535+0000", 2024-04-26T11:13:47.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012455061999999999 2024-04-26T11:13:47.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918624+0000", 2024-04-26T11:13:47.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.878e-05 2024-04-26T11:13:47.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:47.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918748+0000", 2024-04-26T11:13:47.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012453799999999999 2024-04-26T11:13:47.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:47.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922172+0000", 2024-04-26T11:13:47.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034232580000000002 2024-04-26T11:13:47.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:47.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923079+0000", 2024-04-26T11:13:47.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00090687899999999998 2024-04-26T11:13:47.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:47.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923129+0000", 2024-04-26T11:13:47.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0773999999999999e-05 2024-04-26T11:13:47.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:47.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923170+0000", 2024-04-26T11:13:47.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0238999999999999e-05 2024-04-26T11:13:47.687 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.687 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.687 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.688 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:47.688 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906048+0000", 2024-04-26T11:13:47.688 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.696607125, 2024-04-26T11:13:47.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018763734000000001, 2024-04-26T11:13:47.688 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.688 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:47.688 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906048+0000", 2024-04-26T11:13:47.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906048+0000", 2024-04-26T11:13:47.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906047+0000", 2024-04-26T11:13:47.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:47.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906051+0000", 2024-04-26T11:13:47.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.799e-06 2024-04-26T11:13:47.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906058+0000", 2024-04-26T11:13:47.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4470000000000003e-06 2024-04-26T11:13:47.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906064+0000", 2024-04-26T11:13:47.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1319999999999999e-06 2024-04-26T11:13:47.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906092+0000", 2024-04-26T11:13:47.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7939000000000001e-05 2024-04-26T11:13:47.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:47.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906097+0000", 2024-04-26T11:13:47.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.741e-06 2024-04-26T11:13:47.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920571+0000", 2024-04-26T11:13:47.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014474526 2024-04-26T11:13:47.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920675+0000", 2024-04-26T11:13:47.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000103644 2024-04-26T11:13:47.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:47.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920803+0000", 2024-04-26T11:13:47.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012879699999999999 2024-04-26T11:13:47.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:47.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923655+0000", 2024-04-26T11:13:47.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028517379999999999 2024-04-26T11:13:47.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:47.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924728+0000", 2024-04-26T11:13:47.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0010732199999999999 2024-04-26T11:13:47.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:47.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924775+0000", 2024-04-26T11:13:47.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6168999999999998e-05 2024-04-26T11:13:47.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:47.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924812+0000", 2024-04-26T11:13:47.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7070000000000003e-05 2024-04-26T11:13:47.694 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.694 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.694 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.694 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:47.694 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906072+0000", 2024-04-26T11:13:47.694 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.696583421, 2024-04-26T11:13:47.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016458922000000001, 2024-04-26T11:13:47.694 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.694 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:47.694 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906072+0000", 2024-04-26T11:13:47.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906072+0000", 2024-04-26T11:13:47.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906071+0000", 2024-04-26T11:13:47.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:47.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906074+0000", 2024-04-26T11:13:47.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9289999999999998e-06 2024-04-26T11:13:47.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906081+0000", 2024-04-26T11:13:47.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8950000000000001e-06 2024-04-26T11:13:47.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906086+0000", 2024-04-26T11:13:47.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7979999999999996e-06 2024-04-26T11:13:47.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906138+0000", 2024-04-26T11:13:47.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1820999999999997e-05 2024-04-26T11:13:47.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:13:47.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906140+0000", 2024-04-26T11:13:47.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.706e-06 2024-04-26T11:13:47.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.916004+0000", 2024-04-26T11:13:47.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098632700000000004 2024-04-26T11:13:47.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.916126+0000", 2024-04-26T11:13:47.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012214300000000001 2024-04-26T11:13:47.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:47.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.916259+0000", 2024-04-26T11:13:47.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013354999999999999 2024-04-26T11:13:47.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:47.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922337+0000", 2024-04-26T11:13:47.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060773600000000004 2024-04-26T11:13:47.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:47.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922447+0000", 2024-04-26T11:13:47.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011003800000000001 2024-04-26T11:13:47.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:47.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922492+0000", 2024-04-26T11:13:47.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5185000000000002e-05 2024-04-26T11:13:47.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:47.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922531+0000", 2024-04-26T11:13:47.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8652999999999997e-05 2024-04-26T11:13:47.700 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.700 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.700 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.700 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:47.700 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906123+0000", 2024-04-26T11:13:47.700 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.696532253000001, 2024-04-26T11:13:47.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018987535999999999, 2024-04-26T11:13:47.700 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.700 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:47.700 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906123+0000", 2024-04-26T11:13:47.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906123+0000", 2024-04-26T11:13:47.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906122+0000", 2024-04-26T11:13:47.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:47.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906136+0000", 2024-04-26T11:13:47.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4527e-05 2024-04-26T11:13:47.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906148+0000", 2024-04-26T11:13:47.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2332e-05 2024-04-26T11:13:47.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906157+0000", 2024-04-26T11:13:47.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0129999999999999e-06 2024-04-26T11:13:47.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906187+0000", 2024-04-26T11:13:47.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9748e-05 2024-04-26T11:13:47.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:47.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906190+0000", 2024-04-26T11:13:47.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0290000000000001e-06 2024-04-26T11:13:47.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.921242+0000", 2024-04-26T11:13:47.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015052100000000001 2024-04-26T11:13:47.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.921750+0000", 2024-04-26T11:13:47.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00050746299999999999 2024-04-26T11:13:47.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:47.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.921915+0000", 2024-04-26T11:13:47.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016514700000000001 2024-04-26T11:13:47.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:47.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923673+0000", 2024-04-26T11:13:47.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001757836 2024-04-26T11:13:47.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:47.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925039+0000", 2024-04-26T11:13:47.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001366396 2024-04-26T11:13:47.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:47.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925077+0000", 2024-04-26T11:13:47.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7595999999999997e-05 2024-04-26T11:13:47.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:47.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925110+0000", 2024-04-26T11:13:47.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3531999999999997e-05 2024-04-26T11:13:47.706 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.706 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.706 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.706 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:21 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:47.706 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906168+0000", 2024-04-26T11:13:47.706 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.696486614000001, 2024-04-26T11:13:47.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346383, 2024-04-26T11:13:47.706 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.706 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:47.706 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906168+0000", 2024-04-26T11:13:47.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906168+0000", 2024-04-26T11:13:47.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906168+0000", 2024-04-26T11:13:47.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:47.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906183+0000", 2024-04-26T11:13:47.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5597e-05 2024-04-26T11:13:47.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906201+0000", 2024-04-26T11:13:47.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7949e-05 2024-04-26T11:13:47.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906208+0000", 2024-04-26T11:13:47.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0990000000000001e-06 2024-04-26T11:13:47.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906233+0000", 2024-04-26T11:13:47.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4351000000000001e-05 2024-04-26T11:13:47.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:47.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906235+0000", 2024-04-26T11:13:47.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4169999999999999e-06 2024-04-26T11:13:47.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.919842+0000", 2024-04-26T11:13:47.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013606337 2024-04-26T11:13:47.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920004+0000", 2024-04-26T11:13:47.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016249799999999999 2024-04-26T11:13:47.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:47.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920157+0000", 2024-04-26T11:13:47.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015337400000000001 2024-04-26T11:13:47.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:47.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922705+0000", 2024-04-26T11:13:47.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0025479330000000001 2024-04-26T11:13:47.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:47.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923419+0000", 2024-04-26T11:13:47.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00071332999999999998 2024-04-26T11:13:47.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:47.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923467+0000", 2024-04-26T11:13:47.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8556000000000001e-05 2024-04-26T11:13:47.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:47.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923515+0000", 2024-04-26T11:13:47.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7540999999999998e-05 2024-04-26T11:13:47.712 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.712 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.712 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.712 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:47.712 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906218+0000", 2024-04-26T11:13:47.712 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.696437418000002, 2024-04-26T11:13:47.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018831681999999999, 2024-04-26T11:13:47.712 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.712 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:47.712 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906218+0000", 2024-04-26T11:13:47.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906218+0000", 2024-04-26T11:13:47.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906217+0000", 2024-04-26T11:13:47.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:47.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906221+0000", 2024-04-26T11:13:47.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1760000000000003e-06 2024-04-26T11:13:47.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906228+0000", 2024-04-26T11:13:47.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9800000000000001e-06 2024-04-26T11:13:47.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906234+0000", 2024-04-26T11:13:47.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9320000000000001e-06 2024-04-26T11:13:47.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906264+0000", 2024-04-26T11:13:47.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9518000000000001e-05 2024-04-26T11:13:47.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:13:47.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906268+0000", 2024-04-26T11:13:47.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2939999999999999e-06 2024-04-26T11:13:47.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922451+0000", 2024-04-26T11:13:47.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016183288000000001 2024-04-26T11:13:47.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922567+0000", 2024-04-26T11:13:47.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000115313 2024-04-26T11:13:47.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:47.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922684+0000", 2024-04-26T11:13:47.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117419 2024-04-26T11:13:47.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:47.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924129+0000", 2024-04-26T11:13:47.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001444753 2024-04-26T11:13:47.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:47.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924979+0000", 2024-04-26T11:13:47.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00084985900000000001 2024-04-26T11:13:47.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:47.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925012+0000", 2024-04-26T11:13:47.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3352999999999997e-05 2024-04-26T11:13:47.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:47.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925049+0000", 2024-04-26T11:13:47.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7354999999999997e-05 2024-04-26T11:13:47.718 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.718 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.718 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.718 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:47.718 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906243+0000", 2024-04-26T11:13:47.718 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.696412039000002, 2024-04-26T11:13:47.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018983739999999999, 2024-04-26T11:13:47.719 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.719 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:13:47.719 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906243+0000", 2024-04-26T11:13:47.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906243+0000", 2024-04-26T11:13:47.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906243+0000", 2024-04-26T11:13:47.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:47.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906245+0000", 2024-04-26T11:13:47.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9189999999999999e-06 2024-04-26T11:13:47.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906252+0000", 2024-04-26T11:13:47.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:13:47.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906258+0000", 2024-04-26T11:13:47.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.728e-06 2024-04-26T11:13:47.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906290+0000", 2024-04-26T11:13:47.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2400000000000001e-05 2024-04-26T11:13:47.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:47.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906293+0000", 2024-04-26T11:13:47.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1769999999999998e-06 2024-04-26T11:13:47.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922664+0000", 2024-04-26T11:13:47.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016370663000000001 2024-04-26T11:13:47.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922923+0000", 2024-04-26T11:13:47.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025853200000000001 2024-04-26T11:13:47.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:47.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925227+0000", 2024-04-26T11:13:47.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023042570000000001 2024-04-26T11:13:47.723 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.723 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.723 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.723 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:20314 5.2 5:43aadba9:::benchmark_data_smithi029_44842_object20313:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:47.723 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:43.342792+0000", 2024-04-26T11:13:47.723 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.2598634119999996, 2024-04-26T11:13:47.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014798617, 2024-04-26T11:13:47.724 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:47.724 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:47.724 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:47.724 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:47.724 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:47.724 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 20314 2024-04-26T11:13:47.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.724 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:47.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:47.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.342792+0000", 2024-04-26T11:13:47.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:47.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.342792+0000", 2024-04-26T11:13:47.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:47.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:47.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.342791+0000", 2024-04-26T11:13:47.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:47.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:47.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.342846+0000", 2024-04-26T11:13:47.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4935999999999997e-05 2024-04-26T11:13:47.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:47.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.342855+0000", 2024-04-26T11:13:47.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.448e-06 2024-04-26T11:13:47.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.342861+0000", 2024-04-26T11:13:47.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.502e-06 2024-04-26T11:13:47.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:47.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.342887+0000", 2024-04-26T11:13:47.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6704e-05 2024-04-26T11:13:47.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:47.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.342977+0000", 2024-04-26T11:13:47.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9622000000000004e-05 2024-04-26T11:13:47.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:47.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.343073+0000", 2024-04-26T11:13:47.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5722000000000003e-05 2024-04-26T11:13:47.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:47.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.345559+0000", 2024-04-26T11:13:47.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024860400000000001 2024-04-26T11:13:47.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:47.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.357515+0000", 2024-04-26T11:13:47.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011956346 2024-04-26T11:13:47.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:47.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.357558+0000", 2024-04-26T11:13:47.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3377000000000002e-05 2024-04-26T11:13:47.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:47.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:47.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:47.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:43.357590+0000", 2024-04-26T11:13:47.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1810999999999997e-05 2024-04-26T11:13:47.729 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.729 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.729 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.729 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:47.729 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:47.729 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:13:47.732 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:13:47.732 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:47.729+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:47.732 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:47.732 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-26T11:13:47.732 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 22, 2024-04-26T11:13:47.733 INFO:teuthology.orchestra.run.smithi029.stdout: "fsid": "2b52ce04-9559-478f-9787-c3cc3b261c15", 2024-04-26T11:13:47.733 INFO:teuthology.orchestra.run.smithi029.stdout: "created": "2024-04-26T11:12:58.193418+0000", 2024-04-26T11:13:47.733 INFO:teuthology.orchestra.run.smithi029.stdout: "modified": "2024-04-26T11:13:45.309820+0000", 2024-04-26T11:13:47.733 INFO:teuthology.orchestra.run.smithi029.stdout: "last_up_change": "2024-04-26T11:13:06.102821+0000", 2024-04-26T11:13:47.733 INFO:teuthology.orchestra.run.smithi029.stdout: "last_in_change": "2024-04-26T11:12:59.116286+0000", 2024-04-26T11:13:47.733 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T11:13:47.733 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_num": 5799936, 2024-04-26T11:13:47.733 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_set": [ 2024-04-26T11:13:47.733 INFO:teuthology.orchestra.run.smithi029.stdout: "pglog_hardlimit", 2024-04-26T11:13:47.733 INFO:teuthology.orchestra.run.smithi029.stdout: "purged_snapdirs", 2024-04-26T11:13:47.733 INFO:teuthology.orchestra.run.smithi029.stdout: "recovery_deletes", 2024-04-26T11:13:47.733 INFO:teuthology.orchestra.run.smithi029.stdout: "sortbitwise" 2024-04-26T11:13:47.733 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-04-26T11:13:47.733 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_version": 4, 2024-04-26T11:13:47.734 INFO:teuthology.orchestra.run.smithi029.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T11:13:47.734 INFO:teuthology.orchestra.run.smithi029.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T11:13:47.734 INFO:teuthology.orchestra.run.smithi029.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T11:13:47.734 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_snapshot": "", 2024-04-26T11:13:47.734 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_max": 5, 2024-04-26T11:13:47.734 INFO:teuthology.orchestra.run.smithi029.stdout: "max_osd": 3, 2024-04-26T11:13:47.734 INFO:teuthology.orchestra.run.smithi029.stdout: "require_min_compat_client": "luminous", 2024-04-26T11:13:47.734 INFO:teuthology.orchestra.run.smithi029.stdout: "min_compat_client": "jewel", 2024-04-26T11:13:47.734 INFO:teuthology.orchestra.run.smithi029.stdout: "require_osd_release": "reef", 2024-04-26T11:13:47.734 INFO:teuthology.orchestra.run.smithi029.stdout: "allow_crimson": false, 2024-04-26T11:13:47.734 INFO:teuthology.orchestra.run.smithi029.stdout: "pools": [ 2024-04-26T11:13:47.734 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.734 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 1, 2024-04-26T11:13:47.735 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": ".mgr", 2024-04-26T11:13:47.735 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2024-04-26T11:13:06.502266+0000", 2024-04-26T11:13:47.735 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-04-26T11:13:47.735 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool", 2024-04-26T11:13:47.735 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2024-04-26T11:13:47.735 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2024-04-26T11:13:47.735 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2024-04-26T11:13:47.735 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2024-04-26T11:13:47.735 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:13:47.735 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:13:47.735 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:13:47.735 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:13:47.735 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2024-04-26T11:13:47.735 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:13:47.736 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 1, 2024-04-26T11:13:47.736 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 1, 2024-04-26T11:13:47.736 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 1, 2024-04-26T11:13:47.736 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 1, 2024-04-26T11:13:47.736 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 1, 2024-04-26T11:13:47.736 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2024-04-26T11:13:47.736 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2024-04-26T11:13:47.736 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2024-04-26T11:13:47.736 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2024-04-26T11:13:47.736 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2024-04-26T11:13:47.736 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2024-04-26T11:13:47.736 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2024-04-26T11:13:47.736 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.736 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "11", 2024-04-26T11:13:47.737 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2024-04-26T11:13:47.737 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:13:47.737 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:13:47.737 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2024-04-26T11:13:47.737 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:13:47.737 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2024-04-26T11:13:47.737 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2024-04-26T11:13:47.737 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2024-04-26T11:13:47.737 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2024-04-26T11:13:47.737 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2024-04-26T11:13:47.737 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2024-04-26T11:13:47.737 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2024-04-26T11:13:47.737 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2024-04-26T11:13:47.737 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2024-04-26T11:13:47.737 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2024-04-26T11:13:47.738 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2024-04-26T11:13:47.738 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2024-04-26T11:13:47.738 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2024-04-26T11:13:47.738 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:13:47.738 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:13:47.738 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:13:47.738 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2024-04-26T11:13:47.738 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2024-04-26T11:13:47.738 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2024-04-26T11:13:47.738 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2024-04-26T11:13:47.738 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2024-04-26T11:13:47.738 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.738 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2024-04-26T11:13:47.739 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2024-04-26T11:13:47.739 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2024-04-26T11:13:47.739 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:13:47.739 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:13:47.739 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:13:47.739 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:13:47.739 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2024-04-26T11:13:47.739 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2024-04-26T11:13:47.739 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2024-04-26T11:13:47.739 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2024-04-26T11:13:47.739 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2024-04-26T11:13:47.739 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_max": 32, 2024-04-26T11:13:47.739 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 1 2024-04-26T11:13:47.740 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.740 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2024-04-26T11:13:47.740 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr": {} 2024-04-26T11:13:47.740 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.740 INFO:teuthology.orchestra.run.smithi029.stdout: "read_balance": { 2024-04-26T11:13:47.740 INFO:teuthology.orchestra.run.smithi029.stdout: "score_acting": 2.9900000095367432, 2024-04-26T11:13:47.740 INFO:teuthology.orchestra.run.smithi029.stdout: "score_stable": 2.9900000095367432, 2024-04-26T11:13:47.740 INFO:teuthology.orchestra.run.smithi029.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T11:13:47.740 INFO:teuthology.orchestra.run.smithi029.stdout: "raw_score_acting": 2, 2024-04-26T11:13:47.740 INFO:teuthology.orchestra.run.smithi029.stdout: "raw_score_stable": 2, 2024-04-26T11:13:47.740 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity_weighted": 1, 2024-04-26T11:13:47.740 INFO:teuthology.orchestra.run.smithi029.stdout: "average_primary_affinity": 1, 2024-04-26T11:13:47.740 INFO:teuthology.orchestra.run.smithi029.stdout: "average_primary_affinity_weighted": 1 2024-04-26T11:13:47.740 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:47.741 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.741 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.741 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 2, 2024-04-26T11:13:47.741 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": "rbd", 2024-04-26T11:13:47.741 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2024-04-26T11:13:06.913870+0000", 2024-04-26T11:13:47.741 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-04-26T11:13:47.741 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool", 2024-04-26T11:13:47.741 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2024-04-26T11:13:47.741 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2024-04-26T11:13:47.741 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2024-04-26T11:13:47.741 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2024-04-26T11:13:47.741 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:13:47.741 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:13:47.741 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:13:47.742 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:13:47.742 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2024-04-26T11:13:47.742 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:13:47.742 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 8, 2024-04-26T11:13:47.742 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 8, 2024-04-26T11:13:47.742 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 8, 2024-04-26T11:13:47.742 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 8, 2024-04-26T11:13:47.742 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 8, 2024-04-26T11:13:47.742 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2024-04-26T11:13:47.742 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2024-04-26T11:13:47.742 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2024-04-26T11:13:47.742 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2024-04-26T11:13:47.743 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2024-04-26T11:13:47.743 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2024-04-26T11:13:47.743 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2024-04-26T11:13:47.743 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.743 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "11", 2024-04-26T11:13:47.743 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2024-04-26T11:13:47.743 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:13:47.743 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:13:47.743 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2024-04-26T11:13:47.743 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:13:47.743 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2024-04-26T11:13:47.743 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2024-04-26T11:13:47.743 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2024-04-26T11:13:47.743 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2024-04-26T11:13:47.744 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2024-04-26T11:13:47.744 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2024-04-26T11:13:47.744 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2024-04-26T11:13:47.744 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2024-04-26T11:13:47.744 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2024-04-26T11:13:47.744 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2024-04-26T11:13:47.744 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2024-04-26T11:13:47.744 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2024-04-26T11:13:47.744 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2024-04-26T11:13:47.744 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:13:47.744 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:13:47.744 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:13:47.744 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2024-04-26T11:13:47.744 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2024-04-26T11:13:47.745 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2024-04-26T11:13:47.745 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2024-04-26T11:13:47.745 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2024-04-26T11:13:47.745 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.745 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2024-04-26T11:13:47.745 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2024-04-26T11:13:47.745 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2024-04-26T11:13:47.745 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:13:47.745 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:13:47.745 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:13:47.745 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:13:47.745 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2024-04-26T11:13:47.746 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2024-04-26T11:13:47.746 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2024-04-26T11:13:47.746 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2024-04-26T11:13:47.746 INFO:teuthology.orchestra.run.smithi029.stdout: "options": {}, 2024-04-26T11:13:47.746 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2024-04-26T11:13:47.746 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd": {} 2024-04-26T11:13:47.746 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.746 INFO:teuthology.orchestra.run.smithi029.stdout: "read_balance": { 2024-04-26T11:13:47.746 INFO:teuthology.orchestra.run.smithi029.stdout: "score_acting": 1.5, 2024-04-26T11:13:47.746 INFO:teuthology.orchestra.run.smithi029.stdout: "score_stable": 1.5, 2024-04-26T11:13:47.746 INFO:teuthology.orchestra.run.smithi029.stdout: "optimal_score": 1, 2024-04-26T11:13:47.746 INFO:teuthology.orchestra.run.smithi029.stdout: "raw_score_acting": 1.5, 2024-04-26T11:13:47.746 INFO:teuthology.orchestra.run.smithi029.stdout: "raw_score_stable": 1.5, 2024-04-26T11:13:47.746 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity_weighted": 1, 2024-04-26T11:13:47.747 INFO:teuthology.orchestra.run.smithi029.stdout: "average_primary_affinity": 1, 2024-04-26T11:13:47.747 INFO:teuthology.orchestra.run.smithi029.stdout: "average_primary_affinity_weighted": 1 2024-04-26T11:13:47.747 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:47.747 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.747 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.747 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 3, 2024-04-26T11:13:47.747 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": "cephfs_metadata", 2024-04-26T11:13:47.747 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2024-04-26T11:13:11.430854+0000", 2024-04-26T11:13:47.747 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-04-26T11:13:47.747 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool", 2024-04-26T11:13:47.747 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2024-04-26T11:13:47.747 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2024-04-26T11:13:47.747 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2024-04-26T11:13:47.747 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2024-04-26T11:13:47.747 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:13:47.748 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:13:47.748 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:13:47.748 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:13:47.748 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2024-04-26T11:13:47.748 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:13:47.748 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 32, 2024-04-26T11:13:47.748 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 32, 2024-04-26T11:13:47.748 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 32, 2024-04-26T11:13:47.748 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 32, 2024-04-26T11:13:47.748 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 32, 2024-04-26T11:13:47.748 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2024-04-26T11:13:47.748 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2024-04-26T11:13:47.748 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2024-04-26T11:13:47.748 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2024-04-26T11:13:47.749 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2024-04-26T11:13:47.749 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2024-04-26T11:13:47.749 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2024-04-26T11:13:47.749 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.749 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "14", 2024-04-26T11:13:47.749 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2024-04-26T11:13:47.749 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:13:47.749 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:13:47.749 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2024-04-26T11:13:47.749 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:13:47.749 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2024-04-26T11:13:47.749 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2024-04-26T11:13:47.749 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2024-04-26T11:13:47.750 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2024-04-26T11:13:47.750 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2024-04-26T11:13:47.750 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2024-04-26T11:13:47.750 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2024-04-26T11:13:47.750 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2024-04-26T11:13:47.750 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2024-04-26T11:13:47.750 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2024-04-26T11:13:47.750 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2024-04-26T11:13:47.750 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2024-04-26T11:13:47.750 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2024-04-26T11:13:47.750 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:13:47.750 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:13:47.750 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:13:47.750 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2024-04-26T11:13:47.751 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2024-04-26T11:13:47.751 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2024-04-26T11:13:47.751 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2024-04-26T11:13:47.751 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2024-04-26T11:13:47.751 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.751 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2024-04-26T11:13:47.751 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2024-04-26T11:13:47.751 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2024-04-26T11:13:47.751 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:13:47.751 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:13:47.751 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:13:47.751 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:13:47.751 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2024-04-26T11:13:47.752 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2024-04-26T11:13:47.752 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2024-04-26T11:13:47.752 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2024-04-26T11:13:47.752 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2024-04-26T11:13:47.752 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_bias": 4, 2024-04-26T11:13:47.752 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 16, 2024-04-26T11:13:47.752 INFO:teuthology.orchestra.run.smithi029.stdout: "recovery_priority": 5 2024-04-26T11:13:47.752 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.752 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2024-04-26T11:13:47.752 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs": { 2024-04-26T11:13:47.752 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": "cephfs" 2024-04-26T11:13:47.752 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:47.752 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.752 INFO:teuthology.orchestra.run.smithi029.stdout: "read_balance": { 2024-04-26T11:13:47.753 INFO:teuthology.orchestra.run.smithi029.stdout: "score_acting": 1.2200000286102295, 2024-04-26T11:13:47.753 INFO:teuthology.orchestra.run.smithi029.stdout: "score_stable": 1.2200000286102295, 2024-04-26T11:13:47.753 INFO:teuthology.orchestra.run.smithi029.stdout: "optimal_score": 1, 2024-04-26T11:13:47.753 INFO:teuthology.orchestra.run.smithi029.stdout: "raw_score_acting": 1.2200000286102295, 2024-04-26T11:13:47.753 INFO:teuthology.orchestra.run.smithi029.stdout: "raw_score_stable": 1.2200000286102295, 2024-04-26T11:13:47.753 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity_weighted": 1, 2024-04-26T11:13:47.753 INFO:teuthology.orchestra.run.smithi029.stdout: "average_primary_affinity": 1, 2024-04-26T11:13:47.753 INFO:teuthology.orchestra.run.smithi029.stdout: "average_primary_affinity_weighted": 1 2024-04-26T11:13:47.753 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:47.753 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.753 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.753 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 4, 2024-04-26T11:13:47.753 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": "cephfs_data", 2024-04-26T11:13:47.753 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2024-04-26T11:13:11.859264+0000", 2024-04-26T11:13:47.753 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-04-26T11:13:47.754 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool", 2024-04-26T11:13:47.754 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2024-04-26T11:13:47.754 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2024-04-26T11:13:47.754 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2024-04-26T11:13:47.754 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2024-04-26T11:13:47.754 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:13:47.754 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:13:47.754 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:13:47.754 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:13:47.754 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2024-04-26T11:13:47.754 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:13:47.754 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 64, 2024-04-26T11:13:47.755 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 64, 2024-04-26T11:13:47.755 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 64, 2024-04-26T11:13:47.755 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 64, 2024-04-26T11:13:47.755 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 64, 2024-04-26T11:13:47.755 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2024-04-26T11:13:47.755 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2024-04-26T11:13:47.755 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2024-04-26T11:13:47.755 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2024-04-26T11:13:47.755 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2024-04-26T11:13:47.755 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2024-04-26T11:13:47.755 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2024-04-26T11:13:47.755 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.755 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "15", 2024-04-26T11:13:47.756 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2024-04-26T11:13:47.756 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:13:47.756 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:13:47.756 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2024-04-26T11:13:47.756 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:13:47.756 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2024-04-26T11:13:47.756 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2024-04-26T11:13:47.756 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2024-04-26T11:13:47.756 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2024-04-26T11:13:47.756 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2024-04-26T11:13:47.756 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2024-04-26T11:13:47.756 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2024-04-26T11:13:47.756 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2024-04-26T11:13:47.757 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2024-04-26T11:13:47.757 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2024-04-26T11:13:47.757 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2024-04-26T11:13:47.757 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2024-04-26T11:13:47.757 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2024-04-26T11:13:47.757 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:13:47.757 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:13:47.757 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:13:47.757 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2024-04-26T11:13:47.757 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2024-04-26T11:13:47.757 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2024-04-26T11:13:47.757 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2024-04-26T11:13:47.757 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2024-04-26T11:13:47.757 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.757 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2024-04-26T11:13:47.758 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2024-04-26T11:13:47.758 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2024-04-26T11:13:47.758 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:13:47.758 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:13:47.758 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:13:47.758 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:13:47.758 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2024-04-26T11:13:47.758 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2024-04-26T11:13:47.758 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2024-04-26T11:13:47.758 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2024-04-26T11:13:47.758 INFO:teuthology.orchestra.run.smithi029.stdout: "options": { 2024-04-26T11:13:47.758 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_min": 64, 2024-04-26T11:13:47.758 INFO:teuthology.orchestra.run.smithi029.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T11:13:47.759 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.759 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2024-04-26T11:13:47.759 INFO:teuthology.orchestra.run.smithi029.stdout: "cephfs": { 2024-04-26T11:13:47.759 INFO:teuthology.orchestra.run.smithi029.stdout: "data": "cephfs" 2024-04-26T11:13:47.759 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:47.759 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.759 INFO:teuthology.orchestra.run.smithi029.stdout: "read_balance": { 2024-04-26T11:13:47.759 INFO:teuthology.orchestra.run.smithi029.stdout: "score_acting": 1.1699999570846558, 2024-04-26T11:13:47.759 INFO:teuthology.orchestra.run.smithi029.stdout: "score_stable": 1.1699999570846558, 2024-04-26T11:13:47.759 INFO:teuthology.orchestra.run.smithi029.stdout: "optimal_score": 1, 2024-04-26T11:13:47.759 INFO:teuthology.orchestra.run.smithi029.stdout: "raw_score_acting": 1.1699999570846558, 2024-04-26T11:13:47.759 INFO:teuthology.orchestra.run.smithi029.stdout: "raw_score_stable": 1.1699999570846558, 2024-04-26T11:13:47.760 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity_weighted": 1, 2024-04-26T11:13:47.760 INFO:teuthology.orchestra.run.smithi029.stdout: "average_primary_affinity": 1, 2024-04-26T11:13:47.760 INFO:teuthology.orchestra.run.smithi029.stdout: "average_primary_affinity_weighted": 1 2024-04-26T11:13:47.760 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:47.760 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.760 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.760 INFO:teuthology.orchestra.run.smithi029.stdout: "pool": 5, 2024-04-26T11:13:47.760 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": "unique_pool_0", 2024-04-26T11:13:47.760 INFO:teuthology.orchestra.run.smithi029.stdout: "create_time": "2024-04-26T11:13:36.235806+0000", 2024-04-26T11:13:47.760 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-04-26T11:13:47.760 INFO:teuthology.orchestra.run.smithi029.stdout: "flags_names": "hashpspool", 2024-04-26T11:13:47.760 INFO:teuthology.orchestra.run.smithi029.stdout: "type": 1, 2024-04-26T11:13:47.760 INFO:teuthology.orchestra.run.smithi029.stdout: "size": 2, 2024-04-26T11:13:47.761 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": 1, 2024-04-26T11:13:47.761 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_rule": 0, 2024-04-26T11:13:47.761 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:13:47.761 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:13:47.761 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:13:47.761 INFO:teuthology.orchestra.run.smithi029.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:13:47.761 INFO:teuthology.orchestra.run.smithi029.stdout: "object_hash": 2, 2024-04-26T11:13:47.761 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:13:47.761 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": 16, 2024-04-26T11:13:47.761 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num": 16, 2024-04-26T11:13:47.761 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_placement_num_target": 16, 2024-04-26T11:13:47.761 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_target": 16, 2024-04-26T11:13:47.761 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num_pending": 16, 2024-04-26T11:13:47.761 INFO:teuthology.orchestra.run.smithi029.stdout: "last_pg_merge_meta": { 2024-04-26T11:13:47.762 INFO:teuthology.orchestra.run.smithi029.stdout: "source_pgid": "0.0", 2024-04-26T11:13:47.762 INFO:teuthology.orchestra.run.smithi029.stdout: "ready_epoch": 0, 2024-04-26T11:13:47.762 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_started": 0, 2024-04-26T11:13:47.762 INFO:teuthology.orchestra.run.smithi029.stdout: "last_epoch_clean": 0, 2024-04-26T11:13:47.762 INFO:teuthology.orchestra.run.smithi029.stdout: "source_version": "0'0", 2024-04-26T11:13:47.762 INFO:teuthology.orchestra.run.smithi029.stdout: "target_version": "0'0" 2024-04-26T11:13:47.762 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.762 INFO:teuthology.orchestra.run.smithi029.stdout: "last_change": "18", 2024-04-26T11:13:47.762 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend": "0", 2024-04-26T11:13:47.762 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:13:47.762 INFO:teuthology.orchestra.run.smithi029.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:13:47.762 INFO:teuthology.orchestra.run.smithi029.stdout: "auid": 0, 2024-04-26T11:13:47.762 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:13:47.762 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_seq": 0, 2024-04-26T11:13:47.763 INFO:teuthology.orchestra.run.smithi029.stdout: "snap_epoch": 0, 2024-04-26T11:13:47.763 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_snaps": [], 2024-04-26T11:13:47.763 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps": "[]", 2024-04-26T11:13:47.763 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_bytes": 0, 2024-04-26T11:13:47.763 INFO:teuthology.orchestra.run.smithi029.stdout: "quota_max_objects": 0, 2024-04-26T11:13:47.763 INFO:teuthology.orchestra.run.smithi029.stdout: "tiers": [], 2024-04-26T11:13:47.763 INFO:teuthology.orchestra.run.smithi029.stdout: "tier_of": -1, 2024-04-26T11:13:47.763 INFO:teuthology.orchestra.run.smithi029.stdout: "read_tier": -1, 2024-04-26T11:13:47.763 INFO:teuthology.orchestra.run.smithi029.stdout: "write_tier": -1, 2024-04-26T11:13:47.763 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_mode": "none", 2024-04-26T11:13:47.763 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_bytes": 0, 2024-04-26T11:13:47.763 INFO:teuthology.orchestra.run.smithi029.stdout: "target_max_objects": 0, 2024-04-26T11:13:47.763 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:13:47.764 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:13:47.764 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:13:47.764 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_flush_age": 0, 2024-04-26T11:13:47.764 INFO:teuthology.orchestra.run.smithi029.stdout: "cache_min_evict_age": 0, 2024-04-26T11:13:47.764 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profile": "", 2024-04-26T11:13:47.764 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_params": { 2024-04-26T11:13:47.764 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "none" 2024-04-26T11:13:47.764 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.764 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_period": 0, 2024-04-26T11:13:47.764 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_count": 0, 2024-04-26T11:13:47.764 INFO:teuthology.orchestra.run.smithi029.stdout: "use_gmt_hitset": true, 2024-04-26T11:13:47.764 INFO:teuthology.orchestra.run.smithi029.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:13:47.764 INFO:teuthology.orchestra.run.smithi029.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:13:47.764 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:13:47.764 INFO:teuthology.orchestra.run.smithi029.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:13:47.765 INFO:teuthology.orchestra.run.smithi029.stdout: "grade_table": [], 2024-04-26T11:13:47.765 INFO:teuthology.orchestra.run.smithi029.stdout: "stripe_width": 0, 2024-04-26T11:13:47.765 INFO:teuthology.orchestra.run.smithi029.stdout: "expected_num_objects": 0, 2024-04-26T11:13:47.765 INFO:teuthology.orchestra.run.smithi029.stdout: "fast_read": false, 2024-04-26T11:13:47.765 INFO:teuthology.orchestra.run.smithi029.stdout: "options": {}, 2024-04-26T11:13:47.765 INFO:teuthology.orchestra.run.smithi029.stdout: "application_metadata": { 2024-04-26T11:13:47.765 INFO:teuthology.orchestra.run.smithi029.stdout: "rados": {} 2024-04-26T11:13:47.765 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.765 INFO:teuthology.orchestra.run.smithi029.stdout: "read_balance": { 2024-04-26T11:13:47.765 INFO:teuthology.orchestra.run.smithi029.stdout: "score_acting": 1.1299999952316284, 2024-04-26T11:13:47.765 INFO:teuthology.orchestra.run.smithi029.stdout: "score_stable": 1.1299999952316284, 2024-04-26T11:13:47.765 INFO:teuthology.orchestra.run.smithi029.stdout: "optimal_score": 1, 2024-04-26T11:13:47.765 INFO:teuthology.orchestra.run.smithi029.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T11:13:47.766 INFO:teuthology.orchestra.run.smithi029.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T11:13:47.766 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity_weighted": 1, 2024-04-26T11:13:47.766 INFO:teuthology.orchestra.run.smithi029.stdout: "average_primary_affinity": 1, 2024-04-26T11:13:47.766 INFO:teuthology.orchestra.run.smithi029.stdout: "average_primary_affinity_weighted": 1 2024-04-26T11:13:47.766 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:47.766 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:47.766 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-04-26T11:13:47.766 INFO:teuthology.orchestra.run.smithi029.stdout: "osds": [ 2024-04-26T11:13:47.766 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.766 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 0, 2024-04-26T11:13:47.766 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "c3496b3f-5972-47ff-a449-832f5055beac", 2024-04-26T11:13:47.766 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2024-04-26T11:13:47.766 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2024-04-26T11:13:47.767 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 0.8972625732421875, 2024-04-26T11:13:47.767 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2024-04-26T11:13:47.767 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2024-04-26T11:13:47.767 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2024-04-26T11:13:47.767 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 8, 2024-04-26T11:13:47.767 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 16, 2024-04-26T11:13:47.767 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2024-04-26T11:13:47.767 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2024-04-26T11:13:47.767 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2024-04-26T11:13:47.767 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-04-26T11:13:47.767 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.767 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-04-26T11:13:47.767 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.72:6800", 2024-04-26T11:13:47.768 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 41434 2024-04-26T11:13:47.768 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.768 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.768 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:13:47.768 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.72:6801", 2024-04-26T11:13:47.768 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 41434 2024-04-26T11:13:47.768 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:47.768 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:47.768 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.768 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2024-04-26T11:13:47.768 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-04-26T11:13:47.768 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.768 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-04-26T11:13:47.769 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.72:6802", 2024-04-26T11:13:47.769 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 41434 2024-04-26T11:13:47.769 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.769 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.769 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:13:47.769 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.72:6803", 2024-04-26T11:13:47.769 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 41434 2024-04-26T11:13:47.769 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:47.769 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:47.769 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.769 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2024-04-26T11:13:47.769 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-04-26T11:13:47.770 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.770 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-04-26T11:13:47.770 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.72:6806", 2024-04-26T11:13:47.770 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 41434 2024-04-26T11:13:47.770 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.770 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.770 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:13:47.770 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.72:6807", 2024-04-26T11:13:47.770 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 41434 2024-04-26T11:13:47.770 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:47.770 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:47.770 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.771 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2024-04-26T11:13:47.771 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-04-26T11:13:47.771 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.771 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-04-26T11:13:47.771 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.72:6804", 2024-04-26T11:13:47.771 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 41434 2024-04-26T11:13:47.771 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.771 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.771 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:13:47.771 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.72:6805", 2024-04-26T11:13:47.771 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 41434 2024-04-26T11:13:47.771 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:47.772 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:47.772 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.772 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.72:6801/41434", 2024-04-26T11:13:47.772 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.72:6803/41434", 2024-04-26T11:13:47.772 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.72:6807/41434", 2024-04-26T11:13:47.772 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.72:6805/41434", 2024-04-26T11:13:47.772 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2024-04-26T11:13:47.772 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2024-04-26T11:13:47.772 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2024-04-26T11:13:47.772 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:47.772 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.772 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.772 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2024-04-26T11:13:47.773 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "4842abe1-e7b4-480f-85b3-11c8fa2123f1", 2024-04-26T11:13:47.773 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2024-04-26T11:13:47.773 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2024-04-26T11:13:47.773 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2024-04-26T11:13:47.773 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2024-04-26T11:13:47.773 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2024-04-26T11:13:47.773 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2024-04-26T11:13:47.773 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 8, 2024-04-26T11:13:47.773 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 20, 2024-04-26T11:13:47.773 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2024-04-26T11:13:47.773 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2024-04-26T11:13:47.773 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2024-04-26T11:13:47.773 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-04-26T11:13:47.773 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.774 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-04-26T11:13:47.774 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.82:6800", 2024-04-26T11:13:47.774 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 41442 2024-04-26T11:13:47.774 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.774 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.774 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:13:47.774 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.82:6801", 2024-04-26T11:13:47.774 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 41442 2024-04-26T11:13:47.774 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:47.774 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:47.774 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.774 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2024-04-26T11:13:47.774 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-04-26T11:13:47.774 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.775 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-04-26T11:13:47.775 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.82:6802", 2024-04-26T11:13:47.775 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 41442 2024-04-26T11:13:47.775 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.775 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.775 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:13:47.775 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.82:6803", 2024-04-26T11:13:47.775 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 41442 2024-04-26T11:13:47.775 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:47.775 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:47.775 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.775 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2024-04-26T11:13:47.775 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-04-26T11:13:47.775 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.776 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-04-26T11:13:47.776 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.82:6806", 2024-04-26T11:13:47.776 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 41442 2024-04-26T11:13:47.776 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.776 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.776 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:13:47.776 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.82:6807", 2024-04-26T11:13:47.776 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 41442 2024-04-26T11:13:47.776 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:47.776 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:47.776 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.776 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2024-04-26T11:13:47.776 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-04-26T11:13:47.776 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.777 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-04-26T11:13:47.777 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.82:6804", 2024-04-26T11:13:47.777 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 41442 2024-04-26T11:13:47.777 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.777 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.777 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:13:47.777 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.82:6805", 2024-04-26T11:13:47.777 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 41442 2024-04-26T11:13:47.777 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:47.777 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:47.777 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.777 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.82:6801/41442", 2024-04-26T11:13:47.777 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.82:6803/41442", 2024-04-26T11:13:47.777 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.82:6807/41442", 2024-04-26T11:13:47.777 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.82:6805/41442", 2024-04-26T11:13:47.778 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2024-04-26T11:13:47.778 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2024-04-26T11:13:47.778 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2024-04-26T11:13:47.778 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:47.778 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.778 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.778 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 2, 2024-04-26T11:13:47.778 INFO:teuthology.orchestra.run.smithi029.stdout: "uuid": "57b4a874-e4ce-42a9-a7fd-f9e0acf03cec", 2024-04-26T11:13:47.778 INFO:teuthology.orchestra.run.smithi029.stdout: "up": 1, 2024-04-26T11:13:47.778 INFO:teuthology.orchestra.run.smithi029.stdout: "in": 1, 2024-04-26T11:13:47.778 INFO:teuthology.orchestra.run.smithi029.stdout: "weight": 1, 2024-04-26T11:13:47.778 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_affinity": 1, 2024-04-26T11:13:47.778 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_begin": 0, 2024-04-26T11:13:47.778 INFO:teuthology.orchestra.run.smithi029.stdout: "last_clean_end": 0, 2024-04-26T11:13:47.778 INFO:teuthology.orchestra.run.smithi029.stdout: "up_from": 8, 2024-04-26T11:13:47.779 INFO:teuthology.orchestra.run.smithi029.stdout: "up_thru": 20, 2024-04-26T11:13:47.779 INFO:teuthology.orchestra.run.smithi029.stdout: "down_at": 0, 2024-04-26T11:13:47.779 INFO:teuthology.orchestra.run.smithi029.stdout: "lost_at": 0, 2024-04-26T11:13:47.779 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addrs": { 2024-04-26T11:13:47.779 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-04-26T11:13:47.779 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.779 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-04-26T11:13:47.779 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.122:6800", 2024-04-26T11:13:47.779 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 41571 2024-04-26T11:13:47.779 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.779 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.779 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:13:47.779 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.122:6801", 2024-04-26T11:13:47.779 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 41571 2024-04-26T11:13:47.779 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:47.780 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:47.780 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.780 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addrs": { 2024-04-26T11:13:47.780 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-04-26T11:13:47.780 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.780 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-04-26T11:13:47.780 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.122:6802", 2024-04-26T11:13:47.780 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 41571 2024-04-26T11:13:47.780 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.780 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.780 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:13:47.780 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.122:6803", 2024-04-26T11:13:47.780 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 41571 2024-04-26T11:13:47.780 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:47.780 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:47.780 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.781 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addrs": { 2024-04-26T11:13:47.781 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-04-26T11:13:47.781 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.781 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-04-26T11:13:47.781 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.122:6806", 2024-04-26T11:13:47.781 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 41571 2024-04-26T11:13:47.781 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.781 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.781 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:13:47.781 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.122:6807", 2024-04-26T11:13:47.781 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 41571 2024-04-26T11:13:47.781 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:47.781 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:47.781 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.781 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addrs": { 2024-04-26T11:13:47.782 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-04-26T11:13:47.782 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.782 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-04-26T11:13:47.782 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.122:6804", 2024-04-26T11:13:47.782 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 41571 2024-04-26T11:13:47.782 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.782 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.782 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-04-26T11:13:47.782 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.122:6805", 2024-04-26T11:13:47.782 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 41571 2024-04-26T11:13:47.782 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:47.782 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:47.783 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.783 INFO:teuthology.orchestra.run.smithi029.stdout: "public_addr": "172.21.15.122:6801/41571", 2024-04-26T11:13:47.783 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_addr": "172.21.15.122:6803/41571", 2024-04-26T11:13:47.783 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_back_addr": "172.21.15.122:6807/41571", 2024-04-26T11:13:47.783 INFO:teuthology.orchestra.run.smithi029.stdout: "heartbeat_front_addr": "172.21.15.122:6805/41571", 2024-04-26T11:13:47.783 INFO:teuthology.orchestra.run.smithi029.stdout: "state": [ 2024-04-26T11:13:47.783 INFO:teuthology.orchestra.run.smithi029.stdout: "exists", 2024-04-26T11:13:47.783 INFO:teuthology.orchestra.run.smithi029.stdout: "up" 2024-04-26T11:13:47.783 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-04-26T11:13:47.783 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:47.783 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-04-26T11:13:47.783 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_xinfo": [ 2024-04-26T11:13:47.783 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.783 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 0, 2024-04-26T11:13:47.784 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2024-04-26T11:13:47.784 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2024-04-26T11:13:47.784 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2024-04-26T11:13:47.784 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138322906710015, 2024-04-26T11:13:47.784 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2024-04-26T11:13:47.784 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2024-04-26T11:13:04.123925+0000", 2024-04-26T11:13:47.784 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2024-04-26T11:13:47.784 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.784 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.784 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 1, 2024-04-26T11:13:47.784 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2024-04-26T11:13:47.784 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2024-04-26T11:13:47.784 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2024-04-26T11:13:47.784 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138322906710015, 2024-04-26T11:13:47.784 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2024-04-26T11:13:47.785 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2024-04-26T11:13:04.145646+0000", 2024-04-26T11:13:47.785 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2024-04-26T11:13:47.785 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.785 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-04-26T11:13:47.785 INFO:teuthology.orchestra.run.smithi029.stdout: "osd": 2, 2024-04-26T11:13:47.785 INFO:teuthology.orchestra.run.smithi029.stdout: "down_stamp": "0.000000", 2024-04-26T11:13:47.785 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_probability": 0, 2024-04-26T11:13:47.785 INFO:teuthology.orchestra.run.smithi029.stdout: "laggy_interval": 0, 2024-04-26T11:13:47.785 INFO:teuthology.orchestra.run.smithi029.stdout: "features": 4540138322906710015, 2024-04-26T11:13:47.785 INFO:teuthology.orchestra.run.smithi029.stdout: "old_weight": 0, 2024-04-26T11:13:47.785 INFO:teuthology.orchestra.run.smithi029.stdout: "last_purged_snaps_scrub": "2024-04-26T11:13:05.101494+0000", 2024-04-26T11:13:47.785 INFO:teuthology.orchestra.run.smithi029.stdout: "dead_epoch": 0 2024-04-26T11:13:47.785 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:47.785 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-04-26T11:13:47.786 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_upmap": [], 2024-04-26T11:13:47.786 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_upmap_items": [], 2024-04-26T11:13:47.786 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_upmap_primaries": [], 2024-04-26T11:13:47.786 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_temp": [], 2024-04-26T11:13:47.786 INFO:teuthology.orchestra.run.smithi029.stdout: "primary_temp": [], 2024-04-26T11:13:47.786 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklist": {}, 2024-04-26T11:13:47.786 INFO:teuthology.orchestra.run.smithi029.stdout: "range_blocklist": {}, 2024-04-26T11:13:47.786 INFO:teuthology.orchestra.run.smithi029.stdout: "erasure_code_profiles": { 2024-04-26T11:13:47.786 INFO:teuthology.orchestra.run.smithi029.stdout: "default": { 2024-04-26T11:13:47.786 INFO:teuthology.orchestra.run.smithi029.stdout: "crush-failure-domain": "osd", 2024-04-26T11:13:47.786 INFO:teuthology.orchestra.run.smithi029.stdout: "k": "2", 2024-04-26T11:13:47.786 INFO:teuthology.orchestra.run.smithi029.stdout: "m": "1", 2024-04-26T11:13:47.786 INFO:teuthology.orchestra.run.smithi029.stdout: "plugin": "jerasure", 2024-04-26T11:13:47.787 INFO:teuthology.orchestra.run.smithi029.stdout: "technique": "reed_sol_van" 2024-04-26T11:13:47.787 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:47.787 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-04-26T11:13:47.787 INFO:teuthology.orchestra.run.smithi029.stdout: "removed_snaps_queue": [], 2024-04-26T11:13:47.787 INFO:teuthology.orchestra.run.smithi029.stdout: "new_removed_snaps": [], 2024-04-26T11:13:47.787 INFO:teuthology.orchestra.run.smithi029.stdout: "new_purged_snaps": [], 2024-04-26T11:13:47.787 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_node_flags": {}, 2024-04-26T11:13:47.787 INFO:teuthology.orchestra.run.smithi029.stdout: "device_class_flags": {}, 2024-04-26T11:13:47.787 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode": { 2024-04-26T11:13:47.787 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode_enabled": false, 2024-04-26T11:13:47.787 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_bucket_count": 0, 2024-04-26T11:13:47.787 INFO:teuthology.orchestra.run.smithi029.stdout: "degraded_stretch_mode": 0, 2024-04-26T11:13:47.787 INFO:teuthology.orchestra.run.smithi029.stdout: "recovering_stretch_mode": 0, 2024-04-26T11:13:47.787 INFO:teuthology.orchestra.run.smithi029.stdout: "stretch_mode_bucket": 0 2024-04-26T11:13:47.788 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-04-26T11:13:47.788 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-26T11:13:47.788 INFO:tasks.thrashosds.thrasher:j is {'epoch': 22, 'fsid': '2b52ce04-9559-478f-9787-c3cc3b261c15', 'created': '2024-04-26T11:12:58.193418+0000', 'modified': '2024-04-26T11:13:45.309820+0000', 'last_up_change': '2024-04-26T11:13:06.102821+0000', 'last_in_change': '2024-04-26T11:12:59.116286+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T11:13:06.502266+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T11:13:06.913870+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T11:13:11.430854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.2200000286102295, 'score_stable': 1.2200000286102295, 'optimal_score': 1, 'raw_score_acting': 1.2200000286102295, 'raw_score_stable': 1.2200000286102295, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T11:13:11.859264+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1699999570846558, 'score_stable': 1.1699999570846558, 'optimal_score': 1, 'raw_score_acting': 1.1699999570846558, 'raw_score_stable': 1.1699999570846558, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-04-26T11:13:36.235806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'c3496b3f-5972-47ff-a449-832f5055beac', 'up': 1, 'in': 1, 'weight': 0.8972625732421875, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6800', 'nonce': 41434}, {'type': 'v1', 'addr': '172.21.15.72:6801', 'nonce': 41434}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6802', 'nonce': 41434}, {'type': 'v1', 'addr': '172.21.15.72:6803', 'nonce': 41434}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6806', 'nonce': 41434}, {'type': 'v1', 'addr': '172.21.15.72:6807', 'nonce': 41434}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6804', 'nonce': 41434}, {'type': 'v1', 'addr': '172.21.15.72:6805', 'nonce': 41434}]}, 'public_addr': '172.21.15.72:6801/41434', 'cluster_addr': '172.21.15.72:6803/41434', 'heartbeat_back_addr': '172.21.15.72:6807/41434', 'heartbeat_front_addr': '172.21.15.72:6805/41434', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '4842abe1-e7b4-480f-85b3-11c8fa2123f1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 20, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6800', 'nonce': 41442}, {'type': 'v1', 'addr': '172.21.15.82:6801', 'nonce': 41442}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6802', 'nonce': 41442}, {'type': 'v1', 'addr': '172.21.15.82:6803', 'nonce': 41442}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6806', 'nonce': 41442}, {'type': 'v1', 'addr': '172.21.15.82:6807', 'nonce': 41442}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6804', 'nonce': 41442}, {'type': 'v1', 'addr': '172.21.15.82:6805', 'nonce': 41442}]}, 'public_addr': '172.21.15.82:6801/41442', 'cluster_addr': '172.21.15.82:6803/41442', 'heartbeat_back_addr': '172.21.15.82:6807/41442', 'heartbeat_front_addr': '172.21.15.82:6805/41442', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '57b4a874-e4ce-42a9-a7fd-f9e0acf03cec', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 20, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6800', 'nonce': 41571}, {'type': 'v1', 'addr': '172.21.15.122:6801', 'nonce': 41571}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6802', 'nonce': 41571}, {'type': 'v1', 'addr': '172.21.15.122:6803', 'nonce': 41571}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6806', 'nonce': 41571}, {'type': 'v1', 'addr': '172.21.15.122:6807', 'nonce': 41571}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6804', 'nonce': 41571}, {'type': 'v1', 'addr': '172.21.15.122:6805', 'nonce': 41571}]}, 'public_addr': '172.21.15.122:6801/41571', 'cluster_addr': '172.21.15.122:6803/41571', 'heartbeat_back_addr': '172.21.15.122:6807/41571', 'heartbeat_front_addr': '172.21.15.122:6805/41571', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T11:13:04.123925+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T11:13:04.145646+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T11:13:05.101494+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T11:13:47.789 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:13:47.831 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:47.830+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:47.932 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:47.931+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:47.975 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:13:47.975 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:13:47.975 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.975 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:34252 5.e e22/16 5:7d1e11d5:::benchmark_data_smithi029_44842_object34251:head v 22'2110, mlcod=22'2108)", 2024-04-26T11:13:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.967386+0000", 2024-04-26T11:13:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0052448310000000001, 2024-04-26T11:13:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.005269546, 2024-04-26T11:13:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.967386+0000", 2024-04-26T11:13:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.967386+0000", 2024-04-26T11:13:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.967385+0000", 2024-04-26T11:13:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.967427+0000", 2024-04-26T11:13:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1690000000000002e-05 2024-04-26T11:13:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.967434+0000", 2024-04-26T11:13:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2339999999999997e-06 2024-04-26T11:13:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.967442+0000", 2024-04-26T11:13:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.379e-06 2024-04-26T11:13:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.968649+0000", 2024-04-26T11:13:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001207519 2024-04-26T11:13:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.968668+0000", 2024-04-26T11:13:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9369999999999999e-05 2024-04-26T11:13:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:34256 5.3 5:cd330289:::benchmark_data_smithi029_44842_object34255:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.968836+0000", 2024-04-26T11:13:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0037942150000000001, 2024-04-26T11:13:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0038896429999999999, 2024-04-26T11:13:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 34256 2024-04-26T11:13:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.968836+0000", 2024-04-26T11:13:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.968836+0000", 2024-04-26T11:13:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.968835+0000", 2024-04-26T11:13:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.968990+0000", 2024-04-26T11:13:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015487699999999999 2024-04-26T11:13:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.968999+0000", 2024-04-26T11:13:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1390000000000001e-06 2024-04-26T11:13:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969006+0000", 2024-04-26T11:13:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3960000000000003e-06 2024-04-26T11:13:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969064+0000", 2024-04-26T11:13:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8418000000000002e-05 2024-04-26T11:13:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969198+0000", 2024-04-26T11:13:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000133788 2024-04-26T11:13:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969373+0000", 2024-04-26T11:13:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000174952 2024-04-26T11:13:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971494+0000", 2024-04-26T11:13:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002121698 2024-04-26T11:13:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:34258 5.5 5:a04fa561:::benchmark_data_smithi029_44842_object34257:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.969148+0000", 2024-04-26T11:13:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0034825519999999999, 2024-04-26T11:13:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0036611479999999999, 2024-04-26T11:13:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 34258 2024-04-26T11:13:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969148+0000", 2024-04-26T11:13:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969148+0000", 2024-04-26T11:13:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969147+0000", 2024-04-26T11:13:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969179+0000", 2024-04-26T11:13:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1442999999999997e-05 2024-04-26T11:13:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969189+0000", 2024-04-26T11:13:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.9809999999999998e-06 2024-04-26T11:13:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969198+0000", 2024-04-26T11:13:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.0380000000000005e-06 2024-04-26T11:13:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969316+0000", 2024-04-26T11:13:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000118386 2024-04-26T11:13:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969468+0000", 2024-04-26T11:13:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015171600000000001 2024-04-26T11:13:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969614+0000", 2024-04-26T11:13:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014612100000000001 2024-04-26T11:13:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:34259 5.5 5:a7fc00d2:::benchmark_data_smithi029_44842_object34258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.969283+0000", 2024-04-26T11:13:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.003347442, 2024-04-26T11:13:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003599634, 2024-04-26T11:13:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 34259 2024-04-26T11:13:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969283+0000", 2024-04-26T11:13:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969283+0000", 2024-04-26T11:13:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969282+0000", 2024-04-26T11:13:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969335+0000", 2024-04-26T11:13:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2516999999999999e-05 2024-04-26T11:13:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969344+0000", 2024-04-26T11:13:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3219999999999999e-06 2024-04-26T11:13:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969351+0000", 2024-04-26T11:13:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1389999999999998e-06 2024-04-26T11:13:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.970808+0000", 2024-04-26T11:13:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001456536 2024-04-26T11:13:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.970960+0000", 2024-04-26T11:13:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015211599999999999 2024-04-26T11:13:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971102+0000", 2024-04-26T11:13:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014219800000000001 2024-04-26T11:13:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:34260 5.6 5:65c63575:::benchmark_data_smithi029_44842_object34259:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.969359+0000", 2024-04-26T11:13:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.003271005, 2024-04-26T11:13:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003598118, 2024-04-26T11:13:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 34260 2024-04-26T11:13:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969359+0000", 2024-04-26T11:13:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969359+0000", 2024-04-26T11:13:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969359+0000", 2024-04-26T11:13:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969397+0000", 2024-04-26T11:13:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8040000000000002e-05 2024-04-26T11:13:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969406+0000", 2024-04-26T11:13:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9590000000000001e-06 2024-04-26T11:13:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969412+0000", 2024-04-26T11:13:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9290000000000003e-06 2024-04-26T11:13:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969850+0000", 2024-04-26T11:13:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00043860399999999999 2024-04-26T11:13:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969931+0000", 2024-04-26T11:13:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.106e-05 2024-04-26T11:13:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.970023+0000", 2024-04-26T11:13:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1164999999999999e-05 2024-04-26T11:13:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:34261 5.c 5:34190dc4:::benchmark_data_smithi029_44842_object34260:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.969786+0000", 2024-04-26T11:13:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0028442889999999998, 2024-04-26T11:13:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0032462089999999999, 2024-04-26T11:13:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 34261 2024-04-26T11:13:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969786+0000", 2024-04-26T11:13:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969786+0000", 2024-04-26T11:13:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.969785+0000", 2024-04-26T11:13:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.970862+0000", 2024-04-26T11:13:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0010764500000000001 2024-04-26T11:13:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.970869+0000", 2024-04-26T11:13:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1620000000000002e-06 2024-04-26T11:13:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.970876+0000", 2024-04-26T11:13:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1289999999999998e-06 2024-04-26T11:13:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971059+0000", 2024-04-26T11:13:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000182506 2024-04-26T11:13:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971272+0000", 2024-04-26T11:13:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021305 2024-04-26T11:13:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971377+0000", 2024-04-26T11:13:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105116 2024-04-26T11:13:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:34262 5.1 e22/16 5:8d8d50ac:::benchmark_data_smithi029_44842_object34261:head v 22'2146, mlcod=22'2144)", 2024-04-26T11:13:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.970920+0000", 2024-04-26T11:13:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0017102510000000001, 2024-04-26T11:13:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022109529999999999, 2024-04-26T11:13:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.970920+0000", 2024-04-26T11:13:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.970920+0000", 2024-04-26T11:13:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.970920+0000", 2024-04-26T11:13:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.970944+0000", 2024-04-26T11:13:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4241000000000001e-05 2024-04-26T11:13:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.970950+0000", 2024-04-26T11:13:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4969999999999998e-06 2024-04-26T11:13:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.970954+0000", 2024-04-26T11:13:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9620000000000004e-06 2024-04-26T11:13:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.970992+0000", 2024-04-26T11:13:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7901000000000002e-05 2024-04-26T11:13:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971011+0000", 2024-04-26T11:13:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8782000000000001e-05 2024-04-26T11:13:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:34264 5.6 5:6142e07a:::benchmark_data_smithi029_44842_object34263:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.970889+0000", 2024-04-26T11:13:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0017414069999999999, 2024-04-26T11:13:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002327516, 2024-04-26T11:13:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 34264 2024-04-26T11:13:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.970889+0000", 2024-04-26T11:13:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.970889+0000", 2024-04-26T11:13:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.970888+0000", 2024-04-26T11:13:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971008+0000", 2024-04-26T11:13:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011950100000000001 2024-04-26T11:13:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971016+0000", 2024-04-26T11:13:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9670000000000001e-06 2024-04-26T11:13:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971022+0000", 2024-04-26T11:13:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9989999999999997e-06 2024-04-26T11:13:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971064+0000", 2024-04-26T11:13:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2085000000000001e-05 2024-04-26T11:13:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971221+0000", 2024-04-26T11:13:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000157839 2024-04-26T11:13:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971355+0000", 2024-04-26T11:13:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000134 2024-04-26T11:13:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:34263 5.8 e22/16 5:1ead5aff:::benchmark_data_smithi029_44842_object34262:head v 22'2169, mlcod=22'2167)", 2024-04-26T11:13:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.971033+0000", 2024-04-26T11:13:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0015970909999999999, 2024-04-26T11:13:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022678300000000002, 2024-04-26T11:13:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971033+0000", 2024-04-26T11:13:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971033+0000", 2024-04-26T11:13:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971033+0000", 2024-04-26T11:13:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971082+0000", 2024-04-26T11:13:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.9304000000000001e-05 2024-04-26T11:13:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971091+0000", 2024-04-26T11:13:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1770000000000004e-06 2024-04-26T11:13:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971097+0000", 2024-04-26T11:13:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6529999999999999e-06 2024-04-26T11:13:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971137+0000", 2024-04-26T11:13:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0160000000000002e-05 2024-04-26T11:13:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971158+0000", 2024-04-26T11:13:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1098999999999999e-05 2024-04-26T11:13:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:34265 5.0 e22/16 5:07820d65:::benchmark_data_smithi029_44842_object34264:head v 22'2120, mlcod=22'2118)", 2024-04-26T11:13:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.971142+0000", 2024-04-26T11:13:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.001487934, 2024-04-26T11:13:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022174690000000001, 2024-04-26T11:13:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971142+0000", 2024-04-26T11:13:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971142+0000", 2024-04-26T11:13:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971142+0000", 2024-04-26T11:13:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971230+0000", 2024-04-26T11:13:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7997000000000005e-05 2024-04-26T11:13:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971236+0000", 2024-04-26T11:13:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4500000000000001e-06 2024-04-26T11:13:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971242+0000", 2024-04-26T11:13:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0970000000000002e-06 2024-04-26T11:13:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.972050+0000", 2024-04-26T11:13:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00080714600000000001 2024-04-26T11:13:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.972070+0000", 2024-04-26T11:13:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0628999999999998e-05 2024-04-26T11:13:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:34266 5.e e22/16 5:71e433d7:::benchmark_data_smithi029_44842_object34265:head v 22'2111, mlcod=22'2108)", 2024-04-26T11:13:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.971251+0000", 2024-04-26T11:13:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0013789449999999999, 2024-04-26T11:13:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0021531969999999999, 2024-04-26T11:13:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971251+0000", 2024-04-26T11:13:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971251+0000", 2024-04-26T11:13:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971251+0000", 2024-04-26T11:13:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971277+0000", 2024-04-26T11:13:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6282e-05 2024-04-26T11:13:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971284+0000", 2024-04-26T11:13:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2650000000000002e-06 2024-04-26T11:13:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971289+0000", 2024-04-26T11:13:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0520000000000001e-06 2024-04-26T11:13:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.972290+0000", 2024-04-26T11:13:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001001259 2024-04-26T11:13:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.972309+0000", 2024-04-26T11:13:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9051000000000001e-05 2024-04-26T11:13:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:34270 5.7 e22/16 5:ef74ec7e:::benchmark_data_smithi029_44842_object34269:head v 22'2130, mlcod=22'2128)", 2024-04-26T11:13:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.971768+0000", 2024-04-26T11:13:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.000862694, 2024-04-26T11:13:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001693195, 2024-04-26T11:13:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971768+0000", 2024-04-26T11:13:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971768+0000", 2024-04-26T11:13:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971767+0000", 2024-04-26T11:13:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971830+0000", 2024-04-26T11:13:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2850999999999998e-05 2024-04-26T11:13:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971840+0000", 2024-04-26T11:13:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.764e-06 2024-04-26T11:13:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.971845+0000", 2024-04-26T11:13:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6339999999999998e-06 2024-04-26T11:13:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.972085+0000", 2024-04-26T11:13:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00023924499999999999 2024-04-26T11:13:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.972101+0000", 2024-04-26T11:13:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6592999999999999e-05 2024-04-26T11:13:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:34267 5.0 e22/16 5:04c3ce7c:::benchmark_data_smithi029_44842_object34266:head v 22'2121, mlcod=22'2118)", 2024-04-26T11:13:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.972483+0000", 2024-04-26T11:13:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.000147756, 2024-04-26T11:13:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0010504119999999999, 2024-04-26T11:13:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.972483+0000", 2024-04-26T11:13:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.972483+0000", 2024-04-26T11:13:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.972482+0000", 2024-04-26T11:13:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.972505+0000", 2024-04-26T11:13:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3289999999999999e-05 2024-04-26T11:13:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.972513+0000", 2024-04-26T11:13:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6469999999999998e-06 2024-04-26T11:13:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.972518+0000", 2024-04-26T11:13:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.425e-06 2024-04-26T11:13:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.973298+0000", 2024-04-26T11:13:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00078022300000000003 2024-04-26T11:13:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.973315+0000", 2024-04-26T11:13:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7450999999999999e-05 2024-04-26T11:13:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:34271 5.7 e22/16 5:e25c967d:::benchmark_data_smithi029_44842_object34270:head v 22'2131, mlcod=22'2128)", 2024-04-26T11:13:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.973341+0000", 2024-04-26T11:13:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.99929, 2024-04-26T11:13:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00027098500000000001, 2024-04-26T11:13:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.973341+0000", 2024-04-26T11:13:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.973341+0000", 2024-04-26T11:13:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.973340+0000", 2024-04-26T11:13:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.973437+0000", 2024-04-26T11:13:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6306999999999998e-05 2024-04-26T11:13:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.973449+0000", 2024-04-26T11:13:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2125e-05 2024-04-26T11:13:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.973458+0000", 2024-04-26T11:13:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.0699999999999996e-06 2024-04-26T11:13:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.973489+0000", 2024-04-26T11:13:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1411000000000001e-05 2024-04-26T11:13:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.973506+0000", 2024-04-26T11:13:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6864999999999999e-05 2024-04-26T11:13:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.032 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.032 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:13:48.032 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 14 2024-04-26T11:13:48.032 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:13:48.033 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:48.032+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:48.034 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:13:48.134 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:48.133+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:48.156 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:13:48.158 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:13:48.168 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-04-26T11:13:46.457521+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":917703514,"num_objects":14018,"num_object_clones":0,"num_object_copies":28036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14018,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":14242,"num_write_kb":899090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14190,"ondisk_log_size":14190,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1781692,"kb_used_data":1692436,"kb_used_omap":4,"kb_used_meta":89211,"kb_avail":281333828,"statfs":{"total":289910292480,"available":288085839872,"internally_reserved":0,"allocated":1733054464,"data_stored":1732645115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":91352402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,6,3,5],"upper_bound":16},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":917110784,"num_objects":13994,"num_object_clones":0,"num_object_copies":27988,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13994,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13994,"num_write_kb":895616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000988"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.296082+0000","last_change":"2024-04-26T11:13:12.919196+0000","last_active":"2024-04-26T11:13:38.296082+0000","last_peered":"2024-04-26T11:13:38.296082+0000","last_clean":"2024-04-26T11:13:38.296082+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:13:38.296082+0000","last_undegraded":"2024-04-26T11:13:38.296082+0000","last_fullsized":"2024-04-26T11:13:38.296082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295702+0000","last_change":"2024-04-26T11:13:12.917670+0000","last_active":"2024-04-26T11:13:38.295702+0000","last_peered":"2024-04-26T11:13:38.295702+0000","last_clean":"2024-04-26T11:13:38.295702+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:13:38.295702+0000","last_undegraded":"2024-04-26T11:13:38.295702+0000","last_fullsized":"2024-04-26T11:13:38.295702+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.413573+0000","last_change":"2024-04-26T11:13:12.922235+0000","last_active":"2024-04-26T11:13:38.413573+0000","last_peered":"2024-04-26T11:13:38.413573+0000","last_clean":"2024-04-26T11:13:38.413573+0000","last_became_active":"2024-04-26T11:13:12.919993+0000","last_became_peered":"2024-04-26T11:13:12.919993+0000","last_unstale":"2024-04-26T11:13:38.413573+0000","last_undegraded":"2024-04-26T11:13:38.413573+0000","last_fullsized":"2024-04-26T11:13:38.413573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:41.004462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.413291+0000","last_change":"2024-04-26T11:13:12.916859+0000","last_active":"2024-04-26T11:13:38.413291+0000","last_peered":"2024-04-26T11:13:38.413291+0000","last_clean":"2024-04-26T11:13:38.413291+0000","last_became_active":"2024-04-26T11:13:12.915591+0000","last_became_peered":"2024-04-26T11:13:12.915591+0000","last_unstale":"2024-04-26T11:13:38.413291+0000","last_undegraded":"2024-04-26T11:13:38.413291+0000","last_fullsized":"2024-04-26T11:13:38.413291+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:52.543148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295393+0000","last_change":"2024-04-26T11:13:12.917403+0000","last_active":"2024-04-26T11:13:38.295393+0000","last_peered":"2024-04-26T11:13:38.295393+0000","last_clean":"2024-04-26T11:13:38.295393+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:13:38.295393+0000","last_undegraded":"2024-04-26T11:13:38.295393+0000","last_fullsized":"2024-04-26T11:13:38.295393+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:42.014955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.412883+0000","last_change":"2024-04-26T11:13:12.918802+0000","last_active":"2024-04-26T11:13:38.412883+0000","last_peered":"2024-04-26T11:13:38.412883+0000","last_clean":"2024-04-26T11:13:38.412883+0000","last_became_active":"2024-04-26T11:13:12.917353+0000","last_became_peered":"2024-04-26T11:13:12.917353+0000","last_unstale":"2024-04-26T11:13:38.412883+0000","last_undegraded":"2024-04-26T11:13:38.412883+0000","last_fullsized":"2024-04-26T11:13:38.412883+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:08.956085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.413363+0000","last_change":"2024-04-26T11:13:12.916789+0000","last_active":"2024-04-26T11:13:38.413363+0000","last_peered":"2024-04-26T11:13:38.413363+0000","last_clean":"2024-04-26T11:13:38.413363+0000","last_became_active":"2024-04-26T11:13:12.914947+0000","last_became_peered":"2024-04-26T11:13:12.914947+0000","last_unstale":"2024-04-26T11:13:38.413363+0000","last_undegraded":"2024-04-26T11:13:38.413363+0000","last_fullsized":"2024-04-26T11:13:38.413363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.412434+0000","last_change":"2024-04-26T11:13:12.919968+0000","last_active":"2024-04-26T11:13:38.412434+0000","last_peered":"2024-04-26T11:13:38.412434+0000","last_clean":"2024-04-26T11:13:38.412434+0000","last_became_active":"2024-04-26T11:13:12.918600+0000","last_became_peered":"2024-04-26T11:13:12.918600+0000","last_unstale":"2024-04-26T11:13:38.412434+0000","last_undegraded":"2024-04-26T11:13:38.412434+0000","last_fullsized":"2024-04-26T11:13:38.412434+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:41.073901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295867+0000","last_change":"2024-04-26T11:13:12.914649+0000","last_active":"2024-04-26T11:13:38.295867+0000","last_peered":"2024-04-26T11:13:38.295867+0000","last_clean":"2024-04-26T11:13:38.295867+0000","last_became_active":"2024-04-26T11:13:12.914174+0000","last_became_peered":"2024-04-26T11:13:12.914174+0000","last_unstale":"2024-04-26T11:13:38.295867+0000","last_undegraded":"2024-04-26T11:13:38.295867+0000","last_fullsized":"2024-04-26T11:13:38.295867+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:41.004462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295839+0000","last_change":"2024-04-26T11:13:12.918521+0000","last_active":"2024-04-26T11:13:38.295839+0000","last_peered":"2024-04-26T11:13:38.295839+0000","last_clean":"2024-04-26T11:13:38.295839+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:13:38.295839+0000","last_undegraded":"2024-04-26T11:13:38.295839+0000","last_fullsized":"2024-04-26T11:13:38.295839+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.413272+0000","last_change":"2024-04-26T11:13:12.922456+0000","last_active":"2024-04-26T11:13:38.413272+0000","last_peered":"2024-04-26T11:13:38.413272+0000","last_clean":"2024-04-26T11:13:38.413272+0000","last_became_active":"2024-04-26T11:13:12.921230+0000","last_became_peered":"2024-04-26T11:13:12.921230+0000","last_unstale":"2024-04-26T11:13:38.413272+0000","last_undegraded":"2024-04-26T11:13:38.413272+0000","last_fullsized":"2024-04-26T11:13:38.413272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:55.318150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295584+0000","last_change":"2024-04-26T11:13:12.914082+0000","last_active":"2024-04-26T11:13:38.295584+0000","last_peered":"2024-04-26T11:13:38.295584+0000","last_clean":"2024-04-26T11:13:38.295584+0000","last_became_active":"2024-04-26T11:13:12.913374+0000","last_became_peered":"2024-04-26T11:13:12.913374+0000","last_unstale":"2024-04-26T11:13:38.295584+0000","last_undegraded":"2024-04-26T11:13:38.295584+0000","last_fullsized":"2024-04-26T11:13:38.295584+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:52.543148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295502+0000","last_change":"2024-04-26T11:13:12.915484+0000","last_active":"2024-04-26T11:13:38.295502+0000","last_peered":"2024-04-26T11:13:38.295502+0000","last_clean":"2024-04-26T11:13:38.295502+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:13:38.295502+0000","last_undegraded":"2024-04-26T11:13:38.295502+0000","last_fullsized":"2024-04-26T11:13:38.295502+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.413223+0000","last_change":"2024-04-26T11:13:12.914318+0000","last_active":"2024-04-26T11:13:38.413223+0000","last_peered":"2024-04-26T11:13:38.413223+0000","last_clean":"2024-04-26T11:13:38.413223+0000","last_became_active":"2024-04-26T11:13:12.913437+0000","last_became_peered":"2024-04-26T11:13:12.913437+0000","last_unstale":"2024-04-26T11:13:38.413223+0000","last_undegraded":"2024-04-26T11:13:38.413223+0000","last_fullsized":"2024-04-26T11:13:38.413223+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.412698+0000","last_change":"2024-04-26T11:13:12.914523+0000","last_active":"2024-04-26T11:13:38.412698+0000","last_peered":"2024-04-26T11:13:38.412698+0000","last_clean":"2024-04-26T11:13:38.412698+0000","last_became_active":"2024-04-26T11:13:12.913241+0000","last_became_peered":"2024-04-26T11:13:12.913241+0000","last_unstale":"2024-04-26T11:13:38.412698+0000","last_undegraded":"2024-04-26T11:13:38.412698+0000","last_fullsized":"2024-04-26T11:13:38.412698+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:10.887079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.412449+0000","last_change":"2024-04-26T11:13:12.922145+0000","last_active":"2024-04-26T11:13:38.412449+0000","last_peered":"2024-04-26T11:13:38.412449+0000","last_clean":"2024-04-26T11:13:38.412449+0000","last_became_active":"2024-04-26T11:13:12.919048+0000","last_became_peered":"2024-04-26T11:13:12.919048+0000","last_unstale":"2024-04-26T11:13:38.412449+0000","last_undegraded":"2024-04-26T11:13:38.412449+0000","last_fullsized":"2024-04-26T11:13:38.412449+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:47.958725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295871+0000","last_change":"2024-04-26T11:13:12.914484+0000","last_active":"2024-04-26T11:13:38.295871+0000","last_peered":"2024-04-26T11:13:38.295871+0000","last_clean":"2024-04-26T11:13:38.295871+0000","last_became_active":"2024-04-26T11:13:12.913596+0000","last_became_peered":"2024-04-26T11:13:12.913596+0000","last_unstale":"2024-04-26T11:13:38.295871+0000","last_undegraded":"2024-04-26T11:13:38.295871+0000","last_fullsized":"2024-04-26T11:13:38.295871+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:38.001491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295918+0000","last_change":"2024-04-26T11:13:12.918759+0000","last_active":"2024-04-26T11:13:38.295918+0000","last_peered":"2024-04-26T11:13:38.295918+0000","last_clean":"2024-04-26T11:13:38.295918+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:13:38.295918+0000","last_undegraded":"2024-04-26T11:13:38.295918+0000","last_fullsized":"2024-04-26T11:13:38.295918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:55.002972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295557+0000","last_change":"2024-04-26T11:13:12.917334+0000","last_active":"2024-04-26T11:13:38.295557+0000","last_peered":"2024-04-26T11:13:38.295557+0000","last_clean":"2024-04-26T11:13:38.295557+0000","last_became_active":"2024-04-26T11:13:12.917010+0000","last_became_peered":"2024-04-26T11:13:12.917010+0000","last_unstale":"2024-04-26T11:13:38.295557+0000","last_undegraded":"2024-04-26T11:13:38.295557+0000","last_fullsized":"2024-04-26T11:13:38.295557+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:52.543148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.413305+0000","last_change":"2024-04-26T11:13:12.917519+0000","last_active":"2024-04-26T11:13:38.413305+0000","last_peered":"2024-04-26T11:13:38.413305+0000","last_clean":"2024-04-26T11:13:38.413305+0000","last_became_active":"2024-04-26T11:13:12.916985+0000","last_became_peered":"2024-04-26T11:13:12.916985+0000","last_unstale":"2024-04-26T11:13:38.413305+0000","last_undegraded":"2024-04-26T11:13:38.413305+0000","last_fullsized":"2024-04-26T11:13:38.413305+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:38.001491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.412616+0000","last_change":"2024-04-26T11:13:12.919641+0000","last_active":"2024-04-26T11:13:38.412616+0000","last_peered":"2024-04-26T11:13:38.412616+0000","last_clean":"2024-04-26T11:13:38.412616+0000","last_became_active":"2024-04-26T11:13:12.918830+0000","last_became_peered":"2024-04-26T11:13:12.918830+0000","last_unstale":"2024-04-26T11:13:38.412616+0000","last_undegraded":"2024-04-26T11:13:38.412616+0000","last_fullsized":"2024-04-26T11:13:38.412616+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:52.714816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295268+0000","last_change":"2024-04-26T11:13:12.914087+0000","last_active":"2024-04-26T11:13:38.295268+0000","last_peered":"2024-04-26T11:13:38.295268+0000","last_clean":"2024-04-26T11:13:38.295268+0000","last_became_active":"2024-04-26T11:13:12.913393+0000","last_became_peered":"2024-04-26T11:13:12.913393+0000","last_unstale":"2024-04-26T11:13:38.295268+0000","last_undegraded":"2024-04-26T11:13:38.295268+0000","last_fullsized":"2024-04-26T11:13:38.295268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:38.001491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295012+0000","last_change":"2024-04-26T11:13:12.918407+0000","last_active":"2024-04-26T11:13:38.295012+0000","last_peered":"2024-04-26T11:13:38.295012+0000","last_clean":"2024-04-26T11:13:38.295012+0000","last_became_active":"2024-04-26T11:13:12.918176+0000","last_became_peered":"2024-04-26T11:13:12.918176+0000","last_unstale":"2024-04-26T11:13:38.295012+0000","last_undegraded":"2024-04-26T11:13:38.295012+0000","last_fullsized":"2024-04-26T11:13:38.295012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295322+0000","last_change":"2024-04-26T11:13:12.912756+0000","last_active":"2024-04-26T11:13:38.295322+0000","last_peered":"2024-04-26T11:13:38.295322+0000","last_clean":"2024-04-26T11:13:38.295322+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:13:38.295322+0000","last_undegraded":"2024-04-26T11:13:38.295322+0000","last_fullsized":"2024-04-26T11:13:38.295322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:04.177831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.296101+0000","last_change":"2024-04-26T11:13:12.920122+0000","last_active":"2024-04-26T11:13:38.296101+0000","last_peered":"2024-04-26T11:13:38.296101+0000","last_clean":"2024-04-26T11:13:38.296101+0000","last_became_active":"2024-04-26T11:13:12.919792+0000","last_became_peered":"2024-04-26T11:13:12.919792+0000","last_unstale":"2024-04-26T11:13:38.296101+0000","last_undegraded":"2024-04-26T11:13:38.296101+0000","last_fullsized":"2024-04-26T11:13:38.296101+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:54.809926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295827+0000","last_change":"2024-04-26T11:13:12.912803+0000","last_active":"2024-04-26T11:13:38.295827+0000","last_peered":"2024-04-26T11:13:38.295827+0000","last_clean":"2024-04-26T11:13:38.295827+0000","last_became_active":"2024-04-26T11:13:12.912254+0000","last_became_peered":"2024-04-26T11:13:12.912254+0000","last_unstale":"2024-04-26T11:13:38.295827+0000","last_undegraded":"2024-04-26T11:13:38.295827+0000","last_fullsized":"2024-04-26T11:13:38.295827+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:11.313582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.413352+0000","last_change":"2024-04-26T11:13:12.921062+0000","last_active":"2024-04-26T11:13:38.413352+0000","last_peered":"2024-04-26T11:13:38.413352+0000","last_clean":"2024-04-26T11:13:38.413352+0000","last_became_active":"2024-04-26T11:13:12.918716+0000","last_became_peered":"2024-04-26T11:13:12.918716+0000","last_unstale":"2024-04-26T11:13:38.413352+0000","last_undegraded":"2024-04-26T11:13:38.413352+0000","last_fullsized":"2024-04-26T11:13:38.413352+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:55.576807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295262+0000","last_change":"2024-04-26T11:13:12.493425+0000","last_active":"2024-04-26T11:13:38.295262+0000","last_peered":"2024-04-26T11:13:38.295262+0000","last_clean":"2024-04-26T11:13:38.295262+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:13:38.295262+0000","last_undegraded":"2024-04-26T11:13:38.295262+0000","last_fullsized":"2024-04-26T11:13:38.295262+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:23.279580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.296003+0000","last_change":"2024-04-26T11:13:12.918515+0000","last_active":"2024-04-26T11:13:38.296003+0000","last_peered":"2024-04-26T11:13:38.296003+0000","last_clean":"2024-04-26T11:13:38.296003+0000","last_became_active":"2024-04-26T11:13:12.918002+0000","last_became_peered":"2024-04-26T11:13:12.918002+0000","last_unstale":"2024-04-26T11:13:38.296003+0000","last_undegraded":"2024-04-26T11:13:38.296003+0000","last_fullsized":"2024-04-26T11:13:38.296003+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:46.610126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295193+0000","last_change":"2024-04-26T11:13:12.490257+0000","last_active":"2024-04-26T11:13:38.295193+0000","last_peered":"2024-04-26T11:13:38.295193+0000","last_clean":"2024-04-26T11:13:38.295193+0000","last_became_active":"2024-04-26T11:13:12.488819+0000","last_became_peered":"2024-04-26T11:13:12.488819+0000","last_unstale":"2024-04-26T11:13:38.295193+0000","last_undegraded":"2024-04-26T11:13:38.295193+0000","last_fullsized":"2024-04-26T11:13:38.295193+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:52.644533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295910+0000","last_change":"2024-04-26T11:13:12.915624+0000","last_active":"2024-04-26T11:13:38.295910+0000","last_peered":"2024-04-26T11:13:38.295910+0000","last_clean":"2024-04-26T11:13:38.295910+0000","last_became_active":"2024-04-26T11:13:12.915375+0000","last_became_peered":"2024-04-26T11:13:12.915375+0000","last_unstale":"2024-04-26T11:13:38.295910+0000","last_undegraded":"2024-04-26T11:13:38.295910+0000","last_fullsized":"2024-04-26T11:13:38.295910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:28.908758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295376+0000","last_change":"2024-04-26T11:13:12.487990+0000","last_active":"2024-04-26T11:13:38.295376+0000","last_peered":"2024-04-26T11:13:38.295376+0000","last_clean":"2024-04-26T11:13:38.295376+0000","last_became_active":"2024-04-26T11:13:12.486848+0000","last_became_peered":"2024-04-26T11:13:12.486848+0000","last_unstale":"2024-04-26T11:13:38.295376+0000","last_undegraded":"2024-04-26T11:13:38.295376+0000","last_fullsized":"2024-04-26T11:13:38.295376+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:56.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.296027+0000","last_change":"2024-04-26T11:13:12.917423+0000","last_active":"2024-04-26T11:13:38.296027+0000","last_peered":"2024-04-26T11:13:38.296027+0000","last_clean":"2024-04-26T11:13:38.296027+0000","last_became_active":"2024-04-26T11:13:12.916811+0000","last_became_peered":"2024-04-26T11:13:12.916811+0000","last_unstale":"2024-04-26T11:13:38.296027+0000","last_undegraded":"2024-04-26T11:13:38.296027+0000","last_fullsized":"2024-04-26T11:13:38.296027+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:28.908758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.296039+0000","last_change":"2024-04-26T11:13:12.490251+0000","last_active":"2024-04-26T11:13:38.296039+0000","last_peered":"2024-04-26T11:13:38.296039+0000","last_clean":"2024-04-26T11:13:38.296039+0000","last_became_active":"2024-04-26T11:13:12.489836+0000","last_became_peered":"2024-04-26T11:13:12.489836+0000","last_unstale":"2024-04-26T11:13:38.296039+0000","last_undegraded":"2024-04-26T11:13:38.296039+0000","last_fullsized":"2024-04-26T11:13:38.296039+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:42.000159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295218+0000","last_change":"2024-04-26T11:13:12.912865+0000","last_active":"2024-04-26T11:13:38.295218+0000","last_peered":"2024-04-26T11:13:38.295218+0000","last_clean":"2024-04-26T11:13:38.295218+0000","last_became_active":"2024-04-26T11:13:12.912397+0000","last_became_peered":"2024-04-26T11:13:12.912397+0000","last_unstale":"2024-04-26T11:13:38.295218+0000","last_undegraded":"2024-04-26T11:13:38.295218+0000","last_fullsized":"2024-04-26T11:13:38.295218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.413092+0000","last_change":"2024-04-26T11:13:12.493118+0000","last_active":"2024-04-26T11:13:38.413092+0000","last_peered":"2024-04-26T11:13:38.413092+0000","last_clean":"2024-04-26T11:13:38.413092+0000","last_became_active":"2024-04-26T11:13:12.492799+0000","last_became_peered":"2024-04-26T11:13:12.492799+0000","last_unstale":"2024-04-26T11:13:38.413092+0000","last_undegraded":"2024-04-26T11:13:38.413092+0000","last_fullsized":"2024-04-26T11:13:38.413092+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:46.082467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295299+0000","last_change":"2024-04-26T11:13:12.918149+0000","last_active":"2024-04-26T11:13:38.295299+0000","last_peered":"2024-04-26T11:13:38.295299+0000","last_clean":"2024-04-26T11:13:38.295299+0000","last_became_active":"2024-04-26T11:13:12.917636+0000","last_became_peered":"2024-04-26T11:13:12.917636+0000","last_unstale":"2024-04-26T11:13:38.295299+0000","last_undegraded":"2024-04-26T11:13:38.295299+0000","last_fullsized":"2024-04-26T11:13:38.295299+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:20.837217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295804+0000","last_change":"2024-04-26T11:13:12.495785+0000","last_active":"2024-04-26T11:13:38.295804+0000","last_peered":"2024-04-26T11:13:38.295804+0000","last_clean":"2024-04-26T11:13:38.295804+0000","last_became_active":"2024-04-26T11:13:12.495527+0000","last_became_peered":"2024-04-26T11:13:12.495527+0000","last_unstale":"2024-04-26T11:13:38.295804+0000","last_undegraded":"2024-04-26T11:13:38.295804+0000","last_fullsized":"2024-04-26T11:13:38.295804+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:45.374565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295314+0000","last_change":"2024-04-26T11:13:12.913698+0000","last_active":"2024-04-26T11:13:38.295314+0000","last_peered":"2024-04-26T11:13:38.295314+0000","last_clean":"2024-04-26T11:13:38.295314+0000","last_became_active":"2024-04-26T11:13:12.913198+0000","last_became_peered":"2024-04-26T11:13:12.913198+0000","last_unstale":"2024-04-26T11:13:38.295314+0000","last_undegraded":"2024-04-26T11:13:38.295314+0000","last_fullsized":"2024-04-26T11:13:38.295314+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.413207+0000","last_change":"2024-04-26T11:13:12.492878+0000","last_active":"2024-04-26T11:13:38.413207+0000","last_peered":"2024-04-26T11:13:38.413207+0000","last_clean":"2024-04-26T11:13:38.413207+0000","last_became_active":"2024-04-26T11:13:12.491690+0000","last_became_peered":"2024-04-26T11:13:12.491690+0000","last_unstale":"2024-04-26T11:13:38.413207+0000","last_undegraded":"2024-04-26T11:13:38.413207+0000","last_fullsized":"2024-04-26T11:13:38.413207+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:12.581788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.412983+0000","last_change":"2024-04-26T11:13:12.916914+0000","last_active":"2024-04-26T11:13:38.412983+0000","last_peered":"2024-04-26T11:13:38.412983+0000","last_clean":"2024-04-26T11:13:38.412983+0000","last_became_active":"2024-04-26T11:13:12.913900+0000","last_became_peered":"2024-04-26T11:13:12.913900+0000","last_unstale":"2024-04-26T11:13:38.412983+0000","last_undegraded":"2024-04-26T11:13:38.412983+0000","last_fullsized":"2024-04-26T11:13:38.412983+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:28.908758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.412855+0000","last_change":"2024-04-26T11:13:12.493445+0000","last_active":"2024-04-26T11:13:38.412855+0000","last_peered":"2024-04-26T11:13:38.412855+0000","last_clean":"2024-04-26T11:13:38.412855+0000","last_became_active":"2024-04-26T11:13:12.493015+0000","last_became_peered":"2024-04-26T11:13:12.493015+0000","last_unstale":"2024-04-26T11:13:38.412855+0000","last_undegraded":"2024-04-26T11:13:38.412855+0000","last_fullsized":"2024-04-26T11:13:38.412855+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:17.385314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295725+0000","last_change":"2024-04-26T11:13:12.916685+0000","last_active":"2024-04-26T11:13:38.295725+0000","last_peered":"2024-04-26T11:13:38.295725+0000","last_clean":"2024-04-26T11:13:38.295725+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:13:38.295725+0000","last_undegraded":"2024-04-26T11:13:38.295725+0000","last_fullsized":"2024-04-26T11:13:38.295725+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295411+0000","last_change":"2024-04-26T11:13:12.491438+0000","last_active":"2024-04-26T11:13:38.295411+0000","last_peered":"2024-04-26T11:13:38.295411+0000","last_clean":"2024-04-26T11:13:38.295411+0000","last_became_active":"2024-04-26T11:13:12.490515+0000","last_became_peered":"2024-04-26T11:13:12.490515+0000","last_unstale":"2024-04-26T11:13:38.295411+0000","last_undegraded":"2024-04-26T11:13:38.295411+0000","last_fullsized":"2024-04-26T11:13:38.295411+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:11.480844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295889+0000","last_change":"2024-04-26T11:13:12.915238+0000","last_active":"2024-04-26T11:13:38.295889+0000","last_peered":"2024-04-26T11:13:38.295889+0000","last_clean":"2024-04-26T11:13:38.295889+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:13:38.295889+0000","last_undegraded":"2024-04-26T11:13:38.295889+0000","last_fullsized":"2024-04-26T11:13:38.295889+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:48.068465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295242+0000","last_change":"2024-04-26T11:13:12.492682+0000","last_active":"2024-04-26T11:13:38.295242+0000","last_peered":"2024-04-26T11:13:38.295242+0000","last_clean":"2024-04-26T11:13:38.295242+0000","last_became_active":"2024-04-26T11:13:12.492346+0000","last_became_peered":"2024-04-26T11:13:12.492346+0000","last_unstale":"2024-04-26T11:13:38.295242+0000","last_undegraded":"2024-04-26T11:13:38.295242+0000","last_fullsized":"2024-04-26T11:13:38.295242+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:28.034755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295991+0000","last_change":"2024-04-26T11:13:12.913671+0000","last_active":"2024-04-26T11:13:38.295991+0000","last_peered":"2024-04-26T11:13:38.295991+0000","last_clean":"2024-04-26T11:13:38.295991+0000","last_became_active":"2024-04-26T11:13:12.913264+0000","last_became_peered":"2024-04-26T11:13:12.913264+0000","last_unstale":"2024-04-26T11:13:38.295991+0000","last_undegraded":"2024-04-26T11:13:38.295991+0000","last_fullsized":"2024-04-26T11:13:38.295991+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":23,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.412701+0000","last_change":"2024-04-26T11:13:12.492802+0000","last_active":"2024-04-26T11:13:38.412701+0000","last_peered":"2024-04-26T11:13:38.412701+0000","last_clean":"2024-04-26T11:13:38.412701+0000","last_became_active":"2024-04-26T11:13:12.491774+0000","last_became_peered":"2024-04-26T11:13:12.491774+0000","last_unstale":"2024-04-26T11:13:38.412701+0000","last_undegraded":"2024-04-26T11:13:38.412701+0000","last_fullsized":"2024-04-26T11:13:38.412701+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:05.413010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.296117+0000","last_change":"2024-04-26T11:13:12.915666+0000","last_active":"2024-04-26T11:13:38.296117+0000","last_peered":"2024-04-26T11:13:38.296117+0000","last_clean":"2024-04-26T11:13:38.296117+0000","last_became_active":"2024-04-26T11:13:12.915393+0000","last_became_peered":"2024-04-26T11:13:12.915393+0000","last_unstale":"2024-04-26T11:13:38.296117+0000","last_undegraded":"2024-04-26T11:13:38.296117+0000","last_fullsized":"2024-04-26T11:13:38.296117+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"19'905","reported_seq":916,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:13:41.431663+0000","last_change":"2024-04-26T11:13:37.299025+0000","last_active":"2024-04-26T11:13:41.431663+0000","last_peered":"2024-04-26T11:13:41.431663+0000","last_clean":"2024-04-26T11:13:41.431663+0000","last_became_active":"2024-04-26T11:13:37.298756+0000","last_became_peered":"2024-04-26T11:13:37.298756+0000","last_unstale":"2024-04-26T11:13:41.431663+0000","last_undegraded":"2024-04-26T11:13:41.431663+0000","last_fullsized":"2024-04-26T11:13:41.431663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_clean_scrub_stamp":"2024-04-26T11:13:36.285985+0000","objects_scrubbed":0,"log_size":905,"log_dups_size":0,"ondisk_log_size":905,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:21.057641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59310080,"num_objects":905,"num_object_clones":0,"num_object_copies":1810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":905,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":905,"num_write_kb":57920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.413737+0000","last_change":"2024-04-26T11:13:12.491934+0000","last_active":"2024-04-26T11:13:38.413737+0000","last_peered":"2024-04-26T11:13:38.413737+0000","last_clean":"2024-04-26T11:13:38.413737+0000","last_became_active":"2024-04-26T11:13:12.491262+0000","last_became_peered":"2024-04-26T11:13:12.491262+0000","last_unstale":"2024-04-26T11:13:38.413737+0000","last_undegraded":"2024-04-26T11:13:38.413737+0000","last_fullsized":"2024-04-26T11:13:38.413737+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:11.480844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295108+0000","last_change":"2024-04-26T11:13:12.920072+0000","last_active":"2024-04-26T11:13:38.295108+0000","last_peered":"2024-04-26T11:13:38.295108+0000","last_clean":"2024-04-26T11:13:38.295108+0000","last_became_active":"2024-04-26T11:13:12.919233+0000","last_became_peered":"2024-04-26T11:13:12.919233+0000","last_unstale":"2024-04-26T11:13:38.295108+0000","last_undegraded":"2024-04-26T11:13:38.295108+0000","last_fullsized":"2024-04-26T11:13:38.295108+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:41.004462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"19'887","reported_seq":898,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:13:41.454134+0000","last_change":"2024-04-26T11:13:37.298010+0000","last_active":"2024-04-26T11:13:41.454134+0000","last_peered":"2024-04-26T11:13:41.454134+0000","last_clean":"2024-04-26T11:13:41.454134+0000","last_became_active":"2024-04-26T11:13:37.297768+0000","last_became_peered":"2024-04-26T11:13:37.297768+0000","last_unstale":"2024-04-26T11:13:41.454134+0000","last_undegraded":"2024-04-26T11:13:41.454134+0000","last_fullsized":"2024-04-26T11:13:41.454134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_clean_scrub_stamp":"2024-04-26T11:13:36.285985+0000","objects_scrubbed":0,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:04:38.824213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58130432,"num_objects":887,"num_object_clones":0,"num_object_copies":1774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":887,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":887,"num_write_kb":56768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295789+0000","last_change":"2024-04-26T11:13:12.493060+0000","last_active":"2024-04-26T11:13:38.295789+0000","last_peered":"2024-04-26T11:13:38.295789+0000","last_clean":"2024-04-26T11:13:38.295789+0000","last_became_active":"2024-04-26T11:13:12.492519+0000","last_became_peered":"2024-04-26T11:13:12.492519+0000","last_unstale":"2024-04-26T11:13:38.295789+0000","last_undegraded":"2024-04-26T11:13:38.295789+0000","last_fullsized":"2024-04-26T11:13:38.295789+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:48.928740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295341+0000","last_change":"2024-04-26T11:13:12.912207+0000","last_active":"2024-04-26T11:13:38.295341+0000","last_peered":"2024-04-26T11:13:38.295341+0000","last_clean":"2024-04-26T11:13:38.295341+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:13:38.295341+0000","last_undegraded":"2024-04-26T11:13:38.295341+0000","last_fullsized":"2024-04-26T11:13:38.295341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"19'896","reported_seq":907,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:13:41.459212+0000","last_change":"2024-04-26T11:13:37.297502+0000","last_active":"2024-04-26T11:13:41.459212+0000","last_peered":"2024-04-26T11:13:41.459212+0000","last_clean":"2024-04-26T11:13:41.459212+0000","last_became_active":"2024-04-26T11:13:37.297248+0000","last_became_peered":"2024-04-26T11:13:37.297248+0000","last_unstale":"2024-04-26T11:13:41.459212+0000","last_undegraded":"2024-04-26T11:13:41.459212+0000","last_fullsized":"2024-04-26T11:13:41.459212+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_clean_scrub_stamp":"2024-04-26T11:13:36.285985+0000","objects_scrubbed":0,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:20.687741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":896,"num_object_clones":0,"num_object_copies":1792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":896,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.413432+0000","last_change":"2024-04-26T11:13:12.492772+0000","last_active":"2024-04-26T11:13:38.413432+0000","last_peered":"2024-04-26T11:13:38.413432+0000","last_clean":"2024-04-26T11:13:38.413432+0000","last_became_active":"2024-04-26T11:13:12.491901+0000","last_became_peered":"2024-04-26T11:13:12.491901+0000","last_unstale":"2024-04-26T11:13:38.413432+0000","last_undegraded":"2024-04-26T11:13:38.413432+0000","last_fullsized":"2024-04-26T11:13:38.413432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:45.693017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.413058+0000","last_change":"2024-04-26T11:13:12.919749+0000","last_active":"2024-04-26T11:13:38.413058+0000","last_peered":"2024-04-26T11:13:38.413058+0000","last_clean":"2024-04-26T11:13:38.413058+0000","last_became_active":"2024-04-26T11:13:12.917479+0000","last_became_peered":"2024-04-26T11:13:12.917479+0000","last_unstale":"2024-04-26T11:13:38.413058+0000","last_undegraded":"2024-04-26T11:13:38.413058+0000","last_fullsized":"2024-04-26T11:13:38.413058+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:12.483631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"19'920","reported_seq":931,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:13:41.447390+0000","last_change":"2024-04-26T11:13:37.296879+0000","last_active":"2024-04-26T11:13:41.447390+0000","last_peered":"2024-04-26T11:13:41.447390+0000","last_clean":"2024-04-26T11:13:41.447390+0000","last_became_active":"2024-04-26T11:13:37.296620+0000","last_became_peered":"2024-04-26T11:13:37.296620+0000","last_unstale":"2024-04-26T11:13:41.447390+0000","last_undegraded":"2024-04-26T11:13:41.447390+0000","last_fullsized":"2024-04-26T11:13:41.447390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_clean_scrub_stamp":"2024-04-26T11:13:36.285985+0000","objects_scrubbed":0,"log_size":920,"log_dups_size":0,"ondisk_log_size":920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:16.311140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60293120,"num_objects":920,"num_object_clones":0,"num_object_copies":1840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":920,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":920,"num_write_kb":58880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.413014+0000","last_change":"2024-04-26T11:13:12.495144+0000","last_active":"2024-04-26T11:13:38.413014+0000","last_peered":"2024-04-26T11:13:38.413014+0000","last_clean":"2024-04-26T11:13:38.413014+0000","last_became_active":"2024-04-26T11:13:12.494510+0000","last_became_peered":"2024-04-26T11:13:12.494510+0000","last_unstale":"2024-04-26T11:13:38.413014+0000","last_undegraded":"2024-04-26T11:13:38.413014+0000","last_fullsized":"2024-04-26T11:13:38.413014+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:00.146717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295544+0000","last_change":"2024-04-26T11:13:12.913350+0000","last_active":"2024-04-26T11:13:38.295544+0000","last_peered":"2024-04-26T11:13:38.295544+0000","last_clean":"2024-04-26T11:13:38.295544+0000","last_became_active":"2024-04-26T11:13:12.912991+0000","last_became_peered":"2024-04-26T11:13:12.912991+0000","last_unstale":"2024-04-26T11:13:38.295544+0000","last_undegraded":"2024-04-26T11:13:38.295544+0000","last_fullsized":"2024-04-26T11:13:38.295544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:54.809926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"19'881","reported_seq":890,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:13:41.459393+0000","last_change":"2024-04-26T11:13:37.300090+0000","last_active":"2024-04-26T11:13:41.459393+0000","last_peered":"2024-04-26T11:13:41.459393+0000","last_clean":"2024-04-26T11:13:41.459393+0000","last_became_active":"2024-04-26T11:13:37.299926+0000","last_became_peered":"2024-04-26T11:13:37.299926+0000","last_unstale":"2024-04-26T11:13:41.459393+0000","last_undegraded":"2024-04-26T11:13:41.459393+0000","last_fullsized":"2024-04-26T11:13:41.459393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_clean_scrub_stamp":"2024-04-26T11:13:36.285985+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:05.850003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57737216,"num_objects":881,"num_object_clones":0,"num_object_copies":1762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":881,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":881,"num_write_kb":56384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295510+0000","last_change":"2024-04-26T11:13:12.490343+0000","last_active":"2024-04-26T11:13:38.295510+0000","last_peered":"2024-04-26T11:13:38.295510+0000","last_clean":"2024-04-26T11:13:38.295510+0000","last_became_active":"2024-04-26T11:13:12.490027+0000","last_became_peered":"2024-04-26T11:13:12.490027+0000","last_unstale":"2024-04-26T11:13:38.295510+0000","last_undegraded":"2024-04-26T11:13:38.295510+0000","last_fullsized":"2024-04-26T11:13:38.295510+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:45.693017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.413067+0000","last_change":"2024-04-26T11:13:12.918774+0000","last_active":"2024-04-26T11:13:38.413067+0000","last_peered":"2024-04-26T11:13:38.413067+0000","last_clean":"2024-04-26T11:13:38.413067+0000","last_became_active":"2024-04-26T11:13:12.917269+0000","last_became_peered":"2024-04-26T11:13:12.917269+0000","last_unstale":"2024-04-26T11:13:38.413067+0000","last_undegraded":"2024-04-26T11:13:38.413067+0000","last_fullsized":"2024-04-26T11:13:38.413067+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:33.358984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"19'857","reported_seq":868,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:13:41.458144+0000","last_change":"2024-04-26T11:13:37.300556+0000","last_active":"2024-04-26T11:13:41.458144+0000","last_peered":"2024-04-26T11:13:41.458144+0000","last_clean":"2024-04-26T11:13:41.458144+0000","last_became_active":"2024-04-26T11:13:37.300284+0000","last_became_peered":"2024-04-26T11:13:37.300284+0000","last_unstale":"2024-04-26T11:13:41.458144+0000","last_undegraded":"2024-04-26T11:13:41.458144+0000","last_fullsized":"2024-04-26T11:13:41.458144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_clean_scrub_stamp":"2024-04-26T11:13:36.285985+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:38.611018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56164352,"num_objects":857,"num_object_clones":0,"num_object_copies":1714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":857,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":857,"num_write_kb":54848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.413102+0000","last_change":"2024-04-26T11:13:12.494689+0000","last_active":"2024-04-26T11:13:38.413102+0000","last_peered":"2024-04-26T11:13:38.413102+0000","last_clean":"2024-04-26T11:13:38.413102+0000","last_became_active":"2024-04-26T11:13:12.494236+0000","last_became_peered":"2024-04-26T11:13:12.494236+0000","last_unstale":"2024-04-26T11:13:38.413102+0000","last_undegraded":"2024-04-26T11:13:38.413102+0000","last_fullsized":"2024-04-26T11:13:38.413102+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:42.000159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.413738+0000","last_change":"2024-04-26T11:13:12.919985+0000","last_active":"2024-04-26T11:13:38.413738+0000","last_peered":"2024-04-26T11:13:38.413738+0000","last_clean":"2024-04-26T11:13:38.413738+0000","last_became_active":"2024-04-26T11:13:12.916239+0000","last_became_peered":"2024-04-26T11:13:12.916239+0000","last_unstale":"2024-04-26T11:13:38.413738+0000","last_undegraded":"2024-04-26T11:13:38.413738+0000","last_fullsized":"2024-04-26T11:13:38.413738+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:54.809926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"19'858","reported_seq":868,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:13:41.454655+0000","last_change":"2024-04-26T11:13:37.299328+0000","last_active":"2024-04-26T11:13:41.454655+0000","last_peered":"2024-04-26T11:13:41.454655+0000","last_clean":"2024-04-26T11:13:41.454655+0000","last_became_active":"2024-04-26T11:13:37.298946+0000","last_became_peered":"2024-04-26T11:13:37.298946+0000","last_unstale":"2024-04-26T11:13:41.454655+0000","last_undegraded":"2024-04-26T11:13:41.454655+0000","last_fullsized":"2024-04-26T11:13:41.454655+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_clean_scrub_stamp":"2024-04-26T11:13:36.285985+0000","objects_scrubbed":0,"log_size":858,"log_dups_size":0,"ondisk_log_size":858,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:20:43.106464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56229888,"num_objects":858,"num_object_clones":0,"num_object_copies":1716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":858,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":858,"num_write_kb":54912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295136+0000","last_change":"2024-04-26T11:13:12.492856+0000","last_active":"2024-04-26T11:13:38.295136+0000","last_peered":"2024-04-26T11:13:38.295136+0000","last_clean":"2024-04-26T11:13:38.295136+0000","last_became_active":"2024-04-26T11:13:12.492412+0000","last_became_peered":"2024-04-26T11:13:12.492412+0000","last_unstale":"2024-04-26T11:13:38.295136+0000","last_undegraded":"2024-04-26T11:13:38.295136+0000","last_fullsized":"2024-04-26T11:13:38.295136+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:58:09.572402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.413212+0000","last_change":"2024-04-26T11:13:12.920056+0000","last_active":"2024-04-26T11:13:38.413212+0000","last_peered":"2024-04-26T11:13:38.413212+0000","last_clean":"2024-04-26T11:13:38.413212+0000","last_became_active":"2024-04-26T11:13:12.919049+0000","last_became_peered":"2024-04-26T11:13:12.919049+0000","last_unstale":"2024-04-26T11:13:38.413212+0000","last_undegraded":"2024-04-26T11:13:38.413212+0000","last_fullsized":"2024-04-26T11:13:38.413212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"19'837","reported_seq":848,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:13:41.462011+0000","last_change":"2024-04-26T11:13:37.297841+0000","last_active":"2024-04-26T11:13:41.462011+0000","last_peered":"2024-04-26T11:13:41.462011+0000","last_clean":"2024-04-26T11:13:41.462011+0000","last_became_active":"2024-04-26T11:13:37.297615+0000","last_became_peered":"2024-04-26T11:13:37.297615+0000","last_unstale":"2024-04-26T11:13:41.462011+0000","last_undegraded":"2024-04-26T11:13:41.462011+0000","last_fullsized":"2024-04-26T11:13:41.462011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_clean_scrub_stamp":"2024-04-26T11:13:36.285985+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:12.795861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54853632,"num_objects":837,"num_object_clones":0,"num_object_copies":1674,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":837,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":837,"num_write_kb":53568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295254+0000","last_change":"2024-04-26T11:13:12.493217+0000","last_active":"2024-04-26T11:13:38.295254+0000","last_peered":"2024-04-26T11:13:38.295254+0000","last_clean":"2024-04-26T11:13:38.295254+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:13:38.295254+0000","last_undegraded":"2024-04-26T11:13:38.295254+0000","last_fullsized":"2024-04-26T11:13:38.295254+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:00.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295952+0000","last_change":"2024-04-26T11:13:12.914321+0000","last_active":"2024-04-26T11:13:38.295952+0000","last_peered":"2024-04-26T11:13:38.295952+0000","last_clean":"2024-04-26T11:13:38.295952+0000","last_became_active":"2024-04-26T11:13:12.913543+0000","last_became_peered":"2024-04-26T11:13:12.913543+0000","last_unstale":"2024-04-26T11:13:38.295952+0000","last_undegraded":"2024-04-26T11:13:38.295952+0000","last_fullsized":"2024-04-26T11:13:38.295952+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"19'848","reported_seq":859,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:13:41.449430+0000","last_change":"2024-04-26T11:13:37.300351+0000","last_active":"2024-04-26T11:13:41.449430+0000","last_peered":"2024-04-26T11:13:41.449430+0000","last_clean":"2024-04-26T11:13:41.449430+0000","last_became_active":"2024-04-26T11:13:37.300182+0000","last_became_peered":"2024-04-26T11:13:37.300182+0000","last_unstale":"2024-04-26T11:13:41.449430+0000","last_undegraded":"2024-04-26T11:13:41.449430+0000","last_fullsized":"2024-04-26T11:13:41.449430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_clean_scrub_stamp":"2024-04-26T11:13:36.285985+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:12.973967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55574528,"num_objects":848,"num_object_clones":0,"num_object_copies":1696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":848,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":848,"num_write_kb":54272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295723+0000","last_change":"2024-04-26T11:13:08.113095+0000","last_active":"2024-04-26T11:13:38.295723+0000","last_peered":"2024-04-26T11:13:38.295723+0000","last_clean":"2024-04-26T11:13:38.295723+0000","last_became_active":"2024-04-26T11:13:08.112778+0000","last_became_peered":"2024-04-26T11:13:08.112778+0000","last_unstale":"2024-04-26T11:13:38.295723+0000","last_undegraded":"2024-04-26T11:13:38.295723+0000","last_fullsized":"2024-04-26T11:13:38.295723+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:41.705893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.413661+0000","last_change":"2024-04-26T11:13:12.493960+0000","last_active":"2024-04-26T11:13:38.413661+0000","last_peered":"2024-04-26T11:13:38.413661+0000","last_clean":"2024-04-26T11:13:38.413661+0000","last_became_active":"2024-04-26T11:13:12.493087+0000","last_became_peered":"2024-04-26T11:13:12.493087+0000","last_unstale":"2024-04-26T11:13:38.413661+0000","last_undegraded":"2024-04-26T11:13:38.413661+0000","last_fullsized":"2024-04-26T11:13:38.413661+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:19.538082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295367+0000","last_change":"2024-04-26T11:13:12.917458+0000","last_active":"2024-04-26T11:13:38.295367+0000","last_peered":"2024-04-26T11:13:38.295367+0000","last_clean":"2024-04-26T11:13:38.295367+0000","last_became_active":"2024-04-26T11:13:12.916792+0000","last_became_peered":"2024-04-26T11:13:12.916792+0000","last_unstale":"2024-04-26T11:13:38.295367+0000","last_undegraded":"2024-04-26T11:13:38.295367+0000","last_fullsized":"2024-04-26T11:13:38.295367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:12.483631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"19'829","reported_seq":840,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:13:41.449175+0000","last_change":"2024-04-26T11:13:37.300949+0000","last_active":"2024-04-26T11:13:41.449175+0000","last_peered":"2024-04-26T11:13:41.449175+0000","last_clean":"2024-04-26T11:13:41.449175+0000","last_became_active":"2024-04-26T11:13:37.300723+0000","last_became_peered":"2024-04-26T11:13:37.300723+0000","last_unstale":"2024-04-26T11:13:41.449175+0000","last_undegraded":"2024-04-26T11:13:41.449175+0000","last_fullsized":"2024-04-26T11:13:41.449175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_clean_scrub_stamp":"2024-04-26T11:13:36.285985+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:20.026449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54329344,"num_objects":829,"num_object_clones":0,"num_object_copies":1658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":829,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":829,"num_write_kb":53056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.413141+0000","last_change":"2024-04-26T11:13:08.112744+0000","last_active":"2024-04-26T11:13:38.413141+0000","last_peered":"2024-04-26T11:13:38.413141+0000","last_clean":"2024-04-26T11:13:38.413141+0000","last_became_active":"2024-04-26T11:13:08.112498+0000","last_became_peered":"2024-04-26T11:13:08.112498+0000","last_unstale":"2024-04-26T11:13:38.413141+0000","last_undegraded":"2024-04-26T11:13:38.413141+0000","last_fullsized":"2024-04-26T11:13:38.413141+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:38.407116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.412724+0000","last_change":"2024-04-26T11:13:12.494137+0000","last_active":"2024-04-26T11:13:38.412724+0000","last_peered":"2024-04-26T11:13:38.412724+0000","last_clean":"2024-04-26T11:13:38.412724+0000","last_became_active":"2024-04-26T11:13:12.493447+0000","last_became_peered":"2024-04-26T11:13:12.493447+0000","last_unstale":"2024-04-26T11:13:38.412724+0000","last_undegraded":"2024-04-26T11:13:38.412724+0000","last_fullsized":"2024-04-26T11:13:38.412724+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:52.644533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295676+0000","last_change":"2024-04-26T11:13:12.912553+0000","last_active":"2024-04-26T11:13:38.295676+0000","last_peered":"2024-04-26T11:13:38.295676+0000","last_clean":"2024-04-26T11:13:38.295676+0000","last_became_active":"2024-04-26T11:13:12.912022+0000","last_became_peered":"2024-04-26T11:13:12.912022+0000","last_unstale":"2024-04-26T11:13:38.295676+0000","last_undegraded":"2024-04-26T11:13:38.295676+0000","last_fullsized":"2024-04-26T11:13:38.295676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"19'901","reported_seq":912,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:13:41.453853+0000","last_change":"2024-04-26T11:13:37.300834+0000","last_active":"2024-04-26T11:13:41.453853+0000","last_peered":"2024-04-26T11:13:41.453853+0000","last_clean":"2024-04-26T11:13:41.453853+0000","last_became_active":"2024-04-26T11:13:37.300648+0000","last_became_peered":"2024-04-26T11:13:37.300648+0000","last_unstale":"2024-04-26T11:13:41.453853+0000","last_undegraded":"2024-04-26T11:13:41.453853+0000","last_fullsized":"2024-04-26T11:13:41.453853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_clean_scrub_stamp":"2024-04-26T11:13:36.285985+0000","objects_scrubbed":0,"log_size":901,"log_dups_size":0,"ondisk_log_size":901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:12.795861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59047936,"num_objects":901,"num_object_clones":0,"num_object_copies":1802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":901,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":901,"num_write_kb":57664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295136+0000","last_change":"2024-04-26T11:13:08.113650+0000","last_active":"2024-04-26T11:13:38.295136+0000","last_peered":"2024-04-26T11:13:38.295136+0000","last_clean":"2024-04-26T11:13:38.295136+0000","last_became_active":"2024-04-26T11:13:08.113394+0000","last_became_peered":"2024-04-26T11:13:08.113394+0000","last_unstale":"2024-04-26T11:13:38.295136+0000","last_undegraded":"2024-04-26T11:13:38.295136+0000","last_fullsized":"2024-04-26T11:13:38.295136+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:44.642172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295232+0000","last_change":"2024-04-26T11:13:12.492888+0000","last_active":"2024-04-26T11:13:38.295232+0000","last_peered":"2024-04-26T11:13:38.295232+0000","last_clean":"2024-04-26T11:13:38.295232+0000","last_became_active":"2024-04-26T11:13:12.492274+0000","last_became_peered":"2024-04-26T11:13:12.492274+0000","last_unstale":"2024-04-26T11:13:38.295232+0000","last_undegraded":"2024-04-26T11:13:38.295232+0000","last_fullsized":"2024-04-26T11:13:38.295232+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:51.136157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.296029+0000","last_change":"2024-04-26T11:13:12.914599+0000","last_active":"2024-04-26T11:13:38.296029+0000","last_peered":"2024-04-26T11:13:38.296029+0000","last_clean":"2024-04-26T11:13:38.296029+0000","last_became_active":"2024-04-26T11:13:12.913916+0000","last_became_peered":"2024-04-26T11:13:12.913916+0000","last_unstale":"2024-04-26T11:13:38.296029+0000","last_undegraded":"2024-04-26T11:13:38.296029+0000","last_fullsized":"2024-04-26T11:13:38.296029+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"19'872","reported_seq":883,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:13:41.454358+0000","last_change":"2024-04-26T11:13:37.297517+0000","last_active":"2024-04-26T11:13:41.454358+0000","last_peered":"2024-04-26T11:13:41.454358+0000","last_clean":"2024-04-26T11:13:41.454358+0000","last_became_active":"2024-04-26T11:13:37.297287+0000","last_became_peered":"2024-04-26T11:13:37.297287+0000","last_unstale":"2024-04-26T11:13:41.454358+0000","last_undegraded":"2024-04-26T11:13:41.454358+0000","last_fullsized":"2024-04-26T11:13:41.454358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_clean_scrub_stamp":"2024-04-26T11:13:36.285985+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:12:38.611018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57147392,"num_objects":872,"num_object_clones":0,"num_object_copies":1744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":872,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":872,"num_write_kb":55808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.412759+0000","last_change":"2024-04-26T11:13:08.112690+0000","last_active":"2024-04-26T11:13:38.412759+0000","last_peered":"2024-04-26T11:13:38.412759+0000","last_clean":"2024-04-26T11:13:38.412759+0000","last_became_active":"2024-04-26T11:13:08.112454+0000","last_became_peered":"2024-04-26T11:13:08.112454+0000","last_unstale":"2024-04-26T11:13:38.412759+0000","last_undegraded":"2024-04-26T11:13:38.412759+0000","last_fullsized":"2024-04-26T11:13:38.412759+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:41.011030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.412537+0000","last_change":"2024-04-26T11:13:08.113419+0000","last_active":"2024-04-26T11:13:38.412537+0000","last_peered":"2024-04-26T11:13:38.412537+0000","last_clean":"2024-04-26T11:13:38.412537+0000","last_became_active":"2024-04-26T11:13:08.113154+0000","last_became_peered":"2024-04-26T11:13:08.113154+0000","last_unstale":"2024-04-26T11:13:38.412537+0000","last_undegraded":"2024-04-26T11:13:38.412537+0000","last_fullsized":"2024-04-26T11:13:38.412537+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:36.482001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295312+0000","last_change":"2024-04-26T11:13:12.491278+0000","last_active":"2024-04-26T11:13:38.295312+0000","last_peered":"2024-04-26T11:13:38.295312+0000","last_clean":"2024-04-26T11:13:38.295312+0000","last_became_active":"2024-04-26T11:13:12.488223+0000","last_became_peered":"2024-04-26T11:13:12.488223+0000","last_unstale":"2024-04-26T11:13:38.295312+0000","last_undegraded":"2024-04-26T11:13:38.295312+0000","last_fullsized":"2024-04-26T11:13:38.295312+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:05.413010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.413657+0000","last_change":"2024-04-26T11:13:12.920834+0000","last_active":"2024-04-26T11:13:38.413657+0000","last_peered":"2024-04-26T11:13:38.413657+0000","last_clean":"2024-04-26T11:13:38.413657+0000","last_became_active":"2024-04-26T11:13:12.917055+0000","last_became_peered":"2024-04-26T11:13:12.917055+0000","last_unstale":"2024-04-26T11:13:38.413657+0000","last_undegraded":"2024-04-26T11:13:38.413657+0000","last_fullsized":"2024-04-26T11:13:38.413657+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:11.313582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"19'864","reported_seq":875,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:13:41.453644+0000","last_change":"2024-04-26T11:13:37.300512+0000","last_active":"2024-04-26T11:13:41.453644+0000","last_peered":"2024-04-26T11:13:41.453644+0000","last_clean":"2024-04-26T11:13:41.453644+0000","last_became_active":"2024-04-26T11:13:37.300041+0000","last_became_peered":"2024-04-26T11:13:37.300041+0000","last_unstale":"2024-04-26T11:13:41.453644+0000","last_undegraded":"2024-04-26T11:13:41.453644+0000","last_fullsized":"2024-04-26T11:13:41.453644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_clean_scrub_stamp":"2024-04-26T11:13:36.285985+0000","objects_scrubbed":0,"log_size":864,"log_dups_size":0,"ondisk_log_size":864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:39.735019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56623104,"num_objects":864,"num_object_clones":0,"num_object_copies":1728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":864,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":864,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.412529+0000","last_change":"2024-04-26T11:13:08.113497+0000","last_active":"2024-04-26T11:13:38.412529+0000","last_peered":"2024-04-26T11:13:38.412529+0000","last_clean":"2024-04-26T11:13:38.412529+0000","last_became_active":"2024-04-26T11:13:08.113237+0000","last_became_peered":"2024-04-26T11:13:08.113237+0000","last_unstale":"2024-04-26T11:13:38.412529+0000","last_undegraded":"2024-04-26T11:13:38.412529+0000","last_fullsized":"2024-04-26T11:13:38.412529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:26:52.240361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295042+0000","last_change":"2024-04-26T11:13:12.491936+0000","last_active":"2024-04-26T11:13:38.295042+0000","last_peered":"2024-04-26T11:13:38.295042+0000","last_clean":"2024-04-26T11:13:38.295042+0000","last_became_active":"2024-04-26T11:13:12.491533+0000","last_became_peered":"2024-04-26T11:13:12.491533+0000","last_unstale":"2024-04-26T11:13:38.295042+0000","last_undegraded":"2024-04-26T11:13:38.295042+0000","last_fullsized":"2024-04-26T11:13:38.295042+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:54:13.320025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295870+0000","last_change":"2024-04-26T11:13:12.918648+0000","last_active":"2024-04-26T11:13:38.295870+0000","last_peered":"2024-04-26T11:13:38.295870+0000","last_clean":"2024-04-26T11:13:38.295870+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:13:38.295870+0000","last_undegraded":"2024-04-26T11:13:38.295870+0000","last_fullsized":"2024-04-26T11:13:38.295870+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"19'843","reported_seq":854,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:13:41.457992+0000","last_change":"2024-04-26T11:13:37.301021+0000","last_active":"2024-04-26T11:13:41.457992+0000","last_peered":"2024-04-26T11:13:41.457992+0000","last_clean":"2024-04-26T11:13:41.457992+0000","last_became_active":"2024-04-26T11:13:37.300038+0000","last_became_peered":"2024-04-26T11:13:37.300038+0000","last_unstale":"2024-04-26T11:13:41.457992+0000","last_undegraded":"2024-04-26T11:13:41.457992+0000","last_fullsized":"2024-04-26T11:13:41.457992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_clean_scrub_stamp":"2024-04-26T11:13:36.285985+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:59.869130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55246848,"num_objects":843,"num_object_clones":0,"num_object_copies":1686,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":843,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":843,"num_write_kb":53952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.296031+0000","last_change":"2024-04-26T11:13:08.110433+0000","last_active":"2024-04-26T11:13:38.296031+0000","last_peered":"2024-04-26T11:13:38.296031+0000","last_clean":"2024-04-26T11:13:38.296031+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:13:38.296031+0000","last_undegraded":"2024-04-26T11:13:38.296031+0000","last_fullsized":"2024-04-26T11:13:38.296031+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295784+0000","last_change":"2024-04-26T11:13:12.491648+0000","last_active":"2024-04-26T11:13:38.295784+0000","last_peered":"2024-04-26T11:13:38.295784+0000","last_clean":"2024-04-26T11:13:38.295784+0000","last_became_active":"2024-04-26T11:13:12.488599+0000","last_became_peered":"2024-04-26T11:13:12.488599+0000","last_unstale":"2024-04-26T11:13:38.295784+0000","last_undegraded":"2024-04-26T11:13:38.295784+0000","last_fullsized":"2024-04-26T11:13:38.295784+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:45.374565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295409+0000","last_change":"2024-04-26T11:13:12.920065+0000","last_active":"2024-04-26T11:13:38.295409+0000","last_peered":"2024-04-26T11:13:38.295409+0000","last_clean":"2024-04-26T11:13:38.295409+0000","last_became_active":"2024-04-26T11:13:12.919741+0000","last_became_peered":"2024-04-26T11:13:12.919741+0000","last_unstale":"2024-04-26T11:13:38.295409+0000","last_undegraded":"2024-04-26T11:13:38.295409+0000","last_fullsized":"2024-04-26T11:13:38.295409+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:20.837217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"19'883","reported_seq":894,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:13:41.456236+0000","last_change":"2024-04-26T11:13:37.300751+0000","last_active":"2024-04-26T11:13:41.456236+0000","last_peered":"2024-04-26T11:13:41.456236+0000","last_clean":"2024-04-26T11:13:41.456236+0000","last_became_active":"2024-04-26T11:13:37.300060+0000","last_became_peered":"2024-04-26T11:13:37.300060+0000","last_unstale":"2024-04-26T11:13:41.456236+0000","last_undegraded":"2024-04-26T11:13:41.456236+0000","last_fullsized":"2024-04-26T11:13:41.456236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_clean_scrub_stamp":"2024-04-26T11:13:36.285985+0000","objects_scrubbed":0,"log_size":883,"log_dups_size":0,"ondisk_log_size":883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:54.952519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57868288,"num_objects":883,"num_object_clones":0,"num_object_copies":1766,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":883,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":883,"num_write_kb":56512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295929+0000","last_change":"2024-04-26T11:13:12.488576+0000","last_active":"2024-04-26T11:13:38.295929+0000","last_peered":"2024-04-26T11:13:38.295929+0000","last_clean":"2024-04-26T11:13:38.295929+0000","last_became_active":"2024-04-26T11:13:12.488248+0000","last_became_peered":"2024-04-26T11:13:12.488248+0000","last_unstale":"2024-04-26T11:13:38.295929+0000","last_undegraded":"2024-04-26T11:13:38.295929+0000","last_fullsized":"2024-04-26T11:13:38.295929+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:46:48.928740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295960+0000","last_change":"2024-04-26T11:13:08.113157+0000","last_active":"2024-04-26T11:13:38.295960+0000","last_peered":"2024-04-26T11:13:38.295960+0000","last_clean":"2024-04-26T11:13:38.295960+0000","last_became_active":"2024-04-26T11:13:08.112788+0000","last_became_peered":"2024-04-26T11:13:08.112788+0000","last_unstale":"2024-04-26T11:13:38.295960+0000","last_undegraded":"2024-04-26T11:13:38.295960+0000","last_fullsized":"2024-04-26T11:13:38.295960+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:14.606433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295218+0000","last_change":"2024-04-26T11:13:12.919100+0000","last_active":"2024-04-26T11:13:38.295218+0000","last_peered":"2024-04-26T11:13:38.295218+0000","last_clean":"2024-04-26T11:13:38.295218+0000","last_became_active":"2024-04-26T11:13:12.918816+0000","last_became_peered":"2024-04-26T11:13:12.918816+0000","last_unstale":"2024-04-26T11:13:38.295218+0000","last_undegraded":"2024-04-26T11:13:38.295218+0000","last_fullsized":"2024-04-26T11:13:38.295218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"19'913","reported_seq":924,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T11:13:41.454393+0000","last_change":"2024-04-26T11:13:37.298321+0000","last_active":"2024-04-26T11:13:41.454393+0000","last_peered":"2024-04-26T11:13:41.454393+0000","last_clean":"2024-04-26T11:13:41.454393+0000","last_became_active":"2024-04-26T11:13:37.298125+0000","last_became_peered":"2024-04-26T11:13:37.298125+0000","last_unstale":"2024-04-26T11:13:41.454393+0000","last_undegraded":"2024-04-26T11:13:41.454393+0000","last_fullsized":"2024-04-26T11:13:41.454393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:36.285985+0000","last_clean_scrub_stamp":"2024-04-26T11:13:36.285985+0000","objects_scrubbed":0,"log_size":913,"log_dups_size":0,"ondisk_log_size":913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:54.579722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59834368,"num_objects":913,"num_object_clones":0,"num_object_copies":1826,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":913,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":913,"num_write_kb":58432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.413741+0000","last_change":"2024-04-26T11:13:08.113505+0000","last_active":"2024-04-26T11:13:38.413741+0000","last_peered":"2024-04-26T11:13:38.413741+0000","last_clean":"2024-04-26T11:13:38.413741+0000","last_became_active":"2024-04-26T11:13:08.113224+0000","last_became_peered":"2024-04-26T11:13:08.113224+0000","last_unstale":"2024-04-26T11:13:38.413741+0000","last_undegraded":"2024-04-26T11:13:38.413741+0000","last_fullsized":"2024-04-26T11:13:38.413741+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:04:16.157275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295834+0000","last_change":"2024-04-26T11:13:12.490249+0000","last_active":"2024-04-26T11:13:38.295834+0000","last_peered":"2024-04-26T11:13:38.295834+0000","last_clean":"2024-04-26T11:13:38.295834+0000","last_became_active":"2024-04-26T11:13:12.488836+0000","last_became_peered":"2024-04-26T11:13:12.488836+0000","last_unstale":"2024-04-26T11:13:38.295834+0000","last_undegraded":"2024-04-26T11:13:38.295834+0000","last_fullsized":"2024-04-26T11:13:38.295834+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:12.581788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295311+0000","last_change":"2024-04-26T11:13:12.913955+0000","last_active":"2024-04-26T11:13:38.295311+0000","last_peered":"2024-04-26T11:13:38.295311+0000","last_clean":"2024-04-26T11:13:38.295311+0000","last_became_active":"2024-04-26T11:13:12.913037+0000","last_became_peered":"2024-04-26T11:13:12.913037+0000","last_unstale":"2024-04-26T11:13:38.295311+0000","last_undegraded":"2024-04-26T11:13:38.295311+0000","last_fullsized":"2024-04-26T11:13:38.295311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:11.313582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295460+0000","last_change":"2024-04-26T11:13:12.493479+0000","last_active":"2024-04-26T11:13:38.295460+0000","last_peered":"2024-04-26T11:13:38.295460+0000","last_clean":"2024-04-26T11:13:38.295460+0000","last_became_active":"2024-04-26T11:13:12.493174+0000","last_became_peered":"2024-04-26T11:13:12.493174+0000","last_unstale":"2024-04-26T11:13:38.295460+0000","last_undegraded":"2024-04-26T11:13:38.295460+0000","last_fullsized":"2024-04-26T11:13:38.295460+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:05.413010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295891+0000","last_change":"2024-04-26T11:13:12.917812+0000","last_active":"2024-04-26T11:13:38.295891+0000","last_peered":"2024-04-26T11:13:38.295891+0000","last_clean":"2024-04-26T11:13:38.295891+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:13:38.295891+0000","last_undegraded":"2024-04-26T11:13:38.295891+0000","last_fullsized":"2024-04-26T11:13:38.295891+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.413205+0000","last_change":"2024-04-26T11:13:12.493351+0000","last_active":"2024-04-26T11:13:38.413205+0000","last_peered":"2024-04-26T11:13:38.413205+0000","last_clean":"2024-04-26T11:13:38.413205+0000","last_became_active":"2024-04-26T11:13:12.492923+0000","last_became_peered":"2024-04-26T11:13:12.492923+0000","last_unstale":"2024-04-26T11:13:38.413205+0000","last_undegraded":"2024-04-26T11:13:38.413205+0000","last_fullsized":"2024-04-26T11:13:38.413205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:14:53.444842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.412669+0000","last_change":"2024-04-26T11:13:12.918383+0000","last_active":"2024-04-26T11:13:38.412669+0000","last_peered":"2024-04-26T11:13:38.412669+0000","last_clean":"2024-04-26T11:13:38.412669+0000","last_became_active":"2024-04-26T11:13:12.917098+0000","last_became_peered":"2024-04-26T11:13:12.917098+0000","last_unstale":"2024-04-26T11:13:38.412669+0000","last_undegraded":"2024-04-26T11:13:38.412669+0000","last_fullsized":"2024-04-26T11:13:38.412669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:08:43.397887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295847+0000","last_change":"2024-04-26T11:13:12.493387+0000","last_active":"2024-04-26T11:13:38.295847+0000","last_peered":"2024-04-26T11:13:38.295847+0000","last_clean":"2024-04-26T11:13:38.295847+0000","last_became_active":"2024-04-26T11:13:12.493158+0000","last_became_peered":"2024-04-26T11:13:12.493158+0000","last_unstale":"2024-04-26T11:13:38.295847+0000","last_undegraded":"2024-04-26T11:13:38.295847+0000","last_fullsized":"2024-04-26T11:13:38.295847+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:56.477041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.412985+0000","last_change":"2024-04-26T11:13:12.920137+0000","last_active":"2024-04-26T11:13:38.412985+0000","last_peered":"2024-04-26T11:13:38.412985+0000","last_clean":"2024-04-26T11:13:38.412985+0000","last_became_active":"2024-04-26T11:13:12.919020+0000","last_became_peered":"2024-04-26T11:13:12.919020+0000","last_unstale":"2024-04-26T11:13:38.412985+0000","last_undegraded":"2024-04-26T11:13:38.412985+0000","last_fullsized":"2024-04-26T11:13:38.412985+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:57:47.014768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.296041+0000","last_change":"2024-04-26T11:13:12.490017+0000","last_active":"2024-04-26T11:13:38.296041+0000","last_peered":"2024-04-26T11:13:38.296041+0000","last_clean":"2024-04-26T11:13:38.296041+0000","last_became_active":"2024-04-26T11:13:12.488282+0000","last_became_peered":"2024-04-26T11:13:12.488282+0000","last_unstale":"2024-04-26T11:13:38.296041+0000","last_undegraded":"2024-04-26T11:13:38.296041+0000","last_fullsized":"2024-04-26T11:13:38.296041+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:20.176849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295427+0000","last_change":"2024-04-26T11:13:12.917763+0000","last_active":"2024-04-26T11:13:38.295427+0000","last_peered":"2024-04-26T11:13:38.295427+0000","last_clean":"2024-04-26T11:13:38.295427+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:13:38.295427+0000","last_undegraded":"2024-04-26T11:13:38.295427+0000","last_fullsized":"2024-04-26T11:13:38.295427+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295984+0000","last_change":"2024-04-26T11:13:12.491798+0000","last_active":"2024-04-26T11:13:38.295984+0000","last_peered":"2024-04-26T11:13:38.295984+0000","last_clean":"2024-04-26T11:13:38.295984+0000","last_became_active":"2024-04-26T11:13:12.490582+0000","last_became_peered":"2024-04-26T11:13:12.490582+0000","last_unstale":"2024-04-26T11:13:38.295984+0000","last_undegraded":"2024-04-26T11:13:38.295984+0000","last_fullsized":"2024-04-26T11:13:38.295984+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:10:46.082467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.412787+0000","last_change":"2024-04-26T11:13:12.914549+0000","last_active":"2024-04-26T11:13:38.412787+0000","last_peered":"2024-04-26T11:13:38.412787+0000","last_clean":"2024-04-26T11:13:38.412787+0000","last_became_active":"2024-04-26T11:13:12.913041+0000","last_became_peered":"2024-04-26T11:13:12.913041+0000","last_unstale":"2024-04-26T11:13:38.412787+0000","last_undegraded":"2024-04-26T11:13:38.412787+0000","last_fullsized":"2024-04-26T11:13:38.412787+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.412824+0000","last_change":"2024-04-26T11:13:12.916942+0000","last_active":"2024-04-26T11:13:38.412824+0000","last_peered":"2024-04-26T11:13:38.412824+0000","last_clean":"2024-04-26T11:13:38.412824+0000","last_became_active":"2024-04-26T11:13:12.916144+0000","last_became_peered":"2024-04-26T11:13:12.916144+0000","last_unstale":"2024-04-26T11:13:38.412824+0000","last_undegraded":"2024-04-26T11:13:38.412824+0000","last_fullsized":"2024-04-26T11:13:38.412824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:46.610126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295104+0000","last_change":"2024-04-26T11:13:12.913826+0000","last_active":"2024-04-26T11:13:38.295104+0000","last_peered":"2024-04-26T11:13:38.295104+0000","last_clean":"2024-04-26T11:13:38.295104+0000","last_became_active":"2024-04-26T11:13:12.912911+0000","last_became_peered":"2024-04-26T11:13:12.912911+0000","last_unstale":"2024-04-26T11:13:38.295104+0000","last_undegraded":"2024-04-26T11:13:38.295104+0000","last_fullsized":"2024-04-26T11:13:38.295104+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:10.887079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295575+0000","last_change":"2024-04-26T11:13:12.921818+0000","last_active":"2024-04-26T11:13:38.295575+0000","last_peered":"2024-04-26T11:13:38.295575+0000","last_clean":"2024-04-26T11:13:38.295575+0000","last_became_active":"2024-04-26T11:13:12.921526+0000","last_became_peered":"2024-04-26T11:13:12.921526+0000","last_unstale":"2024-04-26T11:13:38.295575+0000","last_undegraded":"2024-04-26T11:13:38.295575+0000","last_fullsized":"2024-04-26T11:13:38.295575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:47.958725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295610+0000","last_change":"2024-04-26T11:13:12.912731+0000","last_active":"2024-04-26T11:13:38.295610+0000","last_peered":"2024-04-26T11:13:38.295610+0000","last_clean":"2024-04-26T11:13:38.295610+0000","last_became_active":"2024-04-26T11:13:12.911522+0000","last_became_peered":"2024-04-26T11:13:12.911522+0000","last_unstale":"2024-04-26T11:13:38.295610+0000","last_undegraded":"2024-04-26T11:13:38.295610+0000","last_fullsized":"2024-04-26T11:13:38.295610+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:46.610126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:13:38.295840+0000","last_change":"2024-04-26T11:13:12.919750+0000","last_active":"2024-04-26T11:13:38.295840+0000","last_peered":"2024-04-26T11:13:38.295840+0000","last_clean":"2024-04-26T11:13:38.295840+0000","last_became_active":"2024-04-26T11:13:12.919116+0000","last_became_peered":"2024-04-26T11:13:12.919116+0000","last_unstale":"2024-04-26T11:13:38.295840+0000","last_undegraded":"2024-04-26T11:13:38.295840+0000","last_fullsized":"2024-04-26T11:13:38.295840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:10.887079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":917110784,"num_objects":13994,"num_object_clones":0,"num_object_copies":27988,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13994,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13994,"num_write_kb":895616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1835270144,"data_stored":1835270144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13994,"ondisk_log_size":13994,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":519700,"kb_used_data":488584,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93852140,"statfs":{"total":96636764160,"available":96104591360,"internally_reserved":0,"allocated":500310016,"data_stored":500171813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":563232,"kb_used_data":532116,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93808608,"statfs":{"total":96636764160,"available":96060014592,"internally_reserved":0,"allocated":544886784,"data_stored":544738020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,2,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738378,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":698760,"kb_used_data":671736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93673080,"statfs":{"total":96636764160,"available":95921233920,"internally_reserved":0,"allocated":687857664,"data_stored":687735282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,3,1,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.217}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":568655872,"data_stored":568655872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":743833600,"data_stored":743833600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":522780672,"data_stored":522780672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:13:48.173 INFO:tasks.thrashosds.thrasher:Setting 5.d to [1, 2, 0] 2024-04-26T11:13:48.173 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '5.d', '1', '2', '0'] 2024-04-26T11:13:48.173 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 5.d 1 2 0 2024-04-26T11:13:48.220 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:13:48.221 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:13:48.221 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:13:48.221 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:13:48.221 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:13:48.235 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:13:48.236 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:48.233+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:48.325 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:13:48.336 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:48.334+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:48.410 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 10 16 35457 35441 221.489 173.75 0.00446363 0.00451156 2024-04-26T11:13:48.429 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:13:48.429 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:13:48.429 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:13:48.429 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:13:48.429 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:18846 5.3 5:c95f8f7f:::benchmark_data_smithi029_44842_object18845:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T11:13:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:42.872799+0000", 2024-04-26T11:13:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 5.5529845900000003, 2024-04-26T11:13:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.014816975, 2024-04-26T11:13:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 18846 2024-04-26T11:13:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.872799+0000", 2024-04-26T11:13:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.872799+0000", 2024-04-26T11:13:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.872798+0000", 2024-04-26T11:13:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.872859+0000", 2024-04-26T11:13:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1165000000000001e-05 2024-04-26T11:13:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.872864+0000", 2024-04-26T11:13:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4989999999999996e-06 2024-04-26T11:13:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.872867+0000", 2024-04-26T11:13:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3280000000000002e-06 2024-04-26T11:13:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.877233+0000", 2024-04-26T11:13:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.004366361 2024-04-26T11:13:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.877306+0000", 2024-04-26T11:13:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2935000000000006e-05 2024-04-26T11:13:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.877392+0000", 2024-04-26T11:13:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5982000000000004e-05 2024-04-26T11:13:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.882799+0000", 2024-04-26T11:13:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0054068930000000003 2024-04-26T11:13:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.887562+0000", 2024-04-26T11:13:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0047625080000000004 2024-04-26T11:13:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.887593+0000", 2024-04-26T11:13:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0868999999999999e-05 2024-04-26T11:13:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.887615+0000", 2024-04-26T11:13:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2849000000000001e-05 2024-04-26T11:13:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:18848 5.3 5:c502f67d:::benchmark_data_smithi029_44842_object18847:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T11:13:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:42.872993+0000", 2024-04-26T11:13:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 5.5527897350000002, 2024-04-26T11:13:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.014682486999999999, 2024-04-26T11:13:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 18848 2024-04-26T11:13:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.872993+0000", 2024-04-26T11:13:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.872993+0000", 2024-04-26T11:13:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.872993+0000", 2024-04-26T11:13:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.873055+0000", 2024-04-26T11:13:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2243999999999996e-05 2024-04-26T11:13:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.873060+0000", 2024-04-26T11:13:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2739999999999998e-06 2024-04-26T11:13:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.873064+0000", 2024-04-26T11:13:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0599999999999999e-06 2024-04-26T11:13:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.879904+0000", 2024-04-26T11:13:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0068406609999999996 2024-04-26T11:13:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.880040+0000", 2024-04-26T11:13:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013589400000000001 2024-04-26T11:13:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.880181+0000", 2024-04-26T11:13:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014134600000000001 2024-04-26T11:13:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.883242+0000", 2024-04-26T11:13:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0030607389999999998 2024-04-26T11:13:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.887636+0000", 2024-04-26T11:13:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0043937910000000002 2024-04-26T11:13:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.887659+0000", 2024-04-26T11:13:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3027000000000002e-05 2024-04-26T11:13:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.887676+0000", 2024-04-26T11:13:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6880000000000001e-05 2024-04-26T11:13:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:18854 5.3 5:c9f544d2:::benchmark_data_smithi029_44842_object18853:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T11:13:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:42.875830+0000", 2024-04-26T11:13:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 5.5499531820000003, 2024-04-26T11:13:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.014783163, 2024-04-26T11:13:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 18854 2024-04-26T11:13:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.875830+0000", 2024-04-26T11:13:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.875830+0000", 2024-04-26T11:13:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.875829+0000", 2024-04-26T11:13:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.875898+0000", 2024-04-26T11:13:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8206000000000004e-05 2024-04-26T11:13:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.875904+0000", 2024-04-26T11:13:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6309999999999997e-06 2024-04-26T11:13:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.875910+0000", 2024-04-26T11:13:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9309999999999996e-06 2024-04-26T11:13:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.880816+0000", 2024-04-26T11:13:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0049059280000000004 2024-04-26T11:13:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.880885+0000", 2024-04-26T11:13:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9401999999999997e-05 2024-04-26T11:13:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.880962+0000", 2024-04-26T11:13:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7065999999999997e-05 2024-04-26T11:13:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.883260+0000", 2024-04-26T11:13:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022976120000000001 2024-04-26T11:13:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.890549+0000", 2024-04-26T11:13:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0072887050000000004 2024-04-26T11:13:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.890580+0000", 2024-04-26T11:13:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1380000000000001e-05 2024-04-26T11:13:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.890613+0000", 2024-04-26T11:13:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2913000000000001e-05 2024-04-26T11:13:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:20317 5.3 5:c8d247a8:::benchmark_data_smithi029_44842_object20316:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:43.342907+0000", 2024-04-26T11:13:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 5.0828760969999998, 2024-04-26T11:13:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.013361530999999999, 2024-04-26T11:13:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 20317 2024-04-26T11:13:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.342907+0000", 2024-04-26T11:13:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.342907+0000", 2024-04-26T11:13:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.342906+0000", 2024-04-26T11:13:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.343036+0000", 2024-04-26T11:13:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956600000000001 2024-04-26T11:13:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.343043+0000", 2024-04-26T11:13:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5599999999999996e-06 2024-04-26T11:13:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.343049+0000", 2024-04-26T11:13:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4909999999999996e-06 2024-04-26T11:13:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.343827+0000", 2024-04-26T11:13:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00077799599999999998 2024-04-26T11:13:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.343950+0000", 2024-04-26T11:13:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012344100000000001 2024-04-26T11:13:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.344094+0000", 2024-04-26T11:13:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000143146 2024-04-26T11:13:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.346109+0000", 2024-04-26T11:13:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020150810000000002 2024-04-26T11:13:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.356185+0000", 2024-04-26T11:13:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.010076241 2024-04-26T11:13:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.356232+0000", 2024-04-26T11:13:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6742000000000001e-05 2024-04-26T11:13:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:43.356269+0000", 2024-04-26T11:13:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6940999999999997e-05 2024-04-26T11:13:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:24654 5.a 5:55b15ace:::benchmark_data_smithi029_44842_object24653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:44.719961+0000", 2024-04-26T11:13:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 3.7058218080000001, 2024-04-26T11:13:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.014476233999999999, 2024-04-26T11:13:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 24654 2024-04-26T11:13:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.719961+0000", 2024-04-26T11:13:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.719961+0000", 2024-04-26T11:13:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.719960+0000", 2024-04-26T11:13:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.720064+0000", 2024-04-26T11:13:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010403699999999999 2024-04-26T11:13:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.720076+0000", 2024-04-26T11:13:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1657e-05 2024-04-26T11:13:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.720083+0000", 2024-04-26T11:13:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2139999999999999e-06 2024-04-26T11:13:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.720112+0000", 2024-04-26T11:13:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8588000000000001e-05 2024-04-26T11:13:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.720214+0000", 2024-04-26T11:13:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000101745 2024-04-26T11:13:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.720314+0000", 2024-04-26T11:13:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100822 2024-04-26T11:13:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.722669+0000", 2024-04-26T11:13:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0023544870000000002 2024-04-26T11:13:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.734344+0000", 2024-04-26T11:13:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011675504999999999 2024-04-26T11:13:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.734412+0000", 2024-04-26T11:13:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7432000000000001e-05 2024-04-26T11:13:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.734438+0000", 2024-04-26T11:13:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5734000000000001e-05 2024-04-26T11:13:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:24658 5.a 5:5461cfe5:::benchmark_data_smithi029_44842_object24657:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:44.720427+0000", 2024-04-26T11:13:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 3.7053559050000002, 2024-04-26T11:13:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.014067728999999999, 2024-04-26T11:13:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 24658 2024-04-26T11:13:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.720427+0000", 2024-04-26T11:13:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.720427+0000", 2024-04-26T11:13:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.720426+0000", 2024-04-26T11:13:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.720484+0000", 2024-04-26T11:13:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7432999999999997e-05 2024-04-26T11:13:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.720498+0000", 2024-04-26T11:13:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4761e-05 2024-04-26T11:13:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.720506+0000", 2024-04-26T11:13:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3590000000000002e-06 2024-04-26T11:13:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.722693+0000", 2024-04-26T11:13:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0021867670000000001 2024-04-26T11:13:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.722796+0000", 2024-04-26T11:13:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000103065 2024-04-26T11:13:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.722904+0000", 2024-04-26T11:13:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010819099999999999 2024-04-26T11:13:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.731810+0000", 2024-04-26T11:13:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089065900000000007 2024-04-26T11:13:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.734442+0000", 2024-04-26T11:13:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026319030000000001 2024-04-26T11:13:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.734476+0000", 2024-04-26T11:13:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3339e-05 2024-04-26T11:13:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.734495+0000", 2024-04-26T11:13:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9228e-05 2024-04-26T11:13:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:24662 5.a 5:564f9128:::benchmark_data_smithi029_44842_object24661:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T11:13:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:44.720925+0000", 2024-04-26T11:13:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 3.7048579940000002, 2024-04-26T11:13:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0136127, 2024-04-26T11:13:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 24662 2024-04-26T11:13:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.720925+0000", 2024-04-26T11:13:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.720925+0000", 2024-04-26T11:13:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.720924+0000", 2024-04-26T11:13:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.721037+0000", 2024-04-26T11:13:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000112978 2024-04-26T11:13:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.721046+0000", 2024-04-26T11:13:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9509999999999995e-06 2024-04-26T11:13:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.721053+0000", 2024-04-26T11:13:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9999999999999999e-06 2024-04-26T11:13:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.726130+0000", 2024-04-26T11:13:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0050770099999999999 2024-04-26T11:13:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.726262+0000", 2024-04-26T11:13:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013193699999999999 2024-04-26T11:13:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.726408+0000", 2024-04-26T11:13:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014620799999999999 2024-04-26T11:13:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.731829+0000", 2024-04-26T11:13:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00542064 2024-04-26T11:13:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.734500+0000", 2024-04-26T11:13:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026704739999999999 2024-04-26T11:13:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.734522+0000", 2024-04-26T11:13:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2435000000000001e-05 2024-04-26T11:13:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:44.734538+0000", 2024-04-26T11:13:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5846e-05 2024-04-26T11:13:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:32247 5.c 5:3dd2b787:::benchmark_data_smithi029_44842_object32246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.259409+0000", 2024-04-26T11:13:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 1.1663743449999999, 2024-04-26T11:13:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015090465000000001, 2024-04-26T11:13:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 32247 2024-04-26T11:13:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.259409+0000", 2024-04-26T11:13:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.259409+0000", 2024-04-26T11:13:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.259408+0000", 2024-04-26T11:13:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.259439+0000", 2024-04-26T11:13:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0954999999999998e-05 2024-04-26T11:13:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.259447+0000", 2024-04-26T11:13:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2230000000000007e-06 2024-04-26T11:13:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.259458+0000", 2024-04-26T11:13:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0586e-05 2024-04-26T11:13:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.260834+0000", 2024-04-26T11:13:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00137634 2024-04-26T11:13:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.260957+0000", 2024-04-26T11:13:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012241199999999999 2024-04-26T11:13:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.261091+0000", 2024-04-26T11:13:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000133817 2024-04-26T11:13:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.267473+0000", 2024-04-26T11:13:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0063827119999999996 2024-04-26T11:13:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.274410+0000", 2024-04-26T11:13:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069364020000000004 2024-04-26T11:13:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.274465+0000", 2024-04-26T11:13:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4987000000000001e-05 2024-04-26T11:13:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.274499+0000", 2024-04-26T11:13:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4554999999999997e-05 2024-04-26T11:13:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:32823 5.6 5:6cacaef4:::benchmark_data_smithi029_44842_object32822:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.459516+0000", 2024-04-26T11:13:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.96626752000000005, 2024-04-26T11:13:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.01540511, 2024-04-26T11:13:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 32823 2024-04-26T11:13:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.459516+0000", 2024-04-26T11:13:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.459516+0000", 2024-04-26T11:13:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.459515+0000", 2024-04-26T11:13:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.459578+0000", 2024-04-26T11:13:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3318999999999995e-05 2024-04-26T11:13:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.459586+0000", 2024-04-26T11:13:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9179999999999994e-06 2024-04-26T11:13:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.459591+0000", 2024-04-26T11:13:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3720000000000004e-06 2024-04-26T11:13:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.460740+0000", 2024-04-26T11:13:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00114861 2024-04-26T11:13:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.460833+0000", 2024-04-26T11:13:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3125e-05 2024-04-26T11:13:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.460973+0000", 2024-04-26T11:13:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013959000000000001 2024-04-26T11:13:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.463853+0000", 2024-04-26T11:13:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002880549 2024-04-26T11:13:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.474871+0000", 2024-04-26T11:13:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011017469 2024-04-26T11:13:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.474899+0000", 2024-04-26T11:13:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8580000000000001e-05 2024-04-26T11:13:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.474921+0000", 2024-04-26T11:13:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1316000000000001e-05 2024-04-26T11:13:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:32829 5.3 5:c26ce371:::benchmark_data_smithi029_44842_object32828:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.461251+0000", 2024-04-26T11:13:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.96453180900000002, 2024-04-26T11:13:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0137149, 2024-04-26T11:13:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 32829 2024-04-26T11:13:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.461251+0000", 2024-04-26T11:13:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.461251+0000", 2024-04-26T11:13:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.461251+0000", 2024-04-26T11:13:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.461316+0000", 2024-04-26T11:13:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5446999999999999e-05 2024-04-26T11:13:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.461324+0000", 2024-04-26T11:13:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8420000000000005e-06 2024-04-26T11:13:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.461329+0000", 2024-04-26T11:13:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.9620000000000001e-06 2024-04-26T11:13:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.461358+0000", 2024-04-26T11:13:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9125e-05 2024-04-26T11:13:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.461466+0000", 2024-04-26T11:13:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000107867 2024-04-26T11:13:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.461577+0000", 2024-04-26T11:13:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011144199999999999 2024-04-26T11:13:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.466314+0000", 2024-04-26T11:13:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.004736596 2024-04-26T11:13:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.474911+0000", 2024-04-26T11:13:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0085966259999999996 2024-04-26T11:13:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.474943+0000", 2024-04-26T11:13:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2144999999999998e-05 2024-04-26T11:13:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.474966+0000", 2024-04-26T11:13:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3439999999999999e-05 2024-04-26T11:13:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:32830 5.6 5:681be729:::benchmark_data_smithi029_44842_object32829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.461612+0000", 2024-04-26T11:13:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.96417110100000003, 2024-04-26T11:13:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.013377933999999999, 2024-04-26T11:13:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 32830 2024-04-26T11:13:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.461612+0000", 2024-04-26T11:13:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.461612+0000", 2024-04-26T11:13:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.461611+0000", 2024-04-26T11:13:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.461698+0000", 2024-04-26T11:13:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6916999999999995e-05 2024-04-26T11:13:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.461706+0000", 2024-04-26T11:13:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4939999999999997e-06 2024-04-26T11:13:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.461715+0000", 2024-04-26T11:13:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1700000000000003e-06 2024-04-26T11:13:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.461782+0000", 2024-04-26T11:13:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7426000000000001e-05 2024-04-26T11:13:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.461920+0000", 2024-04-26T11:13:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013727100000000001 2024-04-26T11:13:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.462028+0000", 2024-04-26T11:13:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000108248 2024-04-26T11:13:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.466424+0000", 2024-04-26T11:13:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0043966559999999997 2024-04-26T11:13:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.474946+0000", 2024-04-26T11:13:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.008521331 2024-04-26T11:13:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.474972+0000", 2024-04-26T11:13:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6336999999999999e-05 2024-04-26T11:13:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.474990+0000", 2024-04-26T11:13:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7762999999999999e-05 2024-04-26T11:13:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:32836 5.5 5:a6fe1943:::benchmark_data_smithi029_44842_object32835:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.461887+0000", 2024-04-26T11:13:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.96389653500000005, 2024-04-26T11:13:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.013462452999999999, 2024-04-26T11:13:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 32836 2024-04-26T11:13:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.461887+0000", 2024-04-26T11:13:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.461887+0000", 2024-04-26T11:13:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.461886+0000", 2024-04-26T11:13:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.462027+0000", 2024-04-26T11:13:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014061299999999999 2024-04-26T11:13:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.462037+0000", 2024-04-26T11:13:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0611999999999999e-05 2024-04-26T11:13:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.462045+0000", 2024-04-26T11:13:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6009999999999997e-06 2024-04-26T11:13:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.462604+0000", 2024-04-26T11:13:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00055893299999999996 2024-04-26T11:13:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.462724+0000", 2024-04-26T11:13:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011967400000000001 2024-04-26T11:13:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.462827+0000", 2024-04-26T11:13:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000103001 2024-04-26T11:13:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.466389+0000", 2024-04-26T11:13:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0035625819999999999 2024-04-26T11:13:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.475303+0000", 2024-04-26T11:13:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089133029999999992 2024-04-26T11:13:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.475330+0000", 2024-04-26T11:13:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7192999999999999e-05 2024-04-26T11:13:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.475349+0000", 2024-04-26T11:13:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9318e-05 2024-04-26T11:13:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:33820 5.3 5:cfcfda3f:::benchmark_data_smithi029_44842_object33819:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.801167+0000", 2024-04-26T11:13:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.62461609500000004, 2024-04-26T11:13:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015083233, 2024-04-26T11:13:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 33820 2024-04-26T11:13:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.801167+0000", 2024-04-26T11:13:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.801167+0000", 2024-04-26T11:13:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.801166+0000", 2024-04-26T11:13:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.801195+0000", 2024-04-26T11:13:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8683e-05 2024-04-26T11:13:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.801202+0000", 2024-04-26T11:13:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3999999999999997e-06 2024-04-26T11:13:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.801205+0000", 2024-04-26T11:13:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9090000000000002e-06 2024-04-26T11:13:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.803951+0000", 2024-04-26T11:13:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0027452520000000001 2024-04-26T11:13:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804073+0000", 2024-04-26T11:13:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012266600000000001 2024-04-26T11:13:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804212+0000", 2024-04-26T11:13:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013901899999999999 2024-04-26T11:13:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.811894+0000", 2024-04-26T11:13:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0076815049999999999 2024-04-26T11:13:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.816195+0000", 2024-04-26T11:13:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.004300669 2024-04-26T11:13:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.816226+0000", 2024-04-26T11:13:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1223000000000002e-05 2024-04-26T11:13:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.816250+0000", 2024-04-26T11:13:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4485e-05 2024-04-26T11:13:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:33826 5.3 5:c4100d2e:::benchmark_data_smithi029_44842_object33825:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.804001+0000", 2024-04-26T11:13:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.62178163399999997, 2024-04-26T11:13:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015655404000000001, 2024-04-26T11:13:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 33826 2024-04-26T11:13:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804001+0000", 2024-04-26T11:13:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804001+0000", 2024-04-26T11:13:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804001+0000", 2024-04-26T11:13:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804056+0000", 2024-04-26T11:13:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5285999999999999e-05 2024-04-26T11:13:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804065+0000", 2024-04-26T11:13:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.8589999999999994e-06 2024-04-26T11:13:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804083+0000", 2024-04-26T11:13:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7949999999999999e-05 2024-04-26T11:13:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.806510+0000", 2024-04-26T11:13:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0024274930000000002 2024-04-26T11:13:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.806622+0000", 2024-04-26T11:13:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000111675 2024-04-26T11:13:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.806769+0000", 2024-04-26T11:13:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000147312 2024-04-26T11:13:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812012+0000", 2024-04-26T11:13:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0052431580000000004 2024-04-26T11:13:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.819580+0000", 2024-04-26T11:13:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0075680410000000002 2024-04-26T11:13:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.819618+0000", 2024-04-26T11:13:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7622e-05 2024-04-26T11:13:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.819657+0000", 2024-04-26T11:13:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8868999999999997e-05 2024-04-26T11:13:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:33827 5.3 5:c927f878:::benchmark_data_smithi029_44842_object33826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.804106+0000", 2024-04-26T11:13:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.62167725200000001, 2024-04-26T11:13:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.017369738999999999, 2024-04-26T11:13:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 33827 2024-04-26T11:13:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804106+0000", 2024-04-26T11:13:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804106+0000", 2024-04-26T11:13:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804105+0000", 2024-04-26T11:13:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804138+0000", 2024-04-26T11:13:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3172e-05 2024-04-26T11:13:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804146+0000", 2024-04-26T11:13:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.204e-06 2024-04-26T11:13:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804153+0000", 2024-04-26T11:13:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0940000000000002e-06 2024-04-26T11:13:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812034+0000", 2024-04-26T11:13:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0078809210000000008 2024-04-26T11:13:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812181+0000", 2024-04-26T11:13:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014739199999999999 2024-04-26T11:13:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812284+0000", 2024-04-26T11:13:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000103453 2024-04-26T11:13:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.814699+0000", 2024-04-26T11:13:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002415043 2024-04-26T11:13:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.821418+0000", 2024-04-26T11:13:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0067184879999999999 2024-04-26T11:13:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.821449+0000", 2024-04-26T11:13:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0763999999999999e-05 2024-04-26T11:13:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.821476+0000", 2024-04-26T11:13:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6889999999999998e-05 2024-04-26T11:13:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:33828 5.b e22/16 5:d3313e8b:::benchmark_data_smithi029_44842_object33827:head v 22'2195, mlcod=22'2192)", 2024-04-26T11:13:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.805391+0000", 2024-04-26T11:13:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.62039166800000001, 2024-04-26T11:13:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016105534000000001, 2024-04-26T11:13:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.805391+0000", 2024-04-26T11:13:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.805391+0000", 2024-04-26T11:13:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.805391+0000", 2024-04-26T11:13:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.805484+0000", 2024-04-26T11:13:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2740999999999999e-05 2024-04-26T11:13:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.805492+0000", 2024-04-26T11:13:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.8799999999999997e-06 2024-04-26T11:13:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.805498+0000", 2024-04-26T11:13:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3510000000000001e-06 2024-04-26T11:13:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.811898+0000", 2024-04-26T11:13:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0063998040000000003 2024-04-26T11:13:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.811919+0000", 2024-04-26T11:13:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1246e-05 2024-04-26T11:13:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.821478+0000", 2024-04-26T11:13:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0095594779999999997 2024-04-26T11:13:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.821497+0000", 2024-04-26T11:13:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8593999999999998e-05 2024-04-26T11:13:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:33832 5.3 5:c924c675:::benchmark_data_smithi029_44842_object33831:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.809663+0000", 2024-04-26T11:13:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.61611971600000004, 2024-04-26T11:13:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.014777222, 2024-04-26T11:13:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 33832 2024-04-26T11:13:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.809663+0000", 2024-04-26T11:13:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.809663+0000", 2024-04-26T11:13:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.809662+0000", 2024-04-26T11:13:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999986 2024-04-26T11:13:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.809769+0000", 2024-04-26T11:13:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000107302 2024-04-26T11:13:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.809779+0000", 2024-04-26T11:13:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.329e-06 2024-04-26T11:13:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.809786+0000", 2024-04-26T11:13:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5859999999999999e-06 2024-04-26T11:13:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.814745+0000", 2024-04-26T11:13:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0049585499999999999 2024-04-26T11:13:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.814903+0000", 2024-04-26T11:13:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015823700000000001 2024-04-26T11:13:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.815060+0000", 2024-04-26T11:13:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015646799999999999 2024-04-26T11:13:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.822994+0000", 2024-04-26T11:13:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0079339159999999992 2024-04-26T11:13:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.824338+0000", 2024-04-26T11:13:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0013444959999999999 2024-04-26T11:13:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.824388+0000", 2024-04-26T11:13:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.9592999999999998e-05 2024-04-26T11:13:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.824441+0000", 2024-04-26T11:13:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2961999999999999e-05 2024-04-26T11:13:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:33839 5.3 5:c4b09ae9:::benchmark_data_smithi029_44842_object33838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.812387+0000", 2024-04-26T11:13:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.61339633400000004, 2024-04-26T11:13:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.013654681, 2024-04-26T11:13:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 33839 2024-04-26T11:13:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812387+0000", 2024-04-26T11:13:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812387+0000", 2024-04-26T11:13:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812386+0000", 2024-04-26T11:13:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812444+0000", 2024-04-26T11:13:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7945000000000002e-05 2024-04-26T11:13:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812471+0000", 2024-04-26T11:13:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6832e-05 2024-04-26T11:13:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812478+0000", 2024-04-26T11:13:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0690000000000004e-06 2024-04-26T11:13:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.816275+0000", 2024-04-26T11:13:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0037970629999999998 2024-04-26T11:13:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.816409+0000", 2024-04-26T11:13:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013410700000000001 2024-04-26T11:13:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.816569+0000", 2024-04-26T11:13:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015965599999999999 2024-04-26T11:13:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.822998+0000", 2024-04-26T11:13:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0064295580000000001 2024-04-26T11:13:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.825991+0000", 2024-04-26T11:13:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002992584 2024-04-26T11:13:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.826018+0000", 2024-04-26T11:13:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6916000000000001e-05 2024-04-26T11:13:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.826041+0000", 2024-04-26T11:13:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3475000000000001e-05 2024-04-26T11:13:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:33845 5.3 5:c066a762:::benchmark_data_smithi029_44842_object33844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.815221+0000", 2024-04-26T11:13:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.61056224599999998, 2024-04-26T11:13:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.014272048000000001, 2024-04-26T11:13:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 33845 2024-04-26T11:13:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.815221+0000", 2024-04-26T11:13:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.815221+0000", 2024-04-26T11:13:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.815220+0000", 2024-04-26T11:13:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.815281+0000", 2024-04-26T11:13:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1432000000000004e-05 2024-04-26T11:13:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.815291+0000", 2024-04-26T11:13:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1050000000000001e-06 2024-04-26T11:13:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.815296+0000", 2024-04-26T11:13:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4519999999999996e-06 2024-04-26T11:13:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.819703+0000", 2024-04-26T11:13:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0044073690000000004 2024-04-26T11:13:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.819836+0000", 2024-04-26T11:13:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000132836 2024-04-26T11:13:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.819974+0000", 2024-04-26T11:13:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013781000000000001 2024-04-26T11:13:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.824144+0000", 2024-04-26T11:13:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0041698380000000004 2024-04-26T11:13:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.829403+0000", 2024-04-26T11:13:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0052588239999999996 2024-04-26T11:13:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.829455+0000", 2024-04-26T11:13:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2621999999999999e-05 2024-04-26T11:13:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.829493+0000", 2024-04-26T11:13:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7586000000000002e-05 2024-04-26T11:13:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:33909 5.6 5:62c61ae4:::benchmark_data_smithi029_44842_object33908:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.840147+0000", 2024-04-26T11:13:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.58563582999999997, 2024-04-26T11:13:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.014211087000000001, 2024-04-26T11:13:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 33909 2024-04-26T11:13:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.840147+0000", 2024-04-26T11:13:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.840147+0000", 2024-04-26T11:13:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.840147+0000", 2024-04-26T11:13:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.840178+0000", 2024-04-26T11:13:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1603999999999998e-05 2024-04-26T11:13:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.840184+0000", 2024-04-26T11:13:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4620000000000004e-06 2024-04-26T11:13:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.840188+0000", 2024-04-26T11:13:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8419999999999998e-06 2024-04-26T11:13:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.847762+0000", 2024-04-26T11:13:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0075741070000000001 2024-04-26T11:13:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.847964+0000", 2024-04-26T11:13:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00020264299999999999 2024-04-26T11:13:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.848125+0000", 2024-04-26T11:13:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00016016899999999999 2024-04-26T11:13:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.851512+0000", 2024-04-26T11:13:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0033875490000000001 2024-04-26T11:13:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.854270+0000", 2024-04-26T11:13:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0027574180000000002 2024-04-26T11:13:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.854316+0000", 2024-04-26T11:13:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6659999999999997e-05 2024-04-26T11:13:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.854358+0000", 2024-04-26T11:13:48.542 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2089000000000003e-05 2024-04-26T11:13:48.542 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.542 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.542 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.542 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:48.542 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:48.542 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:13:48.543 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:48.541+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:48.544 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:13:48.588 INFO:teuthology.orchestra.run.smithi029.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-04-26T11:13:48.590 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T11:13:48.591 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-04-26T11:13:48.644 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:48.642+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:48.715 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:13:48.715 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:13:48.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.715 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:36244 5.4 5:2bd3c5c9:::benchmark_data_smithi029_44842_object36243:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:48.715 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.709884+0000", 2024-04-26T11:13:48.715 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0031387149999999998, 2024-04-26T11:13:48.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0031626190000000002, 2024-04-26T11:13:48.716 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:48.716 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:48.716 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:48.716 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:48.716 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.716 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 36244 2024-04-26T11:13:48.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.716 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:48.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:48.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.709884+0000", 2024-04-26T11:13:48.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:48.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.709884+0000", 2024-04-26T11:13:48.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:48.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.709883+0000", 2024-04-26T11:13:48.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:48.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.709961+0000", 2024-04-26T11:13:48.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7744999999999995e-05 2024-04-26T11:13:48.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:48.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.709970+0000", 2024-04-26T11:13:48.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4619999999999996e-06 2024-04-26T11:13:48.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.709975+0000", 2024-04-26T11:13:48.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8720000000000001e-06 2024-04-26T11:13:48.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:48.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.712621+0000", 2024-04-26T11:13:48.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026468429999999999 2024-04-26T11:13:48.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:48.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.712746+0000", 2024-04-26T11:13:48.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012502499999999999 2024-04-26T11:13:48.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:48.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.712880+0000", 2024-04-26T11:13:48.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000133456 2024-04-26T11:13:48.719 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.719 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:48.719 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.720 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(client.4534.0:36238 5.4 e23/16)", 2024-04-26T11:13:48.720 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.710807+0000", 2024-04-26T11:13:48.720 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0022157790000000002, 2024-04-26T11:13:48.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002310917, 2024-04-26T11:13:48.720 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:48.720 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-26T11:13:48.720 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:48.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:48.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.710807+0000", 2024-04-26T11:13:48.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:48.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.710807+0000", 2024-04-26T11:13:48.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:48.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.710807+0000", 2024-04-26T11:13:48.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967296 2024-04-26T11:13:48.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:48.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.710809+0000", 2024-04-26T11:13:48.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7120000000000001e-06 2024-04-26T11:13:48.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:48.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.710814+0000", 2024-04-26T11:13:48.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.75e-06 2024-04-26T11:13:48.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.710818+0000", 2024-04-26T11:13:48.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1640000000000003e-06 2024-04-26T11:13:48.722 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.722 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:48.722 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.723 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4534.0:36245 5.9 e23/16 5:91438c26:::benchmark_data_smithi029_44842_object36244:head v 23'2279, mlcod=23'2276)", 2024-04-26T11:13:48.723 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.711009+0000", 2024-04-26T11:13:48.723 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0020139619999999998, 2024-04-26T11:13:48.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021606030000000001, 2024-04-26T11:13:48.723 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:48.723 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:13:48.723 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:48.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:48.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711009+0000", 2024-04-26T11:13:48.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:48.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711009+0000", 2024-04-26T11:13:48.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:48.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711008+0000", 2024-04-26T11:13:48.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:48.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711115+0000", 2024-04-26T11:13:48.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106337 2024-04-26T11:13:48.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:48.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711124+0000", 2024-04-26T11:13:48.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.969e-06 2024-04-26T11:13:48.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711129+0000", 2024-04-26T11:13:48.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.882e-06 2024-04-26T11:13:48.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:48.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711158+0000", 2024-04-26T11:13:48.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9505999999999998e-05 2024-04-26T11:13:48.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:48.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711176+0000", 2024-04-26T11:13:48.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8226000000000001e-05 2024-04-26T11:13:48.726 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.726 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:48.726 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.726 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4534.0:36247 5.a e23/16 5:51042fe9:::benchmark_data_smithi029_44842_object36246:head v 23'2360, mlcod=23'2358)", 2024-04-26T11:13:48.726 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.711058+0000", 2024-04-26T11:13:48.726 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0019645880000000002, 2024-04-26T11:13:48.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002146078, 2024-04-26T11:13:48.726 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:48.726 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:13:48.727 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:48.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:48.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711058+0000", 2024-04-26T11:13:48.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:48.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711058+0000", 2024-04-26T11:13:48.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:48.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711058+0000", 2024-04-26T11:13:48.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967296 2024-04-26T11:13:48.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:48.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711196+0000", 2024-04-26T11:13:48.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013793 2024-04-26T11:13:48.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:48.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711205+0000", 2024-04-26T11:13:48.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6859999999999995e-06 2024-04-26T11:13:48.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711210+0000", 2024-04-26T11:13:48.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7230000000000001e-06 2024-04-26T11:13:48.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:48.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711239+0000", 2024-04-26T11:13:48.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8365e-05 2024-04-26T11:13:48.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:48.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711257+0000", 2024-04-26T11:13:48.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8323000000000001e-05 2024-04-26T11:13:48.729 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.729 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:48.730 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.730 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4534.0:36246 5.f e23/16 5:f95315d9:::benchmark_data_smithi029_44842_object36245:head v 23'2270, mlcod=23'2268)", 2024-04-26T11:13:48.730 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.711135+0000", 2024-04-26T11:13:48.730 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.001887515, 2024-04-26T11:13:48.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021040350000000002, 2024-04-26T11:13:48.730 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:48.730 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:13:48.730 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:48.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:48.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711135+0000", 2024-04-26T11:13:48.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:48.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711135+0000", 2024-04-26T11:13:48.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:48.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711135+0000", 2024-04-26T11:13:48.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:48.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711260+0000", 2024-04-26T11:13:48.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012545199999999999 2024-04-26T11:13:48.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:48.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711271+0000", 2024-04-26T11:13:48.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0458999999999999e-05 2024-04-26T11:13:48.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711281+0000", 2024-04-26T11:13:48.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0020000000000001e-05 2024-04-26T11:13:48.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:48.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711323+0000", 2024-04-26T11:13:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1956000000000003e-05 2024-04-26T11:13:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711342+0000", 2024-04-26T11:13:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9415999999999998e-05 2024-04-26T11:13:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:36251 5.4 5.baa8aa94 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.711117+0000", 2024-04-26T11:13:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.001905871, 2024-04-26T11:13:48.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002166472, 2024-04-26T11:13:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-26T11:13:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 36251 2024-04-26T11:13:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711117+0000", 2024-04-26T11:13:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711117+0000", 2024-04-26T11:13:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711116+0000", 2024-04-26T11:13:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711268+0000", 2024-04-26T11:13:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000151497 2024-04-26T11:13:48.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711276+0000", 2024-04-26T11:13:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8429999999999993e-06 2024-04-26T11:13:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.711288+0000", 2024-04-26T11:13:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2217e-05 2024-04-26T11:13:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.737 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4534.0:36249 5.f e23/16 5:f22c4762:::benchmark_data_smithi029_44842_object36248:head v 23'2271, mlcod=23'2268)", 2024-04-26T11:13:48.737 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.712306+0000", 2024-04-26T11:13:48.737 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00071712700000000002, 2024-04-26T11:13:48.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010124380000000001, 2024-04-26T11:13:48.737 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:48.737 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:13:48.737 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.712306+0000", 2024-04-26T11:13:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.712306+0000", 2024-04-26T11:13:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.712305+0000", 2024-04-26T11:13:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.712361+0000", 2024-04-26T11:13:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5452999999999999e-05 2024-04-26T11:13:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.712375+0000", 2024-04-26T11:13:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4027e-05 2024-04-26T11:13:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.712379+0000", 2024-04-26T11:13:48.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.741e-06 2024-04-26T11:13:48.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:48.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.712628+0000", 2024-04-26T11:13:48.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00024879600000000002 2024-04-26T11:13:48.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:48.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.712641+0000", 2024-04-26T11:13:48.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2568000000000001e-05 2024-04-26T11:13:48.740 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4534.0:36250 5.9 e23/16 5:9b3cf4a9:::benchmark_data_smithi029_44842_object36249:head v 23'2280, mlcod=23'2276)", 2024-04-26T11:13:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.712385+0000", 2024-04-26T11:13:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00063735899999999999, 2024-04-26T11:13:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00098956900000000004, 2024-04-26T11:13:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:13:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.712385+0000", 2024-04-26T11:13:48.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.712385+0000", 2024-04-26T11:13:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.712385+0000", 2024-04-26T11:13:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:48.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.712425+0000", 2024-04-26T11:13:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0105999999999999e-05 2024-04-26T11:13:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.712434+0000", 2024-04-26T11:13:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2169999999999994e-06 2024-04-26T11:13:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.712442+0000", 2024-04-26T11:13:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7350000000000002e-06 2024-04-26T11:13:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.712553+0000", 2024-04-26T11:13:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000110262 2024-04-26T11:13:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.712564+0000", 2024-04-26T11:13:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.154e-05 2024-04-26T11:13:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:36252 5.b 5:d6390f64:::benchmark_data_smithi029_44842_object36251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.712969+0000", 2024-04-26T11:13:48.744 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.3774999999999999e-05, 2024-04-26T11:13:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000446971, 2024-04-26T11:13:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 36252 2024-04-26T11:13:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.712969+0000", 2024-04-26T11:13:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.712969+0000", 2024-04-26T11:13:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.712968+0000", 2024-04-26T11:13:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.713061+0000", 2024-04-26T11:13:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2758999999999997e-05 2024-04-26T11:13:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.713072+0000", 2024-04-26T11:13:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1627999999999999e-05 2024-04-26T11:13:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.713081+0000", 2024-04-26T11:13:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5760000000000006e-06 2024-04-26T11:13:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.713123+0000", 2024-04-26T11:13:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1523000000000002e-05 2024-04-26T11:13:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.713251+0000", 2024-04-26T11:13:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128016 2024-04-26T11:13:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.713391+0000", 2024-04-26T11:13:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140125 2024-04-26T11:13:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.748 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(client.4534.0:36243 5.4 e23/16)", 2024-04-26T11:13:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.713103+0000", 2024-04-26T11:13:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9999199, 2024-04-26T11:13:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00035718000000000002, 2024-04-26T11:13:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-26T11:13:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.713103+0000", 2024-04-26T11:13:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.713103+0000", 2024-04-26T11:13:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.713103+0000", 2024-04-26T11:13:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.713106+0000", 2024-04-26T11:13:48.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0450000000000001e-06 2024-04-26T11:13:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.713112+0000", 2024-04-26T11:13:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6510000000000004e-06 2024-04-26T11:13:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.713117+0000", 2024-04-26T11:13:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0130000000000001e-06 2024-04-26T11:13:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:36237 5.d 5:b00397a6:::benchmark_data_smithi029_44842_object36236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.706585+0000", 2024-04-26T11:13:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0064380690000000003, 2024-04-26T11:13:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0069193290000000001, 2024-04-26T11:13:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 36237 2024-04-26T11:13:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:48.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.706585+0000", 2024-04-26T11:13:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.706585+0000", 2024-04-26T11:13:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.706584+0000", 2024-04-26T11:13:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.706625+0000", 2024-04-26T11:13:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1189999999999997e-05 2024-04-26T11:13:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.706640+0000", 2024-04-26T11:13:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4521e-05 2024-04-26T11:13:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.706649+0000", 2024-04-26T11:13:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0850000000000003e-06 2024-04-26T11:13:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.706695+0000", 2024-04-26T11:13:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6113999999999999e-05 2024-04-26T11:13:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.706782+0000", 2024-04-26T11:13:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6978999999999995e-05 2024-04-26T11:13:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.706863+0000", 2024-04-26T11:13:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0907000000000003e-05 2024-04-26T11:13:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.710142+0000", 2024-04-26T11:13:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003279288 2024-04-26T11:13:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:36238 5.4 5:2cc5bf2e:::benchmark_data_smithi029_44842_object36237:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.707336+0000", 2024-04-26T11:13:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0056870499999999999, 2024-04-26T11:13:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062380889999999996, 2024-04-26T11:13:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:48.756 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 36238 2024-04-26T11:13:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707336+0000", 2024-04-26T11:13:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707336+0000", 2024-04-26T11:13:48.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707335+0000", 2024-04-26T11:13:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707404+0000", 2024-04-26T11:13:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8552000000000004e-05 2024-04-26T11:13:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707414+0000", 2024-04-26T11:13:48.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.04e-05 2024-04-26T11:13:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707422+0000", 2024-04-26T11:13:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5700000000000004e-06 2024-04-26T11:13:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707877+0000", 2024-04-26T11:13:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00045534900000000002 2024-04-26T11:13:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:48.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707960+0000", 2024-04-26T11:13:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2675000000000004e-05 2024-04-26T11:13:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.708077+0000", 2024-04-26T11:13:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117156 2024-04-26T11:13:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:36239 5.e 5:7235524b:::benchmark_data_smithi029_44842_object36238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.707861+0000", 2024-04-26T11:13:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0051614269999999997, 2024-04-26T11:13:48.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057583410000000002, 2024-04-26T11:13:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 36239 2024-04-26T11:13:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707861+0000", 2024-04-26T11:13:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707861+0000", 2024-04-26T11:13:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707861+0000", 2024-04-26T11:13:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707880+0000", 2024-04-26T11:13:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9412999999999999e-05 2024-04-26T11:13:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:48.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707887+0000", 2024-04-26T11:13:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2030000000000003e-06 2024-04-26T11:13:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707903+0000", 2024-04-26T11:13:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.588e-05 2024-04-26T11:13:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707946+0000", 2024-04-26T11:13:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3075999999999999e-05 2024-04-26T11:13:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.708069+0000", 2024-04-26T11:13:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000122824 2024-04-26T11:13:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.708205+0000", 2024-04-26T11:13:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013541200000000001 2024-04-26T11:13:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.710882+0000", 2024-04-26T11:13:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002677324 2024-04-26T11:13:48.765 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:36240 5.b 5:d927f9c1:::benchmark_data_smithi029_44842_object36239:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.707912+0000", 2024-04-26T11:13:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0051106980000000003, 2024-04-26T11:13:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057529039999999997, 2024-04-26T11:13:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 36240 2024-04-26T11:13:48.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707912+0000", 2024-04-26T11:13:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707912+0000", 2024-04-26T11:13:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:48.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707912+0000", 2024-04-26T11:13:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707934+0000", 2024-04-26T11:13:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2798000000000001e-05 2024-04-26T11:13:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707941+0000", 2024-04-26T11:13:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8199999999999999e-06 2024-04-26T11:13:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707945+0000", 2024-04-26T11:13:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1529999999999999e-06 2024-04-26T11:13:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707979+0000", 2024-04-26T11:13:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3451000000000002e-05 2024-04-26T11:13:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.708073+0000", 2024-04-26T11:13:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4425000000000005e-05 2024-04-26T11:13:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.708198+0000", 2024-04-26T11:13:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012433600000000001 2024-04-26T11:13:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.710881+0000", 2024-04-26T11:13:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026832380000000001 2024-04-26T11:13:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.771 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:36242 5.0 5:05e57751:::benchmark_data_smithi029_44842_object36241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:48.771 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.707951+0000", 2024-04-26T11:13:48.771 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0050720069999999999, 2024-04-26T11:13:48.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057695519999999998, 2024-04-26T11:13:48.772 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:48.772 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:48.772 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:48.772 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:48.772 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.772 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 36242 2024-04-26T11:13:48.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.772 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:48.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:48.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707951+0000", 2024-04-26T11:13:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707951+0000", 2024-04-26T11:13:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707950+0000", 2024-04-26T11:13:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:48.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707975+0000", 2024-04-26T11:13:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4916e-05 2024-04-26T11:13:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707981+0000", 2024-04-26T11:13:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0859999999999998e-06 2024-04-26T11:13:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.707987+0000", 2024-04-26T11:13:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2469999999999999e-06 2024-04-26T11:13:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.708020+0000", 2024-04-26T11:13:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2931e-05 2024-04-26T11:13:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.708131+0000", 2024-04-26T11:13:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111425 2024-04-26T11:13:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.708253+0000", 2024-04-26T11:13:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012223900000000001 2024-04-26T11:13:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.710844+0000", 2024-04-26T11:13:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025905239999999999 2024-04-26T11:13:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:36243 5.4 5:2f782efd:::benchmark_data_smithi029_44842_object36242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.708041+0000", 2024-04-26T11:13:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0049818120000000004, 2024-04-26T11:13:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057320449999999998, 2024-04-26T11:13:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:48.776 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 36243 2024-04-26T11:13:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.708041+0000", 2024-04-26T11:13:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.708041+0000", 2024-04-26T11:13:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.708040+0000", 2024-04-26T11:13:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.708120+0000", 2024-04-26T11:13:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9864000000000006e-05 2024-04-26T11:13:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.708131+0000", 2024-04-26T11:13:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0523000000000001e-05 2024-04-26T11:13:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.708137+0000", 2024-04-26T11:13:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2400000000000004e-06 2024-04-26T11:13:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.710418+0000", 2024-04-26T11:13:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022814300000000001 2024-04-26T11:13:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.710509+0000", 2024-04-26T11:13:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0350000000000001e-05 2024-04-26T11:13:48.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:48.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:48.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:48.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.710591+0000", 2024-04-26T11:13:48.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2510999999999997e-05 2024-04-26T11:13:48.780 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.780 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:48.780 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.780 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:48.780 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:13:48.780 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 16 2024-04-26T11:13:48.780 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:13:48.782 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:13:48.782 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:48.780+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:48.882 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:48.880+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:48.948 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:13:48.948 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:13:48.948 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:13:48.948 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:13:48.948 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:13:48.963 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:13:49.008 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:49.006+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:49.084 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:49.083+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:49.135 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:13:49.135 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:13:49.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:13:49.135 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:13:49.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.136 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:49.136 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.905682+0000", 2024-04-26T11:13:49.136 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.226236462000003, 2024-04-26T11:13:49.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017168134000000002, 2024-04-26T11:13:49.136 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:49.136 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:49.136 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:49.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:49.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905682+0000", 2024-04-26T11:13:49.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:49.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905682+0000", 2024-04-26T11:13:49.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:49.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905681+0000", 2024-04-26T11:13:49.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:13:49.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:49.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905689+0000", 2024-04-26T11:13:49.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7830000000000004e-06 2024-04-26T11:13:49.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905703+0000", 2024-04-26T11:13:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3322000000000001e-05 2024-04-26T11:13:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905717+0000", 2024-04-26T11:13:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4562000000000001e-05 2024-04-26T11:13:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906126+0000", 2024-04-26T11:13:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040896900000000002 2024-04-26T11:13:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:13:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906133+0000", 2024-04-26T11:13:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6370000000000002e-06 2024-04-26T11:13:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.914252+0000", 2024-04-26T11:13:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0081192529999999999 2024-04-26T11:13:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.914675+0000", 2024-04-26T11:13:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00042322399999999999 2024-04-26T11:13:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915080+0000", 2024-04-26T11:13:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040486899999999998 2024-04-26T11:13:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.917940+0000", 2024-04-26T11:13:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0028593400000000001 2024-04-26T11:13:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.922776+0000", 2024-04-26T11:13:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048359420000000002 2024-04-26T11:13:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.922825+0000", 2024-04-26T11:13:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9048999999999997e-05 2024-04-26T11:13:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.922850+0000", 2024-04-26T11:13:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5689000000000001e-05 2024-04-26T11:13:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.141 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:18 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:49.142 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906121+0000", 2024-04-26T11:13:49.142 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.225797640000003, 2024-04-26T11:13:49.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015092059, 2024-04-26T11:13:49.142 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:49.142 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:49.142 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:49.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:49.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906121+0000", 2024-04-26T11:13:49.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906121+0000", 2024-04-26T11:13:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906121+0000", 2024-04-26T11:13:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906124+0000", 2024-04-26T11:13:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6009999999999999e-06 2024-04-26T11:13:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906130+0000", 2024-04-26T11:13:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3010000000000003e-06 2024-04-26T11:13:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906136+0000", 2024-04-26T11:13:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1370000000000001e-06 2024-04-26T11:13:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906289+0000", 2024-04-26T11:13:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000153299 2024-04-26T11:13:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:13:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906296+0000", 2024-04-26T11:13:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9829999999999999e-06 2024-04-26T11:13:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.910345+0000", 2024-04-26T11:13:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040495510000000002 2024-04-26T11:13:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.910479+0000", 2024-04-26T11:13:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013406 2024-04-26T11:13:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.910881+0000", 2024-04-26T11:13:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040128800000000002 2024-04-26T11:13:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.913427+0000", 2024-04-26T11:13:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025464440000000001 2024-04-26T11:13:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921131+0000", 2024-04-26T11:13:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0077034399999999998 2024-04-26T11:13:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921175+0000", 2024-04-26T11:13:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4811000000000002e-05 2024-04-26T11:13:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921213+0000", 2024-04-26T11:13:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7607000000000001e-05 2024-04-26T11:13:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:26 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906148+0000", 2024-04-26T11:13:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.225771121999998, 2024-04-26T11:13:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017103547, 2024-04-26T11:13:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906148+0000", 2024-04-26T11:13:49.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906148+0000", 2024-04-26T11:13:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906147+0000", 2024-04-26T11:13:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906152+0000", 2024-04-26T11:13:49.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2530000000000004e-06 2024-04-26T11:13:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906160+0000", 2024-04-26T11:13:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.605e-06 2024-04-26T11:13:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906165+0000", 2024-04-26T11:13:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4689999999999996e-06 2024-04-26T11:13:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906223+0000", 2024-04-26T11:13:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7578999999999999e-05 2024-04-26T11:13:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906228+0000", 2024-04-26T11:13:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.485e-06 2024-04-26T11:13:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915364+0000", 2024-04-26T11:13:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0091359230000000007 2024-04-26T11:13:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915433+0000", 2024-04-26T11:13:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8913999999999998e-05 2024-04-26T11:13:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915517+0000", 2024-04-26T11:13:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4023000000000005e-05 2024-04-26T11:13:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.918856+0000", 2024-04-26T11:13:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0033382469999999999 2024-04-26T11:13:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923141+0000", 2024-04-26T11:13:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0042854779999999997 2024-04-26T11:13:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923209+0000", 2024-04-26T11:13:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8122999999999998e-05 2024-04-26T11:13:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923251+0000", 2024-04-26T11:13:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1919999999999998e-05 2024-04-26T11:13:49.153 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.154 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:49.154 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.154 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:28 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:49.154 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906186+0000", 2024-04-26T11:13:49.154 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.225732706000002, 2024-04-26T11:13:49.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015189243999999999, 2024-04-26T11:13:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906186+0000", 2024-04-26T11:13:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906186+0000", 2024-04-26T11:13:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906185+0000", 2024-04-26T11:13:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906190+0000", 2024-04-26T11:13:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7169999999999999e-06 2024-04-26T11:13:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906197+0000", 2024-04-26T11:13:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7519999999999999e-06 2024-04-26T11:13:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906206+0000", 2024-04-26T11:13:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0790000000000007e-06 2024-04-26T11:13:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906254+0000", 2024-04-26T11:13:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8248999999999998e-05 2024-04-26T11:13:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906258+0000", 2024-04-26T11:13:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1799999999999998e-06 2024-04-26T11:13:49.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.912492+0000", 2024-04-26T11:13:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062335560000000003 2024-04-26T11:13:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.912603+0000", 2024-04-26T11:13:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111597 2024-04-26T11:13:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.912734+0000", 2024-04-26T11:13:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013028700000000001 2024-04-26T11:13:49.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915693+0000", 2024-04-26T11:13:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0029589460000000001 2024-04-26T11:13:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921316+0000", 2024-04-26T11:13:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0056232130000000002 2024-04-26T11:13:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921346+0000", 2024-04-26T11:13:49.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0011000000000001e-05 2024-04-26T11:13:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921375+0000", 2024-04-26T11:13:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9254000000000001e-05 2024-04-26T11:13:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906220+0000", 2024-04-26T11:13:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.225698901999998, 2024-04-26T11:13:49.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0151527, 2024-04-26T11:13:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906220+0000", 2024-04-26T11:13:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906220+0000", 2024-04-26T11:13:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906219+0000", 2024-04-26T11:13:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906233+0000", 2024-04-26T11:13:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3848e-05 2024-04-26T11:13:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906241+0000", 2024-04-26T11:13:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5979999999999999e-06 2024-04-26T11:13:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906250+0000", 2024-04-26T11:13:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1619999999999997e-06 2024-04-26T11:13:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906593+0000", 2024-04-26T11:13:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00034324900000000001 2024-04-26T11:13:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906598+0000", 2024-04-26T11:13:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8729999999999998e-06 2024-04-26T11:13:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.911534+0000", 2024-04-26T11:13:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049357869999999996 2024-04-26T11:13:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.911637+0000", 2024-04-26T11:13:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103071 2024-04-26T11:13:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.911781+0000", 2024-04-26T11:13:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000144499 2024-04-26T11:13:49.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.913870+0000", 2024-04-26T11:13:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020884369999999998 2024-04-26T11:13:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921293+0000", 2024-04-26T11:13:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0074231810000000001 2024-04-26T11:13:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921328+0000", 2024-04-26T11:13:49.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4606e-05 2024-04-26T11:13:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.921372+0000", 2024-04-26T11:13:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4909e-05 2024-04-26T11:13:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906402+0000", 2024-04-26T11:13:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.225517070000002, 2024-04-26T11:13:49.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017555191000000001, 2024-04-26T11:13:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906402+0000", 2024-04-26T11:13:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906402+0000", 2024-04-26T11:13:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906401+0000", 2024-04-26T11:13:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906407+0000", 2024-04-26T11:13:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2689999999999996e-06 2024-04-26T11:13:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906416+0000", 2024-04-26T11:13:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5080000000000005e-06 2024-04-26T11:13:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906422+0000", 2024-04-26T11:13:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9460000000000003e-06 2024-04-26T11:13:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906459+0000", 2024-04-26T11:13:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6998000000000001e-05 2024-04-26T11:13:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906463+0000", 2024-04-26T11:13:49.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.374e-06 2024-04-26T11:13:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915821+0000", 2024-04-26T11:13:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0093578050000000003 2024-04-26T11:13:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.916209+0000", 2024-04-26T11:13:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00038876999999999998 2024-04-26T11:13:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.916349+0000", 2024-04-26T11:13:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013992900000000001 2024-04-26T11:13:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.920269+0000", 2024-04-26T11:13:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003919133 2024-04-26T11:13:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923899+0000", 2024-04-26T11:13:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003630716 2024-04-26T11:13:49.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923932+0000", 2024-04-26T11:13:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2471999999999997e-05 2024-04-26T11:13:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923957+0000", 2024-04-26T11:13:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5038999999999999e-05 2024-04-26T11:13:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.172 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:33232 5.0 5:0853a86f:::benchmark_data_smithi029_44842_object33231:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:47.603147+0000", 2024-04-26T11:13:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 1.528771691, 2024-04-26T11:13:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01429009, 2024-04-26T11:13:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 33232 2024-04-26T11:13:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.603147+0000", 2024-04-26T11:13:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.603147+0000", 2024-04-26T11:13:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.603146+0000", 2024-04-26T11:13:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.603175+0000", 2024-04-26T11:13:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9039000000000001e-05 2024-04-26T11:13:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.603184+0000", 2024-04-26T11:13:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7150000000000004e-06 2024-04-26T11:13:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.603191+0000", 2024-04-26T11:13:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.63e-06 2024-04-26T11:13:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.608539+0000", 2024-04-26T11:13:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053479540000000002 2024-04-26T11:13:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.608674+0000", 2024-04-26T11:13:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135706 2024-04-26T11:13:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.608832+0000", 2024-04-26T11:13:49.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000157412 2024-04-26T11:13:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.612704+0000", 2024-04-26T11:13:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038716499999999999 2024-04-26T11:13:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.617387+0000", 2024-04-26T11:13:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0046836559999999996 2024-04-26T11:13:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:49.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.617417+0000", 2024-04-26T11:13:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9672999999999999e-05 2024-04-26T11:13:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.617437+0000", 2024-04-26T11:13:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0140999999999999e-05 2024-04-26T11:13:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:33828 5.b 5:d3313e8b:::benchmark_data_smithi029_44842_object33827:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:47.804177+0000", 2024-04-26T11:13:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 1.327741625, 2024-04-26T11:13:49.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01819138, 2024-04-26T11:13:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 33828 2024-04-26T11:13:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804177+0000", 2024-04-26T11:13:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:49.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804177+0000", 2024-04-26T11:13:49.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:49.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804176+0000", 2024-04-26T11:13:49.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:49.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:49.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804238+0000", 2024-04-26T11:13:49.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1791000000000005e-05 2024-04-26T11:13:49.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:49.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804248+0000", 2024-04-26T11:13:49.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9969999999999993e-06 2024-04-26T11:13:49.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:49.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804253+0000", 2024-04-26T11:13:49.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2830000000000003e-06 2024-04-26T11:13:49.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.805184+0000", 2024-04-26T11:13:49.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093189900000000003 2024-04-26T11:13:49.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.805268+0000", 2024-04-26T11:13:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3634000000000006e-05 2024-04-26T11:13:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.805359+0000", 2024-04-26T11:13:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0603e-05 2024-04-26T11:13:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.806391+0000", 2024-04-26T11:13:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001031978 2024-04-26T11:13:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.822308+0000", 2024-04-26T11:13:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015917343 2024-04-26T11:13:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.822344+0000", 2024-04-26T11:13:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5754999999999999e-05 2024-04-26T11:13:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.822368+0000", 2024-04-26T11:13:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4658e-05 2024-04-26T11:13:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35482 5.b 5:d2b3ef95:::benchmark_data_smithi029_44842_object35481:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:13:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.71323704099999996, 2024-04-26T11:13:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019390455000000001, 2024-04-26T11:13:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35482 2024-04-26T11:13:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:13:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:13:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418681+0000", 2024-04-26T11:13:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:49.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418802+0000", 2024-04-26T11:13:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120835 2024-04-26T11:13:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418810+0000", 2024-04-26T11:13:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1240000000000005e-06 2024-04-26T11:13:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418816+0000", 2024-04-26T11:13:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5749999999999997e-06 2024-04-26T11:13:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.419905+0000", 2024-04-26T11:13:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001088751 2024-04-26T11:13:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.420046+0000", 2024-04-26T11:13:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140514 2024-04-26T11:13:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.420180+0000", 2024-04-26T11:13:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440899999999999 2024-04-26T11:13:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:49.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425415+0000", 2024-04-26T11:13:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052350540000000003 2024-04-26T11:13:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.437989+0000", 2024-04-26T11:13:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012573632 2024-04-26T11:13:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.438035+0000", 2024-04-26T11:13:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5799e-05 2024-04-26T11:13:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.438072+0000", 2024-04-26T11:13:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7530999999999997e-05 2024-04-26T11:13:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35483 5.b 5:d3dd14f6:::benchmark_data_smithi029_44842_object35482:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:13:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.71309429899999999, 2024-04-26T11:13:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021245969, 2024-04-26T11:13:49.189 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35483 2024-04-26T11:13:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:13:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:13:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:13:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418885+0000", 2024-04-26T11:13:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1294e-05 2024-04-26T11:13:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418892+0000", 2024-04-26T11:13:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4599999999999997e-06 2024-04-26T11:13:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418899+0000", 2024-04-26T11:13:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0909999999999998e-06 2024-04-26T11:13:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421347+0000", 2024-04-26T11:13:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024484609999999999 2024-04-26T11:13:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421468+0000", 2024-04-26T11:13:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000121179 2024-04-26T11:13:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421605+0000", 2024-04-26T11:13:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013672200000000001 2024-04-26T11:13:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425456+0000", 2024-04-26T11:13:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038511719999999999 2024-04-26T11:13:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.439986+0000", 2024-04-26T11:13:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014530080000000001 2024-04-26T11:13:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440038+0000", 2024-04-26T11:13:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1916999999999998e-05 2024-04-26T11:13:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440070+0000", 2024-04-26T11:13:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2245e-05 2024-04-26T11:13:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:49.194 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35493 5.8 5:14785d1e:::benchmark_data_smithi029_44842_object35492:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.422582+0000", 2024-04-26T11:13:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.70933672800000003, 2024-04-26T11:13:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01748692, 2024-04-26T11:13:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35493 2024-04-26T11:13:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.195 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422582+0000", 2024-04-26T11:13:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422582+0000", 2024-04-26T11:13:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422581+0000", 2024-04-26T11:13:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:49.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422715+0000", 2024-04-26T11:13:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013359600000000001 2024-04-26T11:13:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422723+0000", 2024-04-26T11:13:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4749999999999993e-06 2024-04-26T11:13:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422728+0000", 2024-04-26T11:13:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7210000000000002e-06 2024-04-26T11:13:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422753+0000", 2024-04-26T11:13:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4456000000000001e-05 2024-04-26T11:13:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422832+0000", 2024-04-26T11:13:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9810999999999999e-05 2024-04-26T11:13:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422932+0000", 2024-04-26T11:13:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9865999999999996e-05 2024-04-26T11:13:49.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.427701+0000", 2024-04-26T11:13:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047686999999999998 2024-04-26T11:13:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.439983+0000", 2024-04-26T11:13:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012281861 2024-04-26T11:13:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440032+0000", 2024-04-26T11:13:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9317999999999998e-05 2024-04-26T11:13:49.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440069+0000", 2024-04-26T11:13:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6740999999999999e-05 2024-04-26T11:13:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35494 5.4 5:2687a65a:::benchmark_data_smithi029_44842_object35493:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.422734+0000", 2024-04-26T11:13:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.70918432600000003, 2024-04-26T11:13:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017335989, 2024-04-26T11:13:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:49.200 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35494 2024-04-26T11:13:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422734+0000", 2024-04-26T11:13:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422734+0000", 2024-04-26T11:13:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422734+0000", 2024-04-26T11:13:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422769+0000", 2024-04-26T11:13:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4759999999999999e-05 2024-04-26T11:13:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422773+0000", 2024-04-26T11:13:49.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6319999999999999e-06 2024-04-26T11:13:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422777+0000", 2024-04-26T11:13:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3550000000000001e-06 2024-04-26T11:13:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422802+0000", 2024-04-26T11:13:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5771000000000001e-05 2024-04-26T11:13:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422905+0000", 2024-04-26T11:13:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102509 2024-04-26T11:13:49.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422983+0000", 2024-04-26T11:13:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8209999999999998e-05 2024-04-26T11:13:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.427677+0000", 2024-04-26T11:13:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0046938659999999997 2024-04-26T11:13:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.439988+0000", 2024-04-26T11:13:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012311344 2024-04-26T11:13:49.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440036+0000", 2024-04-26T11:13:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7187000000000001e-05 2024-04-26T11:13:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440070+0000", 2024-04-26T11:13:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4752999999999997e-05 2024-04-26T11:13:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35499 5.0 5:01ad2011:::benchmark_data_smithi029_44842_object35498:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.425538+0000", 2024-04-26T11:13:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.70638055, 2024-04-26T11:13:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016428793000000001, 2024-04-26T11:13:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35499 2024-04-26T11:13:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425538+0000", 2024-04-26T11:13:49.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425538+0000", 2024-04-26T11:13:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425537+0000", 2024-04-26T11:13:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425701+0000", 2024-04-26T11:13:49.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163616 2024-04-26T11:13:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425709+0000", 2024-04-26T11:13:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3780000000000001e-06 2024-04-26T11:13:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425715+0000", 2024-04-26T11:13:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6330000000000001e-06 2024-04-26T11:13:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425739+0000", 2024-04-26T11:13:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4314000000000001e-05 2024-04-26T11:13:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425819+0000", 2024-04-26T11:13:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9385e-05 2024-04-26T11:13:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425901+0000", 2024-04-26T11:13:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2536999999999999e-05 2024-04-26T11:13:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.430126+0000", 2024-04-26T11:13:49.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0042245800000000003 2024-04-26T11:13:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.441905+0000", 2024-04-26T11:13:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01177957 2024-04-26T11:13:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.441935+0000", 2024-04-26T11:13:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.936e-05 2024-04-26T11:13:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.441967+0000", 2024-04-26T11:13:49.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2172000000000003e-05 2024-04-26T11:13:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35502 5.8 5:16872f12:::benchmark_data_smithi029_44842_object35501:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.425722+0000", 2024-04-26T11:13:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.70619696499999995, 2024-04-26T11:13:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014476826, 2024-04-26T11:13:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35502 2024-04-26T11:13:49.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425722+0000", 2024-04-26T11:13:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425722+0000", 2024-04-26T11:13:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:49.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425721+0000", 2024-04-26T11:13:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425812+0000", 2024-04-26T11:13:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0798999999999996e-05 2024-04-26T11:13:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425823+0000", 2024-04-26T11:13:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0761000000000001e-05 2024-04-26T11:13:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425827+0000", 2024-04-26T11:13:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7639999999999999e-06 2024-04-26T11:13:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425847+0000", 2024-04-26T11:13:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0613000000000001e-05 2024-04-26T11:13:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425931+0000", 2024-04-26T11:13:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3838999999999995e-05 2024-04-26T11:13:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.426008+0000", 2024-04-26T11:13:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7360000000000005e-05 2024-04-26T11:13:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.430136+0000", 2024-04-26T11:13:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0041281620000000003 2024-04-26T11:13:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440109+0000", 2024-04-26T11:13:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0099726199999999997 2024-04-26T11:13:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440167+0000", 2024-04-26T11:13:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8028000000000001e-05 2024-04-26T11:13:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440198+0000", 2024-04-26T11:13:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1341999999999999e-05 2024-04-26T11:13:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.218 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35504 5.b 5:d1700222:::benchmark_data_smithi029_44842_object35503:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:49.219 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.425836+0000", 2024-04-26T11:13:49.219 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.70608256700000005, 2024-04-26T11:13:49.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014362104000000001, 2024-04-26T11:13:49.219 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:49.219 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:49.219 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:49.219 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:49.219 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:49.219 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35504 2024-04-26T11:13:49.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.219 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:49.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:49.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425836+0000", 2024-04-26T11:13:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425836+0000", 2024-04-26T11:13:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425836+0000", 2024-04-26T11:13:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:49.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425869+0000", 2024-04-26T11:13:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3183999999999999e-05 2024-04-26T11:13:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425873+0000", 2024-04-26T11:13:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5929999999999999e-06 2024-04-26T11:13:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425879+0000", 2024-04-26T11:13:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7470000000000002e-06 2024-04-26T11:13:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425917+0000", 2024-04-26T11:13:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.782e-05 2024-04-26T11:13:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.426039+0000", 2024-04-26T11:13:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012196099999999999 2024-04-26T11:13:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.426173+0000", 2024-04-26T11:13:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013400400000000001 2024-04-26T11:13:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:49.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.430172+0000", 2024-04-26T11:13:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039986140000000002 2024-04-26T11:13:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440109+0000", 2024-04-26T11:13:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0099378260000000003 2024-04-26T11:13:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440165+0000", 2024-04-26T11:13:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.554e-05 2024-04-26T11:13:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:49.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440198+0000", 2024-04-26T11:13:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3225000000000001e-05 2024-04-26T11:13:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35598 5.8 5:1ddb4c8b:::benchmark_data_smithi029_44842_object35597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.470702+0000", 2024-04-26T11:13:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.66121626300000003, 2024-04-26T11:13:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01530686, 2024-04-26T11:13:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:49.224 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35598 2024-04-26T11:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.470702+0000", 2024-04-26T11:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.470702+0000", 2024-04-26T11:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.470702+0000", 2024-04-26T11:13:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.470756+0000", 2024-04-26T11:13:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4595999999999997e-05 2024-04-26T11:13:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.470763+0000", 2024-04-26T11:13:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3509999999999998e-06 2024-04-26T11:13:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.470767+0000", 2024-04-26T11:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7610000000000001e-06 2024-04-26T11:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.474322+0000", 2024-04-26T11:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003555047 2024-04-26T11:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.474437+0000", 2024-04-26T11:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000115432 2024-04-26T11:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.474570+0000", 2024-04-26T11:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000133089 2024-04-26T11:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.482098+0000", 2024-04-26T11:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0075277540000000002 2024-04-26T11:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.485946+0000", 2024-04-26T11:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038482289999999999 2024-04-26T11:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.485976+0000", 2024-04-26T11:13:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9975e-05 2024-04-26T11:13:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.486009+0000", 2024-04-26T11:13:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3090000000000003e-05 2024-04-26T11:13:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35600 5.8 5:14fb4af8:::benchmark_data_smithi029_44842_object35599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.471550+0000", 2024-04-26T11:13:49.229 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.66036882600000002, 2024-04-26T11:13:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014541174, 2024-04-26T11:13:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35600 2024-04-26T11:13:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.471550+0000", 2024-04-26T11:13:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.471550+0000", 2024-04-26T11:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.471549+0000", 2024-04-26T11:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.471635+0000", 2024-04-26T11:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6045999999999996e-05 2024-04-26T11:13:49.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.471646+0000", 2024-04-26T11:13:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.095e-05 2024-04-26T11:13:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.471654+0000", 2024-04-26T11:13:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5700000000000004e-06 2024-04-26T11:13:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.475946+0000", 2024-04-26T11:13:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0042919589999999997 2024-04-26T11:13:49.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.476081+0000", 2024-04-26T11:13:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013574999999999999 2024-04-26T11:13:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.476228+0000", 2024-04-26T11:13:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014688799999999999 2024-04-26T11:13:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.482148+0000", 2024-04-26T11:13:49.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059198719999999996 2024-04-26T11:13:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.486016+0000", 2024-04-26T11:13:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038683089999999999 2024-04-26T11:13:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.486058+0000", 2024-04-26T11:13:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1551999999999998e-05 2024-04-26T11:13:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.486091+0000", 2024-04-26T11:13:49.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3079e-05 2024-04-26T11:13:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35612 5.8 5:132b5985:::benchmark_data_smithi029_44842_object35611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.475480+0000", 2024-04-26T11:13:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.65643833699999998, 2024-04-26T11:13:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015418382, 2024-04-26T11:13:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:49.235 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35612 2024-04-26T11:13:49.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.236 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:49.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:49.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.475480+0000", 2024-04-26T11:13:49.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:49.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.475480+0000", 2024-04-26T11:13:49.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:49.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.475480+0000", 2024-04-26T11:13:49.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:49.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:49.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.475520+0000", 2024-04-26T11:13:49.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0011e-05 2024-04-26T11:13:49.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:49.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.475537+0000", 2024-04-26T11:13:49.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7421000000000001e-05 2024-04-26T11:13:49.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:49.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.475544+0000", 2024-04-26T11:13:49.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8260000000000004e-06 2024-04-26T11:13:49.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.482231+0000", 2024-04-26T11:13:49.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.006686974 2024-04-26T11:13:49.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:49.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.482413+0000", 2024-04-26T11:13:49.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018217099999999999 2024-04-26T11:13:49.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:49.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.482551+0000", 2024-04-26T11:13:49.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013819200000000001 2024-04-26T11:13:49.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:49.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.486144+0000", 2024-04-26T11:13:49.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035932640000000001 2024-04-26T11:13:49.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:49.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.490798+0000", 2024-04-26T11:13:49.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0046539889999999999 2024-04-26T11:13:49.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:49.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.490859+0000", 2024-04-26T11:13:49.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0312000000000001e-05 2024-04-26T11:13:49.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:49.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.490899+0000", 2024-04-26T11:13:49.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9913999999999998e-05 2024-04-26T11:13:49.240 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.240 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:49.240 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.240 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35614 5.0 5:0eb2c7dc:::benchmark_data_smithi029_44842_object35613:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:49.240 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.476120+0000", 2024-04-26T11:13:49.240 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.655798934, 2024-04-26T11:13:49.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014673682, 2024-04-26T11:13:49.240 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:49.241 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:49.241 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:49.241 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:49.241 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:49.241 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35614 2024-04-26T11:13:49.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.241 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:49.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:49.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.476120+0000", 2024-04-26T11:13:49.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:49.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.476120+0000", 2024-04-26T11:13:49.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:49.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.476119+0000", 2024-04-26T11:13:49.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:49.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:49.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.476184+0000", 2024-04-26T11:13:49.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4942000000000003e-05 2024-04-26T11:13:49.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:49.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.476201+0000", 2024-04-26T11:13:49.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7e-05 2024-04-26T11:13:49.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:49.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.476209+0000", 2024-04-26T11:13:49.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7819999999999994e-06 2024-04-26T11:13:49.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.482212+0000", 2024-04-26T11:13:49.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060030810000000004 2024-04-26T11:13:49.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:49.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.482355+0000", 2024-04-26T11:13:49.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014369400000000001 2024-04-26T11:13:49.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:49.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.482491+0000", 2024-04-26T11:13:49.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013588000000000001 2024-04-26T11:13:49.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:49.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.486125+0000", 2024-04-26T11:13:49.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036337869999999999 2024-04-26T11:13:49.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:49.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.490741+0000", 2024-04-26T11:13:49.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0046157569999999998 2024-04-26T11:13:49.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:49.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.490773+0000", 2024-04-26T11:13:49.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1856999999999997e-05 2024-04-26T11:13:49.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:49.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.490793+0000", 2024-04-26T11:13:49.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0727e-05 2024-04-26T11:13:49.245 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.245 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:49.245 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.246 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:36746 5.8 5:14dea2d5:::benchmark_data_smithi029_44842_object36745:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:49.246 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.896239+0000", 2024-04-26T11:13:49.246 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.23567976800000001, 2024-04-26T11:13:49.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016757729999999998, 2024-04-26T11:13:49.246 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:49.246 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:49.246 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:49.246 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:49.246 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:49.246 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 36746 2024-04-26T11:13:49.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.246 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:49.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:49.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.896239+0000", 2024-04-26T11:13:49.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:49.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.896239+0000", 2024-04-26T11:13:49.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:49.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:49.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.896238+0000", 2024-04-26T11:13:49.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:49.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:49.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.896270+0000", 2024-04-26T11:13:49.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1337999999999997e-05 2024-04-26T11:13:49.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:49.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.896276+0000", 2024-04-26T11:13:49.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0680000000000002e-06 2024-04-26T11:13:49.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:49.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.896287+0000", 2024-04-26T11:13:49.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1586999999999999e-05 2024-04-26T11:13:49.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:49.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.898129+0000", 2024-04-26T11:13:49.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018412630000000001 2024-04-26T11:13:49.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:49.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.898211+0000", 2024-04-26T11:13:49.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1978999999999996e-05 2024-04-26T11:13:49.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:49.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.898296+0000", 2024-04-26T11:13:49.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5680999999999995e-05 2024-04-26T11:13:49.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:49.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.899825+0000", 2024-04-26T11:13:49.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001528789 2024-04-26T11:13:49.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:49.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.912927+0000", 2024-04-26T11:13:49.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013101665 2024-04-26T11:13:49.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:49.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.912963+0000", 2024-04-26T11:13:49.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6745000000000001e-05 2024-04-26T11:13:49.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:49.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:49.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:49.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.912997+0000", 2024-04-26T11:13:49.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3118999999999999e-05 2024-04-26T11:13:49.251 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.251 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:49.251 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.251 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:49.251 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:49.251 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:13:49.251 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:13:49.253 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:13:49.254 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:49.250+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:49.353 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:49.352+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:49.409 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:13:49.410 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 11 16 38097 38081 216.353 165 0.00660649 0.00461789 2024-04-26T11:13:49.425 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:49.425 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:49.429 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:13:49.439 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:13:49.450 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:13:49.452 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:13:49.452 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:13:49.452 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:13:49.454 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:49.452+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:49.555 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:49.553+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:49.655 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:49.655 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:49.656 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:49.655+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:49.668 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:13:49.757 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:49.755+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:49.858 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:49.857+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:49.881 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:49.881 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:49.894 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:13:49.959 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:49.957+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:50.059 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:50.057+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:50.074 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:50.074 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:50.085 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:13:50.161 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:50.159+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:50.262 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:50.260+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:50.310 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:50.310 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:50.323 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:13:50.337 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:13:50.363 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:50.362+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:50.410 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 12 16 40526 40510 210.974 151.812 0.00458479 0.00473673 2024-04-26T11:13:50.464 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:50.462+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:50.540 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:50.541 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:50.550 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:13:50.565 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:50.564+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:50.666 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:50.665+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:50.695 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:50.695 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:50.708 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:13:50.768 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:50.765+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:50.868 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:50.867+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:50.878 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:50.878 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:50.890 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:13:50.969 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:50.967+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:51.070 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:51.068+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:51.102 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:51.102 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:51.116 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:13:51.171 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:51.170+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:51.272 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:51.270+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:51.286 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:51.286 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:51.301 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:13:51.330 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is set 2024-04-26T11:13:51.373 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:51.371+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:51.411 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 13 16 42849 42833 205.912 145.188 0.00465032 0.00485366 2024-04-26T11:13:51.464 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:13:51.474 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:51.472+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:51.511 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:51.511 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:51.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:13:51.575 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:51.574+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:51.634 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:13:51.655 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:13:51.664 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:13:51.664 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:13:51.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:13:51.664 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:13:51.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.664 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:51.664 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905603+0000", 2024-04-26T11:13:51.664 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.754793788000001, 2024-04-26T11:13:51.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016623645999999999, 2024-04-26T11:13:51.664 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:51.664 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:51.664 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:51.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:51.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905603+0000", 2024-04-26T11:13:51.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:51.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905603+0000", 2024-04-26T11:13:51.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:51.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905601+0000", 2024-04-26T11:13:51.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999986 2024-04-26T11:13:51.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:51.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905609+0000", 2024-04-26T11:13:51.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3679999999999996e-06 2024-04-26T11:13:51.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:51.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905617+0000", 2024-04-26T11:13:51.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4309999999999994e-06 2024-04-26T11:13:51.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905626+0000", 2024-04-26T11:13:51.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9840000000000007e-06 2024-04-26T11:13:51.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905677+0000", 2024-04-26T11:13:51.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0305e-05 2024-04-26T11:13:51.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:13:51.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905684+0000", 2024-04-26T11:13:51.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0129999999999996e-06 2024-04-26T11:13:51.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.914734+0000", 2024-04-26T11:13:51.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090507199999999999 2024-04-26T11:13:51.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:51.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.914927+0000", 2024-04-26T11:13:51.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019310599999999999 2024-04-26T11:13:51.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:51.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.915592+0000", 2024-04-26T11:13:51.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00066429800000000002 2024-04-26T11:13:51.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:51.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.921998+0000", 2024-04-26T11:13:51.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064060469999999998 2024-04-26T11:13:51.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:51.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922072+0000", 2024-04-26T11:13:51.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3899999999999994e-05 2024-04-26T11:13:51.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:51.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922185+0000", 2024-04-26T11:13:51.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011294900000000001 2024-04-26T11:13:51.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:51.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922226+0000", 2024-04-26T11:13:51.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1777000000000003e-05 2024-04-26T11:13:51.670 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.670 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:51.670 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.670 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:51.670 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905638+0000", 2024-04-26T11:13:51.670 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.754758183, 2024-04-26T11:13:51.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019821874, 2024-04-26T11:13:51.670 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:51.670 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:51.670 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:51.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:51.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905638+0000", 2024-04-26T11:13:51.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:51.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905638+0000", 2024-04-26T11:13:51.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:51.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905638+0000", 2024-04-26T11:13:51.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:51.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:51.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905642+0000", 2024-04-26T11:13:51.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9759999999999997e-06 2024-04-26T11:13:51.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:51.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905647+0000", 2024-04-26T11:13:51.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5949999999999998e-06 2024-04-26T11:13:51.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905651+0000", 2024-04-26T11:13:51.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.924e-06 2024-04-26T11:13:51.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905752+0000", 2024-04-26T11:13:51.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000101 2024-04-26T11:13:51.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:51.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905758+0000", 2024-04-26T11:13:51.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:13:51.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922256+0000", 2024-04-26T11:13:51.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016497947999999998 2024-04-26T11:13:51.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:51.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922369+0000", 2024-04-26T11:13:51.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000113213 2024-04-26T11:13:51.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:51.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922505+0000", 2024-04-26T11:13:51.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000135635 2024-04-26T11:13:51.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:51.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925373+0000", 2024-04-26T11:13:51.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002868013 2024-04-26T11:13:51.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:51.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925402+0000", 2024-04-26T11:13:51.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.898e-05 2024-04-26T11:13:51.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:51.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925430+0000", 2024-04-26T11:13:51.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7739999999999999e-05 2024-04-26T11:13:51.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:51.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925460+0000", 2024-04-26T11:13:51.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0582e-05 2024-04-26T11:13:51.677 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.677 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:51.677 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.678 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:51.678 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905672+0000", 2024-04-26T11:13:51.678 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.754724351, 2024-04-26T11:13:51.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019920424999999999, 2024-04-26T11:13:51.678 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:51.678 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:51.678 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:51.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:51.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905672+0000", 2024-04-26T11:13:51.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:51.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905672+0000", 2024-04-26T11:13:51.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:51.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905672+0000", 2024-04-26T11:13:51.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:51.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:51.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905689+0000", 2024-04-26T11:13:51.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6929e-05 2024-04-26T11:13:51.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:51.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905694+0000", 2024-04-26T11:13:51.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3839999999999996e-06 2024-04-26T11:13:51.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905698+0000", 2024-04-26T11:13:51.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1450000000000001e-06 2024-04-26T11:13:51.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905812+0000", 2024-04-26T11:13:51.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000113807 2024-04-26T11:13:51.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:51.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905817+0000", 2024-04-26T11:13:51.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.203e-06 2024-04-26T11:13:51.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922934+0000", 2024-04-26T11:13:51.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017116681000000002 2024-04-26T11:13:51.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:51.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923094+0000", 2024-04-26T11:13:51.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000159667 2024-04-26T11:13:51.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:51.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923233+0000", 2024-04-26T11:13:51.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013987 2024-04-26T11:13:51.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:51.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925378+0000", 2024-04-26T11:13:51.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002144389 2024-04-26T11:13:51.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:51.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925510+0000", 2024-04-26T11:13:51.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013231399999999999 2024-04-26T11:13:51.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:51.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925559+0000", 2024-04-26T11:13:51.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8958000000000001e-05 2024-04-26T11:13:51.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:51.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925593+0000", 2024-04-26T11:13:51.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3488999999999997e-05 2024-04-26T11:13:51.683 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.683 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:51.683 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.684 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:51.684 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905702+0000", 2024-04-26T11:13:51.684 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.754694518000001, 2024-04-26T11:13:51.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.01999043, 2024-04-26T11:13:51.684 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:51.684 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:51.684 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:51.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:51.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905702+0000", 2024-04-26T11:13:51.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:51.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905702+0000", 2024-04-26T11:13:51.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:51.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905702+0000", 2024-04-26T11:13:51.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:51.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:51.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905704+0000", 2024-04-26T11:13:51.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6699999999999998e-06 2024-04-26T11:13:51.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:51.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905708+0000", 2024-04-26T11:13:51.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3000000000000002e-06 2024-04-26T11:13:51.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905712+0000", 2024-04-26T11:13:51.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.425e-06 2024-04-26T11:13:51.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905855+0000", 2024-04-26T11:13:51.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014253200000000001 2024-04-26T11:13:51.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:51.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905858+0000", 2024-04-26T11:13:51.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.822e-06 2024-04-26T11:13:51.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923510+0000", 2024-04-26T11:13:51.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017651394000000001 2024-04-26T11:13:51.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:51.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923578+0000", 2024-04-26T11:13:51.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8283999999999999e-05 2024-04-26T11:13:51.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:51.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923710+0000", 2024-04-26T11:13:51.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013175200000000001 2024-04-26T11:13:51.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:51.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925607+0000", 2024-04-26T11:13:51.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001897648 2024-04-26T11:13:51.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:51.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925644+0000", 2024-04-26T11:13:51.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6658e-05 2024-04-26T11:13:51.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:51.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925673+0000", 2024-04-26T11:13:51.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8566999999999999e-05 2024-04-26T11:13:51.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:51.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925692+0000", 2024-04-26T11:13:51.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9720000000000001e-05 2024-04-26T11:13:51.689 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.689 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:51.689 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.689 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:51.690 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905731+0000", 2024-04-26T11:13:51.690 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.754665539999998, 2024-04-26T11:13:51.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020112349000000002, 2024-04-26T11:13:51.690 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:51.690 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:51.690 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:51.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:51.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905731+0000", 2024-04-26T11:13:51.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:51.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905731+0000", 2024-04-26T11:13:51.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:51.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905731+0000", 2024-04-26T11:13:51.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:51.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:51.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905734+0000", 2024-04-26T11:13:51.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2329999999999998e-06 2024-04-26T11:13:51.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:51.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905740+0000", 2024-04-26T11:13:51.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4300000000000003e-06 2024-04-26T11:13:51.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905752+0000", 2024-04-26T11:13:51.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1987000000000001e-05 2024-04-26T11:13:51.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905894+0000", 2024-04-26T11:13:51.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000141858 2024-04-26T11:13:51.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:51.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905898+0000", 2024-04-26T11:13:51.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3599999999999998e-06 2024-04-26T11:13:51.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924011+0000", 2024-04-26T11:13:51.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018113066000000001 2024-04-26T11:13:51.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:51.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924100+0000", 2024-04-26T11:13:51.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8894999999999995e-05 2024-04-26T11:13:51.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:51.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924188+0000", 2024-04-26T11:13:51.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7903000000000002e-05 2024-04-26T11:13:51.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:51.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925616+0000", 2024-04-26T11:13:51.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014277319999999999 2024-04-26T11:13:51.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:51.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925741+0000", 2024-04-26T11:13:51.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012525899999999999 2024-04-26T11:13:51.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:51.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925804+0000", 2024-04-26T11:13:51.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2954999999999996e-05 2024-04-26T11:13:51.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:51.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925843+0000", 2024-04-26T11:13:51.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9096e-05 2024-04-26T11:13:51.696 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.697 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:51.697 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.697 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:51.697 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905757+0000", 2024-04-26T11:13:51.697 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.754639560999998, 2024-04-26T11:13:51.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020224836999999999, 2024-04-26T11:13:51.697 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:51.697 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:51.697 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:51.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:51.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905757+0000", 2024-04-26T11:13:51.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:51.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905757+0000", 2024-04-26T11:13:51.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:51.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905757+0000", 2024-04-26T11:13:51.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:51.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:51.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905760+0000", 2024-04-26T11:13:51.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2219999999999998e-06 2024-04-26T11:13:51.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:51.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905766+0000", 2024-04-26T11:13:51.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0820000000000004e-06 2024-04-26T11:13:51.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905771+0000", 2024-04-26T11:13:51.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1159999999999998e-06 2024-04-26T11:13:51.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905930+0000", 2024-04-26T11:13:51.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015876200000000001 2024-04-26T11:13:51.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:51.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905933+0000", 2024-04-26T11:13:51.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0359999999999998e-06 2024-04-26T11:13:51.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924368+0000", 2024-04-26T11:13:51.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0184355 2024-04-26T11:13:51.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:51.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924415+0000", 2024-04-26T11:13:51.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7098000000000002e-05 2024-04-26T11:13:51.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:51.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924506+0000", 2024-04-26T11:13:51.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1090999999999999e-05 2024-04-26T11:13:51.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:51.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925622+0000", 2024-04-26T11:13:51.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011159480000000001 2024-04-26T11:13:51.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:51.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925927+0000", 2024-04-26T11:13:51.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00030507899999999998 2024-04-26T11:13:51.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:51.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925958+0000", 2024-04-26T11:13:51.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0534999999999998e-05 2024-04-26T11:13:51.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:51.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925982+0000", 2024-04-26T11:13:51.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3782999999999999e-05 2024-04-26T11:13:51.702 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.702 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:51.702 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.703 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:51.703 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905814+0000", 2024-04-26T11:13:51.703 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.754582423000002, 2024-04-26T11:13:51.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020271001, 2024-04-26T11:13:51.703 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:51.703 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:51.703 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:51.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:51.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905814+0000", 2024-04-26T11:13:51.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:51.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905814+0000", 2024-04-26T11:13:51.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:51.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905813+0000", 2024-04-26T11:13:51.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:51.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:51.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905821+0000", 2024-04-26T11:13:51.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1280000000000008e-06 2024-04-26T11:13:51.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:51.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905832+0000", 2024-04-26T11:13:51.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1318000000000001e-05 2024-04-26T11:13:51.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905842+0000", 2024-04-26T11:13:51.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0101e-05 2024-04-26T11:13:51.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905970+0000", 2024-04-26T11:13:51.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012764499999999999 2024-04-26T11:13:51.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:51.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905977+0000", 2024-04-26T11:13:51.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5019999999999998e-06 2024-04-26T11:13:51.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924672+0000", 2024-04-26T11:13:51.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018694908999999999 2024-04-26T11:13:51.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:51.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924754+0000", 2024-04-26T11:13:51.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2167000000000001e-05 2024-04-26T11:13:51.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:51.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924834+0000", 2024-04-26T11:13:51.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0313000000000002e-05 2024-04-26T11:13:51.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:51.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925860+0000", 2024-04-26T11:13:51.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0010255869999999999 2024-04-26T11:13:51.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:51.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926020+0000", 2024-04-26T11:13:51.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000160588 2024-04-26T11:13:51.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:51.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926054+0000", 2024-04-26T11:13:51.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3748999999999998e-05 2024-04-26T11:13:51.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:51.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926085+0000", 2024-04-26T11:13:51.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1111000000000001e-05 2024-04-26T11:13:51.710 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.710 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:51.710 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.710 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:51.710 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905851+0000", 2024-04-26T11:13:51.710 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.754545333999999, 2024-04-26T11:13:51.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020308667999999998, 2024-04-26T11:13:51.710 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:51.710 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:51.710 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:51.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:51.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905851+0000", 2024-04-26T11:13:51.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:51.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905851+0000", 2024-04-26T11:13:51.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:51.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905851+0000", 2024-04-26T11:13:51.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:51.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:51.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905855+0000", 2024-04-26T11:13:51.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3120000000000004e-06 2024-04-26T11:13:51.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:51.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905861+0000", 2024-04-26T11:13:51.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9399999999999999e-06 2024-04-26T11:13:51.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905865+0000", 2024-04-26T11:13:51.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9079999999999997e-06 2024-04-26T11:13:51.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906003+0000", 2024-04-26T11:13:51.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013821800000000001 2024-04-26T11:13:51.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:51.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906007+0000", 2024-04-26T11:13:51.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9670000000000003e-06 2024-04-26T11:13:51.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925040+0000", 2024-04-26T11:13:51.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019032613 2024-04-26T11:13:51.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:51.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925107+0000", 2024-04-26T11:13:51.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7185000000000001e-05 2024-04-26T11:13:51.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:51.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925195+0000", 2024-04-26T11:13:51.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8515000000000002e-05 2024-04-26T11:13:51.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:51.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926094+0000", 2024-04-26T11:13:51.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089852300000000003 2024-04-26T11:13:51.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:51.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926116+0000", 2024-04-26T11:13:51.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1951e-05 2024-04-26T11:13:51.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:51.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926142+0000", 2024-04-26T11:13:51.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6667000000000001e-05 2024-04-26T11:13:51.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:51.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926160+0000", 2024-04-26T11:13:51.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7339000000000001e-05 2024-04-26T11:13:51.716 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.716 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:51.716 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.716 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:16 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:51.716 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905890+0000", 2024-04-26T11:13:51.716 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.754506431999999, 2024-04-26T11:13:51.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017722176999999999, 2024-04-26T11:13:51.716 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:51.716 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:51.716 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:51.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:51.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905890+0000", 2024-04-26T11:13:51.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:51.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905890+0000", 2024-04-26T11:13:51.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:51.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905890+0000", 2024-04-26T11:13:51.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:51.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:51.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905893+0000", 2024-04-26T11:13:51.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9160000000000001e-06 2024-04-26T11:13:51.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:51.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905899+0000", 2024-04-26T11:13:51.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6810000000000001e-06 2024-04-26T11:13:51.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905904+0000", 2024-04-26T11:13:51.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2009999999999998e-06 2024-04-26T11:13:51.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905956+0000", 2024-04-26T11:13:51.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1505999999999998e-05 2024-04-26T11:13:51.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:13:51.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905962+0000", 2024-04-26T11:13:51.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1539999999999999e-06 2024-04-26T11:13:51.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918151+0000", 2024-04-26T11:13:51.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012189046 2024-04-26T11:13:51.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:51.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918261+0000", 2024-04-26T11:13:51.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000110258 2024-04-26T11:13:51.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:51.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918423+0000", 2024-04-26T11:13:51.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000162027 2024-04-26T11:13:51.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:51.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923237+0000", 2024-04-26T11:13:51.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048139519999999998 2024-04-26T11:13:51.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:51.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923530+0000", 2024-04-26T11:13:51.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00029218799999999997 2024-04-26T11:13:51.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:51.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923576+0000", 2024-04-26T11:13:51.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6545999999999998e-05 2024-04-26T11:13:51.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:51.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923612+0000", 2024-04-26T11:13:51.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6171000000000003e-05 2024-04-26T11:13:51.722 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.722 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:51.722 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.722 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:17 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:51.722 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905914+0000", 2024-04-26T11:13:51.722 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.754482545000002, 2024-04-26T11:13:51.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017543897999999999, 2024-04-26T11:13:51.722 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:51.722 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:51.722 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:51.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:51.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905914+0000", 2024-04-26T11:13:51.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:51.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905914+0000", 2024-04-26T11:13:51.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:51.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905914+0000", 2024-04-26T11:13:51.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:51.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:51.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905917+0000", 2024-04-26T11:13:51.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4359999999999998e-06 2024-04-26T11:13:51.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:51.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905925+0000", 2024-04-26T11:13:51.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0779999999999996e-06 2024-04-26T11:13:51.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905932+0000", 2024-04-26T11:13:51.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3810000000000001e-06 2024-04-26T11:13:51.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905979+0000", 2024-04-26T11:13:51.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6264000000000003e-05 2024-04-26T11:13:51.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:13:51.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905983+0000", 2024-04-26T11:13:51.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8909999999999997e-06 2024-04-26T11:13:51.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.914254+0000", 2024-04-26T11:13:51.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0082715619999999997 2024-04-26T11:13:51.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:51.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.914410+0000", 2024-04-26T11:13:51.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015563 2024-04-26T11:13:51.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:51.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.914633+0000", 2024-04-26T11:13:51.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022336 2024-04-26T11:13:51.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:51.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920212+0000", 2024-04-26T11:13:51.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055787349999999996 2024-04-26T11:13:51.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:51.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923369+0000", 2024-04-26T11:13:51.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0031574060000000002 2024-04-26T11:13:51.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:51.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923419+0000", 2024-04-26T11:13:51.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9527000000000002e-05 2024-04-26T11:13:51.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:51.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923458+0000", 2024-04-26T11:13:51.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9005999999999999e-05 2024-04-26T11:13:51.728 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.728 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:51.728 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.728 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:31 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:51.728 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905953+0000", 2024-04-26T11:13:51.728 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.754443647999999, 2024-04-26T11:13:51.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018731343000000001, 2024-04-26T11:13:51.728 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:51.728 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:51.728 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:51.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:51.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905953+0000", 2024-04-26T11:13:51.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:51.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905953+0000", 2024-04-26T11:13:51.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:51.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905952+0000", 2024-04-26T11:13:51.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:51.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:51.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905966+0000", 2024-04-26T11:13:51.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3281999999999999e-05 2024-04-26T11:13:51.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:51.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905973+0000", 2024-04-26T11:13:51.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4109999999999999e-06 2024-04-26T11:13:51.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905979+0000", 2024-04-26T11:13:51.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2949999999999999e-06 2024-04-26T11:13:51.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906013+0000", 2024-04-26T11:13:51.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3844000000000003e-05 2024-04-26T11:13:51.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:51.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906017+0000", 2024-04-26T11:13:51.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4419999999999998e-06 2024-04-26T11:13:51.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918937+0000", 2024-04-26T11:13:51.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012920403 2024-04-26T11:13:51.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:51.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.919018+0000", 2024-04-26T11:13:51.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1540999999999997e-05 2024-04-26T11:13:51.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:51.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.919765+0000", 2024-04-26T11:13:51.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00074620299999999997 2024-04-26T11:13:51.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:51.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923650+0000", 2024-04-26T11:13:51.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038853820000000002 2024-04-26T11:13:51.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:51.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924619+0000", 2024-04-26T11:13:51.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00096863899999999998 2024-04-26T11:13:51.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:51.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924649+0000", 2024-04-26T11:13:51.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9879e-05 2024-04-26T11:13:51.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:51.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924684+0000", 2024-04-26T11:13:51.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5611999999999997e-05 2024-04-26T11:13:51.734 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.734 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:51.734 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.735 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:51.735 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905987+0000", 2024-04-26T11:13:51.735 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.754409987999999, 2024-04-26T11:13:51.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018241182000000002, 2024-04-26T11:13:51.735 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:51.735 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:51.735 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:51.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:51.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905987+0000", 2024-04-26T11:13:51.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:51.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905987+0000", 2024-04-26T11:13:51.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:51.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905986+0000", 2024-04-26T11:13:51.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:51.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:51.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905990+0000", 2024-04-26T11:13:51.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.755e-06 2024-04-26T11:13:51.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:51.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905995+0000", 2024-04-26T11:13:51.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4999999999999999e-06 2024-04-26T11:13:51.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906000+0000", 2024-04-26T11:13:51.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8949999999999997e-06 2024-04-26T11:13:51.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906038+0000", 2024-04-26T11:13:51.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7762999999999997e-05 2024-04-26T11:13:51.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:51.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906042+0000", 2024-04-26T11:13:51.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6890000000000002e-06 2024-04-26T11:13:51.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922401+0000", 2024-04-26T11:13:51.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358973999999998 2024-04-26T11:13:51.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:51.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922482+0000", 2024-04-26T11:13:51.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1711000000000004e-05 2024-04-26T11:13:51.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:51.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922607+0000", 2024-04-26T11:13:51.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000124955 2024-04-26T11:13:51.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:51.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924016+0000", 2024-04-26T11:13:51.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014086490000000001 2024-04-26T11:13:51.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:51.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924154+0000", 2024-04-26T11:13:51.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013777599999999999 2024-04-26T11:13:51.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:51.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924196+0000", 2024-04-26T11:13:51.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2647e-05 2024-04-26T11:13:51.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:51.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924228+0000", 2024-04-26T11:13:51.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1372999999999999e-05 2024-04-26T11:13:51.740 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.740 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:51.740 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.741 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:51.741 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906018+0000", 2024-04-26T11:13:51.741 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.754378078000002, 2024-04-26T11:13:51.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017151182000000001, 2024-04-26T11:13:51.741 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:51.741 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:51.741 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:51.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:51.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906018+0000", 2024-04-26T11:13:51.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:51.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906018+0000", 2024-04-26T11:13:51.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:51.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906018+0000", 2024-04-26T11:13:51.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:51.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:51.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906027+0000", 2024-04-26T11:13:51.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9190000000000005e-06 2024-04-26T11:13:51.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:51.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906033+0000", 2024-04-26T11:13:51.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1419999999999998e-06 2024-04-26T11:13:51.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906039+0000", 2024-04-26T11:13:51.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.156e-06 2024-04-26T11:13:51.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906075+0000", 2024-04-26T11:13:51.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5608999999999997e-05 2024-04-26T11:13:51.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:13:51.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906080+0000", 2024-04-26T11:13:51.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.276e-06 2024-04-26T11:13:51.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918535+0000", 2024-04-26T11:13:51.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012455061999999999 2024-04-26T11:13:51.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:51.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918624+0000", 2024-04-26T11:13:51.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.878e-05 2024-04-26T11:13:51.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:51.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918748+0000", 2024-04-26T11:13:51.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012453799999999999 2024-04-26T11:13:51.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:51.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922172+0000", 2024-04-26T11:13:51.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034232580000000002 2024-04-26T11:13:51.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:51.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923079+0000", 2024-04-26T11:13:51.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00090687899999999998 2024-04-26T11:13:51.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:51.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923129+0000", 2024-04-26T11:13:51.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0773999999999999e-05 2024-04-26T11:13:51.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:51.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923170+0000", 2024-04-26T11:13:51.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0238999999999999e-05 2024-04-26T11:13:51.746 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.746 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:51.746 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.746 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:51.746 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906048+0000", 2024-04-26T11:13:51.746 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.754348559, 2024-04-26T11:13:51.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018763734000000001, 2024-04-26T11:13:51.747 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:51.747 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:51.747 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:51.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:51.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906048+0000", 2024-04-26T11:13:51.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:51.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906048+0000", 2024-04-26T11:13:51.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:51.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906047+0000", 2024-04-26T11:13:51.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:51.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:51.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906051+0000", 2024-04-26T11:13:51.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.799e-06 2024-04-26T11:13:51.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:51.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906058+0000", 2024-04-26T11:13:51.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4470000000000003e-06 2024-04-26T11:13:51.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906064+0000", 2024-04-26T11:13:51.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1319999999999999e-06 2024-04-26T11:13:51.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906092+0000", 2024-04-26T11:13:51.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7939000000000001e-05 2024-04-26T11:13:51.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:51.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906097+0000", 2024-04-26T11:13:51.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.741e-06 2024-04-26T11:13:51.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920571+0000", 2024-04-26T11:13:51.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014474526 2024-04-26T11:13:51.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:51.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920675+0000", 2024-04-26T11:13:51.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000103644 2024-04-26T11:13:51.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:51.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920803+0000", 2024-04-26T11:13:51.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012879699999999999 2024-04-26T11:13:51.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:51.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923655+0000", 2024-04-26T11:13:51.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028517379999999999 2024-04-26T11:13:51.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:51.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924728+0000", 2024-04-26T11:13:51.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0010732199999999999 2024-04-26T11:13:51.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:51.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924775+0000", 2024-04-26T11:13:51.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6168999999999998e-05 2024-04-26T11:13:51.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:51.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924812+0000", 2024-04-26T11:13:51.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7070000000000003e-05 2024-04-26T11:13:51.752 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.752 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:51.752 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.752 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:51.752 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906123+0000", 2024-04-26T11:13:51.752 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.754273687000001, 2024-04-26T11:13:51.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018987535999999999, 2024-04-26T11:13:51.752 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:51.752 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:51.753 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:51.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:51.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906123+0000", 2024-04-26T11:13:51.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:51.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906123+0000", 2024-04-26T11:13:51.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:51.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906122+0000", 2024-04-26T11:13:51.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:51.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:51.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906136+0000", 2024-04-26T11:13:51.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4527e-05 2024-04-26T11:13:51.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:51.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906148+0000", 2024-04-26T11:13:51.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2332e-05 2024-04-26T11:13:51.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906157+0000", 2024-04-26T11:13:51.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0129999999999999e-06 2024-04-26T11:13:51.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906187+0000", 2024-04-26T11:13:51.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9748e-05 2024-04-26T11:13:51.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:51.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906190+0000", 2024-04-26T11:13:51.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0290000000000001e-06 2024-04-26T11:13:51.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.921242+0000", 2024-04-26T11:13:51.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015052100000000001 2024-04-26T11:13:51.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:51.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.921750+0000", 2024-04-26T11:13:51.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00050746299999999999 2024-04-26T11:13:51.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:51.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.921915+0000", 2024-04-26T11:13:51.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016514700000000001 2024-04-26T11:13:51.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:51.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923673+0000", 2024-04-26T11:13:51.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001757836 2024-04-26T11:13:51.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:51.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925039+0000", 2024-04-26T11:13:51.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001366396 2024-04-26T11:13:51.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:51.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925077+0000", 2024-04-26T11:13:51.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7595999999999997e-05 2024-04-26T11:13:51.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:51.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925110+0000", 2024-04-26T11:13:51.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3531999999999997e-05 2024-04-26T11:13:51.757 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.757 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:51.758 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.758 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:21 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:51.758 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906168+0000", 2024-04-26T11:13:51.758 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.754228048000002, 2024-04-26T11:13:51.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017346383, 2024-04-26T11:13:51.758 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:51.758 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:51.758 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:51.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:51.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906168+0000", 2024-04-26T11:13:51.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:51.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906168+0000", 2024-04-26T11:13:51.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:51.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906168+0000", 2024-04-26T11:13:51.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:51.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:51.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906183+0000", 2024-04-26T11:13:51.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5597e-05 2024-04-26T11:13:51.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:51.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906201+0000", 2024-04-26T11:13:51.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7949e-05 2024-04-26T11:13:51.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906208+0000", 2024-04-26T11:13:51.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0990000000000001e-06 2024-04-26T11:13:51.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906233+0000", 2024-04-26T11:13:51.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4351000000000001e-05 2024-04-26T11:13:51.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:51.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906235+0000", 2024-04-26T11:13:51.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4169999999999999e-06 2024-04-26T11:13:51.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.919842+0000", 2024-04-26T11:13:51.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013606337 2024-04-26T11:13:51.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:51.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920004+0000", 2024-04-26T11:13:51.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016249799999999999 2024-04-26T11:13:51.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:51.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920157+0000", 2024-04-26T11:13:51.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015337400000000001 2024-04-26T11:13:51.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:51.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922705+0000", 2024-04-26T11:13:51.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0025479330000000001 2024-04-26T11:13:51.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:51.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923419+0000", 2024-04-26T11:13:51.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00071332999999999998 2024-04-26T11:13:51.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:51.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923467+0000", 2024-04-26T11:13:51.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8556000000000001e-05 2024-04-26T11:13:51.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:51.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923515+0000", 2024-04-26T11:13:51.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7540999999999998e-05 2024-04-26T11:13:51.763 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.763 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:51.763 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.764 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:51.764 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906218+0000", 2024-04-26T11:13:51.764 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.754178852000003, 2024-04-26T11:13:51.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018831681999999999, 2024-04-26T11:13:51.764 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:51.764 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:51.764 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:51.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:51.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906218+0000", 2024-04-26T11:13:51.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:51.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906218+0000", 2024-04-26T11:13:51.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:51.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906217+0000", 2024-04-26T11:13:51.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:51.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:51.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906221+0000", 2024-04-26T11:13:51.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1760000000000003e-06 2024-04-26T11:13:51.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:51.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906228+0000", 2024-04-26T11:13:51.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9800000000000001e-06 2024-04-26T11:13:51.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906234+0000", 2024-04-26T11:13:51.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9320000000000001e-06 2024-04-26T11:13:51.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906264+0000", 2024-04-26T11:13:51.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9518000000000001e-05 2024-04-26T11:13:51.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:13:51.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906268+0000", 2024-04-26T11:13:51.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2939999999999999e-06 2024-04-26T11:13:51.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922451+0000", 2024-04-26T11:13:51.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016183288000000001 2024-04-26T11:13:51.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:51.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922567+0000", 2024-04-26T11:13:51.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000115313 2024-04-26T11:13:51.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:51.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922684+0000", 2024-04-26T11:13:51.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117419 2024-04-26T11:13:51.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:51.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924129+0000", 2024-04-26T11:13:51.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001444753 2024-04-26T11:13:51.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:51.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924979+0000", 2024-04-26T11:13:51.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00084985900000000001 2024-04-26T11:13:51.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:51.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925012+0000", 2024-04-26T11:13:51.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3352999999999997e-05 2024-04-26T11:13:51.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:51.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925049+0000", 2024-04-26T11:13:51.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7354999999999997e-05 2024-04-26T11:13:51.769 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.769 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:51.769 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.769 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:51.769 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906243+0000", 2024-04-26T11:13:51.769 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 38.754153473000002, 2024-04-26T11:13:51.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018983739999999999, 2024-04-26T11:13:51.769 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:51.770 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:13:51.770 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:51.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:51.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906243+0000", 2024-04-26T11:13:51.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:51.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906243+0000", 2024-04-26T11:13:51.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:51.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906243+0000", 2024-04-26T11:13:51.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:51.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:51.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906245+0000", 2024-04-26T11:13:51.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9189999999999999e-06 2024-04-26T11:13:51.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:51.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906252+0000", 2024-04-26T11:13:51.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:13:51.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906258+0000", 2024-04-26T11:13:51.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.728e-06 2024-04-26T11:13:51.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906290+0000", 2024-04-26T11:13:51.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2400000000000001e-05 2024-04-26T11:13:51.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:51.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906293+0000", 2024-04-26T11:13:51.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1769999999999998e-06 2024-04-26T11:13:51.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922664+0000", 2024-04-26T11:13:51.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016370663000000001 2024-04-26T11:13:51.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:51.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922923+0000", 2024-04-26T11:13:51.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025853200000000001 2024-04-26T11:13:51.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:51.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925227+0000", 2024-04-26T11:13:51.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023042570000000001 2024-04-26T11:13:51.773 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.773 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:51.773 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.773 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:35496 5.2 5:422c3e1d:::benchmark_data_smithi029_44842_object35495:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:51.774 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:48.422889+0000", 2024-04-26T11:13:51.774 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.2375074740000001, 2024-04-26T11:13:51.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017178318000000001, 2024-04-26T11:13:51.774 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:51.774 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:51.774 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:51.774 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:51.774 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:51.774 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 35496 2024-04-26T11:13:51.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.774 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:51.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:51.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.422889+0000", 2024-04-26T11:13:51.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:51.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.422889+0000", 2024-04-26T11:13:51.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:51.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.422888+0000", 2024-04-26T11:13:51.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:51.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:51.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.422960+0000", 2024-04-26T11:13:51.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1775999999999999e-05 2024-04-26T11:13:51.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:51.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.422977+0000", 2024-04-26T11:13:51.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7051e-05 2024-04-26T11:13:51.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.422989+0000", 2024-04-26T11:13:51.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1528e-05 2024-04-26T11:13:51.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.423023+0000", 2024-04-26T11:13:51.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4350000000000001e-05 2024-04-26T11:13:51.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:51.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.423112+0000", 2024-04-26T11:13:51.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9359999999999998e-05 2024-04-26T11:13:51.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:51.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.423202+0000", 2024-04-26T11:13:51.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0072000000000001e-05 2024-04-26T11:13:51.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:51.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.424445+0000", 2024-04-26T11:13:51.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0012428770000000001 2024-04-26T11:13:51.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:51.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.440015+0000", 2024-04-26T11:13:51.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015570067999999999 2024-04-26T11:13:51.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:51.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.440045+0000", 2024-04-26T11:13:51.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0088999999999999e-05 2024-04-26T11:13:51.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:51.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.440067+0000", 2024-04-26T11:13:51.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1906e-05 2024-04-26T11:13:51.779 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.779 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:51.779 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.779 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:35501 5.7 5:e8d3a8de:::benchmark_data_smithi029_44842_object35500:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:51.779 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:48.425483+0000", 2024-04-26T11:13:51.779 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.2349131099999999, 2024-04-26T11:13:51.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016575286000000002, 2024-04-26T11:13:51.779 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:51.779 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:51.779 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:51.779 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:51.779 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:51.779 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 35501 2024-04-26T11:13:51.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.780 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:51.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:51.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.425483+0000", 2024-04-26T11:13:51.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:51.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.425483+0000", 2024-04-26T11:13:51.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:51.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:51.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.425483+0000", 2024-04-26T11:13:51.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:51.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:51.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.425635+0000", 2024-04-26T11:13:51.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000151893 2024-04-26T11:13:51.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:51.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.425644+0000", 2024-04-26T11:13:51.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8439999999999993e-06 2024-04-26T11:13:51.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.425652+0000", 2024-04-26T11:13:51.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0520000000000002e-06 2024-04-26T11:13:51.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:51.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.425698+0000", 2024-04-26T11:13:51.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5207000000000003e-05 2024-04-26T11:13:51.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:51.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.425824+0000", 2024-04-26T11:13:51.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012594 2024-04-26T11:13:51.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:51.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.425957+0000", 2024-04-26T11:13:51.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013356199999999999 2024-04-26T11:13:51.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:51.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.428624+0000", 2024-04-26T11:13:51.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026665650000000001 2024-04-26T11:13:51.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:51.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.441971+0000", 2024-04-26T11:13:51.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013347589999999999 2024-04-26T11:13:51.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:51.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.442031+0000", 2024-04-26T11:13:51.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9913e-05 2024-04-26T11:13:51.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:51.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:51.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:51.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:48.442059+0000", 2024-04-26T11:13:51.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.745e-05 2024-04-26T11:13:51.784 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.784 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:51.784 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.784 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:51.784 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:51.784 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:13:51.785 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:13:51.787 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:13:51.787 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:51.784+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:51.787 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:13:51.787 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:13:51.787 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:13:51.887 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:51.885+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:51.973 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:13:51.974 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:13:51.974 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.974 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:43979 5.8 e24/16 5:1de7791a:::benchmark_data_smithi029_44842_object43978:head v 24'2785, mlcod=24'2782)", 2024-04-26T11:13:51.974 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:51.965763+0000", 2024-04-26T11:13:51.974 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0058608310000000004, 2024-04-26T11:13:51.974 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0058780389999999998, 2024-04-26T11:13:51.974 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:51.974 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:51.974 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:51.974 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.974 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:51.974 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.965763+0000", 2024-04-26T11:13:51.975 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:51.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.975 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.975 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:51.975 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.965763+0000", 2024-04-26T11:13:51.975 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:51.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.975 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.975 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:51.975 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.965762+0000", 2024-04-26T11:13:51.975 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:51.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.975 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.975 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:51.976 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.965785+0000", 2024-04-26T11:13:51.976 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2830999999999999e-05 2024-04-26T11:13:51.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.976 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.976 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:51.976 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.965791+0000", 2024-04-26T11:13:51.976 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0310000000000004e-06 2024-04-26T11:13:51.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.976 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.976 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.976 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.965795+0000", 2024-04-26T11:13:51.976 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.3189999999999996e-06 2024-04-26T11:13:51.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.976 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.977 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:51.977 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.967167+0000", 2024-04-26T11:13:51.977 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0013720130000000001 2024-04-26T11:13:51.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.977 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.977 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:51.977 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.967185+0000", 2024-04-26T11:13:51.977 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7796e-05 2024-04-26T11:13:51.977 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:51.977 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:51.977 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:51.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.977 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.977 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:43986 5.7 e24/16 5:e1497bec:::benchmark_data_smithi029_44842_object43985:head v 24'2702, mlcod=24'2700)", 2024-04-26T11:13:51.977 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:51.966387+0000", 2024-04-26T11:13:51.978 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0052367350000000002, 2024-04-26T11:13:51.978 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0052937749999999997, 2024-04-26T11:13:51.978 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:51.978 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:51.978 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:51.978 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.978 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:51.978 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.966387+0000", 2024-04-26T11:13:51.978 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:51.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.978 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.978 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:51.978 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.966387+0000", 2024-04-26T11:13:51.978 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:51.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.979 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.979 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:51.979 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.966386+0000", 2024-04-26T11:13:51.979 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:51.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.979 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.979 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:51.979 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.966448+0000", 2024-04-26T11:13:51.979 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2104e-05 2024-04-26T11:13:51.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.979 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.979 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:51.979 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.966462+0000", 2024-04-26T11:13:51.979 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3212e-05 2024-04-26T11:13:51.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.980 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.980 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.966467+0000", 2024-04-26T11:13:51.980 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8449999999999999e-06 2024-04-26T11:13:51.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.980 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:51.980 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.966989+0000", 2024-04-26T11:13:51.980 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00052185899999999995 2024-04-26T11:13:51.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.980 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:51.980 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.967010+0000", 2024-04-26T11:13:51.980 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0809e-05 2024-04-26T11:13:51.981 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:51.981 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:51.981 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:51.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.981 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.981 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:43983 5.8 e24/16 5:17eb2944:::benchmark_data_smithi029_44842_object43982:head v 24'2786, mlcod=24'2782)", 2024-04-26T11:13:51.981 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:51.967449+0000", 2024-04-26T11:13:51.981 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0041742869999999996, 2024-04-26T11:13:51.981 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042675279999999996, 2024-04-26T11:13:51.981 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:51.981 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:51.981 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:51.981 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.981 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:51.982 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.967449+0000", 2024-04-26T11:13:51.982 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:51.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.982 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.982 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:51.982 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.967449+0000", 2024-04-26T11:13:51.982 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:51.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.982 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.982 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:51.982 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.967449+0000", 2024-04-26T11:13:51.982 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:51.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.982 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.983 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:51.983 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.967485+0000", 2024-04-26T11:13:51.983 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6105000000000001e-05 2024-04-26T11:13:51.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.983 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:51.983 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.967494+0000", 2024-04-26T11:13:51.983 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1910000000000006e-06 2024-04-26T11:13:51.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.983 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.983 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.967500+0000", 2024-04-26T11:13:51.983 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1029999999999998e-06 2024-04-26T11:13:51.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.983 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:51.984 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.969663+0000", 2024-04-26T11:13:51.984 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0021631380000000002 2024-04-26T11:13:51.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.984 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:51.984 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.969684+0000", 2024-04-26T11:13:51.984 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0786999999999999e-05 2024-04-26T11:13:51.984 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:51.984 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:51.984 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:51.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.984 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:43987 5.e e24/16 5:7b368eee:::benchmark_data_smithi029_44842_object43986:head v 24'2710, mlcod=24'2708)", 2024-04-26T11:13:51.984 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:51.967874+0000", 2024-04-26T11:13:51.984 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0037497749999999999, 2024-04-26T11:13:51.985 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003877723, 2024-04-26T11:13:51.985 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:51.985 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:51.985 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:51.985 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.985 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:51.985 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.967874+0000", 2024-04-26T11:13:51.985 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:51.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.985 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.985 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:51.985 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.967874+0000", 2024-04-26T11:13:51.985 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:51.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.985 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.986 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:51.986 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.967873+0000", 2024-04-26T11:13:51.986 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:51.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.987 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:51.987 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.967967+0000", 2024-04-26T11:13:51.987 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4229999999999997e-05 2024-04-26T11:13:51.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.988 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:51.988 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.967976+0000", 2024-04-26T11:13:51.988 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3569999999999998e-06 2024-04-26T11:13:51.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.988 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.988 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.988 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.967986+0000", 2024-04-26T11:13:51.988 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0416e-05 2024-04-26T11:13:51.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.988 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.988 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:51.988 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.968681+0000", 2024-04-26T11:13:51.988 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00069485499999999997 2024-04-26T11:13:51.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.988 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.989 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:51.989 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.968703+0000", 2024-04-26T11:13:51.989 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1783000000000001e-05 2024-04-26T11:13:51.989 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:51.989 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:51.989 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:51.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.989 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.989 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:43990 5.a 5:5696835b:::benchmark_data_smithi029_44842_object43989:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:51.989 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:51.967909+0000", 2024-04-26T11:13:51.989 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.003714359, 2024-04-26T11:13:51.989 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003911739, 2024-04-26T11:13:51.989 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:51.989 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:51.989 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:51.990 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:51.990 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:51.990 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 43990 2024-04-26T11:13:51.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.990 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:51.990 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.990 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:51.990 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.967909+0000", 2024-04-26T11:13:51.990 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:51.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.990 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.990 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:51.991 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.967909+0000", 2024-04-26T11:13:51.991 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:51.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.991 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:51.991 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.967908+0000", 2024-04-26T11:13:51.991 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:51.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.991 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:51.991 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.968013+0000", 2024-04-26T11:13:51.991 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105194 2024-04-26T11:13:51.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.991 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:51.992 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.968023+0000", 2024-04-26T11:13:51.992 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4590000000000004e-06 2024-04-26T11:13:51.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.992 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.992 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.992 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.968029+0000", 2024-04-26T11:13:51.992 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3829999999999997e-06 2024-04-26T11:13:51.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.992 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.992 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:51.992 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.968069+0000", 2024-04-26T11:13:51.992 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9384000000000001e-05 2024-04-26T11:13:51.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.992 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.992 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:51.993 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.968194+0000", 2024-04-26T11:13:51.993 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012539199999999999 2024-04-26T11:13:51.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.993 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.993 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:51.993 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.968361+0000", 2024-04-26T11:13:51.993 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00016664800000000001 2024-04-26T11:13:51.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.993 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.993 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:51.993 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.970365+0000", 2024-04-26T11:13:51.993 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020040560000000002 2024-04-26T11:13:51.993 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:51.993 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:51.993 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:51.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.994 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.994 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:43992 5.c 5:3a1ad072:::benchmark_data_smithi029_44842_object43991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:51.994 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:51.968304+0000", 2024-04-26T11:13:51.994 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.003319982, 2024-04-26T11:13:51.994 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0035796489999999999, 2024-04-26T11:13:51.994 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:51.994 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:51.994 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:51.994 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:51.994 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:51.994 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 43992 2024-04-26T11:13:51.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.994 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:51.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.995 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:51.995 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.968304+0000", 2024-04-26T11:13:51.995 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:51.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.995 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:51.995 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.968304+0000", 2024-04-26T11:13:51.995 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:51.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.995 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:51.995 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.968303+0000", 2024-04-26T11:13:51.995 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:51.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.996 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.996 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:51.996 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.968368+0000", 2024-04-26T11:13:51.996 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5162999999999999e-05 2024-04-26T11:13:51.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.996 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.996 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:51.996 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.968379+0000", 2024-04-26T11:13:51.996 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0822000000000001e-05 2024-04-26T11:13:51.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.996 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.996 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:51.996 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.968385+0000", 2024-04-26T11:13:51.996 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0820000000000004e-06 2024-04-26T11:13:51.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.997 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:51.997 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.968420+0000", 2024-04-26T11:13:51.997 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5179999999999999e-05 2024-04-26T11:13:51.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.997 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:51.997 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.968519+0000", 2024-04-26T11:13:51.997 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.8845999999999995e-05 2024-04-26T11:13:51.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.997 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:51.997 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.968609+0000", 2024-04-26T11:13:51.997 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.0210999999999994e-05 2024-04-26T11:13:51.997 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:51.998 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:51.998 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:51.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.998 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.998 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:43991 5.7 e24/16 5:e5502e63:::benchmark_data_smithi029_44842_object43990:head v 24'2703, mlcod=24'2700)", 2024-04-26T11:13:51.998 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:51.968501+0000", 2024-04-26T11:13:51.998 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0031222720000000002, 2024-04-26T11:13:51.998 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0034224889999999999, 2024-04-26T11:13:51.998 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:51.998 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:51.998 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:51.998 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.998 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:51.998 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.968501+0000", 2024-04-26T11:13:51.998 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:51.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.999 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.999 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:51.999 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.968501+0000", 2024-04-26T11:13:51.999 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:51.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.999 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.999 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:51.999 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.968501+0000", 2024-04-26T11:13:51.999 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:51.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:51.999 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:51.999 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:51.999 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.968558+0000", 2024-04-26T11:13:52.000 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6745e-05 2024-04-26T11:13:52.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.000 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.000 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.968565+0000", 2024-04-26T11:13:52.000 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4259999999999997e-06 2024-04-26T11:13:52.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.000 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.000 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.968570+0000", 2024-04-26T11:13:52.000 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2009999999999998e-06 2024-04-26T11:13:52.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.000 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.000 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.969688+0000", 2024-04-26T11:13:52.000 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001117561 2024-04-26T11:13:52.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.001 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.001 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.001 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.969707+0000", 2024-04-26T11:13:52.001 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9089e-05 2024-04-26T11:13:52.001 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.001 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.001 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.001 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.001 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:43994 5.e e24/16 5:7d4a5191:::benchmark_data_smithi029_44842_object43993:head v 24'2711, mlcod=24'2708)", 2024-04-26T11:13:52.001 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:51.970631+0000", 2024-04-26T11:13:52.001 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00099210399999999995, 2024-04-26T11:13:52.001 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0013273580000000001, 2024-04-26T11:13:52.002 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.002 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:52.002 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.002 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.002 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.002 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.970631+0000", 2024-04-26T11:13:52.002 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.002 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.002 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.002 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.970631+0000", 2024-04-26T11:13:52.002 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.002 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.003 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.003 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.970631+0000", 2024-04-26T11:13:52.003 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.003 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.003 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.003 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.970737+0000", 2024-04-26T11:13:52.003 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000106259 2024-04-26T11:13:52.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.003 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.003 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.003 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.970745+0000", 2024-04-26T11:13:52.003 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.089e-06 2024-04-26T11:13:52.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.003 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.003 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.004 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.970750+0000", 2024-04-26T11:13:52.004 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4190000000000004e-06 2024-04-26T11:13:52.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.004 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.004 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.004 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.970787+0000", 2024-04-26T11:13:52.004 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7110999999999998e-05 2024-04-26T11:13:52.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.004 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.004 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.004 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.970805+0000", 2024-04-26T11:13:52.004 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8434e-05 2024-04-26T11:13:52.004 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.004 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.004 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.005 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:43997 5.a 5:52130125:::benchmark_data_smithi029_44842_object43996:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:52.005 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:51.970603+0000", 2024-04-26T11:13:52.005 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.001020469, 2024-04-26T11:13:52.005 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0013904620000000001, 2024-04-26T11:13:52.005 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.005 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:52.005 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:52.005 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:52.005 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:52.005 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 43997 2024-04-26T11:13:52.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.005 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.006 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.006 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.970603+0000", 2024-04-26T11:13:52.006 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.006 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.006 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.006 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.970603+0000", 2024-04-26T11:13:52.006 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.006 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.006 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.006 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.970602+0000", 2024-04-26T11:13:52.006 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:52.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.006 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.007 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.007 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.970738+0000", 2024-04-26T11:13:52.007 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000135399 2024-04-26T11:13:52.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.007 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.007 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.970751+0000", 2024-04-26T11:13:52.007 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3606e-05 2024-04-26T11:13:52.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.007 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.007 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.970759+0000", 2024-04-26T11:13:52.007 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8320000000000006e-06 2024-04-26T11:13:52.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.008 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.008 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.970790+0000", 2024-04-26T11:13:52.008 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0620999999999997e-05 2024-04-26T11:13:52.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.008 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.008 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.008 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.970885+0000", 2024-04-26T11:13:52.008 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.5706999999999997e-05 2024-04-26T11:13:52.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.008 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.008 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:52.008 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.971031+0000", 2024-04-26T11:13:52.008 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000145532 2024-04-26T11:13:52.008 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.008 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.008 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.009 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:43998 5.c 5:3160316e:::benchmark_data_smithi029_44842_object43997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:52.009 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:51.970898+0000", 2024-04-26T11:13:52.009 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00072597299999999998, 2024-04-26T11:13:52.009 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0011579680000000001, 2024-04-26T11:13:52.009 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.009 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:52.009 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:52.009 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:52.009 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:52.009 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 43998 2024-04-26T11:13:52.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.009 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.010 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.010 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.970898+0000", 2024-04-26T11:13:52.010 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.010 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.010 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.010 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.970898+0000", 2024-04-26T11:13:52.010 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.010 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.010 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.010 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.970897+0000", 2024-04-26T11:13:52.010 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:52.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.010 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.011 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.011 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.970960+0000", 2024-04-26T11:13:52.011 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3571000000000005e-05 2024-04-26T11:13:52.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.011 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.011 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.970969+0000", 2024-04-26T11:13:52.011 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.1219999999999995e-06 2024-04-26T11:13:52.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.011 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.011 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.970975+0000", 2024-04-26T11:13:52.011 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:13:52.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.012 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.012 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.971014+0000", 2024-04-26T11:13:52.012 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8764999999999999e-05 2024-04-26T11:13:52.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.012 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.012 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.012 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.971164+0000", 2024-04-26T11:13:52.012 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000149872 2024-04-26T11:13:52.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.012 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.012 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:52.012 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.971309+0000", 2024-04-26T11:13:52.012 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014482199999999999 2024-04-26T11:13:52.012 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.012 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.012 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.013 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.013 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop_reply(client.4534.0:43976 5.6 e24/16)", 2024-04-26T11:13:52.013 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:51.972069+0000", 2024-04-26T11:13:52.013 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9995542, 2024-04-26T11:13:52.013 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1475000000000003e-05, 2024-04-26T11:13:52.013 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.013 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:52.013 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.013 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.013 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.013 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972069+0000", 2024-04-26T11:13:52.013 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.013 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.014 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.014 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972069+0000", 2024-04-26T11:13:52.014 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.014 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.014 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972069+0000", 2024-04-26T11:13:52.014 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.014 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.014 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972073+0000", 2024-04-26T11:13:52.014 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7799999999999998e-06 2024-04-26T11:13:52.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.015 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.015 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972080+0000", 2024-04-26T11:13:52.015 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2660000000000004e-06 2024-04-26T11:13:52.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.015 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.015 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972085+0000", 2024-04-26T11:13:52.015 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8130000000000003e-06 2024-04-26T11:13:52.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.015 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.015 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972119+0000", 2024-04-26T11:13:52.015 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4031e-05 2024-04-26T11:13:52.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.016 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.016 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972127+0000", 2024-04-26T11:13:52.016 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2670000000000006e-06 2024-04-26T11:13:52.016 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.016 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.016 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.016 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.016 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop_reply(client.4534.0:43990 5.a e24/16)", 2024-04-26T11:13:52.016 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:51.972133+0000", 2024-04-26T11:13:52.016 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9994903, 2024-04-26T11:13:52.016 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1857000000000001e-05, 2024-04-26T11:13:52.016 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.016 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:13:52.016 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.017 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.017 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972133+0000", 2024-04-26T11:13:52.017 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.017 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.017 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972133+0000", 2024-04-26T11:13:52.017 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.017 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.017 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972133+0000", 2024-04-26T11:13:52.017 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.018 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.018 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972138+0000", 2024-04-26T11:13:52.018 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2809999999999999e-06 2024-04-26T11:13:52.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.018 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.018 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.018 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972146+0000", 2024-04-26T11:13:52.018 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8129999999999996e-06 2024-04-26T11:13:52.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.018 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.018 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.018 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972152+0000", 2024-04-26T11:13:52.018 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3690000000000003e-06 2024-04-26T11:13:52.018 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.018 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.019 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.019 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.019 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:43995 5.e e24/16)", 2024-04-26T11:13:52.019 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:51.972159+0000", 2024-04-26T11:13:52.019 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9994645, 2024-04-26T11:13:52.019 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3116999999999997e-05, 2024-04-26T11:13:52.019 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.019 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:13:52.019 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.019 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.019 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.019 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972159+0000", 2024-04-26T11:13:52.019 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.020 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.020 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972159+0000", 2024-04-26T11:13:52.020 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.020 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.020 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972159+0000", 2024-04-26T11:13:52.020 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.020 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.020 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972191+0000", 2024-04-26T11:13:52.020 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2153000000000002e-05 2024-04-26T11:13:52.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.021 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.021 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972197+0000", 2024-04-26T11:13:52.021 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4139999999999999e-06 2024-04-26T11:13:52.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.021 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.021 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.021 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972206+0000", 2024-04-26T11:13:52.021 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2409999999999995e-06 2024-04-26T11:13:52.021 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.021 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.021 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.021 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.021 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:43999 5.b e24/16)", 2024-04-26T11:13:52.021 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:51.972211+0000", 2024-04-26T11:13:52.022 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.999413, 2024-04-26T11:13:52.022 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2148e-05, 2024-04-26T11:13:52.022 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.022 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:13:52.022 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.022 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.022 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972211+0000", 2024-04-26T11:13:52.022 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.022 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.022 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972211+0000", 2024-04-26T11:13:52.022 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.023 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.023 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.023 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972210+0000", 2024-04-26T11:13:52.023 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.023 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.023 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.023 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972237+0000", 2024-04-26T11:13:52.023 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6883e-05 2024-04-26T11:13:52.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.023 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.023 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.023 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972243+0000", 2024-04-26T11:13:52.023 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2240000000000003e-06 2024-04-26T11:13:52.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.024 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.024 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.024 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972246+0000", 2024-04-26T11:13:52.024 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.174e-06 2024-04-26T11:13:52.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.024 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.024 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.024 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972275+0000", 2024-04-26T11:13:52.024 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9476e-05 2024-04-26T11:13:52.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.024 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.024 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.024 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.972292+0000", 2024-04-26T11:13:52.024 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6305000000000001e-05 2024-04-26T11:13:52.024 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.024 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.025 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.025 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.025 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:13:52.025 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 14 2024-04-26T11:13:52.025 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:13:52.026 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:13:52.027 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:52.024+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:52.127 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:52.125+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:52.210 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:13:52.211 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:13:52.211 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:13:52.211 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:13:52.211 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:13:52.227 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:13:52.269 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:52.266+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:52.329 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:52.327+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:52.411 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 14 15 45075 45060 201.145 139.188 0.00854682 0.00496748 2024-04-26T11:13:52.430 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:52.428+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:52.453 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:13:52.453 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:13:52.453 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:13:52.453 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:13:52.453 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.453 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:18846 5.3 5:c95f8f7f:::benchmark_data_smithi029_44842_object18845:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T11:13:52.453 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:42.872799+0000", 2024-04-26T11:13:52.453 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 9.5765897310000003, 2024-04-26T11:13:52.453 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.014816975, 2024-04-26T11:13:52.453 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.454 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:52.454 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:52.454 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:52.454 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:52.454 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 18846 2024-04-26T11:13:52.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.454 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.454 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.454 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.454 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.872799+0000", 2024-04-26T11:13:52.454 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.454 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.454 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.455 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.872799+0000", 2024-04-26T11:13:52.455 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.455 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.455 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.455 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.872798+0000", 2024-04-26T11:13:52.455 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.455 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.455 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.455 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.872859+0000", 2024-04-26T11:13:52.455 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1165000000000001e-05 2024-04-26T11:13:52.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.455 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.455 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.456 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.872864+0000", 2024-04-26T11:13:52.456 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4989999999999996e-06 2024-04-26T11:13:52.456 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.456 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.456 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.456 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.872867+0000", 2024-04-26T11:13:52.456 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3280000000000002e-06 2024-04-26T11:13:52.456 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.456 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.456 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.456 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.877233+0000", 2024-04-26T11:13:52.456 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.004366361 2024-04-26T11:13:52.456 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.456 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.456 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.457 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.877306+0000", 2024-04-26T11:13:52.457 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2935000000000006e-05 2024-04-26T11:13:52.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.457 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.457 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:52.457 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.877392+0000", 2024-04-26T11:13:52.457 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5982000000000004e-05 2024-04-26T11:13:52.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.457 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.457 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:52.457 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.882799+0000", 2024-04-26T11:13:52.457 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0054068930000000003 2024-04-26T11:13:52.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.457 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.457 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:52.458 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.887562+0000", 2024-04-26T11:13:52.458 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0047625080000000004 2024-04-26T11:13:52.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.458 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.458 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:52.458 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.887593+0000", 2024-04-26T11:13:52.458 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0868999999999999e-05 2024-04-26T11:13:52.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.458 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.458 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:52.458 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.887615+0000", 2024-04-26T11:13:52.458 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2849000000000001e-05 2024-04-26T11:13:52.458 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.458 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.458 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.459 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.459 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:18854 5.3 5:c9f544d2:::benchmark_data_smithi029_44842_object18853:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T11:13:52.459 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:42.875830+0000", 2024-04-26T11:13:52.459 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 9.5735583230000003, 2024-04-26T11:13:52.459 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.014783163, 2024-04-26T11:13:52.459 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.459 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:52.459 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:52.459 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:52.459 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:52.459 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 18854 2024-04-26T11:13:52.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.459 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.460 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.460 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.460 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.875830+0000", 2024-04-26T11:13:52.460 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.460 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.460 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.460 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.875830+0000", 2024-04-26T11:13:52.460 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.460 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.460 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.460 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.875829+0000", 2024-04-26T11:13:52.460 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.461 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.461 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.875898+0000", 2024-04-26T11:13:52.461 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8206000000000004e-05 2024-04-26T11:13:52.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.461 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.461 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.875904+0000", 2024-04-26T11:13:52.461 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6309999999999997e-06 2024-04-26T11:13:52.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.461 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.461 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.875910+0000", 2024-04-26T11:13:52.461 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9309999999999996e-06 2024-04-26T11:13:52.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.462 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.462 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.462 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.880816+0000", 2024-04-26T11:13:52.462 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0049059280000000004 2024-04-26T11:13:52.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.462 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.462 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.462 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.880885+0000", 2024-04-26T11:13:52.462 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9401999999999997e-05 2024-04-26T11:13:52.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.462 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.462 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:52.462 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.880962+0000", 2024-04-26T11:13:52.462 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7065999999999997e-05 2024-04-26T11:13:52.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.463 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.463 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:52.463 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.883260+0000", 2024-04-26T11:13:52.463 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022976120000000001 2024-04-26T11:13:52.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.463 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.463 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:52.463 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.890549+0000", 2024-04-26T11:13:52.463 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0072887050000000004 2024-04-26T11:13:52.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.463 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.463 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:52.463 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.890580+0000", 2024-04-26T11:13:52.463 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1380000000000001e-05 2024-04-26T11:13:52.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.464 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.464 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:52.464 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:42.890613+0000", 2024-04-26T11:13:52.464 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2913000000000001e-05 2024-04-26T11:13:52.464 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.464 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.464 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.464 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.464 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:32247 5.c 5:3dd2b787:::benchmark_data_smithi029_44842_object32246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:52.464 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.259409+0000", 2024-04-26T11:13:52.464 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 5.1899794860000004, 2024-04-26T11:13:52.464 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015090465000000001, 2024-04-26T11:13:52.464 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.464 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:52.464 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:52.465 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:52.465 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:52.465 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 32247 2024-04-26T11:13:52.465 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.465 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.465 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.465 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.465 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.259409+0000", 2024-04-26T11:13:52.465 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.465 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.465 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.465 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.465 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.259409+0000", 2024-04-26T11:13:52.465 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.466 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.466 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.466 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.259408+0000", 2024-04-26T11:13:52.466 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.466 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.466 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.466 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.259439+0000", 2024-04-26T11:13:52.466 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0954999999999998e-05 2024-04-26T11:13:52.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.466 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.466 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.466 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.259447+0000", 2024-04-26T11:13:52.466 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2230000000000007e-06 2024-04-26T11:13:52.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.467 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.467 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.259458+0000", 2024-04-26T11:13:52.467 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0586e-05 2024-04-26T11:13:52.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.467 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.467 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.260834+0000", 2024-04-26T11:13:52.467 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00137634 2024-04-26T11:13:52.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.468 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.468 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.468 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.260957+0000", 2024-04-26T11:13:52.468 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012241199999999999 2024-04-26T11:13:52.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.468 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.468 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:52.468 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.261091+0000", 2024-04-26T11:13:52.468 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000133817 2024-04-26T11:13:52.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.468 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.468 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:52.468 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.267473+0000", 2024-04-26T11:13:52.468 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0063827119999999996 2024-04-26T11:13:52.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.469 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:52.469 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.274410+0000", 2024-04-26T11:13:52.469 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069364020000000004 2024-04-26T11:13:52.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.469 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:52.469 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.274465+0000", 2024-04-26T11:13:52.469 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4987000000000001e-05 2024-04-26T11:13:52.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.469 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:52.469 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.274499+0000", 2024-04-26T11:13:52.469 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4554999999999997e-05 2024-04-26T11:13:52.470 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.470 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.470 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.470 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.470 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:32823 5.6 5:6cacaef4:::benchmark_data_smithi029_44842_object32822:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:52.470 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.459516+0000", 2024-04-26T11:13:52.470 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.9898726609999997, 2024-04-26T11:13:52.470 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.01540511, 2024-04-26T11:13:52.470 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.470 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:52.470 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:52.470 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:52.471 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:52.471 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 32823 2024-04-26T11:13:52.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.471 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.471 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.471 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.471 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.459516+0000", 2024-04-26T11:13:52.471 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.471 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.471 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.471 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.459516+0000", 2024-04-26T11:13:52.471 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.471 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.471 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.472 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.459515+0000", 2024-04-26T11:13:52.472 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:52.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.472 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.472 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.472 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.459578+0000", 2024-04-26T11:13:52.472 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3318999999999995e-05 2024-04-26T11:13:52.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.472 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.472 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.472 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.459586+0000", 2024-04-26T11:13:52.472 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9179999999999994e-06 2024-04-26T11:13:52.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.472 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.473 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.473 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.459591+0000", 2024-04-26T11:13:52.473 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3720000000000004e-06 2024-04-26T11:13:52.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.473 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.473 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.460740+0000", 2024-04-26T11:13:52.473 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00114861 2024-04-26T11:13:52.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.473 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.473 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.460833+0000", 2024-04-26T11:13:52.473 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3125e-05 2024-04-26T11:13:52.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.474 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:52.474 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.460973+0000", 2024-04-26T11:13:52.474 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013959000000000001 2024-04-26T11:13:52.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.474 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:52.474 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.463853+0000", 2024-04-26T11:13:52.474 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002880549 2024-04-26T11:13:52.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.474 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:52.474 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.474871+0000", 2024-04-26T11:13:52.474 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011017469 2024-04-26T11:13:52.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.475 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:52.475 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.474899+0000", 2024-04-26T11:13:52.475 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8580000000000001e-05 2024-04-26T11:13:52.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.475 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:52.475 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.474921+0000", 2024-04-26T11:13:52.475 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1316000000000001e-05 2024-04-26T11:13:52.475 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.475 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.475 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.476 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:33820 5.3 5:cfcfda3f:::benchmark_data_smithi029_44842_object33819:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:52.476 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.801167+0000", 2024-04-26T11:13:52.476 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.6482212360000004, 2024-04-26T11:13:52.476 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015083233, 2024-04-26T11:13:52.476 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.476 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:52.476 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:52.476 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:52.476 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:52.476 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 33820 2024-04-26T11:13:52.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.476 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.476 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.476 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.477 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.801167+0000", 2024-04-26T11:13:52.477 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.477 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.477 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.477 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.801167+0000", 2024-04-26T11:13:52.477 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.477 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.477 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.477 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.801166+0000", 2024-04-26T11:13:52.478 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.478 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.478 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.478 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.801195+0000", 2024-04-26T11:13:52.478 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8683e-05 2024-04-26T11:13:52.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.479 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.479 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.479 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.801202+0000", 2024-04-26T11:13:52.479 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3999999999999997e-06 2024-04-26T11:13:52.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.479 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.479 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.479 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.801205+0000", 2024-04-26T11:13:52.479 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9090000000000002e-06 2024-04-26T11:13:52.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.479 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.479 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.481 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.803951+0000", 2024-04-26T11:13:52.481 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0027452520000000001 2024-04-26T11:13:52.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.481 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.481 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.481 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804073+0000", 2024-04-26T11:13:52.482 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012266600000000001 2024-04-26T11:13:52.482 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.482 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.482 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:52.482 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804212+0000", 2024-04-26T11:13:52.482 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013901899999999999 2024-04-26T11:13:52.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.483 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.483 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:52.483 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.811894+0000", 2024-04-26T11:13:52.483 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0076815049999999999 2024-04-26T11:13:52.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.483 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.483 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:52.484 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.816195+0000", 2024-04-26T11:13:52.484 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.004300669 2024-04-26T11:13:52.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.484 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.484 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:52.484 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.816226+0000", 2024-04-26T11:13:52.484 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1223000000000002e-05 2024-04-26T11:13:52.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.485 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.485 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:52.485 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.816250+0000", 2024-04-26T11:13:52.485 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4485e-05 2024-04-26T11:13:52.486 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.486 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.486 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.486 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.486 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:33826 5.3 5:c4100d2e:::benchmark_data_smithi029_44842_object33825:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:52.487 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.804001+0000", 2024-04-26T11:13:52.487 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.6453867750000004, 2024-04-26T11:13:52.487 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015655404000000001, 2024-04-26T11:13:52.487 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.487 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:52.487 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:52.488 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:52.488 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:52.488 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 33826 2024-04-26T11:13:52.488 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.488 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.488 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.488 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.489 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804001+0000", 2024-04-26T11:13:52.489 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.489 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.489 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.489 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804001+0000", 2024-04-26T11:13:52.489 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.490 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.490 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.490 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804001+0000", 2024-04-26T11:13:52.490 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:52.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.491 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.491 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.491 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804056+0000", 2024-04-26T11:13:52.491 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5285999999999999e-05 2024-04-26T11:13:52.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.491 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.492 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.492 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804065+0000", 2024-04-26T11:13:52.492 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.8589999999999994e-06 2024-04-26T11:13:52.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.492 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.492 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.492 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804083+0000", 2024-04-26T11:13:52.493 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7949999999999999e-05 2024-04-26T11:13:52.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.493 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.493 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.493 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.806510+0000", 2024-04-26T11:13:52.493 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0024274930000000002 2024-04-26T11:13:52.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.494 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.494 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.494 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.806622+0000", 2024-04-26T11:13:52.494 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000111675 2024-04-26T11:13:52.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.494 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.495 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:52.495 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.806769+0000", 2024-04-26T11:13:52.495 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000147312 2024-04-26T11:13:52.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.495 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.495 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:52.496 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812012+0000", 2024-04-26T11:13:52.496 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0052431580000000004 2024-04-26T11:13:52.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.496 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.496 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:52.496 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.819580+0000", 2024-04-26T11:13:52.497 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0075680410000000002 2024-04-26T11:13:52.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.497 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.497 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:52.497 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.819618+0000", 2024-04-26T11:13:52.497 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7622e-05 2024-04-26T11:13:52.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.498 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.498 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:52.498 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.819657+0000", 2024-04-26T11:13:52.498 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8868999999999997e-05 2024-04-26T11:13:52.498 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.498 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.499 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.499 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.499 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:33827 5.3 5:c927f878:::benchmark_data_smithi029_44842_object33826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:52.499 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.804106+0000", 2024-04-26T11:13:52.499 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.6452823930000005, 2024-04-26T11:13:52.499 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.017369738999999999, 2024-04-26T11:13:52.500 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.500 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:52.500 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:52.500 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:52.500 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:52.500 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 33827 2024-04-26T11:13:52.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.501 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.501 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.501 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.501 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804106+0000", 2024-04-26T11:13:52.501 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.502 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.502 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.502 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804106+0000", 2024-04-26T11:13:52.502 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.503 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.503 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.503 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804105+0000", 2024-04-26T11:13:52.503 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.503 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.504 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.504 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804138+0000", 2024-04-26T11:13:52.504 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3172e-05 2024-04-26T11:13:52.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.504 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.504 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.504 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804146+0000", 2024-04-26T11:13:52.505 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.204e-06 2024-04-26T11:13:52.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.505 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.505 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.505 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804153+0000", 2024-04-26T11:13:52.505 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0940000000000002e-06 2024-04-26T11:13:52.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.506 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.506 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.506 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812034+0000", 2024-04-26T11:13:52.506 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0078809210000000008 2024-04-26T11:13:52.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.507 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.507 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.507 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812181+0000", 2024-04-26T11:13:52.507 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014739199999999999 2024-04-26T11:13:52.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.507 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.508 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:52.508 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812284+0000", 2024-04-26T11:13:52.508 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000103453 2024-04-26T11:13:52.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.508 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.508 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:52.509 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.814699+0000", 2024-04-26T11:13:52.509 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002415043 2024-04-26T11:13:52.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.509 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.509 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:52.509 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.821418+0000", 2024-04-26T11:13:52.509 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0067184879999999999 2024-04-26T11:13:52.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.510 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.510 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:52.510 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.821449+0000", 2024-04-26T11:13:52.510 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0763999999999999e-05 2024-04-26T11:13:52.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.511 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.511 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:52.511 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.821476+0000", 2024-04-26T11:13:52.511 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6889999999999998e-05 2024-04-26T11:13:52.511 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.511 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.512 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.512 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.512 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:33828 5.b e22/16 5:d3313e8b:::benchmark_data_smithi029_44842_object33827:head v 22'2195, mlcod=22'2192)", 2024-04-26T11:13:52.512 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.805391+0000", 2024-04-26T11:13:52.512 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.6439968089999999, 2024-04-26T11:13:52.513 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016105534000000001, 2024-04-26T11:13:52.513 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.513 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:52.513 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.513 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.513 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.514 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.805391+0000", 2024-04-26T11:13:52.514 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.514 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.514 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.514 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.805391+0000", 2024-04-26T11:13:52.515 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.515 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.515 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.515 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.805391+0000", 2024-04-26T11:13:52.515 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.516 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.516 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.516 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.805484+0000", 2024-04-26T11:13:52.516 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2740999999999999e-05 2024-04-26T11:13:52.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.517 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.517 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.517 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.805492+0000", 2024-04-26T11:13:52.517 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.8799999999999997e-06 2024-04-26T11:13:52.517 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.517 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.517 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.518 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.805498+0000", 2024-04-26T11:13:52.518 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3510000000000001e-06 2024-04-26T11:13:52.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.518 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.518 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.519 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.811898+0000", 2024-04-26T11:13:52.519 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0063998040000000003 2024-04-26T11:13:52.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.519 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.519 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.519 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.811919+0000", 2024-04-26T11:13:52.520 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1246e-05 2024-04-26T11:13:52.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.520 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.520 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:52.520 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.821478+0000", 2024-04-26T11:13:52.520 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0095594779999999997 2024-04-26T11:13:52.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.521 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.521 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:52.521 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.821497+0000", 2024-04-26T11:13:52.521 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8593999999999998e-05 2024-04-26T11:13:52.521 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.522 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.522 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.522 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.522 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:33832 5.3 5:c924c675:::benchmark_data_smithi029_44842_object33831:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:52.522 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.809663+0000", 2024-04-26T11:13:52.523 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.639724857, 2024-04-26T11:13:52.523 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.014777222, 2024-04-26T11:13:52.523 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.523 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:52.523 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:52.523 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:52.524 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:52.524 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 33832 2024-04-26T11:13:52.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.524 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.524 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.524 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.524 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.809663+0000", 2024-04-26T11:13:52.524 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.525 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.525 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.525 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.809663+0000", 2024-04-26T11:13:52.525 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.525 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.525 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.525 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.809662+0000", 2024-04-26T11:13:52.525 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999986 2024-04-26T11:13:52.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.526 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.526 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.526 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.809769+0000", 2024-04-26T11:13:52.526 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000107302 2024-04-26T11:13:52.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.526 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.526 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.526 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.809779+0000", 2024-04-26T11:13:52.526 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.329e-06 2024-04-26T11:13:52.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.527 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.527 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.527 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.809786+0000", 2024-04-26T11:13:52.527 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5859999999999999e-06 2024-04-26T11:13:52.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.527 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.527 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.527 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.814745+0000", 2024-04-26T11:13:52.527 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0049585499999999999 2024-04-26T11:13:52.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.527 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.527 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.528 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.814903+0000", 2024-04-26T11:13:52.528 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015823700000000001 2024-04-26T11:13:52.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.528 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.528 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:52.528 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.815060+0000", 2024-04-26T11:13:52.528 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015646799999999999 2024-04-26T11:13:52.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.528 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.528 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:52.528 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.822994+0000", 2024-04-26T11:13:52.528 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0079339159999999992 2024-04-26T11:13:52.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.528 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.528 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:52.529 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.824338+0000", 2024-04-26T11:13:52.529 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0013444959999999999 2024-04-26T11:13:52.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.529 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.529 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:52.529 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.824388+0000", 2024-04-26T11:13:52.529 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.9592999999999998e-05 2024-04-26T11:13:52.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.529 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.529 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:52.529 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.824441+0000", 2024-04-26T11:13:52.529 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2961999999999999e-05 2024-04-26T11:13:52.529 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.529 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.530 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.530 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.530 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:35482 5.b e23/16 5:d2b3ef95:::benchmark_data_smithi029_44842_object35481:head v 23'2303, mlcod=23'2300)", 2024-04-26T11:13:52.530 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:48.420993+0000", 2024-04-26T11:13:52.530 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.02839569, 2024-04-26T11:13:52.530 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016814145999999999, 2024-04-26T11:13:52.530 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.530 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:52.530 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.530 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.530 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.530 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.420993+0000", 2024-04-26T11:13:52.530 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.531 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.531 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.531 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.420993+0000", 2024-04-26T11:13:52.531 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.531 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.531 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.531 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.420992+0000", 2024-04-26T11:13:52.531 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.531 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.531 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.531 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.421020+0000", 2024-04-26T11:13:52.532 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8422999999999999e-05 2024-04-26T11:13:52.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.532 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.532 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.421027+0000", 2024-04-26T11:13:52.532 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3060000000000003e-06 2024-04-26T11:13:52.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.532 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.532 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.421031+0000", 2024-04-26T11:13:52.532 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4100000000000001e-06 2024-04-26T11:13:52.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.532 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.532 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.421848+0000", 2024-04-26T11:13:52.532 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00081644900000000002 2024-04-26T11:13:52.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.533 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.421866+0000", 2024-04-26T11:13:52.533 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8702000000000002e-05 2024-04-26T11:13:52.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:52.533 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.437769+0000", 2024-04-26T11:13:52.533 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015902195000000001 2024-04-26T11:13:52.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:52.533 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.437807+0000", 2024-04-26T11:13:52.534 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8170000000000002e-05 2024-04-26T11:13:52.534 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.534 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.534 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.534 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:35483 5.b e23/16 5:d3dd14f6:::benchmark_data_smithi029_44842_object35482:head v 23'2304, mlcod=23'2300)", 2024-04-26T11:13:52.534 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:48.422102+0000", 2024-04-26T11:13:52.534 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.02728646, 2024-04-26T11:13:52.534 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.017674038, 2024-04-26T11:13:52.534 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.534 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:52.534 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.534 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.535 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422102+0000", 2024-04-26T11:13:52.535 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.535 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.535 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.535 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422102+0000", 2024-04-26T11:13:52.535 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.535 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.535 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.535 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422101+0000", 2024-04-26T11:13:52.535 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.535 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.535 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.536 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422129+0000", 2024-04-26T11:13:52.536 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8277999999999999e-05 2024-04-26T11:13:52.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.536 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.536 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.536 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422139+0000", 2024-04-26T11:13:52.536 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1290000000000002e-06 2024-04-26T11:13:52.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.536 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.536 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.536 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422145+0000", 2024-04-26T11:13:52.536 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7490000000000001e-06 2024-04-26T11:13:52.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.536 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.536 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.536 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423217+0000", 2024-04-26T11:13:52.537 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0010718539999999999 2024-04-26T11:13:52.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.537 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.537 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423234+0000", 2024-04-26T11:13:52.537 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6602000000000001e-05 2024-04-26T11:13:52.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.537 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:52.537 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439742+0000", 2024-04-26T11:13:52.537 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016508061000000001 2024-04-26T11:13:52.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.537 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:52.538 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439776+0000", 2024-04-26T11:13:52.538 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3992000000000003e-05 2024-04-26T11:13:52.538 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.538 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.538 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.538 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:35492 5.1 e23/16 5:8e0c53f7:::benchmark_data_smithi029_44842_object35491:head v 23'2229, mlcod=23'2227)", 2024-04-26T11:13:52.538 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:48.422953+0000", 2024-04-26T11:13:52.538 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.0264350799999997, 2024-04-26T11:13:52.538 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.014783304000000001, 2024-04-26T11:13:52.538 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.538 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:52.538 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.539 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.539 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422953+0000", 2024-04-26T11:13:52.539 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.539 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.539 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422953+0000", 2024-04-26T11:13:52.539 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.539 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.539 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422949+0000", 2024-04-26T11:13:52.539 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999952 2024-04-26T11:13:52.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.540 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.540 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423067+0000", 2024-04-26T11:13:52.540 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011856 2024-04-26T11:13:52.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.540 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.540 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423077+0000", 2024-04-26T11:13:52.540 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0368e-05 2024-04-26T11:13:52.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.540 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.540 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423089+0000", 2024-04-26T11:13:52.540 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1433e-05 2024-04-26T11:13:52.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.541 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.541 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423126+0000", 2024-04-26T11:13:52.541 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7499000000000001e-05 2024-04-26T11:13:52.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.541 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.541 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423146+0000", 2024-04-26T11:13:52.541 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9372999999999999e-05 2024-04-26T11:13:52.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.541 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:52.541 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.437695+0000", 2024-04-26T11:13:52.541 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.014549242 2024-04-26T11:13:52.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.542 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.542 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:52.542 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.437736+0000", 2024-04-26T11:13:52.542 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1451e-05 2024-04-26T11:13:52.542 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.542 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.542 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.542 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.542 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:35493 5.8 e23/16 5:14785d1e:::benchmark_data_smithi029_44842_object35492:head v 23'2253, mlcod=23'2250)", 2024-04-26T11:13:52.542 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:48.422959+0000", 2024-04-26T11:13:52.542 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.0264288830000003, 2024-04-26T11:13:52.542 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016788944, 2024-04-26T11:13:52.542 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.542 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:52.543 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.543 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.543 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.543 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422959+0000", 2024-04-26T11:13:52.543 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.543 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.543 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.543 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422959+0000", 2024-04-26T11:13:52.543 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.543 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.543 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.543 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422959+0000", 2024-04-26T11:13:52.543 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.544 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.544 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.544 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423085+0000", 2024-04-26T11:13:52.544 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012600299999999999 2024-04-26T11:13:52.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.544 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.544 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.544 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423093+0000", 2024-04-26T11:13:52.544 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2339999999999994e-06 2024-04-26T11:13:52.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.544 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.544 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.544 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423099+0000", 2024-04-26T11:13:52.544 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3659999999999997e-06 2024-04-26T11:13:52.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.545 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.545 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.545 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423130+0000", 2024-04-26T11:13:52.545 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0518999999999997e-05 2024-04-26T11:13:52.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.545 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.545 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.545 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423147+0000", 2024-04-26T11:13:52.545 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6997e-05 2024-04-26T11:13:52.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.545 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.545 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:52.545 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439721+0000", 2024-04-26T11:13:52.545 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016574185000000002 2024-04-26T11:13:52.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.546 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.546 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:52.546 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439748+0000", 2024-04-26T11:13:52.546 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7131000000000002e-05 2024-04-26T11:13:52.546 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.546 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.546 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.546 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.546 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:35494 5.4 e23/16 5:2687a65a:::benchmark_data_smithi029_44842_object35493:head v 23'2185, mlcod=23'2181)", 2024-04-26T11:13:52.546 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:48.423109+0000", 2024-04-26T11:13:52.546 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.0262790879999999, 2024-04-26T11:13:52.546 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016693116000000001, 2024-04-26T11:13:52.546 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.547 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:52.547 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.547 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.547 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423109+0000", 2024-04-26T11:13:52.547 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.547 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.547 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423109+0000", 2024-04-26T11:13:52.547 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.547 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.547 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423109+0000", 2024-04-26T11:13:52.548 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.548 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.548 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.548 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423143+0000", 2024-04-26T11:13:52.548 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3980999999999999e-05 2024-04-26T11:13:52.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.548 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.548 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.548 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423150+0000", 2024-04-26T11:13:52.548 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3080000000000002e-06 2024-04-26T11:13:52.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.548 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.548 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.548 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423155+0000", 2024-04-26T11:13:52.548 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1529999999999996e-06 2024-04-26T11:13:52.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.549 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.549 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.549 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423182+0000", 2024-04-26T11:13:52.549 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7158e-05 2024-04-26T11:13:52.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.549 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.549 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.549 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423199+0000", 2024-04-26T11:13:52.549 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6478999999999999e-05 2024-04-26T11:13:52.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.549 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.549 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:52.550 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439769+0000", 2024-04-26T11:13:52.550 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016570519999999998 2024-04-26T11:13:52.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.550 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.550 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:52.550 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439802+0000", 2024-04-26T11:13:52.550 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2963999999999998e-05 2024-04-26T11:13:52.550 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.550 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.550 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.550 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.550 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:35496 5.2 e23/16 5:422c3e1d:::benchmark_data_smithi029_44842_object35495:head v 23'2188, mlcod=23'2186)", 2024-04-26T11:13:52.550 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:48.423315+0000", 2024-04-26T11:13:52.550 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.0260735299999997, 2024-04-26T11:13:52.551 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016628417, 2024-04-26T11:13:52.551 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.551 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:52.551 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.551 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.551 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.551 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423315+0000", 2024-04-26T11:13:52.551 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.551 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.551 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.551 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423315+0000", 2024-04-26T11:13:52.551 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.551 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.552 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.552 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423314+0000", 2024-04-26T11:13:52.552 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.552 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.552 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.552 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423376+0000", 2024-04-26T11:13:52.552 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1909999999999995e-05 2024-04-26T11:13:52.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.552 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.552 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.552 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423389+0000", 2024-04-26T11:13:52.552 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3144e-05 2024-04-26T11:13:52.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.552 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.553 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.553 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423396+0000", 2024-04-26T11:13:52.553 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0550000000000002e-06 2024-04-26T11:13:52.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.553 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.553 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.553 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423429+0000", 2024-04-26T11:13:52.553 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2815999999999999e-05 2024-04-26T11:13:52.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.553 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.553 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.553 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423447+0000", 2024-04-26T11:13:52.553 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7555e-05 2024-04-26T11:13:52.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.553 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.554 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:52.554 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439911+0000", 2024-04-26T11:13:52.554 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016464248000000001 2024-04-26T11:13:52.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.554 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.554 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:52.554 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439943+0000", 2024-04-26T11:13:52.554 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2311000000000003e-05 2024-04-26T11:13:52.554 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.554 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.554 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.554 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.554 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:35501 5.7 e23/16 5:e8d3a8de:::benchmark_data_smithi029_44842_object35500:head v 23'2194, mlcod=23'2192)", 2024-04-26T11:13:52.555 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:48.426097+0000", 2024-04-26T11:13:52.555 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.0232910950000003, 2024-04-26T11:13:52.555 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015283450000000001, 2024-04-26T11:13:52.555 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.555 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:52.555 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.555 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.555 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.555 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.426097+0000", 2024-04-26T11:13:52.555 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.555 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.555 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.555 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.555 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.426097+0000", 2024-04-26T11:13:52.556 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.556 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.556 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.556 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.426097+0000", 2024-04-26T11:13:52.556 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.556 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.556 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.556 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.426363+0000", 2024-04-26T11:13:52.556 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00026629799999999999 2024-04-26T11:13:52.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.556 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.556 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.556 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.426371+0000", 2024-04-26T11:13:52.557 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.1359999999999997e-06 2024-04-26T11:13:52.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.557 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.557 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.557 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.426377+0000", 2024-04-26T11:13:52.557 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:13:52.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.557 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.557 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.557 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.426411+0000", 2024-04-26T11:13:52.557 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4042999999999999e-05 2024-04-26T11:13:52.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.557 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.557 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.557 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.426429+0000", 2024-04-26T11:13:52.558 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7608000000000001e-05 2024-04-26T11:13:52.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.558 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.558 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:52.558 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.441347+0000", 2024-04-26T11:13:52.558 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.014917972 2024-04-26T11:13:52.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.558 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.558 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:52.558 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.441381+0000", 2024-04-26T11:13:52.558 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4056000000000001e-05 2024-04-26T11:13:52.558 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.558 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.558 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.559 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.559 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:35536 5.5 5:acc6d5ae:::benchmark_data_smithi029_44842_object35535:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:52.559 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:48.445093+0000", 2024-04-26T11:13:52.559 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.0042951860000002, 2024-04-26T11:13:52.559 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015420552000000001, 2024-04-26T11:13:52.559 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.559 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:52.559 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:52.559 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:52.559 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:52.559 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 35536 2024-04-26T11:13:52.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.559 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.559 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.559 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.560 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.445093+0000", 2024-04-26T11:13:52.560 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.560 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.560 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.560 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.445093+0000", 2024-04-26T11:13:52.560 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.560 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.560 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.560 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.445092+0000", 2024-04-26T11:13:52.560 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:52.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.560 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.560 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.560 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.445251+0000", 2024-04-26T11:13:52.561 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015830999999999999 2024-04-26T11:13:52.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.561 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.561 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.561 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.445260+0000", 2024-04-26T11:13:52.561 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4720000000000001e-06 2024-04-26T11:13:52.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.561 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.561 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.561 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.445266+0000", 2024-04-26T11:13:52.561 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2430000000000002e-06 2024-04-26T11:13:52.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.561 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.561 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.561 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.446759+0000", 2024-04-26T11:13:52.562 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0014926570000000001 2024-04-26T11:13:52.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.562 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.562 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.562 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.446860+0000", 2024-04-26T11:13:52.562 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100628 2024-04-26T11:13:52.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.562 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.562 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:52.562 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.446940+0000", 2024-04-26T11:13:52.562 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0201e-05 2024-04-26T11:13:52.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.562 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.562 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:52.563 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.447900+0000", 2024-04-26T11:13:52.563 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00095980999999999996 2024-04-26T11:13:52.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.563 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.563 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:52.563 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.460464+0000", 2024-04-26T11:13:52.563 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.012564594 2024-04-26T11:13:52.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.563 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.563 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:52.563 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.460494+0000", 2024-04-26T11:13:52.563 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.959e-05 2024-04-26T11:13:52.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.563 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.563 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:52.564 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.460514+0000", 2024-04-26T11:13:52.564 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9851e-05 2024-04-26T11:13:52.564 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.564 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.564 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.564 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.564 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.564 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:38062 5.c 5:3a6c0710:::benchmark_data_smithi029_44842_object38061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:52.564 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:49.385419+0000", 2024-04-26T11:13:52.564 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 3.063969707, 2024-04-26T11:13:52.564 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016211069000000002, 2024-04-26T11:13:52.564 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.564 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:52.564 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:52.564 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:52.565 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:52.565 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 38062 2024-04-26T11:13:52.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.565 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.565 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.565 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.565 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.385419+0000", 2024-04-26T11:13:52.565 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.565 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.565 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.565 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.385419+0000", 2024-04-26T11:13:52.565 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.565 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.565 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.566 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.385417+0000", 2024-04-26T11:13:52.566 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999986 2024-04-26T11:13:52.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.566 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.566 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.566 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.385494+0000", 2024-04-26T11:13:52.566 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6596999999999999e-05 2024-04-26T11:13:52.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.566 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.566 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.566 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.385504+0000", 2024-04-26T11:13:52.566 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0543999999999999e-05 2024-04-26T11:13:52.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.566 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.566 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.567 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.385512+0000", 2024-04-26T11:13:52.567 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9850000000000006e-06 2024-04-26T11:13:52.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.567 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.567 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.567 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.390338+0000", 2024-04-26T11:13:52.567 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0048251939999999997 2024-04-26T11:13:52.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.567 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.567 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.567 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.390488+0000", 2024-04-26T11:13:52.567 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015001200000000001 2024-04-26T11:13:52.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.567 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.567 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:52.568 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.390618+0000", 2024-04-26T11:13:52.568 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013007599999999999 2024-04-26T11:13:52.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.568 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.568 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:52.568 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.393270+0000", 2024-04-26T11:13:52.568 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026525810000000002 2024-04-26T11:13:52.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.568 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.568 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:52.568 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.401550+0000", 2024-04-26T11:13:52.568 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0082794749999999997 2024-04-26T11:13:52.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.568 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.568 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:52.568 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.401594+0000", 2024-04-26T11:13:52.569 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209000000000003e-05 2024-04-26T11:13:52.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.569 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.569 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:52.569 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.401630+0000", 2024-04-26T11:13:52.569 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5614999999999997e-05 2024-04-26T11:13:52.569 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.569 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.569 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.569 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.569 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:43949 5.4 e24/16 5:2e5d1e95:::benchmark_data_smithi029_44842_object43948:head v 24'2721, mlcod=24'2718)", 2024-04-26T11:13:52.569 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:51.950062+0000", 2024-04-26T11:13:52.569 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.49932672, 2024-04-26T11:13:52.569 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015047908, 2024-04-26T11:13:52.570 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.570 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:52.570 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.570 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.570 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.570 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.950062+0000", 2024-04-26T11:13:52.570 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.570 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.570 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.570 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.950062+0000", 2024-04-26T11:13:52.570 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.570 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.570 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.571 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.950061+0000", 2024-04-26T11:13:52.571 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.571 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.571 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.571 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.950119+0000", 2024-04-26T11:13:52.571 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8276000000000002e-05 2024-04-26T11:13:52.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.571 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.571 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.571 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.950128+0000", 2024-04-26T11:13:52.571 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3010000000000007e-06 2024-04-26T11:13:52.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.571 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.571 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.572 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.950132+0000", 2024-04-26T11:13:52.572 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8409999999999999e-06 2024-04-26T11:13:52.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.572 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.572 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.572 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.955415+0000", 2024-04-26T11:13:52.572 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0052824550000000001 2024-04-26T11:13:52.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.572 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.572 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.572 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.955434+0000", 2024-04-26T11:13:52.572 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9524000000000001e-05 2024-04-26T11:13:52.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.572 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.572 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:52.572 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.965081+0000", 2024-04-26T11:13:52.573 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0096466929999999996 2024-04-26T11:13:52.573 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.573 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.573 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:52.573 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:51.965109+0000", 2024-04-26T11:13:52.573 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8356000000000001e-05 2024-04-26T11:13:52.573 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.573 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.573 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.573 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.573 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.573 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:44261 5.a 5:5ffcbb94:::benchmark_data_smithi029_44842_object44260:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:52.573 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:52.068966+0000", 2024-04-26T11:13:52.573 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.38042198500000002, 2024-04-26T11:13:52.573 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.014838262, 2024-04-26T11:13:52.574 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:52.574 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:52.574 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:52.574 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:52.574 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:52.574 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 44261 2024-04-26T11:13:52.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.574 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:52.574 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.574 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:52.574 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:52.068966+0000", 2024-04-26T11:13:52.574 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.574 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.574 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:52.575 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:52.068966+0000", 2024-04-26T11:13:52.575 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:52.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.575 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.575 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:52.575 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:52.068965+0000", 2024-04-26T11:13:52.575 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999986 2024-04-26T11:13:52.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.575 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.575 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:52.575 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:52.069126+0000", 2024-04-26T11:13:52.575 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00016154299999999999 2024-04-26T11:13:52.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.575 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.575 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:52.576 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:52.069145+0000", 2024-04-26T11:13:52.576 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8219e-05 2024-04-26T11:13:52.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.576 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.576 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.576 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:52.069153+0000", 2024-04-26T11:13:52.576 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.1240000000000005e-06 2024-04-26T11:13:52.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.576 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.576 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:52.576 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:52.069193+0000", 2024-04-26T11:13:52.576 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0206000000000001e-05 2024-04-26T11:13:52.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.576 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.576 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:52.577 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:52.069337+0000", 2024-04-26T11:13:52.577 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014447700000000001 2024-04-26T11:13:52.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.577 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.577 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:52.577 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:52.069499+0000", 2024-04-26T11:13:52.577 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000161896 2024-04-26T11:13:52.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.577 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.577 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:52.577 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:52.072865+0000", 2024-04-26T11:13:52.577 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0033655930000000001 2024-04-26T11:13:52.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.577 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.577 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:52.578 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:52.083726+0000", 2024-04-26T11:13:52.578 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.010861588 2024-04-26T11:13:52.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.578 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.578 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:52.578 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:52.083768+0000", 2024-04-26T11:13:52.578 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2006999999999999e-05 2024-04-26T11:13:52.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:52.578 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:52.578 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:52.578 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:52.083805+0000", 2024-04-26T11:13:52.578 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6109999999999998e-05 2024-04-26T11:13:52.578 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.578 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.579 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.579 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:52.579 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:52.579 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:13:52.580 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:52.578+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:52.581 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:13:52.681 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:52.679+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:52.749 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:13:52.749 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:13:52.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.749 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:45907 5.d 5:b1a893aa:::benchmark_data_smithi029_44842_object45906:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:52.749 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.742953+0000", 2024-04-26T11:13:52.749 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0043844039999999997, 2024-04-26T11:13:52.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044130150000000002, 2024-04-26T11:13:52.750 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:52.750 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:52.750 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:52.750 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:52.750 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:52.750 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 45907 2024-04-26T11:13:52.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.750 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:52.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:52.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.742953+0000", 2024-04-26T11:13:52.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:52.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:52.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.742953+0000", 2024-04-26T11:13:52.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:52.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:52.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.742952+0000", 2024-04-26T11:13:52.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:52.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.743011+0000", 2024-04-26T11:13:52.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9348000000000002e-05 2024-04-26T11:13:52.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:52.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.743020+0000", 2024-04-26T11:13:52.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1689999999999992e-06 2024-04-26T11:13:52.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.743026+0000", 2024-04-26T11:13:52.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.793e-06 2024-04-26T11:13:52.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:52.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.743056+0000", 2024-04-26T11:13:52.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9507999999999999e-05 2024-04-26T11:13:52.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:52.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.743149+0000", 2024-04-26T11:13:52.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3571000000000002e-05 2024-04-26T11:13:52.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:52.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.743253+0000", 2024-04-26T11:13:52.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103447 2024-04-26T11:13:52.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:52.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.745477+0000", 2024-04-26T11:13:52.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022241840000000001 2024-04-26T11:13:52.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:52.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.747308+0000", 2024-04-26T11:13:52.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018313610000000001 2024-04-26T11:13:52.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:52.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.747350+0000", 2024-04-26T11:13:52.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1857999999999998e-05 2024-04-26T11:13:52.755 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:52.755 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:52.755 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:52.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.755 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:45909 5.4 5:2f988477:::benchmark_data_smithi029_44842_object45908:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:52.756 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.743430+0000", 2024-04-26T11:13:52.756 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0039069159999999999, 2024-04-26T11:13:52.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040395860000000004, 2024-04-26T11:13:52.756 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:52.756 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:52.756 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:52.756 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:52.756 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:52.756 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 45909 2024-04-26T11:13:52.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.756 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:52.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:52.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.743430+0000", 2024-04-26T11:13:52.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:52.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:52.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.743430+0000", 2024-04-26T11:13:52.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:52.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:52.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.743430+0000", 2024-04-26T11:13:52.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:52.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.743500+0000", 2024-04-26T11:13:52.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0945000000000006e-05 2024-04-26T11:13:52.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:52.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.743508+0000", 2024-04-26T11:13:52.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7570000000000004e-06 2024-04-26T11:13:52.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.743515+0000", 2024-04-26T11:13:52.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3450000000000002e-06 2024-04-26T11:13:52.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:52.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.744535+0000", 2024-04-26T11:13:52.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010205290000000001 2024-04-26T11:13:52.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:52.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.744664+0000", 2024-04-26T11:13:52.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128598 2024-04-26T11:13:52.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:52.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.744802+0000", 2024-04-26T11:13:52.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000138586 2024-04-26T11:13:52.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:52.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.746778+0000", 2024-04-26T11:13:52.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0019755699999999998 2024-04-26T11:13:52.761 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:52.761 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:52.761 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:52.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.761 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:45912 5.0 5:0c999425:::benchmark_data_smithi029_44842_object45911:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:52.761 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.744468+0000", 2024-04-26T11:13:52.761 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0028693989999999999, 2024-04-26T11:13:52.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030861759999999999, 2024-04-26T11:13:52.761 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:52.761 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:52.761 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:52.762 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:52.762 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:52.762 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 45912 2024-04-26T11:13:52.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.762 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:52.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:52.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.744468+0000", 2024-04-26T11:13:52.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:52.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:52.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.744468+0000", 2024-04-26T11:13:52.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:52.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:52.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.744467+0000", 2024-04-26T11:13:52.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:52.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.744530+0000", 2024-04-26T11:13:52.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3079999999999999e-05 2024-04-26T11:13:52.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:52.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.744537+0000", 2024-04-26T11:13:52.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3889999999999999e-06 2024-04-26T11:13:52.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.744542+0000", 2024-04-26T11:13:52.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7910000000000004e-06 2024-04-26T11:13:52.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:52.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.744579+0000", 2024-04-26T11:13:52.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6554999999999998e-05 2024-04-26T11:13:52.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:52.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.744701+0000", 2024-04-26T11:13:52.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012210500000000001 2024-04-26T11:13:52.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:52.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.744837+0000", 2024-04-26T11:13:52.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013569400000000001 2024-04-26T11:13:52.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:52.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.747408+0000", 2024-04-26T11:13:52.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002571341 2024-04-26T11:13:52.766 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:52.766 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:52.766 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:52.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.766 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:45915 5.8 5:13aca91a:::benchmark_data_smithi029_44842_object45914:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:52.766 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.745602+0000", 2024-04-26T11:13:52.766 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.001734955, 2024-04-26T11:13:52.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002032528, 2024-04-26T11:13:52.767 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:52.767 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:52.767 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:52.767 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:52.767 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:52.767 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 45915 2024-04-26T11:13:52.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.767 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:52.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:52.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.745602+0000", 2024-04-26T11:13:52.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:52.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:52.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.745602+0000", 2024-04-26T11:13:52.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:52.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:52.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.745601+0000", 2024-04-26T11:13:52.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:52.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:52.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.745649+0000", 2024-04-26T11:13:52.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7927999999999999e-05 2024-04-26T11:13:52.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:52.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.745659+0000", 2024-04-26T11:13:52.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5400000000000001e-06 2024-04-26T11:13:52.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.745665+0000", 2024-04-26T11:13:52.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0850000000000002e-06 2024-04-26T11:13:52.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:52.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.745706+0000", 2024-04-26T11:13:52.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1233999999999999e-05 2024-04-26T11:13:52.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:52.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.745842+0000", 2024-04-26T11:13:52.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013527799999999999 2024-04-26T11:13:52.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:52.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.745978+0000", 2024-04-26T11:13:52.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013691800000000001 2024-04-26T11:13:52.771 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:52.771 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:52.771 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:52.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.771 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:45916 5.d 5:b3b6f2b6:::benchmark_data_smithi029_44842_object45915:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:52.771 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.745673+0000", 2024-04-26T11:13:52.771 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0016640660000000001, 2024-04-26T11:13:52.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020370480000000001, 2024-04-26T11:13:52.771 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:52.771 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:52.772 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:52.772 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:52.772 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:52.772 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 45916 2024-04-26T11:13:52.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.772 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:52.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:52.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.745673+0000", 2024-04-26T11:13:52.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:52.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:52.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.745673+0000", 2024-04-26T11:13:52.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:52.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:52.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.745673+0000", 2024-04-26T11:13:52.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:52.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.745708+0000", 2024-04-26T11:13:52.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5790999999999997e-05 2024-04-26T11:13:52.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:52.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.745717+0000", 2024-04-26T11:13:52.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4570000000000005e-06 2024-04-26T11:13:52.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.745722+0000", 2024-04-26T11:13:52.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1889999999999998e-06 2024-04-26T11:13:52.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:52.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.745757+0000", 2024-04-26T11:13:52.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5099999999999999e-05 2024-04-26T11:13:52.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:52.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.745875+0000", 2024-04-26T11:13:52.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011793 2024-04-26T11:13:52.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:52.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.745995+0000", 2024-04-26T11:13:52.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120123 2024-04-26T11:13:52.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:52.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.747677+0000", 2024-04-26T11:13:52.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001682116 2024-04-26T11:13:52.776 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:52.776 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:52.776 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:52.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.776 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4534.0:45918 5.a e24/16 5:56fa5e13:::benchmark_data_smithi029_44842_object45917:head v 24'2978, mlcod=24'2976)", 2024-04-26T11:13:52.777 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.747095+0000", 2024-04-26T11:13:52.777 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00024189700000000001, 2024-04-26T11:13:52.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00069169399999999997, 2024-04-26T11:13:52.777 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:52.777 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:13:52.777 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:52.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:52.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.747095+0000", 2024-04-26T11:13:52.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:52.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:52.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.747095+0000", 2024-04-26T11:13:52.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:52.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:52.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.747095+0000", 2024-04-26T11:13:52.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:52.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.747119+0000", 2024-04-26T11:13:52.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4182999999999999e-05 2024-04-26T11:13:52.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:52.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.747125+0000", 2024-04-26T11:13:52.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6660000000000002e-06 2024-04-26T11:13:52.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.747131+0000", 2024-04-26T11:13:52.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2630000000000003e-06 2024-04-26T11:13:52.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:52.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.747168+0000", 2024-04-26T11:13:52.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6918000000000001e-05 2024-04-26T11:13:52.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:52.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.747186+0000", 2024-04-26T11:13:52.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8233e-05 2024-04-26T11:13:52.780 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:52.780 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:52.780 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:52.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.781 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4534.0:45919 5.f e24/16 5:f809fa6f:::benchmark_data_smithi029_44842_object45918:head v 24'2845, mlcod=24'2843)", 2024-04-26T11:13:52.781 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.747091+0000", 2024-04-26T11:13:52.781 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.000246075, 2024-04-26T11:13:52.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00075667200000000001, 2024-04-26T11:13:52.781 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:52.781 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:13:52.781 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:52.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:52.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.747091+0000", 2024-04-26T11:13:52.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:52.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:52.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.747091+0000", 2024-04-26T11:13:52.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:52.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:52.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.747090+0000", 2024-04-26T11:13:52.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:52.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.747147+0000", 2024-04-26T11:13:52.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6196000000000002e-05 2024-04-26T11:13:52.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:52.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.747156+0000", 2024-04-26T11:13:52.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8709999999999992e-06 2024-04-26T11:13:52.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.747164+0000", 2024-04-26T11:13:52.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4710000000000001e-06 2024-04-26T11:13:52.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:52.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.747199+0000", 2024-04-26T11:13:52.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5329e-05 2024-04-26T11:13:52.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:52.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.747228+0000", 2024-04-26T11:13:52.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8586e-05 2024-04-26T11:13:52.784 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:52.784 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:52.784 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:52.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.785 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:45906 5.4 5:2a514dea:::benchmark_data_smithi029_44842_object45905:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:52.785 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.742830+0000", 2024-04-26T11:13:52.785 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0045074060000000003, 2024-04-26T11:13:52.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050803669999999997, 2024-04-26T11:13:52.785 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:52.785 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:52.785 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:52.785 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:52.785 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:52.785 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 45906 2024-04-26T11:13:52.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.785 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:52.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:52.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.742830+0000", 2024-04-26T11:13:52.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:52.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:52.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.742830+0000", 2024-04-26T11:13:52.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:52.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:52.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.742829+0000", 2024-04-26T11:13:52.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:52.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:52.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.742876+0000", 2024-04-26T11:13:52.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7169999999999997e-05 2024-04-26T11:13:52.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:52.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.742885+0000", 2024-04-26T11:13:52.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7339999999999997e-06 2024-04-26T11:13:52.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:52.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.742892+0000", 2024-04-26T11:13:52.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1550000000000001e-06 2024-04-26T11:13:52.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:52.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.742927+0000", 2024-04-26T11:13:52.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4708e-05 2024-04-26T11:13:52.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:52.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.743034+0000", 2024-04-26T11:13:52.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107295 2024-04-26T11:13:52.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:52.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.743158+0000", 2024-04-26T11:13:52.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123767 2024-04-26T11:13:52.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:52.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:52.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:52.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.746301+0000", 2024-04-26T11:13:52.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00314277 2024-04-26T11:13:52.789 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:52.789 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:52.790 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:52.790 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:52.790 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:13:52.790 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 8 2024-04-26T11:13:52.790 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:13:52.792 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:13:52.792 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:52.789+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:52.892 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:52.890+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:52.962 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:13:52.962 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:13:52.962 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:13:52.963 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:13:52.963 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:13:52.977 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:13:53.021 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:53.019+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:53.094 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:53.092+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:53.154 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:13:53.154 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:13:53.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:13:53.154 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:13:53.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.154 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:53.154 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.905682+0000", 2024-04-26T11:13:53.154 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 40.245216913999997, 2024-04-26T11:13:53.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017168134000000002, 2024-04-26T11:13:53.154 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905682+0000", 2024-04-26T11:13:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905682+0000", 2024-04-26T11:13:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:53.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905681+0000", 2024-04-26T11:13:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:13:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905689+0000", 2024-04-26T11:13:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7830000000000004e-06 2024-04-26T11:13:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905703+0000", 2024-04-26T11:13:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3322000000000001e-05 2024-04-26T11:13:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905717+0000", 2024-04-26T11:13:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4562000000000001e-05 2024-04-26T11:13:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906126+0000", 2024-04-26T11:13:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040896900000000002 2024-04-26T11:13:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:13:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906133+0000", 2024-04-26T11:13:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6370000000000002e-06 2024-04-26T11:13:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.914252+0000", 2024-04-26T11:13:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0081192529999999999 2024-04-26T11:13:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.914675+0000", 2024-04-26T11:13:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00042322399999999999 2024-04-26T11:13:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915080+0000", 2024-04-26T11:13:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040486899999999998 2024-04-26T11:13:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.917940+0000", 2024-04-26T11:13:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0028593400000000001 2024-04-26T11:13:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.922776+0000", 2024-04-26T11:13:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048359420000000002 2024-04-26T11:13:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.922825+0000", 2024-04-26T11:13:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9048999999999997e-05 2024-04-26T11:13:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.922850+0000", 2024-04-26T11:13:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5689000000000001e-05 2024-04-26T11:13:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:26 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906148+0000", 2024-04-26T11:13:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 40.244751573999999, 2024-04-26T11:13:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017103547, 2024-04-26T11:13:53.160 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906148+0000", 2024-04-26T11:13:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906148+0000", 2024-04-26T11:13:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:53.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906147+0000", 2024-04-26T11:13:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906152+0000", 2024-04-26T11:13:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2530000000000004e-06 2024-04-26T11:13:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906160+0000", 2024-04-26T11:13:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.605e-06 2024-04-26T11:13:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906165+0000", 2024-04-26T11:13:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4689999999999996e-06 2024-04-26T11:13:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906223+0000", 2024-04-26T11:13:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7578999999999999e-05 2024-04-26T11:13:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906228+0000", 2024-04-26T11:13:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.485e-06 2024-04-26T11:13:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915364+0000", 2024-04-26T11:13:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0091359230000000007 2024-04-26T11:13:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915433+0000", 2024-04-26T11:13:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8913999999999998e-05 2024-04-26T11:13:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915517+0000", 2024-04-26T11:13:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4023000000000005e-05 2024-04-26T11:13:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.918856+0000", 2024-04-26T11:13:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0033382469999999999 2024-04-26T11:13:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923141+0000", 2024-04-26T11:13:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0042854779999999997 2024-04-26T11:13:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923209+0000", 2024-04-26T11:13:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8122999999999998e-05 2024-04-26T11:13:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:53.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923251+0000", 2024-04-26T11:13:53.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1919999999999998e-05 2024-04-26T11:13:53.166 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.166 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:53.166 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.166 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:53.166 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906402+0000", 2024-04-26T11:13:53.166 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 40.244497522000003, 2024-04-26T11:13:53.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017555191000000001, 2024-04-26T11:13:53.166 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:53.166 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906402+0000", 2024-04-26T11:13:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906402+0000", 2024-04-26T11:13:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:53.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906401+0000", 2024-04-26T11:13:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906407+0000", 2024-04-26T11:13:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2689999999999996e-06 2024-04-26T11:13:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906416+0000", 2024-04-26T11:13:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5080000000000005e-06 2024-04-26T11:13:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906422+0000", 2024-04-26T11:13:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9460000000000003e-06 2024-04-26T11:13:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906459+0000", 2024-04-26T11:13:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6998000000000001e-05 2024-04-26T11:13:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906463+0000", 2024-04-26T11:13:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.374e-06 2024-04-26T11:13:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915821+0000", 2024-04-26T11:13:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0093578050000000003 2024-04-26T11:13:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.916209+0000", 2024-04-26T11:13:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00038876999999999998 2024-04-26T11:13:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.916349+0000", 2024-04-26T11:13:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013992900000000001 2024-04-26T11:13:53.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.920269+0000", 2024-04-26T11:13:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003919133 2024-04-26T11:13:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923899+0000", 2024-04-26T11:13:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003630716 2024-04-26T11:13:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923932+0000", 2024-04-26T11:13:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2471999999999997e-05 2024-04-26T11:13:53.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923957+0000", 2024-04-26T11:13:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5038999999999999e-05 2024-04-26T11:13:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:33828 5.b 5:d3313e8b:::benchmark_data_smithi029_44842_object33827:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:47.804177+0000", 2024-04-26T11:13:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.3467220769999999, 2024-04-26T11:13:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01819138, 2024-04-26T11:13:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:53.172 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.173 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:53.173 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:53.173 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:53.173 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 33828 2024-04-26T11:13:53.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.173 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:53.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:53.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804177+0000", 2024-04-26T11:13:53.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:53.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804177+0000", 2024-04-26T11:13:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804176+0000", 2024-04-26T11:13:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804238+0000", 2024-04-26T11:13:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1791000000000005e-05 2024-04-26T11:13:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:53.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804248+0000", 2024-04-26T11:13:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9969999999999993e-06 2024-04-26T11:13:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804253+0000", 2024-04-26T11:13:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2830000000000003e-06 2024-04-26T11:13:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.805184+0000", 2024-04-26T11:13:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093189900000000003 2024-04-26T11:13:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.805268+0000", 2024-04-26T11:13:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3634000000000006e-05 2024-04-26T11:13:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.805359+0000", 2024-04-26T11:13:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0603e-05 2024-04-26T11:13:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.806391+0000", 2024-04-26T11:13:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001031978 2024-04-26T11:13:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.822308+0000", 2024-04-26T11:13:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015917343 2024-04-26T11:13:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.822344+0000", 2024-04-26T11:13:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5754999999999999e-05 2024-04-26T11:13:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.822368+0000", 2024-04-26T11:13:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4658e-05 2024-04-26T11:13:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.177 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35482 5.b 5:d2b3ef95:::benchmark_data_smithi029_44842_object35481:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:13:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.7322174930000003, 2024-04-26T11:13:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019390455000000001, 2024-04-26T11:13:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35482 2024-04-26T11:13:53.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:13:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:13:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:53.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418681+0000", 2024-04-26T11:13:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418802+0000", 2024-04-26T11:13:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120835 2024-04-26T11:13:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418810+0000", 2024-04-26T11:13:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1240000000000005e-06 2024-04-26T11:13:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418816+0000", 2024-04-26T11:13:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5749999999999997e-06 2024-04-26T11:13:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.419905+0000", 2024-04-26T11:13:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001088751 2024-04-26T11:13:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.420046+0000", 2024-04-26T11:13:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140514 2024-04-26T11:13:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:53.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.420180+0000", 2024-04-26T11:13:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440899999999999 2024-04-26T11:13:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425415+0000", 2024-04-26T11:13:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052350540000000003 2024-04-26T11:13:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.437989+0000", 2024-04-26T11:13:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012573632 2024-04-26T11:13:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.438035+0000", 2024-04-26T11:13:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5799e-05 2024-04-26T11:13:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.438072+0000", 2024-04-26T11:13:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7530999999999997e-05 2024-04-26T11:13:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35483 5.b 5:d3dd14f6:::benchmark_data_smithi029_44842_object35482:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:13:53.183 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.7320747509999999, 2024-04-26T11:13:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021245969, 2024-04-26T11:13:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35483 2024-04-26T11:13:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:13:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:13:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:13:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418885+0000", 2024-04-26T11:13:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1294e-05 2024-04-26T11:13:53.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418892+0000", 2024-04-26T11:13:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4599999999999997e-06 2024-04-26T11:13:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418899+0000", 2024-04-26T11:13:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0909999999999998e-06 2024-04-26T11:13:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421347+0000", 2024-04-26T11:13:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024484609999999999 2024-04-26T11:13:53.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421468+0000", 2024-04-26T11:13:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000121179 2024-04-26T11:13:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421605+0000", 2024-04-26T11:13:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013672200000000001 2024-04-26T11:13:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425456+0000", 2024-04-26T11:13:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038511719999999999 2024-04-26T11:13:53.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.439986+0000", 2024-04-26T11:13:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014530080000000001 2024-04-26T11:13:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440038+0000", 2024-04-26T11:13:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1916999999999998e-05 2024-04-26T11:13:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440070+0000", 2024-04-26T11:13:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2245e-05 2024-04-26T11:13:53.188 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35493 5.8 5:14785d1e:::benchmark_data_smithi029_44842_object35492:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.422582+0000", 2024-04-26T11:13:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.7283171800000003, 2024-04-26T11:13:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01748692, 2024-04-26T11:13:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:53.189 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35493 2024-04-26T11:13:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422582+0000", 2024-04-26T11:13:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422582+0000", 2024-04-26T11:13:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422581+0000", 2024-04-26T11:13:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422715+0000", 2024-04-26T11:13:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013359600000000001 2024-04-26T11:13:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422723+0000", 2024-04-26T11:13:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4749999999999993e-06 2024-04-26T11:13:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422728+0000", 2024-04-26T11:13:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7210000000000002e-06 2024-04-26T11:13:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422753+0000", 2024-04-26T11:13:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4456000000000001e-05 2024-04-26T11:13:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422832+0000", 2024-04-26T11:13:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9810999999999999e-05 2024-04-26T11:13:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422932+0000", 2024-04-26T11:13:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9865999999999996e-05 2024-04-26T11:13:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.427701+0000", 2024-04-26T11:13:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047686999999999998 2024-04-26T11:13:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.439983+0000", 2024-04-26T11:13:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012281861 2024-04-26T11:13:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440032+0000", 2024-04-26T11:13:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9317999999999998e-05 2024-04-26T11:13:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440069+0000", 2024-04-26T11:13:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6740999999999999e-05 2024-04-26T11:13:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:53.194 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35494 5.4 5:2687a65a:::benchmark_data_smithi029_44842_object35493:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.422734+0000", 2024-04-26T11:13:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.728164778, 2024-04-26T11:13:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017335989, 2024-04-26T11:13:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35494 2024-04-26T11:13:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:53.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422734+0000", 2024-04-26T11:13:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422734+0000", 2024-04-26T11:13:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422734+0000", 2024-04-26T11:13:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422769+0000", 2024-04-26T11:13:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4759999999999999e-05 2024-04-26T11:13:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422773+0000", 2024-04-26T11:13:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6319999999999999e-06 2024-04-26T11:13:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422777+0000", 2024-04-26T11:13:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3550000000000001e-06 2024-04-26T11:13:53.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422802+0000", 2024-04-26T11:13:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5771000000000001e-05 2024-04-26T11:13:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422905+0000", 2024-04-26T11:13:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102509 2024-04-26T11:13:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422983+0000", 2024-04-26T11:13:53.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8209999999999998e-05 2024-04-26T11:13:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.427677+0000", 2024-04-26T11:13:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0046938659999999997 2024-04-26T11:13:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.439988+0000", 2024-04-26T11:13:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012311344 2024-04-26T11:13:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:53.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440036+0000", 2024-04-26T11:13:53.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7187000000000001e-05 2024-04-26T11:13:53.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:53.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440070+0000", 2024-04-26T11:13:53.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4752999999999997e-05 2024-04-26T11:13:53.200 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.200 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:53.200 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35499 5.0 5:01ad2011:::benchmark_data_smithi029_44842_object35498:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.425538+0000", 2024-04-26T11:13:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.7253610019999996, 2024-04-26T11:13:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016428793000000001, 2024-04-26T11:13:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:53.201 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35499 2024-04-26T11:13:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425538+0000", 2024-04-26T11:13:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425538+0000", 2024-04-26T11:13:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425537+0000", 2024-04-26T11:13:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425701+0000", 2024-04-26T11:13:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000163616 2024-04-26T11:13:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425709+0000", 2024-04-26T11:13:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3780000000000001e-06 2024-04-26T11:13:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425715+0000", 2024-04-26T11:13:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6330000000000001e-06 2024-04-26T11:13:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425739+0000", 2024-04-26T11:13:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4314000000000001e-05 2024-04-26T11:13:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425819+0000", 2024-04-26T11:13:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9385e-05 2024-04-26T11:13:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425901+0000", 2024-04-26T11:13:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2536999999999999e-05 2024-04-26T11:13:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.430126+0000", 2024-04-26T11:13:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0042245800000000003 2024-04-26T11:13:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.441905+0000", 2024-04-26T11:13:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01177957 2024-04-26T11:13:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:53.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.441935+0000", 2024-04-26T11:13:53.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.936e-05 2024-04-26T11:13:53.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:53.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.441967+0000", 2024-04-26T11:13:53.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2172000000000003e-05 2024-04-26T11:13:53.206 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.206 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:53.206 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.206 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:36746 5.8 5:14dea2d5:::benchmark_data_smithi029_44842_object36745:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:53.207 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.896239+0000", 2024-04-26T11:13:53.207 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.2546602199999999, 2024-04-26T11:13:53.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016757729999999998, 2024-04-26T11:13:53.207 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:53.207 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.207 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:53.207 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:53.207 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:53.207 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 36746 2024-04-26T11:13:53.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.207 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:53.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:53.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.896239+0000", 2024-04-26T11:13:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.896239+0000", 2024-04-26T11:13:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.896238+0000", 2024-04-26T11:13:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:53.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.896270+0000", 2024-04-26T11:13:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1337999999999997e-05 2024-04-26T11:13:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.896276+0000", 2024-04-26T11:13:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0680000000000002e-06 2024-04-26T11:13:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.896287+0000", 2024-04-26T11:13:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1586999999999999e-05 2024-04-26T11:13:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.898129+0000", 2024-04-26T11:13:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018412630000000001 2024-04-26T11:13:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.898211+0000", 2024-04-26T11:13:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1978999999999996e-05 2024-04-26T11:13:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.898296+0000", 2024-04-26T11:13:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5680999999999995e-05 2024-04-26T11:13:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.899825+0000", 2024-04-26T11:13:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001528789 2024-04-26T11:13:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.912927+0000", 2024-04-26T11:13:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013101665 2024-04-26T11:13:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.912963+0000", 2024-04-26T11:13:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6745000000000001e-05 2024-04-26T11:13:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.912997+0000", 2024-04-26T11:13:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3118999999999999e-05 2024-04-26T11:13:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:43949 5.4 5:2e5d1e95:::benchmark_data_smithi029_44842_object43948:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:51.948739+0000", 2024-04-26T11:13:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 1.202159835, 2024-04-26T11:13:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016626398000000001, 2024-04-26T11:13:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:53.212 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 43949 2024-04-26T11:13:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:51.948739+0000", 2024-04-26T11:13:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:51.948739+0000", 2024-04-26T11:13:53.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:51.948739+0000", 2024-04-26T11:13:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:51.948797+0000", 2024-04-26T11:13:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8838999999999997e-05 2024-04-26T11:13:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:53.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:51.948803+0000", 2024-04-26T11:13:53.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4140000000000002e-06 2024-04-26T11:13:53.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:51.948807+0000", 2024-04-26T11:13:53.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9160000000000003e-06 2024-04-26T11:13:53.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:53.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:51.949852+0000", 2024-04-26T11:13:53.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010452269999999999 2024-04-26T11:13:53.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:53.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:51.949934+0000", 2024-04-26T11:13:53.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1778000000000002e-05 2024-04-26T11:13:53.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:53.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:51.950019+0000", 2024-04-26T11:13:53.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5379999999999999e-05 2024-04-26T11:13:53.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:53.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:51.951114+0000", 2024-04-26T11:13:53.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001094832 2024-04-26T11:13:53.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:51.965298+0000", 2024-04-26T11:13:53.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014183553 2024-04-26T11:13:53.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:53.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:51.965329+0000", 2024-04-26T11:13:53.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1185e-05 2024-04-26T11:13:53.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:53.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:51.965366+0000", 2024-04-26T11:13:53.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6908e-05 2024-04-26T11:13:53.217 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.217 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:53.217 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.218 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44504 5.0 5:0536d5a4:::benchmark_data_smithi029_44842_object44503:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:53.218 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:13:53.218 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.98161312899999997, 2024-04-26T11:13:53.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018576187000000001, 2024-04-26T11:13:53.218 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:53.218 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.218 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:53.218 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:53.218 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:53.218 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44504 2024-04-26T11:13:53.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.218 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:53.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:53.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:13:53.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:53.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:13:53.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:53.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:13:53.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169304+0000", 2024-04-26T11:13:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8331000000000001e-05 2024-04-26T11:13:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169308+0000", 2024-04-26T11:13:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9609999999999999e-06 2024-04-26T11:13:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169311+0000", 2024-04-26T11:13:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.044e-06 2024-04-26T11:13:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.174118+0000", 2024-04-26T11:13:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004806645 2024-04-26T11:13:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.174207+0000", 2024-04-26T11:13:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9665000000000003e-05 2024-04-26T11:13:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.174308+0000", 2024-04-26T11:13:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100399 2024-04-26T11:13:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.185001+0000", 2024-04-26T11:13:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010693599 2024-04-26T11:13:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187698+0000", 2024-04-26T11:13:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026970929999999998 2024-04-26T11:13:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187777+0000", 2024-04-26T11:13:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8335000000000001e-05 2024-04-26T11:13:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187862+0000", 2024-04-26T11:13:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5521999999999999e-05 2024-04-26T11:13:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44506 5.0 5:07ec7127:::benchmark_data_smithi029_44842_object44505:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:13:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.98131321000000005, 2024-04-26T11:13:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018482386999999999, 2024-04-26T11:13:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44506 2024-04-26T11:13:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:13:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:13:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:13:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169730+0000", 2024-04-26T11:13:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014447200000000001 2024-04-26T11:13:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169738+0000", 2024-04-26T11:13:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5700000000000004e-06 2024-04-26T11:13:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169741+0000", 2024-04-26T11:13:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3909999999999998e-06 2024-04-26T11:13:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.176682+0000", 2024-04-26T11:13:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0069412129999999999 2024-04-26T11:13:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.176816+0000", 2024-04-26T11:13:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000134265 2024-04-26T11:13:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.176952+0000", 2024-04-26T11:13:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013520000000000001 2024-04-26T11:13:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.185004+0000", 2024-04-26T11:13:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0080524959999999993 2024-04-26T11:13:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187983+0000", 2024-04-26T11:13:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0029783330000000001 2024-04-26T11:13:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188031+0000", 2024-04-26T11:13:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8588000000000003e-05 2024-04-26T11:13:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188068+0000", 2024-04-26T11:13:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7154999999999999e-05 2024-04-26T11:13:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44509 5.0 5:0828d2b6:::benchmark_data_smithi029_44842_object44508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.169815+0000", 2024-04-26T11:13:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.98108436499999996, 2024-04-26T11:13:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018410841000000001, 2024-04-26T11:13:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44509 2024-04-26T11:13:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169815+0000", 2024-04-26T11:13:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169815+0000", 2024-04-26T11:13:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169814+0000", 2024-04-26T11:13:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169921+0000", 2024-04-26T11:13:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107194 2024-04-26T11:13:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169927+0000", 2024-04-26T11:13:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.203e-06 2024-04-26T11:13:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169931+0000", 2024-04-26T11:13:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0829999999999997e-06 2024-04-26T11:13:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.179590+0000", 2024-04-26T11:13:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096589999999999992 2024-04-26T11:13:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.179718+0000", 2024-04-26T11:13:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012885699999999999 2024-04-26T11:13:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.179857+0000", 2024-04-26T11:13:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013884100000000001 2024-04-26T11:13:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188082+0000", 2024-04-26T11:13:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082250099999999996 2024-04-26T11:13:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188164+0000", 2024-04-26T11:13:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2123e-05 2024-04-26T11:13:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188197+0000", 2024-04-26T11:13:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2471000000000001e-05 2024-04-26T11:13:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188226+0000", 2024-04-26T11:13:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8609999999999999e-05 2024-04-26T11:13:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44513 5.0 5:0a236ebb:::benchmark_data_smithi029_44842_object44512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:13:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.98081177100000005, 2024-04-26T11:13:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020724414, 2024-04-26T11:13:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44513 2024-04-26T11:13:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:13:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:13:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:13:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:53.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170120+0000", 2024-04-26T11:13:53.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2941000000000002e-05 2024-04-26T11:13:53.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:53.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170127+0000", 2024-04-26T11:13:53.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.469e-06 2024-04-26T11:13:53.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170133+0000", 2024-04-26T11:13:53.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1340000000000001e-06 2024-04-26T11:13:53.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:53.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182383+0000", 2024-04-26T11:13:53.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012249970000000001 2024-04-26T11:13:53.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:53.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182477+0000", 2024-04-26T11:13:53.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3776999999999993e-05 2024-04-26T11:13:53.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:53.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182572+0000", 2024-04-26T11:13:53.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4841999999999998e-05 2024-04-26T11:13:53.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:53.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188262+0000", 2024-04-26T11:13:53.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005690077 2024-04-26T11:13:53.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190748+0000", 2024-04-26T11:13:53.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024857780000000001 2024-04-26T11:13:53.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:53.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190776+0000", 2024-04-26T11:13:53.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8419999999999999e-05 2024-04-26T11:13:53.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:53.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190812+0000", 2024-04-26T11:13:53.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5630999999999998e-05 2024-04-26T11:13:53.240 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.240 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:53.240 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.240 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44786 5.8 5:16733aa6:::benchmark_data_smithi029_44842_object44785:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:53.240 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.280150+0000", 2024-04-26T11:13:53.241 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.87074860600000004, 2024-04-26T11:13:53.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015575442, 2024-04-26T11:13:53.241 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:53.241 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.241 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:53.241 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:53.241 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:53.241 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44786 2024-04-26T11:13:53.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.241 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:53.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:53.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.280150+0000", 2024-04-26T11:13:53.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:53.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.280150+0000", 2024-04-26T11:13:53.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:53.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.280150+0000", 2024-04-26T11:13:53.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:53.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.280272+0000", 2024-04-26T11:13:53.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012184300000000001 2024-04-26T11:13:53.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:53.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.280284+0000", 2024-04-26T11:13:53.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2231e-05 2024-04-26T11:13:53.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.280290+0000", 2024-04-26T11:13:53.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2079999999999997e-06 2024-04-26T11:13:53.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:53.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.281213+0000", 2024-04-26T11:13:53.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00092325899999999995 2024-04-26T11:13:53.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:53.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.281347+0000", 2024-04-26T11:13:53.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013355299999999999 2024-04-26T11:13:53.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:53.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.281480+0000", 2024-04-26T11:13:53.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013260400000000001 2024-04-26T11:13:53.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:53.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.287708+0000", 2024-04-26T11:13:53.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00622888 2024-04-26T11:13:53.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.295651+0000", 2024-04-26T11:13:53.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079422139999999995 2024-04-26T11:13:53.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:53.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.295692+0000", 2024-04-26T11:13:53.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1780999999999999e-05 2024-04-26T11:13:53.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:53.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.295726+0000", 2024-04-26T11:13:53.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3448999999999998e-05 2024-04-26T11:13:53.246 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.246 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:53.246 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.246 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44792 5.8 5:17ddc189:::benchmark_data_smithi029_44842_object44791:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:53.246 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.282364+0000", 2024-04-26T11:13:53.246 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.86853522699999997, 2024-04-26T11:13:53.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016770038000000001, 2024-04-26T11:13:53.246 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:53.246 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.246 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:53.247 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:53.247 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:53.247 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44792 2024-04-26T11:13:53.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.247 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:53.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:53.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.282364+0000", 2024-04-26T11:13:53.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:53.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.282364+0000", 2024-04-26T11:13:53.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:53.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.282363+0000", 2024-04-26T11:13:53.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:53.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:53.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.282462+0000", 2024-04-26T11:13:53.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8799000000000001e-05 2024-04-26T11:13:53.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:53.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.282471+0000", 2024-04-26T11:13:53.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0189999999999995e-06 2024-04-26T11:13:53.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.282478+0000", 2024-04-26T11:13:53.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7449999999999998e-06 2024-04-26T11:13:53.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:53.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.285628+0000", 2024-04-26T11:13:53.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0031500429999999999 2024-04-26T11:13:53.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:53.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.285705+0000", 2024-04-26T11:13:53.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7291000000000002e-05 2024-04-26T11:13:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.285792+0000", 2024-04-26T11:13:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7164999999999996e-05 2024-04-26T11:13:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.288027+0000", 2024-04-26T11:13:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022347299999999999 2024-04-26T11:13:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.299036+0000", 2024-04-26T11:13:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011008808 2024-04-26T11:13:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.299085+0000", 2024-04-26T11:13:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.905e-05 2024-04-26T11:13:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.299134+0000", 2024-04-26T11:13:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9184000000000002e-05 2024-04-26T11:13:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44794 5.8 5:158fd219:::benchmark_data_smithi029_44842_object44793:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.283382+0000", 2024-04-26T11:13:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.86751719400000005, 2024-04-26T11:13:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018701497000000001, 2024-04-26T11:13:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44794 2024-04-26T11:13:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283382+0000", 2024-04-26T11:13:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283382+0000", 2024-04-26T11:13:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283381+0000", 2024-04-26T11:13:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283409+0000", 2024-04-26T11:13:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.798e-05 2024-04-26T11:13:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283417+0000", 2024-04-26T11:13:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2629999999999997e-06 2024-04-26T11:13:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283424+0000", 2024-04-26T11:13:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1210000000000001e-06 2024-04-26T11:13:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.286843+0000", 2024-04-26T11:13:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034194490000000002 2024-04-26T11:13:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.286932+0000", 2024-04-26T11:13:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9065000000000002e-05 2024-04-26T11:13:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.287019+0000", 2024-04-26T11:13:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6976000000000002e-05 2024-04-26T11:13:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.288238+0000", 2024-04-26T11:13:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012185 2024-04-26T11:13:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.302032+0000", 2024-04-26T11:13:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013794618999999999 2024-04-26T11:13:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.302061+0000", 2024-04-26T11:13:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9008000000000001e-05 2024-04-26T11:13:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.302083+0000", 2024-04-26T11:13:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2002e-05 2024-04-26T11:13:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:45051 5.0 5:0f54b16a:::benchmark_data_smithi029_44842_object45050:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.395755+0000", 2024-04-26T11:13:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.755143958, 2024-04-26T11:13:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017330567000000002, 2024-04-26T11:13:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 45051 2024-04-26T11:13:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.395755+0000", 2024-04-26T11:13:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.395755+0000", 2024-04-26T11:13:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.395754+0000", 2024-04-26T11:13:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.395786+0000", 2024-04-26T11:13:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1177999999999999e-05 2024-04-26T11:13:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.395794+0000", 2024-04-26T11:13:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4260000000000003e-06 2024-04-26T11:13:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.395799+0000", 2024-04-26T11:13:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3419999999999998e-06 2024-04-26T11:13:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.401856+0000", 2024-04-26T11:13:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060561549999999997 2024-04-26T11:13:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.401964+0000", 2024-04-26T11:13:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108062 2024-04-26T11:13:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.402103+0000", 2024-04-26T11:13:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139808 2024-04-26T11:13:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.407608+0000", 2024-04-26T11:13:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055047789999999996 2024-04-26T11:13:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.413014+0000", 2024-04-26T11:13:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054058980000000001 2024-04-26T11:13:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.413054+0000", 2024-04-26T11:13:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9576000000000002e-05 2024-04-26T11:13:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.413086+0000", 2024-04-26T11:13:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2042999999999998e-05 2024-04-26T11:13:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:46860 5.0 5:01e93721:::benchmark_data_smithi029_44842_object46859:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.103996+0000", 2024-04-26T11:13:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.046902727999999998, 2024-04-26T11:13:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015859056999999999, 2024-04-26T11:13:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 46860 2024-04-26T11:13:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.103996+0000", 2024-04-26T11:13:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.103996+0000", 2024-04-26T11:13:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.103996+0000", 2024-04-26T11:13:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.104050+0000", 2024-04-26T11:13:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4462000000000001e-05 2024-04-26T11:13:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.104061+0000", 2024-04-26T11:13:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1239e-05 2024-04-26T11:13:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.104068+0000", 2024-04-26T11:13:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.336e-06 2024-04-26T11:13:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.114000+0000", 2024-04-26T11:13:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0099325530000000002 2024-04-26T11:13:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.114100+0000", 2024-04-26T11:13:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9568999999999995e-05 2024-04-26T11:13:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.114212+0000", 2024-04-26T11:13:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111623 2024-04-26T11:13:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.116163+0000", 2024-04-26T11:13:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0019509320000000001 2024-04-26T11:13:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.119796+0000", 2024-04-26T11:13:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003633088 2024-04-26T11:13:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.119831+0000", 2024-04-26T11:13:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5516999999999999e-05 2024-04-26T11:13:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.119855+0000", 2024-04-26T11:13:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4298e-05 2024-04-26T11:13:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:53.268 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:13:53.270 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:53.268+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:53.270 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:13:53.342 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:13:53.371 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:53.370+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:53.397 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:13:53.397 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:13:53.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.397 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:47260 5.f 5:f0be0cbd:::benchmark_data_smithi029_44842_object47259:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:53.397 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:53.268352+0000", 2024-04-26T11:13:53.397 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.12775850599999999, 2024-04-26T11:13:53.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12778984400000001, 2024-04-26T11:13:53.397 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:53.397 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:53.398 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:53.398 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:53.398 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:53.398 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 47260 2024-04-26T11:13:53.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.398 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:53.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:53.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268352+0000", 2024-04-26T11:13:53.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:53.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268352+0000", 2024-04-26T11:13:53.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:53.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268352+0000", 2024-04-26T11:13:53.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:53.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:53.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268412+0000", 2024-04-26T11:13:53.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0609999999999997e-05 2024-04-26T11:13:53.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:53.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268425+0000", 2024-04-26T11:13:53.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2403e-05 2024-04-26T11:13:53.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268433+0000", 2024-04-26T11:13:53.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:13:53.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268462+0000", 2024-04-26T11:13:53.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8571000000000001e-05 2024-04-26T11:13:53.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:53.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268552+0000", 2024-04-26T11:13:53.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0804999999999995e-05 2024-04-26T11:13:53.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:53.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268629+0000", 2024-04-26T11:13:53.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6996999999999995e-05 2024-04-26T11:13:53.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:53.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.270729+0000", 2024-04-26T11:13:53.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0020996209999999999 2024-04-26T11:13:53.402 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.402 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.402 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.402 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:47264 5.2 5:4ecbc772:::benchmark_data_smithi029_44842_object47263:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:53.403 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:53.268503+0000", 2024-04-26T11:13:53.403 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.12760766100000001, 2024-04-26T11:13:53.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12769127799999999, 2024-04-26T11:13:53.403 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:53.403 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:53.403 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:53.403 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:53.403 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:53.403 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 47264 2024-04-26T11:13:53.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.403 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:53.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:53.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268503+0000", 2024-04-26T11:13:53.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:53.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268503+0000", 2024-04-26T11:13:53.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:53.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268502+0000", 2024-04-26T11:13:53.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:53.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:53.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268675+0000", 2024-04-26T11:13:53.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017224100000000001 2024-04-26T11:13:53.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:53.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268683+0000", 2024-04-26T11:13:53.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0730000000000005e-06 2024-04-26T11:13:53.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268687+0000", 2024-04-26T11:13:53.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1559999999999997e-06 2024-04-26T11:13:53.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.269653+0000", 2024-04-26T11:13:53.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00096616900000000001 2024-04-26T11:13:53.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:53.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.269780+0000", 2024-04-26T11:13:53.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000126871 2024-04-26T11:13:53.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:53.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.269914+0000", 2024-04-26T11:13:53.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000134072 2024-04-26T11:13:53.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:53.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.271739+0000", 2024-04-26T11:13:53.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00182452 2024-04-26T11:13:53.407 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.407 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.407 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.407 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:47272 5.f 5:f1f61da5:::benchmark_data_smithi029_44842_object47271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:53.407 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:53.271143+0000", 2024-04-26T11:13:53.407 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.124967437, 2024-04-26T11:13:53.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12509667299999999, 2024-04-26T11:13:53.407 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:53.407 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:53.407 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:53.408 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:53.408 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:53.408 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 47272 2024-04-26T11:13:53.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.408 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:53.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:53.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.271143+0000", 2024-04-26T11:13:53.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:53.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.271143+0000", 2024-04-26T11:13:53.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:53.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.271143+0000", 2024-04-26T11:13:53.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:53.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:53.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.271213+0000", 2024-04-26T11:13:53.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0037999999999996e-05 2024-04-26T11:13:53.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:53.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.271219+0000", 2024-04-26T11:13:53.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6150000000000002e-06 2024-04-26T11:13:53.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.271224+0000", 2024-04-26T11:13:53.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.656e-06 2024-04-26T11:13:53.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.271268+0000", 2024-04-26T11:13:53.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4529e-05 2024-04-26T11:13:53.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:53.411 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.271402+0000", 2024-04-26T11:13:53.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133261 2024-04-26T11:13:53.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.411 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:53.411 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.271523+0000", 2024-04-26T11:13:53.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012136 2024-04-26T11:13:53.411 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.411 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.411 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.411 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4534.0:47274 5.5 e24/16 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head v 24'2847, mlcod=24'2845)", 2024-04-26T11:13:53.412 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:53.272031+0000", 2024-04-26T11:13:53.412 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.124080306, 2024-04-26T11:13:53.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.124249526, 2024-04-26T11:13:53.412 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:53.412 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:13:53.412 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:53.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:53.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.272031+0000", 2024-04-26T11:13:53.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:53.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.272031+0000", 2024-04-26T11:13:53.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:53.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.272030+0000", 2024-04-26T11:13:53.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:53.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.272088+0000", 2024-04-26T11:13:53.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8239999999999998e-05 2024-04-26T11:13:53.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:53.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.272098+0000", 2024-04-26T11:13:53.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4239999999999999e-06 2024-04-26T11:13:53.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.272104+0000", 2024-04-26T11:13:53.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1260000000000003e-06 2024-04-26T11:13:53.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.272132+0000", 2024-04-26T11:13:53.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8394999999999998e-05 2024-04-26T11:13:53.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:53.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.272144+0000", 2024-04-26T11:13:53.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1603999999999999e-05 2024-04-26T11:13:53.415 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.415 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.416 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.416 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.416 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2024-04-26T11:13:53.416 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 4 2024-04-26T11:13:53.416 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:13:53.416 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 15 16 47293 47277 196.972 138.562 0.00711328 0.00502999 2024-04-26T11:13:53.417 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:13:53.471 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:53.470+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:53.572 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:13:53.571+0000 7fe890ef5700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41432) UID: 0 2024-04-26T11:13:53.590 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:13:53.591 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:13:53.591 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2024-04-26T11:13:53.591 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2024-04-26T11:13:53.591 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:13:53.592 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T11:13:53.592 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:13:53.592 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [0, 1, 2] 2024-04-26T11:13:53.593 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T11:13:53.593 INFO:teuthology.orchestra.console.smithi072:Power off 2024-04-26T11:13:53.593 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T11:13:53.606 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:13:53.616 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2024-04-26T11:13:53.617 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:13:53.644 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2024-04-26T11:13:53.675 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:53.673+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:53.777 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:53.775+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:53.788 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:13:53.824 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:13:53.824 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2024-04-26T11:13:53.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2024-04-26T11:13:53.824 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2024-04-26T11:13:53.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.824 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:53.824 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905638+0000", 2024-04-26T11:13:53.824 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.915012093000001, 2024-04-26T11:13:53.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019821874, 2024-04-26T11:13:53.825 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:53.825 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.825 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:53.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:53.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905638+0000", 2024-04-26T11:13:53.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:53.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905638+0000", 2024-04-26T11:13:53.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:53.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905638+0000", 2024-04-26T11:13:53.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:53.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905642+0000", 2024-04-26T11:13:53.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9759999999999997e-06 2024-04-26T11:13:53.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:53.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905647+0000", 2024-04-26T11:13:53.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5949999999999998e-06 2024-04-26T11:13:53.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905651+0000", 2024-04-26T11:13:53.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.924e-06 2024-04-26T11:13:53.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905752+0000", 2024-04-26T11:13:53.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000101 2024-04-26T11:13:53.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:53.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905758+0000", 2024-04-26T11:13:53.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:13:53.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922256+0000", 2024-04-26T11:13:53.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016497947999999998 2024-04-26T11:13:53.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:53.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922369+0000", 2024-04-26T11:13:53.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000113213 2024-04-26T11:13:53.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:53.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922505+0000", 2024-04-26T11:13:53.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000135635 2024-04-26T11:13:53.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:53.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925373+0000", 2024-04-26T11:13:53.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002868013 2024-04-26T11:13:53.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925402+0000", 2024-04-26T11:13:53.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.898e-05 2024-04-26T11:13:53.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:53.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925430+0000", 2024-04-26T11:13:53.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7739999999999999e-05 2024-04-26T11:13:53.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:53.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925460+0000", 2024-04-26T11:13:53.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0582e-05 2024-04-26T11:13:53.830 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.830 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.830 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.831 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:53.831 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905672+0000", 2024-04-26T11:13:53.831 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.914978261000002, 2024-04-26T11:13:53.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019920424999999999, 2024-04-26T11:13:53.831 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:53.831 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.831 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:53.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:53.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905672+0000", 2024-04-26T11:13:53.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:53.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905672+0000", 2024-04-26T11:13:53.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:53.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905672+0000", 2024-04-26T11:13:53.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:53.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905689+0000", 2024-04-26T11:13:53.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6929e-05 2024-04-26T11:13:53.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:53.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905694+0000", 2024-04-26T11:13:53.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3839999999999996e-06 2024-04-26T11:13:53.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905698+0000", 2024-04-26T11:13:53.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1450000000000001e-06 2024-04-26T11:13:53.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905812+0000", 2024-04-26T11:13:53.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000113807 2024-04-26T11:13:53.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:53.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905817+0000", 2024-04-26T11:13:53.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.203e-06 2024-04-26T11:13:53.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922934+0000", 2024-04-26T11:13:53.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017116681000000002 2024-04-26T11:13:53.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:53.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923094+0000", 2024-04-26T11:13:53.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000159667 2024-04-26T11:13:53.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:53.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923233+0000", 2024-04-26T11:13:53.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013987 2024-04-26T11:13:53.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:53.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925378+0000", 2024-04-26T11:13:53.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002144389 2024-04-26T11:13:53.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925510+0000", 2024-04-26T11:13:53.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013231399999999999 2024-04-26T11:13:53.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:53.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925559+0000", 2024-04-26T11:13:53.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8958000000000001e-05 2024-04-26T11:13:53.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:53.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925593+0000", 2024-04-26T11:13:53.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3488999999999997e-05 2024-04-26T11:13:53.836 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.836 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.836 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.837 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:53.837 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905702+0000", 2024-04-26T11:13:53.837 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.914948428000002, 2024-04-26T11:13:53.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.01999043, 2024-04-26T11:13:53.837 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:53.837 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.837 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:53.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:53.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905702+0000", 2024-04-26T11:13:53.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:53.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905702+0000", 2024-04-26T11:13:53.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:53.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905702+0000", 2024-04-26T11:13:53.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:53.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905704+0000", 2024-04-26T11:13:53.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6699999999999998e-06 2024-04-26T11:13:53.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:53.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905708+0000", 2024-04-26T11:13:53.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3000000000000002e-06 2024-04-26T11:13:53.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905712+0000", 2024-04-26T11:13:53.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.425e-06 2024-04-26T11:13:53.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905855+0000", 2024-04-26T11:13:53.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014253200000000001 2024-04-26T11:13:53.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:53.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905858+0000", 2024-04-26T11:13:53.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.822e-06 2024-04-26T11:13:53.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923510+0000", 2024-04-26T11:13:53.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017651394000000001 2024-04-26T11:13:53.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:53.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923578+0000", 2024-04-26T11:13:53.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8283999999999999e-05 2024-04-26T11:13:53.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:53.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923710+0000", 2024-04-26T11:13:53.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013175200000000001 2024-04-26T11:13:53.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:53.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925607+0000", 2024-04-26T11:13:53.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001897648 2024-04-26T11:13:53.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925644+0000", 2024-04-26T11:13:53.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6658e-05 2024-04-26T11:13:53.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:53.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925673+0000", 2024-04-26T11:13:53.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8566999999999999e-05 2024-04-26T11:13:53.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:53.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925692+0000", 2024-04-26T11:13:53.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9720000000000001e-05 2024-04-26T11:13:53.842 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.842 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.843 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.843 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:53.843 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905731+0000", 2024-04-26T11:13:53.843 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.914919449999999, 2024-04-26T11:13:53.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020112349000000002, 2024-04-26T11:13:53.843 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:53.843 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.843 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:53.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:53.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905731+0000", 2024-04-26T11:13:53.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:53.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905731+0000", 2024-04-26T11:13:53.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:53.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905731+0000", 2024-04-26T11:13:53.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:53.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905734+0000", 2024-04-26T11:13:53.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2329999999999998e-06 2024-04-26T11:13:53.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:53.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905740+0000", 2024-04-26T11:13:53.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4300000000000003e-06 2024-04-26T11:13:53.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905752+0000", 2024-04-26T11:13:53.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1987000000000001e-05 2024-04-26T11:13:53.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905894+0000", 2024-04-26T11:13:53.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000141858 2024-04-26T11:13:53.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:53.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905898+0000", 2024-04-26T11:13:53.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3599999999999998e-06 2024-04-26T11:13:53.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924011+0000", 2024-04-26T11:13:53.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018113066000000001 2024-04-26T11:13:53.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:53.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924100+0000", 2024-04-26T11:13:53.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8894999999999995e-05 2024-04-26T11:13:53.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:53.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924188+0000", 2024-04-26T11:13:53.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7903000000000002e-05 2024-04-26T11:13:53.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:53.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925616+0000", 2024-04-26T11:13:53.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014277319999999999 2024-04-26T11:13:53.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925741+0000", 2024-04-26T11:13:53.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012525899999999999 2024-04-26T11:13:53.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:53.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925804+0000", 2024-04-26T11:13:53.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2954999999999996e-05 2024-04-26T11:13:53.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:53.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925843+0000", 2024-04-26T11:13:53.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9096e-05 2024-04-26T11:13:53.849 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.849 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.849 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.849 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:53.849 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905757+0000", 2024-04-26T11:13:53.849 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.914893470999999, 2024-04-26T11:13:53.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020224836999999999, 2024-04-26T11:13:53.849 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:53.849 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.849 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:53.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:53.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905757+0000", 2024-04-26T11:13:53.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:53.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905757+0000", 2024-04-26T11:13:53.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:53.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905757+0000", 2024-04-26T11:13:53.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:53.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905760+0000", 2024-04-26T11:13:53.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2219999999999998e-06 2024-04-26T11:13:53.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:53.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905766+0000", 2024-04-26T11:13:53.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0820000000000004e-06 2024-04-26T11:13:53.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905771+0000", 2024-04-26T11:13:53.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1159999999999998e-06 2024-04-26T11:13:53.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905930+0000", 2024-04-26T11:13:53.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015876200000000001 2024-04-26T11:13:53.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:53.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905933+0000", 2024-04-26T11:13:53.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0359999999999998e-06 2024-04-26T11:13:53.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924368+0000", 2024-04-26T11:13:53.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0184355 2024-04-26T11:13:53.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:53.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924415+0000", 2024-04-26T11:13:53.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7098000000000002e-05 2024-04-26T11:13:53.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:53.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924506+0000", 2024-04-26T11:13:53.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1090999999999999e-05 2024-04-26T11:13:53.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:53.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925622+0000", 2024-04-26T11:13:53.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011159480000000001 2024-04-26T11:13:53.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925927+0000", 2024-04-26T11:13:53.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00030507899999999998 2024-04-26T11:13:53.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:53.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925958+0000", 2024-04-26T11:13:53.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0534999999999998e-05 2024-04-26T11:13:53.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:53.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925982+0000", 2024-04-26T11:13:53.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3782999999999999e-05 2024-04-26T11:13:53.855 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.855 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.855 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.855 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:53.855 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905814+0000", 2024-04-26T11:13:53.855 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.914836332999997, 2024-04-26T11:13:53.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020271001, 2024-04-26T11:13:53.855 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:53.855 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.855 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:53.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:53.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905814+0000", 2024-04-26T11:13:53.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:53.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905814+0000", 2024-04-26T11:13:53.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:53.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905813+0000", 2024-04-26T11:13:53.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:53.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:53.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905821+0000", 2024-04-26T11:13:53.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1280000000000008e-06 2024-04-26T11:13:53.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:53.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905832+0000", 2024-04-26T11:13:53.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1318000000000001e-05 2024-04-26T11:13:53.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905842+0000", 2024-04-26T11:13:53.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0101e-05 2024-04-26T11:13:53.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905970+0000", 2024-04-26T11:13:53.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012764499999999999 2024-04-26T11:13:53.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:53.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905977+0000", 2024-04-26T11:13:53.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5019999999999998e-06 2024-04-26T11:13:53.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924672+0000", 2024-04-26T11:13:53.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018694908999999999 2024-04-26T11:13:53.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:53.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924754+0000", 2024-04-26T11:13:53.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2167000000000001e-05 2024-04-26T11:13:53.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:53.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924834+0000", 2024-04-26T11:13:53.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0313000000000002e-05 2024-04-26T11:13:53.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:53.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925860+0000", 2024-04-26T11:13:53.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0010255869999999999 2024-04-26T11:13:53.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926020+0000", 2024-04-26T11:13:53.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000160588 2024-04-26T11:13:53.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:53.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926054+0000", 2024-04-26T11:13:53.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3748999999999998e-05 2024-04-26T11:13:53.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:53.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926085+0000", 2024-04-26T11:13:53.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1111000000000001e-05 2024-04-26T11:13:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905851+0000", 2024-04-26T11:13:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.914799244000001, 2024-04-26T11:13:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020308667999999998, 2024-04-26T11:13:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:53.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905851+0000", 2024-04-26T11:13:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905851+0000", 2024-04-26T11:13:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905851+0000", 2024-04-26T11:13:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:53.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905855+0000", 2024-04-26T11:13:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3120000000000004e-06 2024-04-26T11:13:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905861+0000", 2024-04-26T11:13:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9399999999999999e-06 2024-04-26T11:13:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905865+0000", 2024-04-26T11:13:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9079999999999997e-06 2024-04-26T11:13:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906003+0000", 2024-04-26T11:13:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013821800000000001 2024-04-26T11:13:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906007+0000", 2024-04-26T11:13:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9670000000000003e-06 2024-04-26T11:13:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925040+0000", 2024-04-26T11:13:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019032613 2024-04-26T11:13:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925107+0000", 2024-04-26T11:13:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7185000000000001e-05 2024-04-26T11:13:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925195+0000", 2024-04-26T11:13:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8515000000000002e-05 2024-04-26T11:13:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926094+0000", 2024-04-26T11:13:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00089852300000000003 2024-04-26T11:13:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926116+0000", 2024-04-26T11:13:53.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1951e-05 2024-04-26T11:13:53.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:53.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926142+0000", 2024-04-26T11:13:53.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6667000000000001e-05 2024-04-26T11:13:53.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:53.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.926160+0000", 2024-04-26T11:13:53.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7339000000000001e-05 2024-04-26T11:13:53.866 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:31 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905953+0000", 2024-04-26T11:13:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.914697558, 2024-04-26T11:13:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018731343000000001, 2024-04-26T11:13:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905953+0000", 2024-04-26T11:13:53.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905953+0000", 2024-04-26T11:13:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905952+0000", 2024-04-26T11:13:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:53.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905966+0000", 2024-04-26T11:13:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3281999999999999e-05 2024-04-26T11:13:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905973+0000", 2024-04-26T11:13:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4109999999999999e-06 2024-04-26T11:13:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905979+0000", 2024-04-26T11:13:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2949999999999999e-06 2024-04-26T11:13:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906013+0000", 2024-04-26T11:13:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3844000000000003e-05 2024-04-26T11:13:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906017+0000", 2024-04-26T11:13:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4419999999999998e-06 2024-04-26T11:13:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.918937+0000", 2024-04-26T11:13:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012920403 2024-04-26T11:13:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.919018+0000", 2024-04-26T11:13:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1540999999999997e-05 2024-04-26T11:13:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.919765+0000", 2024-04-26T11:13:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00074620299999999997 2024-04-26T11:13:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923650+0000", 2024-04-26T11:13:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038853820000000002 2024-04-26T11:13:53.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924619+0000", 2024-04-26T11:13:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00096863899999999998 2024-04-26T11:13:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924649+0000", 2024-04-26T11:13:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9879e-05 2024-04-26T11:13:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924684+0000", 2024-04-26T11:13:53.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5611999999999997e-05 2024-04-26T11:13:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:33 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.905987+0000", 2024-04-26T11:13:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.914663898000001, 2024-04-26T11:13:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018241182000000002, 2024-04-26T11:13:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:53.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905987+0000", 2024-04-26T11:13:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905987+0000", 2024-04-26T11:13:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905986+0000", 2024-04-26T11:13:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:53.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905990+0000", 2024-04-26T11:13:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.755e-06 2024-04-26T11:13:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.905995+0000", 2024-04-26T11:13:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4999999999999999e-06 2024-04-26T11:13:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906000+0000", 2024-04-26T11:13:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8949999999999997e-06 2024-04-26T11:13:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906038+0000", 2024-04-26T11:13:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7762999999999997e-05 2024-04-26T11:13:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906042+0000", 2024-04-26T11:13:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6890000000000002e-06 2024-04-26T11:13:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922401+0000", 2024-04-26T11:13:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016358973999999998 2024-04-26T11:13:53.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:53.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922482+0000", 2024-04-26T11:13:53.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1711000000000004e-05 2024-04-26T11:13:53.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:53.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922607+0000", 2024-04-26T11:13:53.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000124955 2024-04-26T11:13:53.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924016+0000", 2024-04-26T11:13:53.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014086490000000001 2024-04-26T11:13:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924154+0000", 2024-04-26T11:13:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013777599999999999 2024-04-26T11:13:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924196+0000", 2024-04-26T11:13:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2647e-05 2024-04-26T11:13:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:53.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924228+0000", 2024-04-26T11:13:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1372999999999999e-05 2024-04-26T11:13:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906048+0000", 2024-04-26T11:13:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.914602469000002, 2024-04-26T11:13:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018763734000000001, 2024-04-26T11:13:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:53.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:53.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906048+0000", 2024-04-26T11:13:53.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:53.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906048+0000", 2024-04-26T11:13:53.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:53.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906047+0000", 2024-04-26T11:13:53.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:53.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906051+0000", 2024-04-26T11:13:53.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.799e-06 2024-04-26T11:13:53.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:53.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906058+0000", 2024-04-26T11:13:53.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4470000000000003e-06 2024-04-26T11:13:53.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906064+0000", 2024-04-26T11:13:53.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1319999999999999e-06 2024-04-26T11:13:53.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906092+0000", 2024-04-26T11:13:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7939000000000001e-05 2024-04-26T11:13:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906097+0000", 2024-04-26T11:13:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.741e-06 2024-04-26T11:13:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920571+0000", 2024-04-26T11:13:53.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014474526 2024-04-26T11:13:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920675+0000", 2024-04-26T11:13:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000103644 2024-04-26T11:13:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.920803+0000", 2024-04-26T11:13:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012879699999999999 2024-04-26T11:13:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923655+0000", 2024-04-26T11:13:53.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028517379999999999 2024-04-26T11:13:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924728+0000", 2024-04-26T11:13:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0010732199999999999 2024-04-26T11:13:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924775+0000", 2024-04-26T11:13:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6168999999999998e-05 2024-04-26T11:13:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924812+0000", 2024-04-26T11:13:53.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7070000000000003e-05 2024-04-26T11:13:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906123+0000", 2024-04-26T11:13:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.914527597000003, 2024-04-26T11:13:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018987535999999999, 2024-04-26T11:13:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:53.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906123+0000", 2024-04-26T11:13:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906123+0000", 2024-04-26T11:13:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906122+0000", 2024-04-26T11:13:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:53.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906136+0000", 2024-04-26T11:13:53.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4527e-05 2024-04-26T11:13:53.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:53.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906148+0000", 2024-04-26T11:13:53.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2332e-05 2024-04-26T11:13:53.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906157+0000", 2024-04-26T11:13:53.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0129999999999999e-06 2024-04-26T11:13:53.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906187+0000", 2024-04-26T11:13:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9748e-05 2024-04-26T11:13:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906190+0000", 2024-04-26T11:13:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0290000000000001e-06 2024-04-26T11:13:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.921242+0000", 2024-04-26T11:13:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015052100000000001 2024-04-26T11:13:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:53.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.921750+0000", 2024-04-26T11:13:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00050746299999999999 2024-04-26T11:13:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.921915+0000", 2024-04-26T11:13:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016514700000000001 2024-04-26T11:13:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.923673+0000", 2024-04-26T11:13:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001757836 2024-04-26T11:13:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925039+0000", 2024-04-26T11:13:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001366396 2024-04-26T11:13:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925077+0000", 2024-04-26T11:13:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7595999999999997e-05 2024-04-26T11:13:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925110+0000", 2024-04-26T11:13:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3531999999999997e-05 2024-04-26T11:13:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906218+0000", 2024-04-26T11:13:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.914432761999997, 2024-04-26T11:13:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018831681999999999, 2024-04-26T11:13:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906218+0000", 2024-04-26T11:13:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906218+0000", 2024-04-26T11:13:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906217+0000", 2024-04-26T11:13:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906221+0000", 2024-04-26T11:13:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1760000000000003e-06 2024-04-26T11:13:53.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906228+0000", 2024-04-26T11:13:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9800000000000001e-06 2024-04-26T11:13:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906234+0000", 2024-04-26T11:13:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9320000000000001e-06 2024-04-26T11:13:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906264+0000", 2024-04-26T11:13:53.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9518000000000001e-05 2024-04-26T11:13:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op must wait for map", 2024-04-26T11:13:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906268+0000", 2024-04-26T11:13:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2939999999999999e-06 2024-04-26T11:13:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922451+0000", 2024-04-26T11:13:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016183288000000001 2024-04-26T11:13:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:53.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922567+0000", 2024-04-26T11:13:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000115313 2024-04-26T11:13:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922684+0000", 2024-04-26T11:13:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117419 2024-04-26T11:13:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924129+0000", 2024-04-26T11:13:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001444753 2024-04-26T11:13:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.924979+0000", 2024-04-26T11:13:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00084985900000000001 2024-04-26T11:13:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925012+0000", 2024-04-26T11:13:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3352999999999997e-05 2024-04-26T11:13:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925049+0000", 2024-04-26T11:13:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7354999999999997e-05 2024-04-26T11:13:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.896 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:12.906243+0000", 2024-04-26T11:13:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.914407382999997, 2024-04-26T11:13:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018983739999999999, 2024-04-26T11:13:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:13:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906243+0000", 2024-04-26T11:13:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906243+0000", 2024-04-26T11:13:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906243+0000", 2024-04-26T11:13:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906245+0000", 2024-04-26T11:13:53.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9189999999999999e-06 2024-04-26T11:13:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906252+0000", 2024-04-26T11:13:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:13:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906258+0000", 2024-04-26T11:13:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.728e-06 2024-04-26T11:13:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906290+0000", 2024-04-26T11:13:53.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2400000000000001e-05 2024-04-26T11:13:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.906293+0000", 2024-04-26T11:13:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1769999999999998e-06 2024-04-26T11:13:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922664+0000", 2024-04-26T11:13:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016370663000000001 2024-04-26T11:13:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.922923+0000", 2024-04-26T11:13:53.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00025853200000000001 2024-04-26T11:13:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:12.925227+0000", 2024-04-26T11:13:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023042570000000001 2024-04-26T11:13:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:47260 5.f 5:f0be0cbd:::benchmark_data_smithi029_44842_object47259:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:53.268352+0000", 2024-04-26T11:13:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.55229797400000002, 2024-04-26T11:13:53.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.149544071, 2024-04-26T11:13:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 47260 2024-04-26T11:13:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268352+0000", 2024-04-26T11:13:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268352+0000", 2024-04-26T11:13:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268352+0000", 2024-04-26T11:13:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268412+0000", 2024-04-26T11:13:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0609999999999997e-05 2024-04-26T11:13:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268425+0000", 2024-04-26T11:13:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2403e-05 2024-04-26T11:13:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268433+0000", 2024-04-26T11:13:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:13:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268462+0000", 2024-04-26T11:13:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8571000000000001e-05 2024-04-26T11:13:53.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268552+0000", 2024-04-26T11:13:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0804999999999995e-05 2024-04-26T11:13:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268629+0000", 2024-04-26T11:13:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6996999999999995e-05 2024-04-26T11:13:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.270729+0000", 2024-04-26T11:13:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0020996209999999999 2024-04-26T11:13:53.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.417830+0000", 2024-04-26T11:13:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.147100589 2024-04-26T11:13:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.417858+0000", 2024-04-26T11:13:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7914000000000001e-05 2024-04-26T11:13:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.417896+0000", 2024-04-26T11:13:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8934999999999999e-05 2024-04-26T11:13:53.906 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:47264 5.2 5:4ecbc772:::benchmark_data_smithi029_44842_object47263:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:53.268503+0000", 2024-04-26T11:13:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.55214712899999996, 2024-04-26T11:13:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.149191198, 2024-04-26T11:13:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 47264 2024-04-26T11:13:53.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268503+0000", 2024-04-26T11:13:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268503+0000", 2024-04-26T11:13:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:53.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268502+0000", 2024-04-26T11:13:53.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:53.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:53.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268675+0000", 2024-04-26T11:13:53.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017224100000000001 2024-04-26T11:13:53.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:53.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268683+0000", 2024-04-26T11:13:53.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0730000000000005e-06 2024-04-26T11:13:53.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.268687+0000", 2024-04-26T11:13:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1559999999999997e-06 2024-04-26T11:13:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.269653+0000", 2024-04-26T11:13:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00096616900000000001 2024-04-26T11:13:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.269780+0000", 2024-04-26T11:13:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000126871 2024-04-26T11:13:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.269914+0000", 2024-04-26T11:13:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000134072 2024-04-26T11:13:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.271739+0000", 2024-04-26T11:13:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00182452 2024-04-26T11:13:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.417605+0000", 2024-04-26T11:13:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.145865987 2024-04-26T11:13:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.417653+0000", 2024-04-26T11:13:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8900999999999998e-05 2024-04-26T11:13:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.417694+0000", 2024-04-26T11:13:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1026999999999999e-05 2024-04-26T11:13:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:47272 5.f 5:f1f61da5:::benchmark_data_smithi029_44842_object47271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:53.271143+0000", 2024-04-26T11:13:53.912 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.54950690499999999, 2024-04-26T11:13:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.15203951499999999, 2024-04-26T11:13:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 47272 2024-04-26T11:13:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:53.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.271143+0000", 2024-04-26T11:13:53.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:53.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.271143+0000", 2024-04-26T11:13:53.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:53.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.271143+0000", 2024-04-26T11:13:53.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.999999 2024-04-26T11:13:53.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.271213+0000", 2024-04-26T11:13:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0037999999999996e-05 2024-04-26T11:13:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.271219+0000", 2024-04-26T11:13:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6150000000000002e-06 2024-04-26T11:13:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.271224+0000", 2024-04-26T11:13:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.656e-06 2024-04-26T11:13:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.271268+0000", 2024-04-26T11:13:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4529e-05 2024-04-26T11:13:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.271402+0000", 2024-04-26T11:13:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133261 2024-04-26T11:13:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2024-04-26T11:13:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.271523+0000", 2024-04-26T11:13:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012136 2024-04-26T11:13:53.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.418038+0000", 2024-04-26T11:13:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14651515900000001 2024-04-26T11:13:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.423089+0000", 2024-04-26T11:13:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050506120000000003 2024-04-26T11:13:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.423144+0000", 2024-04-26T11:13:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4879000000000001e-05 2024-04-26T11:13:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.423183+0000", 2024-04-26T11:13:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9283999999999999e-05 2024-04-26T11:13:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4534.0:47274 5.5 e24/16 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head v 24'2847, mlcod=24'2845)", 2024-04-26T11:13:53.918 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:53.272031+0000", 2024-04-26T11:13:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.54861977399999995, 2024-04-26T11:13:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14986749399999999, 2024-04-26T11:13:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.272031+0000", 2024-04-26T11:13:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.272031+0000", 2024-04-26T11:13:53.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:53.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.272030+0000", 2024-04-26T11:13:53.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:53.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.272088+0000", 2024-04-26T11:13:53.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8239999999999998e-05 2024-04-26T11:13:53.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:53.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.272098+0000", 2024-04-26T11:13:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4239999999999999e-06 2024-04-26T11:13:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.272104+0000", 2024-04-26T11:13:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1260000000000003e-06 2024-04-26T11:13:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.921 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.272132+0000", 2024-04-26T11:13:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8394999999999998e-05 2024-04-26T11:13:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.272144+0000", 2024-04-26T11:13:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1603999999999999e-05 2024-04-26T11:13:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.421871+0000", 2024-04-26T11:13:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.149727211 2024-04-26T11:13:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:53.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.421898+0000", 2024-04-26T11:13:53.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7155e-05 2024-04-26T11:13:53.923 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.923 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.923 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.923 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4534.0:47267 5.3 e24/16 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head v 24'2974, mlcod=24'2971)", 2024-04-26T11:13:53.923 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:53.273336+0000", 2024-04-26T11:13:53.923 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.54731487700000003, 2024-04-26T11:13:53.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14869191300000001, 2024-04-26T11:13:53.923 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:53.923 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.273336+0000", 2024-04-26T11:13:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.273336+0000", 2024-04-26T11:13:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.273335+0000", 2024-04-26T11:13:53.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.273401+0000", 2024-04-26T11:13:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5708000000000002e-05 2024-04-26T11:13:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.417451+0000", 2024-04-26T11:13:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14404999299999999 2024-04-26T11:13:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.925 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.417461+0000", 2024-04-26T11:13:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0108999999999999e-05 2024-04-26T11:13:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.417503+0000", 2024-04-26T11:13:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2478000000000002e-05 2024-04-26T11:13:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.417533+0000", 2024-04-26T11:13:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9624999999999998e-05 2024-04-26T11:13:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.421991+0000", 2024-04-26T11:13:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0044578370000000001 2024-04-26T11:13:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:13:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6829999999999998e-05 2024-04-26T11:13:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(client.4534.0:47260 5.f e24/16 ondisk, result = 0)", 2024-04-26T11:13:53.927 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:53.274040+0000", 2024-04-26T11:13:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.54661089900000004, 2024-04-26T11:13:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14386550300000001, 2024-04-26T11:13:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2024-04-26T11:13:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.274040+0000", 2024-04-26T11:13:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.274040+0000", 2024-04-26T11:13:53.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.274039+0000", 2024-04-26T11:13:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.274044+0000", 2024-04-26T11:13:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8040000000000001e-06 2024-04-26T11:13:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.417433+0000", 2024-04-26T11:13:53.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14338954200000001 2024-04-26T11:13:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.417451+0000", 2024-04-26T11:13:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7581e-05 2024-04-26T11:13:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.417818+0000", 2024-04-26T11:13:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036759 2024-04-26T11:13:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:53.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.417826+0000", 2024-04-26T11:13:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6450000000000005e-06 2024-04-26T11:13:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.417905+0000", 2024-04-26T11:13:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9034000000000003e-05 2024-04-26T11:13:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4534.0:47282 5.2 5:4291b6a9:::benchmark_data_smithi029_44842_object47281:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:53.931 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:13:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.54136416700000001, 2024-04-26T11:13:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14698537, 2024-04-26T11:13:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2024-04-26T11:13:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2024-04-26T11:13:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4534", 2024-04-26T11:13:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 47282 2024-04-26T11:13:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2024-04-26T11:13:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2024-04-26T11:13:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:13:53.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2024-04-26T11:13:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:13:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2024-04-26T11:13:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2024-04-26T11:13:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.279281+0000", 2024-04-26T11:13:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4294967295.9999943 2024-04-26T11:13:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2024-04-26T11:13:53.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.279388+0000", 2024-04-26T11:13:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000106797 2024-04-26T11:13:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2024-04-26T11:13:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.417497+0000", 2024-04-26T11:13:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.138109026 2024-04-26T11:13:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2024-04-26T11:13:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.417512+0000", 2024-04-26T11:13:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5274e-05 2024-04-26T11:13:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2024-04-26T11:13:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.417728+0000", 2024-04-26T11:13:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000215959 2024-04-26T11:13:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2024-04-26T11:13:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.417873+0000", 2024-04-26T11:13:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014548 2024-04-26T11:13:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.418026+0000", 2024-04-26T11:13:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000152907 2024-04-26T11:13:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2024-04-26T11:13:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.423026+0000", 2024-04-26T11:13:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049994239999999997 2024-04-26T11:13:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.426204+0000", 2024-04-26T11:13:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0031780519999999998 2024-04-26T11:13:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2024-04-26T11:13:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.426235+0000", 2024-04-26T11:13:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1080000000000001e-05 2024-04-26T11:13:53.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-04-26T11:13:53.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-04-26T11:13:53.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2024-04-26T11:13:53.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2024-04-26T11:13:53.426272+0000", 2024-04-26T11:13:53.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6891000000000003e-05 2024-04-26T11:13:53.937 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.937 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.937 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.937 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-04-26T11:13:53.937 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-04-26T11:13:53.937 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:13:53.939 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:53.936+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:53.939 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:13:53.943 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:13:53.964 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:13:53.984 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:13:53.985 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:13:53.985 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:13:53.985 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:13:54.039 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:54.037+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:54.110 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:54.110 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:54.123 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:13:54.141 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:54.139+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:54.242 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:54.240+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:54.292 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:54.292 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:54.304 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:13:54.337 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:13:54.353 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:54.346+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:54.411 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 16 15 49684 49669 194.004 149.5 0.00617808 0.00515171 2024-04-26T11:13:54.443 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:54.441+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:54.472 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:54.472 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:54.486 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:13:54.546 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:54.544+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:54.647 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:54.644+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:54.663 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:54.663 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:54.680 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:13:54.765 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:54.762+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:54.848 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:54.846+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:54.901 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:54.902 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:54.918 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:13:54.950 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:54.948+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:55.050 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:55.049+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:55.141 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:55.142 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:55.152 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:55.150+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:55.157 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:13:55.253 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:55.251+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:55.324 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:55.324 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:55.339 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:13:55.385 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:55.383+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:55.411 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 17 16 52008 51992 191.131 145.188 0.00495641 0.00522897 2024-04-26T11:13:55.454 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:55.453+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:55.507 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:55.507 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:55.522 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:13:55.555 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:55.553+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:55.656 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:55.654+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:55.728 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:55.728 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:55.742 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:13:55.783 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:55.781+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:55.859 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:55.857+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:55.921 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:55.921 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:55.937 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:13:55.960 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:55.958+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:55.996 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:13:56.061 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:56.059+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:56.122 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:56.122 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:56.137 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:13:56.151 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0: {} 2024-04-26T11:13:56.162 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:56.160+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:56.173 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:13:56.193 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:13:56.194 INFO:teuthology.orchestra.run.smithi029.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:13:56.194 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:13:56.194 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:13:56.263 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:56.261+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:56.317 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:13:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:13:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:13:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:13:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:32247 5.c 5:3dd2b787:::benchmark_data_smithi029_44842_object32246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.259409+0000", 2024-04-26T11:13:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 9.0551280670000001, 2024-04-26T11:13:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015090465000000001, 2024-04-26T11:13:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 32247 2024-04-26T11:13:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.259409+0000", 2024-04-26T11:13:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.259409+0000", 2024-04-26T11:13:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.259408+0000", 2024-04-26T11:13:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.259439+0000", 2024-04-26T11:13:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0954999999999998e-05 2024-04-26T11:13:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.259447+0000", 2024-04-26T11:13:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2230000000000007e-06 2024-04-26T11:13:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.259458+0000", 2024-04-26T11:13:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0586e-05 2024-04-26T11:13:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.260834+0000", 2024-04-26T11:13:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00137634 2024-04-26T11:13:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.260957+0000", 2024-04-26T11:13:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012241199999999999 2024-04-26T11:13:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.261091+0000", 2024-04-26T11:13:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000133817 2024-04-26T11:13:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.267473+0000", 2024-04-26T11:13:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0063827119999999996 2024-04-26T11:13:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.274410+0000", 2024-04-26T11:13:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069364020000000004 2024-04-26T11:13:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.274465+0000", 2024-04-26T11:13:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4987000000000001e-05 2024-04-26T11:13:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.274499+0000", 2024-04-26T11:13:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4554999999999997e-05 2024-04-26T11:13:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:32823 5.6 5:6cacaef4:::benchmark_data_smithi029_44842_object32822:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.459516+0000", 2024-04-26T11:13:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.8550212419999994, 2024-04-26T11:13:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.01540511, 2024-04-26T11:13:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 32823 2024-04-26T11:13:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.459516+0000", 2024-04-26T11:13:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.459516+0000", 2024-04-26T11:13:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.459515+0000", 2024-04-26T11:13:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.459578+0000", 2024-04-26T11:13:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3318999999999995e-05 2024-04-26T11:13:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.459586+0000", 2024-04-26T11:13:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9179999999999994e-06 2024-04-26T11:13:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.459591+0000", 2024-04-26T11:13:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3720000000000004e-06 2024-04-26T11:13:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.460740+0000", 2024-04-26T11:13:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00114861 2024-04-26T11:13:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.460833+0000", 2024-04-26T11:13:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3125e-05 2024-04-26T11:13:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.460973+0000", 2024-04-26T11:13:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013959000000000001 2024-04-26T11:13:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.463853+0000", 2024-04-26T11:13:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002880549 2024-04-26T11:13:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.474871+0000", 2024-04-26T11:13:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011017469 2024-04-26T11:13:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.474899+0000", 2024-04-26T11:13:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8580000000000001e-05 2024-04-26T11:13:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.474921+0000", 2024-04-26T11:13:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1316000000000001e-05 2024-04-26T11:13:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:33820 5.3 5:cfcfda3f:::benchmark_data_smithi029_44842_object33819:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.801167+0000", 2024-04-26T11:13:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.5133698169999992, 2024-04-26T11:13:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015083233, 2024-04-26T11:13:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 33820 2024-04-26T11:13:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.801167+0000", 2024-04-26T11:13:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.801167+0000", 2024-04-26T11:13:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.801166+0000", 2024-04-26T11:13:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.801195+0000", 2024-04-26T11:13:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8683e-05 2024-04-26T11:13:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.801202+0000", 2024-04-26T11:13:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3999999999999997e-06 2024-04-26T11:13:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.801205+0000", 2024-04-26T11:13:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9090000000000002e-06 2024-04-26T11:13:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.803951+0000", 2024-04-26T11:13:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0027452520000000001 2024-04-26T11:13:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804073+0000", 2024-04-26T11:13:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012266600000000001 2024-04-26T11:13:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804212+0000", 2024-04-26T11:13:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013901899999999999 2024-04-26T11:13:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.811894+0000", 2024-04-26T11:13:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0076815049999999999 2024-04-26T11:13:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.816195+0000", 2024-04-26T11:13:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.004300669 2024-04-26T11:13:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.816226+0000", 2024-04-26T11:13:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1223000000000002e-05 2024-04-26T11:13:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.816250+0000", 2024-04-26T11:13:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4485e-05 2024-04-26T11:13:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:33826 5.3 5:c4100d2e:::benchmark_data_smithi029_44842_object33825:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.804001+0000", 2024-04-26T11:13:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.5105353560000001, 2024-04-26T11:13:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015655404000000001, 2024-04-26T11:13:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 33826 2024-04-26T11:13:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804001+0000", 2024-04-26T11:13:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804001+0000", 2024-04-26T11:13:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804001+0000", 2024-04-26T11:13:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804056+0000", 2024-04-26T11:13:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5285999999999999e-05 2024-04-26T11:13:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804065+0000", 2024-04-26T11:13:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.8589999999999994e-06 2024-04-26T11:13:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804083+0000", 2024-04-26T11:13:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7949999999999999e-05 2024-04-26T11:13:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.806510+0000", 2024-04-26T11:13:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0024274930000000002 2024-04-26T11:13:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.806622+0000", 2024-04-26T11:13:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000111675 2024-04-26T11:13:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.806769+0000", 2024-04-26T11:13:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000147312 2024-04-26T11:13:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812012+0000", 2024-04-26T11:13:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0052431580000000004 2024-04-26T11:13:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.819580+0000", 2024-04-26T11:13:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0075680410000000002 2024-04-26T11:13:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.819618+0000", 2024-04-26T11:13:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7622e-05 2024-04-26T11:13:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.819657+0000", 2024-04-26T11:13:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8868999999999997e-05 2024-04-26T11:13:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:33827 5.3 5:c927f878:::benchmark_data_smithi029_44842_object33826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.804106+0000", 2024-04-26T11:13:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.5104309740000001, 2024-04-26T11:13:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.017369738999999999, 2024-04-26T11:13:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 33827 2024-04-26T11:13:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804106+0000", 2024-04-26T11:13:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804106+0000", 2024-04-26T11:13:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804105+0000", 2024-04-26T11:13:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804138+0000", 2024-04-26T11:13:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3172e-05 2024-04-26T11:13:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804146+0000", 2024-04-26T11:13:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.204e-06 2024-04-26T11:13:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804153+0000", 2024-04-26T11:13:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0940000000000002e-06 2024-04-26T11:13:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812034+0000", 2024-04-26T11:13:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0078809210000000008 2024-04-26T11:13:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812181+0000", 2024-04-26T11:13:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014739199999999999 2024-04-26T11:13:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812284+0000", 2024-04-26T11:13:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000103453 2024-04-26T11:13:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.814699+0000", 2024-04-26T11:13:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002415043 2024-04-26T11:13:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.821418+0000", 2024-04-26T11:13:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0067184879999999999 2024-04-26T11:13:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.821449+0000", 2024-04-26T11:13:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0763999999999999e-05 2024-04-26T11:13:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.821476+0000", 2024-04-26T11:13:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6889999999999998e-05 2024-04-26T11:13:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:33828 5.b e22/16 5:d3313e8b:::benchmark_data_smithi029_44842_object33827:head v 22'2195, mlcod=22'2192)", 2024-04-26T11:13:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.805391+0000", 2024-04-26T11:13:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.5091453900000005, 2024-04-26T11:13:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016105534000000001, 2024-04-26T11:13:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.805391+0000", 2024-04-26T11:13:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.805391+0000", 2024-04-26T11:13:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.805391+0000", 2024-04-26T11:13:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.805484+0000", 2024-04-26T11:13:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2740999999999999e-05 2024-04-26T11:13:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.805492+0000", 2024-04-26T11:13:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.8799999999999997e-06 2024-04-26T11:13:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.805498+0000", 2024-04-26T11:13:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3510000000000001e-06 2024-04-26T11:13:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.811898+0000", 2024-04-26T11:13:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0063998040000000003 2024-04-26T11:13:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.811919+0000", 2024-04-26T11:13:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1246e-05 2024-04-26T11:13:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.821478+0000", 2024-04-26T11:13:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0095594779999999997 2024-04-26T11:13:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.821497+0000", 2024-04-26T11:13:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8593999999999998e-05 2024-04-26T11:13:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:35482 5.b e23/16 5:d2b3ef95:::benchmark_data_smithi029_44842_object35481:head v 23'2303, mlcod=23'2300)", 2024-04-26T11:13:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:48.420993+0000", 2024-04-26T11:13:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 7.8935442709999997, 2024-04-26T11:13:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016814145999999999, 2024-04-26T11:13:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.420993+0000", 2024-04-26T11:13:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.420993+0000", 2024-04-26T11:13:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.420992+0000", 2024-04-26T11:13:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.421020+0000", 2024-04-26T11:13:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8422999999999999e-05 2024-04-26T11:13:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.421027+0000", 2024-04-26T11:13:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3060000000000003e-06 2024-04-26T11:13:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.421031+0000", 2024-04-26T11:13:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4100000000000001e-06 2024-04-26T11:13:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.421848+0000", 2024-04-26T11:13:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00081644900000000002 2024-04-26T11:13:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.421866+0000", 2024-04-26T11:13:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8702000000000002e-05 2024-04-26T11:13:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.437769+0000", 2024-04-26T11:13:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015902195000000001 2024-04-26T11:13:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.437807+0000", 2024-04-26T11:13:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8170000000000002e-05 2024-04-26T11:13:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:35483 5.b e23/16 5:d3dd14f6:::benchmark_data_smithi029_44842_object35482:head v 23'2304, mlcod=23'2300)", 2024-04-26T11:13:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:48.422102+0000", 2024-04-26T11:13:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 7.8924350409999997, 2024-04-26T11:13:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.017674038, 2024-04-26T11:13:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422102+0000", 2024-04-26T11:13:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422102+0000", 2024-04-26T11:13:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422101+0000", 2024-04-26T11:13:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422129+0000", 2024-04-26T11:13:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8277999999999999e-05 2024-04-26T11:13:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422139+0000", 2024-04-26T11:13:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1290000000000002e-06 2024-04-26T11:13:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422145+0000", 2024-04-26T11:13:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7490000000000001e-06 2024-04-26T11:13:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423217+0000", 2024-04-26T11:13:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0010718539999999999 2024-04-26T11:13:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423234+0000", 2024-04-26T11:13:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6602000000000001e-05 2024-04-26T11:13:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439742+0000", 2024-04-26T11:13:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016508061000000001 2024-04-26T11:13:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439776+0000", 2024-04-26T11:13:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3992000000000003e-05 2024-04-26T11:13:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:35493 5.8 e23/16 5:14785d1e:::benchmark_data_smithi029_44842_object35492:head v 23'2253, mlcod=23'2250)", 2024-04-26T11:13:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:48.422959+0000", 2024-04-26T11:13:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 7.891577464, 2024-04-26T11:13:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016788944, 2024-04-26T11:13:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422959+0000", 2024-04-26T11:13:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422959+0000", 2024-04-26T11:13:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422959+0000", 2024-04-26T11:13:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423085+0000", 2024-04-26T11:13:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012600299999999999 2024-04-26T11:13:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423093+0000", 2024-04-26T11:13:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2339999999999994e-06 2024-04-26T11:13:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423099+0000", 2024-04-26T11:13:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3659999999999997e-06 2024-04-26T11:13:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423130+0000", 2024-04-26T11:13:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0518999999999997e-05 2024-04-26T11:13:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423147+0000", 2024-04-26T11:13:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6997e-05 2024-04-26T11:13:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439721+0000", 2024-04-26T11:13:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016574185000000002 2024-04-26T11:13:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439748+0000", 2024-04-26T11:13:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7131000000000002e-05 2024-04-26T11:13:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:35494 5.4 e23/16 5:2687a65a:::benchmark_data_smithi029_44842_object35493:head v 23'2185, mlcod=23'2181)", 2024-04-26T11:13:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:48.423109+0000", 2024-04-26T11:13:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 7.8914276690000005, 2024-04-26T11:13:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016693116000000001, 2024-04-26T11:13:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423109+0000", 2024-04-26T11:13:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423109+0000", 2024-04-26T11:13:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423109+0000", 2024-04-26T11:13:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423143+0000", 2024-04-26T11:13:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3980999999999999e-05 2024-04-26T11:13:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423150+0000", 2024-04-26T11:13:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3080000000000002e-06 2024-04-26T11:13:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423155+0000", 2024-04-26T11:13:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1529999999999996e-06 2024-04-26T11:13:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423182+0000", 2024-04-26T11:13:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7158e-05 2024-04-26T11:13:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423199+0000", 2024-04-26T11:13:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6478999999999999e-05 2024-04-26T11:13:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439769+0000", 2024-04-26T11:13:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016570519999999998 2024-04-26T11:13:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439802+0000", 2024-04-26T11:13:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2963999999999998e-05 2024-04-26T11:13:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:35496 5.2 e23/16 5:422c3e1d:::benchmark_data_smithi029_44842_object35495:head v 23'2188, mlcod=23'2186)", 2024-04-26T11:13:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:48.423315+0000", 2024-04-26T11:13:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 7.8912221110000003, 2024-04-26T11:13:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016628417, 2024-04-26T11:13:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423315+0000", 2024-04-26T11:13:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423315+0000", 2024-04-26T11:13:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423314+0000", 2024-04-26T11:13:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423376+0000", 2024-04-26T11:13:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1909999999999995e-05 2024-04-26T11:13:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423389+0000", 2024-04-26T11:13:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3144e-05 2024-04-26T11:13:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423396+0000", 2024-04-26T11:13:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0550000000000002e-06 2024-04-26T11:13:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423429+0000", 2024-04-26T11:13:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2815999999999999e-05 2024-04-26T11:13:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423447+0000", 2024-04-26T11:13:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7555e-05 2024-04-26T11:13:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439911+0000", 2024-04-26T11:13:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016464248000000001 2024-04-26T11:13:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439943+0000", 2024-04-26T11:13:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2311000000000003e-05 2024-04-26T11:13:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:35501 5.7 e23/16 5:e8d3a8de:::benchmark_data_smithi029_44842_object35500:head v 23'2194, mlcod=23'2192)", 2024-04-26T11:13:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:48.426097+0000", 2024-04-26T11:13:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 7.888439676, 2024-04-26T11:13:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015283450000000001, 2024-04-26T11:13:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.426097+0000", 2024-04-26T11:13:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.426097+0000", 2024-04-26T11:13:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.426097+0000", 2024-04-26T11:13:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.426363+0000", 2024-04-26T11:13:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00026629799999999999 2024-04-26T11:13:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.426371+0000", 2024-04-26T11:13:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.1359999999999997e-06 2024-04-26T11:13:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.426377+0000", 2024-04-26T11:13:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:13:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.426411+0000", 2024-04-26T11:13:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4042999999999999e-05 2024-04-26T11:13:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.426429+0000", 2024-04-26T11:13:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7608000000000001e-05 2024-04-26T11:13:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.441347+0000", 2024-04-26T11:13:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.014917972 2024-04-26T11:13:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.441381+0000", 2024-04-26T11:13:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4056000000000001e-05 2024-04-26T11:13:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:35536 5.5 5:acc6d5ae:::benchmark_data_smithi029_44842_object35535:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:48.445093+0000", 2024-04-26T11:13:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 7.8694437669999999, 2024-04-26T11:13:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015420552000000001, 2024-04-26T11:13:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 35536 2024-04-26T11:13:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.445093+0000", 2024-04-26T11:13:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.445093+0000", 2024-04-26T11:13:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.445092+0000", 2024-04-26T11:13:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.445251+0000", 2024-04-26T11:13:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015830999999999999 2024-04-26T11:13:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.445260+0000", 2024-04-26T11:13:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4720000000000001e-06 2024-04-26T11:13:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.445266+0000", 2024-04-26T11:13:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2430000000000002e-06 2024-04-26T11:13:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.446759+0000", 2024-04-26T11:13:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0014926570000000001 2024-04-26T11:13:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.446860+0000", 2024-04-26T11:13:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100628 2024-04-26T11:13:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.446940+0000", 2024-04-26T11:13:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0201e-05 2024-04-26T11:13:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.447900+0000", 2024-04-26T11:13:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00095980999999999996 2024-04-26T11:13:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.460464+0000", 2024-04-26T11:13:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.012564594 2024-04-26T11:13:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.460494+0000", 2024-04-26T11:13:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.959e-05 2024-04-26T11:13:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.460514+0000", 2024-04-26T11:13:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9851e-05 2024-04-26T11:13:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:38062 5.c 5:3a6c0710:::benchmark_data_smithi029_44842_object38061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:49.385419+0000", 2024-04-26T11:13:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 6.9291182879999997, 2024-04-26T11:13:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016211069000000002, 2024-04-26T11:13:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 38062 2024-04-26T11:13:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.385419+0000", 2024-04-26T11:13:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.385419+0000", 2024-04-26T11:13:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.385417+0000", 2024-04-26T11:13:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999986 2024-04-26T11:13:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.385494+0000", 2024-04-26T11:13:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6596999999999999e-05 2024-04-26T11:13:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.385504+0000", 2024-04-26T11:13:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0543999999999999e-05 2024-04-26T11:13:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.385512+0000", 2024-04-26T11:13:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9850000000000006e-06 2024-04-26T11:13:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.390338+0000", 2024-04-26T11:13:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0048251939999999997 2024-04-26T11:13:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.390488+0000", 2024-04-26T11:13:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015001200000000001 2024-04-26T11:13:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.390618+0000", 2024-04-26T11:13:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013007599999999999 2024-04-26T11:13:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.393270+0000", 2024-04-26T11:13:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026525810000000002 2024-04-26T11:13:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.401550+0000", 2024-04-26T11:13:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0082794749999999997 2024-04-26T11:13:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.401594+0000", 2024-04-26T11:13:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209000000000003e-05 2024-04-26T11:13:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.401630+0000", 2024-04-26T11:13:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5614999999999997e-05 2024-04-26T11:13:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:46902 5.6 5:6f103941:::benchmark_data_smithi029_44842_object46901:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.120845+0000", 2024-04-26T11:13:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 3.1936920299999998, 2024-04-26T11:13:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018538669000000001, 2024-04-26T11:13:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 46902 2024-04-26T11:13:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120845+0000", 2024-04-26T11:13:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120845+0000", 2024-04-26T11:13:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120844+0000", 2024-04-26T11:13:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120870+0000", 2024-04-26T11:13:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5678e-05 2024-04-26T11:13:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120874+0000", 2024-04-26T11:13:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.3189999999999996e-06 2024-04-26T11:13:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120878+0000", 2024-04-26T11:13:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4240000000000002e-06 2024-04-26T11:13:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.126176+0000", 2024-04-26T11:13:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0052983630000000004 2024-04-26T11:13:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.126300+0000", 2024-04-26T11:13:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012375099999999999 2024-04-26T11:13:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.126426+0000", 2024-04-26T11:13:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012646399999999999 2024-04-26T11:13:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.132371+0000", 2024-04-26T11:13:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0059443839999999996 2024-04-26T11:13:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.139296+0000", 2024-04-26T11:13:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069250320000000002 2024-04-26T11:13:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.139347+0000", 2024-04-26T11:13:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0954e-05 2024-04-26T11:13:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.139383+0000", 2024-04-26T11:13:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6862e-05 2024-04-26T11:13:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:46970 5.6 5:6ae63d9e:::benchmark_data_smithi029_44842_object46969:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.153793+0000", 2024-04-26T11:13:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 3.1607439589999999, 2024-04-26T11:13:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015124235999999999, 2024-04-26T11:13:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 46970 2024-04-26T11:13:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.153793+0000", 2024-04-26T11:13:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.153793+0000", 2024-04-26T11:13:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.153792+0000", 2024-04-26T11:13:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.153849+0000", 2024-04-26T11:13:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7030000000000001e-05 2024-04-26T11:13:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.153856+0000", 2024-04-26T11:13:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1060000000000002e-06 2024-04-26T11:13:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.153861+0000", 2024-04-26T11:13:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.3699999999999997e-06 2024-04-26T11:13:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.157525+0000", 2024-04-26T11:13:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0036644830000000001 2024-04-26T11:13:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.157616+0000", 2024-04-26T11:13:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.0752000000000001e-05 2024-04-26T11:13:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.157708+0000", 2024-04-26T11:13:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2399999999999996e-05 2024-04-26T11:13:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.158770+0000", 2024-04-26T11:13:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0010615259999999999 2024-04-26T11:13:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.168837+0000", 2024-04-26T11:13:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.010067135 2024-04-26T11:13:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.168883+0000", 2024-04-26T11:13:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5491000000000002e-05 2024-04-26T11:13:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.168917+0000", 2024-04-26T11:13:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4523000000000001e-05 2024-04-26T11:13:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:13:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 3.0437899979999998, 2024-04-26T11:13:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:13:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:13:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:13:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:13:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:13:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:13:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:13:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:13:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:13:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:13:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:13:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:13:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:13:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:13:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:13:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:13:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:13:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:13:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:13:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:13:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:13:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:13:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:13:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:13:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:13:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:13:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 3.042978433, 2024-04-26T11:13:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:13:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:13:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:13:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:13:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:13:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:13:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:13:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:13:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:13:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:13:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:13:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:13:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:13:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:13:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:13:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:13:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:13:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:13:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:13:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:13:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:13:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:13:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:13:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:13:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:13:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:13:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 3.0357915960000001, 2024-04-26T11:13:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:13:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:13:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:13:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:13:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:13:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:13:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:13:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:13:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:13:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:13:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:13:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:13:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:13:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:13:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:13:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:13:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:13:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:13:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:13:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:13:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:13:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:13:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:13:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:13:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:13:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:13:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 3.0352507169999998, 2024-04-26T11:13:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:13:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:13:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:13:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:13:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:13:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:13:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:13:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:13:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:13:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:13:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:13:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:13:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:13:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:13:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:13:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:13:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:13:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:13:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:13:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:13:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:13:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:13:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:13:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:13:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:13:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:56.425 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:13:56.425 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:13:56.427 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 18 15 54282 54267 188.411 142.188 0.00898575 0.00530453 2024-04-26T11:13:56.428 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:13:56.428 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:56.425+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:56.527 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:56.525+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:56.595 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:13:56.596 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:13:56.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.596 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:54697 5.b 5:d2527e7e:::benchmark_data_smithi029_44842_object54696:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:13:56.596 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:56.589076+0000", 2024-04-26T11:13:56.596 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0049263349999999996, 2024-04-26T11:13:56.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049537959999999999, 2024-04-26T11:13:56.596 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:56.596 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:56.596 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:56.596 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:56.596 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:56.596 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 54697 2024-04-26T11:13:56.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.596 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:56.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:56.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.589076+0000", 2024-04-26T11:13:56.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:56.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:56.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.589076+0000", 2024-04-26T11:13:56.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:56.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:56.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.589075+0000", 2024-04-26T11:13:56.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:56.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:56.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.589213+0000", 2024-04-26T11:13:56.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013799999999999999 2024-04-26T11:13:56.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:56.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.589221+0000", 2024-04-26T11:13:56.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0849999999999997e-06 2024-04-26T11:13:56.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.589226+0000", 2024-04-26T11:13:56.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9200000000000003e-06 2024-04-26T11:13:56.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:56.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.589261+0000", 2024-04-26T11:13:56.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5163999999999997e-05 2024-04-26T11:13:56.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:56.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.589400+0000", 2024-04-26T11:13:56.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013897900000000001 2024-04-26T11:13:56.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:56.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.589539+0000", 2024-04-26T11:13:56.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013934099999999999 2024-04-26T11:13:56.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:56.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.591365+0000", 2024-04-26T11:13:56.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018257519999999999 2024-04-26T11:13:56.600 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:56.600 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:56.600 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:56.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.600 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:54704 5.4 5:2772de1e:::benchmark_data_smithi029_44842_object54703:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:13:56.600 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:56.591849+0000", 2024-04-26T11:13:56.600 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0021526219999999999, 2024-04-26T11:13:56.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022682850000000001, 2024-04-26T11:13:56.600 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:56.601 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:56.601 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:56.601 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:56.601 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:56.601 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 54704 2024-04-26T11:13:56.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.601 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:56.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:56.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.591849+0000", 2024-04-26T11:13:56.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:56.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:56.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.591849+0000", 2024-04-26T11:13:56.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:56.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:56.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.591848+0000", 2024-04-26T11:13:56.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:56.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:56.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.591902+0000", 2024-04-26T11:13:56.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3918000000000001e-05 2024-04-26T11:13:56.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:56.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.591911+0000", 2024-04-26T11:13:56.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8659999999999995e-06 2024-04-26T11:13:56.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.591917+0000", 2024-04-26T11:13:56.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.144e-06 2024-04-26T11:13:56.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:56.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.591958+0000", 2024-04-26T11:13:56.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1282000000000002e-05 2024-04-26T11:13:56.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:56.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592097+0000", 2024-04-26T11:13:56.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013878799999999999 2024-04-26T11:13:56.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:56.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592252+0000", 2024-04-26T11:13:56.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000154835 2024-04-26T11:13:56.604 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:56.604 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:56.604 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:56.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.604 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:54705 5.b 5:d9b022f1:::benchmark_data_smithi029_44842_object54704:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:13:56.604 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:56.591993+0000", 2024-04-26T11:13:56.604 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0020086819999999999, 2024-04-26T11:13:56.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021993999999999998, 2024-04-26T11:13:56.605 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:56.605 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:56.605 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:56.605 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:56.605 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:56.605 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 54705 2024-04-26T11:13:56.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.605 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:56.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:56.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.591993+0000", 2024-04-26T11:13:56.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:56.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:56.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.591993+0000", 2024-04-26T11:13:56.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:56.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:56.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.591993+0000", 2024-04-26T11:13:56.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:56.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:56.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592057+0000", 2024-04-26T11:13:56.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4085999999999996e-05 2024-04-26T11:13:56.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:56.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592062+0000", 2024-04-26T11:13:56.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1939999999999997e-06 2024-04-26T11:13:56.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592066+0000", 2024-04-26T11:13:56.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6669999999999998e-06 2024-04-26T11:13:56.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:56.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592091+0000", 2024-04-26T11:13:56.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5564000000000001e-05 2024-04-26T11:13:56.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:56.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592205+0000", 2024-04-26T11:13:56.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113384 2024-04-26T11:13:56.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:56.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592322+0000", 2024-04-26T11:13:56.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000116915 2024-04-26T11:13:56.608 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:56.608 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:56.608 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:56.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.609 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4534.0:54703 5.9 e25/16 5:9344aab1:::benchmark_data_smithi029_44842_object54702:head v 25'3419, mlcod=25'3415)", 2024-04-26T11:13:56.609 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:56.592134+0000", 2024-04-26T11:13:56.609 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00186757, 2024-04-26T11:13:56.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021291259999999998, 2024-04-26T11:13:56.609 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:56.609 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:13:56.609 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:56.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:56.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592134+0000", 2024-04-26T11:13:56.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:56.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:56.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592134+0000", 2024-04-26T11:13:56.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:56.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:56.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592134+0000", 2024-04-26T11:13:56.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:56.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:56.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592191+0000", 2024-04-26T11:13:56.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7059999999999999e-05 2024-04-26T11:13:56.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:56.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592200+0000", 2024-04-26T11:13:56.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8810000000000002e-06 2024-04-26T11:13:56.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592206+0000", 2024-04-26T11:13:56.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7510000000000002e-06 2024-04-26T11:13:56.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:56.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592241+0000", 2024-04-26T11:13:56.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4739000000000001e-05 2024-04-26T11:13:56.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:56.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592258+0000", 2024-04-26T11:13:56.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7288000000000001e-05 2024-04-26T11:13:56.612 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:56.612 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:56.612 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:56.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.612 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:54707 5.8 5:1252ca73:::benchmark_data_smithi029_44842_object54706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:13:56.612 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:56.592681+0000", 2024-04-26T11:13:56.612 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.001321336, 2024-04-26T11:13:56.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001650735, 2024-04-26T11:13:56.612 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:56.612 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:56.613 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:56.613 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:56.613 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:56.613 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 54707 2024-04-26T11:13:56.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.613 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:56.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:56.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592681+0000", 2024-04-26T11:13:56.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:56.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:56.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592681+0000", 2024-04-26T11:13:56.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:56.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:56.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592680+0000", 2024-04-26T11:13:56.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:56.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:56.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592754+0000", 2024-04-26T11:13:56.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4219000000000002e-05 2024-04-26T11:13:56.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:56.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592762+0000", 2024-04-26T11:13:56.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3380000000000005e-06 2024-04-26T11:13:56.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592767+0000", 2024-04-26T11:13:56.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.826e-06 2024-04-26T11:13:56.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:56.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592815+0000", 2024-04-26T11:13:56.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8189999999999998e-05 2024-04-26T11:13:56.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:56.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592949+0000", 2024-04-26T11:13:56.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013321200000000001 2024-04-26T11:13:56.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:56.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.593077+0000", 2024-04-26T11:13:56.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128264 2024-04-26T11:13:56.616 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:56.616 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:56.616 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:56.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.616 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:54709 5.0 5:07f943ef:::benchmark_data_smithi029_44842_object54708:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:13:56.616 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:56.592865+0000", 2024-04-26T11:13:56.616 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.001136401, 2024-04-26T11:13:56.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00153903, 2024-04-26T11:13:56.616 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:56.617 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:56.617 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:56.617 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:56.617 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:56.617 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 54709 2024-04-26T11:13:56.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.617 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:56.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:56.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592865+0000", 2024-04-26T11:13:56.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:56.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:56.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592865+0000", 2024-04-26T11:13:56.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:56.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:56.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592865+0000", 2024-04-26T11:13:56.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:56.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:56.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592927+0000", 2024-04-26T11:13:56.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2435999999999996e-05 2024-04-26T11:13:56.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:56.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592934+0000", 2024-04-26T11:13:56.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2319999999999998e-06 2024-04-26T11:13:56.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592937+0000", 2024-04-26T11:13:56.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6720000000000002e-06 2024-04-26T11:13:56.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:56.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.592960+0000", 2024-04-26T11:13:56.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2755000000000002e-05 2024-04-26T11:13:56.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:56.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.593042+0000", 2024-04-26T11:13:56.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1638999999999995e-05 2024-04-26T11:13:56.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:56.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.593133+0000", 2024-04-26T11:13:56.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1645999999999996e-05 2024-04-26T11:13:56.620 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:56.620 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:56.620 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:56.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.620 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:54692 5.b 5:d85431c0:::benchmark_data_smithi029_44842_object54691:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:13:56.620 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:56.586606+0000", 2024-04-26T11:13:56.620 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0073954219999999996, 2024-04-26T11:13:56.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0078749360000000008, 2024-04-26T11:13:56.621 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:56.621 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:13:56.621 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:56.621 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:56.621 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:56.621 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 54692 2024-04-26T11:13:56.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.621 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:56.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:56.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.586606+0000", 2024-04-26T11:13:56.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:56.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:56.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.586606+0000", 2024-04-26T11:13:56.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:56.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:56.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.586606+0000", 2024-04-26T11:13:56.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:56.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:56.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.586660+0000", 2024-04-26T11:13:56.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4175000000000002e-05 2024-04-26T11:13:56.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:56.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.586668+0000", 2024-04-26T11:13:56.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0020000000000006e-06 2024-04-26T11:13:56.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:56.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.586673+0000", 2024-04-26T11:13:56.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6580000000000001e-06 2024-04-26T11:13:56.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:56.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.586701+0000", 2024-04-26T11:13:56.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.826e-05 2024-04-26T11:13:56.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:56.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.586776+0000", 2024-04-26T11:13:56.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4606999999999999e-05 2024-04-26T11:13:56.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:56.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.586853+0000", 2024-04-26T11:13:56.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7842000000000005e-05 2024-04-26T11:13:56.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:56.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:56.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:56.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.589072+0000", 2024-04-26T11:13:56.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022187639999999998 2024-04-26T11:13:56.624 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:56.624 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:56.624 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:56.624 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:56.625 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:13:56.625 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 7 2024-04-26T11:13:56.625 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:13:56.626 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:13:56.628 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:56.626+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:56.729 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:56.728+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:56.831 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:56.829+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:56.837 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:13:56.837 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:13:56.837 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:13:56.837 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:13:56.837 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:13:56.851 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:13:56.936 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:56.934+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:57.033 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:57.031+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:57.062 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:13:57.062 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:13:57.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:13:57.062 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:13:57.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.063 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:57.063 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.905682+0000", 2024-04-26T11:13:57.063 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 44.153697561999998, 2024-04-26T11:13:57.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017168134000000002, 2024-04-26T11:13:57.063 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.063 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.063 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905682+0000", 2024-04-26T11:13:57.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905682+0000", 2024-04-26T11:13:57.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905681+0000", 2024-04-26T11:13:57.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:13:57.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905689+0000", 2024-04-26T11:13:57.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7830000000000004e-06 2024-04-26T11:13:57.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905703+0000", 2024-04-26T11:13:57.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3322000000000001e-05 2024-04-26T11:13:57.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905717+0000", 2024-04-26T11:13:57.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4562000000000001e-05 2024-04-26T11:13:57.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906126+0000", 2024-04-26T11:13:57.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040896900000000002 2024-04-26T11:13:57.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:13:57.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906133+0000", 2024-04-26T11:13:57.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6370000000000002e-06 2024-04-26T11:13:57.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.914252+0000", 2024-04-26T11:13:57.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0081192529999999999 2024-04-26T11:13:57.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:57.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.914675+0000", 2024-04-26T11:13:57.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00042322399999999999 2024-04-26T11:13:57.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:57.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915080+0000", 2024-04-26T11:13:57.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040486899999999998 2024-04-26T11:13:57.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:57.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.917940+0000", 2024-04-26T11:13:57.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0028593400000000001 2024-04-26T11:13:57.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.922776+0000", 2024-04-26T11:13:57.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048359420000000002 2024-04-26T11:13:57.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:57.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.922825+0000", 2024-04-26T11:13:57.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9048999999999997e-05 2024-04-26T11:13:57.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:57.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.922850+0000", 2024-04-26T11:13:57.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5689000000000001e-05 2024-04-26T11:13:57.068 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.068 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.068 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.068 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:26 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:57.069 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906148+0000", 2024-04-26T11:13:57.069 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 44.153232222, 2024-04-26T11:13:57.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017103547, 2024-04-26T11:13:57.069 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.069 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.069 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906148+0000", 2024-04-26T11:13:57.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906148+0000", 2024-04-26T11:13:57.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906147+0000", 2024-04-26T11:13:57.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906152+0000", 2024-04-26T11:13:57.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2530000000000004e-06 2024-04-26T11:13:57.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906160+0000", 2024-04-26T11:13:57.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.605e-06 2024-04-26T11:13:57.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906165+0000", 2024-04-26T11:13:57.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4689999999999996e-06 2024-04-26T11:13:57.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906223+0000", 2024-04-26T11:13:57.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7578999999999999e-05 2024-04-26T11:13:57.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:57.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906228+0000", 2024-04-26T11:13:57.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.485e-06 2024-04-26T11:13:57.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915364+0000", 2024-04-26T11:13:57.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0091359230000000007 2024-04-26T11:13:57.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:57.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915433+0000", 2024-04-26T11:13:57.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8913999999999998e-05 2024-04-26T11:13:57.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.072 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:57.072 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915517+0000", 2024-04-26T11:13:57.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4023000000000005e-05 2024-04-26T11:13:57.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:57.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.918856+0000", 2024-04-26T11:13:57.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0033382469999999999 2024-04-26T11:13:57.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923141+0000", 2024-04-26T11:13:57.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0042854779999999997 2024-04-26T11:13:57.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:57.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923209+0000", 2024-04-26T11:13:57.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8122999999999998e-05 2024-04-26T11:13:57.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:57.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923251+0000", 2024-04-26T11:13:57.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1919999999999998e-05 2024-04-26T11:13:57.074 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.074 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.074 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.074 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:57.074 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906402+0000", 2024-04-26T11:13:57.074 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 44.152978169999997, 2024-04-26T11:13:57.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017555191000000001, 2024-04-26T11:13:57.075 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.075 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.075 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906402+0000", 2024-04-26T11:13:57.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906402+0000", 2024-04-26T11:13:57.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906401+0000", 2024-04-26T11:13:57.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:57.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906407+0000", 2024-04-26T11:13:57.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2689999999999996e-06 2024-04-26T11:13:57.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906416+0000", 2024-04-26T11:13:57.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5080000000000005e-06 2024-04-26T11:13:57.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906422+0000", 2024-04-26T11:13:57.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9460000000000003e-06 2024-04-26T11:13:57.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906459+0000", 2024-04-26T11:13:57.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6998000000000001e-05 2024-04-26T11:13:57.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:57.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906463+0000", 2024-04-26T11:13:57.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.374e-06 2024-04-26T11:13:57.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915821+0000", 2024-04-26T11:13:57.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0093578050000000003 2024-04-26T11:13:57.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:57.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.916209+0000", 2024-04-26T11:13:57.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00038876999999999998 2024-04-26T11:13:57.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:57.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.916349+0000", 2024-04-26T11:13:57.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013992900000000001 2024-04-26T11:13:57.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:57.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.920269+0000", 2024-04-26T11:13:57.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003919133 2024-04-26T11:13:57.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923899+0000", 2024-04-26T11:13:57.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003630716 2024-04-26T11:13:57.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:57.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923932+0000", 2024-04-26T11:13:57.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2471999999999997e-05 2024-04-26T11:13:57.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:57.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923957+0000", 2024-04-26T11:13:57.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5038999999999999e-05 2024-04-26T11:13:57.080 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.080 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.080 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.080 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:33828 5.b 5:d3313e8b:::benchmark_data_smithi029_44842_object33827:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:57.080 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:47.804177+0000", 2024-04-26T11:13:57.080 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.2552027250000002, 2024-04-26T11:13:57.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01819138, 2024-04-26T11:13:57.080 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.080 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.081 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:57.081 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:57.081 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.081 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 33828 2024-04-26T11:13:57.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.081 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804177+0000", 2024-04-26T11:13:57.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804177+0000", 2024-04-26T11:13:57.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804176+0000", 2024-04-26T11:13:57.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804238+0000", 2024-04-26T11:13:57.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1791000000000005e-05 2024-04-26T11:13:57.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804248+0000", 2024-04-26T11:13:57.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9969999999999993e-06 2024-04-26T11:13:57.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804253+0000", 2024-04-26T11:13:57.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2830000000000003e-06 2024-04-26T11:13:57.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.805184+0000", 2024-04-26T11:13:57.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093189900000000003 2024-04-26T11:13:57.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:57.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.805268+0000", 2024-04-26T11:13:57.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3634000000000006e-05 2024-04-26T11:13:57.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:57.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.805359+0000", 2024-04-26T11:13:57.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0603e-05 2024-04-26T11:13:57.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:57.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.806391+0000", 2024-04-26T11:13:57.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001031978 2024-04-26T11:13:57.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.822308+0000", 2024-04-26T11:13:57.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015917343 2024-04-26T11:13:57.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:57.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.822344+0000", 2024-04-26T11:13:57.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5754999999999999e-05 2024-04-26T11:13:57.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:57.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.822368+0000", 2024-04-26T11:13:57.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4658e-05 2024-04-26T11:13:57.086 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.086 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.086 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.086 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35482 5.b 5:d2b3ef95:::benchmark_data_smithi029_44842_object35481:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:57.086 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:13:57.086 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.6406981409999997, 2024-04-26T11:13:57.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019390455000000001, 2024-04-26T11:13:57.086 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.087 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.087 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:57.087 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:57.087 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.087 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35482 2024-04-26T11:13:57.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.087 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:13:57.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:13:57.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418681+0000", 2024-04-26T11:13:57.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:57.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418802+0000", 2024-04-26T11:13:57.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120835 2024-04-26T11:13:57.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418810+0000", 2024-04-26T11:13:57.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1240000000000005e-06 2024-04-26T11:13:57.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418816+0000", 2024-04-26T11:13:57.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5749999999999997e-06 2024-04-26T11:13:57.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.419905+0000", 2024-04-26T11:13:57.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001088751 2024-04-26T11:13:57.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:57.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.420046+0000", 2024-04-26T11:13:57.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140514 2024-04-26T11:13:57.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:57.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.420180+0000", 2024-04-26T11:13:57.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440899999999999 2024-04-26T11:13:57.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:57.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425415+0000", 2024-04-26T11:13:57.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052350540000000003 2024-04-26T11:13:57.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.437989+0000", 2024-04-26T11:13:57.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012573632 2024-04-26T11:13:57.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:57.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.438035+0000", 2024-04-26T11:13:57.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5799e-05 2024-04-26T11:13:57.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:57.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.438072+0000", 2024-04-26T11:13:57.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7530999999999997e-05 2024-04-26T11:13:57.091 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.092 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.092 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.092 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35483 5.b 5:d3dd14f6:::benchmark_data_smithi029_44842_object35482:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:57.092 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:13:57.092 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.6405553990000001, 2024-04-26T11:13:57.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021245969, 2024-04-26T11:13:57.092 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.092 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.092 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:57.092 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:57.092 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.092 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35483 2024-04-26T11:13:57.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.093 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:13:57.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:13:57.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:13:57.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418885+0000", 2024-04-26T11:13:57.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1294e-05 2024-04-26T11:13:57.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418892+0000", 2024-04-26T11:13:57.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4599999999999997e-06 2024-04-26T11:13:57.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418899+0000", 2024-04-26T11:13:57.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0909999999999998e-06 2024-04-26T11:13:57.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421347+0000", 2024-04-26T11:13:57.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024484609999999999 2024-04-26T11:13:57.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:57.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421468+0000", 2024-04-26T11:13:57.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000121179 2024-04-26T11:13:57.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:57.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421605+0000", 2024-04-26T11:13:57.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013672200000000001 2024-04-26T11:13:57.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:57.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425456+0000", 2024-04-26T11:13:57.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038511719999999999 2024-04-26T11:13:57.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.439986+0000", 2024-04-26T11:13:57.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014530080000000001 2024-04-26T11:13:57.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:57.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440038+0000", 2024-04-26T11:13:57.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1916999999999998e-05 2024-04-26T11:13:57.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:57.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440070+0000", 2024-04-26T11:13:57.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2245e-05 2024-04-26T11:13:57.097 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.097 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.097 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.097 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35493 5.8 5:14785d1e:::benchmark_data_smithi029_44842_object35492:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:57.097 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.422582+0000", 2024-04-26T11:13:57.097 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.6367978280000006, 2024-04-26T11:13:57.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01748692, 2024-04-26T11:13:57.098 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.098 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.098 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:57.098 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:57.098 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.098 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35493 2024-04-26T11:13:57.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.098 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422582+0000", 2024-04-26T11:13:57.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422582+0000", 2024-04-26T11:13:57.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422581+0000", 2024-04-26T11:13:57.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422715+0000", 2024-04-26T11:13:57.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013359600000000001 2024-04-26T11:13:57.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422723+0000", 2024-04-26T11:13:57.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4749999999999993e-06 2024-04-26T11:13:57.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422728+0000", 2024-04-26T11:13:57.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7210000000000002e-06 2024-04-26T11:13:57.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422753+0000", 2024-04-26T11:13:57.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4456000000000001e-05 2024-04-26T11:13:57.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:57.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422832+0000", 2024-04-26T11:13:57.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9810999999999999e-05 2024-04-26T11:13:57.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:57.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422932+0000", 2024-04-26T11:13:57.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9865999999999996e-05 2024-04-26T11:13:57.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:57.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.427701+0000", 2024-04-26T11:13:57.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047686999999999998 2024-04-26T11:13:57.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.439983+0000", 2024-04-26T11:13:57.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012281861 2024-04-26T11:13:57.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:57.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440032+0000", 2024-04-26T11:13:57.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9317999999999998e-05 2024-04-26T11:13:57.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:57.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440069+0000", 2024-04-26T11:13:57.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6740999999999999e-05 2024-04-26T11:13:57.103 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.103 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.103 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.103 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35494 5.4 5:2687a65a:::benchmark_data_smithi029_44842_object35493:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:57.103 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.422734+0000", 2024-04-26T11:13:57.103 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.6366454259999994, 2024-04-26T11:13:57.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017335989, 2024-04-26T11:13:57.103 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.103 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.103 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:57.103 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:57.103 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.103 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35494 2024-04-26T11:13:57.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.104 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422734+0000", 2024-04-26T11:13:57.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422734+0000", 2024-04-26T11:13:57.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422734+0000", 2024-04-26T11:13:57.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422769+0000", 2024-04-26T11:13:57.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4759999999999999e-05 2024-04-26T11:13:57.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422773+0000", 2024-04-26T11:13:57.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6319999999999999e-06 2024-04-26T11:13:57.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422777+0000", 2024-04-26T11:13:57.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3550000000000001e-06 2024-04-26T11:13:57.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422802+0000", 2024-04-26T11:13:57.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5771000000000001e-05 2024-04-26T11:13:57.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:57.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422905+0000", 2024-04-26T11:13:57.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102509 2024-04-26T11:13:57.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:57.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422983+0000", 2024-04-26T11:13:57.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8209999999999998e-05 2024-04-26T11:13:57.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:57.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.427677+0000", 2024-04-26T11:13:57.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0046938659999999997 2024-04-26T11:13:57.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.439988+0000", 2024-04-26T11:13:57.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012311344 2024-04-26T11:13:57.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:57.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440036+0000", 2024-04-26T11:13:57.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7187000000000001e-05 2024-04-26T11:13:57.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:57.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440070+0000", 2024-04-26T11:13:57.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4752999999999997e-05 2024-04-26T11:13:57.108 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.108 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.108 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.109 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:36746 5.8 5:14dea2d5:::benchmark_data_smithi029_44842_object36745:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:57.109 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.896239+0000", 2024-04-26T11:13:57.109 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.1631408679999993, 2024-04-26T11:13:57.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016757729999999998, 2024-04-26T11:13:57.109 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.109 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.109 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:57.109 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:57.109 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.109 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 36746 2024-04-26T11:13:57.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.109 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.896239+0000", 2024-04-26T11:13:57.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.896239+0000", 2024-04-26T11:13:57.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.896238+0000", 2024-04-26T11:13:57.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.896270+0000", 2024-04-26T11:13:57.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1337999999999997e-05 2024-04-26T11:13:57.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.896276+0000", 2024-04-26T11:13:57.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0680000000000002e-06 2024-04-26T11:13:57.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.896287+0000", 2024-04-26T11:13:57.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1586999999999999e-05 2024-04-26T11:13:57.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.898129+0000", 2024-04-26T11:13:57.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018412630000000001 2024-04-26T11:13:57.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:57.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.898211+0000", 2024-04-26T11:13:57.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1978999999999996e-05 2024-04-26T11:13:57.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:57.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.898296+0000", 2024-04-26T11:13:57.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5680999999999995e-05 2024-04-26T11:13:57.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:57.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.899825+0000", 2024-04-26T11:13:57.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001528789 2024-04-26T11:13:57.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.912927+0000", 2024-04-26T11:13:57.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013101665 2024-04-26T11:13:57.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:57.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.912963+0000", 2024-04-26T11:13:57.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6745000000000001e-05 2024-04-26T11:13:57.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:57.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.912997+0000", 2024-04-26T11:13:57.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3118999999999999e-05 2024-04-26T11:13:57.114 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.114 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.114 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.114 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44504 5.0 5:0536d5a4:::benchmark_data_smithi029_44842_object44503:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:57.114 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:13:57.114 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.8900937769999997, 2024-04-26T11:13:57.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018576187000000001, 2024-04-26T11:13:57.115 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.115 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.115 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:57.115 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:57.115 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.115 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44504 2024-04-26T11:13:57.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.115 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:13:57.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:13:57.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:13:57.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169304+0000", 2024-04-26T11:13:57.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8331000000000001e-05 2024-04-26T11:13:57.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169308+0000", 2024-04-26T11:13:57.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9609999999999999e-06 2024-04-26T11:13:57.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169311+0000", 2024-04-26T11:13:57.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.044e-06 2024-04-26T11:13:57.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.174118+0000", 2024-04-26T11:13:57.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004806645 2024-04-26T11:13:57.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:57.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.174207+0000", 2024-04-26T11:13:57.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9665000000000003e-05 2024-04-26T11:13:57.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:57.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.174308+0000", 2024-04-26T11:13:57.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100399 2024-04-26T11:13:57.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:57.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.185001+0000", 2024-04-26T11:13:57.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010693599 2024-04-26T11:13:57.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187698+0000", 2024-04-26T11:13:57.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026970929999999998 2024-04-26T11:13:57.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:57.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187777+0000", 2024-04-26T11:13:57.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8335000000000001e-05 2024-04-26T11:13:57.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:57.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187862+0000", 2024-04-26T11:13:57.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5521999999999999e-05 2024-04-26T11:13:57.120 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.120 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.120 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.120 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44506 5.0 5:07ec7127:::benchmark_data_smithi029_44842_object44505:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:57.120 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:13:57.120 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.889793858, 2024-04-26T11:13:57.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018482386999999999, 2024-04-26T11:13:57.120 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.120 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.120 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:57.120 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:57.120 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.121 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44506 2024-04-26T11:13:57.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.121 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:13:57.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:13:57.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:13:57.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169730+0000", 2024-04-26T11:13:57.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014447200000000001 2024-04-26T11:13:57.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169738+0000", 2024-04-26T11:13:57.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5700000000000004e-06 2024-04-26T11:13:57.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169741+0000", 2024-04-26T11:13:57.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3909999999999998e-06 2024-04-26T11:13:57.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.176682+0000", 2024-04-26T11:13:57.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0069412129999999999 2024-04-26T11:13:57.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:57.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.176816+0000", 2024-04-26T11:13:57.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000134265 2024-04-26T11:13:57.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:57.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.176952+0000", 2024-04-26T11:13:57.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013520000000000001 2024-04-26T11:13:57.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:57.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.185004+0000", 2024-04-26T11:13:57.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0080524959999999993 2024-04-26T11:13:57.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187983+0000", 2024-04-26T11:13:57.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0029783330000000001 2024-04-26T11:13:57.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:57.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188031+0000", 2024-04-26T11:13:57.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8588000000000003e-05 2024-04-26T11:13:57.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:57.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188068+0000", 2024-04-26T11:13:57.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7154999999999999e-05 2024-04-26T11:13:57.125 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.125 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.125 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.126 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44509 5.0 5:0828d2b6:::benchmark_data_smithi029_44842_object44508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:57.126 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.169815+0000", 2024-04-26T11:13:57.126 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.8895650130000003, 2024-04-26T11:13:57.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018410841000000001, 2024-04-26T11:13:57.126 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.126 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.126 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:57.126 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:57.126 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.126 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44509 2024-04-26T11:13:57.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.126 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169815+0000", 2024-04-26T11:13:57.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169815+0000", 2024-04-26T11:13:57.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169814+0000", 2024-04-26T11:13:57.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169921+0000", 2024-04-26T11:13:57.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107194 2024-04-26T11:13:57.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169927+0000", 2024-04-26T11:13:57.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.203e-06 2024-04-26T11:13:57.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169931+0000", 2024-04-26T11:13:57.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0829999999999997e-06 2024-04-26T11:13:57.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.179590+0000", 2024-04-26T11:13:57.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096589999999999992 2024-04-26T11:13:57.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:57.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.179718+0000", 2024-04-26T11:13:57.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012885699999999999 2024-04-26T11:13:57.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:57.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.179857+0000", 2024-04-26T11:13:57.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013884100000000001 2024-04-26T11:13:57.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:57.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188082+0000", 2024-04-26T11:13:57.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082250099999999996 2024-04-26T11:13:57.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188164+0000", 2024-04-26T11:13:57.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2123e-05 2024-04-26T11:13:57.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:57.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188197+0000", 2024-04-26T11:13:57.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2471000000000001e-05 2024-04-26T11:13:57.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:57.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188226+0000", 2024-04-26T11:13:57.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8609999999999999e-05 2024-04-26T11:13:57.131 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.131 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.131 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.131 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44513 5.0 5:0a236ebb:::benchmark_data_smithi029_44842_object44512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:57.131 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:13:57.131 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.8892924190000002, 2024-04-26T11:13:57.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020724414, 2024-04-26T11:13:57.132 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.132 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.132 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:57.132 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:57.132 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.132 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44513 2024-04-26T11:13:57.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.132 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:13:57.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:13:57.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:13:57.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170120+0000", 2024-04-26T11:13:57.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2941000000000002e-05 2024-04-26T11:13:57.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170127+0000", 2024-04-26T11:13:57.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.469e-06 2024-04-26T11:13:57.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170133+0000", 2024-04-26T11:13:57.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1340000000000001e-06 2024-04-26T11:13:57.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182383+0000", 2024-04-26T11:13:57.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012249970000000001 2024-04-26T11:13:57.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:57.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182477+0000", 2024-04-26T11:13:57.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3776999999999993e-05 2024-04-26T11:13:57.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:57.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182572+0000", 2024-04-26T11:13:57.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4841999999999998e-05 2024-04-26T11:13:57.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:57.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188262+0000", 2024-04-26T11:13:57.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005690077 2024-04-26T11:13:57.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190748+0000", 2024-04-26T11:13:57.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024857780000000001 2024-04-26T11:13:57.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:57.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190776+0000", 2024-04-26T11:13:57.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8419999999999999e-05 2024-04-26T11:13:57.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:57.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190812+0000", 2024-04-26T11:13:57.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5630999999999998e-05 2024-04-26T11:13:57.137 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.137 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.137 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.137 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44792 5.8 5:17ddc189:::benchmark_data_smithi029_44842_object44791:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:57.137 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.282364+0000", 2024-04-26T11:13:57.137 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.777015875, 2024-04-26T11:13:57.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016770038000000001, 2024-04-26T11:13:57.137 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.137 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.137 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:57.137 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:57.138 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.138 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44792 2024-04-26T11:13:57.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.138 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.282364+0000", 2024-04-26T11:13:57.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.282364+0000", 2024-04-26T11:13:57.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.282363+0000", 2024-04-26T11:13:57.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:57.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.282462+0000", 2024-04-26T11:13:57.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8799000000000001e-05 2024-04-26T11:13:57.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.282471+0000", 2024-04-26T11:13:57.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0189999999999995e-06 2024-04-26T11:13:57.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.282478+0000", 2024-04-26T11:13:57.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7449999999999998e-06 2024-04-26T11:13:57.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.285628+0000", 2024-04-26T11:13:57.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0031500429999999999 2024-04-26T11:13:57.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:57.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.285705+0000", 2024-04-26T11:13:57.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7291000000000002e-05 2024-04-26T11:13:57.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:57.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.285792+0000", 2024-04-26T11:13:57.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7164999999999996e-05 2024-04-26T11:13:57.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:57.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.288027+0000", 2024-04-26T11:13:57.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022347299999999999 2024-04-26T11:13:57.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.299036+0000", 2024-04-26T11:13:57.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011008808 2024-04-26T11:13:57.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:57.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.299085+0000", 2024-04-26T11:13:57.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.905e-05 2024-04-26T11:13:57.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:57.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.299134+0000", 2024-04-26T11:13:57.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9184000000000002e-05 2024-04-26T11:13:57.142 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.143 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.143 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.143 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44794 5.8 5:158fd219:::benchmark_data_smithi029_44842_object44793:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:57.143 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.283382+0000", 2024-04-26T11:13:57.143 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.7759978419999998, 2024-04-26T11:13:57.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018701497000000001, 2024-04-26T11:13:57.143 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.143 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.143 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:57.143 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:57.143 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.143 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44794 2024-04-26T11:13:57.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.144 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283382+0000", 2024-04-26T11:13:57.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283382+0000", 2024-04-26T11:13:57.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283381+0000", 2024-04-26T11:13:57.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283409+0000", 2024-04-26T11:13:57.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.798e-05 2024-04-26T11:13:57.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283417+0000", 2024-04-26T11:13:57.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2629999999999997e-06 2024-04-26T11:13:57.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283424+0000", 2024-04-26T11:13:57.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1210000000000001e-06 2024-04-26T11:13:57.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.286843+0000", 2024-04-26T11:13:57.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034194490000000002 2024-04-26T11:13:57.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:57.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.286932+0000", 2024-04-26T11:13:57.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9065000000000002e-05 2024-04-26T11:13:57.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:57.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.287019+0000", 2024-04-26T11:13:57.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6976000000000002e-05 2024-04-26T11:13:57.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:57.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.288238+0000", 2024-04-26T11:13:57.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012185 2024-04-26T11:13:57.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.302032+0000", 2024-04-26T11:13:57.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013794618999999999 2024-04-26T11:13:57.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:57.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.302061+0000", 2024-04-26T11:13:57.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9008000000000001e-05 2024-04-26T11:13:57.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:57.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.302083+0000", 2024-04-26T11:13:57.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2002e-05 2024-04-26T11:13:57.148 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.148 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.148 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.149 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:45051 5.0 5:0f54b16a:::benchmark_data_smithi029_44842_object45050:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:57.149 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.395755+0000", 2024-04-26T11:13:57.149 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.663624606, 2024-04-26T11:13:57.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017330567000000002, 2024-04-26T11:13:57.149 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.149 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.149 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:57.149 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:57.149 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.149 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 45051 2024-04-26T11:13:57.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.149 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.395755+0000", 2024-04-26T11:13:57.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.395755+0000", 2024-04-26T11:13:57.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.395754+0000", 2024-04-26T11:13:57.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.395786+0000", 2024-04-26T11:13:57.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1177999999999999e-05 2024-04-26T11:13:57.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.395794+0000", 2024-04-26T11:13:57.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4260000000000003e-06 2024-04-26T11:13:57.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.395799+0000", 2024-04-26T11:13:57.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3419999999999998e-06 2024-04-26T11:13:57.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.401856+0000", 2024-04-26T11:13:57.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060561549999999997 2024-04-26T11:13:57.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:57.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.401964+0000", 2024-04-26T11:13:57.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108062 2024-04-26T11:13:57.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:57.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.402103+0000", 2024-04-26T11:13:57.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139808 2024-04-26T11:13:57.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:57.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.407608+0000", 2024-04-26T11:13:57.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055047789999999996 2024-04-26T11:13:57.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.413014+0000", 2024-04-26T11:13:57.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054058980000000001 2024-04-26T11:13:57.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:57.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.413054+0000", 2024-04-26T11:13:57.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9576000000000002e-05 2024-04-26T11:13:57.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:57.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.413086+0000", 2024-04-26T11:13:57.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2042999999999998e-05 2024-04-26T11:13:57.154 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.154 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.154 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.154 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:57.154 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:13:57.155 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.780589397, 2024-04-26T11:13:57.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:13:57.155 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.155 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.155 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:57.155 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:57.155 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.155 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:13:57.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.155 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:13:57.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:13:57.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:13:57.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:13:57.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:13:57.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:13:57.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:13:57.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:13:57.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:13:57.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:13:57.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:13:57.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:57.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:13:57.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:13:57.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:57.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:13:57.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:13:57.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:57.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:13:57.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:13:57.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:13:57.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:13:57.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:57.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:13:57.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:13:57.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:57.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:13:57.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:13:57.160 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.160 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.160 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.160 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:57.160 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:13:57.160 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.7799396949999999, 2024-04-26T11:13:57.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:13:57.160 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.161 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.161 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:57.161 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:57.161 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.161 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:13:57.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.161 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:13:57.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:13:57.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:13:57.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:57.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:13:57.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:13:57.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:13:57.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:13:57.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:13:57.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:13:57.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:13:57.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:13:57.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:57.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:13:57.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:13:57.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:57.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:13:57.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:13:57.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:57.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:13:57.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:13:57.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:13:57.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:13:57.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:57.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:13:57.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:13:57.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:57.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:13:57.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:13:57.166 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.166 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.166 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.166 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:55093 5.e 5:7ebffa9e:::benchmark_data_smithi029_44842_object55092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:13:57.166 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:13:57.166 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.31280797700000001, 2024-04-26T11:13:57.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020381660999999999, 2024-04-26T11:13:57.166 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.166 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.166 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:57.166 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:57.166 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.167 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 55093 2024-04-26T11:13:57.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.167 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:13:57.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:13:57.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746571+0000", 2024-04-26T11:13:57.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746599+0000", 2024-04-26T11:13:57.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8262000000000001e-05 2024-04-26T11:13:57.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746610+0000", 2024-04-26T11:13:57.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1070000000000001e-05 2024-04-26T11:13:57.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746617+0000", 2024-04-26T11:13:57.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8190000000000003e-06 2024-04-26T11:13:57.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748218+0000", 2024-04-26T11:13:57.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0016005889999999999 2024-04-26T11:13:57.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:57.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748350+0000", 2024-04-26T11:13:57.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132528 2024-04-26T11:13:57.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:57.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748499+0000", 2024-04-26T11:13:57.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014815600000000001 2024-04-26T11:13:57.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:57.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.750795+0000", 2024-04-26T11:13:57.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022960369999999999 2024-04-26T11:13:57.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766866+0000", 2024-04-26T11:13:57.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016071230999999998 2024-04-26T11:13:57.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:57.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766922+0000", 2024-04-26T11:13:57.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6643e-05 2024-04-26T11:13:57.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:57.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766953+0000", 2024-04-26T11:13:57.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0981e-05 2024-04-26T11:13:57.171 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.171 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.171 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.171 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:55738 5.4 5:2d90ff60:::benchmark_data_smithi029_44842_object55737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:13:57.172 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.026425+0000", 2024-04-26T11:13:57.172 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.032954513999999997, 2024-04-26T11:13:57.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018738008, 2024-04-26T11:13:57.172 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.172 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.172 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:57.172 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:57.172 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.172 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 55738 2024-04-26T11:13:57.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.172 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026425+0000", 2024-04-26T11:13:57.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026425+0000", 2024-04-26T11:13:57.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026425+0000", 2024-04-26T11:13:57.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026456+0000", 2024-04-26T11:13:57.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1312000000000001e-05 2024-04-26T11:13:57.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026463+0000", 2024-04-26T11:13:57.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2710000000000003e-06 2024-04-26T11:13:57.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026469+0000", 2024-04-26T11:13:57.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7389999999999996e-06 2024-04-26T11:13:57.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026561+0000", 2024-04-26T11:13:57.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2552000000000004e-05 2024-04-26T11:13:57.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:57.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026695+0000", 2024-04-26T11:13:57.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013394500000000001 2024-04-26T11:13:57.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:57.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026827+0000", 2024-04-26T11:13:57.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013146800000000001 2024-04-26T11:13:57.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:57.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.028905+0000", 2024-04-26T11:13:57.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020783749999999999 2024-04-26T11:13:57.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.045076+0000", 2024-04-26T11:13:57.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016170411999999999 2024-04-26T11:13:57.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:57.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.045130+0000", 2024-04-26T11:13:57.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4169000000000003e-05 2024-04-26T11:13:57.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:57.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.045163+0000", 2024-04-26T11:13:57.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3368999999999998e-05 2024-04-26T11:13:57.177 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.177 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.177 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.177 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.177 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.177 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:13:57.178 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:57.176+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:57.179 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:13:57.279 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:57.277+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:57.343 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:13:57.356 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:13:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:13:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:13:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:13:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.030060461, 2024-04-26T11:13:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.030095520000000001, 2024-04-26T11:13:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for peered", 2024-04-26T11:13:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:13:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:13:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:13:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:13:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:13:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:13:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:13:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:13:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:13:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:13:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:13:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:13:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:13:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:13:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:13:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:13:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:13:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:13:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:13:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:13:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:13:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:13:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:13:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:13:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:13:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.024848637, 2024-04-26T11:13:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.024942219000000002, 2024-04-26T11:13:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for peered", 2024-04-26T11:13:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:13:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:13:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:13:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:13:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:13:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:13:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:13:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:13:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:13:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:13:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:13:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:13:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:13:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:13:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:13:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:13:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:13:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:13:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:13:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:13:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:13:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:13:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:13:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5.5f5f3d32 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:13:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:13:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0083999369999999997, 2024-04-26T11:13:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0085416789999999999, 2024-04-26T11:13:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for peered", 2024-04-26T11:13:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:13:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:13:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:13:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:13:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:13:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:13:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:13:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:13:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:13:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:13:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:13:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:13:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:13:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:13:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:13:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5.ad27f551 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:13:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:13:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0067024320000000004, 2024-04-26T11:13:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0068805380000000003, 2024-04-26T11:13:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for peered", 2024-04-26T11:13:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:13:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:13:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:13:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:13:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:13:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:13:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:13:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:13:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:13:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:13:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:13:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:13:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:13:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:13:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:13:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5.fbdf7d17 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:13:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:13:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0066381299999999999, 2024-04-26T11:13:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.006850783, 2024-04-26T11:13:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for peered", 2024-04-26T11:13:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:13:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:13:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:13:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:13:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:13:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:13:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:13:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:13:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:13:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:13:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:13:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:13:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:13:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:13:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:13:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5.db292341 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:13:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:13:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0065839059999999996, 2024-04-26T11:13:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0068310300000000001, 2024-04-26T11:13:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for peered", 2024-04-26T11:13:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:13:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:13:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:13:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:13:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:13:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:13:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:13:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:13:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:13:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:13:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:13:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:13:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:13:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:13:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:13:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5.484ccf1 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:13:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:13:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0065393939999999996, 2024-04-26T11:13:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0068205319999999998, 2024-04-26T11:13:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for peered", 2024-04-26T11:13:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:13:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:13:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:13:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:13:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:13:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:13:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:13:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:13:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:13:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:13:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:13:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:13:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:13:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:13:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:13:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5.8ec6487 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:13:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:13:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0023183919999999998, 2024-04-26T11:13:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026354310000000001, 2024-04-26T11:13:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for peered", 2024-04-26T11:13:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:13:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:13:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:13:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:13:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:13:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:13:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:13:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:13:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:13:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:13:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:13:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:13:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:13:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:13:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:13:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:13:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:13:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:13:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.032253800999999999, 2024-04-26T11:13:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.032608698999999998, 2024-04-26T11:13:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for peered", 2024-04-26T11:13:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:13:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:13:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:13:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:13:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:13:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:13:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:13:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:13:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:13:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:13:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:13:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:13:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:13:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:13:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:13:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:13:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:13:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:13:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:13:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:13:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:13:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:13:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:13:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:13:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 9 2024-04-26T11:13:57.395 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:13:57.396 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:13:57.397 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:57.394+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:57.411 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 19 16 56430 56414 185.556 134.188 0.0113847 0.00536429 2024-04-26T11:13:57.497 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:57.495+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:57.563 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:13:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:13:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:13:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:13:57.563 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:13:57.573 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:13:57.598 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:57.597+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:57.645 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:13:57.700 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:57.697+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:57.701 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:13:57.701 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:13:57.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:13:57.702 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:13:57.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.702 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:32823 5.6 5:6cacaef4:::benchmark_data_smithi029_44842_object32822:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:57.702 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.459516+0000", 2024-04-26T11:13:57.702 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 10.238993637, 2024-04-26T11:13:57.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.01540511, 2024-04-26T11:13:57.702 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.702 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.702 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:57.703 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:57.703 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.703 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 32823 2024-04-26T11:13:57.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.703 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.459516+0000", 2024-04-26T11:13:57.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.459516+0000", 2024-04-26T11:13:57.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.459515+0000", 2024-04-26T11:13:57.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:57.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.459578+0000", 2024-04-26T11:13:57.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3318999999999995e-05 2024-04-26T11:13:57.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.459586+0000", 2024-04-26T11:13:57.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9179999999999994e-06 2024-04-26T11:13:57.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.459591+0000", 2024-04-26T11:13:57.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3720000000000004e-06 2024-04-26T11:13:57.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.460740+0000", 2024-04-26T11:13:57.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00114861 2024-04-26T11:13:57.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:57.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.460833+0000", 2024-04-26T11:13:57.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3125e-05 2024-04-26T11:13:57.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:57.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.460973+0000", 2024-04-26T11:13:57.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013959000000000001 2024-04-26T11:13:57.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:57.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.463853+0000", 2024-04-26T11:13:57.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002880549 2024-04-26T11:13:57.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.474871+0000", 2024-04-26T11:13:57.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011017469 2024-04-26T11:13:57.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.474899+0000", 2024-04-26T11:13:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8580000000000001e-05 2024-04-26T11:13:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.474921+0000", 2024-04-26T11:13:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1316000000000001e-05 2024-04-26T11:13:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.709 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:33826 5.3 5:c4100d2e:::benchmark_data_smithi029_44842_object33825:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:57.709 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.804001+0000", 2024-04-26T11:13:57.709 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 9.8945077510000008, 2024-04-26T11:13:57.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015655404000000001, 2024-04-26T11:13:57.709 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.709 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.709 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:57.709 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:57.709 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.709 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 33826 2024-04-26T11:13:57.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.710 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804001+0000", 2024-04-26T11:13:57.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804001+0000", 2024-04-26T11:13:57.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.711 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.711 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804001+0000", 2024-04-26T11:13:57.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:57.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.711 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.711 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804056+0000", 2024-04-26T11:13:57.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5285999999999999e-05 2024-04-26T11:13:57.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804065+0000", 2024-04-26T11:13:57.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.8589999999999994e-06 2024-04-26T11:13:57.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804083+0000", 2024-04-26T11:13:57.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7949999999999999e-05 2024-04-26T11:13:57.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.806510+0000", 2024-04-26T11:13:57.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0024274930000000002 2024-04-26T11:13:57.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:57.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.806622+0000", 2024-04-26T11:13:57.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000111675 2024-04-26T11:13:57.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:57.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.806769+0000", 2024-04-26T11:13:57.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000147312 2024-04-26T11:13:57.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812012+0000", 2024-04-26T11:13:57.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0052431580000000004 2024-04-26T11:13:57.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:57.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.819580+0000", 2024-04-26T11:13:57.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0075680410000000002 2024-04-26T11:13:57.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:57.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.819618+0000", 2024-04-26T11:13:57.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7622e-05 2024-04-26T11:13:57.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:57.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.819657+0000", 2024-04-26T11:13:57.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8868999999999997e-05 2024-04-26T11:13:57.716 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.716 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.716 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.716 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:33827 5.3 5:c927f878:::benchmark_data_smithi029_44842_object33826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:57.716 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.804106+0000", 2024-04-26T11:13:57.716 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 9.8944033689999991, 2024-04-26T11:13:57.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.017369738999999999, 2024-04-26T11:13:57.716 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.716 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.716 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:57.717 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:57.717 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.717 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 33827 2024-04-26T11:13:57.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.717 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804106+0000", 2024-04-26T11:13:57.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804106+0000", 2024-04-26T11:13:57.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804105+0000", 2024-04-26T11:13:57.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804138+0000", 2024-04-26T11:13:57.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3172e-05 2024-04-26T11:13:57.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804146+0000", 2024-04-26T11:13:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.204e-06 2024-04-26T11:13:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804153+0000", 2024-04-26T11:13:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0940000000000002e-06 2024-04-26T11:13:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812034+0000", 2024-04-26T11:13:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0078809210000000008 2024-04-26T11:13:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:57.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812181+0000", 2024-04-26T11:13:57.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014739199999999999 2024-04-26T11:13:57.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:57.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812284+0000", 2024-04-26T11:13:57.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000103453 2024-04-26T11:13:57.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.814699+0000", 2024-04-26T11:13:57.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002415043 2024-04-26T11:13:57.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.821418+0000", 2024-04-26T11:13:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0067184879999999999 2024-04-26T11:13:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.821449+0000", 2024-04-26T11:13:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0763999999999999e-05 2024-04-26T11:13:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.821476+0000", 2024-04-26T11:13:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6889999999999998e-05 2024-04-26T11:13:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:33828 5.b e22/16 5:d3313e8b:::benchmark_data_smithi029_44842_object33827:head v 22'2195, mlcod=22'2192)", 2024-04-26T11:13:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.805391+0000", 2024-04-26T11:13:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 9.8931177849999994, 2024-04-26T11:13:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016105534000000001, 2024-04-26T11:13:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.805391+0000", 2024-04-26T11:13:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.805391+0000", 2024-04-26T11:13:57.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.805391+0000", 2024-04-26T11:13:57.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.805484+0000", 2024-04-26T11:13:57.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2740999999999999e-05 2024-04-26T11:13:57.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.805492+0000", 2024-04-26T11:13:57.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.8799999999999997e-06 2024-04-26T11:13:57.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.805498+0000", 2024-04-26T11:13:57.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3510000000000001e-06 2024-04-26T11:13:57.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.811898+0000", 2024-04-26T11:13:57.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0063998040000000003 2024-04-26T11:13:57.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:57.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.811919+0000", 2024-04-26T11:13:57.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1246e-05 2024-04-26T11:13:57.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:57.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.821478+0000", 2024-04-26T11:13:57.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0095594779999999997 2024-04-26T11:13:57.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:57.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.821497+0000", 2024-04-26T11:13:57.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8593999999999998e-05 2024-04-26T11:13:57.726 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.726 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.726 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.726 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:35482 5.b e23/16 5:d2b3ef95:::benchmark_data_smithi029_44842_object35481:head v 23'2303, mlcod=23'2300)", 2024-04-26T11:13:57.726 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:48.420993+0000", 2024-04-26T11:13:57.726 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 9.2775166660000004, 2024-04-26T11:13:57.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016814145999999999, 2024-04-26T11:13:57.726 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.726 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.726 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.420993+0000", 2024-04-26T11:13:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.420993+0000", 2024-04-26T11:13:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.420992+0000", 2024-04-26T11:13:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.421020+0000", 2024-04-26T11:13:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8422999999999999e-05 2024-04-26T11:13:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.421027+0000", 2024-04-26T11:13:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3060000000000003e-06 2024-04-26T11:13:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.421031+0000", 2024-04-26T11:13:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4100000000000001e-06 2024-04-26T11:13:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.421848+0000", 2024-04-26T11:13:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00081644900000000002 2024-04-26T11:13:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.421866+0000", 2024-04-26T11:13:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8702000000000002e-05 2024-04-26T11:13:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.437769+0000", 2024-04-26T11:13:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015902195000000001 2024-04-26T11:13:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.437807+0000", 2024-04-26T11:13:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8170000000000002e-05 2024-04-26T11:13:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:35483 5.b e23/16 5:d3dd14f6:::benchmark_data_smithi029_44842_object35482:head v 23'2304, mlcod=23'2300)", 2024-04-26T11:13:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:48.422102+0000", 2024-04-26T11:13:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 9.2764074359999995, 2024-04-26T11:13:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.017674038, 2024-04-26T11:13:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422102+0000", 2024-04-26T11:13:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422102+0000", 2024-04-26T11:13:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422101+0000", 2024-04-26T11:13:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422129+0000", 2024-04-26T11:13:57.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8277999999999999e-05 2024-04-26T11:13:57.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422139+0000", 2024-04-26T11:13:57.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1290000000000002e-06 2024-04-26T11:13:57.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422145+0000", 2024-04-26T11:13:57.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7490000000000001e-06 2024-04-26T11:13:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423217+0000", 2024-04-26T11:13:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0010718539999999999 2024-04-26T11:13:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423234+0000", 2024-04-26T11:13:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6602000000000001e-05 2024-04-26T11:13:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439742+0000", 2024-04-26T11:13:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016508061000000001 2024-04-26T11:13:57.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:57.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439776+0000", 2024-04-26T11:13:57.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3992000000000003e-05 2024-04-26T11:13:57.734 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.734 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.734 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.734 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:35493 5.8 e23/16 5:14785d1e:::benchmark_data_smithi029_44842_object35492:head v 23'2253, mlcod=23'2250)", 2024-04-26T11:13:57.734 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:48.422959+0000", 2024-04-26T11:13:57.734 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 9.2755498589999998, 2024-04-26T11:13:57.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016788944, 2024-04-26T11:13:57.735 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.735 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.735 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422959+0000", 2024-04-26T11:13:57.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422959+0000", 2024-04-26T11:13:57.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422959+0000", 2024-04-26T11:13:57.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423085+0000", 2024-04-26T11:13:57.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012600299999999999 2024-04-26T11:13:57.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423093+0000", 2024-04-26T11:13:57.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2339999999999994e-06 2024-04-26T11:13:57.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423099+0000", 2024-04-26T11:13:57.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3659999999999997e-06 2024-04-26T11:13:57.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423130+0000", 2024-04-26T11:13:57.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0518999999999997e-05 2024-04-26T11:13:57.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:57.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423147+0000", 2024-04-26T11:13:57.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6997e-05 2024-04-26T11:13:57.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:57.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439721+0000", 2024-04-26T11:13:57.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016574185000000002 2024-04-26T11:13:57.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:57.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439748+0000", 2024-04-26T11:13:57.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7131000000000002e-05 2024-04-26T11:13:57.738 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.738 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.738 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.738 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:35494 5.4 e23/16 5:2687a65a:::benchmark_data_smithi029_44842_object35493:head v 23'2185, mlcod=23'2181)", 2024-04-26T11:13:57.738 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:48.423109+0000", 2024-04-26T11:13:57.738 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 9.2754000639999994, 2024-04-26T11:13:57.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016693116000000001, 2024-04-26T11:13:57.739 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.739 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.739 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423109+0000", 2024-04-26T11:13:57.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423109+0000", 2024-04-26T11:13:57.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423109+0000", 2024-04-26T11:13:57.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423143+0000", 2024-04-26T11:13:57.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3980999999999999e-05 2024-04-26T11:13:57.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423150+0000", 2024-04-26T11:13:57.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3080000000000002e-06 2024-04-26T11:13:57.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423155+0000", 2024-04-26T11:13:57.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1529999999999996e-06 2024-04-26T11:13:57.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423182+0000", 2024-04-26T11:13:57.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7158e-05 2024-04-26T11:13:57.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:57.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423199+0000", 2024-04-26T11:13:57.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6478999999999999e-05 2024-04-26T11:13:57.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:57.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439769+0000", 2024-04-26T11:13:57.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016570519999999998 2024-04-26T11:13:57.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:57.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439802+0000", 2024-04-26T11:13:57.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2963999999999998e-05 2024-04-26T11:13:57.742 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.742 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.742 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.742 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:35496 5.2 e23/16 5:422c3e1d:::benchmark_data_smithi029_44842_object35495:head v 23'2188, mlcod=23'2186)", 2024-04-26T11:13:57.742 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:48.423315+0000", 2024-04-26T11:13:57.743 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 9.2751945060000001, 2024-04-26T11:13:57.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016628417, 2024-04-26T11:13:57.743 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.743 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.743 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423315+0000", 2024-04-26T11:13:57.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423315+0000", 2024-04-26T11:13:57.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423314+0000", 2024-04-26T11:13:57.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423376+0000", 2024-04-26T11:13:57.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1909999999999995e-05 2024-04-26T11:13:57.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423389+0000", 2024-04-26T11:13:57.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3144e-05 2024-04-26T11:13:57.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423396+0000", 2024-04-26T11:13:57.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0550000000000002e-06 2024-04-26T11:13:57.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423429+0000", 2024-04-26T11:13:57.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2815999999999999e-05 2024-04-26T11:13:57.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:57.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423447+0000", 2024-04-26T11:13:57.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7555e-05 2024-04-26T11:13:57.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:57.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439911+0000", 2024-04-26T11:13:57.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016464248000000001 2024-04-26T11:13:57.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:57.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439943+0000", 2024-04-26T11:13:57.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2311000000000003e-05 2024-04-26T11:13:57.746 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.746 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.746 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.747 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:35536 5.5 5:acc6d5ae:::benchmark_data_smithi029_44842_object35535:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:57.747 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:48.445093+0000", 2024-04-26T11:13:57.747 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 9.2534161620000006, 2024-04-26T11:13:57.747 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015420552000000001, 2024-04-26T11:13:57.747 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.747 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.747 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:57.747 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:57.747 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.747 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 35536 2024-04-26T11:13:57.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.747 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.747 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.747 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.445093+0000", 2024-04-26T11:13:57.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.445093+0000", 2024-04-26T11:13:57.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.445092+0000", 2024-04-26T11:13:57.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:57.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.445251+0000", 2024-04-26T11:13:57.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015830999999999999 2024-04-26T11:13:57.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.445260+0000", 2024-04-26T11:13:57.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4720000000000001e-06 2024-04-26T11:13:57.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.445266+0000", 2024-04-26T11:13:57.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2430000000000002e-06 2024-04-26T11:13:57.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.446759+0000", 2024-04-26T11:13:57.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0014926570000000001 2024-04-26T11:13:57.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:57.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.446860+0000", 2024-04-26T11:13:57.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100628 2024-04-26T11:13:57.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:57.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.446940+0000", 2024-04-26T11:13:57.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0201e-05 2024-04-26T11:13:57.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:57.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.447900+0000", 2024-04-26T11:13:57.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00095980999999999996 2024-04-26T11:13:57.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.460464+0000", 2024-04-26T11:13:57.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.012564594 2024-04-26T11:13:57.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:57.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.460494+0000", 2024-04-26T11:13:57.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.959e-05 2024-04-26T11:13:57.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:57.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.460514+0000", 2024-04-26T11:13:57.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9851e-05 2024-04-26T11:13:57.752 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.752 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.752 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.752 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:38062 5.c 5:3a6c0710:::benchmark_data_smithi029_44842_object38061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:57.752 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:49.385419+0000", 2024-04-26T11:13:57.752 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.3130906830000004, 2024-04-26T11:13:57.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016211069000000002, 2024-04-26T11:13:57.752 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.752 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.752 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:57.752 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:57.752 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.753 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 38062 2024-04-26T11:13:57.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.753 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.385419+0000", 2024-04-26T11:13:57.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.385419+0000", 2024-04-26T11:13:57.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.385417+0000", 2024-04-26T11:13:57.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999986 2024-04-26T11:13:57.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.385494+0000", 2024-04-26T11:13:57.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6596999999999999e-05 2024-04-26T11:13:57.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.385504+0000", 2024-04-26T11:13:57.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0543999999999999e-05 2024-04-26T11:13:57.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.385512+0000", 2024-04-26T11:13:57.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9850000000000006e-06 2024-04-26T11:13:57.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.390338+0000", 2024-04-26T11:13:57.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0048251939999999997 2024-04-26T11:13:57.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:57.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.390488+0000", 2024-04-26T11:13:57.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015001200000000001 2024-04-26T11:13:57.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:57.756 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.390618+0000", 2024-04-26T11:13:57.756 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013007599999999999 2024-04-26T11:13:57.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.756 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.756 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.393270+0000", 2024-04-26T11:13:57.756 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026525810000000002 2024-04-26T11:13:57.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.756 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:57.756 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.401550+0000", 2024-04-26T11:13:57.756 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0082794749999999997 2024-04-26T11:13:57.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.756 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:57.757 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.401594+0000", 2024-04-26T11:13:57.757 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209000000000003e-05 2024-04-26T11:13:57.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.757 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:57.757 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:49.401630+0000", 2024-04-26T11:13:57.757 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5614999999999997e-05 2024-04-26T11:13:57.757 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.757 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.757 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.757 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:46902 5.6 5:6f103941:::benchmark_data_smithi029_44842_object46901:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:57.757 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.120845+0000", 2024-04-26T11:13:57.757 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.577664425, 2024-04-26T11:13:57.758 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018538669000000001, 2024-04-26T11:13:57.758 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.758 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.758 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:57.758 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:57.758 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.758 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 46902 2024-04-26T11:13:57.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.758 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.758 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.758 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120845+0000", 2024-04-26T11:13:57.758 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.759 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120845+0000", 2024-04-26T11:13:57.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.759 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120844+0000", 2024-04-26T11:13:57.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.759 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120870+0000", 2024-04-26T11:13:57.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5678e-05 2024-04-26T11:13:57.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.760 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120874+0000", 2024-04-26T11:13:57.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.3189999999999996e-06 2024-04-26T11:13:57.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.760 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120878+0000", 2024-04-26T11:13:57.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4240000000000002e-06 2024-04-26T11:13:57.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.760 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.126176+0000", 2024-04-26T11:13:57.761 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0052983630000000004 2024-04-26T11:13:57.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.761 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:57.761 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.126300+0000", 2024-04-26T11:13:57.761 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012375099999999999 2024-04-26T11:13:57.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.761 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:57.761 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.126426+0000", 2024-04-26T11:13:57.761 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012646399999999999 2024-04-26T11:13:57.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.761 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.762 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.132371+0000", 2024-04-26T11:13:57.762 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0059443839999999996 2024-04-26T11:13:57.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.762 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:57.762 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.139296+0000", 2024-04-26T11:13:57.762 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069250320000000002 2024-04-26T11:13:57.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.762 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:57.762 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.139347+0000", 2024-04-26T11:13:57.762 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0954e-05 2024-04-26T11:13:57.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.763 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:57.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.139383+0000", 2024-04-26T11:13:57.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6862e-05 2024-04-26T11:13:57.763 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.763 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.763 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.763 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:57.763 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:13:57.763 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.4277623930000001, 2024-04-26T11:13:57.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:13:57.763 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.763 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.763 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:57.764 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:57.764 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.764 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:13:57.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.764 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.764 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.764 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:13:57.764 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.764 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.764 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:13:57.764 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:13:57.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:13:57.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:13:57.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.766 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.766 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:13:57.766 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:13:57.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.766 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.766 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.766 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:13:57.766 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:13:57.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.767 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.767 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:13:57.767 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:13:57.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.767 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:57.767 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:13:57.767 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:13:57.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.767 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:57.767 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:13:57.767 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:13:57.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.768 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:57.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:13:57.768 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:13:57.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.768 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:13:57.768 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:13:57.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.768 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:57.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:13:57.769 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:13:57.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.769 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:57.769 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:13:57.769 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:13:57.769 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.769 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.769 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.769 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:57.769 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:13:57.769 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.4269508279999998, 2024-04-26T11:13:57.769 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:13:57.770 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.770 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.770 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:57.770 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:57.770 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.770 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:13:57.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.770 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.770 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.770 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.770 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:13:57.770 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.771 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.771 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.771 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:13:57.771 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.771 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.771 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.771 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:13:57.771 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:57.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.771 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.771 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.771 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:13:57.771 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:13:57.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.772 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.772 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.772 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:13:57.772 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:13:57.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.772 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.772 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.772 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:13:57.772 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:13:57.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.772 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.772 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.772 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:13:57.772 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:13:57.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.773 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.773 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:57.773 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:13:57.773 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:13:57.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.773 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.773 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:57.773 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:13:57.773 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:13:57.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.773 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.773 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:57.773 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:13:57.773 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:13:57.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.774 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.774 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.774 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:13:57.774 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:13:57.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.774 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.774 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:57.774 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:13:57.774 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:13:57.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.774 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.774 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:57.774 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:13:57.775 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:13:57.775 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.775 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.775 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.775 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.775 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:57.775 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:13:57.775 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.4197639909999999, 2024-04-26T11:13:57.775 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:13:57.775 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.775 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.775 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:57.775 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:57.775 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.776 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:13:57.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.776 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.776 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.776 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:13:57.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.776 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.776 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:13:57.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.777 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.777 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:13:57.777 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:57.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.777 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.777 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:13:57.777 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:13:57.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.777 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.777 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:13:57.777 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:13:57.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.778 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.778 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:13:57.778 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:13:57.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.778 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.778 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.778 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:13:57.778 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:13:57.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.778 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.778 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:57.778 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:13:57.778 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:13:57.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.779 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:57.779 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:13:57.779 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:13:57.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.779 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:57.779 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:13:57.779 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:13:57.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.779 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.779 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:13:57.779 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:13:57.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.780 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:57.780 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:13:57.780 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:13:57.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.780 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:57.780 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:13:57.780 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:13:57.780 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.780 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.780 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.780 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:57.781 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:13:57.781 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.4192231120000001, 2024-04-26T11:13:57.781 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:13:57.781 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.781 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.781 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:57.781 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:57.781 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.781 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:13:57.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.781 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.781 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.781 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.781 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:13:57.781 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.782 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.782 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:13:57.782 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.782 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.782 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:13:57.782 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.782 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.782 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:13:57.783 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:13:57.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.783 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.783 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.783 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:13:57.783 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:13:57.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.783 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.783 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.783 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:13:57.783 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:13:57.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.783 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.783 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.783 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:13:57.784 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:13:57.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.784 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:57.784 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:13:57.784 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:13:57.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.784 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:57.784 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:13:57.784 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:13:57.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.784 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:57.785 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:13:57.785 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:13:57.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.785 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.785 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:13:57.785 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:13:57.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.785 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:57.785 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:13:57.785 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:13:57.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.785 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:13:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:13:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:54047 5.6 5:6762c910:::benchmark_data_smithi029_44842_object54046:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:13:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:56.307270+0000", 2024-04-26T11:13:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 1.3912394049999999, 2024-04-26T11:13:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016264639000000001, 2024-04-26T11:13:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 54047 2024-04-26T11:13:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.307270+0000", 2024-04-26T11:13:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.307270+0000", 2024-04-26T11:13:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.307269+0000", 2024-04-26T11:13:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.307354+0000", 2024-04-26T11:13:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5086999999999994e-05 2024-04-26T11:13:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.307364+0000", 2024-04-26T11:13:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2520000000000005e-06 2024-04-26T11:13:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.307370+0000", 2024-04-26T11:13:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5180000000000001e-06 2024-04-26T11:13:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.309438+0000", 2024-04-26T11:13:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020682560000000001 2024-04-26T11:13:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.309577+0000", 2024-04-26T11:13:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013829599999999999 2024-04-26T11:13:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.309714+0000", 2024-04-26T11:13:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013730599999999999 2024-04-26T11:13:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.312839+0000", 2024-04-26T11:13:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003124627 2024-04-26T11:13:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.323455+0000", 2024-04-26T11:13:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.010616066 2024-04-26T11:13:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.323501+0000", 2024-04-26T11:13:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6103000000000002e-05 2024-04-26T11:13:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.323534+0000", 2024-04-26T11:13:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3764999999999999e-05 2024-04-26T11:13:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:55101 5.6 5:6a592c7d:::benchmark_data_smithi029_44842_object55100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:13:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:56.749788+0000", 2024-04-26T11:13:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.94872103299999999, 2024-04-26T11:13:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015657388000000001, 2024-04-26T11:13:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 55101 2024-04-26T11:13:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.749788+0000", 2024-04-26T11:13:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.749788+0000", 2024-04-26T11:13:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.749787+0000", 2024-04-26T11:13:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.749861+0000", 2024-04-26T11:13:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3258999999999998e-05 2024-04-26T11:13:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.749873+0000", 2024-04-26T11:13:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.274e-05 2024-04-26T11:13:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.749881+0000", 2024-04-26T11:13:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5000000000000002e-06 2024-04-26T11:13:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.752830+0000", 2024-04-26T11:13:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0029489350000000002 2024-04-26T11:13:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.752977+0000", 2024-04-26T11:13:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014766599999999999 2024-04-26T11:13:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.753076+0000", 2024-04-26T11:13:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.8628000000000005e-05 2024-04-26T11:13:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.761362+0000", 2024-04-26T11:13:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0082856649999999993 2024-04-26T11:13:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.765362+0000", 2024-04-26T11:13:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0039999120000000004 2024-04-26T11:13:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.765410+0000", 2024-04-26T11:13:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8334999999999997e-05 2024-04-26T11:13:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.765446+0000", 2024-04-26T11:13:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5641e-05 2024-04-26T11:13:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:55119 5.6 5:6ad50111:::benchmark_data_smithi029_44842_object55118:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:13:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:13:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.938159458, 2024-04-26T11:13:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018830264999999999, 2024-04-26T11:13:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 55119 2024-04-26T11:13:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:13:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:13:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760349+0000", 2024-04-26T11:13:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760402+0000", 2024-04-26T11:13:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2695999999999998e-05 2024-04-26T11:13:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760411+0000", 2024-04-26T11:13:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.0589999999999992e-06 2024-04-26T11:13:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760416+0000", 2024-04-26T11:13:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.587e-06 2024-04-26T11:13:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767638+0000", 2024-04-26T11:13:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0072214050000000002 2024-04-26T11:13:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767760+0000", 2024-04-26T11:13:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000122067 2024-04-26T11:13:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767927+0000", 2024-04-26T11:13:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00016747999999999999 2024-04-26T11:13:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.770877+0000", 2024-04-26T11:13:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002949335 2024-04-26T11:13:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779130+0000", 2024-04-26T11:13:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.008253491 2024-04-26T11:13:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779158+0000", 2024-04-26T11:13:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7849000000000001e-05 2024-04-26T11:13:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779180+0000", 2024-04-26T11:13:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2048999999999998e-05 2024-04-26T11:13:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56258 5.3 5:c4f37a92:::benchmark_data_smithi029_44842_object56257:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:13:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.254567+0000", 2024-04-26T11:13:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.44394219299999998, 2024-04-26T11:13:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015680342999999999, 2024-04-26T11:13:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:13:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:13:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:13:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56258 2024-04-26T11:13:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:13:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:13:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.254567+0000", 2024-04-26T11:13:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:13:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.254567+0000", 2024-04-26T11:13:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:13:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:13:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.254566+0000", 2024-04-26T11:13:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:13:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:13:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.254743+0000", 2024-04-26T11:13:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000176799 2024-04-26T11:13:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:13:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.254753+0000", 2024-04-26T11:13:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.55e-06 2024-04-26T11:13:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.254759+0000", 2024-04-26T11:13:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5080000000000002e-06 2024-04-26T11:13:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:13:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.256711+0000", 2024-04-26T11:13:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019519089999999999 2024-04-26T11:13:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:13:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.256789+0000", 2024-04-26T11:13:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8151000000000004e-05 2024-04-26T11:13:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.256916+0000", 2024-04-26T11:13:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000127081 2024-04-26T11:13:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.264542+0000", 2024-04-26T11:13:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0076260679999999997 2024-04-26T11:13:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:13:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.270182+0000", 2024-04-26T11:13:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00563971 2024-04-26T11:13:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:13:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.270220+0000", 2024-04-26T11:13:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8368000000000003e-05 2024-04-26T11:13:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:13:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:13:57.808 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:13:57.808 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.270247+0000", 2024-04-26T11:13:57.808 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6923e-05 2024-04-26T11:13:57.808 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.808 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.808 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.808 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:13:57.808 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:13:57.808 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:13:57.811 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:13:57.811 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:57.808+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:57.812 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2024-04-26T11:13:57.911 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:57.909+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:57.939 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:13:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:13:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5.1095a639 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:13:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:13:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.59223619800000005, 2024-04-26T11:13:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.59226315900000004, 2024-04-26T11:13:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for peered", 2024-04-26T11:13:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:13:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:13:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:13:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:13:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:13:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:13:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:13:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:13:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:13:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:13:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:13:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:13:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:13:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:13:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:13:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5.d343dfef (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:13:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:13:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.59214055200000004, 2024-04-26T11:13:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.59221347300000005, 2024-04-26T11:13:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for peered", 2024-04-26T11:13:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:13:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:13:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:13:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:13:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:13:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:13:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:13:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:13:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:13:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:13:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:13:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:13:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:13:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:13:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:13:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5.a7bc214f (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:13:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:13:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.59200887300000005, 2024-04-26T11:13:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.592120125, 2024-04-26T11:13:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for peered", 2024-04-26T11:13:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:13:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:13:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:13:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:13:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:13:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:13:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:13:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:13:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:13:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:13:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:13:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:13:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:13:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:13:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:13:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5.77a7e9c9 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:13:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:13:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.59190041699999996, 2024-04-26T11:13:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.59204962800000005, 2024-04-26T11:13:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for peered", 2024-04-26T11:13:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:13:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:13:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:13:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:13:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:13:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:13:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:13:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:13:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:13:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:13:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:13:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:13:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:13:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:13:57.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:13:57.959 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.959 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.959 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.959 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5.cf554859 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:13:57.959 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:13:57.959 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.59179914899999997, 2024-04-26T11:13:57.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.59198578499999999, 2024-04-26T11:13:57.959 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.959 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for peered", 2024-04-26T11:13:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:13:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:13:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:13:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:13:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:13:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:13:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:13:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:13:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:13:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:13:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:13:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:13:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:13:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:13:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:13:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5.fb40b60f (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:13:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:13:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.59173020799999998, 2024-04-26T11:13:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.59195630300000002, 2024-04-26T11:13:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for peered", 2024-04-26T11:13:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:13:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:13:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:13:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:13:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:13:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:13:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:13:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:13:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:13:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:13:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:13:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:13:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:13:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:13:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:13:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5.4e76c6ad (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:13:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:13:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.58573462700000001, 2024-04-26T11:13:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.58601356199999999, 2024-04-26T11:13:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for peered", 2024-04-26T11:13:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:13:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:13:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:13:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:13:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:13:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:13:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:13:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:13:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:13:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:13:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:13:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:13:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:13:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:13:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:13:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:13:57.974 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 7 2024-04-26T11:13:57.974 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:13:57.975 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:13:58.019 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:58.017+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:58.101 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:13:58.101 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:13:58.101 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:13:58.101 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:13:58.101 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:13:58.111 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:13:58.152 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:58.150+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:58.206 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:13:58.214 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:58.212+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:58.279 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:13:58.279 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:13:58.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:13:58.279 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:13:58.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.280 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:58.280 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.905682+0000", 2024-04-26T11:13:58.280 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.370865817999999, 2024-04-26T11:13:58.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017168134000000002, 2024-04-26T11:13:58.280 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:58.280 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:58.280 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:58.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:58.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905682+0000", 2024-04-26T11:13:58.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:58.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905682+0000", 2024-04-26T11:13:58.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:58.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905681+0000", 2024-04-26T11:13:58.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:13:58.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:58.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905689+0000", 2024-04-26T11:13:58.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7830000000000004e-06 2024-04-26T11:13:58.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:58.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905703+0000", 2024-04-26T11:13:58.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3322000000000001e-05 2024-04-26T11:13:58.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:58.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.905717+0000", 2024-04-26T11:13:58.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4562000000000001e-05 2024-04-26T11:13:58.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:58.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906126+0000", 2024-04-26T11:13:58.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040896900000000002 2024-04-26T11:13:58.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op must wait for map", 2024-04-26T11:13:58.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906133+0000", 2024-04-26T11:13:58.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6370000000000002e-06 2024-04-26T11:13:58.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:58.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.914252+0000", 2024-04-26T11:13:58.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0081192529999999999 2024-04-26T11:13:58.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:58.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.914675+0000", 2024-04-26T11:13:58.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00042322399999999999 2024-04-26T11:13:58.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:58.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915080+0000", 2024-04-26T11:13:58.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00040486899999999998 2024-04-26T11:13:58.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:58.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.917940+0000", 2024-04-26T11:13:58.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0028593400000000001 2024-04-26T11:13:58.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:58.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.922776+0000", 2024-04-26T11:13:58.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048359420000000002 2024-04-26T11:13:58.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:58.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.922825+0000", 2024-04-26T11:13:58.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9048999999999997e-05 2024-04-26T11:13:58.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:58.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.922850+0000", 2024-04-26T11:13:58.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5689000000000001e-05 2024-04-26T11:13:58.286 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.286 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:58.286 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.286 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:26 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:58.286 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906148+0000", 2024-04-26T11:13:58.286 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.370400478000001, 2024-04-26T11:13:58.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017103547, 2024-04-26T11:13:58.286 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:58.286 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:58.286 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:58.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:58.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906148+0000", 2024-04-26T11:13:58.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:58.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906148+0000", 2024-04-26T11:13:58.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:58.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906147+0000", 2024-04-26T11:13:58.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:58.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:58.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906152+0000", 2024-04-26T11:13:58.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2530000000000004e-06 2024-04-26T11:13:58.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:58.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906160+0000", 2024-04-26T11:13:58.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.605e-06 2024-04-26T11:13:58.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:58.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906165+0000", 2024-04-26T11:13:58.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4689999999999996e-06 2024-04-26T11:13:58.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:58.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906223+0000", 2024-04-26T11:13:58.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7578999999999999e-05 2024-04-26T11:13:58.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:58.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906228+0000", 2024-04-26T11:13:58.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.485e-06 2024-04-26T11:13:58.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:58.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915364+0000", 2024-04-26T11:13:58.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0091359230000000007 2024-04-26T11:13:58.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:58.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915433+0000", 2024-04-26T11:13:58.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8913999999999998e-05 2024-04-26T11:13:58.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:58.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915517+0000", 2024-04-26T11:13:58.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4023000000000005e-05 2024-04-26T11:13:58.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:58.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.918856+0000", 2024-04-26T11:13:58.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0033382469999999999 2024-04-26T11:13:58.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:58.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923141+0000", 2024-04-26T11:13:58.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0042854779999999997 2024-04-26T11:13:58.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:58.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923209+0000", 2024-04-26T11:13:58.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8122999999999998e-05 2024-04-26T11:13:58.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:58.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923251+0000", 2024-04-26T11:13:58.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1919999999999998e-05 2024-04-26T11:13:58.291 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.292 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:58.292 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.292 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:13:58.292 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906402+0000", 2024-04-26T11:13:58.292 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 45.370146425999998, 2024-04-26T11:13:58.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017555191000000001, 2024-04-26T11:13:58.292 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:58.292 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:58.292 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:58.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:58.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906402+0000", 2024-04-26T11:13:58.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:58.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906402+0000", 2024-04-26T11:13:58.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:58.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906401+0000", 2024-04-26T11:13:58.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:58.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:58.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906407+0000", 2024-04-26T11:13:58.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2689999999999996e-06 2024-04-26T11:13:58.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:58.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906416+0000", 2024-04-26T11:13:58.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5080000000000005e-06 2024-04-26T11:13:58.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:58.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906422+0000", 2024-04-26T11:13:58.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9460000000000003e-06 2024-04-26T11:13:58.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:58.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906459+0000", 2024-04-26T11:13:58.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6998000000000001e-05 2024-04-26T11:13:58.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:13:58.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906463+0000", 2024-04-26T11:13:58.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.374e-06 2024-04-26T11:13:58.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:58.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915821+0000", 2024-04-26T11:13:58.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0093578050000000003 2024-04-26T11:13:58.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:58.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.916209+0000", 2024-04-26T11:13:58.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00038876999999999998 2024-04-26T11:13:58.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:58.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.916349+0000", 2024-04-26T11:13:58.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013992900000000001 2024-04-26T11:13:58.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:58.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.920269+0000", 2024-04-26T11:13:58.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003919133 2024-04-26T11:13:58.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:58.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923899+0000", 2024-04-26T11:13:58.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003630716 2024-04-26T11:13:58.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:58.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923932+0000", 2024-04-26T11:13:58.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2471999999999997e-05 2024-04-26T11:13:58.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:58.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923957+0000", 2024-04-26T11:13:58.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5038999999999999e-05 2024-04-26T11:13:58.298 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.298 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:58.298 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.299 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:33828 5.b 5:d3313e8b:::benchmark_data_smithi029_44842_object33827:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:13:58.299 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:47.804177+0000", 2024-04-26T11:13:58.299 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 10.472370980999999, 2024-04-26T11:13:58.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01819138, 2024-04-26T11:13:58.299 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:58.299 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:58.299 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:58.299 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:58.299 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:58.299 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 33828 2024-04-26T11:13:58.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.299 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:58.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:58.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804177+0000", 2024-04-26T11:13:58.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:58.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804177+0000", 2024-04-26T11:13:58.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:58.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804176+0000", 2024-04-26T11:13:58.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:58.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:58.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804238+0000", 2024-04-26T11:13:58.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1791000000000005e-05 2024-04-26T11:13:58.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:58.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804248+0000", 2024-04-26T11:13:58.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9969999999999993e-06 2024-04-26T11:13:58.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:58.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804253+0000", 2024-04-26T11:13:58.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2830000000000003e-06 2024-04-26T11:13:58.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:58.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.805184+0000", 2024-04-26T11:13:58.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093189900000000003 2024-04-26T11:13:58.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:58.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.805268+0000", 2024-04-26T11:13:58.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3634000000000006e-05 2024-04-26T11:13:58.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:58.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.805359+0000", 2024-04-26T11:13:58.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0603e-05 2024-04-26T11:13:58.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:58.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.806391+0000", 2024-04-26T11:13:58.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001031978 2024-04-26T11:13:58.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:58.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.822308+0000", 2024-04-26T11:13:58.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015917343 2024-04-26T11:13:58.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:58.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.822344+0000", 2024-04-26T11:13:58.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5754999999999999e-05 2024-04-26T11:13:58.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:58.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.822368+0000", 2024-04-26T11:13:58.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4658e-05 2024-04-26T11:13:58.304 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.304 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:58.304 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.304 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35482 5.b 5:d2b3ef95:::benchmark_data_smithi029_44842_object35481:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:58.304 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:13:58.304 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.8578663970000004, 2024-04-26T11:13:58.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019390455000000001, 2024-04-26T11:13:58.305 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:58.305 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:58.305 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:58.305 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:58.306 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:58.306 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35482 2024-04-26T11:13:58.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.306 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:58.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:58.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:13:58.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:58.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:13:58.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:58.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418681+0000", 2024-04-26T11:13:58.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:58.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:58.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418802+0000", 2024-04-26T11:13:58.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120835 2024-04-26T11:13:58.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:58.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418810+0000", 2024-04-26T11:13:58.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1240000000000005e-06 2024-04-26T11:13:58.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:58.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418816+0000", 2024-04-26T11:13:58.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5749999999999997e-06 2024-04-26T11:13:58.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:58.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.419905+0000", 2024-04-26T11:13:58.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001088751 2024-04-26T11:13:58.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:58.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.420046+0000", 2024-04-26T11:13:58.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140514 2024-04-26T11:13:58.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:58.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.420180+0000", 2024-04-26T11:13:58.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440899999999999 2024-04-26T11:13:58.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:58.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425415+0000", 2024-04-26T11:13:58.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052350540000000003 2024-04-26T11:13:58.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:58.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.437989+0000", 2024-04-26T11:13:58.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012573632 2024-04-26T11:13:58.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:58.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.438035+0000", 2024-04-26T11:13:58.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5799e-05 2024-04-26T11:13:58.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:58.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.438072+0000", 2024-04-26T11:13:58.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7530999999999997e-05 2024-04-26T11:13:58.310 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.310 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:58.310 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.311 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35483 5.b 5:d3dd14f6:::benchmark_data_smithi029_44842_object35482:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:58.311 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:13:58.311 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.8577236550000009, 2024-04-26T11:13:58.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021245969, 2024-04-26T11:13:58.311 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:58.311 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:58.311 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:58.311 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:58.311 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:58.311 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35483 2024-04-26T11:13:58.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.311 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:58.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:58.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:13:58.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:58.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:13:58.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:58.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:13:58.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:58.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:58.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418885+0000", 2024-04-26T11:13:58.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1294e-05 2024-04-26T11:13:58.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:58.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418892+0000", 2024-04-26T11:13:58.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4599999999999997e-06 2024-04-26T11:13:58.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:58.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418899+0000", 2024-04-26T11:13:58.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0909999999999998e-06 2024-04-26T11:13:58.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:58.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421347+0000", 2024-04-26T11:13:58.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024484609999999999 2024-04-26T11:13:58.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:58.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421468+0000", 2024-04-26T11:13:58.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000121179 2024-04-26T11:13:58.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:58.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421605+0000", 2024-04-26T11:13:58.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013672200000000001 2024-04-26T11:13:58.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:58.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425456+0000", 2024-04-26T11:13:58.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038511719999999999 2024-04-26T11:13:58.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:58.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.439986+0000", 2024-04-26T11:13:58.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014530080000000001 2024-04-26T11:13:58.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:58.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440038+0000", 2024-04-26T11:13:58.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1916999999999998e-05 2024-04-26T11:13:58.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:58.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440070+0000", 2024-04-26T11:13:58.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2245e-05 2024-04-26T11:13:58.316 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.317 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:58.317 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.317 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35493 5.8 5:14785d1e:::benchmark_data_smithi029_44842_object35492:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:58.317 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.422582+0000", 2024-04-26T11:13:58.318 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.8539660839999996, 2024-04-26T11:13:58.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01748692, 2024-04-26T11:13:58.318 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:58.318 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:58.318 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:58.318 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:58.318 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:58.318 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35493 2024-04-26T11:13:58.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.318 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:58.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:58.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422582+0000", 2024-04-26T11:13:58.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:58.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422582+0000", 2024-04-26T11:13:58.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:58.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422581+0000", 2024-04-26T11:13:58.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:58.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:58.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422715+0000", 2024-04-26T11:13:58.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013359600000000001 2024-04-26T11:13:58.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:58.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422723+0000", 2024-04-26T11:13:58.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4749999999999993e-06 2024-04-26T11:13:58.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:58.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422728+0000", 2024-04-26T11:13:58.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7210000000000002e-06 2024-04-26T11:13:58.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:58.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422753+0000", 2024-04-26T11:13:58.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4456000000000001e-05 2024-04-26T11:13:58.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:58.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422832+0000", 2024-04-26T11:13:58.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9810999999999999e-05 2024-04-26T11:13:58.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:58.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422932+0000", 2024-04-26T11:13:58.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9865999999999996e-05 2024-04-26T11:13:58.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:58.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.427701+0000", 2024-04-26T11:13:58.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047686999999999998 2024-04-26T11:13:58.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:58.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.439983+0000", 2024-04-26T11:13:58.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012281861 2024-04-26T11:13:58.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:58.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440032+0000", 2024-04-26T11:13:58.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9317999999999998e-05 2024-04-26T11:13:58.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:58.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440069+0000", 2024-04-26T11:13:58.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6740999999999999e-05 2024-04-26T11:13:58.323 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.323 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:58.323 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.323 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35494 5.4 5:2687a65a:::benchmark_data_smithi029_44842_object35493:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:58.323 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.422734+0000", 2024-04-26T11:13:58.323 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.8538136820000002, 2024-04-26T11:13:58.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017335989, 2024-04-26T11:13:58.323 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:58.323 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:58.323 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:58.323 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:58.323 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:58.324 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35494 2024-04-26T11:13:58.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.324 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:58.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:58.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422734+0000", 2024-04-26T11:13:58.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:58.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422734+0000", 2024-04-26T11:13:58.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:58.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422734+0000", 2024-04-26T11:13:58.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:58.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:58.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422769+0000", 2024-04-26T11:13:58.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4759999999999999e-05 2024-04-26T11:13:58.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:58.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422773+0000", 2024-04-26T11:13:58.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6319999999999999e-06 2024-04-26T11:13:58.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:58.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422777+0000", 2024-04-26T11:13:58.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3550000000000001e-06 2024-04-26T11:13:58.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:58.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422802+0000", 2024-04-26T11:13:58.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5771000000000001e-05 2024-04-26T11:13:58.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:58.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422905+0000", 2024-04-26T11:13:58.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102509 2024-04-26T11:13:58.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:58.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.422983+0000", 2024-04-26T11:13:58.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8209999999999998e-05 2024-04-26T11:13:58.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:58.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.427677+0000", 2024-04-26T11:13:58.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0046938659999999997 2024-04-26T11:13:58.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:58.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.439988+0000", 2024-04-26T11:13:58.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012311344 2024-04-26T11:13:58.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:58.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440036+0000", 2024-04-26T11:13:58.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7187000000000001e-05 2024-04-26T11:13:58.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:58.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440070+0000", 2024-04-26T11:13:58.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4752999999999997e-05 2024-04-26T11:13:58.328 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.328 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:58.328 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.328 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:36746 5.8 5:14dea2d5:::benchmark_data_smithi029_44842_object36745:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:13:58.328 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.896239+0000", 2024-04-26T11:13:58.329 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.3803091240000001, 2024-04-26T11:13:58.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016757729999999998, 2024-04-26T11:13:58.329 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:58.329 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:58.329 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:58.329 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:58.329 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:58.329 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 36746 2024-04-26T11:13:58.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.329 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:58.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:58.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.896239+0000", 2024-04-26T11:13:58.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:58.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.896239+0000", 2024-04-26T11:13:58.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:58.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.896238+0000", 2024-04-26T11:13:58.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:58.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:58.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.896270+0000", 2024-04-26T11:13:58.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1337999999999997e-05 2024-04-26T11:13:58.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:58.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.896276+0000", 2024-04-26T11:13:58.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0680000000000002e-06 2024-04-26T11:13:58.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:58.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.896287+0000", 2024-04-26T11:13:58.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1586999999999999e-05 2024-04-26T11:13:58.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:58.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.898129+0000", 2024-04-26T11:13:58.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018412630000000001 2024-04-26T11:13:58.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:58.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.898211+0000", 2024-04-26T11:13:58.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1978999999999996e-05 2024-04-26T11:13:58.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:58.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.898296+0000", 2024-04-26T11:13:58.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5680999999999995e-05 2024-04-26T11:13:58.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:58.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.899825+0000", 2024-04-26T11:13:58.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001528789 2024-04-26T11:13:58.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:58.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.912927+0000", 2024-04-26T11:13:58.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013101665 2024-04-26T11:13:58.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:58.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.912963+0000", 2024-04-26T11:13:58.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6745000000000001e-05 2024-04-26T11:13:58.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:58.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.912997+0000", 2024-04-26T11:13:58.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3118999999999999e-05 2024-04-26T11:13:58.333 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.333 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:58.333 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.334 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44504 5.0 5:0536d5a4:::benchmark_data_smithi029_44842_object44503:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:58.334 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:13:58.334 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 6.1072620329999996, 2024-04-26T11:13:58.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018576187000000001, 2024-04-26T11:13:58.334 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:58.334 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:58.334 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:58.334 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:58.334 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:58.334 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44504 2024-04-26T11:13:58.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.334 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:58.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:58.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:13:58.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:58.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:13:58.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:58.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:13:58.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:58.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:58.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169304+0000", 2024-04-26T11:13:58.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8331000000000001e-05 2024-04-26T11:13:58.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:58.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169308+0000", 2024-04-26T11:13:58.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9609999999999999e-06 2024-04-26T11:13:58.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:58.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169311+0000", 2024-04-26T11:13:58.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.044e-06 2024-04-26T11:13:58.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:58.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.174118+0000", 2024-04-26T11:13:58.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004806645 2024-04-26T11:13:58.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:58.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.174207+0000", 2024-04-26T11:13:58.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9665000000000003e-05 2024-04-26T11:13:58.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:58.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.174308+0000", 2024-04-26T11:13:58.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100399 2024-04-26T11:13:58.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:58.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.185001+0000", 2024-04-26T11:13:58.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010693599 2024-04-26T11:13:58.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:58.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187698+0000", 2024-04-26T11:13:58.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026970929999999998 2024-04-26T11:13:58.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:58.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187777+0000", 2024-04-26T11:13:58.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8335000000000001e-05 2024-04-26T11:13:58.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:58.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187862+0000", 2024-04-26T11:13:58.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5521999999999999e-05 2024-04-26T11:13:58.339 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.339 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:58.339 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.339 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44506 5.0 5:07ec7127:::benchmark_data_smithi029_44842_object44505:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:58.339 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:13:58.339 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 6.1069621139999999, 2024-04-26T11:13:58.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018482386999999999, 2024-04-26T11:13:58.339 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:58.339 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:58.339 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:58.340 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:58.340 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:58.340 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44506 2024-04-26T11:13:58.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.340 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:58.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:58.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:13:58.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:58.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:13:58.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:58.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:13:58.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:58.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:58.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169730+0000", 2024-04-26T11:13:58.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014447200000000001 2024-04-26T11:13:58.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:58.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169738+0000", 2024-04-26T11:13:58.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5700000000000004e-06 2024-04-26T11:13:58.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:58.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169741+0000", 2024-04-26T11:13:58.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3909999999999998e-06 2024-04-26T11:13:58.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:58.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.176682+0000", 2024-04-26T11:13:58.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0069412129999999999 2024-04-26T11:13:58.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:58.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.176816+0000", 2024-04-26T11:13:58.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000134265 2024-04-26T11:13:58.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:58.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.176952+0000", 2024-04-26T11:13:58.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013520000000000001 2024-04-26T11:13:58.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:58.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.185004+0000", 2024-04-26T11:13:58.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0080524959999999993 2024-04-26T11:13:58.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:58.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187983+0000", 2024-04-26T11:13:58.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0029783330000000001 2024-04-26T11:13:58.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:58.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188031+0000", 2024-04-26T11:13:58.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8588000000000003e-05 2024-04-26T11:13:58.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:58.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188068+0000", 2024-04-26T11:13:58.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7154999999999999e-05 2024-04-26T11:13:58.344 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.344 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:58.344 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.344 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44509 5.0 5:0828d2b6:::benchmark_data_smithi029_44842_object44508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:58.345 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.169815+0000", 2024-04-26T11:13:58.345 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 6.1067332690000002, 2024-04-26T11:13:58.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018410841000000001, 2024-04-26T11:13:58.345 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:58.345 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:58.345 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:58.345 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:58.345 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:58.345 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44509 2024-04-26T11:13:58.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.345 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:58.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:58.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169815+0000", 2024-04-26T11:13:58.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:58.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169815+0000", 2024-04-26T11:13:58.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:58.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169814+0000", 2024-04-26T11:13:58.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:58.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:58.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169921+0000", 2024-04-26T11:13:58.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107194 2024-04-26T11:13:58.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:58.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169927+0000", 2024-04-26T11:13:58.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.203e-06 2024-04-26T11:13:58.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:58.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169931+0000", 2024-04-26T11:13:58.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0829999999999997e-06 2024-04-26T11:13:58.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:58.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.179590+0000", 2024-04-26T11:13:58.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096589999999999992 2024-04-26T11:13:58.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:58.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.179718+0000", 2024-04-26T11:13:58.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012885699999999999 2024-04-26T11:13:58.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:58.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.179857+0000", 2024-04-26T11:13:58.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013884100000000001 2024-04-26T11:13:58.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:58.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188082+0000", 2024-04-26T11:13:58.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082250099999999996 2024-04-26T11:13:58.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:58.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188164+0000", 2024-04-26T11:13:58.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2123e-05 2024-04-26T11:13:58.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:58.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188197+0000", 2024-04-26T11:13:58.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2471000000000001e-05 2024-04-26T11:13:58.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:58.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188226+0000", 2024-04-26T11:13:58.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8609999999999999e-05 2024-04-26T11:13:58.350 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.350 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:58.350 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.350 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44513 5.0 5:0a236ebb:::benchmark_data_smithi029_44842_object44512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:58.350 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:13:58.350 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 6.1064606750000001, 2024-04-26T11:13:58.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020724414, 2024-04-26T11:13:58.350 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:58.350 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:58.350 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:58.350 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:58.350 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:58.351 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44513 2024-04-26T11:13:58.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.351 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:58.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:58.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:13:58.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:58.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:13:58.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:58.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:13:58.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:58.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:58.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170120+0000", 2024-04-26T11:13:58.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2941000000000002e-05 2024-04-26T11:13:58.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:58.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170127+0000", 2024-04-26T11:13:58.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.469e-06 2024-04-26T11:13:58.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:58.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170133+0000", 2024-04-26T11:13:58.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1340000000000001e-06 2024-04-26T11:13:58.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:58.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182383+0000", 2024-04-26T11:13:58.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012249970000000001 2024-04-26T11:13:58.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:58.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182477+0000", 2024-04-26T11:13:58.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3776999999999993e-05 2024-04-26T11:13:58.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:58.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182572+0000", 2024-04-26T11:13:58.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4841999999999998e-05 2024-04-26T11:13:58.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:58.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188262+0000", 2024-04-26T11:13:58.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005690077 2024-04-26T11:13:58.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:58.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190748+0000", 2024-04-26T11:13:58.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024857780000000001 2024-04-26T11:13:58.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:58.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190776+0000", 2024-04-26T11:13:58.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8419999999999999e-05 2024-04-26T11:13:58.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:58.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190812+0000", 2024-04-26T11:13:58.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5630999999999998e-05 2024-04-26T11:13:58.355 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.355 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:58.355 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.355 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44792 5.8 5:17ddc189:::benchmark_data_smithi029_44842_object44791:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:58.355 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.282364+0000", 2024-04-26T11:13:58.356 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.9941841309999999, 2024-04-26T11:13:58.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016770038000000001, 2024-04-26T11:13:58.356 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:58.356 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:58.356 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:58.356 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:58.356 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:58.356 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44792 2024-04-26T11:13:58.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.356 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:58.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:58.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.282364+0000", 2024-04-26T11:13:58.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:58.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.282364+0000", 2024-04-26T11:13:58.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:58.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.282363+0000", 2024-04-26T11:13:58.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:58.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:58.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.282462+0000", 2024-04-26T11:13:58.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8799000000000001e-05 2024-04-26T11:13:58.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:58.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.282471+0000", 2024-04-26T11:13:58.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0189999999999995e-06 2024-04-26T11:13:58.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:58.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.282478+0000", 2024-04-26T11:13:58.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7449999999999998e-06 2024-04-26T11:13:58.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:58.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.285628+0000", 2024-04-26T11:13:58.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0031500429999999999 2024-04-26T11:13:58.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:58.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.285705+0000", 2024-04-26T11:13:58.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7291000000000002e-05 2024-04-26T11:13:58.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:58.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.285792+0000", 2024-04-26T11:13:58.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7164999999999996e-05 2024-04-26T11:13:58.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:58.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.288027+0000", 2024-04-26T11:13:58.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022347299999999999 2024-04-26T11:13:58.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:58.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.299036+0000", 2024-04-26T11:13:58.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011008808 2024-04-26T11:13:58.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:58.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.299085+0000", 2024-04-26T11:13:58.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.905e-05 2024-04-26T11:13:58.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:58.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.299134+0000", 2024-04-26T11:13:58.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9184000000000002e-05 2024-04-26T11:13:58.361 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.361 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:58.361 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.361 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44794 5.8 5:158fd219:::benchmark_data_smithi029_44842_object44793:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:58.361 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.283382+0000", 2024-04-26T11:13:58.361 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.9931660979999997, 2024-04-26T11:13:58.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018701497000000001, 2024-04-26T11:13:58.361 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:58.361 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:58.361 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:58.361 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:58.361 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:58.361 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44794 2024-04-26T11:13:58.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.362 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:58.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:58.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283382+0000", 2024-04-26T11:13:58.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:58.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283382+0000", 2024-04-26T11:13:58.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:58.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283381+0000", 2024-04-26T11:13:58.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:58.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:58.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283409+0000", 2024-04-26T11:13:58.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.798e-05 2024-04-26T11:13:58.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:58.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283417+0000", 2024-04-26T11:13:58.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2629999999999997e-06 2024-04-26T11:13:58.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:58.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283424+0000", 2024-04-26T11:13:58.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1210000000000001e-06 2024-04-26T11:13:58.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:58.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.286843+0000", 2024-04-26T11:13:58.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034194490000000002 2024-04-26T11:13:58.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:58.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.286932+0000", 2024-04-26T11:13:58.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9065000000000002e-05 2024-04-26T11:13:58.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:58.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.287019+0000", 2024-04-26T11:13:58.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6976000000000002e-05 2024-04-26T11:13:58.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:58.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.288238+0000", 2024-04-26T11:13:58.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012185 2024-04-26T11:13:58.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:58.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.302032+0000", 2024-04-26T11:13:58.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013794618999999999 2024-04-26T11:13:58.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:58.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.302061+0000", 2024-04-26T11:13:58.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9008000000000001e-05 2024-04-26T11:13:58.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:58.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.302083+0000", 2024-04-26T11:13:58.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2002e-05 2024-04-26T11:13:58.366 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.366 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:58.366 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.367 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:45051 5.0 5:0f54b16a:::benchmark_data_smithi029_44842_object45050:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:58.367 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.395755+0000", 2024-04-26T11:13:58.367 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.8807928619999998, 2024-04-26T11:13:58.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017330567000000002, 2024-04-26T11:13:58.367 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:58.367 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:58.367 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:58.367 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:58.367 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:58.367 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 45051 2024-04-26T11:13:58.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.367 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:58.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:58.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.395755+0000", 2024-04-26T11:13:58.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:58.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.395755+0000", 2024-04-26T11:13:58.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:58.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.395754+0000", 2024-04-26T11:13:58.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:58.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:58.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.395786+0000", 2024-04-26T11:13:58.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1177999999999999e-05 2024-04-26T11:13:58.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:58.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.395794+0000", 2024-04-26T11:13:58.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4260000000000003e-06 2024-04-26T11:13:58.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:58.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.395799+0000", 2024-04-26T11:13:58.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3419999999999998e-06 2024-04-26T11:13:58.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:58.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.401856+0000", 2024-04-26T11:13:58.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060561549999999997 2024-04-26T11:13:58.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:58.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.401964+0000", 2024-04-26T11:13:58.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108062 2024-04-26T11:13:58.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:58.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.402103+0000", 2024-04-26T11:13:58.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139808 2024-04-26T11:13:58.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:58.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.407608+0000", 2024-04-26T11:13:58.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055047789999999996 2024-04-26T11:13:58.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:58.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.413014+0000", 2024-04-26T11:13:58.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054058980000000001 2024-04-26T11:13:58.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:58.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.413054+0000", 2024-04-26T11:13:58.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9576000000000002e-05 2024-04-26T11:13:58.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:58.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.413086+0000", 2024-04-26T11:13:58.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2042999999999998e-05 2024-04-26T11:13:58.372 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.372 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:58.372 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.372 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:58.372 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:13:58.372 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.9977576529999999, 2024-04-26T11:13:58.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:13:58.372 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:58.372 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:58.372 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:58.372 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:58.373 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:58.373 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:13:58.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.373 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:58.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:58.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:13:58.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:58.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:13:58.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:58.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:13:58.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:58.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:58.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:13:58.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:13:58.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:58.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:13:58.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:13:58.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:58.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:13:58.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:13:58.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:58.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:13:58.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:13:58.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:58.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:13:58.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:13:58.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:58.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:13:58.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:13:58.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:58.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:13:58.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:13:58.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:58.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:13:58.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:13:58.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:58.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:13:58.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:13:58.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:58.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:13:58.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:13:58.377 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.377 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:58.377 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.377 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:13:58.377 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:13:58.377 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.9971079510000003, 2024-04-26T11:13:58.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:13:58.378 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:58.378 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:58.378 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:58.378 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:58.378 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:58.378 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:13:58.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.378 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:58.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:58.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:13:58.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:58.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:13:58.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:58.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:13:58.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:13:58.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:58.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:13:58.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:13:58.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:58.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:13:58.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:13:58.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:58.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:13:58.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:13:58.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:58.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:13:58.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:13:58.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:58.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:13:58.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:13:58.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:13:58.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:13:58.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:13:58.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:58.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:13:58.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:13:58.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:58.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:13:58.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:13:58.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:58.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:13:58.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:13:58.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:58.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:13:58.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:13:58.382 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.383 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:58.383 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.383 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:55093 5.e 5:7ebffa9e:::benchmark_data_smithi029_44842_object55092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:13:58.383 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:13:58.383 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 1.529976233, 2024-04-26T11:13:58.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020381660999999999, 2024-04-26T11:13:58.383 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:58.383 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:58.383 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:58.383 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:58.383 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:58.383 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 55093 2024-04-26T11:13:58.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.383 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:58.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:58.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:13:58.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:58.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:13:58.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:58.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746571+0000", 2024-04-26T11:13:58.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:58.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:58.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746599+0000", 2024-04-26T11:13:58.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8262000000000001e-05 2024-04-26T11:13:58.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:58.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746610+0000", 2024-04-26T11:13:58.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1070000000000001e-05 2024-04-26T11:13:58.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:58.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746617+0000", 2024-04-26T11:13:58.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8190000000000003e-06 2024-04-26T11:13:58.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:58.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748218+0000", 2024-04-26T11:13:58.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0016005889999999999 2024-04-26T11:13:58.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:58.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748350+0000", 2024-04-26T11:13:58.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132528 2024-04-26T11:13:58.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:58.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748499+0000", 2024-04-26T11:13:58.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014815600000000001 2024-04-26T11:13:58.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:58.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.750795+0000", 2024-04-26T11:13:58.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022960369999999999 2024-04-26T11:13:58.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:58.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766866+0000", 2024-04-26T11:13:58.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016071230999999998 2024-04-26T11:13:58.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:58.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766922+0000", 2024-04-26T11:13:58.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6643e-05 2024-04-26T11:13:58.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:58.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766953+0000", 2024-04-26T11:13:58.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0981e-05 2024-04-26T11:13:58.388 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.388 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:58.388 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.388 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:55738 5.4 5:2d90ff60:::benchmark_data_smithi029_44842_object55737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:13:58.388 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.026425+0000", 2024-04-26T11:13:58.388 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 1.2501227699999999, 2024-04-26T11:13:58.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018738008, 2024-04-26T11:13:58.388 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:13:58.389 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:13:58.389 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:13:58.389 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:13:58.389 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:13:58.389 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 55738 2024-04-26T11:13:58.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.389 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:13:58.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:13:58.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026425+0000", 2024-04-26T11:13:58.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:13:58.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026425+0000", 2024-04-26T11:13:58.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:13:58.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:13:58.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026425+0000", 2024-04-26T11:13:58.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:13:58.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:13:58.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026456+0000", 2024-04-26T11:13:58.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1312000000000001e-05 2024-04-26T11:13:58.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:13:58.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026463+0000", 2024-04-26T11:13:58.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2710000000000003e-06 2024-04-26T11:13:58.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:13:58.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026469+0000", 2024-04-26T11:13:58.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7389999999999996e-06 2024-04-26T11:13:58.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:13:58.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026561+0000", 2024-04-26T11:13:58.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2552000000000004e-05 2024-04-26T11:13:58.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:13:58.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026695+0000", 2024-04-26T11:13:58.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013394500000000001 2024-04-26T11:13:58.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:13:58.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026827+0000", 2024-04-26T11:13:58.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013146800000000001 2024-04-26T11:13:58.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:13:58.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.028905+0000", 2024-04-26T11:13:58.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020783749999999999 2024-04-26T11:13:58.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:13:58.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.045076+0000", 2024-04-26T11:13:58.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016170411999999999 2024-04-26T11:13:58.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:13:58.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.045130+0000", 2024-04-26T11:13:58.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4169000000000003e-05 2024-04-26T11:13:58.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:13:58.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:13:58.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:13:58.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.045163+0000", 2024-04-26T11:13:58.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3368999999999998e-05 2024-04-26T11:13:58.393 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.393 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:58.393 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.393 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:13:58.393 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:13:58.394 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:13:58.395 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:13:58.395 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:58.393+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:58.396 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:13:58.399 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:13:58.399 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:13:58.399 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:13:58.399 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:13:58.401 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:13:58.402 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:13:58.415 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:2024-04-26T11:13:58.411185+0000 min lat: 0.00112975 max lat: 1.0322 avg lat: 0.0056555 2024-04-26T11:13:58.415 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-26T11:13:58.415 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 20 16 56567 56551 176.706 8.5625 0.00878403 0.0056555 2024-04-26T11:13:58.496 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:58.494+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:58.574 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:58.574 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:58.588 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:13:58.597 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:58.595+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:58.697 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-26T11:13:58.698 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:58.696+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:58.777 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:58.777 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:58.792 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:13:58.837 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:58.835+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:58.900 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:58.898+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:58.980 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:58.980 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:58.994 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:13:59.039 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:59.033+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:59.101 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:59.099+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:59.167 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:59.167 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:59.181 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:13:59.223 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:59.221+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:59.302 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:59.300+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:59.355 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:13:59.387 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:59.387 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:59.401 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:13:59.403 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:59.401+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:59.411 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 21 16 58890 58874 175.205 145.188 0.00467038 0.00570497 2024-04-26T11:13:59.504 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:59.502+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:59.570 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:59.571 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:59.584 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:13:59.630 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:13:59.628+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:13:59.706 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:59.704+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:59.767 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:13:59.767 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:13:59.782 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:13:59.807 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:59.805+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:13:59.907 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:13:59.906+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:00.005 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:00.005 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:00.008 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:00.007+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:00.023 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:00.113 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:00.109+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:00.205 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:00.206 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:00.210 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:00.208+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:00.221 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:00.312 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:00.310+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:00.352 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:14:00.394 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:00.394 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:00.403 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:14:00.409 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:00.411 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 22 16 61114 61098 173.559 139 0.00549871 0.00575809 2024-04-26T11:14:00.452 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:00.450+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:00.513 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:00.512+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:00.557 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:00.579 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:00.579 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:00.579 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:00.579 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:00.579 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:14:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:14:00.580 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:14:00.580 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:00.581 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:00.582 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:00.593 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:00.635 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:00.633+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:00.715 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:00.714+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:00.811 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:00.811 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:14:00.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:14:00.811 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:00.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.811 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(mds.0.3:23 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T11:14:00.811 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:12.906402+0000", 2024-04-26T11:14:00.811 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.900748446000001, 2024-04-26T11:14:00.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017555191000000001, 2024-04-26T11:14:00.812 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:00.812 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:00.812 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:00.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:00.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906402+0000", 2024-04-26T11:14:00.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.812 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:00.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906402+0000", 2024-04-26T11:14:00.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:00.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906401+0000", 2024-04-26T11:14:00.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:00.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:00.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906407+0000", 2024-04-26T11:14:00.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2689999999999996e-06 2024-04-26T11:14:00.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:00.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906416+0000", 2024-04-26T11:14:00.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5080000000000005e-06 2024-04-26T11:14:00.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:00.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906422+0000", 2024-04-26T11:14:00.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9460000000000003e-06 2024-04-26T11:14:00.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906459+0000", 2024-04-26T11:14:00.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6998000000000001e-05 2024-04-26T11:14:00.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:14:00.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.906463+0000", 2024-04-26T11:14:00.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.374e-06 2024-04-26T11:14:00.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.915821+0000", 2024-04-26T11:14:00.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0093578050000000003 2024-04-26T11:14:00.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:00.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.916209+0000", 2024-04-26T11:14:00.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00038876999999999998 2024-04-26T11:14:00.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:00.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.916349+0000", 2024-04-26T11:14:00.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013992900000000001 2024-04-26T11:14:00.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:00.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.920269+0000", 2024-04-26T11:14:00.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003919133 2024-04-26T11:14:00.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:00.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923899+0000", 2024-04-26T11:14:00.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003630716 2024-04-26T11:14:00.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:00.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923932+0000", 2024-04-26T11:14:00.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2471999999999997e-05 2024-04-26T11:14:00.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:00.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:12.923957+0000", 2024-04-26T11:14:00.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5038999999999999e-05 2024-04-26T11:14:00.817 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.817 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:00.817 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.817 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:33828 5.b 5:d3313e8b:::benchmark_data_smithi029_44842_object33827:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:14:00.817 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:47.804177+0000", 2024-04-26T11:14:00.818 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.002973001000001, 2024-04-26T11:14:00.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01819138, 2024-04-26T11:14:00.818 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:00.818 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:00.818 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:00.818 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:00.818 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:00.818 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 33828 2024-04-26T11:14:00.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.818 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:00.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:00.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804177+0000", 2024-04-26T11:14:00.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:00.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804177+0000", 2024-04-26T11:14:00.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:00.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804176+0000", 2024-04-26T11:14:00.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:00.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:00.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804238+0000", 2024-04-26T11:14:00.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1791000000000005e-05 2024-04-26T11:14:00.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:00.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804248+0000", 2024-04-26T11:14:00.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9969999999999993e-06 2024-04-26T11:14:00.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:00.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804253+0000", 2024-04-26T11:14:00.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2830000000000003e-06 2024-04-26T11:14:00.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.805184+0000", 2024-04-26T11:14:00.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093189900000000003 2024-04-26T11:14:00.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:00.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.805268+0000", 2024-04-26T11:14:00.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3634000000000006e-05 2024-04-26T11:14:00.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:00.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.805359+0000", 2024-04-26T11:14:00.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0603e-05 2024-04-26T11:14:00.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:00.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.806391+0000", 2024-04-26T11:14:00.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001031978 2024-04-26T11:14:00.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:00.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.822308+0000", 2024-04-26T11:14:00.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015917343 2024-04-26T11:14:00.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:00.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.822344+0000", 2024-04-26T11:14:00.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5754999999999999e-05 2024-04-26T11:14:00.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:00.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.822368+0000", 2024-04-26T11:14:00.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4658e-05 2024-04-26T11:14:00.823 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.823 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:00.823 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.823 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35482 5.b 5:d2b3ef95:::benchmark_data_smithi029_44842_object35481:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:14:00.823 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:14:00.823 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.388468417, 2024-04-26T11:14:00.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019390455000000001, 2024-04-26T11:14:00.823 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:00.824 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:00.824 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:00.824 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:00.824 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:00.824 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35482 2024-04-26T11:14:00.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.824 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:00.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:00.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:14:00.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:00.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:14:00.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:00.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418681+0000", 2024-04-26T11:14:00.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:00.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:00.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418802+0000", 2024-04-26T11:14:00.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120835 2024-04-26T11:14:00.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:00.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418810+0000", 2024-04-26T11:14:00.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1240000000000005e-06 2024-04-26T11:14:00.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:00.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418816+0000", 2024-04-26T11:14:00.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5749999999999997e-06 2024-04-26T11:14:00.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.419905+0000", 2024-04-26T11:14:00.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001088751 2024-04-26T11:14:00.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:00.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.420046+0000", 2024-04-26T11:14:00.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140514 2024-04-26T11:14:00.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:00.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.420180+0000", 2024-04-26T11:14:00.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440899999999999 2024-04-26T11:14:00.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:00.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425415+0000", 2024-04-26T11:14:00.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052350540000000003 2024-04-26T11:14:00.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:00.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.437989+0000", 2024-04-26T11:14:00.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012573632 2024-04-26T11:14:00.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:00.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.438035+0000", 2024-04-26T11:14:00.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5799e-05 2024-04-26T11:14:00.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:00.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.438072+0000", 2024-04-26T11:14:00.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7530999999999997e-05 2024-04-26T11:14:00.828 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.828 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:00.828 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.829 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35483 5.b 5:d3dd14f6:::benchmark_data_smithi029_44842_object35482:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:14:00.829 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:00.829 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.388325675000001, 2024-04-26T11:14:00.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021245969, 2024-04-26T11:14:00.829 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:00.829 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:00.829 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:00.829 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:00.829 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:00.829 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35483 2024-04-26T11:14:00.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.829 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:00.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:00.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:00.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:00.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:00.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:00.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:00.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:00.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:00.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418885+0000", 2024-04-26T11:14:00.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1294e-05 2024-04-26T11:14:00.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:00.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418892+0000", 2024-04-26T11:14:00.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4599999999999997e-06 2024-04-26T11:14:00.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:00.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418899+0000", 2024-04-26T11:14:00.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0909999999999998e-06 2024-04-26T11:14:00.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421347+0000", 2024-04-26T11:14:00.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024484609999999999 2024-04-26T11:14:00.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:00.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421468+0000", 2024-04-26T11:14:00.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000121179 2024-04-26T11:14:00.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:00.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421605+0000", 2024-04-26T11:14:00.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013672200000000001 2024-04-26T11:14:00.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:00.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425456+0000", 2024-04-26T11:14:00.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038511719999999999 2024-04-26T11:14:00.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:00.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.439986+0000", 2024-04-26T11:14:00.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014530080000000001 2024-04-26T11:14:00.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:00.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440038+0000", 2024-04-26T11:14:00.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1916999999999998e-05 2024-04-26T11:14:00.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:00.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440070+0000", 2024-04-26T11:14:00.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2245e-05 2024-04-26T11:14:00.835 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.835 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:00.835 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.835 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44504 5.0 5:0536d5a4:::benchmark_data_smithi029_44842_object44503:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:00.836 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:14:00.836 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.6378640529999995, 2024-04-26T11:14:00.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018576187000000001, 2024-04-26T11:14:00.836 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:00.837 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:00.837 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:00.837 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:00.837 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:00.837 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44504 2024-04-26T11:14:00.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.837 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:00.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:00.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:14:00.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:00.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:14:00.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:00.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:14:00.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:00.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:00.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169304+0000", 2024-04-26T11:14:00.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8331000000000001e-05 2024-04-26T11:14:00.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:00.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169308+0000", 2024-04-26T11:14:00.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9609999999999999e-06 2024-04-26T11:14:00.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:00.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169311+0000", 2024-04-26T11:14:00.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.044e-06 2024-04-26T11:14:00.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.174118+0000", 2024-04-26T11:14:00.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004806645 2024-04-26T11:14:00.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:00.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.174207+0000", 2024-04-26T11:14:00.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9665000000000003e-05 2024-04-26T11:14:00.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:00.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.174308+0000", 2024-04-26T11:14:00.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100399 2024-04-26T11:14:00.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:00.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.185001+0000", 2024-04-26T11:14:00.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010693599 2024-04-26T11:14:00.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:00.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187698+0000", 2024-04-26T11:14:00.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026970929999999998 2024-04-26T11:14:00.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:00.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187777+0000", 2024-04-26T11:14:00.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8335000000000001e-05 2024-04-26T11:14:00.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:00.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187862+0000", 2024-04-26T11:14:00.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5521999999999999e-05 2024-04-26T11:14:00.843 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.843 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:00.843 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.843 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44506 5.0 5:07ec7127:::benchmark_data_smithi029_44842_object44505:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:00.843 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:14:00.843 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.6375641339999998, 2024-04-26T11:14:00.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018482386999999999, 2024-04-26T11:14:00.844 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:00.844 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:00.844 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:00.844 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:00.844 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:00.844 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44506 2024-04-26T11:14:00.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.844 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:00.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:00.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:14:00.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:00.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:14:00.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:00.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:14:00.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:00.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:00.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169730+0000", 2024-04-26T11:14:00.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014447200000000001 2024-04-26T11:14:00.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:00.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169738+0000", 2024-04-26T11:14:00.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5700000000000004e-06 2024-04-26T11:14:00.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:00.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169741+0000", 2024-04-26T11:14:00.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3909999999999998e-06 2024-04-26T11:14:00.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.176682+0000", 2024-04-26T11:14:00.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0069412129999999999 2024-04-26T11:14:00.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:00.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.176816+0000", 2024-04-26T11:14:00.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000134265 2024-04-26T11:14:00.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:00.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.176952+0000", 2024-04-26T11:14:00.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013520000000000001 2024-04-26T11:14:00.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:00.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.185004+0000", 2024-04-26T11:14:00.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0080524959999999993 2024-04-26T11:14:00.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:00.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187983+0000", 2024-04-26T11:14:00.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0029783330000000001 2024-04-26T11:14:00.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:00.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188031+0000", 2024-04-26T11:14:00.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8588000000000003e-05 2024-04-26T11:14:00.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:00.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188068+0000", 2024-04-26T11:14:00.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7154999999999999e-05 2024-04-26T11:14:00.849 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.850 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:00.850 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.850 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44509 5.0 5:0828d2b6:::benchmark_data_smithi029_44842_object44508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:00.850 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.169815+0000", 2024-04-26T11:14:00.850 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.6373352889999992, 2024-04-26T11:14:00.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018410841000000001, 2024-04-26T11:14:00.850 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:00.850 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:00.850 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:00.850 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:00.850 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:00.851 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44509 2024-04-26T11:14:00.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.851 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:00.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:00.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169815+0000", 2024-04-26T11:14:00.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:00.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169815+0000", 2024-04-26T11:14:00.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:00.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169814+0000", 2024-04-26T11:14:00.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:00.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:00.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169921+0000", 2024-04-26T11:14:00.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107194 2024-04-26T11:14:00.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:00.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169927+0000", 2024-04-26T11:14:00.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.203e-06 2024-04-26T11:14:00.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:00.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169931+0000", 2024-04-26T11:14:00.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0829999999999997e-06 2024-04-26T11:14:00.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.179590+0000", 2024-04-26T11:14:00.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096589999999999992 2024-04-26T11:14:00.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:00.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.179718+0000", 2024-04-26T11:14:00.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012885699999999999 2024-04-26T11:14:00.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:00.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.179857+0000", 2024-04-26T11:14:00.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013884100000000001 2024-04-26T11:14:00.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:00.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188082+0000", 2024-04-26T11:14:00.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082250099999999996 2024-04-26T11:14:00.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:00.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188164+0000", 2024-04-26T11:14:00.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2123e-05 2024-04-26T11:14:00.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:00.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188197+0000", 2024-04-26T11:14:00.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2471000000000001e-05 2024-04-26T11:14:00.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:00.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188226+0000", 2024-04-26T11:14:00.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8609999999999999e-05 2024-04-26T11:14:00.856 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.856 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:00.856 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.857 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44513 5.0 5:0a236ebb:::benchmark_data_smithi029_44842_object44512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:00.857 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:00.857 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.6370626950000009, 2024-04-26T11:14:00.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020724414, 2024-04-26T11:14:00.857 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:00.857 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:00.857 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:00.857 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:00.857 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:00.857 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44513 2024-04-26T11:14:00.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.857 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:00.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:00.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:00.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:00.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:00.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:00.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:00.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:00.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:00.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170120+0000", 2024-04-26T11:14:00.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2941000000000002e-05 2024-04-26T11:14:00.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:00.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170127+0000", 2024-04-26T11:14:00.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.469e-06 2024-04-26T11:14:00.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:00.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170133+0000", 2024-04-26T11:14:00.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1340000000000001e-06 2024-04-26T11:14:00.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182383+0000", 2024-04-26T11:14:00.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012249970000000001 2024-04-26T11:14:00.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:00.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182477+0000", 2024-04-26T11:14:00.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3776999999999993e-05 2024-04-26T11:14:00.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:00.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182572+0000", 2024-04-26T11:14:00.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4841999999999998e-05 2024-04-26T11:14:00.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:00.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188262+0000", 2024-04-26T11:14:00.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005690077 2024-04-26T11:14:00.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:00.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190748+0000", 2024-04-26T11:14:00.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024857780000000001 2024-04-26T11:14:00.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:00.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190776+0000", 2024-04-26T11:14:00.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8419999999999999e-05 2024-04-26T11:14:00.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:00.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190812+0000", 2024-04-26T11:14:00.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5630999999999998e-05 2024-04-26T11:14:00.863 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.863 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:00.863 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.864 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44794 5.8 5:158fd219:::benchmark_data_smithi029_44842_object44793:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:00.864 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.283382+0000", 2024-04-26T11:14:00.864 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.5237681179999996, 2024-04-26T11:14:00.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018701497000000001, 2024-04-26T11:14:00.864 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:00.864 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:00.864 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:00.864 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:00.864 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:00.864 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44794 2024-04-26T11:14:00.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.864 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:00.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:00.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283382+0000", 2024-04-26T11:14:00.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:00.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283382+0000", 2024-04-26T11:14:00.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:00.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283381+0000", 2024-04-26T11:14:00.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:00.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:00.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283409+0000", 2024-04-26T11:14:00.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.798e-05 2024-04-26T11:14:00.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:00.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283417+0000", 2024-04-26T11:14:00.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2629999999999997e-06 2024-04-26T11:14:00.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:00.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283424+0000", 2024-04-26T11:14:00.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1210000000000001e-06 2024-04-26T11:14:00.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.286843+0000", 2024-04-26T11:14:00.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034194490000000002 2024-04-26T11:14:00.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:00.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.286932+0000", 2024-04-26T11:14:00.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9065000000000002e-05 2024-04-26T11:14:00.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:00.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.287019+0000", 2024-04-26T11:14:00.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6976000000000002e-05 2024-04-26T11:14:00.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:00.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.288238+0000", 2024-04-26T11:14:00.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012185 2024-04-26T11:14:00.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:00.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.302032+0000", 2024-04-26T11:14:00.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013794618999999999 2024-04-26T11:14:00.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:00.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.302061+0000", 2024-04-26T11:14:00.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9008000000000001e-05 2024-04-26T11:14:00.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:00.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.302083+0000", 2024-04-26T11:14:00.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2002e-05 2024-04-26T11:14:00.870 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.870 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:00.870 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.870 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:00.871 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:00.871 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.5283596729999998, 2024-04-26T11:14:00.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:14:00.871 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:00.871 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:00.871 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:00.871 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:00.871 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:00.871 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:14:00.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.871 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:00.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:00.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:00.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:00.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:00.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:00.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:00.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:00.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:00.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:14:00.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:14:00.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:00.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:14:00.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:14:00.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:00.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:14:00.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:14:00.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:14:00.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:14:00.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:00.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:14:00.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:14:00.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:00.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:14:00.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:14:00.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:00.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:14:00.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:14:00.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:00.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:14:00.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:14:00.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:00.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:14:00.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:14:00.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:00.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:14:00.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:14:00.876 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.876 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:00.877 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.877 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:00.877 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:00.877 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.5277099710000002, 2024-04-26T11:14:00.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:14:00.877 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:00.877 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:00.877 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:00.878 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:00.878 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:00.878 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:14:00.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.878 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:00.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:00.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:00.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:00.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:00.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:00.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:14:00.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:00.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:00.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:14:00.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:14:00.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:00.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:14:00.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:14:00.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:00.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:14:00.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:14:00.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:14:00.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:14:00.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:00.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:14:00.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:14:00.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:00.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:14:00.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:14:00.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:00.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:14:00.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:14:00.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:00.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:14:00.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:14:00.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:00.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:14:00.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:14:00.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:00.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:14:00.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:14:00.882 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.882 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:00.882 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.883 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:55093 5.e 5:7ebffa9e:::benchmark_data_smithi029_44842_object55092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:00.883 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:14:00.883 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.0605782530000001, 2024-04-26T11:14:00.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020381660999999999, 2024-04-26T11:14:00.883 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:00.883 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:00.883 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:00.883 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:00.883 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:00.883 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 55093 2024-04-26T11:14:00.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.884 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:00.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:00.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:14:00.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:00.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:14:00.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:00.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746571+0000", 2024-04-26T11:14:00.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:00.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:00.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746599+0000", 2024-04-26T11:14:00.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8262000000000001e-05 2024-04-26T11:14:00.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:00.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746610+0000", 2024-04-26T11:14:00.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1070000000000001e-05 2024-04-26T11:14:00.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:00.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746617+0000", 2024-04-26T11:14:00.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8190000000000003e-06 2024-04-26T11:14:00.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748218+0000", 2024-04-26T11:14:00.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0016005889999999999 2024-04-26T11:14:00.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:00.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748350+0000", 2024-04-26T11:14:00.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132528 2024-04-26T11:14:00.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:00.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748499+0000", 2024-04-26T11:14:00.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014815600000000001 2024-04-26T11:14:00.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:00.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.750795+0000", 2024-04-26T11:14:00.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022960369999999999 2024-04-26T11:14:00.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:00.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766866+0000", 2024-04-26T11:14:00.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016071230999999998 2024-04-26T11:14:00.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:00.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766922+0000", 2024-04-26T11:14:00.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6643e-05 2024-04-26T11:14:00.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:00.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766953+0000", 2024-04-26T11:14:00.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0981e-05 2024-04-26T11:14:00.888 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.889 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:00.889 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.889 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:55738 5.4 5:2d90ff60:::benchmark_data_smithi029_44842_object55737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:00.889 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.026425+0000", 2024-04-26T11:14:00.889 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.7807247899999998, 2024-04-26T11:14:00.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018738008, 2024-04-26T11:14:00.889 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:00.889 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:00.889 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:00.889 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:00.889 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:00.889 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 55738 2024-04-26T11:14:00.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.890 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:00.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:00.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026425+0000", 2024-04-26T11:14:00.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:00.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026425+0000", 2024-04-26T11:14:00.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:00.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026425+0000", 2024-04-26T11:14:00.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:00.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:00.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026456+0000", 2024-04-26T11:14:00.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1312000000000001e-05 2024-04-26T11:14:00.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:00.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026463+0000", 2024-04-26T11:14:00.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2710000000000003e-06 2024-04-26T11:14:00.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:00.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026469+0000", 2024-04-26T11:14:00.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7389999999999996e-06 2024-04-26T11:14:00.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026561+0000", 2024-04-26T11:14:00.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2552000000000004e-05 2024-04-26T11:14:00.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:00.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026695+0000", 2024-04-26T11:14:00.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013394500000000001 2024-04-26T11:14:00.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:00.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026827+0000", 2024-04-26T11:14:00.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013146800000000001 2024-04-26T11:14:00.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:00.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.028905+0000", 2024-04-26T11:14:00.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020783749999999999 2024-04-26T11:14:00.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:00.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.045076+0000", 2024-04-26T11:14:00.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016170411999999999 2024-04-26T11:14:00.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:00.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.045130+0000", 2024-04-26T11:14:00.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4169000000000003e-05 2024-04-26T11:14:00.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:00.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.045163+0000", 2024-04-26T11:14:00.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3368999999999998e-05 2024-04-26T11:14:00.894 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.894 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:00.894 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.895 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:00.895 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:00.895 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.4610679320000002, 2024-04-26T11:14:00.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:14:00.895 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:00.895 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:00.895 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:00.895 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:00.895 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:00.895 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:14:00.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.896 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:00.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:00.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:00.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:00.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:00.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:00.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:14:00.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:00.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:00.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:14:00.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:14:00.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:00.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:14:00.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:14:00.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:00.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:14:00.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:14:00.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:14:00.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:14:00.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:00.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:14:00.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:14:00.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:14:00.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:14:00.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:00.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:14:00.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:14:00.899 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.899 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:00.899 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.899 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:00.899 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:00.900 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.4609722860000001, 2024-04-26T11:14:00.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:14:00.900 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:00.900 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:00.900 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:00.900 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:00.900 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:00.900 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:14:00.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.900 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:00.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:00.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:00.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:00.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:00.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:00.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:14:00.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:00.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:00.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:14:00.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:14:00.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:00.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:14:00.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:14:00.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:00.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:14:00.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:14:00.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:14:00.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:14:00.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:00.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:14:00.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:14:00.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:14:00.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:14:00.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:00.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:14:00.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:14:00.904 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.904 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:00.904 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.904 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:00.904 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:00.904 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.4608406070000002, 2024-04-26T11:14:00.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:14:00.905 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:00.905 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:00.905 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:00.905 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:00.905 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:00.905 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:14:00.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.905 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:00.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:00.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:00.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:00.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:00.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:00.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:00.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:00.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:00.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:14:00.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:14:00.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:00.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:14:00.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:14:00.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:00.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:14:00.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:14:00.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:14:00.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:14:00.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:00.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:14:00.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:14:00.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:14:00.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:14:00.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:00.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:14:00.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:14:00.909 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.909 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:00.909 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.909 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:00.910 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:00.910 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.4607321510000002, 2024-04-26T11:14:00.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:14:00.910 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:00.910 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:00.910 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:00.910 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:00.910 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:00.910 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:14:00.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.910 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:00.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:00.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:00.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:00.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:00.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:00.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:14:00.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:00.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:00.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:14:00.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:14:00.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:00.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:14:00.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:14:00.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:00.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:14:00.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:14:00.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:14:00.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:14:00.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:00.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:14:00.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:14:00.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:14:00.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:14:00.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:00.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:14:00.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:14:00.914 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.914 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:00.914 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.914 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:00.914 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:00.915 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.4606308829999999, 2024-04-26T11:14:00.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:14:00.915 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:00.915 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:00.915 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:00.915 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:00.915 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:00.915 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:14:00.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.916 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:00.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:00.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:00.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:00.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:00.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:00.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:00.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:00.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:00.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:14:00.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:14:00.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:00.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:14:00.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:14:00.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:00.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:14:00.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:14:00.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:14:00.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:14:00.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:00.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:14:00.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:14:00.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:14:00.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:14:00.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:00.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:14:00.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:14:00.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:00.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:14:00.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:14:00.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:00.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:14:00.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:14:00.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:00.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:14:00.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:14:00.920 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.921 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:00.921 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.921 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:00.921 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:00.921 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.460561942, 2024-04-26T11:14:00.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:14:00.921 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:00.921 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:00.921 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:00.921 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:00.921 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:00.922 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:14:00.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.922 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:00.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:00.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:00.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:00.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:00.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:00.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:14:00.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:00.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:00.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:14:00.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:14:00.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:00.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:14:00.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:14:00.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:00.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:14:00.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:14:00.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:14:00.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:14:00.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:00.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:14:00.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:14:00.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:14:00.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:14:00.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:00.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:14:00.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:14:00.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:00.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:14:00.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:14:00.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:00.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:14:00.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:14:00.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:00.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:14:00.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:14:00.926 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.926 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:00.927 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.927 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:00.927 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:00.927 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.4545663609999999, 2024-04-26T11:14:00.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:14:00.927 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:00.927 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:00.927 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:00.927 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:00.927 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:00.927 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:14:00.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.927 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:00.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:00.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:00.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:00.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:00.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:00.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:00.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:14:00.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:00.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:00.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:14:00.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:14:00.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:00.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:14:00.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:14:00.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:00.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:14:00.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:14:00.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:14:00.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:14:00.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:00.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:14:00.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:14:00.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:00.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:14:00.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:14:00.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:00.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:14:00.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:14:00.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:00.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:14:00.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:14:00.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:00.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:14:00.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:14:00.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:00.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:00.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:00.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:14:00.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:14:00.932 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.932 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:00.932 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.932 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:00.932 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:00.932 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:00.934 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:00.932+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:00.934 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:01.036 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:01.034+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:01.120 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:01.120 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:01.120 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.120 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:62728 5.2 5:491d2401:::benchmark_data_smithi029_44842_object62727:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:01.120 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:01.107347+0000", 2024-04-26T11:14:01.120 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.010282289999999999, 2024-04-26T11:14:01.120 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.010317155999999999, 2024-04-26T11:14:01.120 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.120 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:01.120 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.121 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.121 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.121 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 62728 2024-04-26T11:14:01.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.121 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.121 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.121 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.121 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.107347+0000", 2024-04-26T11:14:01.121 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.121 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.121 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.121 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.107347+0000", 2024-04-26T11:14:01.121 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.107346+0000", 2024-04-26T11:14:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.107423+0000", 2024-04-26T11:14:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7273000000000004e-05 2024-04-26T11:14:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.107431+0000", 2024-04-26T11:14:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0350000000000001e-06 2024-04-26T11:14:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.107438+0000", 2024-04-26T11:14:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2049999999999999e-06 2024-04-26T11:14:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.109906+0000", 2024-04-26T11:14:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0024682430000000002 2024-04-26T11:14:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.110027+0000", 2024-04-26T11:14:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012087999999999999 2024-04-26T11:14:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:62733 5.2 5:47f2cb4b:::benchmark_data_smithi029_44842_object62732:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:01.107558+0000", 2024-04-26T11:14:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.010070768000000001, 2024-04-26T11:14:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.010184343, 2024-04-26T11:14:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 62733 2024-04-26T11:14:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.107558+0000", 2024-04-26T11:14:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.107558+0000", 2024-04-26T11:14:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.107558+0000", 2024-04-26T11:14:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.107681+0000", 2024-04-26T11:14:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012320000000000001 2024-04-26T11:14:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.107689+0000", 2024-04-26T11:14:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.79e-06 2024-04-26T11:14:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.107695+0000", 2024-04-26T11:14:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7479999999999996e-06 2024-04-26T11:14:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113197+0000", 2024-04-26T11:14:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0055019819999999999 2024-04-26T11:14:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113337+0000", 2024-04-26T11:14:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013972100000000001 2024-04-26T11:14:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:62734 5.a 5:555d5769:::benchmark_data_smithi029_44842_object62733:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:01.107891+0000", 2024-04-26T11:14:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0097376010000000002, 2024-04-26T11:14:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0099210900000000005, 2024-04-26T11:14:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 62734 2024-04-26T11:14:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.107891+0000", 2024-04-26T11:14:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.107891+0000", 2024-04-26T11:14:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.107891+0000", 2024-04-26T11:14:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.109481+0000", 2024-04-26T11:14:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0015903759999999999 2024-04-26T11:14:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.109493+0000", 2024-04-26T11:14:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1711e-05 2024-04-26T11:14:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.109500+0000", 2024-04-26T11:14:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2099999999999996e-06 2024-04-26T11:14:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.111753+0000", 2024-04-26T11:14:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002253335 2024-04-26T11:14:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.111843+0000", 2024-04-26T11:14:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9606999999999998e-05 2024-04-26T11:14:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:14:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.111970+0000", 2024-04-26T11:14:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012695100000000001 2024-04-26T11:14:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.115565+0000", 2024-04-26T11:14:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0035954350000000001 2024-04-26T11:14:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:62742 5.7 5:ef142362:::benchmark_data_smithi029_44842_object62741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:01.113465+0000", 2024-04-26T11:14:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0041643339999999996, 2024-04-26T11:14:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0044313219999999997, 2024-04-26T11:14:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 62742 2024-04-26T11:14:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113465+0000", 2024-04-26T11:14:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113465+0000", 2024-04-26T11:14:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113464+0000", 2024-04-26T11:14:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113548+0000", 2024-04-26T11:14:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3895999999999998e-05 2024-04-26T11:14:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113558+0000", 2024-04-26T11:14:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.06e-05 2024-04-26T11:14:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113569+0000", 2024-04-26T11:14:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0648e-05 2024-04-26T11:14:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113616+0000", 2024-04-26T11:14:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6561999999999999e-05 2024-04-26T11:14:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113732+0000", 2024-04-26T11:14:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011666400000000001 2024-04-26T11:14:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.117842+0000", 2024-04-26T11:14:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0041096509999999998 2024-04-26T11:14:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.117891+0000", 2024-04-26T11:14:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8636e-05 2024-04-26T11:14:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:62743 5.a 5:5087eafd:::benchmark_data_smithi029_44842_object62742:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:01.113581+0000", 2024-04-26T11:14:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0040477159999999998, 2024-04-26T11:14:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0044087350000000004, 2024-04-26T11:14:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 62743 2024-04-26T11:14:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113581+0000", 2024-04-26T11:14:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113581+0000", 2024-04-26T11:14:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113581+0000", 2024-04-26T11:14:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113608+0000", 2024-04-26T11:14:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7146999999999999e-05 2024-04-26T11:14:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113616+0000", 2024-04-26T11:14:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7419999999999997e-06 2024-04-26T11:14:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113622+0000", 2024-04-26T11:14:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.139e-06 2024-04-26T11:14:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.115579+0000", 2024-04-26T11:14:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019574990000000001 2024-04-26T11:14:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.115694+0000", 2024-04-26T11:14:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000115037 2024-04-26T11:14:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:14:01.141 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.115843+0000", 2024-04-26T11:14:01.141 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000148364 2024-04-26T11:14:01.141 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.141 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.141 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.141 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.141 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:62740 5.e e28/16 5:712d6902:::benchmark_data_smithi029_44842_object62739:head v 28'3902, mlcod=28'3900)", 2024-04-26T11:14:01.141 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:01.113640+0000", 2024-04-26T11:14:01.141 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0039887730000000001, 2024-04-26T11:14:01.141 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.004433551, 2024-04-26T11:14:01.141 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.141 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:01.141 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.141 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.142 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.142 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113640+0000", 2024-04-26T11:14:01.142 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.142 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.142 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.142 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113640+0000", 2024-04-26T11:14:01.142 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.142 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.142 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.142 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113640+0000", 2024-04-26T11:14:01.142 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.142 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113666+0000", 2024-04-26T11:14:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6764e-05 2024-04-26T11:14:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113673+0000", 2024-04-26T11:14:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9330000000000004e-06 2024-04-26T11:14:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113679+0000", 2024-04-26T11:14:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4879999999999998e-06 2024-04-26T11:14:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113711+0000", 2024-04-26T11:14:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2140000000000001e-05 2024-04-26T11:14:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113728+0000", 2024-04-26T11:14:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7088999999999999e-05 2024-04-26T11:14:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:62741 5.8 e28/16 5:1878f243:::benchmark_data_smithi029_44842_object62740:head v 28'3955, mlcod=28'3953)", 2024-04-26T11:14:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:01.113824+0000", 2024-04-26T11:14:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0038055089999999999, 2024-04-26T11:14:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0043213339999999996, 2024-04-26T11:14:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113824+0000", 2024-04-26T11:14:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113824+0000", 2024-04-26T11:14:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.146 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.146 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113823+0000", 2024-04-26T11:14:01.146 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.146 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.146 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.146 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.146 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113885+0000", 2024-04-26T11:14:01.146 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1993000000000001e-05 2024-04-26T11:14:01.146 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.146 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.146 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.146 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113891+0000", 2024-04-26T11:14:01.146 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9190000000000004e-06 2024-04-26T11:14:01.146 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.147 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.147 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.147 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113895+0000", 2024-04-26T11:14:01.147 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8959999999999996e-06 2024-04-26T11:14:01.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.147 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.147 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.147 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113932+0000", 2024-04-26T11:14:01.147 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6906999999999997e-05 2024-04-26T11:14:01.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.147 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.148 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.148 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.113943+0000", 2024-04-26T11:14:01.148 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.167e-05 2024-04-26T11:14:01.148 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.148 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.148 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.148 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.148 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:62746 5.3 5:cab5ea4c:::benchmark_data_smithi029_44842_object62745:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:01.148 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:01.114014+0000", 2024-04-26T11:14:01.148 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0036150280000000002, 2024-04-26T11:14:01.149 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042166019999999999, 2024-04-26T11:14:01.149 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.149 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:01.149 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.149 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.149 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.149 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 62746 2024-04-26T11:14:01.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.149 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.149 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.149 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.149 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.114014+0000", 2024-04-26T11:14:01.149 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.150 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.150 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.150 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.114014+0000", 2024-04-26T11:14:01.150 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.150 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.150 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.150 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.114013+0000", 2024-04-26T11:14:01.150 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:01.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.150 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.150 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.150 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.114078+0000", 2024-04-26T11:14:01.150 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4795999999999994e-05 2024-04-26T11:14:01.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.151 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.151 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.151 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.114087+0000", 2024-04-26T11:14:01.151 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3049999999999998e-06 2024-04-26T11:14:01.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.151 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.151 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.151 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.114094+0000", 2024-04-26T11:14:01.151 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5200000000000003e-06 2024-04-26T11:14:01.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.151 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.151 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.151 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.114491+0000", 2024-04-26T11:14:01.151 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000396993 2024-04-26T11:14:01.152 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.152 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.152 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.152 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.114601+0000", 2024-04-26T11:14:01.152 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000110058 2024-04-26T11:14:01.152 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.152 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.152 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.152 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.152 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.152 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:62747 5.2 5:487cf966:::benchmark_data_smithi029_44842_object62746:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:01.152 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:01.114475+0000", 2024-04-26T11:14:01.152 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0031539810000000001, 2024-04-26T11:14:01.152 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0038162209999999998, 2024-04-26T11:14:01.152 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.153 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:01.153 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.153 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.153 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.153 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 62747 2024-04-26T11:14:01.153 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.153 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.153 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.153 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.153 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.114475+0000", 2024-04-26T11:14:01.153 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.153 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.153 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.153 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.153 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.114475+0000", 2024-04-26T11:14:01.154 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.154 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.154 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.154 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.114474+0000", 2024-04-26T11:14:01.154 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.154 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.154 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.154 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.114499+0000", 2024-04-26T11:14:01.154 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4873999999999999e-05 2024-04-26T11:14:01.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.154 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.154 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.155 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.114507+0000", 2024-04-26T11:14:01.155 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.1699999999999997e-06 2024-04-26T11:14:01.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.155 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.155 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.155 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.114513+0000", 2024-04-26T11:14:01.155 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8039999999999998e-06 2024-04-26T11:14:01.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.155 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.155 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.155 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.115938+0000", 2024-04-26T11:14:01.155 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001424816 2024-04-26T11:14:01.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.155 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.155 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.156 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.116132+0000", 2024-04-26T11:14:01.156 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000193878 2024-04-26T11:14:01.156 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.156 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.156 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.156 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.156 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:62748 5.2 5:47135344:::benchmark_data_smithi029_44842_object62747:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:01.156 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:01.114781+0000", 2024-04-26T11:14:01.156 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0028480129999999999, 2024-04-26T11:14:01.156 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0035529450000000001, 2024-04-26T11:14:01.156 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.156 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:01.156 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.156 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.156 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.157 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 62748 2024-04-26T11:14:01.157 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.157 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.157 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.157 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.157 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.114781+0000", 2024-04-26T11:14:01.157 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.157 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.157 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.157 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.157 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.114781+0000", 2024-04-26T11:14:01.157 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.157 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.157 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.157 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.158 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.114780+0000", 2024-04-26T11:14:01.158 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.158 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.158 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.158 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.158 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.114870+0000", 2024-04-26T11:14:01.158 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9386000000000001e-05 2024-04-26T11:14:01.158 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.158 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.158 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.158 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.114877+0000", 2024-04-26T11:14:01.158 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6279999999999996e-06 2024-04-26T11:14:01.158 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.158 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.158 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.159 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.114883+0000", 2024-04-26T11:14:01.159 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8989999999999998e-06 2024-04-26T11:14:01.159 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.159 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.159 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.159 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.118112+0000", 2024-04-26T11:14:01.159 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0032289279999999998 2024-04-26T11:14:01.159 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.159 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.159 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.159 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.118234+0000", 2024-04-26T11:14:01.159 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012179400000000001 2024-04-26T11:14:01.159 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.159 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.160 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.160 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.160 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.160 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:62751 5.1 5:8d85691e:::benchmark_data_smithi029_44842_object62750:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:01.160 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:01.115805+0000", 2024-04-26T11:14:01.160 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.001824032, 2024-04-26T11:14:01.160 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0025807709999999999, 2024-04-26T11:14:01.160 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.160 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:01.160 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.160 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.160 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.160 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 62751 2024-04-26T11:14:01.160 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.160 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.161 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.161 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.161 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.115805+0000", 2024-04-26T11:14:01.161 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.161 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.161 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.161 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.115805+0000", 2024-04-26T11:14:01.161 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.161 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.161 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.161 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.115804+0000", 2024-04-26T11:14:01.161 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.162 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.162 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.162 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.115896+0000", 2024-04-26T11:14:01.162 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2052000000000006e-05 2024-04-26T11:14:01.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.162 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.162 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.162 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.115903+0000", 2024-04-26T11:14:01.162 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9709999999999998e-06 2024-04-26T11:14:01.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.162 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.162 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.162 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.115908+0000", 2024-04-26T11:14:01.162 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.9130000000000002e-06 2024-04-26T11:14:01.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.163 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.163 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.163 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.115936+0000", 2024-04-26T11:14:01.163 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7534000000000001e-05 2024-04-26T11:14:01.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.163 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.163 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.163 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.116025+0000", 2024-04-26T11:14:01.163 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9555000000000006e-05 2024-04-26T11:14:01.163 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.163 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.163 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.163 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.163 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:62749 5.4 e28/16 5:288d3f55:::benchmark_data_smithi029_44842_object62748:head v 28'3895, mlcod=28'3893)", 2024-04-26T11:14:01.164 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:01.115918+0000", 2024-04-26T11:14:01.164 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0017106619999999999, 2024-04-26T11:14:01.164 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0025090519999999999, 2024-04-26T11:14:01.164 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.164 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:01.164 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.164 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.164 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.164 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.115918+0000", 2024-04-26T11:14:01.164 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.164 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.164 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.164 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.115918+0000", 2024-04-26T11:14:01.164 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.165 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.165 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.165 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.115911+0000", 2024-04-26T11:14:01.165 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999933 2024-04-26T11:14:01.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.165 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.165 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.165 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.115987+0000", 2024-04-26T11:14:01.165 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5048000000000004e-05 2024-04-26T11:14:01.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.165 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.165 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.165 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.115996+0000", 2024-04-26T11:14:01.165 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.8490000000000001e-06 2024-04-26T11:14:01.166 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.166 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.166 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.166 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.116003+0000", 2024-04-26T11:14:01.166 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.686e-06 2024-04-26T11:14:01.166 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.166 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.166 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.166 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.116039+0000", 2024-04-26T11:14:01.166 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5694000000000001e-05 2024-04-26T11:14:01.166 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.166 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.166 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.166 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.116057+0000", 2024-04-26T11:14:01.166 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8028000000000001e-05 2024-04-26T11:14:01.167 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.167 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.167 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.167 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.167 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.167 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:62745 5.8 e28/16 5:16f0adca:::benchmark_data_smithi029_44842_object62744:head v 28'3956, mlcod=28'3953)", 2024-04-26T11:14:01.167 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:01.116019+0000", 2024-04-26T11:14:01.167 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0016095440000000001, 2024-04-26T11:14:01.167 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0024579490000000001, 2024-04-26T11:14:01.167 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.167 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:01.167 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.167 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.168 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.168 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.116019+0000", 2024-04-26T11:14:01.168 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.168 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.168 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.168 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.168 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.116019+0000", 2024-04-26T11:14:01.168 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.168 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.168 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.168 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.168 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.116019+0000", 2024-04-26T11:14:01.168 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.168 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.168 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.168 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.169 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.116065+0000", 2024-04-26T11:14:01.169 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5677000000000003e-05 2024-04-26T11:14:01.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.169 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.169 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.169 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.116081+0000", 2024-04-26T11:14:01.169 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5968e-05 2024-04-26T11:14:01.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.169 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.169 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.169 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.116086+0000", 2024-04-26T11:14:01.169 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2599999999999996e-06 2024-04-26T11:14:01.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.169 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.169 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.170 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.116129+0000", 2024-04-26T11:14:01.170 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.3371999999999997e-05 2024-04-26T11:14:01.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.170 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.170 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.170 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.116149+0000", 2024-04-26T11:14:01.170 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9261000000000001e-05 2024-04-26T11:14:01.170 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.170 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.170 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.170 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.170 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:62750 5.0 e28/16 5:091bd7d6:::benchmark_data_smithi029_44842_object62749:head v 28'3976, mlcod=28'3974)", 2024-04-26T11:14:01.170 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:01.117964+0000", 2024-04-26T11:14:01.170 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9996648, 2024-04-26T11:14:01.171 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00055254100000000003, 2024-04-26T11:14:01.171 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.171 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:01.171 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.171 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.171 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.171 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.117964+0000", 2024-04-26T11:14:01.171 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.171 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.171 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.171 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.117964+0000", 2024-04-26T11:14:01.171 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.171 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.172 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.172 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.117964+0000", 2024-04-26T11:14:01.172 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.172 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.172 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.172 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.172 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.117992+0000", 2024-04-26T11:14:01.172 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8459e-05 2024-04-26T11:14:01.172 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.172 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.172 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.172 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.118002+0000", 2024-04-26T11:14:01.172 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.8779999999999993e-06 2024-04-26T11:14:01.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.173 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.173 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.173 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.118009+0000", 2024-04-26T11:14:01.173 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0500000000000003e-06 2024-04-26T11:14:01.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.173 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.173 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.173 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.118040+0000", 2024-04-26T11:14:01.173 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0778999999999998e-05 2024-04-26T11:14:01.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.173 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.173 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.174 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.118052+0000", 2024-04-26T11:14:01.174 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2082999999999999e-05 2024-04-26T11:14:01.174 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.174 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.174 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.174 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.174 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:14:01.174 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 14 2024-04-26T11:14:01.174 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:01.175 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:01.173+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:01.176 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:01.276 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:01.275+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:01.377 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:01.376+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:01.402 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:01.403 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:14:01.403 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:14:01.403 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:14:01.403 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:01.412 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 23 16 63412 63396 172.257 143.625 0.00667211 0.00580197 2024-04-26T11:14:01.418 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:01.478 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:01.477+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:01.579 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:01.577+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:01.655 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:01.655 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:14:01.655 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:14:01.655 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:01.655 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.655 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:33827 5.3 5:c927f878:::benchmark_data_smithi029_44842_object33826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:14:01.655 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:47.804106+0000", 2024-04-26T11:14:01.655 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 13.846648223999999, 2024-04-26T11:14:01.655 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.017369738999999999, 2024-04-26T11:14:01.655 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.656 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:01.656 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.656 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.656 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.656 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 33827 2024-04-26T11:14:01.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.656 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.656 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.656 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804106+0000", 2024-04-26T11:14:01.656 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.658 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804106+0000", 2024-04-26T11:14:01.658 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.658 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804105+0000", 2024-04-26T11:14:01.658 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.659 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.659 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804138+0000", 2024-04-26T11:14:01.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3172e-05 2024-04-26T11:14:01.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.659 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.659 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804146+0000", 2024-04-26T11:14:01.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.204e-06 2024-04-26T11:14:01.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.659 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.659 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.804153+0000", 2024-04-26T11:14:01.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0940000000000002e-06 2024-04-26T11:14:01.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.660 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.660 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812034+0000", 2024-04-26T11:14:01.660 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0078809210000000008 2024-04-26T11:14:01.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.660 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.660 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.660 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812181+0000", 2024-04-26T11:14:01.660 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014739199999999999 2024-04-26T11:14:01.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.660 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.660 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:01.660 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.812284+0000", 2024-04-26T11:14:01.660 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000103453 2024-04-26T11:14:01.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.661 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.661 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:01.661 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.814699+0000", 2024-04-26T11:14:01.661 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002415043 2024-04-26T11:14:01.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.661 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.661 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:01.661 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.821418+0000", 2024-04-26T11:14:01.661 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0067184879999999999 2024-04-26T11:14:01.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.661 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.661 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:01.661 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.821449+0000", 2024-04-26T11:14:01.661 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0763999999999999e-05 2024-04-26T11:14:01.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.662 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:01.662 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:47.821476+0000", 2024-04-26T11:14:01.662 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6889999999999998e-05 2024-04-26T11:14:01.662 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.662 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.662 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.662 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:35483 5.b e23/16 5:d3dd14f6:::benchmark_data_smithi029_44842_object35482:head v 23'2304, mlcod=23'2300)", 2024-04-26T11:14:01.662 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:48.422102+0000", 2024-04-26T11:14:01.662 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 13.228652291, 2024-04-26T11:14:01.662 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.017674038, 2024-04-26T11:14:01.663 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.663 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:01.663 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.663 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.663 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422102+0000", 2024-04-26T11:14:01.663 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.663 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.663 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422102+0000", 2024-04-26T11:14:01.663 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.663 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.664 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422101+0000", 2024-04-26T11:14:01.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.664 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.664 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422129+0000", 2024-04-26T11:14:01.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8277999999999999e-05 2024-04-26T11:14:01.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.664 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.664 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422139+0000", 2024-04-26T11:14:01.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1290000000000002e-06 2024-04-26T11:14:01.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.665 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.665 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422145+0000", 2024-04-26T11:14:01.665 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7490000000000001e-06 2024-04-26T11:14:01.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.665 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.665 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423217+0000", 2024-04-26T11:14:01.665 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0010718539999999999 2024-04-26T11:14:01.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.665 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.665 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423234+0000", 2024-04-26T11:14:01.665 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6602000000000001e-05 2024-04-26T11:14:01.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.666 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.666 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:01.666 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439742+0000", 2024-04-26T11:14:01.666 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016508061000000001 2024-04-26T11:14:01.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.666 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.666 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:01.667 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439776+0000", 2024-04-26T11:14:01.667 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3992000000000003e-05 2024-04-26T11:14:01.667 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.667 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.667 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.667 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.667 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:46902 5.6 5:6f103941:::benchmark_data_smithi029_44842_object46901:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:01.667 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.120845+0000", 2024-04-26T11:14:01.667 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.52990928, 2024-04-26T11:14:01.667 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018538669000000001, 2024-04-26T11:14:01.667 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.667 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:01.667 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.667 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.668 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.668 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 46902 2024-04-26T11:14:01.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.668 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.668 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.668 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120845+0000", 2024-04-26T11:14:01.668 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120845+0000", 2024-04-26T11:14:01.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120844+0000", 2024-04-26T11:14:01.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120870+0000", 2024-04-26T11:14:01.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5678e-05 2024-04-26T11:14:01.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.670 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.670 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120874+0000", 2024-04-26T11:14:01.670 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.3189999999999996e-06 2024-04-26T11:14:01.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.670 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.670 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120878+0000", 2024-04-26T11:14:01.670 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4240000000000002e-06 2024-04-26T11:14:01.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.671 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.671 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.126176+0000", 2024-04-26T11:14:01.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0052983630000000004 2024-04-26T11:14:01.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.671 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.671 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.126300+0000", 2024-04-26T11:14:01.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012375099999999999 2024-04-26T11:14:01.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.671 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:01.671 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.126426+0000", 2024-04-26T11:14:01.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012646399999999999 2024-04-26T11:14:01.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:01.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.132371+0000", 2024-04-26T11:14:01.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0059443839999999996 2024-04-26T11:14:01.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:01.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.139296+0000", 2024-04-26T11:14:01.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069250320000000002 2024-04-26T11:14:01.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:01.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.139347+0000", 2024-04-26T11:14:01.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0954e-05 2024-04-26T11:14:01.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:01.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.139383+0000", 2024-04-26T11:14:01.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6862e-05 2024-04-26T11:14:01.673 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.673 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.673 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.673 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:01.673 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:01.673 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.3800072480000001, 2024-04-26T11:14:01.674 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:14:01.674 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.674 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:01.674 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.674 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.674 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.674 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:14:01.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.675 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.675 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.675 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:01.675 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.675 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.675 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:01.675 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.675 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.675 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:14:01.675 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.676 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.676 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:14:01.676 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:14:01.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.676 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.677 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:14:01.677 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:14:01.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.677 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.677 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:14:01.677 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:14:01.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.677 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.677 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:14:01.677 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:14:01.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.678 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:14:01.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:14:01.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.678 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:01.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:14:01.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:14:01.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.678 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:01.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:14:01.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:14:01.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.679 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:01.679 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:14:01.679 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:14:01.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.679 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:01.679 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:14:01.679 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:14:01.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.679 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:01.679 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:14:01.679 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:14:01.680 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.680 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.680 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.680 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:01.680 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:01.680 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.3791956830000007, 2024-04-26T11:14:01.680 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:14:01.680 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.680 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:01.680 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.680 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.680 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.680 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:14:01.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.681 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.681 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.681 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.681 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:01.681 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.681 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.681 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.681 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:01.681 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.681 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.681 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.681 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:01.682 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:01.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.682 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.682 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:14:01.682 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:14:01.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.682 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.682 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:14:01.682 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:14:01.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.682 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.683 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:14:01.683 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:14:01.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.683 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.683 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.683 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:14:01.683 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:14:01.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.683 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.683 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.683 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:14:01.683 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:14:01.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.683 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.683 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:01.684 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:14:01.684 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:14:01.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.684 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:01.684 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:14:01.684 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:14:01.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.684 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:01.684 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:14:01.684 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:14:01.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.684 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:01.685 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:14:01.685 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:14:01.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.685 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.685 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:01.685 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:14:01.685 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:14:01.685 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.685 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.685 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.686 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.686 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:01.686 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:01.686 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.3720088459999999, 2024-04-26T11:14:01.686 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:14:01.686 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.686 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:01.686 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.686 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.686 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.686 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:14:01.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.687 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.687 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.687 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:01.687 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.688 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.688 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:01.688 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.688 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.688 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:14:01.688 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:01.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.688 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.688 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:14:01.688 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:14:01.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.689 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.689 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:14:01.689 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:14:01.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.689 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.689 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:14:01.689 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:14:01.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.689 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.689 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:14:01.689 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:14:01.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.690 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.690 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.690 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:14:01.690 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:14:01.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.690 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.690 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:01.690 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:14:01.690 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:14:01.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.690 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.690 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:01.690 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:14:01.691 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:14:01.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.691 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:01.691 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:14:01.691 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:14:01.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.691 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:01.691 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:14:01.691 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:14:01.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.691 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:01.691 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:14:01.692 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:14:01.692 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.692 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.692 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.692 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:01.692 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:01.692 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.3714679669999992, 2024-04-26T11:14:01.692 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:14:01.692 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.692 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:01.692 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.692 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.693 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.693 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:14:01.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.693 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.693 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.693 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:01.693 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.693 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.693 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:01.693 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.694 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.694 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:01.694 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.694 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.694 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:14:01.694 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:14:01.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.695 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.695 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:14:01.695 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:14:01.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.695 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.695 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:14:01.695 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:14:01.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.695 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.695 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:14:01.695 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:14:01.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.696 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.696 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:14:01.696 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:14:01.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.696 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:01.696 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:14:01.696 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:14:01.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.696 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:01.696 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:14:01.696 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:14:01.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.697 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:01.697 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:14:01.697 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:14:01.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.697 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:01.697 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:14:01.697 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:14:01.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.697 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:01.697 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:14:01.697 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:14:01.698 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.698 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.698 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.698 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.698 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:55119 5.6 5:6ad50111:::benchmark_data_smithi029_44842_object55118:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:01.698 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:01.698 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.8904043130000003, 2024-04-26T11:14:01.698 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018830264999999999, 2024-04-26T11:14:01.698 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.698 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:01.698 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.698 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.698 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.699 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 55119 2024-04-26T11:14:01.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.701 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.702 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.702 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:01.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.702 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.702 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:01.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.702 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.702 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760349+0000", 2024-04-26T11:14:01.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:01.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760402+0000", 2024-04-26T11:14:01.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2695999999999998e-05 2024-04-26T11:14:01.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760411+0000", 2024-04-26T11:14:01.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.0589999999999992e-06 2024-04-26T11:14:01.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760416+0000", 2024-04-26T11:14:01.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.587e-06 2024-04-26T11:14:01.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767638+0000", 2024-04-26T11:14:01.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0072214050000000002 2024-04-26T11:14:01.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767760+0000", 2024-04-26T11:14:01.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000122067 2024-04-26T11:14:01.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:01.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767927+0000", 2024-04-26T11:14:01.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00016747999999999999 2024-04-26T11:14:01.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:01.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.770877+0000", 2024-04-26T11:14:01.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002949335 2024-04-26T11:14:01.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:01.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779130+0000", 2024-04-26T11:14:01.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.008253491 2024-04-26T11:14:01.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:01.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779158+0000", 2024-04-26T11:14:01.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7849000000000001e-05 2024-04-26T11:14:01.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:01.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779180+0000", 2024-04-26T11:14:01.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2048999999999998e-05 2024-04-26T11:14:01.706 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.706 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.706 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.706 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:01.706 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:01.707 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.3282835200000003, 2024-04-26T11:14:01.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:14:01.707 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.707 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:01.707 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.707 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.707 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.707 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:14:01.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.707 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:01.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:01.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:14:01.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:01.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:14:01.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:14:01.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:14:01.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:14:01.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:14:01.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:14:01.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:14:01.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:14:01.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:14:01.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:14:01.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:01.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:14:01.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:14:01.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:01.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:14:01.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:14:01.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.711 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.711 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:14:01.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:14:01.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.711 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:01.711 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:14:01.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:14:01.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.711 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.711 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:14:01.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:14:01.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:01.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:14:01.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:14:01.712 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.712 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.712 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.712 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:01.712 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:01.712 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.3260901799999996, 2024-04-26T11:14:01.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:14:01.713 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.713 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:01.713 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.713 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.713 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.713 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:14:01.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.713 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:01.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:01.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:14:01.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:01.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:14:01.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:14:01.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:14:01.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:14:01.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:14:01.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:14:01.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:14:01.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:14:01.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.716 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:14:01.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:14:01.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.716 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:01.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:14:01.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:14:01.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.716 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:01.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:14:01.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:14:01.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:14:01.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:14:01.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:01.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:14:01.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:14:01.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:14:01.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:14:01.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:01.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:14:01.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:14:01.718 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.718 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.718 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.718 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:01.718 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:01.718 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.3208783559999997, 2024-04-26T11:14:01.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:14:01.718 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.719 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:01.719 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.719 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.719 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.719 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:14:01.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.719 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:01.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:01.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:14:01.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:01.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:14:01.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:14:01.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:14:01.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:14:01.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:14:01.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:14:01.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:14:01.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:14:01.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:14:01.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:14:01.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:01.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:14:01.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:14:01.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:01.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:14:01.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:14:01.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:14:01.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:14:01.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:01.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:14:01.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:14:01.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:14:01.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:14:01.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:01.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:14:01.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:14:01.724 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.724 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.724 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.725 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:01.725 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:01.725 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.3044296559999999, 2024-04-26T11:14:01.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:14:01.725 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.725 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:01.725 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.725 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.725 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.725 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:14:01.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.725 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.726 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:01.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.726 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:01.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.726 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:14:01.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:01.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:14:01.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:14:01.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:14:01.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:14:01.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:14:01.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:14:01.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:14:01.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:14:01.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:01.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:14:01.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:14:01.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:14:01.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:14:01.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:01.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:14:01.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:14:01.729 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.729 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.729 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.729 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:01.729 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:01.729 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.3027321509999998, 2024-04-26T11:14:01.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:14:01.730 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.730 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:01.730 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.730 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.730 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.730 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:14:01.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.730 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:01.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:01.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:14:01.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:01.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:14:01.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:14:01.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:14:01.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:14:01.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:14:01.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:14:01.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:14:01.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:14:01.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:01.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:14:01.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:14:01.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:14:01.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:14:01.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:01.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:14:01.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:14:01.734 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.734 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.734 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.734 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:01.734 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:01.734 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.3026678489999997, 2024-04-26T11:14:01.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:14:01.734 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.735 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:01.735 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.735 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.735 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.735 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:14:01.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.735 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:01.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:01.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:01.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:14:01.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:14:01.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:14:01.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:14:01.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:14:01.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:14:01.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:14:01.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:14:01.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:01.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:14:01.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:14:01.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:14:01.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:14:01.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:14:01.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:14:01.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:01.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:14:01.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:14:01.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:01.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:14:01.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:14:01.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:01.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:14:01.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:14:01.740 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.740 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.740 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.740 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:01.740 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:01.740 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.3026136250000002, 2024-04-26T11:14:01.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:14:01.740 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.740 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:01.740 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.741 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.741 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.741 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:14:01.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.741 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:01.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:01.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:01.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:14:01.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:14:01.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:14:01.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:14:01.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:14:01.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:14:01.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:14:01.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:14:01.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:01.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:14:01.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:14:01.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:14:01.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:14:01.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:14:01.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:14:01.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:01.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:14:01.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:14:01.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:01.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:14:01.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:01.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:01.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:14:01.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:14:01.745 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.745 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.746 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.746 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:01.746 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:01.746 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.3025691129999997, 2024-04-26T11:14:01.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:14:01.746 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.746 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:01.746 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.746 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.746 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.746 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:14:01.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.747 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.747 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.747 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:01.747 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.747 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.747 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:01.747 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.747 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:14:01.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:14:01.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:14:01.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:14:01.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:14:01.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:14:01.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:14:01.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:14:01.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:14:01.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:01.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:14:01.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:14:01.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:14:01.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:14:01.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:14:01.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:14:01.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:01.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:14:01.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:14:01.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:01.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:14:01.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:14:01.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:01.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:14:01.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:14:01.751 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.751 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.752 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.752 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:01.752 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:01.752 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.2983481110000001, 2024-04-26T11:14:01.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:14:01.752 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.752 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:01.752 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.752 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.752 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.752 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:14:01.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.752 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:01.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:01.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:14:01.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:14:01.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:14:01.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:14:01.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:14:01.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:14:01.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:14:01.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:14:01.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:14:01.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:14:01.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.756 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:01.756 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:14:01.756 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:14:01.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.756 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.756 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:14:01.756 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:14:01.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.756 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.756 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:14:01.757 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:14:01.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.757 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:01.757 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:14:01.757 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:14:01.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.757 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:01.757 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:14:01.757 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:14:01.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.757 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:01.757 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:14:01.758 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:14:01.758 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.758 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.758 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.758 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:61817 5.a 5:5627ce7f:::benchmark_data_smithi029_44842_object61816:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:01.758 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:01.758 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.94822265800000005, 2024-04-26T11:14:01.758 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020626958000000001, 2024-04-26T11:14:01.758 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.758 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:01.758 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.759 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.759 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.759 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 61817 2024-04-26T11:14:01.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.759 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.759 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:01.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.759 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:01.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.760 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:01.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.760 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702591+0000", 2024-04-26T11:14:01.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0665999999999998e-05 2024-04-26T11:14:01.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.760 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702599+0000", 2024-04-26T11:14:01.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7130000000000005e-06 2024-04-26T11:14:01.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.761 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.761 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702605+0000", 2024-04-26T11:14:01.761 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4310000000000002e-06 2024-04-26T11:14:01.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.761 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.761 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.707947+0000", 2024-04-26T11:14:01.761 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053424220000000003 2024-04-26T11:14:01.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.761 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.761 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.708052+0000", 2024-04-26T11:14:01.761 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010499 2024-04-26T11:14:01.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.762 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:14:01.762 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.708141+0000", 2024-04-26T11:14:01.762 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9514999999999999e-05 2024-04-26T11:14:01.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.762 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:01.762 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.711954+0000", 2024-04-26T11:14:01.762 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003812265 2024-04-26T11:14:01.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.762 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:01.762 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723070+0000", 2024-04-26T11:14:01.762 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011116727 2024-04-26T11:14:01.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.763 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:01.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723121+0000", 2024-04-26T11:14:01.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0362999999999999e-05 2024-04-26T11:14:01.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.763 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:01.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723158+0000", 2024-04-26T11:14:01.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7579000000000001e-05 2024-04-26T11:14:01.763 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.763 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.763 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.764 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:62424 5.1 5:82f235dd:::benchmark_data_smithi029_44842_object62423:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:01.764 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:00.964723+0000", 2024-04-26T11:14:01.764 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.68603095199999997, 2024-04-26T11:14:01.764 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.017234724999999999, 2024-04-26T11:14:01.764 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.764 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:01.764 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.764 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.764 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.764 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 62424 2024-04-26T11:14:01.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.764 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.964723+0000", 2024-04-26T11:14:01.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.964723+0000", 2024-04-26T11:14:01.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.964722+0000", 2024-04-26T11:14:01.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:01.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.766 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.766 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.964776+0000", 2024-04-26T11:14:01.766 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3928000000000003e-05 2024-04-26T11:14:01.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.766 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.766 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.766 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.964789+0000", 2024-04-26T11:14:01.766 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3022e-05 2024-04-26T11:14:01.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.766 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.766 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.766 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.964797+0000", 2024-04-26T11:14:01.766 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7489999999999998e-06 2024-04-26T11:14:01.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.767 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.767 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.964838+0000", 2024-04-26T11:14:01.767 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0606999999999999e-05 2024-04-26T11:14:01.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.767 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.767 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.965025+0000", 2024-04-26T11:14:01.767 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00018701699999999999 2024-04-26T11:14:01.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.767 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:01.767 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.981835+0000", 2024-04-26T11:14:01.767 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016810843999999998 2024-04-26T11:14:01.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.768 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:01.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.981885+0000", 2024-04-26T11:14:01.768 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.9835e-05 2024-04-26T11:14:01.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.768 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:01.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.981958+0000", 2024-04-26T11:14:01.768 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2571999999999996e-05 2024-04-26T11:14:01.768 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.768 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.768 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.769 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:63213 5.5 5:a7428178:::benchmark_data_smithi029_44842_object63212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:01.769 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:01.311000+0000", 2024-04-26T11:14:01.769 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.33975403999999998, 2024-04-26T11:14:01.769 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.017362064999999999, 2024-04-26T11:14:01.769 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:01.769 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:01.769 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:01.769 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:01.769 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.769 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 63213 2024-04-26T11:14:01.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.769 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:01.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.770 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:01.770 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.311000+0000", 2024-04-26T11:14:01.770 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.770 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.770 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:01.770 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.311000+0000", 2024-04-26T11:14:01.770 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:01.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.770 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.770 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:01.770 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.311000+0000", 2024-04-26T11:14:01.770 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.770 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.771 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:01.771 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.311024+0000", 2024-04-26T11:14:01.771 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4094e-05 2024-04-26T11:14:01.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.771 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.771 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:01.771 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.311030+0000", 2024-04-26T11:14:01.771 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1829999999999999e-06 2024-04-26T11:14:01.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.771 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.771 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.771 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.311035+0000", 2024-04-26T11:14:01.771 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8520000000000003e-06 2024-04-26T11:14:01.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.772 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.772 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:01.772 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.321531+0000", 2024-04-26T11:14:01.772 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.010496704000000001 2024-04-26T11:14:01.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.772 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.772 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:01.772 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.321659+0000", 2024-04-26T11:14:01.772 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012714599999999999 2024-04-26T11:14:01.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.772 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.772 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:01.772 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.328249+0000", 2024-04-26T11:14:01.772 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0065900159999999998 2024-04-26T11:14:01.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.773 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.773 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:01.773 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.328295+0000", 2024-04-26T11:14:01.773 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6013999999999997e-05 2024-04-26T11:14:01.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:01.773 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:01.773 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:01.773 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:01.328362+0000", 2024-04-26T11:14:01.773 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7421000000000004e-05 2024-04-26T11:14:01.773 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.773 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.773 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.773 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:01.773 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:01.774 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:01.775 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:01.776 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:01.773+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:01.813 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:14:01.877 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:01.875+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:01.926 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2024-04-26T11:14:01.946 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:01.947 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:01.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.947 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:64666 5.f 5:ffbc089c:::benchmark_data_smithi029_44842_object64665:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:01.947 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:01.938777+0000", 2024-04-26T11:14:01.947 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0052205970000000004, 2024-04-26T11:14:01.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052504229999999997, 2024-04-26T11:14:01.947 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:01.947 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:01.947 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:01.947 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:01.947 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.947 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 64666 2024-04-26T11:14:01.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.948 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:01.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:01.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.938777+0000", 2024-04-26T11:14:01.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:01.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.938777+0000", 2024-04-26T11:14:01.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:01.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.938777+0000", 2024-04-26T11:14:01.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:01.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:01.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.938913+0000", 2024-04-26T11:14:01.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000136043 2024-04-26T11:14:01.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:01.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.938921+0000", 2024-04-26T11:14:01.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5720000000000003e-06 2024-04-26T11:14:01.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.938926+0000", 2024-04-26T11:14:01.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0560000000000004e-06 2024-04-26T11:14:01.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:01.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.938952+0000", 2024-04-26T11:14:01.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5761999999999998e-05 2024-04-26T11:14:01.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:01.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.939028+0000", 2024-04-26T11:14:01.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.572e-05 2024-04-26T11:14:01.950 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.950 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:01.951 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.951 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:64667 5.f 5:f7aabb5c:::benchmark_data_smithi029_44842_object64666:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:01.951 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:01.938934+0000", 2024-04-26T11:14:01.951 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0050643570000000002, 2024-04-26T11:14:01.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051741369999999997, 2024-04-26T11:14:01.951 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:01.951 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:01.951 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:01.951 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:01.951 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.951 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 64667 2024-04-26T11:14:01.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.952 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:01.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:01.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.938934+0000", 2024-04-26T11:14:01.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:01.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.938934+0000", 2024-04-26T11:14:01.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:01.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.938933+0000", 2024-04-26T11:14:01.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:01.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.939031+0000", 2024-04-26T11:14:01.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7672999999999998e-05 2024-04-26T11:14:01.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:01.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.939039+0000", 2024-04-26T11:14:01.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5010000000000004e-06 2024-04-26T11:14:01.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.939061+0000", 2024-04-26T11:14:01.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2079e-05 2024-04-26T11:14:01.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:01.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.941105+0000", 2024-04-26T11:14:01.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020435179999999998 2024-04-26T11:14:01.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:01.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.941230+0000", 2024-04-26T11:14:01.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000125501 2024-04-26T11:14:01.955 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.955 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:01.955 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.955 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:64670 5.e 5:73bdbcc2:::benchmark_data_smithi029_44842_object64669:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:01.955 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:01.939129+0000", 2024-04-26T11:14:01.955 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0048685739999999996, 2024-04-26T11:14:01.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050799809999999999, 2024-04-26T11:14:01.956 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:01.956 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:01.956 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:01.956 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:01.956 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.956 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 64670 2024-04-26T11:14:01.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.956 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:01.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:01.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.939129+0000", 2024-04-26T11:14:01.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:01.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.939129+0000", 2024-04-26T11:14:01.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:01.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.939129+0000", 2024-04-26T11:14:01.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:01.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.939164+0000", 2024-04-26T11:14:01.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5340999999999999e-05 2024-04-26T11:14:01.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:01.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.939169+0000", 2024-04-26T11:14:01.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9579999999999998e-06 2024-04-26T11:14:01.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.939173+0000", 2024-04-26T11:14:01.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8489999999999999e-06 2024-04-26T11:14:01.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:01.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.939205+0000", 2024-04-26T11:14:01.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1616999999999999e-05 2024-04-26T11:14:01.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:01.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.939315+0000", 2024-04-26T11:14:01.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000109901 2024-04-26T11:14:01.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:01.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.939438+0000", 2024-04-26T11:14:01.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012320399999999999 2024-04-26T11:14:01.959 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.960 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:01.960 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.960 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:64673 5.8 5:152cebbe:::benchmark_data_smithi029_44842_object64672:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:01.960 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:01.939356+0000", 2024-04-26T11:14:01.960 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0046414719999999998, 2024-04-26T11:14:01.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049718790000000002, 2024-04-26T11:14:01.960 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:01.960 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:01.960 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:01.960 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:01.960 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.961 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 64673 2024-04-26T11:14:01.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.961 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:01.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:01.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.939356+0000", 2024-04-26T11:14:01.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:01.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.939356+0000", 2024-04-26T11:14:01.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:01.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.939356+0000", 2024-04-26T11:14:01.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:01.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.939513+0000", 2024-04-26T11:14:01.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015681199999999999 2024-04-26T11:14:01.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:01.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.939522+0000", 2024-04-26T11:14:01.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0149999999999992e-06 2024-04-26T11:14:01.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.939536+0000", 2024-04-26T11:14:01.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4391e-05 2024-04-26T11:14:01.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:01.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.939576+0000", 2024-04-26T11:14:01.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9938999999999998e-05 2024-04-26T11:14:01.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:01.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.939688+0000", 2024-04-26T11:14:01.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011217000000000001 2024-04-26T11:14:01.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:01.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.939812+0000", 2024-04-26T11:14:01.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012379000000000001 2024-04-26T11:14:01.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:01.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942326+0000", 2024-04-26T11:14:01.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002513773 2024-04-26T11:14:01.965 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.965 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:01.965 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.965 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:64674 5.f 5:f8d80bb6:::benchmark_data_smithi029_44842_object64673:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:01.965 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:01.941088+0000", 2024-04-26T11:14:01.966 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0029099379999999999, 2024-04-26T11:14:01.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0033437179999999999, 2024-04-26T11:14:01.966 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:01.966 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:01.966 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:01.966 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:01.966 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.966 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 64674 2024-04-26T11:14:01.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.966 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:01.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:01.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.941088+0000", 2024-04-26T11:14:01.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:01.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.941088+0000", 2024-04-26T11:14:01.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:01.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.941087+0000", 2024-04-26T11:14:01.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:01.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:01.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.941115+0000", 2024-04-26T11:14:01.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7906e-05 2024-04-26T11:14:01.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:01.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.941141+0000", 2024-04-26T11:14:01.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6628e-05 2024-04-26T11:14:01.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.941153+0000", 2024-04-26T11:14:01.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1651000000000001e-05 2024-04-26T11:14:01.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:01.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.943117+0000", 2024-04-26T11:14:01.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0019639940000000002 2024-04-26T11:14:01.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:01.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.943232+0000", 2024-04-26T11:14:01.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000115287 2024-04-26T11:14:01.969 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.969 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:01.969 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.969 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:64675 5.e 5:7da47bd8:::benchmark_data_smithi029_44842_object64674:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:01.969 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:01.941631+0000", 2024-04-26T11:14:01.969 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.002367404, 2024-04-26T11:14:01.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00287747, 2024-04-26T11:14:01.970 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:01.970 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:01.970 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:01.970 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:01.970 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.970 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 64675 2024-04-26T11:14:01.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.970 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:01.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:01.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.941631+0000", 2024-04-26T11:14:01.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:01.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.941631+0000", 2024-04-26T11:14:01.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:01.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.941630+0000", 2024-04-26T11:14:01.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:01.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.941742+0000", 2024-04-26T11:14:01.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111907 2024-04-26T11:14:01.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:01.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.941751+0000", 2024-04-26T11:14:01.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7010000000000008e-06 2024-04-26T11:14:01.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.941760+0000", 2024-04-26T11:14:01.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.276e-06 2024-04-26T11:14:01.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:01.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.941821+0000", 2024-04-26T11:14:01.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.101e-05 2024-04-26T11:14:01.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:01.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.941939+0000", 2024-04-26T11:14:01.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000118324 2024-04-26T11:14:01.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:01.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942570+0000", 2024-04-26T11:14:01.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00063080000000000005 2024-04-26T11:14:01.973 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.973 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:01.973 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.973 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:64676 5.b 5:de835b88:::benchmark_data_smithi029_44842_object64675:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:01.974 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:01.941812+0000", 2024-04-26T11:14:01.974 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0021858369999999999, 2024-04-26T11:14:01.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002769508, 2024-04-26T11:14:01.974 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:01.974 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:01.974 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:01.974 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:01.974 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.974 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 64676 2024-04-26T11:14:01.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.974 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:01.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:01.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.941812+0000", 2024-04-26T11:14:01.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:01.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.941812+0000", 2024-04-26T11:14:01.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:01.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.941812+0000", 2024-04-26T11:14:01.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:01.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.941831+0000", 2024-04-26T11:14:01.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9108000000000001e-05 2024-04-26T11:14:01.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:01.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.941838+0000", 2024-04-26T11:14:01.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.793e-06 2024-04-26T11:14:01.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.941842+0000", 2024-04-26T11:14:01.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2100000000000003e-06 2024-04-26T11:14:01.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:01.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.941877+0000", 2024-04-26T11:14:01.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5389000000000003e-05 2024-04-26T11:14:01.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:01.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.941994+0000", 2024-04-26T11:14:01.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011651599999999999 2024-04-26T11:14:01.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:01.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942124+0000", 2024-04-26T11:14:01.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013076900000000001 2024-04-26T11:14:01.977 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.978 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:01.978 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.978 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:64678 5.0 5:02c4934e:::benchmark_data_smithi029_44842_object64677:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:01.978 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:01.942094+0000", 2024-04-26T11:14:01.978 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0019040299999999999, 2024-04-26T11:14:01.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025640260000000001, 2024-04-26T11:14:01.978 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:01.978 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:01.978 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:01.978 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:01.978 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.979 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 64678 2024-04-26T11:14:01.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.979 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:01.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:01.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942094+0000", 2024-04-26T11:14:01.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:01.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942094+0000", 2024-04-26T11:14:01.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:01.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942093+0000", 2024-04-26T11:14:01.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:01.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942115+0000", 2024-04-26T11:14:01.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1554999999999999e-05 2024-04-26T11:14:01.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:01.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942123+0000", 2024-04-26T11:14:01.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1829999999999994e-06 2024-04-26T11:14:01.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942129+0000", 2024-04-26T11:14:01.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9580000000000004e-06 2024-04-26T11:14:01.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:01.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942164+0000", 2024-04-26T11:14:01.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5196e-05 2024-04-26T11:14:01.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:01.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942284+0000", 2024-04-26T11:14:01.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012006900000000001 2024-04-26T11:14:01.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:01.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942407+0000", 2024-04-26T11:14:01.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012261100000000001 2024-04-26T11:14:01.982 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.982 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:01.982 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.982 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(client.4534.0:64670 5.e e28/16)", 2024-04-26T11:14:01.982 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:01.942863+0000", 2024-04-26T11:14:01.982 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.001134969, 2024-04-26T11:14:01.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018698429999999999, 2024-04-26T11:14:01.982 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:01.982 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:01.983 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:01.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:01.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942863+0000", 2024-04-26T11:14:01.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:01.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942863+0000", 2024-04-26T11:14:01.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:01.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942862+0000", 2024-04-26T11:14:01.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:01.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:01.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942876+0000", 2024-04-26T11:14:01.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3332999999999999e-05 2024-04-26T11:14:01.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:01.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942883+0000", 2024-04-26T11:14:01.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8250000000000005e-06 2024-04-26T11:14:01.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942889+0000", 2024-04-26T11:14:01.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0680000000000002e-06 2024-04-26T11:14:01.985 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.985 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:01.985 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.985 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4534.0:64679 5.a e28/16 5:57fc159e:::benchmark_data_smithi029_44842_object64678:head v 28'4201, mlcod=28'4199)", 2024-04-26T11:14:01.985 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:01.942920+0000", 2024-04-26T11:14:01.985 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.001078236, 2024-04-26T11:14:01.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018649770000000001, 2024-04-26T11:14:01.985 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:01.985 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:01.985 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:01.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:01.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942920+0000", 2024-04-26T11:14:01.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:01.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942920+0000", 2024-04-26T11:14:01.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:01.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942919+0000", 2024-04-26T11:14:01.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:01.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942946+0000", 2024-04-26T11:14:01.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6636e-05 2024-04-26T11:14:01.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:01.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942952+0000", 2024-04-26T11:14:01.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1199999999999999e-06 2024-04-26T11:14:01.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942957+0000", 2024-04-26T11:14:01.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.454e-06 2024-04-26T11:14:01.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:01.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942986+0000", 2024-04-26T11:14:01.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9325000000000001e-05 2024-04-26T11:14:01.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:01.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.943005+0000", 2024-04-26T11:14:01.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8715e-05 2024-04-26T11:14:01.988 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.988 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:01.988 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.988 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:64682 5.f 5.2847908f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:01.988 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:01.942974+0000", 2024-04-26T11:14:01.989 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0010240010000000001, 2024-04-26T11:14:01.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018673559999999999, 2024-04-26T11:14:01.989 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:01.989 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:01.989 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:01.989 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:01.989 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.989 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 64682 2024-04-26T11:14:01.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.989 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:01.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:01.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942974+0000", 2024-04-26T11:14:01.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:01.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942974+0000", 2024-04-26T11:14:01.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:01.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.942973+0000", 2024-04-26T11:14:01.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:01.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.943001+0000", 2024-04-26T11:14:01.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7339e-05 2024-04-26T11:14:01.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:01.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.943009+0000", 2024-04-26T11:14:01.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9820000000000008e-06 2024-04-26T11:14:01.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.943014+0000", 2024-04-26T11:14:01.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3469999999999998e-06 2024-04-26T11:14:01.991 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.991 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:01.991 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.992 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:64683 5.b 5:da986d29:::benchmark_data_smithi029_44842_object64682:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:01.992 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:01.943201+0000", 2024-04-26T11:14:01.992 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00079669699999999997, 2024-04-26T11:14:01.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001697297, 2024-04-26T11:14:01.992 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:01.992 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:01.992 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:01.992 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:01.992 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.992 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 64683 2024-04-26T11:14:01.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.992 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:01.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:01.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.943201+0000", 2024-04-26T11:14:01.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:01.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.943201+0000", 2024-04-26T11:14:01.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:01.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.943201+0000", 2024-04-26T11:14:01.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:01.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:01.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.943249+0000", 2024-04-26T11:14:01.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8372999999999999e-05 2024-04-26T11:14:01.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:01.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.943271+0000", 2024-04-26T11:14:01.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2345999999999999e-05 2024-04-26T11:14:01.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.943283+0000", 2024-04-26T11:14:01.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1266e-05 2024-04-26T11:14:01.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:01.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.944095+0000", 2024-04-26T11:14:01.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081272099999999997 2024-04-26T11:14:01.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:01.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.944217+0000", 2024-04-26T11:14:01.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012210699999999999 2024-04-26T11:14:01.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:01.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.944371+0000", 2024-04-26T11:14:01.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015332400000000001 2024-04-26T11:14:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:64684 5.f 5.d015775f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:01.943291+0000", 2024-04-26T11:14:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00070728800000000004, 2024-04-26T11:14:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001676418, 2024-04-26T11:14:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:01.996 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 64684 2024-04-26T11:14:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.943291+0000", 2024-04-26T11:14:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.943291+0000", 2024-04-26T11:14:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.943290+0000", 2024-04-26T11:14:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.943324+0000", 2024-04-26T11:14:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3639000000000001e-05 2024-04-26T11:14:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.943331+0000", 2024-04-26T11:14:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0439999999999998e-06 2024-04-26T11:14:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.943338+0000", 2024-04-26T11:14:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2640000000000002e-06 2024-04-26T11:14:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop(client.4534.0:64681 5.a e28/16 5:50819917:::benchmark_data_smithi029_44842_object64680:head v 28'4202, mlcod=28'4199)", 2024-04-26T11:14:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:01.944545+0000", 2024-04-26T11:14:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9994531, 2024-04-26T11:14:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00047808799999999999, 2024-04-26T11:14:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:01.999 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.944545+0000", 2024-04-26T11:14:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.944545+0000", 2024-04-26T11:14:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.944544+0000", 2024-04-26T11:14:02.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.944604+0000", 2024-04-26T11:14:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9913e-05 2024-04-26T11:14:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.944615+0000", 2024-04-26T11:14:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0243e-05 2024-04-26T11:14:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.944620+0000", 2024-04-26T11:14:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0420000000000002e-06 2024-04-26T11:14:02.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.944648+0000", 2024-04-26T11:14:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8419e-05 2024-04-26T11:14:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.944673+0000", 2024-04-26T11:14:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5459000000000001e-05 2024-04-26T11:14:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.002 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.003 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:14:02.003 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 14 2024-04-26T11:14:02.003 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:02.004 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:02.003+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:02.005 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:02.027 INFO:teuthology.orchestra.console.smithi072:Power off completed 2024-04-26T11:14:02.108 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:02.106+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:02.208 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:02.207+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:02.220 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:02.220 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:14:02.220 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:14:02.220 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:14:02.220 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:02.235 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:02.310 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:02.309+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:02.364 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:14:02.406 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:02.406 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:14:02.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:14:02.407 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:02.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.407 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:33828 5.b 5:d3313e8b:::benchmark_data_smithi029_44842_object33827:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T11:14:02.407 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:47.804177+0000", 2024-04-26T11:14:02.407 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 14.598793828, 2024-04-26T11:14:02.407 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.01819138, 2024-04-26T11:14:02.407 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:02.407 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:02.407 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:02.407 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:02.407 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:02.407 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 33828 2024-04-26T11:14:02.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.407 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:02.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:02.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804177+0000", 2024-04-26T11:14:02.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:02.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804177+0000", 2024-04-26T11:14:02.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:02.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804176+0000", 2024-04-26T11:14:02.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:02.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:02.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804238+0000", 2024-04-26T11:14:02.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1791000000000005e-05 2024-04-26T11:14:02.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:02.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804248+0000", 2024-04-26T11:14:02.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9969999999999993e-06 2024-04-26T11:14:02.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.804253+0000", 2024-04-26T11:14:02.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2830000000000003e-06 2024-04-26T11:14:02.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.805184+0000", 2024-04-26T11:14:02.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00093189900000000003 2024-04-26T11:14:02.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:02.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.805268+0000", 2024-04-26T11:14:02.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3634000000000006e-05 2024-04-26T11:14:02.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:02.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.805359+0000", 2024-04-26T11:14:02.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0603e-05 2024-04-26T11:14:02.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:02.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.806391+0000", 2024-04-26T11:14:02.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001031978 2024-04-26T11:14:02.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:02.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.822308+0000", 2024-04-26T11:14:02.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015917343 2024-04-26T11:14:02.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:02.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.822344+0000", 2024-04-26T11:14:02.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5754999999999999e-05 2024-04-26T11:14:02.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.412 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:02.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:47.822368+0000", 2024-04-26T11:14:02.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4658e-05 2024-04-26T11:14:02.412 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.412 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:02.412 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.412 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35482 5.b 5:d2b3ef95:::benchmark_data_smithi029_44842_object35481:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:14:02.412 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:14:02.412 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.984289243999999, 2024-04-26T11:14:02.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019390455000000001, 2024-04-26T11:14:02.412 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35482 2024-04-26T11:14:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:14:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:14:02.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418681+0000", 2024-04-26T11:14:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418802+0000", 2024-04-26T11:14:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120835 2024-04-26T11:14:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:02.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418810+0000", 2024-04-26T11:14:02.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1240000000000005e-06 2024-04-26T11:14:02.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418816+0000", 2024-04-26T11:14:02.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5749999999999997e-06 2024-04-26T11:14:02.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.419905+0000", 2024-04-26T11:14:02.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001088751 2024-04-26T11:14:02.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.420046+0000", 2024-04-26T11:14:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140514 2024-04-26T11:14:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.420180+0000", 2024-04-26T11:14:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440899999999999 2024-04-26T11:14:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425415+0000", 2024-04-26T11:14:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052350540000000003 2024-04-26T11:14:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:02.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.437989+0000", 2024-04-26T11:14:02.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012573632 2024-04-26T11:14:02.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:02.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.438035+0000", 2024-04-26T11:14:02.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5799e-05 2024-04-26T11:14:02.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:02.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.438072+0000", 2024-04-26T11:14:02.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7530999999999997e-05 2024-04-26T11:14:02.417 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.417 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:02.417 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.418 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35483 5.b 5:d3dd14f6:::benchmark_data_smithi029_44842_object35482:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:14:02.418 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:02.418 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.984146502, 2024-04-26T11:14:02.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021245969, 2024-04-26T11:14:02.418 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:02.418 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:02.418 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:02.418 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:02.419 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:02.419 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35483 2024-04-26T11:14:02.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.419 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:02.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:02.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:02.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:02.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:02.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:02.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:02.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:02.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:02.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418885+0000", 2024-04-26T11:14:02.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1294e-05 2024-04-26T11:14:02.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:02.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418892+0000", 2024-04-26T11:14:02.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4599999999999997e-06 2024-04-26T11:14:02.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418899+0000", 2024-04-26T11:14:02.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0909999999999998e-06 2024-04-26T11:14:02.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421347+0000", 2024-04-26T11:14:02.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024484609999999999 2024-04-26T11:14:02.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:02.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421468+0000", 2024-04-26T11:14:02.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000121179 2024-04-26T11:14:02.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:02.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421605+0000", 2024-04-26T11:14:02.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013672200000000001 2024-04-26T11:14:02.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:02.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425456+0000", 2024-04-26T11:14:02.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038511719999999999 2024-04-26T11:14:02.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:02.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.439986+0000", 2024-04-26T11:14:02.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014530080000000001 2024-04-26T11:14:02.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:02.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440038+0000", 2024-04-26T11:14:02.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1916999999999998e-05 2024-04-26T11:14:02.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:02.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440070+0000", 2024-04-26T11:14:02.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2245e-05 2024-04-26T11:14:02.423 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.423 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:02.423 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.424 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44504 5.0 5:0536d5a4:::benchmark_data_smithi029_44842_object44503:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:02.424 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:14:02.424 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 10.23368488, 2024-04-26T11:14:02.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018576187000000001, 2024-04-26T11:14:02.424 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:02.424 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:02.424 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:02.425 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:02.425 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:02.425 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44504 2024-04-26T11:14:02.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.425 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:02.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:02.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:14:02.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:02.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:14:02.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:02.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:14:02.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:02.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:02.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169304+0000", 2024-04-26T11:14:02.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8331000000000001e-05 2024-04-26T11:14:02.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:02.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169308+0000", 2024-04-26T11:14:02.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9609999999999999e-06 2024-04-26T11:14:02.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169311+0000", 2024-04-26T11:14:02.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.044e-06 2024-04-26T11:14:02.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.174118+0000", 2024-04-26T11:14:02.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004806645 2024-04-26T11:14:02.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:02.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.174207+0000", 2024-04-26T11:14:02.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9665000000000003e-05 2024-04-26T11:14:02.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:02.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.174308+0000", 2024-04-26T11:14:02.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100399 2024-04-26T11:14:02.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:02.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.185001+0000", 2024-04-26T11:14:02.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010693599 2024-04-26T11:14:02.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:02.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187698+0000", 2024-04-26T11:14:02.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026970929999999998 2024-04-26T11:14:02.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:02.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187777+0000", 2024-04-26T11:14:02.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8335000000000001e-05 2024-04-26T11:14:02.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:02.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187862+0000", 2024-04-26T11:14:02.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5521999999999999e-05 2024-04-26T11:14:02.429 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.429 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:02.430 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.430 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44506 5.0 5:07ec7127:::benchmark_data_smithi029_44842_object44505:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:02.430 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:14:02.430 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 10.233384961000001, 2024-04-26T11:14:02.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018482386999999999, 2024-04-26T11:14:02.430 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:02.430 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:02.430 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:02.430 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:02.430 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:02.430 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44506 2024-04-26T11:14:02.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.430 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:02.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:02.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:14:02.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:02.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:14:02.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:02.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:14:02.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:02.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:02.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169730+0000", 2024-04-26T11:14:02.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014447200000000001 2024-04-26T11:14:02.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:02.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169738+0000", 2024-04-26T11:14:02.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5700000000000004e-06 2024-04-26T11:14:02.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169741+0000", 2024-04-26T11:14:02.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3909999999999998e-06 2024-04-26T11:14:02.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.176682+0000", 2024-04-26T11:14:02.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0069412129999999999 2024-04-26T11:14:02.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:02.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.176816+0000", 2024-04-26T11:14:02.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000134265 2024-04-26T11:14:02.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:02.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.176952+0000", 2024-04-26T11:14:02.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013520000000000001 2024-04-26T11:14:02.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:02.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.185004+0000", 2024-04-26T11:14:02.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0080524959999999993 2024-04-26T11:14:02.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:02.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187983+0000", 2024-04-26T11:14:02.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0029783330000000001 2024-04-26T11:14:02.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:02.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188031+0000", 2024-04-26T11:14:02.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8588000000000003e-05 2024-04-26T11:14:02.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:02.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188068+0000", 2024-04-26T11:14:02.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7154999999999999e-05 2024-04-26T11:14:02.435 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.435 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:02.436 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.436 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44509 5.0 5:0828d2b6:::benchmark_data_smithi029_44842_object44508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:02.436 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.169815+0000", 2024-04-26T11:14:02.436 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 10.233156116, 2024-04-26T11:14:02.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018410841000000001, 2024-04-26T11:14:02.436 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:02.436 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:02.436 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:02.436 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:02.436 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:02.436 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44509 2024-04-26T11:14:02.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.436 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:02.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:02.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169815+0000", 2024-04-26T11:14:02.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:02.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169815+0000", 2024-04-26T11:14:02.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:02.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169814+0000", 2024-04-26T11:14:02.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:02.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:02.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169921+0000", 2024-04-26T11:14:02.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107194 2024-04-26T11:14:02.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:02.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169927+0000", 2024-04-26T11:14:02.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.203e-06 2024-04-26T11:14:02.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169931+0000", 2024-04-26T11:14:02.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0829999999999997e-06 2024-04-26T11:14:02.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.179590+0000", 2024-04-26T11:14:02.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096589999999999992 2024-04-26T11:14:02.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:02.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.179718+0000", 2024-04-26T11:14:02.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012885699999999999 2024-04-26T11:14:02.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:02.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.179857+0000", 2024-04-26T11:14:02.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013884100000000001 2024-04-26T11:14:02.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:02.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188082+0000", 2024-04-26T11:14:02.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082250099999999996 2024-04-26T11:14:02.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:02.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188164+0000", 2024-04-26T11:14:02.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2123e-05 2024-04-26T11:14:02.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:02.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188197+0000", 2024-04-26T11:14:02.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2471000000000001e-05 2024-04-26T11:14:02.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:02.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188226+0000", 2024-04-26T11:14:02.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8609999999999999e-05 2024-04-26T11:14:02.441 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.441 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:02.441 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.441 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44513 5.0 5:0a236ebb:::benchmark_data_smithi029_44842_object44512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:02.441 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:02.441 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 10.232883522, 2024-04-26T11:14:02.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020724414, 2024-04-26T11:14:02.441 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:02.442 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:02.442 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:02.442 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:02.442 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:02.442 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44513 2024-04-26T11:14:02.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.442 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:02.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:02.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:02.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:02.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:02.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:02.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:02.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:02.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:02.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170120+0000", 2024-04-26T11:14:02.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2941000000000002e-05 2024-04-26T11:14:02.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:02.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170127+0000", 2024-04-26T11:14:02.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.469e-06 2024-04-26T11:14:02.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170133+0000", 2024-04-26T11:14:02.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1340000000000001e-06 2024-04-26T11:14:02.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182383+0000", 2024-04-26T11:14:02.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012249970000000001 2024-04-26T11:14:02.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:02.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182477+0000", 2024-04-26T11:14:02.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3776999999999993e-05 2024-04-26T11:14:02.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:02.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182572+0000", 2024-04-26T11:14:02.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4841999999999998e-05 2024-04-26T11:14:02.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:02.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188262+0000", 2024-04-26T11:14:02.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005690077 2024-04-26T11:14:02.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:02.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190748+0000", 2024-04-26T11:14:02.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024857780000000001 2024-04-26T11:14:02.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:02.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190776+0000", 2024-04-26T11:14:02.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8419999999999999e-05 2024-04-26T11:14:02.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:02.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190812+0000", 2024-04-26T11:14:02.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5630999999999998e-05 2024-04-26T11:14:02.446 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.446 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:02.446 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.447 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44794 5.8 5:158fd219:::benchmark_data_smithi029_44842_object44793:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:02.447 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.283382+0000", 2024-04-26T11:14:02.447 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 10.119588945, 2024-04-26T11:14:02.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018701497000000001, 2024-04-26T11:14:02.447 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:02.447 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:02.447 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:02.447 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:02.447 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:02.447 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44794 2024-04-26T11:14:02.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.447 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:02.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:02.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283382+0000", 2024-04-26T11:14:02.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:02.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283382+0000", 2024-04-26T11:14:02.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:02.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283381+0000", 2024-04-26T11:14:02.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:02.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:02.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283409+0000", 2024-04-26T11:14:02.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.798e-05 2024-04-26T11:14:02.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:02.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283417+0000", 2024-04-26T11:14:02.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2629999999999997e-06 2024-04-26T11:14:02.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283424+0000", 2024-04-26T11:14:02.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1210000000000001e-06 2024-04-26T11:14:02.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.286843+0000", 2024-04-26T11:14:02.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034194490000000002 2024-04-26T11:14:02.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:02.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.286932+0000", 2024-04-26T11:14:02.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9065000000000002e-05 2024-04-26T11:14:02.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:02.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.287019+0000", 2024-04-26T11:14:02.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6976000000000002e-05 2024-04-26T11:14:02.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:02.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.288238+0000", 2024-04-26T11:14:02.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012185 2024-04-26T11:14:02.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:02.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.302032+0000", 2024-04-26T11:14:02.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013794618999999999 2024-04-26T11:14:02.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:02.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.302061+0000", 2024-04-26T11:14:02.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9008000000000001e-05 2024-04-26T11:14:02.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:02.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.302083+0000", 2024-04-26T11:14:02.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2002e-05 2024-04-26T11:14:02.452 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.452 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:02.452 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.452 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:02.452 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:02.452 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.1241804999999996, 2024-04-26T11:14:02.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:14:02.452 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:02.452 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:02.452 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:02.453 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:02.453 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:02.453 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:14:02.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.453 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:02.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:02.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:02.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:02.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:02.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:02.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:02.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:02.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:02.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:14:02.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:14:02.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:02.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:14:02.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:14:02.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:14:02.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:14:02.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:14:02.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:14:02.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:02.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:14:02.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:14:02.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:02.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:14:02.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:14:02.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:02.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:14:02.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:14:02.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:02.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:14:02.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:14:02.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:02.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:14:02.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:14:02.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:02.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:14:02.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:14:02.457 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.457 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:02.457 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.458 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:02.458 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:02.458 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.1235307980000009, 2024-04-26T11:14:02.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:14:02.458 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:02.458 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:02.458 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:02.458 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:02.458 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:02.458 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:14:02.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.458 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:02.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:02.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:02.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:02.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:02.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:02.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:14:02.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:02.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:02.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:14:02.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:14:02.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:02.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:14:02.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:14:02.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:14:02.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:14:02.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:14:02.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:14:02.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:02.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:14:02.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:14:02.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:02.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:14:02.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:14:02.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:02.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:14:02.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:14:02.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:02.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:14:02.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:14:02.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:02.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:14:02.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:14:02.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:02.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:14:02.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:14:02.463 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.463 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:02.463 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.463 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:55093 5.e 5:7ebffa9e:::benchmark_data_smithi029_44842_object55092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:02.463 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:14:02.463 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.6563990799999999, 2024-04-26T11:14:02.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020381660999999999, 2024-04-26T11:14:02.463 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:02.463 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:02.464 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:02.464 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:02.464 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:02.464 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 55093 2024-04-26T11:14:02.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.464 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:02.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:02.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:14:02.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:02.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:14:02.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:02.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746571+0000", 2024-04-26T11:14:02.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:02.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:02.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746599+0000", 2024-04-26T11:14:02.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8262000000000001e-05 2024-04-26T11:14:02.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:02.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746610+0000", 2024-04-26T11:14:02.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1070000000000001e-05 2024-04-26T11:14:02.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746617+0000", 2024-04-26T11:14:02.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8190000000000003e-06 2024-04-26T11:14:02.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748218+0000", 2024-04-26T11:14:02.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0016005889999999999 2024-04-26T11:14:02.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:02.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748350+0000", 2024-04-26T11:14:02.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132528 2024-04-26T11:14:02.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:02.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748499+0000", 2024-04-26T11:14:02.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014815600000000001 2024-04-26T11:14:02.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:02.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.750795+0000", 2024-04-26T11:14:02.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022960369999999999 2024-04-26T11:14:02.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:02.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766866+0000", 2024-04-26T11:14:02.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016071230999999998 2024-04-26T11:14:02.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:02.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766922+0000", 2024-04-26T11:14:02.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6643e-05 2024-04-26T11:14:02.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:02.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766953+0000", 2024-04-26T11:14:02.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0981e-05 2024-04-26T11:14:02.470 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.470 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:02.470 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.471 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:55738 5.4 5:2d90ff60:::benchmark_data_smithi029_44842_object55737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:02.471 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.026425+0000", 2024-04-26T11:14:02.471 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.3765456169999997, 2024-04-26T11:14:02.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018738008, 2024-04-26T11:14:02.472 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:02.472 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:02.472 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:02.472 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:02.472 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:02.472 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 55738 2024-04-26T11:14:02.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.472 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:02.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:02.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026425+0000", 2024-04-26T11:14:02.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:02.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026425+0000", 2024-04-26T11:14:02.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:02.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026425+0000", 2024-04-26T11:14:02.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:02.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:02.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026456+0000", 2024-04-26T11:14:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1312000000000001e-05 2024-04-26T11:14:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026463+0000", 2024-04-26T11:14:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2710000000000003e-06 2024-04-26T11:14:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026469+0000", 2024-04-26T11:14:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7389999999999996e-06 2024-04-26T11:14:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026561+0000", 2024-04-26T11:14:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2552000000000004e-05 2024-04-26T11:14:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026695+0000", 2024-04-26T11:14:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013394500000000001 2024-04-26T11:14:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026827+0000", 2024-04-26T11:14:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013146800000000001 2024-04-26T11:14:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.028905+0000", 2024-04-26T11:14:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020783749999999999 2024-04-26T11:14:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.045076+0000", 2024-04-26T11:14:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016170411999999999 2024-04-26T11:14:02.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.045130+0000", 2024-04-26T11:14:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4169000000000003e-05 2024-04-26T11:14:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.045163+0000", 2024-04-26T11:14:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3368999999999998e-05 2024-04-26T11:14:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.478 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:02.478 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:02.478 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.0568887589999996, 2024-04-26T11:14:02.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:14:02.478 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:02.478 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:14:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:02.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:14:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:14:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:14:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:14:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:14:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:14:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:14:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:14:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:14:02.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:02.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:14:02.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:14:02.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:14:02.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:14:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:14:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:14:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:02.484 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.0567931130000003, 2024-04-26T11:14:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:14:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:14:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:02.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:14:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:02.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:14:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:14:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:14:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:14:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:14:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:14:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:14:02.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:14:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:14:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:14:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:14:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:14:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:14:02.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:14:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.0566614339999996, 2024-04-26T11:14:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:14:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:02.489 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:14:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:02.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:02.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:02.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:02.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:14:02.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:14:02.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:02.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:14:02.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:14:02.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:14:02.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:14:02.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:14:02.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:14:02.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:02.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:14:02.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:14:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:14:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:14:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:14:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:14:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.056552978, 2024-04-26T11:14:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:14:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:14:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:02.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:02.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:02.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:02.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:02.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:14:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:14:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:14:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:14:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:14:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:14:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:14:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:14:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:14:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:02.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:14:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:14:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:14:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:14:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:14:02.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:14:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.0564517100000002, 2024-04-26T11:14:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:14:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:02.500 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:14:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:02.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:14:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:14:02.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:14:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:14:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:14:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:14:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:14:02.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:14:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:14:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:14:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:14:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:14:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:14:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:14:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:14:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:14:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:14:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:14:02.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:14:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:14:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:02.506 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.0563827689999998, 2024-04-26T11:14:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:14:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:14:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:02.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:02.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:14:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:14:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:14:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:14:02.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:14:02.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:14:02.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:14:02.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:14:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:14:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:14:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:14:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:14:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:14:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:14:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:14:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:14:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:14:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:14:02.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:14:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:14:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:14:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.0503871880000002, 2024-04-26T11:14:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:14:02.516 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:14:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:02.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:14:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:14:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:14:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:14:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:14:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:14:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:14:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:14:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:14:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:14:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:14:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:14:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:14:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:14:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:14:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:14:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:14:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:14:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:14:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:14:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:14:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:63247 5.e 5:7505e6a1:::benchmark_data_smithi029_44842_object63246:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:01.329089+0000", 2024-04-26T11:14:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 1.0738822459999999, 2024-04-26T11:14:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017759046000000001, 2024-04-26T11:14:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 63247 2024-04-26T11:14:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:02.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.329089+0000", 2024-04-26T11:14:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.329089+0000", 2024-04-26T11:14:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.329088+0000", 2024-04-26T11:14:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.329152+0000", 2024-04-26T11:14:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4418000000000006e-05 2024-04-26T11:14:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.329160+0000", 2024-04-26T11:14:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7500000000000003e-06 2024-04-26T11:14:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.329166+0000", 2024-04-26T11:14:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0310000000000004e-06 2024-04-26T11:14:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.336243+0000", 2024-04-26T11:14:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0070772430000000004 2024-04-26T11:14:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.336368+0000", 2024-04-26T11:14:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012460800000000001 2024-04-26T11:14:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.336516+0000", 2024-04-26T11:14:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014807700000000001 2024-04-26T11:14:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.344407+0000", 2024-04-26T11:14:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0078912119999999999 2024-04-26T11:14:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.346795+0000", 2024-04-26T11:14:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023877360000000001 2024-04-26T11:14:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.346827+0000", 2024-04-26T11:14:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1696000000000003e-05 2024-04-26T11:14:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:02.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:02.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:02.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:01.346848+0000", 2024-04-26T11:14:02.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0846999999999999e-05 2024-04-26T11:14:02.527 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.527 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:02.527 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.527 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:02.527 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:02.527 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:02.528 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 24 16 65781 65765 171.248 148.062 0.00277438 0.00583707 2024-04-26T11:14:02.529 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:02.526+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:02.529 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:02.583 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:14:02.630 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:02.628+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:02.711 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:02.742 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:02.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.742 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:66454 5.5 5:ae3e70f5:::benchmark_data_smithi029_44842_object66453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:02.742 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:02.706721+0000", 2024-04-26T11:14:02.742 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0035236719999999998, 2024-04-26T11:14:02.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0035440799999999998, 2024-04-26T11:14:02.743 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:02.743 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:02.743 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:02.743 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:02.743 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:02.743 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 66454 2024-04-26T11:14:02.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.743 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:02.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:02.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.706721+0000", 2024-04-26T11:14:02.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:02.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:02.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.706721+0000", 2024-04-26T11:14:02.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:02.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:02.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.706720+0000", 2024-04-26T11:14:02.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:02.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:02.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.706793+0000", 2024-04-26T11:14:02.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2557000000000003e-05 2024-04-26T11:14:02.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:02.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.706802+0000", 2024-04-26T11:14:02.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.5710000000000004e-06 2024-04-26T11:14:02.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.706810+0000", 2024-04-26T11:14:02.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8669999999999994e-06 2024-04-26T11:14:02.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:02.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.707332+0000", 2024-04-26T11:14:02.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00052141199999999996 2024-04-26T11:14:02.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:02.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.707426+0000", 2024-04-26T11:14:02.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4089e-05 2024-04-26T11:14:02.746 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:02.746 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:02.746 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:02.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.746 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:66456 5.b e28/16 5:d5ac9d78:::benchmark_data_smithi029_44842_object66455:head v 28'4243, mlcod=28'4241)", 2024-04-26T11:14:02.746 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:02.707404+0000", 2024-04-26T11:14:02.746 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0028410789999999998, 2024-04-26T11:14:02.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0029061120000000002, 2024-04-26T11:14:02.747 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:02.747 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:02.747 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:02.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.747 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:02.747 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.707404+0000", 2024-04-26T11:14:02.747 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:02.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.747 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:02.747 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.707404+0000", 2024-04-26T11:14:02.747 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:02.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.747 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:02.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.707403+0000", 2024-04-26T11:14:02.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:02.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:02.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.707471+0000", 2024-04-26T11:14:02.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8331999999999996e-05 2024-04-26T11:14:02.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:02.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.707481+0000", 2024-04-26T11:14:02.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.5200000000000003e-06 2024-04-26T11:14:02.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.707487+0000", 2024-04-26T11:14:02.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2779999999999999e-06 2024-04-26T11:14:02.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:02.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.707520+0000", 2024-04-26T11:14:02.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2648999999999999e-05 2024-04-26T11:14:02.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:02.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.707540+0000", 2024-04-26T11:14:02.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.065e-05 2024-04-26T11:14:02.749 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:02.749 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:02.750 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:02.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.750 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:66457 5.7 5:e6ce6b81:::benchmark_data_smithi029_44842_object66456:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:02.750 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:02.709320+0000", 2024-04-26T11:14:02.750 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00092460000000000003, 2024-04-26T11:14:02.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001047613, 2024-04-26T11:14:02.750 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:02.750 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:02.750 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:02.750 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:02.750 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:02.750 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 66457 2024-04-26T11:14:02.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.751 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:02.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:02.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.709320+0000", 2024-04-26T11:14:02.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:02.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:02.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.709320+0000", 2024-04-26T11:14:02.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:02.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:02.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.709319+0000", 2024-04-26T11:14:02.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:02.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:02.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.709375+0000", 2024-04-26T11:14:02.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6314000000000003e-05 2024-04-26T11:14:02.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:02.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.709386+0000", 2024-04-26T11:14:02.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0791000000000001e-05 2024-04-26T11:14:02.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.709394+0000", 2024-04-26T11:14:02.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8809999999999996e-06 2024-04-26T11:14:02.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:02.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.709428+0000", 2024-04-26T11:14:02.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3549e-05 2024-04-26T11:14:02.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:02.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.709533+0000", 2024-04-26T11:14:02.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105219 2024-04-26T11:14:02.753 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:02.753 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:02.753 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:02.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.754 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:66458 5.e e28/16 5:7f8de298:::benchmark_data_smithi029_44842_object66457:head v 28'4119, mlcod=28'4117)", 2024-04-26T11:14:02.754 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:02.710029+0000", 2024-04-26T11:14:02.754 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00021605100000000001, 2024-04-26T11:14:02.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00039512299999999999, 2024-04-26T11:14:02.754 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:02.754 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:02.754 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:02.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:02.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.710029+0000", 2024-04-26T11:14:02.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:02.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:02.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.710029+0000", 2024-04-26T11:14:02.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:02.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:02.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.710028+0000", 2024-04-26T11:14:02.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:02.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:02.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.710061+0000", 2024-04-26T11:14:02.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2604999999999997e-05 2024-04-26T11:14:02.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.756 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:02.756 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.710069+0000", 2024-04-26T11:14:02.756 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7600000000000002e-06 2024-04-26T11:14:02.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.756 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:02.756 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.710075+0000", 2024-04-26T11:14:02.756 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9540000000000001e-06 2024-04-26T11:14:02.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.756 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:02.756 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.710114+0000", 2024-04-26T11:14:02.756 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9325e-05 2024-04-26T11:14:02.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:02.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:02.757 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:02.757 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.710132+0000", 2024-04-26T11:14:02.757 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8338999999999998e-05 2024-04-26T11:14:02.757 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:02.757 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:02.757 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:02.757 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:02.757 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:14:02.757 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 4 2024-04-26T11:14:02.757 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:02.758 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:02.759 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:02.760 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:02.757+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:02.760 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:02.761 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:02.761 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:02.761 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:02.762 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:02.762 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:02.859 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:02.857+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:02.960 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:02.959+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:02.991 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:02.991 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:02.999 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:03.062 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:03.060+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:03.163 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:03.162+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:03.226 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:03.226 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:03.241 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:03.286 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:03.284+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:03.365 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:03.364+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:03.412 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 25 16 68074 68058 170.13 143.312 0.00582445 0.00587515 2024-04-26T11:14:03.415 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:03.415 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:03.430 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:03.471 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:03.469+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:03.567 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:03.566+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:03.573 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is set 2024-04-26T11:14:03.640 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:03.640 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:03.655 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:03.669 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:03.667+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:03.769 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:03.768+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:03.862 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:03.862 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:03.870 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:03.869+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:03.878 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:03.971 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:03.969+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:04.072 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:04.072 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:04.074 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:04.072+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:04.087 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:04.173 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:04.171+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:04.273 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:04.272+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:04.320 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:04.320 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:04.336 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:04.377 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:04.376+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:04.412 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 26 16 70378 70362 169.124 144 0.00598992 0.00590982 2024-04-26T11:14:04.475 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:04.474+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:04.506 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~6s 2024-04-26T11:14:04.561 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:04.562 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:04.576 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:04.575+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:04.578 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:04.677 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:04.676+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:04.756 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:04.756 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:04.765 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:14:04.770 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:04.778 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:04.777+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:04.879 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:04.878+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:04.918 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:04.939 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:04.940 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:04.940 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:04.940 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:04.942 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:04.942 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:04.946 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:04.946 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:14:04.947 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:14:04.947 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:14:04.947 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:04.959 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:05.004 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:05.002+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:05.082 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:05.081+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:05.132 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:05.133 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:14:05.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:14:05.133 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:05.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.133 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35482 5.b 5:d2b3ef95:::benchmark_data_smithi029_44842_object35481:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:14:05.133 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:14:05.133 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.710261432999999, 2024-04-26T11:14:05.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019390455000000001, 2024-04-26T11:14:05.133 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:05.133 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:05.133 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:05.134 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:05.134 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.134 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35482 2024-04-26T11:14:05.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.134 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:05.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:05.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:14:05.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:05.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:14:05.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:05.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418681+0000", 2024-04-26T11:14:05.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:05.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:05.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418802+0000", 2024-04-26T11:14:05.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120835 2024-04-26T11:14:05.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:05.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418810+0000", 2024-04-26T11:14:05.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1240000000000005e-06 2024-04-26T11:14:05.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418816+0000", 2024-04-26T11:14:05.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5749999999999997e-06 2024-04-26T11:14:05.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.419905+0000", 2024-04-26T11:14:05.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001088751 2024-04-26T11:14:05.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:05.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.420046+0000", 2024-04-26T11:14:05.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140514 2024-04-26T11:14:05.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:05.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.420180+0000", 2024-04-26T11:14:05.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440899999999999 2024-04-26T11:14:05.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:05.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425415+0000", 2024-04-26T11:14:05.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052350540000000003 2024-04-26T11:14:05.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:05.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.437989+0000", 2024-04-26T11:14:05.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012573632 2024-04-26T11:14:05.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:05.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.438035+0000", 2024-04-26T11:14:05.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5799e-05 2024-04-26T11:14:05.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:05.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.438072+0000", 2024-04-26T11:14:05.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7530999999999997e-05 2024-04-26T11:14:05.139 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.139 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:05.139 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.139 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35483 5.b 5:d3dd14f6:::benchmark_data_smithi029_44842_object35482:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:14:05.139 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:05.139 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.710118691000002, 2024-04-26T11:14:05.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021245969, 2024-04-26T11:14:05.139 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:05.140 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:05.140 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:05.140 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:05.140 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.140 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35483 2024-04-26T11:14:05.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.140 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:05.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:05.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:05.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:05.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:05.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:05.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:05.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:05.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418885+0000", 2024-04-26T11:14:05.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1294e-05 2024-04-26T11:14:05.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:05.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418892+0000", 2024-04-26T11:14:05.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4599999999999997e-06 2024-04-26T11:14:05.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418899+0000", 2024-04-26T11:14:05.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0909999999999998e-06 2024-04-26T11:14:05.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421347+0000", 2024-04-26T11:14:05.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024484609999999999 2024-04-26T11:14:05.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:05.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421468+0000", 2024-04-26T11:14:05.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000121179 2024-04-26T11:14:05.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:05.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421605+0000", 2024-04-26T11:14:05.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013672200000000001 2024-04-26T11:14:05.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:05.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425456+0000", 2024-04-26T11:14:05.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038511719999999999 2024-04-26T11:14:05.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:05.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.439986+0000", 2024-04-26T11:14:05.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014530080000000001 2024-04-26T11:14:05.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:05.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440038+0000", 2024-04-26T11:14:05.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1916999999999998e-05 2024-04-26T11:14:05.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:05.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440070+0000", 2024-04-26T11:14:05.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2245e-05 2024-04-26T11:14:05.144 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.144 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:05.144 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.145 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44504 5.0 5:0536d5a4:::benchmark_data_smithi029_44842_object44503:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:05.145 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:14:05.145 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.959657069, 2024-04-26T11:14:05.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018576187000000001, 2024-04-26T11:14:05.145 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:05.145 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:05.145 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:05.145 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:05.145 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.145 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44504 2024-04-26T11:14:05.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.145 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:05.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:05.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:14:05.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:05.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:14:05.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:05.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:14:05.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:05.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169304+0000", 2024-04-26T11:14:05.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8331000000000001e-05 2024-04-26T11:14:05.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:05.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169308+0000", 2024-04-26T11:14:05.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9609999999999999e-06 2024-04-26T11:14:05.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169311+0000", 2024-04-26T11:14:05.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.044e-06 2024-04-26T11:14:05.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.174118+0000", 2024-04-26T11:14:05.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004806645 2024-04-26T11:14:05.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:05.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.174207+0000", 2024-04-26T11:14:05.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9665000000000003e-05 2024-04-26T11:14:05.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:05.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.174308+0000", 2024-04-26T11:14:05.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100399 2024-04-26T11:14:05.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:05.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.185001+0000", 2024-04-26T11:14:05.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010693599 2024-04-26T11:14:05.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:05.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187698+0000", 2024-04-26T11:14:05.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026970929999999998 2024-04-26T11:14:05.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:05.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187777+0000", 2024-04-26T11:14:05.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8335000000000001e-05 2024-04-26T11:14:05.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:05.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187862+0000", 2024-04-26T11:14:05.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5521999999999999e-05 2024-04-26T11:14:05.150 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.150 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:05.150 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.150 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44506 5.0 5:07ec7127:::benchmark_data_smithi029_44842_object44505:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:05.150 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:14:05.150 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.959357150000001, 2024-04-26T11:14:05.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018482386999999999, 2024-04-26T11:14:05.150 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:05.151 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:05.151 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:05.151 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:05.151 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.151 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44506 2024-04-26T11:14:05.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.151 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:05.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:05.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:14:05.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:05.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:14:05.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:05.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:14:05.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:05.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169730+0000", 2024-04-26T11:14:05.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014447200000000001 2024-04-26T11:14:05.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:05.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169738+0000", 2024-04-26T11:14:05.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5700000000000004e-06 2024-04-26T11:14:05.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169741+0000", 2024-04-26T11:14:05.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3909999999999998e-06 2024-04-26T11:14:05.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.176682+0000", 2024-04-26T11:14:05.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0069412129999999999 2024-04-26T11:14:05.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:05.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.176816+0000", 2024-04-26T11:14:05.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000134265 2024-04-26T11:14:05.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:05.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.176952+0000", 2024-04-26T11:14:05.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013520000000000001 2024-04-26T11:14:05.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:05.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.185004+0000", 2024-04-26T11:14:05.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0080524959999999993 2024-04-26T11:14:05.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:05.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187983+0000", 2024-04-26T11:14:05.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0029783330000000001 2024-04-26T11:14:05.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:05.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188031+0000", 2024-04-26T11:14:05.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8588000000000003e-05 2024-04-26T11:14:05.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:05.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188068+0000", 2024-04-26T11:14:05.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7154999999999999e-05 2024-04-26T11:14:05.155 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.155 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:05.155 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.156 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44509 5.0 5:0828d2b6:::benchmark_data_smithi029_44842_object44508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:05.156 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.169815+0000", 2024-04-26T11:14:05.156 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.959128305, 2024-04-26T11:14:05.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018410841000000001, 2024-04-26T11:14:05.156 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:05.156 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:05.156 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:05.156 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:05.156 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.156 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44509 2024-04-26T11:14:05.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.156 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:05.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:05.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169815+0000", 2024-04-26T11:14:05.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:05.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169815+0000", 2024-04-26T11:14:05.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:05.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169814+0000", 2024-04-26T11:14:05.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:05.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169921+0000", 2024-04-26T11:14:05.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107194 2024-04-26T11:14:05.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:05.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169927+0000", 2024-04-26T11:14:05.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.203e-06 2024-04-26T11:14:05.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169931+0000", 2024-04-26T11:14:05.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0829999999999997e-06 2024-04-26T11:14:05.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.179590+0000", 2024-04-26T11:14:05.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096589999999999992 2024-04-26T11:14:05.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:05.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.179718+0000", 2024-04-26T11:14:05.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012885699999999999 2024-04-26T11:14:05.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:05.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.179857+0000", 2024-04-26T11:14:05.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013884100000000001 2024-04-26T11:14:05.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:05.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188082+0000", 2024-04-26T11:14:05.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082250099999999996 2024-04-26T11:14:05.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:05.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188164+0000", 2024-04-26T11:14:05.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2123e-05 2024-04-26T11:14:05.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:05.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188197+0000", 2024-04-26T11:14:05.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2471000000000001e-05 2024-04-26T11:14:05.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:05.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188226+0000", 2024-04-26T11:14:05.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8609999999999999e-05 2024-04-26T11:14:05.161 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.161 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:05.161 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.161 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44513 5.0 5:0a236ebb:::benchmark_data_smithi029_44842_object44512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:05.161 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:05.161 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.958855711, 2024-04-26T11:14:05.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020724414, 2024-04-26T11:14:05.161 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:05.161 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:05.162 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:05.162 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:05.162 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.162 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44513 2024-04-26T11:14:05.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.162 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:05.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:05.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:05.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:05.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:05.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:05.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:05.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:05.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170120+0000", 2024-04-26T11:14:05.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2941000000000002e-05 2024-04-26T11:14:05.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:05.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170127+0000", 2024-04-26T11:14:05.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.469e-06 2024-04-26T11:14:05.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170133+0000", 2024-04-26T11:14:05.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1340000000000001e-06 2024-04-26T11:14:05.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182383+0000", 2024-04-26T11:14:05.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012249970000000001 2024-04-26T11:14:05.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:05.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182477+0000", 2024-04-26T11:14:05.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3776999999999993e-05 2024-04-26T11:14:05.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:05.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182572+0000", 2024-04-26T11:14:05.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4841999999999998e-05 2024-04-26T11:14:05.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:05.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188262+0000", 2024-04-26T11:14:05.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005690077 2024-04-26T11:14:05.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:05.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190748+0000", 2024-04-26T11:14:05.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024857780000000001 2024-04-26T11:14:05.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:05.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190776+0000", 2024-04-26T11:14:05.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8419999999999999e-05 2024-04-26T11:14:05.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:05.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190812+0000", 2024-04-26T11:14:05.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5630999999999998e-05 2024-04-26T11:14:05.166 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.166 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:05.166 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.167 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44794 5.8 5:158fd219:::benchmark_data_smithi029_44842_object44793:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:05.167 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.283382+0000", 2024-04-26T11:14:05.167 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.845561134, 2024-04-26T11:14:05.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018701497000000001, 2024-04-26T11:14:05.167 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:05.167 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:05.167 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:05.167 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:05.167 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.167 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44794 2024-04-26T11:14:05.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.167 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:05.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:05.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283382+0000", 2024-04-26T11:14:05.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:05.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283382+0000", 2024-04-26T11:14:05.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:05.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283381+0000", 2024-04-26T11:14:05.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:05.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283409+0000", 2024-04-26T11:14:05.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.798e-05 2024-04-26T11:14:05.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:05.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283417+0000", 2024-04-26T11:14:05.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2629999999999997e-06 2024-04-26T11:14:05.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283424+0000", 2024-04-26T11:14:05.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1210000000000001e-06 2024-04-26T11:14:05.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.286843+0000", 2024-04-26T11:14:05.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034194490000000002 2024-04-26T11:14:05.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:05.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.286932+0000", 2024-04-26T11:14:05.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9065000000000002e-05 2024-04-26T11:14:05.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:05.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.287019+0000", 2024-04-26T11:14:05.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6976000000000002e-05 2024-04-26T11:14:05.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:05.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.288238+0000", 2024-04-26T11:14:05.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012185 2024-04-26T11:14:05.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:05.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.302032+0000", 2024-04-26T11:14:05.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013794618999999999 2024-04-26T11:14:05.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:05.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.302061+0000", 2024-04-26T11:14:05.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9008000000000001e-05 2024-04-26T11:14:05.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:05.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.302083+0000", 2024-04-26T11:14:05.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2002e-05 2024-04-26T11:14:05.172 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.172 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:05.172 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.172 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:05.172 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:05.173 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 11.850152689, 2024-04-26T11:14:05.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:14:05.173 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:05.173 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:05.173 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:05.173 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:05.173 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.173 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:14:05.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.173 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:05.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:05.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:05.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:05.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:05.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:05.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:05.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:05.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:14:05.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:14:05.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:05.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:14:05.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:14:05.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:14:05.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:14:05.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:14:05.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:14:05.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:05.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:14:05.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:14:05.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:05.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:14:05.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:14:05.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:05.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:14:05.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:14:05.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:05.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:14:05.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:14:05.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:05.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:14:05.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:14:05.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:05.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:14:05.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:14:05.180 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.180 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:05.180 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.180 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:05.180 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:05.180 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 11.849502986999999, 2024-04-26T11:14:05.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:14:05.180 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:05.180 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:05.180 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:05.180 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:14:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:14:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:14:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:14:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:14:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:14:05.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:14:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:14:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:14:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:14:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:14:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:14:05.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:14:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:14:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:14:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:14:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:14:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:14:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:14:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:14:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:14:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:14:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.185 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:55093 5.e 5:7ebffa9e:::benchmark_data_smithi029_44842_object55092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:14:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.3823712690000001, 2024-04-26T11:14:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020381660999999999, 2024-04-26T11:14:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 55093 2024-04-26T11:14:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:05.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:14:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:14:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746571+0000", 2024-04-26T11:14:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746599+0000", 2024-04-26T11:14:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8262000000000001e-05 2024-04-26T11:14:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746610+0000", 2024-04-26T11:14:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1070000000000001e-05 2024-04-26T11:14:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746617+0000", 2024-04-26T11:14:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8190000000000003e-06 2024-04-26T11:14:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748218+0000", 2024-04-26T11:14:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0016005889999999999 2024-04-26T11:14:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748350+0000", 2024-04-26T11:14:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132528 2024-04-26T11:14:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748499+0000", 2024-04-26T11:14:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014815600000000001 2024-04-26T11:14:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.750795+0000", 2024-04-26T11:14:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022960369999999999 2024-04-26T11:14:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766866+0000", 2024-04-26T11:14:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016071230999999998 2024-04-26T11:14:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766922+0000", 2024-04-26T11:14:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6643e-05 2024-04-26T11:14:05.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766953+0000", 2024-04-26T11:14:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0981e-05 2024-04-26T11:14:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:55738 5.4 5:2d90ff60:::benchmark_data_smithi029_44842_object55737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.026425+0000", 2024-04-26T11:14:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.1025178059999998, 2024-04-26T11:14:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018738008, 2024-04-26T11:14:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:05.191 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 55738 2024-04-26T11:14:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026425+0000", 2024-04-26T11:14:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026425+0000", 2024-04-26T11:14:05.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026425+0000", 2024-04-26T11:14:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026456+0000", 2024-04-26T11:14:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1312000000000001e-05 2024-04-26T11:14:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026463+0000", 2024-04-26T11:14:05.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2710000000000003e-06 2024-04-26T11:14:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026469+0000", 2024-04-26T11:14:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7389999999999996e-06 2024-04-26T11:14:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026561+0000", 2024-04-26T11:14:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2552000000000004e-05 2024-04-26T11:14:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026695+0000", 2024-04-26T11:14:05.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013394500000000001 2024-04-26T11:14:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026827+0000", 2024-04-26T11:14:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013146800000000001 2024-04-26T11:14:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.028905+0000", 2024-04-26T11:14:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020783749999999999 2024-04-26T11:14:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.045076+0000", 2024-04-26T11:14:05.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016170411999999999 2024-04-26T11:14:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.045130+0000", 2024-04-26T11:14:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4169000000000003e-05 2024-04-26T11:14:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.045163+0000", 2024-04-26T11:14:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3368999999999998e-05 2024-04-26T11:14:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.7828609479999997, 2024-04-26T11:14:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:14:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:14:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:05.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:14:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:05.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:14:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:14:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:14:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:14:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:14:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:14:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:14:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:14:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:14:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:14:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:14:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:14:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:14:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:14:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.7827653019999996, 2024-04-26T11:14:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:14:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:05.201 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:14:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:14:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:14:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:14:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:14:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:14:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:14:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:14:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:14:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:14:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:14:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:14:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:14:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:14:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:14:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:14:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:05.205 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.7826336229999997, 2024-04-26T11:14:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:14:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:14:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:05.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:14:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:14:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:14:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:14:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:14:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:14:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:14:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:14:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:14:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:14:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:14:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:14:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:05.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:14:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:14:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.7825251670000002, 2024-04-26T11:14:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:14:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:05.210 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:14:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:14:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:14:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:14:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:14:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:14:05.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:14:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:14:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:14:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:14:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:14:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:14:05.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:14:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:14:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:14:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:14:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.7824238990000003, 2024-04-26T11:14:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:14:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:14:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:14:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:14:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:14:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:14:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:14:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:14:05.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:14:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:14:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:14:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:14:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:14:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:14:05.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:14:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:14:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:14:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:14:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:14:05.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:14:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:14:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:14:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.782354958, 2024-04-26T11:14:05.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:14:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:14:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:14:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:14:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:14:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:14:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:14:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:14:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:14:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:14:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:14:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:14:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:14:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:14:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:14:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:14:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:14:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:14:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:14:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:14:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:14:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:14:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:14:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.225 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:05.226 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.226 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:05.226 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:05.226 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.7763593770000004, 2024-04-26T11:14:05.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:14:05.226 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:05.226 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:05.226 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:05.226 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:05.226 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.226 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:14:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:14:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:14:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:14:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:14:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:14:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:14:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:14:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:14:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:14:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:14:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:14:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:14:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:14:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:14:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:14:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:14:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:14:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:14:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:14:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:14:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:14:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.231 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:66093 5.e 5:70f73c77:::benchmark_data_smithi029_44842_object66092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:02.539855+0000", 2024-04-26T11:14:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 2.5890876110000001, 2024-04-26T11:14:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019258168999999999, 2024-04-26T11:14:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 66093 2024-04-26T11:14:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.539855+0000", 2024-04-26T11:14:05.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.539855+0000", 2024-04-26T11:14:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.539855+0000", 2024-04-26T11:14:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.539880+0000", 2024-04-26T11:14:05.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4882e-05 2024-04-26T11:14:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.539888+0000", 2024-04-26T11:14:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8849999999999999e-06 2024-04-26T11:14:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.539894+0000", 2024-04-26T11:14:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.088e-06 2024-04-26T11:14:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.539924+0000", 2024-04-26T11:14:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0833000000000001e-05 2024-04-26T11:14:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.540002+0000", 2024-04-26T11:14:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7649000000000001e-05 2024-04-26T11:14:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.540085+0000", 2024-04-26T11:14:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3337000000000005e-05 2024-04-26T11:14:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:05.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.544628+0000", 2024-04-26T11:14:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045426080000000001 2024-04-26T11:14:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.559036+0000", 2024-04-26T11:14:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014407503 2024-04-26T11:14:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.559090+0000", 2024-04-26T11:14:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4598999999999997e-05 2024-04-26T11:14:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:05.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.559114+0000", 2024-04-26T11:14:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3422999999999999e-05 2024-04-26T11:14:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:66094 5.e 5:71f1b4a0:::benchmark_data_smithi029_44842_object66093:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:02.540067+0000", 2024-04-26T11:14:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 2.5888765080000002, 2024-04-26T11:14:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019134480999999998, 2024-04-26T11:14:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:05.237 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 66094 2024-04-26T11:14:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.540067+0000", 2024-04-26T11:14:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.540067+0000", 2024-04-26T11:14:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.540066+0000", 2024-04-26T11:14:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.540160+0000", 2024-04-26T11:14:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4153000000000005e-05 2024-04-26T11:14:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.540169+0000", 2024-04-26T11:14:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0399999999999998e-06 2024-04-26T11:14:05.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.540176+0000", 2024-04-26T11:14:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.776e-06 2024-04-26T11:14:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.541723+0000", 2024-04-26T11:14:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001547051 2024-04-26T11:14:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.541830+0000", 2024-04-26T11:14:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107217 2024-04-26T11:14:05.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.541975+0000", 2024-04-26T11:14:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000145255 2024-04-26T11:14:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.547602+0000", 2024-04-26T11:14:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005626631 2024-04-26T11:14:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.559152+0000", 2024-04-26T11:14:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011549808999999999 2024-04-26T11:14:05.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.559181+0000", 2024-04-26T11:14:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9159e-05 2024-04-26T11:14:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.559201+0000", 2024-04-26T11:14:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0098999999999998e-05 2024-04-26T11:14:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:05.242 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:05.242 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:05.244 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:05.245 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:05.243+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:05.345 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:05.344+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:05.412 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 27 16 72661 72645 168.145 142.688 0.00277929 0.00594418 2024-04-26T11:14:05.431 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:05.431 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:05.431 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.431 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:72695 5.7 5:e312bd2b:::benchmark_data_smithi029_44842_object72694:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T11:14:05.431 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:05.425269+0000", 2024-04-26T11:14:05.431 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.003821872, 2024-04-26T11:14:05.432 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0038497330000000001, 2024-04-26T11:14:05.432 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.432 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:05.432 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:05.432 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:05.432 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.432 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 72695 2024-04-26T11:14:05.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.432 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.432 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.432 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.432 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425269+0000", 2024-04-26T11:14:05.432 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.432 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.433 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.433 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425269+0000", 2024-04-26T11:14:05.433 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.433 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.433 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.433 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425269+0000", 2024-04-26T11:14:05.433 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.433 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.433 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.433 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425376+0000", 2024-04-26T11:14:05.433 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000107478 2024-04-26T11:14:05.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.433 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.434 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.434 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425384+0000", 2024-04-26T11:14:05.435 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0080000000000002e-06 2024-04-26T11:14:05.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.435 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.435 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.435 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425389+0000", 2024-04-26T11:14:05.435 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1440000000000002e-06 2024-04-26T11:14:05.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.435 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.435 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.435 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425438+0000", 2024-04-26T11:14:05.435 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8588999999999998e-05 2024-04-26T11:14:05.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.436 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.436 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:05.436 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425592+0000", 2024-04-26T11:14:05.436 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000154611 2024-04-26T11:14:05.436 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.436 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.436 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.436 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.436 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.436 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:72696 5.3 5.e2627283 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T11:14:05.436 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:05.425399+0000", 2024-04-26T11:14:05.436 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.003692477, 2024-04-26T11:14:05.436 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0037750119999999999, 2024-04-26T11:14:05.436 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.436 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:05.437 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:05.437 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:05.437 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.437 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 72696 2024-04-26T11:14:05.437 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.437 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.437 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.437 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.437 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425399+0000", 2024-04-26T11:14:05.437 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.437 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.437 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.437 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.437 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425399+0000", 2024-04-26T11:14:05.438 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.438 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.438 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.438 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425398+0000", 2024-04-26T11:14:05.438 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.438 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.438 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.438 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425465+0000", 2024-04-26T11:14:05.438 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6957000000000003e-05 2024-04-26T11:14:05.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.438 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.438 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.438 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425475+0000", 2024-04-26T11:14:05.439 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0465999999999999e-05 2024-04-26T11:14:05.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.439 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.439 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.439 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425483+0000", 2024-04-26T11:14:05.439 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2869999999999999e-06 2024-04-26T11:14:05.439 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.439 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.439 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.439 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.439 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:72691 5.8 e29/16 5:1d0769b6:::benchmark_data_smithi029_44842_object72690:head v 29'4589, mlcod=29'4587)", 2024-04-26T11:14:05.439 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:05.425445+0000", 2024-04-26T11:14:05.440 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0036460440000000002, 2024-04-26T11:14:05.440 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0037668799999999998, 2024-04-26T11:14:05.440 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.440 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:05.440 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.440 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.440 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.440 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425445+0000", 2024-04-26T11:14:05.440 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.440 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.440 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.440 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425445+0000", 2024-04-26T11:14:05.440 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.441 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.441 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.441 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425444+0000", 2024-04-26T11:14:05.441 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.441 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.441 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.441 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.441 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425500+0000", 2024-04-26T11:14:05.441 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5634999999999998e-05 2024-04-26T11:14:05.441 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.441 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.441 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.441 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425508+0000", 2024-04-26T11:14:05.441 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0609999999999996e-06 2024-04-26T11:14:05.441 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.442 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.442 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.442 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425513+0000", 2024-04-26T11:14:05.442 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.532e-06 2024-04-26T11:14:05.442 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.442 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.442 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.442 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425539+0000", 2024-04-26T11:14:05.442 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6465000000000002e-05 2024-04-26T11:14:05.442 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.442 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.442 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:05.442 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425552+0000", 2024-04-26T11:14:05.443 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2823000000000001e-05 2024-04-26T11:14:05.443 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.443 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.443 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.443 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.443 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.443 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:72693 5.b e29/16 5:dfa3472b:::benchmark_data_smithi029_44842_object72692:head v 29'4596, mlcod=29'4594)", 2024-04-26T11:14:05.443 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:05.425776+0000", 2024-04-26T11:14:05.443 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0033148219999999998, 2024-04-26T11:14:05.443 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003481198, 2024-04-26T11:14:05.444 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.444 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:05.444 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.444 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.444 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.444 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425776+0000", 2024-04-26T11:14:05.444 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.445 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.445 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.445 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425776+0000", 2024-04-26T11:14:05.445 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.445 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.445 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.445 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425776+0000", 2024-04-26T11:14:05.445 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.446 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.446 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.446 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425813+0000", 2024-04-26T11:14:05.446 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7426999999999999e-05 2024-04-26T11:14:05.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.446 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.446 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.446 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425821+0000", 2024-04-26T11:14:05.446 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7689999999999996e-06 2024-04-26T11:14:05.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.446 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.447 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.447 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425841+0000", 2024-04-26T11:14:05.447 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9516000000000001e-05 2024-04-26T11:14:05.447 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.447 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.447 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.447 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.429020+0000", 2024-04-26T11:14:05.447 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003179266 2024-04-26T11:14:05.447 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.447 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.447 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:05.447 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.429037+0000", 2024-04-26T11:14:05.447 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.694e-05 2024-04-26T11:14:05.448 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.448 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.448 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.448 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.448 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.448 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:72698 5.a 5:5bf0b4e7:::benchmark_data_smithi029_44842_object72697:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T11:14:05.448 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:05.425816+0000", 2024-04-26T11:14:05.448 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0032750090000000002, 2024-04-26T11:14:05.448 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0034808009999999999, 2024-04-26T11:14:05.448 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.448 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:05.448 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:05.448 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:05.448 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.449 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 72698 2024-04-26T11:14:05.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.449 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.449 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.449 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.449 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425816+0000", 2024-04-26T11:14:05.449 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.449 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.449 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.449 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425816+0000", 2024-04-26T11:14:05.449 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.449 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.450 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.450 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425815+0000", 2024-04-26T11:14:05.450 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:05.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.450 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.450 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.450 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425921+0000", 2024-04-26T11:14:05.450 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105307 2024-04-26T11:14:05.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.450 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.450 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.450 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425933+0000", 2024-04-26T11:14:05.450 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2237e-05 2024-04-26T11:14:05.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.451 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.451 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.451 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425940+0000", 2024-04-26T11:14:05.451 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0140000000000001e-06 2024-04-26T11:14:05.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.451 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.451 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.451 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.426224+0000", 2024-04-26T11:14:05.451 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00028418900000000001 2024-04-26T11:14:05.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.451 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.451 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:05.451 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.426339+0000", 2024-04-26T11:14:05.451 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011449400000000001 2024-04-26T11:14:05.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.452 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.452 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:14:05.452 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.426473+0000", 2024-04-26T11:14:05.452 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013452700000000001 2024-04-26T11:14:05.452 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.452 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.452 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.452 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.452 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:72694 5.4 e29/16 5:2d2f8a18:::benchmark_data_smithi029_44842_object72693:head v 29'4562, mlcod=29'4560)", 2024-04-26T11:14:05.452 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:05.425850+0000", 2024-04-26T11:14:05.452 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0032407159999999998, 2024-04-26T11:14:05.453 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0034950179999999999, 2024-04-26T11:14:05.453 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.453 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:05.453 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.453 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.453 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.453 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425850+0000", 2024-04-26T11:14:05.453 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.453 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.453 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.453 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.453 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425850+0000", 2024-04-26T11:14:05.453 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.453 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.453 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.454 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.454 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425850+0000", 2024-04-26T11:14:05.454 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.454 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.454 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.454 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425930+0000", 2024-04-26T11:14:05.454 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9955000000000003e-05 2024-04-26T11:14:05.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.454 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.454 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.454 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425940+0000", 2024-04-26T11:14:05.454 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0263e-05 2024-04-26T11:14:05.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.455 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.455 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.455 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425947+0000", 2024-04-26T11:14:05.455 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9700000000000002e-06 2024-04-26T11:14:05.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.455 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.455 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.455 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425977+0000", 2024-04-26T11:14:05.455 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9961e-05 2024-04-26T11:14:05.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.455 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.455 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:05.455 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425994+0000", 2024-04-26T11:14:05.455 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6416999999999999e-05 2024-04-26T11:14:05.455 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.456 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.456 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.456 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.456 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.456 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:72700 5.6 5:65cfc04f:::benchmark_data_smithi029_44842_object72699:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T11:14:05.456 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:05.427678+0000", 2024-04-26T11:14:05.456 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0014134950000000001, 2024-04-26T11:14:05.456 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0017095610000000001, 2024-04-26T11:14:05.456 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.457 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:05.457 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:05.457 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:05.457 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.457 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 72700 2024-04-26T11:14:05.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.457 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.457 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.457 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.457 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.427678+0000", 2024-04-26T11:14:05.457 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.457 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.457 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.457 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.427678+0000", 2024-04-26T11:14:05.458 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.458 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.458 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.458 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.427677+0000", 2024-04-26T11:14:05.458 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:05.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.458 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.458 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.458 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.427744+0000", 2024-04-26T11:14:05.459 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6810999999999994e-05 2024-04-26T11:14:05.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.459 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.459 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.459 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.427761+0000", 2024-04-26T11:14:05.459 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7399000000000001e-05 2024-04-26T11:14:05.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.459 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.459 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.459 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.427769+0000", 2024-04-26T11:14:05.459 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.1759999999999993e-06 2024-04-26T11:14:05.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.459 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.459 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.459 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.427814+0000", 2024-04-26T11:14:05.460 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4672000000000002e-05 2024-04-26T11:14:05.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.460 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.460 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:05.460 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.427905+0000", 2024-04-26T11:14:05.460 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1001999999999994e-05 2024-04-26T11:14:05.460 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.460 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.460 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.460 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.460 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:72697 5.b e29/16)", 2024-04-26T11:14:05.460 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:05.427815+0000", 2024-04-26T11:14:05.460 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0012760169999999999, 2024-04-26T11:14:05.460 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016071810000000001, 2024-04-26T11:14:05.461 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.461 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:05.461 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.461 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.461 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.427815+0000", 2024-04-26T11:14:05.461 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.461 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.461 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.427815+0000", 2024-04-26T11:14:05.461 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.462 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.462 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.427815+0000", 2024-04-26T11:14:05.462 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.462 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.462 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.462 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.427862+0000", 2024-04-26T11:14:05.462 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7822999999999999e-05 2024-04-26T11:14:05.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.462 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.462 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.462 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.427872+0000", 2024-04-26T11:14:05.462 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.7499999999999998e-06 2024-04-26T11:14:05.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.462 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.463 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.463 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.427881+0000", 2024-04-26T11:14:05.463 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3340000000000002e-06 2024-04-26T11:14:05.463 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.463 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.463 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.463 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.463 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:72686 5.3 5:cd937947:::benchmark_data_smithi029_44842_object72685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T11:14:05.463 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:05.421217+0000", 2024-04-26T11:14:05.463 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0078739919999999998, 2024-04-26T11:14:05.463 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0082511839999999999, 2024-04-26T11:14:05.463 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.463 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:05.464 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:05.464 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:05.464 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.464 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 72686 2024-04-26T11:14:05.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.464 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.464 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.464 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.464 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.421217+0000", 2024-04-26T11:14:05.464 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.464 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.464 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.464 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.421217+0000", 2024-04-26T11:14:05.464 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.465 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.465 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.465 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.465 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.421217+0000", 2024-04-26T11:14:05.465 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.465 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.465 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.465 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.465 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.421241+0000", 2024-04-26T11:14:05.465 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4581000000000001e-05 2024-04-26T11:14:05.465 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.465 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.466 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.466 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.421249+0000", 2024-04-26T11:14:05.466 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4320000000000002e-06 2024-04-26T11:14:05.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.466 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.466 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.466 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.421255+0000", 2024-04-26T11:14:05.466 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8680000000000004e-06 2024-04-26T11:14:05.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.467 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.467 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.423589+0000", 2024-04-26T11:14:05.467 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0023349830000000001 2024-04-26T11:14:05.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.467 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:05.467 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.423711+0000", 2024-04-26T11:14:05.467 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000121962 2024-04-26T11:14:05.467 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.467 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.467 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.467 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:72683 5.0 e29/16 5:0249c634:::benchmark_data_smithi029_44842_object72682:head v 29'4597, mlcod=29'4592)", 2024-04-26T11:14:05.468 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:05.422690+0000", 2024-04-26T11:14:05.468 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0064014190000000002, 2024-04-26T11:14:05.468 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0068398979999999996, 2024-04-26T11:14:05.468 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.468 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:05.468 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.468 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.468 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.468 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.422690+0000", 2024-04-26T11:14:05.468 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.468 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.468 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.468 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.422690+0000", 2024-04-26T11:14:05.468 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.469 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.469 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.422689+0000", 2024-04-26T11:14:05.469 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.469 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.469 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.422741+0000", 2024-04-26T11:14:05.469 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1650000000000002e-05 2024-04-26T11:14:05.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.469 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.469 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.422751+0000", 2024-04-26T11:14:05.470 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.076e-05 2024-04-26T11:14:05.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.470 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.470 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.470 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.422758+0000", 2024-04-26T11:14:05.470 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4919999999999998e-06 2024-04-26T11:14:05.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.470 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.470 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.470 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.427307+0000", 2024-04-26T11:14:05.470 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0045490640000000002 2024-04-26T11:14:05.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.470 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.470 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:05.471 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.427325+0000", 2024-04-26T11:14:05.471 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8159e-05 2024-04-26T11:14:05.471 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.471 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.471 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.471 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.471 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:72688 5.1 5:89aed6da:::benchmark_data_smithi029_44842_object72687:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T11:14:05.471 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:05.424017+0000", 2024-04-26T11:14:05.471 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0050744500000000003, 2024-04-26T11:14:05.471 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.005587453, 2024-04-26T11:14:05.471 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.471 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:05.471 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:05.471 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:05.472 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.472 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 72688 2024-04-26T11:14:05.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.472 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.472 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.472 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.472 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.424017+0000", 2024-04-26T11:14:05.472 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.472 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.472 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.472 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.424017+0000", 2024-04-26T11:14:05.472 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.472 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.473 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.473 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.424016+0000", 2024-04-26T11:14:05.473 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:05.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.473 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.473 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.424086+0000", 2024-04-26T11:14:05.473 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9919000000000006e-05 2024-04-26T11:14:05.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.473 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.473 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.424094+0000", 2024-04-26T11:14:05.473 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.1419999999999993e-06 2024-04-26T11:14:05.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.474 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.474 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.424100+0000", 2024-04-26T11:14:05.474 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3999999999999997e-06 2024-04-26T11:14:05.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.474 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.474 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.424142+0000", 2024-04-26T11:14:05.474 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1278e-05 2024-04-26T11:14:05.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.474 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:05.474 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.424269+0000", 2024-04-26T11:14:05.474 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000127837 2024-04-26T11:14:05.474 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.475 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.475 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.475 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:72692 5.3 5:c5de7408:::benchmark_data_smithi029_44842_object72691:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T11:14:05.475 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:05.425144+0000", 2024-04-26T11:14:05.475 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0039467520000000004, 2024-04-26T11:14:05.475 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0045366709999999999, 2024-04-26T11:14:05.475 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.475 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:05.475 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:05.475 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:05.475 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.475 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 72692 2024-04-26T11:14:05.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.476 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.476 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.476 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.476 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425144+0000", 2024-04-26T11:14:05.476 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.476 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.476 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.476 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425144+0000", 2024-04-26T11:14:05.476 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.476 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.476 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.477 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425143+0000", 2024-04-26T11:14:05.477 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:05.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.477 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.477 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.477 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425194+0000", 2024-04-26T11:14:05.477 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0797000000000002e-05 2024-04-26T11:14:05.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.477 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.477 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.478 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425204+0000", 2024-04-26T11:14:05.478 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.8090000000000004e-06 2024-04-26T11:14:05.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.478 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.478 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.478 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425211+0000", 2024-04-26T11:14:05.478 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9029999999999998e-06 2024-04-26T11:14:05.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.478 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.478 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.478 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425551+0000", 2024-04-26T11:14:05.478 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00034044300000000001 2024-04-26T11:14:05.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.478 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.479 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:05.479 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.425658+0000", 2024-04-26T11:14:05.479 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010699700000000001 2024-04-26T11:14:05.479 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.479 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.479 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.479 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.479 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:14:05.479 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 12 2024-04-26T11:14:05.479 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:05.481 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:05.481 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:05.479+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:05.581 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:05.580+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:05.586 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:14:05.682 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:05.680+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:05.711 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:05.711 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:14:05.711 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:14:05.711 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:14:05.712 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:05.726 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:05.783 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:05.781+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:05.884 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:05.882+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:05.916 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:05.916 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:14:05.916 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:14:05.916 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:05.916 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.917 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:35483 5.b e23/16 5:d3dd14f6:::benchmark_data_smithi029_44842_object35482:head v 23'2304, mlcod=23'2300)", 2024-04-26T11:14:05.917 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:48.422102+0000", 2024-04-26T11:14:05.917 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 17.491230746999999, 2024-04-26T11:14:05.917 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.017674038, 2024-04-26T11:14:05.917 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.917 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:05.917 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.917 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.917 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.917 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422102+0000", 2024-04-26T11:14:05.917 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.917 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.917 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.918 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.918 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422102+0000", 2024-04-26T11:14:05.918 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.918 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.918 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.918 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.918 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422101+0000", 2024-04-26T11:14:05.918 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.918 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.918 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.918 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.918 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422129+0000", 2024-04-26T11:14:05.919 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8277999999999999e-05 2024-04-26T11:14:05.919 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.919 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.919 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.919 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422139+0000", 2024-04-26T11:14:05.919 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1290000000000002e-06 2024-04-26T11:14:05.919 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.919 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.919 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.919 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.422145+0000", 2024-04-26T11:14:05.919 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7490000000000001e-06 2024-04-26T11:14:05.919 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.920 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.920 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.920 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423217+0000", 2024-04-26T11:14:05.920 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0010718539999999999 2024-04-26T11:14:05.920 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.920 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.920 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:05.920 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.423234+0000", 2024-04-26T11:14:05.920 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6602000000000001e-05 2024-04-26T11:14:05.920 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.920 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.920 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:05.920 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439742+0000", 2024-04-26T11:14:05.921 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016508061000000001 2024-04-26T11:14:05.921 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.921 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.921 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:05.921 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:48.439776+0000", 2024-04-26T11:14:05.921 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3992000000000003e-05 2024-04-26T11:14:05.921 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.921 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.921 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.921 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.921 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.921 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:46902 5.6 5:6f103941:::benchmark_data_smithi029_44842_object46901:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:05.921 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.120845+0000", 2024-04-26T11:14:05.922 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.792487736, 2024-04-26T11:14:05.922 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018538669000000001, 2024-04-26T11:14:05.922 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.922 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:05.922 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:05.922 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:05.922 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.922 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 46902 2024-04-26T11:14:05.922 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.922 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.922 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.922 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.923 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120845+0000", 2024-04-26T11:14:05.923 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.923 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.923 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.923 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.923 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120845+0000", 2024-04-26T11:14:05.923 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.923 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.923 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.923 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.923 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120844+0000", 2024-04-26T11:14:05.923 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.923 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.924 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.924 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.924 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120870+0000", 2024-04-26T11:14:05.924 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5678e-05 2024-04-26T11:14:05.924 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.924 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.924 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.924 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120874+0000", 2024-04-26T11:14:05.924 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.3189999999999996e-06 2024-04-26T11:14:05.924 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.924 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.924 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.924 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120878+0000", 2024-04-26T11:14:05.925 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4240000000000002e-06 2024-04-26T11:14:05.925 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.925 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.925 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.925 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.126176+0000", 2024-04-26T11:14:05.925 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0052983630000000004 2024-04-26T11:14:05.925 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.925 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.925 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:05.925 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.126300+0000", 2024-04-26T11:14:05.925 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012375099999999999 2024-04-26T11:14:05.925 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.925 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.926 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:05.926 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.126426+0000", 2024-04-26T11:14:05.926 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012646399999999999 2024-04-26T11:14:05.926 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.926 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.926 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:05.926 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.132371+0000", 2024-04-26T11:14:05.926 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0059443839999999996 2024-04-26T11:14:05.926 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.926 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.926 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:05.926 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.139296+0000", 2024-04-26T11:14:05.927 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069250320000000002 2024-04-26T11:14:05.927 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.927 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.927 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:05.927 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.139347+0000", 2024-04-26T11:14:05.927 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0954e-05 2024-04-26T11:14:05.927 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.927 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.927 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:05.927 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.139383+0000", 2024-04-26T11:14:05.927 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6862e-05 2024-04-26T11:14:05.927 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.927 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.928 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.928 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.928 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.928 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:05.928 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:05.928 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.642585704, 2024-04-26T11:14:05.928 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:14:05.928 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.928 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:05.928 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:05.928 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:05.928 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.928 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:14:05.929 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.929 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.929 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.929 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.929 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:05.929 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.929 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.929 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.929 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.929 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:05.929 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.929 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.929 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.929 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.930 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:14:05.930 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.930 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.930 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.930 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.930 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:14:05.930 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:14:05.930 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.930 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.930 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.930 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:14:05.930 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:14:05.931 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.931 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.931 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.931 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:14:05.931 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:14:05.931 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.931 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.931 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.931 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:14:05.931 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:14:05.931 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.931 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.932 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:05.932 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:14:05.932 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:14:05.932 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.932 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.932 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:05.932 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:14:05.932 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:14:05.932 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.932 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.932 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:05.933 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:14:05.933 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:14:05.933 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.933 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.933 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:05.933 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:14:05.933 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:14:05.933 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.933 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.933 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:05.933 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:14:05.933 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:14:05.934 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.934 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.934 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:05.934 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:14:05.934 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:14:05.934 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.934 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.934 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.934 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.934 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.934 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:05.934 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:05.934 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.641774139000001, 2024-04-26T11:14:05.935 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:14:05.935 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.935 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:05.935 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:05.935 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:05.935 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.935 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:14:05.935 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.935 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.935 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.935 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.935 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:05.935 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.936 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.936 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.936 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.936 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:05.936 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.936 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.936 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.936 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.936 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:05.936 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:05.936 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.936 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.936 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.937 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:14:05.937 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:14:05.937 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.937 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.937 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.937 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:14:05.937 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:14:05.937 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.937 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.937 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.937 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:14:05.937 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:14:05.937 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.938 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.938 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.938 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:14:05.938 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:14:05.938 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.938 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.938 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:05.938 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:14:05.938 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:14:05.938 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.938 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.938 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:05.939 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:14:05.939 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:14:05.939 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.939 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.939 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:05.939 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:14:05.939 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:14:05.939 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.939 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.939 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:05.939 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:14:05.939 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:14:05.939 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.940 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.940 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:05.940 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:14:05.940 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:14:05.940 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.940 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.940 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:05.940 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:14:05.940 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:14:05.940 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.940 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.940 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.940 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.941 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.941 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:05.941 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:05.941 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.634587302, 2024-04-26T11:14:05.941 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:14:05.941 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.941 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:05.941 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:05.941 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:05.941 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.941 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:14:05.941 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.942 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.942 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.942 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.942 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:05.942 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.942 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.942 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.942 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.942 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:05.942 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.942 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.942 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.943 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.943 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:14:05.943 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:05.943 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.943 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.943 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.943 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:14:05.943 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:14:05.943 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.943 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.943 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.943 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:14:05.943 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:14:05.943 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.944 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.944 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.944 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:14:05.944 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:14:05.944 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.944 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.944 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.944 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:14:05.944 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:14:05.944 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.944 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.944 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:05.944 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:14:05.945 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:14:05.945 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.945 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.945 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:05.945 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:14:05.945 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:14:05.945 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.945 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.945 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:05.945 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:14:05.945 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:14:05.945 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.945 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.946 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:05.946 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:14:05.946 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:14:05.946 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.946 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.946 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:05.946 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:14:05.946 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:14:05.946 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.946 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.946 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:05.946 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:14:05.947 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:14:05.947 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.947 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.947 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.947 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.947 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.947 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:05.947 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:05.947 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.634046423000001, 2024-04-26T11:14:05.947 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:14:05.947 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.947 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:05.948 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:05.948 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:05.948 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.948 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:14:05.948 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.948 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.948 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.948 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.948 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:05.948 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.948 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.949 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.949 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.949 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:05.949 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.949 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.949 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.949 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.949 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:05.949 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.949 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.949 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.949 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.949 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:14:05.950 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:14:05.950 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.950 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.950 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.950 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:14:05.950 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:14:05.950 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.950 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.950 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.950 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:14:05.951 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:14:05.951 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.951 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.951 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.951 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:14:05.951 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:14:05.951 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.951 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.951 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:05.951 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:14:05.951 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:14:05.951 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.951 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.952 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:05.952 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:14:05.952 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:14:05.952 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.952 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.952 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:05.952 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:14:05.952 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:14:05.952 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.952 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.952 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:05.953 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:14:05.953 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:14:05.953 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.953 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.953 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:05.953 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:14:05.953 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:14:05.953 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.953 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.953 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:05.953 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:14:05.953 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:14:05.953 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.954 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.954 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.954 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.954 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.954 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:55119 5.6 5:6ad50111:::benchmark_data_smithi029_44842_object55118:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:05.954 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:05.954 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 9.1529827689999994, 2024-04-26T11:14:05.954 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018830264999999999, 2024-04-26T11:14:05.954 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.954 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:05.954 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:05.954 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:05.955 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.955 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 55119 2024-04-26T11:14:05.955 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.955 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.955 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.955 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.955 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:05.955 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.955 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.955 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.955 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.955 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:05.955 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.956 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.956 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.956 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.956 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760349+0000", 2024-04-26T11:14:05.956 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:05.956 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.956 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.956 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.956 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760402+0000", 2024-04-26T11:14:05.956 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2695999999999998e-05 2024-04-26T11:14:05.956 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.956 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.957 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.957 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760411+0000", 2024-04-26T11:14:05.957 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.0589999999999992e-06 2024-04-26T11:14:05.957 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.957 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.957 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.957 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760416+0000", 2024-04-26T11:14:05.957 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.587e-06 2024-04-26T11:14:05.957 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.957 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.957 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.957 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767638+0000", 2024-04-26T11:14:05.958 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0072214050000000002 2024-04-26T11:14:05.958 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.958 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.958 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:05.958 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767760+0000", 2024-04-26T11:14:05.958 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000122067 2024-04-26T11:14:05.958 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.958 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.958 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:05.958 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767927+0000", 2024-04-26T11:14:05.958 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00016747999999999999 2024-04-26T11:14:05.958 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.958 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.959 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:05.959 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.770877+0000", 2024-04-26T11:14:05.959 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002949335 2024-04-26T11:14:05.959 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.959 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.959 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:05.959 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779130+0000", 2024-04-26T11:14:05.959 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.008253491 2024-04-26T11:14:05.959 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.959 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.959 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:05.959 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779158+0000", 2024-04-26T11:14:05.960 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7849000000000001e-05 2024-04-26T11:14:05.960 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.960 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.960 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:05.960 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779180+0000", 2024-04-26T11:14:05.960 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2048999999999998e-05 2024-04-26T11:14:05.960 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.960 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.960 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.960 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.960 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.960 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:05.960 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:05.961 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.5908619759999993, 2024-04-26T11:14:05.961 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:14:05.961 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.961 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:05.961 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:05.961 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:05.961 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.961 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:14:05.961 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.961 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.961 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.961 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.962 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:05.962 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.962 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.962 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.962 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.962 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:05.962 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.962 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.962 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.962 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.962 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:14:05.963 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:05.963 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.963 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.963 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.963 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:14:05.963 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:14:05.963 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.963 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.963 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.963 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:14:05.963 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:14:05.963 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.963 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.964 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.964 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:14:05.964 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:14:05.964 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.964 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.964 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.964 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:14:05.964 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:14:05.964 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.964 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.964 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:05.964 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:14:05.964 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:14:05.965 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.965 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.965 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:05.965 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:14:05.965 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:14:05.965 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.965 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.965 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:05.965 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:14:05.965 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:14:05.965 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.965 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.966 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.966 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:14:05.966 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:14:05.966 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.966 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.966 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:05.966 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:14:05.966 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:14:05.966 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.966 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.966 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.966 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:14:05.967 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:14:05.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.967 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.967 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:05.967 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:14:05.967 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:14:05.967 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.967 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.967 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.967 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.967 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:05.967 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:05.968 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.5886686359999995, 2024-04-26T11:14:05.968 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:14:05.968 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.968 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:05.968 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:05.968 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:05.968 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.968 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:14:05.968 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.968 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.968 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.968 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.968 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:05.969 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.969 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.969 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.969 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.969 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:05.969 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.969 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.969 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.969 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.969 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:14:05.969 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:05.969 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.969 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.970 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.970 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:14:05.970 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:14:05.970 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.970 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.970 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.970 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:14:05.970 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:14:05.970 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.970 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.970 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.971 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:14:05.971 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:14:05.971 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.971 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.971 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.971 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:14:05.971 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:14:05.971 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.971 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.971 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:05.971 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:14:05.971 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:14:05.971 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.972 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.972 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:05.972 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:14:05.972 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:14:05.972 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.972 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.972 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:05.972 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:14:05.972 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:14:05.972 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.972 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.972 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.973 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:14:05.973 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:14:05.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.973 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.973 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:05.973 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:14:05.973 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:14:05.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.973 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.973 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.973 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:14:05.973 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:14:05.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.974 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.974 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:05.974 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:14:05.974 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:14:05.974 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.974 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.974 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.974 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.974 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.974 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:05.974 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:05.975 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.5834568119999997, 2024-04-26T11:14:05.975 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:14:05.975 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.975 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:05.975 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:05.975 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:05.975 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.975 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:14:05.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.975 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.975 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.975 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.976 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:05.976 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.976 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.976 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.976 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:05.976 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.976 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.976 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.976 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:14:05.976 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:05.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.977 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.977 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.977 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:14:05.977 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:14:05.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.977 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.977 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.977 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:14:05.977 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:14:05.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.978 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.978 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.978 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:14:05.978 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:14:05.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.978 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.978 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.978 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:14:05.978 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:14:05.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.978 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.978 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:05.979 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:14:05.979 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:14:05.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.979 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.979 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:05.979 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:14:05.979 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:14:05.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.979 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.979 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:05.979 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:14:05.979 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:14:05.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.980 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.980 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:14:05.980 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:14:05.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.980 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:05.980 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:14:05.980 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:14:05.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.980 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.980 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:14:05.981 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:14:05.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.981 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.981 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:05.981 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:14:05.981 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:14:05.981 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.981 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.981 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.981 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.981 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:05.982 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:05.982 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.5670081119999999, 2024-04-26T11:14:05.982 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:14:05.982 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.982 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:05.982 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:05.982 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:05.982 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.982 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:14:05.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.982 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.983 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.983 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:05.983 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.983 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.983 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:05.983 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.983 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.984 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:14:05.984 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:05.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.984 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.984 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:14:05.984 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:14:05.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.984 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.984 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:14:05.985 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:14:05.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.985 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.985 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.985 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:14:05.985 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:14:05.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.985 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.985 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.985 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:14:05.985 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:14:05.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.986 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:05.986 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:14:05.986 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:14:05.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.986 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.986 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:14:05.986 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:14:05.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.987 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:05.987 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:14:05.987 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:14:05.987 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.987 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.987 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.987 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:05.987 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:05.987 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.5653106070000007, 2024-04-26T11:14:05.987 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:14:05.988 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.988 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:05.988 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:05.988 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:05.988 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.988 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:14:05.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.988 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.988 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.988 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.988 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:05.988 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.989 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.989 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.989 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:05.989 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.989 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.989 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.989 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:14:05.989 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:05.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.989 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.990 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.990 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:14:05.990 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:14:05.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.990 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.990 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.990 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:14:05.990 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:14:05.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.990 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.990 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.990 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:14:05.991 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:14:05.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.991 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.991 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:14:05.991 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:14:05.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.991 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:05.991 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:14:05.991 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:14:05.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.992 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.992 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:14:05.992 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:14:05.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.992 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.992 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:05.992 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:14:05.992 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:14:05.992 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.992 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.992 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.993 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.993 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:05.993 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:05.993 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.5652463050000005, 2024-04-26T11:14:05.993 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:14:05.993 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:05.993 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:05.993 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:05.993 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:05.993 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:05.993 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:14:05.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.994 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:05.994 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.994 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:05.994 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:05.994 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.994 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.994 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:05.994 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:05.994 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:05.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.995 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:05.995 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:05.995 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:05.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.995 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:05.995 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:14:05.995 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:14:05.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.995 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:05.995 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:14:05.996 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:14:05.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.996 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.996 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:05.996 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:14:05.996 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:14:05.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.996 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.996 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.996 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:14:05.996 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:14:05.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.997 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:05.997 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:14:05.997 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:14:05.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.997 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:05.997 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:14:05.997 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:14:05.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.997 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:05.997 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:14:05.998 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:14:05.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.998 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.998 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:05.998 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:14:05.998 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:14:05.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.998 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.998 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:05.998 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:14:05.998 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:14:05.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.999 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.999 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:05.999 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:14:05.999 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:14:05.999 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.999 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:05.999 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:05.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:05.999 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:05.999 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:05.999 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:06.000 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.5651920809999993, 2024-04-26T11:14:06.001 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:14:06.001 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:06.001 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:06.001 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:06.001 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:06.001 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.001 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:14:06.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.002 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:06.002 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.002 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:06.002 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:06.002 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.002 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.002 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:06.002 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:06.002 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.003 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.003 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:06.003 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:06.003 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.003 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.003 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:06.003 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:14:06.003 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:14:06.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.003 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.003 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:06.003 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:14:06.004 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:14:06.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.004 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.004 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.004 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:14:06.004 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:14:06.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.004 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.004 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.004 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:14:06.004 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:14:06.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.004 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.005 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:06.005 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:14:06.005 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:14:06.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.005 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.005 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:14:06.005 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:14:06.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.005 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:06.005 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:14:06.006 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:14:06.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.006 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.006 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:06.006 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:14:06.006 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:14:06.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.006 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.006 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:06.006 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:14:06.006 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:06.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.007 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:06.007 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:14:06.007 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:14:06.007 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.007 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:06.007 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.007 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:06.007 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:06.007 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.5651475690000005, 2024-04-26T11:14:06.007 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:14:06.008 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:06.008 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:06.008 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:06.008 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:06.008 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.008 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:14:06.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.008 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:06.008 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.008 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:06.008 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:06.008 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.009 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:06.009 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:06.009 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.009 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:06.009 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:14:06.009 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.009 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:06.009 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:14:06.010 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:14:06.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.010 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.010 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:06.010 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:14:06.010 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:14:06.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.010 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.010 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.010 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:14:06.010 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:14:06.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.010 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.011 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.011 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:14:06.011 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:14:06.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.011 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:06.011 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:14:06.011 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:14:06.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.011 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.012 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:14:06.012 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:14:06.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.012 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.012 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:06.012 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:14:06.012 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:14:06.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.012 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.012 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:06.012 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:14:06.012 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:14:06.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.013 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.013 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:06.013 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:14:06.013 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:14:06.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.013 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.013 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:06.013 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:14:06.013 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:14:06.013 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.013 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:06.013 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.014 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:06.014 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:06.014 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.5609265669999992, 2024-04-26T11:14:06.014 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:14:06.014 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:06.014 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:06.014 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:06.014 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:06.014 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.014 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:14:06.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.015 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:06.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.015 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:06.015 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:06.015 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.015 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:06.015 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:06.015 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.016 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.016 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:06.016 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:14:06.016 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:14:06.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.016 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.016 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:06.016 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:14:06.016 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:14:06.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.016 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.016 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:06.016 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:14:06.017 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:14:06.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.017 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.017 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:14:06.017 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:14:06.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.017 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.017 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:14:06.017 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:14:06.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.018 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.018 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:06.018 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:14:06.018 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:14:06.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.018 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.018 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.018 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:14:06.018 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:14:06.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.018 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.018 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:06.019 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:14:06.019 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:14:06.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.019 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.019 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:06.019 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:14:06.019 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:14:06.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.019 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.019 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:06.019 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:14:06.019 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:14:06.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.020 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:06.020 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:14:06.020 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:14:06.020 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.020 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:06.020 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.020 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:61817 5.a 5:5627ce7f:::benchmark_data_smithi029_44842_object61816:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:06.020 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:06.020 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 5.2108011139999997, 2024-04-26T11:14:06.021 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020626958000000001, 2024-04-26T11:14:06.021 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:06.021 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:06.021 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:06.021 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:06.021 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.021 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 61817 2024-04-26T11:14:06.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.021 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:06.021 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.021 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:06.021 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:06.021 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.022 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:06.022 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:06.022 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.022 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:06.022 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:06.022 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.023 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:06.023 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702591+0000", 2024-04-26T11:14:06.023 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0665999999999998e-05 2024-04-26T11:14:06.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.023 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.023 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:06.023 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702599+0000", 2024-04-26T11:14:06.023 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7130000000000005e-06 2024-04-26T11:14:06.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.023 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.023 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.023 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702605+0000", 2024-04-26T11:14:06.023 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4310000000000002e-06 2024-04-26T11:14:06.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.024 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.024 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.024 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.707947+0000", 2024-04-26T11:14:06.024 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053424220000000003 2024-04-26T11:14:06.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.024 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.024 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:06.024 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.708052+0000", 2024-04-26T11:14:06.024 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010499 2024-04-26T11:14:06.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.024 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.025 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:14:06.025 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.708141+0000", 2024-04-26T11:14:06.025 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9514999999999999e-05 2024-04-26T11:14:06.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.025 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:06.025 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.711954+0000", 2024-04-26T11:14:06.025 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003812265 2024-04-26T11:14:06.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.025 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:06.025 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723070+0000", 2024-04-26T11:14:06.026 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011116727 2024-04-26T11:14:06.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.026 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.026 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:06.026 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723121+0000", 2024-04-26T11:14:06.026 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0362999999999999e-05 2024-04-26T11:14:06.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.026 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.026 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:06.026 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723158+0000", 2024-04-26T11:14:06.026 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7579000000000001e-05 2024-04-26T11:14:06.026 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.027 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:06.027 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.027 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.027 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:65963 5.1 5:8510f6d6:::benchmark_data_smithi029_44842_object65962:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:06.027 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:02.487474+0000", 2024-04-26T11:14:06.027 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 3.4258588329999999, 2024-04-26T11:14:06.027 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.017703408, 2024-04-26T11:14:06.027 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:06.027 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:06.027 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:06.027 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:06.027 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.028 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 65963 2024-04-26T11:14:06.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.028 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:06.028 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.028 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:06.028 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.487474+0000", 2024-04-26T11:14:06.028 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.028 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.028 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:06.028 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.487474+0000", 2024-04-26T11:14:06.028 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.029 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:06.029 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.487473+0000", 2024-04-26T11:14:06.029 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.029 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:06.029 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.487513+0000", 2024-04-26T11:14:06.029 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9789000000000001e-05 2024-04-26T11:14:06.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.029 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:06.030 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.487520+0000", 2024-04-26T11:14:06.030 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0999999999999998e-06 2024-04-26T11:14:06.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.030 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.030 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.030 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.487525+0000", 2024-04-26T11:14:06.030 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4240000000000001e-06 2024-04-26T11:14:06.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.030 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.030 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.030 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.490477+0000", 2024-04-26T11:14:06.031 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0029518040000000001 2024-04-26T11:14:06.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.031 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.031 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:06.031 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.490594+0000", 2024-04-26T11:14:06.031 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011702 2024-04-26T11:14:06.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.031 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.031 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:06.031 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.505073+0000", 2024-04-26T11:14:06.031 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.014478781 2024-04-26T11:14:06.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.032 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.032 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:06.032 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.505111+0000", 2024-04-26T11:14:06.032 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7979999999999999e-05 2024-04-26T11:14:06.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.032 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.032 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:06.032 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.505177+0000", 2024-04-26T11:14:06.032 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6019999999999995e-05 2024-04-26T11:14:06.032 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.032 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:06.032 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.033 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.033 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:72686 5.3 5:cd937947:::benchmark_data_smithi029_44842_object72685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T11:14:06.033 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:05.421217+0000", 2024-04-26T11:14:06.033 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.49211543899999999, 2024-04-26T11:14:06.033 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.017578954000000001, 2024-04-26T11:14:06.033 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:06.033 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:06.033 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:06.033 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:06.033 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.033 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 72686 2024-04-26T11:14:06.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.034 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:06.034 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.034 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:06.034 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.421217+0000", 2024-04-26T11:14:06.034 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.034 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.034 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:06.034 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.421217+0000", 2024-04-26T11:14:06.034 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.034 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.034 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:06.035 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.421217+0000", 2024-04-26T11:14:06.035 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.035 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.035 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.035 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:06.035 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.421241+0000", 2024-04-26T11:14:06.035 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4581000000000001e-05 2024-04-26T11:14:06.035 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.035 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.035 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:06.035 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.421249+0000", 2024-04-26T11:14:06.036 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4320000000000002e-06 2024-04-26T11:14:06.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.036 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.036 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.036 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.421255+0000", 2024-04-26T11:14:06.036 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8680000000000004e-06 2024-04-26T11:14:06.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.036 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.036 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.036 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.423589+0000", 2024-04-26T11:14:06.036 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0023349830000000001 2024-04-26T11:14:06.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.037 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.037 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:06.037 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.423711+0000", 2024-04-26T11:14:06.037 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000121962 2024-04-26T11:14:06.037 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.037 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.037 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:06.037 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.438721+0000", 2024-04-26T11:14:06.037 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015009363 2024-04-26T11:14:06.037 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.037 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.037 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:06.038 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.438752+0000", 2024-04-26T11:14:06.038 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0760999999999999e-05 2024-04-26T11:14:06.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.038 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.038 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:06.038 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.438796+0000", 2024-04-26T11:14:06.038 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4456000000000003e-05 2024-04-26T11:14:06.038 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.038 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:06.038 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.039 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.039 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:73309 5.6 5:6e28f214:::benchmark_data_smithi029_44842_object73308:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T11:14:06.039 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:05.688811+0000", 2024-04-26T11:14:06.039 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.22452139099999999, 2024-04-26T11:14:06.039 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018666492999999999, 2024-04-26T11:14:06.039 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:06.039 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:06.039 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:06.039 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:06.039 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.039 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 73309 2024-04-26T11:14:06.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.040 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:06.040 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.040 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:06.040 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.688811+0000", 2024-04-26T11:14:06.040 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.040 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.040 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:06.042 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.688811+0000", 2024-04-26T11:14:06.042 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.042 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.042 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:06.042 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.688810+0000", 2024-04-26T11:14:06.042 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:06.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.043 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.043 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:06.043 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.688886+0000", 2024-04-26T11:14:06.043 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5746000000000003e-05 2024-04-26T11:14:06.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.043 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.043 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:06.043 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.688895+0000", 2024-04-26T11:14:06.043 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7649999999999999e-06 2024-04-26T11:14:06.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.043 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.043 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.044 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.688901+0000", 2024-04-26T11:14:06.044 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3559999999999998e-06 2024-04-26T11:14:06.044 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.044 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.044 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.044 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.698522+0000", 2024-04-26T11:14:06.044 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0096204299999999993 2024-04-26T11:14:06.044 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.044 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.044 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:06.044 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.698613+0000", 2024-04-26T11:14:06.044 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1440999999999994e-05 2024-04-26T11:14:06.044 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.045 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.045 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:06.045 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.707323+0000", 2024-04-26T11:14:06.045 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.008709662 2024-04-26T11:14:06.045 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.045 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.045 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:06.045 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.707391+0000", 2024-04-26T11:14:06.045 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8137000000000002e-05 2024-04-26T11:14:06.045 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.045 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.045 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:06.046 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.707478+0000", 2024-04-26T11:14:06.046 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6729000000000003e-05 2024-04-26T11:14:06.046 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.046 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:06.046 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.046 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.046 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:06.046 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:06.047 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:06.047 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:06.040+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:06.142 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:06.141+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:06.213 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:06.214 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:06.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.214 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:74477 5.4 5:2d151a86:::benchmark_data_smithi029_44842_object74476:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T11:14:06.214 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:06.204701+0000", 2024-04-26T11:14:06.214 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0080386980000000004, 2024-04-26T11:14:06.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0080596799999999996, 2024-04-26T11:14:06.214 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:06.214 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:06.214 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:06.215 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:06.215 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.215 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 74477 2024-04-26T11:14:06.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.215 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:06.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:06.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.204701+0000", 2024-04-26T11:14:06.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:06.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.204701+0000", 2024-04-26T11:14:06.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:06.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.204700+0000", 2024-04-26T11:14:06.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:06.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.204765+0000", 2024-04-26T11:14:06.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5219e-05 2024-04-26T11:14:06.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:06.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.204772+0000", 2024-04-26T11:14:06.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6420000000000001e-06 2024-04-26T11:14:06.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.204776+0000", 2024-04-26T11:14:06.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9580000000000001e-06 2024-04-26T11:14:06.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.204819+0000", 2024-04-26T11:14:06.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3429e-05 2024-04-26T11:14:06.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:06.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.204961+0000", 2024-04-26T11:14:06.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000141932 2024-04-26T11:14:06.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:06.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.205128+0000", 2024-04-26T11:14:06.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000166391 2024-04-26T11:14:06.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:06.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.209123+0000", 2024-04-26T11:14:06.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039955169999999996 2024-04-26T11:14:06.219 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.219 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.219 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.219 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:74480 5.4 5:2a8f5d3a:::benchmark_data_smithi029_44842_object74479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T11:14:06.219 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:06.205955+0000", 2024-04-26T11:14:06.219 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0067846499999999997, 2024-04-26T11:14:06.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.006860952, 2024-04-26T11:14:06.219 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:06.219 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:06.219 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:06.220 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:06.220 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.220 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 74480 2024-04-26T11:14:06.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.220 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:06.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:06.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.205955+0000", 2024-04-26T11:14:06.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:06.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.205955+0000", 2024-04-26T11:14:06.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:06.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.205954+0000", 2024-04-26T11:14:06.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:06.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.206067+0000", 2024-04-26T11:14:06.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011305 2024-04-26T11:14:06.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:06.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.206076+0000", 2024-04-26T11:14:06.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8969999999999997e-06 2024-04-26T11:14:06.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.206087+0000", 2024-04-26T11:14:06.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0682e-05 2024-04-26T11:14:06.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.207209+0000", 2024-04-26T11:14:06.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011220539999999999 2024-04-26T11:14:06.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:06.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.207342+0000", 2024-04-26T11:14:06.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013290099999999999 2024-04-26T11:14:06.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:06.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.207486+0000", 2024-04-26T11:14:06.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014460499999999999 2024-04-26T11:14:06.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:06.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.209620+0000", 2024-04-26T11:14:06.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021337639999999998 2024-04-26T11:14:06.224 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.224 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.224 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.224 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:74490 5.d 5:b3c2246a:::benchmark_data_smithi029_44842_object74489:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T11:14:06.224 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:06.210659+0000", 2024-04-26T11:14:06.224 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0020804579999999999, 2024-04-26T11:14:06.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022051100000000001, 2024-04-26T11:14:06.224 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:06.224 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:06.224 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:06.224 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:06.225 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.225 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 74490 2024-04-26T11:14:06.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.225 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:06.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:06.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.210659+0000", 2024-04-26T11:14:06.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:06.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.210659+0000", 2024-04-26T11:14:06.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:06.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.210658+0000", 2024-04-26T11:14:06.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:06.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.210717+0000", 2024-04-26T11:14:06.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8362999999999997e-05 2024-04-26T11:14:06.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:06.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.210723+0000", 2024-04-26T11:14:06.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9839999999999998e-06 2024-04-26T11:14:06.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.210727+0000", 2024-04-26T11:14:06.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1060000000000002e-06 2024-04-26T11:14:06.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.210770+0000", 2024-04-26T11:14:06.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.295e-05 2024-04-26T11:14:06.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:06.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.210898+0000", 2024-04-26T11:14:06.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012876599999999999 2024-04-26T11:14:06.228 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.228 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.228 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.228 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:74492 5.b 5:dcbb1088:::benchmark_data_smithi029_44842_object74491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T11:14:06.229 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:06.210754+0000", 2024-04-26T11:14:06.229 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.001985648, 2024-04-26T11:14:06.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021510050000000001, 2024-04-26T11:14:06.229 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:06.229 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:06.229 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:06.229 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:06.229 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.229 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 74492 2024-04-26T11:14:06.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.229 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:06.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:06.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.210754+0000", 2024-04-26T11:14:06.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:06.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.210754+0000", 2024-04-26T11:14:06.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:06.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.210753+0000", 2024-04-26T11:14:06.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:06.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.210802+0000", 2024-04-26T11:14:06.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8646000000000001e-05 2024-04-26T11:14:06.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:06.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.210807+0000", 2024-04-26T11:14:06.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0649999999999998e-06 2024-04-26T11:14:06.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.210811+0000", 2024-04-26T11:14:06.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6650000000000001e-06 2024-04-26T11:14:06.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.210835+0000", 2024-04-26T11:14:06.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4119000000000001e-05 2024-04-26T11:14:06.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:06.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.210909+0000", 2024-04-26T11:14:06.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4012999999999998e-05 2024-04-26T11:14:06.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:06.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.210988+0000", 2024-04-26T11:14:06.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9136999999999998e-05 2024-04-26T11:14:06.232 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.232 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.232 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.232 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.233 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:14:06.233 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 4 2024-04-26T11:14:06.233 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:06.234 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:06.278 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:06.276+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:06.344 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:06.343+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:06.404 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:06.405 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:14:06.405 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:14:06.405 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:14:06.405 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:06.412 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 28 16 74976 74960 167.306 144.688 0.00520914 0.00597443 2024-04-26T11:14:06.419 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:06.460 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:06.458+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:06.545 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:06.544+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:06.580 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:14:06.637 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:06.637 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:14:06.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:14:06.637 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:06.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.637 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35482 5.b 5:d2b3ef95:::benchmark_data_smithi029_44842_object35481:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:14:06.637 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:14:06.637 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 18.214301266, 2024-04-26T11:14:06.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019390455000000001, 2024-04-26T11:14:06.637 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:06.637 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:06.637 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:06.638 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:06.638 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.638 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35482 2024-04-26T11:14:06.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.638 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:06.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:06.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:14:06.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:06.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:14:06.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:06.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418681+0000", 2024-04-26T11:14:06.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:06.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:06.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418802+0000", 2024-04-26T11:14:06.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120835 2024-04-26T11:14:06.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:06.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418810+0000", 2024-04-26T11:14:06.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1240000000000005e-06 2024-04-26T11:14:06.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418816+0000", 2024-04-26T11:14:06.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5749999999999997e-06 2024-04-26T11:14:06.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.419905+0000", 2024-04-26T11:14:06.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001088751 2024-04-26T11:14:06.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:06.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.420046+0000", 2024-04-26T11:14:06.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140514 2024-04-26T11:14:06.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:06.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.420180+0000", 2024-04-26T11:14:06.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440899999999999 2024-04-26T11:14:06.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:06.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425415+0000", 2024-04-26T11:14:06.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052350540000000003 2024-04-26T11:14:06.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:06.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.437989+0000", 2024-04-26T11:14:06.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012573632 2024-04-26T11:14:06.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:06.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.438035+0000", 2024-04-26T11:14:06.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5799e-05 2024-04-26T11:14:06.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:06.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.438072+0000", 2024-04-26T11:14:06.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7530999999999997e-05 2024-04-26T11:14:06.642 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.642 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.642 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.643 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35483 5.b 5:d3dd14f6:::benchmark_data_smithi029_44842_object35482:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:14:06.643 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:06.643 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 18.214158523999998, 2024-04-26T11:14:06.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021245969, 2024-04-26T11:14:06.643 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:06.643 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:06.643 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:06.643 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:06.643 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.643 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35483 2024-04-26T11:14:06.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.643 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:06.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:06.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:06.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:06.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:06.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:06.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:06.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:06.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418885+0000", 2024-04-26T11:14:06.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1294e-05 2024-04-26T11:14:06.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:06.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418892+0000", 2024-04-26T11:14:06.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4599999999999997e-06 2024-04-26T11:14:06.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418899+0000", 2024-04-26T11:14:06.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0909999999999998e-06 2024-04-26T11:14:06.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421347+0000", 2024-04-26T11:14:06.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024484609999999999 2024-04-26T11:14:06.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:06.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421468+0000", 2024-04-26T11:14:06.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000121179 2024-04-26T11:14:06.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:06.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421605+0000", 2024-04-26T11:14:06.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013672200000000001 2024-04-26T11:14:06.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:06.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425456+0000", 2024-04-26T11:14:06.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038511719999999999 2024-04-26T11:14:06.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:06.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.439986+0000", 2024-04-26T11:14:06.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014530080000000001 2024-04-26T11:14:06.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:06.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440038+0000", 2024-04-26T11:14:06.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1916999999999998e-05 2024-04-26T11:14:06.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:06.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440070+0000", 2024-04-26T11:14:06.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2245e-05 2024-04-26T11:14:06.648 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.649 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.649 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.649 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44504 5.0 5:0536d5a4:::benchmark_data_smithi029_44842_object44503:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:06.649 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:14:06.649 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 14.463696902000001, 2024-04-26T11:14:06.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018576187000000001, 2024-04-26T11:14:06.649 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:06.649 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:06.649 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:06.649 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:06.649 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.649 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44504 2024-04-26T11:14:06.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.650 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:06.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:06.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:14:06.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:06.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:14:06.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:06.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169286+0000", 2024-04-26T11:14:06.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:06.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169304+0000", 2024-04-26T11:14:06.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8331000000000001e-05 2024-04-26T11:14:06.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:06.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169308+0000", 2024-04-26T11:14:06.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9609999999999999e-06 2024-04-26T11:14:06.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169311+0000", 2024-04-26T11:14:06.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.044e-06 2024-04-26T11:14:06.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.174118+0000", 2024-04-26T11:14:06.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004806645 2024-04-26T11:14:06.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:06.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.174207+0000", 2024-04-26T11:14:06.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9665000000000003e-05 2024-04-26T11:14:06.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:06.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.174308+0000", 2024-04-26T11:14:06.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100399 2024-04-26T11:14:06.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:06.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.185001+0000", 2024-04-26T11:14:06.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010693599 2024-04-26T11:14:06.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:06.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187698+0000", 2024-04-26T11:14:06.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026970929999999998 2024-04-26T11:14:06.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:06.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187777+0000", 2024-04-26T11:14:06.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8335000000000001e-05 2024-04-26T11:14:06.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:06.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187862+0000", 2024-04-26T11:14:06.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5521999999999999e-05 2024-04-26T11:14:06.655 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.655 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.655 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.655 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44506 5.0 5:07ec7127:::benchmark_data_smithi029_44842_object44505:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:06.655 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:14:06.655 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 14.463396982999999, 2024-04-26T11:14:06.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018482386999999999, 2024-04-26T11:14:06.655 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:06.655 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:06.656 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:06.656 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:06.656 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.656 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44506 2024-04-26T11:14:06.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.656 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:06.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:06.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:14:06.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:06.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:14:06.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:06.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169586+0000", 2024-04-26T11:14:06.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:06.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169730+0000", 2024-04-26T11:14:06.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014447200000000001 2024-04-26T11:14:06.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:06.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169738+0000", 2024-04-26T11:14:06.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5700000000000004e-06 2024-04-26T11:14:06.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.169741+0000", 2024-04-26T11:14:06.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3909999999999998e-06 2024-04-26T11:14:06.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.176682+0000", 2024-04-26T11:14:06.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0069412129999999999 2024-04-26T11:14:06.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:06.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.176816+0000", 2024-04-26T11:14:06.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000134265 2024-04-26T11:14:06.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:06.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.176952+0000", 2024-04-26T11:14:06.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013520000000000001 2024-04-26T11:14:06.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:06.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.185004+0000", 2024-04-26T11:14:06.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0080524959999999993 2024-04-26T11:14:06.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:06.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.187983+0000", 2024-04-26T11:14:06.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0029783330000000001 2024-04-26T11:14:06.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:06.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188031+0000", 2024-04-26T11:14:06.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8588000000000003e-05 2024-04-26T11:14:06.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:06.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188068+0000", 2024-04-26T11:14:06.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7154999999999999e-05 2024-04-26T11:14:06.660 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.660 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.660 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.661 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44513 5.0 5:0a236ebb:::benchmark_data_smithi029_44842_object44512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:06.661 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:06.661 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 14.462895544, 2024-04-26T11:14:06.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020724414, 2024-04-26T11:14:06.661 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:06.661 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:06.661 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:06.661 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:06.661 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.661 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44513 2024-04-26T11:14:06.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.661 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:06.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:06.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:06.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:06.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:06.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:06.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:06.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:06.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170120+0000", 2024-04-26T11:14:06.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2941000000000002e-05 2024-04-26T11:14:06.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:06.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170127+0000", 2024-04-26T11:14:06.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.469e-06 2024-04-26T11:14:06.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170133+0000", 2024-04-26T11:14:06.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1340000000000001e-06 2024-04-26T11:14:06.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182383+0000", 2024-04-26T11:14:06.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012249970000000001 2024-04-26T11:14:06.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:06.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182477+0000", 2024-04-26T11:14:06.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3776999999999993e-05 2024-04-26T11:14:06.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:06.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182572+0000", 2024-04-26T11:14:06.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4841999999999998e-05 2024-04-26T11:14:06.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:06.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188262+0000", 2024-04-26T11:14:06.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005690077 2024-04-26T11:14:06.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:06.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190748+0000", 2024-04-26T11:14:06.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024857780000000001 2024-04-26T11:14:06.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:06.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190776+0000", 2024-04-26T11:14:06.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8419999999999999e-05 2024-04-26T11:14:06.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:06.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190812+0000", 2024-04-26T11:14:06.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5630999999999998e-05 2024-04-26T11:14:06.666 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.666 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.666 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.666 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44794 5.8 5:158fd219:::benchmark_data_smithi029_44842_object44793:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:06.666 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.283382+0000", 2024-04-26T11:14:06.666 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 14.349600967000001, 2024-04-26T11:14:06.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018701497000000001, 2024-04-26T11:14:06.666 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:06.666 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:06.667 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:06.667 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:06.667 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.667 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44794 2024-04-26T11:14:06.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.667 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:06.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:06.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283382+0000", 2024-04-26T11:14:06.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:06.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283382+0000", 2024-04-26T11:14:06.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:06.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283381+0000", 2024-04-26T11:14:06.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:06.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283409+0000", 2024-04-26T11:14:06.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.798e-05 2024-04-26T11:14:06.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:06.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283417+0000", 2024-04-26T11:14:06.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2629999999999997e-06 2024-04-26T11:14:06.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.283424+0000", 2024-04-26T11:14:06.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1210000000000001e-06 2024-04-26T11:14:06.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.286843+0000", 2024-04-26T11:14:06.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034194490000000002 2024-04-26T11:14:06.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:06.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.286932+0000", 2024-04-26T11:14:06.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9065000000000002e-05 2024-04-26T11:14:06.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:06.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.287019+0000", 2024-04-26T11:14:06.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6976000000000002e-05 2024-04-26T11:14:06.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:06.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.288238+0000", 2024-04-26T11:14:06.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012185 2024-04-26T11:14:06.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:06.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.302032+0000", 2024-04-26T11:14:06.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013794618999999999 2024-04-26T11:14:06.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:06.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.302061+0000", 2024-04-26T11:14:06.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9008000000000001e-05 2024-04-26T11:14:06.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:06.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.302083+0000", 2024-04-26T11:14:06.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2002e-05 2024-04-26T11:14:06.671 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.671 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.671 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.672 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:06.672 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:06.672 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.354192522, 2024-04-26T11:14:06.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:14:06.672 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:06.672 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:06.672 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:06.672 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:06.672 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.672 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:14:06.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.672 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:06.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:06.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:06.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:06.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:06.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:06.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:06.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:06.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:14:06.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:14:06.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:06.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:14:06.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:14:06.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:14:06.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:14:06.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:14:06.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:14:06.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:06.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:14:06.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:14:06.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:06.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:14:06.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:14:06.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:06.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:14:06.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:14:06.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:06.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:14:06.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:14:06.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:06.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:14:06.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:14:06.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:06.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:14:06.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:14:06.677 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.677 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.677 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.677 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:06.677 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:06.677 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.353542819999999, 2024-04-26T11:14:06.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:14:06.677 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:06.677 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:06.677 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:06.677 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:06.678 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.678 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:14:06.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.678 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:06.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:06.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:06.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:06.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:06.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:06.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:14:06.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:06.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:06.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:14:06.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:14:06.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:06.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:14:06.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:14:06.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:14:06.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:14:06.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:14:06.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:14:06.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:06.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:14:06.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:14:06.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:06.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:14:06.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:14:06.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:06.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:14:06.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:14:06.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:06.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:14:06.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:14:06.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:06.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:14:06.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:14:06.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:06.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:14:06.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:14:06.682 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.682 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.682 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.683 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:55093 5.e 5:7ebffa9e:::benchmark_data_smithi029_44842_object55092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:06.683 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:14:06.683 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.8864111020000003, 2024-04-26T11:14:06.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020381660999999999, 2024-04-26T11:14:06.683 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:06.683 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:06.683 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:06.683 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:06.683 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.683 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 55093 2024-04-26T11:14:06.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.683 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:06.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:06.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:14:06.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:06.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:14:06.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:06.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746571+0000", 2024-04-26T11:14:06.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:06.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746599+0000", 2024-04-26T11:14:06.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8262000000000001e-05 2024-04-26T11:14:06.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:06.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746610+0000", 2024-04-26T11:14:06.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1070000000000001e-05 2024-04-26T11:14:06.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746617+0000", 2024-04-26T11:14:06.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8190000000000003e-06 2024-04-26T11:14:06.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748218+0000", 2024-04-26T11:14:06.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0016005889999999999 2024-04-26T11:14:06.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:06.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748350+0000", 2024-04-26T11:14:06.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132528 2024-04-26T11:14:06.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:06.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748499+0000", 2024-04-26T11:14:06.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014815600000000001 2024-04-26T11:14:06.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:06.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.750795+0000", 2024-04-26T11:14:06.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022960369999999999 2024-04-26T11:14:06.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:06.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766866+0000", 2024-04-26T11:14:06.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016071230999999998 2024-04-26T11:14:06.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:06.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766922+0000", 2024-04-26T11:14:06.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6643e-05 2024-04-26T11:14:06.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:06.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766953+0000", 2024-04-26T11:14:06.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0981e-05 2024-04-26T11:14:06.688 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.688 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.688 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.688 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:55738 5.4 5:2d90ff60:::benchmark_data_smithi029_44842_object55737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:06.688 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.026425+0000", 2024-04-26T11:14:06.688 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.606557639, 2024-04-26T11:14:06.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018738008, 2024-04-26T11:14:06.688 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:06.688 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:06.688 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:06.689 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:06.689 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.689 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 55738 2024-04-26T11:14:06.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.689 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:06.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:06.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026425+0000", 2024-04-26T11:14:06.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:06.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026425+0000", 2024-04-26T11:14:06.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:06.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026425+0000", 2024-04-26T11:14:06.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:06.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026456+0000", 2024-04-26T11:14:06.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1312000000000001e-05 2024-04-26T11:14:06.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:06.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026463+0000", 2024-04-26T11:14:06.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2710000000000003e-06 2024-04-26T11:14:06.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026469+0000", 2024-04-26T11:14:06.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7389999999999996e-06 2024-04-26T11:14:06.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026561+0000", 2024-04-26T11:14:06.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2552000000000004e-05 2024-04-26T11:14:06.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:06.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026695+0000", 2024-04-26T11:14:06.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013394500000000001 2024-04-26T11:14:06.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:06.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.026827+0000", 2024-04-26T11:14:06.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013146800000000001 2024-04-26T11:14:06.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:06.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.028905+0000", 2024-04-26T11:14:06.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020783749999999999 2024-04-26T11:14:06.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:06.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.045076+0000", 2024-04-26T11:14:06.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016170411999999999 2024-04-26T11:14:06.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:06.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.045130+0000", 2024-04-26T11:14:06.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4169000000000003e-05 2024-04-26T11:14:06.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:06.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.045163+0000", 2024-04-26T11:14:06.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3368999999999998e-05 2024-04-26T11:14:06.693 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.693 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.694 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.694 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:06.694 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:06.694 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.2869007809999999, 2024-04-26T11:14:06.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:14:06.694 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:06.694 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:06.694 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:06.694 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:06.694 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.694 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:14:06.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.694 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:06.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:06.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:06.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:06.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:06.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:06.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:14:06.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:06.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:06.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:14:06.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:14:06.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:06.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:14:06.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:14:06.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:14:06.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:14:06.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:14:06.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:14:06.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:06.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:14:06.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:14:06.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:14:06.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:14:06.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:06.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:14:06.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:14:06.698 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.698 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.698 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.698 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:06.698 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:06.698 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.2868051349999998, 2024-04-26T11:14:06.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:14:06.698 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:06.699 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:06.699 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:06.699 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:06.699 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.699 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:14:06.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.699 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:06.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:06.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:06.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:06.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:06.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:06.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:14:06.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:06.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:14:06.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:14:06.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:06.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:14:06.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:14:06.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:14:06.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:14:06.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:14:06.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:14:06.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:06.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:14:06.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:14:06.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:14:06.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:14:06.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:06.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:14:06.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:14:06.703 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.703 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.703 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.703 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:06.703 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:06.703 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.2866734560000008, 2024-04-26T11:14:06.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:14:06.703 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:06.703 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:06.703 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:06.703 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:06.704 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.704 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:14:06.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.704 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:06.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:06.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:06.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:06.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:06.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:06.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:06.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:06.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:14:06.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:14:06.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:06.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:14:06.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:14:06.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:14:06.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:14:06.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:14:06.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:14:06.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:06.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:14:06.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:14:06.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:14:06.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:14:06.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:06.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:14:06.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:14:06.707 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.707 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.707 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.707 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:06.708 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:06.708 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.2865649999999995, 2024-04-26T11:14:06.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:14:06.708 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:06.708 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:06.708 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:06.708 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:06.708 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.708 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:14:06.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.708 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:06.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:06.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:06.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:06.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:06.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:06.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:14:06.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:06.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:06.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:14:06.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:14:06.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:06.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:14:06.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:14:06.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:14:06.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:14:06.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:14:06.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:14:06.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:06.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:14:06.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:14:06.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:14:06.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:14:06.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:06.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:14:06.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:14:06.712 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.712 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.712 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.712 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:06.712 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:06.712 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.2864637319999996, 2024-04-26T11:14:06.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:14:06.712 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:06.712 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:06.712 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:06.713 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:06.713 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.713 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:14:06.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.713 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:06.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:06.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:06.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:06.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:06.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:06.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:06.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:06.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:14:06.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:14:06.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:06.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:14:06.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:14:06.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:14:06.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:14:06.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:14:06.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:14:06.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:06.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:14:06.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:14:06.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:14:06.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:14:06.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:06.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:14:06.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:14:06.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:06.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:14:06.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:14:06.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:06.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:14:06.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:14:06.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:06.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:14:06.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:14:06.717 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.717 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.717 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.718 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:06.718 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:06.718 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.2863947909999993, 2024-04-26T11:14:06.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:14:06.718 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:06.718 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:06.718 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:06.718 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:06.718 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.718 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:14:06.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.718 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:06.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:06.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:06.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:06.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:06.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:06.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:14:06.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:06.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:14:06.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:14:06.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:06.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:14:06.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:14:06.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:14:06.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:14:06.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:14:06.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:14:06.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:06.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:14:06.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:14:06.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:14:06.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:14:06.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:06.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:14:06.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:14:06.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:06.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:14:06.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:14:06.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:06.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:14:06.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:14:06.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:06.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:14:06.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:14:06.723 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.723 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.723 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.723 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:06.723 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:06.723 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.2803992100000006, 2024-04-26T11:14:06.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:14:06.723 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:06.724 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:06.724 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:06.724 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:06.724 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.724 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:14:06.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.724 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:06.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:06.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:06.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:06.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:06.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:06.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:14:06.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:06.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:14:06.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:14:06.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:06.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:14:06.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:14:06.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:14:06.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:14:06.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:14:06.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:14:06.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:06.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:14:06.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:14:06.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:14:06.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:14:06.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:06.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:14:06.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:14:06.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:06.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:14:06.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:14:06.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:06.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:14:06.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:14:06.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:06.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:14:06.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:14:06.728 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.728 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.728 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.729 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:66093 5.e 5:70f73c77:::benchmark_data_smithi029_44842_object66092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:06.729 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:02.539855+0000", 2024-04-26T11:14:06.729 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.0931274440000003, 2024-04-26T11:14:06.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019258168999999999, 2024-04-26T11:14:06.729 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:06.729 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:06.729 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:06.729 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:06.729 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.729 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 66093 2024-04-26T11:14:06.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.729 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:06.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.539855+0000", 2024-04-26T11:14:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.539855+0000", 2024-04-26T11:14:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.539855+0000", 2024-04-26T11:14:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.539880+0000", 2024-04-26T11:14:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4882e-05 2024-04-26T11:14:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.539888+0000", 2024-04-26T11:14:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8849999999999999e-06 2024-04-26T11:14:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.539894+0000", 2024-04-26T11:14:06.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.088e-06 2024-04-26T11:14:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.539924+0000", 2024-04-26T11:14:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0833000000000001e-05 2024-04-26T11:14:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.540002+0000", 2024-04-26T11:14:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7649000000000001e-05 2024-04-26T11:14:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.540085+0000", 2024-04-26T11:14:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3337000000000005e-05 2024-04-26T11:14:06.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.544628+0000", 2024-04-26T11:14:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045426080000000001 2024-04-26T11:14:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.559036+0000", 2024-04-26T11:14:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014407503 2024-04-26T11:14:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:06.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.559090+0000", 2024-04-26T11:14:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4598999999999997e-05 2024-04-26T11:14:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.559114+0000", 2024-04-26T11:14:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3422999999999999e-05 2024-04-26T11:14:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.734 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:66094 5.e 5:71f1b4a0:::benchmark_data_smithi029_44842_object66093:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:02.540067+0000", 2024-04-26T11:14:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.0929163409999996, 2024-04-26T11:14:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019134480999999998, 2024-04-26T11:14:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 66094 2024-04-26T11:14:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.735 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.540067+0000", 2024-04-26T11:14:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.540067+0000", 2024-04-26T11:14:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:06.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.540066+0000", 2024-04-26T11:14:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.540160+0000", 2024-04-26T11:14:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4153000000000005e-05 2024-04-26T11:14:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.540169+0000", 2024-04-26T11:14:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0399999999999998e-06 2024-04-26T11:14:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.540176+0000", 2024-04-26T11:14:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.776e-06 2024-04-26T11:14:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.541723+0000", 2024-04-26T11:14:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001547051 2024-04-26T11:14:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.541830+0000", 2024-04-26T11:14:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107217 2024-04-26T11:14:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.541975+0000", 2024-04-26T11:14:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000145255 2024-04-26T11:14:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.547602+0000", 2024-04-26T11:14:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005626631 2024-04-26T11:14:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.559152+0000", 2024-04-26T11:14:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011549808999999999 2024-04-26T11:14:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.559181+0000", 2024-04-26T11:14:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9159e-05 2024-04-26T11:14:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.559201+0000", 2024-04-26T11:14:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0098999999999998e-05 2024-04-26T11:14:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:74410 5.8 5:11ec7527:::benchmark_data_smithi029_44842_object74409:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T11:14:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:06.172500+0000", 2024-04-26T11:14:06.740 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.46048313499999999, 2024-04-26T11:14:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.018615745999999999, 2024-04-26T11:14:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 74410 2024-04-26T11:14:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.172500+0000", 2024-04-26T11:14:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.172500+0000", 2024-04-26T11:14:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.172499+0000", 2024-04-26T11:14:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.172557+0000", 2024-04-26T11:14:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8384000000000002e-05 2024-04-26T11:14:06.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.172566+0000", 2024-04-26T11:14:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6929999999999996e-06 2024-04-26T11:14:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.172571+0000", 2024-04-26T11:14:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3929999999999999e-06 2024-04-26T11:14:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.178319+0000", 2024-04-26T11:14:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057478199999999998 2024-04-26T11:14:06.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.178401+0000", 2024-04-26T11:14:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000002e-05 2024-04-26T11:14:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.178707+0000", 2024-04-26T11:14:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000306519 2024-04-26T11:14:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.186731+0000", 2024-04-26T11:14:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0080236430000000004 2024-04-26T11:14:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.191016+0000", 2024-04-26T11:14:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0042851449999999998 2024-04-26T11:14:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.191063+0000", 2024-04-26T11:14:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6579000000000002e-05 2024-04-26T11:14:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.191115+0000", 2024-04-26T11:14:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2952999999999999e-05 2024-04-26T11:14:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.745 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.746 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.746 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:06.746 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:06.746 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:06.747 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:06.748 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:06.746+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:06.848 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:06.846+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:06.930 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:06.930 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:06.930 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.931 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:76133 5.c 5:342e6834:::benchmark_data_smithi029_44842_object76132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T11:14:06.931 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.919711+0000", 2024-04-26T11:14:06.931 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0084729969999999995, 2024-04-26T11:14:06.931 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0084971419999999992, 2024-04-26T11:14:06.931 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:06.931 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:06.931 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:06.931 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:06.931 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.931 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 76133 2024-04-26T11:14:06.931 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.931 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:06.932 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.932 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:06.932 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.919711+0000", 2024-04-26T11:14:06.932 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.932 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.932 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.932 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:06.932 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.919711+0000", 2024-04-26T11:14:06.932 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.932 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.932 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.932 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:06.932 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.919711+0000", 2024-04-26T11:14:06.933 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.933 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.933 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.933 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:06.933 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.919789+0000", 2024-04-26T11:14:06.933 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7999999999999999e-05 2024-04-26T11:14:06.933 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.933 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.933 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:06.933 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.919803+0000", 2024-04-26T11:14:06.933 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4601e-05 2024-04-26T11:14:06.933 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.934 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.934 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.934 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.919810+0000", 2024-04-26T11:14:06.934 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.08e-06 2024-04-26T11:14:06.934 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.934 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.934 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.934 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.919858+0000", 2024-04-26T11:14:06.934 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7352999999999999e-05 2024-04-26T11:14:06.934 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.934 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.934 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:06.934 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920002+0000", 2024-04-26T11:14:06.935 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000144676 2024-04-26T11:14:06.935 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.935 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:06.935 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.935 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.935 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.935 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:76135 5.3 5:c594e8ab:::benchmark_data_smithi029_44842_object76134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T11:14:06.935 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.919943+0000", 2024-04-26T11:14:06.935 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.008241188, 2024-04-26T11:14:06.935 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0083134669999999997, 2024-04-26T11:14:06.935 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:06.935 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:06.936 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:06.936 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:06.936 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.936 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 76135 2024-04-26T11:14:06.936 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.936 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:06.936 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.936 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:06.936 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.919943+0000", 2024-04-26T11:14:06.936 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.937 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.937 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.937 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:06.937 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.919943+0000", 2024-04-26T11:14:06.937 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.937 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.937 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.937 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:06.937 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.919943+0000", 2024-04-26T11:14:06.937 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.937 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.937 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.937 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:06.938 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920011+0000", 2024-04-26T11:14:06.938 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8795999999999997e-05 2024-04-26T11:14:06.938 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.938 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.938 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:06.938 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920018+0000", 2024-04-26T11:14:06.938 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1160000000000001e-06 2024-04-26T11:14:06.938 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.938 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.938 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.938 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920023+0000", 2024-04-26T11:14:06.938 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2939999999999999e-06 2024-04-26T11:14:06.939 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.939 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.939 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.939 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920063+0000", 2024-04-26T11:14:06.939 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9854999999999997e-05 2024-04-26T11:14:06.939 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.939 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.939 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:06.939 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920216+0000", 2024-04-26T11:14:06.939 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015311099999999999 2024-04-26T11:14:06.939 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.939 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:06.940 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.940 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.940 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.940 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:76136 5.6 5:6b5521ff:::benchmark_data_smithi029_44842_object76135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T11:14:06.940 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.920030+0000", 2024-04-26T11:14:06.940 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0081545639999999996, 2024-04-26T11:14:06.940 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0082861940000000002, 2024-04-26T11:14:06.940 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:06.940 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:06.940 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:06.940 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:06.940 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.940 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 76136 2024-04-26T11:14:06.941 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.941 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:06.941 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.941 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:06.941 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920030+0000", 2024-04-26T11:14:06.941 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.941 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.941 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.941 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:06.941 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920030+0000", 2024-04-26T11:14:06.941 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.941 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.941 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.942 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:06.942 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920029+0000", 2024-04-26T11:14:06.942 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.942 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.942 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.942 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:06.942 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920145+0000", 2024-04-26T11:14:06.942 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000116184 2024-04-26T11:14:06.942 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.942 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.942 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:06.943 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920154+0000", 2024-04-26T11:14:06.943 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.8179999999999993e-06 2024-04-26T11:14:06.943 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.943 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.943 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.943 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920161+0000", 2024-04-26T11:14:06.943 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7909999999999999e-06 2024-04-26T11:14:06.943 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.943 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.943 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.943 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920230+0000", 2024-04-26T11:14:06.944 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8604999999999998e-05 2024-04-26T11:14:06.944 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.944 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.944 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:06.944 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920344+0000", 2024-04-26T11:14:06.944 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0001148 2024-04-26T11:14:06.944 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.944 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:06.944 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.944 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.944 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.944 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:76137 5.3 5:c28f83c0:::benchmark_data_smithi029_44842_object76136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T11:14:06.945 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.920173+0000", 2024-04-26T11:14:06.945 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0080118029999999996, 2024-04-26T11:14:06.945 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0081940109999999993, 2024-04-26T11:14:06.945 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:06.945 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:06.945 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:06.945 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:06.945 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.945 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 76137 2024-04-26T11:14:06.945 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.945 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:06.945 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.945 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:06.946 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920173+0000", 2024-04-26T11:14:06.946 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.946 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.946 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.946 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:06.946 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920173+0000", 2024-04-26T11:14:06.946 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.946 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.946 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.946 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:06.946 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920172+0000", 2024-04-26T11:14:06.947 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.947 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.947 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.947 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:06.947 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920203+0000", 2024-04-26T11:14:06.947 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1584000000000001e-05 2024-04-26T11:14:06.947 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.947 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.947 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:06.947 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920211+0000", 2024-04-26T11:14:06.947 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.61e-06 2024-04-26T11:14:06.947 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.947 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.948 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.948 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920217+0000", 2024-04-26T11:14:06.948 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.896e-06 2024-04-26T11:14:06.948 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.948 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.948 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.948 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.924863+0000", 2024-04-26T11:14:06.948 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046455869999999996 2024-04-26T11:14:06.948 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.948 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.948 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:06.948 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.925017+0000", 2024-04-26T11:14:06.949 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015410700000000001 2024-04-26T11:14:06.949 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.949 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:06.949 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.949 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.949 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.949 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:76140 5.7 5:e28a48fd:::benchmark_data_smithi029_44842_object76139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T11:14:06.949 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.920223+0000", 2024-04-26T11:14:06.949 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.007961447, 2024-04-26T11:14:06.949 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0081843430000000002, 2024-04-26T11:14:06.949 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:06.949 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:06.950 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:06.950 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:06.950 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.950 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 76140 2024-04-26T11:14:06.950 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.950 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:06.950 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.950 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:06.950 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920223+0000", 2024-04-26T11:14:06.950 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.950 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.950 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.951 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:06.951 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920223+0000", 2024-04-26T11:14:06.951 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.951 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.951 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.951 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:06.951 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920222+0000", 2024-04-26T11:14:06.951 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.951 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.951 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.951 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:06.951 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920332+0000", 2024-04-26T11:14:06.951 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000109343 2024-04-26T11:14:06.952 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.952 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.952 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:06.952 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920341+0000", 2024-04-26T11:14:06.952 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.628e-06 2024-04-26T11:14:06.952 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.952 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.952 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.952 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920367+0000", 2024-04-26T11:14:06.952 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5341999999999999e-05 2024-04-26T11:14:06.952 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.952 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.953 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.953 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.921558+0000", 2024-04-26T11:14:06.953 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0011908260000000001 2024-04-26T11:14:06.953 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.953 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.953 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:06.953 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.921663+0000", 2024-04-26T11:14:06.953 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010525400000000001 2024-04-26T11:14:06.953 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.953 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:06.953 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.953 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.953 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.954 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:76142 5.2 5:4fd5bde0:::benchmark_data_smithi029_44842_object76141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T11:14:06.954 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.920380+0000", 2024-04-26T11:14:06.954 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0078040549999999998, 2024-04-26T11:14:06.954 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0080662149999999998, 2024-04-26T11:14:06.954 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:06.954 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:06.954 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:06.954 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:06.954 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.954 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 76142 2024-04-26T11:14:06.955 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.955 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:06.955 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.955 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:06.955 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920380+0000", 2024-04-26T11:14:06.955 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.955 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.955 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.955 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:06.955 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920380+0000", 2024-04-26T11:14:06.955 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.955 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.956 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.956 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:06.956 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920380+0000", 2024-04-26T11:14:06.956 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.956 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.956 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.956 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:06.956 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920431+0000", 2024-04-26T11:14:06.956 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1715999999999997e-05 2024-04-26T11:14:06.956 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.956 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.956 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:06.956 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920439+0000", 2024-04-26T11:14:06.957 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9610000000000005e-06 2024-04-26T11:14:06.957 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.957 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.957 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.957 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920446+0000", 2024-04-26T11:14:06.957 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4359999999999999e-06 2024-04-26T11:14:06.957 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.957 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.957 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.957 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920506+0000", 2024-04-26T11:14:06.957 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0452000000000003e-05 2024-04-26T11:14:06.957 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.958 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.958 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:06.958 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920627+0000", 2024-04-26T11:14:06.958 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000120695 2024-04-26T11:14:06.958 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.958 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:06.958 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.958 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.958 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.958 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:76143 5.6 5:61b0bb58:::benchmark_data_smithi029_44842_object76142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T11:14:06.958 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.920479+0000", 2024-04-26T11:14:06.958 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0077054530000000001, 2024-04-26T11:14:06.958 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0080136990000000009, 2024-04-26T11:14:06.959 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:06.959 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:06.959 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:06.959 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:06.959 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.959 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 76143 2024-04-26T11:14:06.959 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.959 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:06.959 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.959 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:06.959 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920479+0000", 2024-04-26T11:14:06.959 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.959 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.960 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.960 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:06.960 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920479+0000", 2024-04-26T11:14:06.960 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.960 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.960 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.960 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:06.960 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920478+0000", 2024-04-26T11:14:06.960 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.960 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.960 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.960 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:06.960 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920509+0000", 2024-04-26T11:14:06.961 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0349e-05 2024-04-26T11:14:06.961 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.961 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.961 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:06.961 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920524+0000", 2024-04-26T11:14:06.961 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5244e-05 2024-04-26T11:14:06.961 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.961 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.961 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.961 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920530+0000", 2024-04-26T11:14:06.961 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1700000000000002e-06 2024-04-26T11:14:06.961 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.962 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.962 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.962 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.922935+0000", 2024-04-26T11:14:06.962 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002404719 2024-04-26T11:14:06.962 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.962 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.962 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:06.962 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.923052+0000", 2024-04-26T11:14:06.962 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011691799999999999 2024-04-26T11:14:06.962 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.962 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:06.962 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.963 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.963 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.963 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:76144 5.c 5:3d2faf1f:::benchmark_data_smithi029_44842_object76143:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T11:14:06.963 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.920536+0000", 2024-04-26T11:14:06.963 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0076484810000000004, 2024-04-26T11:14:06.963 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0079969059999999998, 2024-04-26T11:14:06.963 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:06.963 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:06.963 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:06.963 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:06.963 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.963 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 76144 2024-04-26T11:14:06.963 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.964 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:06.964 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.964 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:06.964 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920536+0000", 2024-04-26T11:14:06.964 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.964 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.964 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.964 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:06.964 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920536+0000", 2024-04-26T11:14:06.964 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.964 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.964 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.965 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:06.965 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920535+0000", 2024-04-26T11:14:06.965 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.965 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.965 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.965 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:06.965 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920564+0000", 2024-04-26T11:14:06.965 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8846000000000001e-05 2024-04-26T11:14:06.965 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.965 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.965 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:06.965 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920571+0000", 2024-04-26T11:14:06.965 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0029999999999997e-06 2024-04-26T11:14:06.966 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.966 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.966 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.966 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920576+0000", 2024-04-26T11:14:06.966 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2979999999999999e-06 2024-04-26T11:14:06.966 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.966 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.966 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.966 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.922850+0000", 2024-04-26T11:14:06.966 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022735160000000002 2024-04-26T11:14:06.966 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.966 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.967 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:06.967 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.922983+0000", 2024-04-26T11:14:06.967 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013265400000000001 2024-04-26T11:14:06.967 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.967 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:06.967 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.967 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.967 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:76145 5.7 5:e84b180f:::benchmark_data_smithi029_44842_object76144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T11:14:06.967 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.920585+0000", 2024-04-26T11:14:06.967 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00759898, 2024-04-26T11:14:06.967 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0079850939999999999, 2024-04-26T11:14:06.967 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:06.968 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:06.968 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:06.968 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:06.968 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.968 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 76145 2024-04-26T11:14:06.968 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.968 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:06.968 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.968 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:06.968 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920585+0000", 2024-04-26T11:14:06.968 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.968 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.969 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.969 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:06.969 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920585+0000", 2024-04-26T11:14:06.969 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.969 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.969 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.969 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:06.969 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920585+0000", 2024-04-26T11:14:06.969 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.969 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.969 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.969 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:06.969 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920608+0000", 2024-04-26T11:14:06.970 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2668e-05 2024-04-26T11:14:06.970 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.970 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.970 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:06.970 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920614+0000", 2024-04-26T11:14:06.970 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4899999999999997e-06 2024-04-26T11:14:06.970 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.970 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.970 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.970 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.920619+0000", 2024-04-26T11:14:06.970 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8509999999999998e-06 2024-04-26T11:14:06.970 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.970 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.971 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.971 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.923287+0000", 2024-04-26T11:14:06.971 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002668054 2024-04-26T11:14:06.971 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.971 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.971 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:06.971 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.923400+0000", 2024-04-26T11:14:06.971 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000113167 2024-04-26T11:14:06.971 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.971 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:06.971 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.971 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.971 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.972 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:76138 5.4 e30/16 5:2825a2f6:::benchmark_data_smithi029_44842_object76137:head v 30'4777, mlcod=30'4775)", 2024-04-26T11:14:06.972 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.921473+0000", 2024-04-26T11:14:06.972 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0067118309999999997, 2024-04-26T11:14:06.972 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0071367269999999998, 2024-04-26T11:14:06.972 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:06.972 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:06.972 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:06.972 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.972 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:06.972 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.921473+0000", 2024-04-26T11:14:06.972 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.972 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.972 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.973 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:06.973 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.921473+0000", 2024-04-26T11:14:06.973 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.973 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.973 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:06.973 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.921472+0000", 2024-04-26T11:14:06.973 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:06.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.973 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.973 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:06.973 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.921505+0000", 2024-04-26T11:14:06.974 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3665999999999999e-05 2024-04-26T11:14:06.974 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.974 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.974 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:06.974 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.921535+0000", 2024-04-26T11:14:06.974 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9337999999999999e-05 2024-04-26T11:14:06.974 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.974 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.974 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.974 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.921541+0000", 2024-04-26T11:14:06.974 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5309999999999998e-06 2024-04-26T11:14:06.974 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.974 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.975 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.975 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.921904+0000", 2024-04-26T11:14:06.975 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00036285199999999999 2024-04-26T11:14:06.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.975 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.975 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:06.975 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.921919+0000", 2024-04-26T11:14:06.975 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4803e-05 2024-04-26T11:14:06.975 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.975 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:06.975 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.976 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.976 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:76141 5.e e30/16 5:7944435f:::benchmark_data_smithi029_44842_object76140:head v 30'4747, mlcod=30'4745)", 2024-04-26T11:14:06.976 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.921547+0000", 2024-04-26T11:14:06.976 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00663695, 2024-04-26T11:14:06.976 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.007095166, 2024-04-26T11:14:06.976 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:06.976 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:06.976 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:06.976 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.976 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:06.976 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.921547+0000", 2024-04-26T11:14:06.976 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.977 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.977 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:06.977 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.921547+0000", 2024-04-26T11:14:06.977 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.977 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.977 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:06.977 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.921547+0000", 2024-04-26T11:14:06.977 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:06.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.977 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.977 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:06.978 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.921574+0000", 2024-04-26T11:14:06.978 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7330000000000001e-05 2024-04-26T11:14:06.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.978 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.978 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:06.978 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.921581+0000", 2024-04-26T11:14:06.978 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4049999999999997e-06 2024-04-26T11:14:06.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.978 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.978 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.978 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.921586+0000", 2024-04-26T11:14:06.978 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.9509999999999997e-06 2024-04-26T11:14:06.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.979 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.979 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.979 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.922864+0000", 2024-04-26T11:14:06.979 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0012787199999999999 2024-04-26T11:14:06.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.979 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.979 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:06.979 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.922882+0000", 2024-04-26T11:14:06.979 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7584e-05 2024-04-26T11:14:06.979 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.979 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:06.979 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.980 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:76146 5.2 5:4b572040:::benchmark_data_smithi029_44842_object76145:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T11:14:06.980 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.922218+0000", 2024-04-26T11:14:06.980 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0059659429999999996, 2024-04-26T11:14:06.980 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0064595670000000003, 2024-04-26T11:14:06.980 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:06.980 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:06.980 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:06.980 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:06.980 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.980 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 76146 2024-04-26T11:14:06.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.981 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:06.981 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.981 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:06.981 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.922218+0000", 2024-04-26T11:14:06.981 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.981 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.981 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:06.981 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.922218+0000", 2024-04-26T11:14:06.981 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.981 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.982 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:06.982 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.922217+0000", 2024-04-26T11:14:06.982 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:06.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.982 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.982 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:06.982 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.922278+0000", 2024-04-26T11:14:06.982 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0145000000000001e-05 2024-04-26T11:14:06.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.982 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.982 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:06.983 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.922288+0000", 2024-04-26T11:14:06.983 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0808999999999999e-05 2024-04-26T11:14:06.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.983 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.983 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.922296+0000", 2024-04-26T11:14:06.983 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.34e-06 2024-04-26T11:14:06.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.983 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.983 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.922915+0000", 2024-04-26T11:14:06.983 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00061913799999999998 2024-04-26T11:14:06.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.984 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:06.984 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.923046+0000", 2024-04-26T11:14:06.984 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000130777 2024-04-26T11:14:06.984 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.984 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:06.984 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.984 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:76148 5.6 5:6ddff0bf:::benchmark_data_smithi029_44842_object76147:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T11:14:06.984 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.924357+0000", 2024-04-26T11:14:06.984 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0038269789999999999, 2024-04-26T11:14:06.985 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0043599090000000004, 2024-04-26T11:14:06.985 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:06.985 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:06.985 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:06.985 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:06.985 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.985 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 76148 2024-04-26T11:14:06.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.985 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:06.985 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.985 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:06.985 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.924357+0000", 2024-04-26T11:14:06.986 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.986 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:06.986 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.924357+0000", 2024-04-26T11:14:06.986 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.986 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:06.986 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.924356+0000", 2024-04-26T11:14:06.986 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:06.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.987 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:06.987 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.924450+0000", 2024-04-26T11:14:06.987 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3386000000000003e-05 2024-04-26T11:14:06.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.987 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:06.987 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.924465+0000", 2024-04-26T11:14:06.987 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4999e-05 2024-04-26T11:14:06.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.987 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.988 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.924472+0000", 2024-04-26T11:14:06.988 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6000000000000001e-06 2024-04-26T11:14:06.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.988 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.988 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.988 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.925763+0000", 2024-04-26T11:14:06.988 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0012902359999999999 2024-04-26T11:14:06.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.988 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.988 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:06.988 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.925900+0000", 2024-04-26T11:14:06.988 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013734899999999999 2024-04-26T11:14:06.988 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.989 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:06.989 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.989 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.989 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:76149 5.3 5:cb47b613:::benchmark_data_smithi029_44842_object76148:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T11:14:06.989 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.925812+0000", 2024-04-26T11:14:06.989 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0023719380000000001, 2024-04-26T11:14:06.989 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0029426230000000001, 2024-04-26T11:14:06.989 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:06.989 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:06.989 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:06.989 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:06.990 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.990 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 76149 2024-04-26T11:14:06.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.990 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:06.990 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.990 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:06.990 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.925812+0000", 2024-04-26T11:14:06.990 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.990 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.990 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:06.990 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.925812+0000", 2024-04-26T11:14:06.990 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.991 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:06.991 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.925812+0000", 2024-04-26T11:14:06.991 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:06.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.991 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:06.991 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.925864+0000", 2024-04-26T11:14:06.991 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2398999999999998e-05 2024-04-26T11:14:06.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.992 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:06.992 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.925874+0000", 2024-04-26T11:14:06.992 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0113e-05 2024-04-26T11:14:06.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.992 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.992 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.992 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.925883+0000", 2024-04-26T11:14:06.992 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.49e-06 2024-04-26T11:14:06.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.992 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.992 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.992 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.926573+0000", 2024-04-26T11:14:06.992 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00069027300000000004 2024-04-26T11:14:06.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.993 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.993 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:06.993 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.926718+0000", 2024-04-26T11:14:06.993 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014518300000000001 2024-04-26T11:14:06.993 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.993 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:06.993 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.993 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.993 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:76150 5.e e30/16 5:7c86f695:::benchmark_data_smithi029_44842_object76149:head v 30'4748, mlcod=30'4745)", 2024-04-26T11:14:06.993 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.926325+0000", 2024-04-26T11:14:06.993 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.001859358, 2024-04-26T11:14:06.994 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0024695289999999998, 2024-04-26T11:14:06.994 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:06.994 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:06.994 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:06.994 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.994 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:06.994 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.926325+0000", 2024-04-26T11:14:06.994 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.994 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.994 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:06.995 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.926325+0000", 2024-04-26T11:14:06.995 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.995 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:06.995 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.926324+0000", 2024-04-26T11:14:06.995 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:06.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.995 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:06.995 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.926382+0000", 2024-04-26T11:14:06.995 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.808e-05 2024-04-26T11:14:06.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.996 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.996 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:06.996 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.926393+0000", 2024-04-26T11:14:06.996 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1080000000000001e-05 2024-04-26T11:14:06.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.996 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.996 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:06.996 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.926401+0000", 2024-04-26T11:14:06.996 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5519999999999999e-06 2024-04-26T11:14:06.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.996 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.996 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:06.996 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.926434+0000", 2024-04-26T11:14:06.997 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2923999999999999e-05 2024-04-26T11:14:06.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.997 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:06.997 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.926467+0000", 2024-04-26T11:14:06.997 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3275000000000002e-05 2024-04-26T11:14:06.997 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.997 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:06.997 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:06.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.997 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:76151 5.7 5:e8dbd3ec:::benchmark_data_smithi029_44842_object76150:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T11:14:06.998 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.927424+0000", 2024-04-26T11:14:06.998 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.000760197, 2024-04-26T11:14:06.998 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0014053399999999999, 2024-04-26T11:14:06.998 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:06.998 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:06.998 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:06.998 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:06.998 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:06.998 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 76151 2024-04-26T11:14:06.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.998 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:06.998 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.998 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:06.999 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.927424+0000", 2024-04-26T11:14:06.999 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.999 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.999 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:06.999 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.927424+0000", 2024-04-26T11:14:06.999 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:06.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:06.999 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:06.999 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:06.999 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.927423+0000", 2024-04-26T11:14:06.999 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:07.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:07.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:07.000 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:07.000 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.927460+0000", 2024-04-26T11:14:07.000 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6297999999999997e-05 2024-04-26T11:14:07.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:07.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:07.000 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:07.000 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.927472+0000", 2024-04-26T11:14:07.000 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2366e-05 2024-04-26T11:14:07.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:07.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:07.000 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:07.001 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.927478+0000", 2024-04-26T11:14:07.001 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.993e-06 2024-04-26T11:14:07.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:07.001 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:07.001 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:07.001 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.927515+0000", 2024-04-26T11:14:07.001 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7156999999999997e-05 2024-04-26T11:14:07.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:07.001 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:07.001 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:07.001 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.927602+0000", 2024-04-26T11:14:07.001 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7101000000000005e-05 2024-04-26T11:14:07.001 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:07.001 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:07.002 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:07.002 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:07.002 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:14:07.002 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 16 2024-04-26T11:14:07.002 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:07.002 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:14:07.004 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:07.005 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:07.002+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:07.105 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:07.104+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:07.129 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-04-26T11:14:07.129 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:14:07.130 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-26T11:14:07.130 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.000000 2024-04-26T11:14:07.130 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0 2024-04-26T11:14:07.158 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:07.179 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:07.179 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:07.179 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:07.179 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:07.181 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:07.182 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:07.206 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:07.204+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:07.231 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:07.231 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:07.248 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:07.306 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:07.305+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:07.408 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:07.406+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:07.412 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 29 16 77214 77198 166.36 139.875 0.0108242 0.00600811 2024-04-26T11:14:07.476 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:07.476 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:07.492 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:07.534 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:07.533+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:07.582 INFO:teuthology.orchestra.run.smithi029.stderr:set osd.1 primary-affinity to 0 (802) 2024-04-26T11:14:07.609 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:07.608+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:07.656 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:07.657 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:07.668 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:07.710 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:07.709+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:07.811 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:07.810+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:07.834 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:07.838 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:07.844 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:07.912 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:07.910+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:07.970 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:07.970 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:07.980 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:08.024 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:08.023+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:08.106 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:08.107 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:08.114 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:08.113+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:08.116 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:08.215 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:08.214+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:08.282 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:08.282 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:08.292 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:08.333 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:08.332+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:08.412 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 30 16 77759 77743 161.95 34.0625 0.00252933 0.0060116 2024-04-26T11:14:08.417 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:08.415+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:08.458 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:08.458 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:08.467 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:08.518 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:08.517+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:08.592 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:14:08.603 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:08.604 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:08.617 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:08.618 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:08.616+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:08.719 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:08.718+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:08.789 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:08.789 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:08.804 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:08.845 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:08.843+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:08.921 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:08.919+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:09.014 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:09.014 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:09.022 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:09.021+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:09.027 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:09.123 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:09.122+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:09.183 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:14:09.217 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:09.218 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:09.224 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:09.222+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:09.235 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:09.325 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:09.324+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:09.336 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:09.357 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:09.357 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:09.357 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:09.358 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:09.359 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:09.360 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:09.412 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 31 16 79589 79573 160.415 114.375 0.00708375 0.0062308 2024-04-26T11:14:09.426 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:09.425+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:09.459 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:09.459 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:14:09.459 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:14:09.459 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:14:09.459 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:09.475 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:09.560 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:09.558+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:09.589 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:14:09.627 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:09.626+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:09.700 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:14:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:14:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:46902 5.6 5:6f103941:::benchmark_data_smithi029_44842_object46901:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.120845+0000", 2024-04-26T11:14:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 16.576146140999999, 2024-04-26T11:14:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018538669000000001, 2024-04-26T11:14:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:09.701 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:09.702 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 46902 2024-04-26T11:14:09.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.702 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:09.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.702 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:09.702 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120845+0000", 2024-04-26T11:14:09.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.702 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:09.702 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120845+0000", 2024-04-26T11:14:09.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.702 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:09.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120844+0000", 2024-04-26T11:14:09.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:09.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:09.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120870+0000", 2024-04-26T11:14:09.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5678e-05 2024-04-26T11:14:09.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:09.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120874+0000", 2024-04-26T11:14:09.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.3189999999999996e-06 2024-04-26T11:14:09.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.120878+0000", 2024-04-26T11:14:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4240000000000002e-06 2024-04-26T11:14:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.126176+0000", 2024-04-26T11:14:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0052983630000000004 2024-04-26T11:14:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.126300+0000", 2024-04-26T11:14:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012375099999999999 2024-04-26T11:14:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.126426+0000", 2024-04-26T11:14:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012646399999999999 2024-04-26T11:14:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.132371+0000", 2024-04-26T11:14:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0059443839999999996 2024-04-26T11:14:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.139296+0000", 2024-04-26T11:14:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069250320000000002 2024-04-26T11:14:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.139347+0000", 2024-04-26T11:14:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0954e-05 2024-04-26T11:14:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.139383+0000", 2024-04-26T11:14:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6862e-05 2024-04-26T11:14:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.706 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 16.426244108999999, 2024-04-26T11:14:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:14:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:14:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:09.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:14:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:09.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:14:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:14:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:14:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:14:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:14:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:14:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:14:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:14:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:14:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:14:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:09.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:14:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:14:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:14:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:14:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:14:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:14:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:14:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:14:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:14:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:14:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.712 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 16.425432544, 2024-04-26T11:14:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:14:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:14:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:09.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:09.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:09.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:09.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:09.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:09.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:09.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:09.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:09.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:14:09.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:14:09.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:09.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:14:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:14:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:14:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:14:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:14:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:14:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.716 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:14:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:14:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:14:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:14:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:14:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:14:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:14:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:14:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:14:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:14:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:14:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:14:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 16.418245707000001, 2024-04-26T11:14:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:14:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:14:09.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:14:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:14:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:14:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:14:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:14:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:14:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:14:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:14:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:14:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:14:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:14:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:14:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:14:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:14:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:14:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:14:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:14:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:09.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:14:09.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:14:09.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:09.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:14:09.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:14:09.724 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.724 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:09.724 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.724 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:09.724 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:09.725 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 16.417704828000002, 2024-04-26T11:14:09.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:14:09.725 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:09.725 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:09.725 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:09.725 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:09.725 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:09.725 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:14:09.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.725 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:09.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:09.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:09.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:09.726 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:09.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:09.726 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:09.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:09.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:09.726 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:14:09.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:14:09.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:09.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:14:09.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:14:09.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:09.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:14:09.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:14:09.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:14:09.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:14:09.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:09.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:14:09.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:14:09.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:09.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:14:09.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:14:09.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:09.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:14:09.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:14:09.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:09.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:14:09.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:14:09.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:09.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:14:09.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:14:09.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:09.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:14:09.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:14:09.730 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.730 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:09.730 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.730 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:55119 5.6 5:6ad50111:::benchmark_data_smithi029_44842_object55118:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:09.730 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:09.730 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.936641174, 2024-04-26T11:14:09.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018830264999999999, 2024-04-26T11:14:09.731 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:09.731 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:09.731 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:09.731 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:09.731 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:09.731 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 55119 2024-04-26T11:14:09.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.731 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:09.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:09.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:09.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:09.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:09.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:09.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760349+0000", 2024-04-26T11:14:09.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:09.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:09.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760402+0000", 2024-04-26T11:14:09.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2695999999999998e-05 2024-04-26T11:14:09.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:09.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760411+0000", 2024-04-26T11:14:09.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.0589999999999992e-06 2024-04-26T11:14:09.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:09.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760416+0000", 2024-04-26T11:14:09.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.587e-06 2024-04-26T11:14:09.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767638+0000", 2024-04-26T11:14:09.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0072214050000000002 2024-04-26T11:14:09.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:09.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767760+0000", 2024-04-26T11:14:09.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000122067 2024-04-26T11:14:09.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:09.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767927+0000", 2024-04-26T11:14:09.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00016747999999999999 2024-04-26T11:14:09.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:09.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.770877+0000", 2024-04-26T11:14:09.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002949335 2024-04-26T11:14:09.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:09.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779130+0000", 2024-04-26T11:14:09.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.008253491 2024-04-26T11:14:09.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:09.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779158+0000", 2024-04-26T11:14:09.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7849000000000001e-05 2024-04-26T11:14:09.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:09.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779180+0000", 2024-04-26T11:14:09.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2048999999999998e-05 2024-04-26T11:14:09.735 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.735 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:09.735 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.736 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:09.736 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:09.736 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.374520381, 2024-04-26T11:14:09.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:14:09.736 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:09.736 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:09.736 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:09.736 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:09.736 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:09.736 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:14:09.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.736 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:09.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:09.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:09.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:09.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:09.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:09.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:14:09.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:09.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:09.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:14:09.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:14:09.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:09.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:14:09.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:14:09.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:09.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:14:09.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:14:09.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:14:09.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:14:09.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:09.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:14:09.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:14:09.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:09.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:14:09.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:14:09.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:09.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:14:09.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:14:09.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:14:09.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:14:09.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:09.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:14:09.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:14:09.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:14:09.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:14:09.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:09.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:14:09.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:14:09.741 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.741 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:09.741 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.741 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:09.741 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:09.741 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.372327041, 2024-04-26T11:14:09.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:14:09.741 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:09.742 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:09.742 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:09.742 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:09.742 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:09.742 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:14:09.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.742 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:09.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:09.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:09.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:09.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:09.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:09.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:14:09.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:09.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:09.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:14:09.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:14:09.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:09.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:14:09.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:14:09.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:09.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:14:09.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:14:09.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:14:09.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:14:09.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:09.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:14:09.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:14:09.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:09.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:14:09.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:14:09.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:09.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:14:09.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:14:09.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:14:09.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:14:09.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:09.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:14:09.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:14:09.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:14:09.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:14:09.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:09.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:14:09.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:14:09.747 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.747 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:09.747 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.747 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:09.747 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:09.747 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.367115217, 2024-04-26T11:14:09.747 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:14:09.747 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:09.747 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:09.747 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:09.747 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:09.747 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:09.747 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:14:09.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.748 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:09.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:09.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:09.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:09.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:09.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:09.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:14:09.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:09.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:09.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:14:09.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:14:09.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:09.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:14:09.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:14:09.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:09.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:14:09.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:14:09.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:14:09.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:14:09.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:09.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:14:09.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:14:09.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:09.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:14:09.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:14:09.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:09.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:14:09.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:14:09.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:14:09.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:14:09.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:09.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:14:09.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:14:09.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:14:09.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:14:09.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:09.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:14:09.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:14:09.752 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.752 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:09.752 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.753 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:09.753 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:09.753 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.350666517000001, 2024-04-26T11:14:09.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:14:09.753 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:09.753 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:09.753 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:09.753 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:09.753 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:09.753 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:14:09.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.753 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:09.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:09.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:09.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:09.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:09.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:09.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:14:09.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:09.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:09.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:14:09.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:14:09.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:09.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:14:09.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:14:09.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:09.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:14:09.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:14:09.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:14:09.756 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:14:09.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.756 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:09.756 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:14:09.756 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:14:09.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.756 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.756 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:14:09.756 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:14:09.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.756 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:09.756 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:14:09.757 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:14:09.757 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.757 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:09.757 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.757 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:09.757 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:09.757 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.348969012, 2024-04-26T11:14:09.757 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:14:09.757 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:09.757 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:09.757 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:09.757 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:09.757 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:09.758 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:14:09.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.758 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:09.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.758 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:09.758 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:09.758 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.758 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:09.758 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:09.758 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.758 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:09.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:14:09.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:09.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.759 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:09.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:14:09.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:14:09.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.759 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:09.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:14:09.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:14:09.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.759 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:09.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:14:09.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:14:09.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.760 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:14:09.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:14:09.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.760 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:09.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:14:09.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:14:09.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.760 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:14:09.761 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:14:09.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.761 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:09.761 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:14:09.761 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:14:09.761 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.761 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:09.761 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.761 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:09.761 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:09.761 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.348904709999999, 2024-04-26T11:14:09.761 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:14:09.762 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:09.762 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:09.762 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:09.762 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:09.762 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:09.762 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:14:09.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.762 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:09.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.762 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:09.762 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:09.762 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.763 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:09.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:09.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.763 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:09.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:09.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:09.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.763 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:09.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:14:09.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:14:09.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.764 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:09.764 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:14:09.764 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:14:09.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.764 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:09.764 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:14:09.764 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:14:09.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.764 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.764 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:14:09.764 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:14:09.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:09.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:14:09.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:14:09.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:14:09.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:14:09.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:09.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:14:09.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:14:09.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:09.766 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:14:09.766 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:14:09.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.766 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.766 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:09.766 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:14:09.766 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:14:09.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.766 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.766 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:09.766 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:14:09.766 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:14:09.766 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.766 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:09.766 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.767 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:09.767 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:09.767 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.348850486, 2024-04-26T11:14:09.767 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:14:09.767 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:09.767 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:09.767 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:09.767 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:09.767 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:09.767 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:14:09.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.767 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:09.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.768 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:09.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:09.768 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.768 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:09.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:09.768 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.768 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:09.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:09.768 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:09.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.769 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:09.769 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:14:09.769 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:14:09.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.769 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:09.769 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:14:09.769 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:14:09.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.769 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:09.769 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:14:09.769 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:14:09.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.770 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.770 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:14:09.770 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:14:09.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.770 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.770 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:09.770 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:14:09.770 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:14:09.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.770 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.770 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.770 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:14:09.770 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:14:09.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.771 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.771 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:09.771 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:14:09.771 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:14:09.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.771 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.771 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:09.771 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:14:09.771 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:14:09.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.771 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.771 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:09.771 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:14:09.771 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:09.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.772 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.772 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:09.772 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:14:09.772 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:14:09.772 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.772 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:09.772 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.772 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.772 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:09.772 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:09.772 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.348805973999999, 2024-04-26T11:14:09.772 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:14:09.772 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:09.772 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:09.773 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:09.773 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:09.773 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:09.773 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:14:09.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.773 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:09.773 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.773 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:09.773 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:09.773 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.773 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.773 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:09.773 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:09.773 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.774 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.774 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:09.774 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:14:09.774 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:09.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.774 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.774 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:09.774 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:14:09.774 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:14:09.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.774 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.774 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:09.774 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:14:09.774 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:14:09.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.775 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.775 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:09.775 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:14:09.775 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:14:09.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.775 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.775 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.775 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:14:09.775 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:14:09.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.775 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.775 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:09.775 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:14:09.775 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:14:09.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.776 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.776 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:14:09.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:14:09.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.776 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:09.776 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:14:09.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:14:09.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.776 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:09.776 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:14:09.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:14:09.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.777 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:09.777 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:14:09.777 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:14:09.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.777 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:09.777 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:14:09.777 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:14:09.777 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.777 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:09.777 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.777 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:09.778 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:09.778 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.344584972, 2024-04-26T11:14:09.778 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:14:09.778 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:09.778 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:09.778 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:09.778 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:09.778 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:09.778 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:14:09.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.778 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:09.778 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.778 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:09.778 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:09.779 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.779 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:09.779 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:09.779 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.779 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:09.779 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:14:09.779 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:14:09.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.779 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:09.779 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:14:09.779 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:14:09.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.780 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:09.780 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:14:09.780 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:14:09.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.780 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:09.780 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:14:09.780 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:14:09.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.780 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.780 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:14:09.780 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:14:09.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.781 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.781 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:09.781 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:14:09.781 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:14:09.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.781 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.781 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.781 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:14:09.781 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:14:09.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.781 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.781 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:09.781 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:14:09.781 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:14:09.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.782 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:09.782 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:14:09.782 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:14:09.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.782 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:09.782 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:14:09.782 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:14:09.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.782 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:09.782 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:14:09.782 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:14:09.782 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.783 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:09.783 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.783 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.783 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:61817 5.a 5:5627ce7f:::benchmark_data_smithi029_44842_object61816:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:09.783 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:09.783 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.9944595189999994, 2024-04-26T11:14:09.783 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020626958000000001, 2024-04-26T11:14:09.783 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:09.783 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:09.783 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:09.783 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:09.783 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:09.783 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 61817 2024-04-26T11:14:09.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.784 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:09.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.784 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:09.784 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:09.784 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.784 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:09.784 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:09.784 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.784 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:09.784 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:09.784 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:09.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.785 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:09.785 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702591+0000", 2024-04-26T11:14:09.785 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0665999999999998e-05 2024-04-26T11:14:09.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.785 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:09.785 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702599+0000", 2024-04-26T11:14:09.785 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7130000000000005e-06 2024-04-26T11:14:09.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.785 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:09.785 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702605+0000", 2024-04-26T11:14:09.785 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4310000000000002e-06 2024-04-26T11:14:09.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.786 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.786 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.707947+0000", 2024-04-26T11:14:09.786 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053424220000000003 2024-04-26T11:14:09.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.786 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:09.786 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.708052+0000", 2024-04-26T11:14:09.786 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010499 2024-04-26T11:14:09.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.786 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:14:09.786 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.708141+0000", 2024-04-26T11:14:09.786 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9514999999999999e-05 2024-04-26T11:14:09.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.787 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.787 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:09.787 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.711954+0000", 2024-04-26T11:14:09.787 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003812265 2024-04-26T11:14:09.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.787 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.787 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:09.787 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723070+0000", 2024-04-26T11:14:09.787 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011116727 2024-04-26T11:14:09.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.787 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.787 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:09.787 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723121+0000", 2024-04-26T11:14:09.787 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0362999999999999e-05 2024-04-26T11:14:09.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.788 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:09.788 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723158+0000", 2024-04-26T11:14:09.788 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7579000000000001e-05 2024-04-26T11:14:09.788 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.788 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:09.788 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.788 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:65963 5.1 5:8510f6d6:::benchmark_data_smithi029_44842_object65962:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:09.788 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:02.487474+0000", 2024-04-26T11:14:09.788 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 7.2095172380000001, 2024-04-26T11:14:09.788 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.017703408, 2024-04-26T11:14:09.789 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:09.789 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:09.789 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:09.789 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:09.789 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:09.789 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 65963 2024-04-26T11:14:09.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.789 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:09.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.789 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:09.789 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.487474+0000", 2024-04-26T11:14:09.789 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.789 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:09.789 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.487474+0000", 2024-04-26T11:14:09.790 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.790 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:09.790 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.487473+0000", 2024-04-26T11:14:09.790 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:09.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.790 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:09.790 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.487513+0000", 2024-04-26T11:14:09.790 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9789000000000001e-05 2024-04-26T11:14:09.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.790 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:09.791 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.487520+0000", 2024-04-26T11:14:09.791 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0999999999999998e-06 2024-04-26T11:14:09.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.791 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:09.791 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.487525+0000", 2024-04-26T11:14:09.791 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4240000000000001e-06 2024-04-26T11:14:09.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.791 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.791 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.490477+0000", 2024-04-26T11:14:09.791 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0029518040000000001 2024-04-26T11:14:09.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.791 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:09.792 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.490594+0000", 2024-04-26T11:14:09.792 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011702 2024-04-26T11:14:09.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.792 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.792 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:09.792 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.505073+0000", 2024-04-26T11:14:09.792 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.014478781 2024-04-26T11:14:09.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.792 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.792 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:09.792 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.505111+0000", 2024-04-26T11:14:09.792 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7979999999999999e-05 2024-04-26T11:14:09.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.792 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.792 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:09.793 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:02.505177+0000", 2024-04-26T11:14:09.793 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6019999999999995e-05 2024-04-26T11:14:09.793 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.793 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:09.793 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.793 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:73309 5.6 5:6e28f214:::benchmark_data_smithi029_44842_object73308:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T11:14:09.793 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:05.688811+0000", 2024-04-26T11:14:09.793 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.0081797960000003, 2024-04-26T11:14:09.793 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018666492999999999, 2024-04-26T11:14:09.793 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:09.793 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:09.793 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:09.793 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:09.794 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:09.794 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 73309 2024-04-26T11:14:09.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.794 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:09.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.794 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:09.794 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.688811+0000", 2024-04-26T11:14:09.794 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.794 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:09.794 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.688811+0000", 2024-04-26T11:14:09.794 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.795 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:09.795 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.688810+0000", 2024-04-26T11:14:09.795 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:09.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.795 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:09.795 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.688886+0000", 2024-04-26T11:14:09.795 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5746000000000003e-05 2024-04-26T11:14:09.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.795 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:09.795 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.688895+0000", 2024-04-26T11:14:09.795 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7649999999999999e-06 2024-04-26T11:14:09.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.796 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:09.796 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.688901+0000", 2024-04-26T11:14:09.796 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3559999999999998e-06 2024-04-26T11:14:09.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.796 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.796 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.698522+0000", 2024-04-26T11:14:09.796 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0096204299999999993 2024-04-26T11:14:09.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.796 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:09.796 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.698613+0000", 2024-04-26T11:14:09.796 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1440999999999994e-05 2024-04-26T11:14:09.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.796 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:09.797 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.707323+0000", 2024-04-26T11:14:09.797 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.008709662 2024-04-26T11:14:09.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.797 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.797 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:09.797 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.707391+0000", 2024-04-26T11:14:09.797 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8137000000000002e-05 2024-04-26T11:14:09.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.797 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.797 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:09.797 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:05.707478+0000", 2024-04-26T11:14:09.797 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6729000000000003e-05 2024-04-26T11:14:09.797 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.797 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:09.797 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.798 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.798 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:75771 5.c 5:3cc8f1b4:::benchmark_data_smithi029_44842_object75770:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T11:14:09.798 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:09.798 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 2.9440151759999997, 2024-04-26T11:14:09.798 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019437949, 2024-04-26T11:14:09.798 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:09.798 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:09.798 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:09.798 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:09.798 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:09.798 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 75771 2024-04-26T11:14:09.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.798 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:09.798 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.798 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:09.799 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:09.799 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.799 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:09.799 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:09.799 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.799 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:09.799 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752975+0000", 2024-04-26T11:14:09.799 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:09.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.799 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:09.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753061+0000", 2024-04-26T11:14:09.800 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5890999999999995e-05 2024-04-26T11:14:09.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.800 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:09.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753071+0000", 2024-04-26T11:14:09.800 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.9990000000000003e-06 2024-04-26T11:14:09.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.800 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:09.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753078+0000", 2024-04-26T11:14:09.800 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1559999999999998e-06 2024-04-26T11:14:09.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.800 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.758559+0000", 2024-04-26T11:14:09.801 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0054812819999999996 2024-04-26T11:14:09.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.801 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:09.801 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.758692+0000", 2024-04-26T11:14:09.801 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000133301 2024-04-26T11:14:09.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.801 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:09.801 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772277+0000", 2024-04-26T11:14:09.801 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.013584839 2024-04-26T11:14:09.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.801 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:09.801 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772340+0000", 2024-04-26T11:14:09.801 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2360999999999995e-05 2024-04-26T11:14:09.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.802 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:09.802 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772414+0000", 2024-04-26T11:14:09.802 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4024999999999997e-05 2024-04-26T11:14:09.802 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.802 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:09.802 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.802 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:75769 5.4 e30/16 5:2d0fae00:::benchmark_data_smithi029_44842_object75768:head v 30'4754, mlcod=30'4750)", 2024-04-26T11:14:09.802 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.753826+0000", 2024-04-26T11:14:09.802 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 2.943164812, 2024-04-26T11:14:09.802 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018628183, 2024-04-26T11:14:09.802 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:09.803 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:09.803 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:09.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.803 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:09.803 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753826+0000", 2024-04-26T11:14:09.803 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.803 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:09.803 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753826+0000", 2024-04-26T11:14:09.803 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:09.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.803 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:09.803 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753825+0000", 2024-04-26T11:14:09.804 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:09.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.804 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:09.804 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753870+0000", 2024-04-26T11:14:09.804 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4258000000000002e-05 2024-04-26T11:14:09.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.804 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:09.804 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753881+0000", 2024-04-26T11:14:09.804 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1374e-05 2024-04-26T11:14:09.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.804 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:09.804 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753888+0000", 2024-04-26T11:14:09.805 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1049999999999997e-06 2024-04-26T11:14:09.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.805 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:09.805 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.758569+0000", 2024-04-26T11:14:09.805 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046807180000000004 2024-04-26T11:14:09.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.805 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:09.805 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.758590+0000", 2024-04-26T11:14:09.805 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1444e-05 2024-04-26T11:14:09.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.805 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:09.805 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772419+0000", 2024-04-26T11:14:09.805 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.013828474 2024-04-26T11:14:09.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:09.806 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:09.806 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:09.806 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772454+0000", 2024-04-26T11:14:09.806 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5488999999999999e-05 2024-04-26T11:14:09.806 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.806 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:09.806 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.806 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:09.806 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:09.806 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:09.808 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:09.808 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:09.806+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:09.908 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:09.906+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:09.986 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:09.987 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:09.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.987 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:80907 5.b 5:d25ea65e:::benchmark_data_smithi029_44842_object80906:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:09.987 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:09.979029+0000", 2024-04-26T11:14:09.987 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.005254262, 2024-04-26T11:14:09.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052826160000000004, 2024-04-26T11:14:09.987 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:09.987 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:09.987 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:09.987 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:09.987 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:09.987 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 80907 2024-04-26T11:14:09.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.988 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:09.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:09.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979029+0000", 2024-04-26T11:14:09.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:09.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:09.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979029+0000", 2024-04-26T11:14:09.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:09.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:09.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979029+0000", 2024-04-26T11:14:09.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:09.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:09.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979060+0000", 2024-04-26T11:14:09.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0867000000000001e-05 2024-04-26T11:14:09.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:09.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979068+0000", 2024-04-26T11:14:09.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4889999999999995e-06 2024-04-26T11:14:09.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:09.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979074+0000", 2024-04-26T11:14:09.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3069999999999999e-06 2024-04-26T11:14:09.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:09.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.981097+0000", 2024-04-26T11:14:09.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020221570000000001 2024-04-26T11:14:09.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:09.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.981223+0000", 2024-04-26T11:14:09.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000126069 2024-04-26T11:14:09.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:09.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.981373+0000", 2024-04-26T11:14:09.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014997099999999999 2024-04-26T11:14:09.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:09.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.983663+0000", 2024-04-26T11:14:09.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022898770000000001 2024-04-26T11:14:09.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:09.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984247+0000", 2024-04-26T11:14:09.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00058479699999999996 2024-04-26T11:14:09.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:09.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984289+0000", 2024-04-26T11:14:09.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1363999999999999e-05 2024-04-26T11:14:09.992 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:09.992 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:09.992 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:09.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.992 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:80908 5.4 5:21d22dc3:::benchmark_data_smithi029_44842_object80907:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:09.992 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:09.979083+0000", 2024-04-26T11:14:09.992 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0052002960000000001, 2024-04-26T11:14:09.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053454560000000002, 2024-04-26T11:14:09.992 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:09.992 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:09.992 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:09.992 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:09.992 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:09.992 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 80908 2024-04-26T11:14:09.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.993 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:09.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:09.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979083+0000", 2024-04-26T11:14:09.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:09.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:09.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979083+0000", 2024-04-26T11:14:09.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:09.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:09.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979083+0000", 2024-04-26T11:14:09.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:09.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:09.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979207+0000", 2024-04-26T11:14:09.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124573 2024-04-26T11:14:09.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:09.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979216+0000", 2024-04-26T11:14:09.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5259999999999993e-06 2024-04-26T11:14:09.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:09.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979222+0000", 2024-04-26T11:14:09.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.348e-06 2024-04-26T11:14:09.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:09.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979268+0000", 2024-04-26T11:14:09.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6199000000000003e-05 2024-04-26T11:14:09.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:09.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979394+0000", 2024-04-26T11:14:09.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012545899999999999 2024-04-26T11:14:09.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:09.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979535+0000", 2024-04-26T11:14:09.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014106899999999999 2024-04-26T11:14:09.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:09.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.982532+0000", 2024-04-26T11:14:09.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0029965930000000001 2024-04-26T11:14:09.997 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:09.997 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:09.997 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:09.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.997 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:80910 5.a 5:56202ed2:::benchmark_data_smithi029_44842_object80909:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:09.997 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:09.979245+0000", 2024-04-26T11:14:09.997 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0050390610000000001, 2024-04-26T11:14:09.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052741890000000003, 2024-04-26T11:14:09.997 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:09.997 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:09.997 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:09.997 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:09.997 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:09.998 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 80910 2024-04-26T11:14:09.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.998 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:09.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:09.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979245+0000", 2024-04-26T11:14:09.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:09.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:09.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979245+0000", 2024-04-26T11:14:09.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:09.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:09.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979244+0000", 2024-04-26T11:14:09.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:09.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:09.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979273+0000", 2024-04-26T11:14:09.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9026e-05 2024-04-26T11:14:09.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:09.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979286+0000", 2024-04-26T11:14:09.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3054000000000001e-05 2024-04-26T11:14:09.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:09.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:09.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979293+0000", 2024-04-26T11:14:10.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6969999999999996e-06 2024-04-26T11:14:10.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979332+0000", 2024-04-26T11:14:10.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9533000000000002e-05 2024-04-26T11:14:10.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:10.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979414+0000", 2024-04-26T11:14:10.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1785000000000004e-05 2024-04-26T11:14:10.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:10.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979509+0000", 2024-04-26T11:14:10.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4951000000000006e-05 2024-04-26T11:14:10.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:10.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.983158+0000", 2024-04-26T11:14:10.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036485630000000001 2024-04-26T11:14:10.001 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.001 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.001 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.001 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:80913 5.a 5:55d550d1:::benchmark_data_smithi029_44842_object80912:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:10.001 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:09.981164+0000", 2024-04-26T11:14:10.002 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.003119733, 2024-04-26T11:14:10.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034441010000000002, 2024-04-26T11:14:10.002 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.002 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:10.002 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.002 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.002 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.002 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 80913 2024-04-26T11:14:10.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.002 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.981164+0000", 2024-04-26T11:14:10.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.981164+0000", 2024-04-26T11:14:10.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.981163+0000", 2024-04-26T11:14:10.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:10.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.981245+0000", 2024-04-26T11:14:10.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2070000000000005e-05 2024-04-26T11:14:10.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.981258+0000", 2024-04-26T11:14:10.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2889e-05 2024-04-26T11:14:10.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.981264+0000", 2024-04-26T11:14:10.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.789e-06 2024-04-26T11:14:10.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.981303+0000", 2024-04-26T11:14:10.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8832999999999999e-05 2024-04-26T11:14:10.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:10.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.981404+0000", 2024-04-26T11:14:10.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000101158 2024-04-26T11:14:10.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:10.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.981530+0000", 2024-04-26T11:14:10.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012634500000000001 2024-04-26T11:14:10.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:10.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.983886+0000", 2024-04-26T11:14:10.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002355663 2024-04-26T11:14:10.006 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.006 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.006 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.006 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:80914 5.e 5:72bee537:::benchmark_data_smithi029_44842_object80913:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:10.006 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:09.981273+0000", 2024-04-26T11:14:10.006 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0030110269999999999, 2024-04-26T11:14:10.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00342655, 2024-04-26T11:14:10.006 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.006 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:10.006 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.006 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.006 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.007 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 80914 2024-04-26T11:14:10.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.007 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.981273+0000", 2024-04-26T11:14:10.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.981273+0000", 2024-04-26T11:14:10.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.981272+0000", 2024-04-26T11:14:10.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.981350+0000", 2024-04-26T11:14:10.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7318999999999996e-05 2024-04-26T11:14:10.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.981357+0000", 2024-04-26T11:14:10.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3880000000000002e-06 2024-04-26T11:14:10.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.981363+0000", 2024-04-26T11:14:10.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4829999999999996e-06 2024-04-26T11:14:10.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.981395+0000", 2024-04-26T11:14:10.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1640000000000002e-05 2024-04-26T11:14:10.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:10.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.981472+0000", 2024-04-26T11:14:10.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6747000000000002e-05 2024-04-26T11:14:10.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:10.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.981554+0000", 2024-04-26T11:14:10.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2089000000000006e-05 2024-04-26T11:14:10.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:10.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.983860+0000", 2024-04-26T11:14:10.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002306542 2024-04-26T11:14:10.010 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.010 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.010 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.010 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:80916 5.9 5:9bd89f04:::benchmark_data_smithi029_44842_object80915:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:10.010 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:09.983034+0000", 2024-04-26T11:14:10.010 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.001249343, 2024-04-26T11:14:10.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001746982, 2024-04-26T11:14:10.011 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.011 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:10.011 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.011 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.011 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.011 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 80916 2024-04-26T11:14:10.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.011 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.983034+0000", 2024-04-26T11:14:10.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.983034+0000", 2024-04-26T11:14:10.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.983033+0000", 2024-04-26T11:14:10.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:10.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.983100+0000", 2024-04-26T11:14:10.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6822999999999994e-05 2024-04-26T11:14:10.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.983112+0000", 2024-04-26T11:14:10.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1559999999999999e-05 2024-04-26T11:14:10.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.983120+0000", 2024-04-26T11:14:10.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1640000000000001e-06 2024-04-26T11:14:10.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.983160+0000", 2024-04-26T11:14:10.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9839999999999998e-05 2024-04-26T11:14:10.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:10.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.983250+0000", 2024-04-26T11:14:10.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9968000000000003e-05 2024-04-26T11:14:10.014 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.014 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.014 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.014 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:80919 5.e 5:72d37c66:::benchmark_data_smithi029_44842_object80918:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:10.014 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:09.984049+0000", 2024-04-26T11:14:10.014 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00023430599999999999, 2024-04-26T11:14:10.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081694500000000002, 2024-04-26T11:14:10.014 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.015 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:10.015 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.015 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.015 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.015 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 80919 2024-04-26T11:14:10.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.015 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984049+0000", 2024-04-26T11:14:10.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984049+0000", 2024-04-26T11:14:10.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984049+0000", 2024-04-26T11:14:10.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:10.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984107+0000", 2024-04-26T11:14:10.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8659999999999997e-05 2024-04-26T11:14:10.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984119+0000", 2024-04-26T11:14:10.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1573000000000001e-05 2024-04-26T11:14:10.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984126+0000", 2024-04-26T11:14:10.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4939999999999997e-06 2024-04-26T11:14:10.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984165+0000", 2024-04-26T11:14:10.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8476999999999998e-05 2024-04-26T11:14:10.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:10.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984296+0000", 2024-04-26T11:14:10.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000131099 2024-04-26T11:14:10.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:10.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984440+0000", 2024-04-26T11:14:10.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014396400000000001 2024-04-26T11:14:10.018 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.018 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.018 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.018 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:80920 5.0 5:02d7b326:::benchmark_data_smithi029_44842_object80919:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:10.018 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:09.984136+0000", 2024-04-26T11:14:10.018 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.000147298, 2024-04-26T11:14:10.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081856799999999999, 2024-04-26T11:14:10.018 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.019 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:10.019 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.019 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.019 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.019 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 80920 2024-04-26T11:14:10.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.019 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984136+0000", 2024-04-26T11:14:10.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984136+0000", 2024-04-26T11:14:10.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984136+0000", 2024-04-26T11:14:10.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984169+0000", 2024-04-26T11:14:10.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2974e-05 2024-04-26T11:14:10.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984176+0000", 2024-04-26T11:14:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1980000000000004e-06 2024-04-26T11:14:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984181+0000", 2024-04-26T11:14:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2079999999999999e-06 2024-04-26T11:14:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984216+0000", 2024-04-26T11:14:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5042000000000001e-05 2024-04-26T11:14:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:10.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984337+0000", 2024-04-26T11:14:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000121159 2024-04-26T11:14:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984427+0000", 2024-04-26T11:14:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9858000000000006e-05 2024-04-26T11:14:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:80922 5.0 5.f0c79130 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:09.984393+0000", 2024-04-26T11:14:10.022 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9998908, 2024-04-26T11:14:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00064143900000000005, 2024-04-26T11:14:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 80922 2024-04-26T11:14:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984393+0000", 2024-04-26T11:14:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984393+0000", 2024-04-26T11:14:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984392+0000", 2024-04-26T11:14:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984490+0000", 2024-04-26T11:14:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7614000000000004e-05 2024-04-26T11:14:10.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984497+0000", 2024-04-26T11:14:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6640000000000001e-06 2024-04-26T11:14:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984501+0000", 2024-04-26T11:14:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1099999999999996e-06 2024-04-26T11:14:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.025 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:80923 5.a 5:55c31f96:::benchmark_data_smithi029_44842_object80922:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:09.984923+0000", 2024-04-26T11:14:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.999361, 2024-04-26T11:14:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00017978499999999999, 2024-04-26T11:14:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 80923 2024-04-26T11:14:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984923+0000", 2024-04-26T11:14:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984923+0000", 2024-04-26T11:14:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.984922+0000", 2024-04-26T11:14:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.985003+0000", 2024-04-26T11:14:10.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0479e-05 2024-04-26T11:14:10.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.985013+0000", 2024-04-26T11:14:10.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0105000000000001e-05 2024-04-26T11:14:10.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.985020+0000", 2024-04-26T11:14:10.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6749999999999996e-06 2024-04-26T11:14:10.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.985049+0000", 2024-04-26T11:14:10.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.938e-05 2024-04-26T11:14:10.029 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.029 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.029 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.029 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:80924 5.f 5:fdfde301:::benchmark_data_smithi029_44842_object80923:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:10.029 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:09.985029+0000", 2024-04-26T11:14:10.029 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9992547, 2024-04-26T11:14:10.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014788299999999999, 2024-04-26T11:14:10.029 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.029 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:10.029 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 80924 2024-04-26T11:14:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.985029+0000", 2024-04-26T11:14:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.985029+0000", 2024-04-26T11:14:10.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.985028+0000", 2024-04-26T11:14:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.985056+0000", 2024-04-26T11:14:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7965000000000001e-05 2024-04-26T11:14:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.985063+0000", 2024-04-26T11:14:10.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.674e-06 2024-04-26T11:14:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.985068+0000", 2024-04-26T11:14:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1599999999999997e-06 2024-04-26T11:14:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.985104+0000", 2024-04-26T11:14:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6134999999999999e-05 2024-04-26T11:14:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:80902 5.e 5:7aa29849:::benchmark_data_smithi029_44842_object80901:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:09.975593+0000", 2024-04-26T11:14:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0086909870000000007, 2024-04-26T11:14:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096574260000000002, 2024-04-26T11:14:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 80902 2024-04-26T11:14:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.975593+0000", 2024-04-26T11:14:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.975593+0000", 2024-04-26T11:14:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.975592+0000", 2024-04-26T11:14:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.975675+0000", 2024-04-26T11:14:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3114000000000004e-05 2024-04-26T11:14:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.975687+0000", 2024-04-26T11:14:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1956e-05 2024-04-26T11:14:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.975696+0000", 2024-04-26T11:14:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.568e-06 2024-04-26T11:14:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.976523+0000", 2024-04-26T11:14:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00082787699999999997 2024-04-26T11:14:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.976658+0000", 2024-04-26T11:14:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013421799999999999 2024-04-26T11:14:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.976803+0000", 2024-04-26T11:14:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014487300000000001 2024-04-26T11:14:10.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.983176+0000", 2024-04-26T11:14:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063737660000000003 2024-04-26T11:14:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:80904 5.e 5:7e1e5cd8:::benchmark_data_smithi029_44842_object80903:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:09.976700+0000", 2024-04-26T11:14:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0075834370000000002, 2024-04-26T11:14:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0086440939999999997, 2024-04-26T11:14:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.037 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 80904 2024-04-26T11:14:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.976700+0000", 2024-04-26T11:14:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.976700+0000", 2024-04-26T11:14:10.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.976699+0000", 2024-04-26T11:14:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.976784+0000", 2024-04-26T11:14:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4590000000000002e-05 2024-04-26T11:14:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.976797+0000", 2024-04-26T11:14:10.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2636000000000001e-05 2024-04-26T11:14:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.976806+0000", 2024-04-26T11:14:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2280000000000004e-06 2024-04-26T11:14:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979079+0000", 2024-04-26T11:14:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022735870000000001 2024-04-26T11:14:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979170+0000", 2024-04-26T11:14:10.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0419000000000003e-05 2024-04-26T11:14:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.979314+0000", 2024-04-26T11:14:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014393699999999999 2024-04-26T11:14:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:09.983180+0000", 2024-04-26T11:14:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003866006 2024-04-26T11:14:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.041 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:14:10.042 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 13 2024-04-26T11:14:10.042 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:10.043 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:10.044 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:10.042+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:10.143 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:10.142+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:10.246 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:10.245+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:10.255 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:10.255 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:14:10.255 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:14:10.255 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:14:10.255 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:10.271 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:10.346 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:10.345+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:10.412 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 32 16 81936 81920 159.986 146.688 0.00546609 0.00624769 2024-04-26T11:14:10.446 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~12s 2024-04-26T11:14:10.447 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:10.446+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:10.493 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:10.493 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:14:10.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:14:10.493 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:10.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.494 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35482 5.b 5:d2b3ef95:::benchmark_data_smithi029_44842_object35481:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:14:10.494 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:14:10.494 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.071300552, 2024-04-26T11:14:10.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019390455000000001, 2024-04-26T11:14:10.494 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.494 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:10.494 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.494 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.494 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.494 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35482 2024-04-26T11:14:10.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.494 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:14:10.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418682+0000", 2024-04-26T11:14:10.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418681+0000", 2024-04-26T11:14:10.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:10.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418802+0000", 2024-04-26T11:14:10.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120835 2024-04-26T11:14:10.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418810+0000", 2024-04-26T11:14:10.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1240000000000005e-06 2024-04-26T11:14:10.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418816+0000", 2024-04-26T11:14:10.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5749999999999997e-06 2024-04-26T11:14:10.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.419905+0000", 2024-04-26T11:14:10.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001088751 2024-04-26T11:14:10.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:10.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.420046+0000", 2024-04-26T11:14:10.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000140514 2024-04-26T11:14:10.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:10.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.420180+0000", 2024-04-26T11:14:10.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013440899999999999 2024-04-26T11:14:10.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:10.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425415+0000", 2024-04-26T11:14:10.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052350540000000003 2024-04-26T11:14:10.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:10.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.437989+0000", 2024-04-26T11:14:10.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012573632 2024-04-26T11:14:10.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:10.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.438035+0000", 2024-04-26T11:14:10.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5799e-05 2024-04-26T11:14:10.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:10.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.438072+0000", 2024-04-26T11:14:10.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7530999999999997e-05 2024-04-26T11:14:10.500 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.500 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.500 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.500 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35483 5.b 5:d3dd14f6:::benchmark_data_smithi029_44842_object35482:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:14:10.500 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:10.500 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.071157809999999, 2024-04-26T11:14:10.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021245969, 2024-04-26T11:14:10.500 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.500 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:10.501 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.501 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.501 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.501 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35483 2024-04-26T11:14:10.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.501 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:10.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:10.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:10.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418885+0000", 2024-04-26T11:14:10.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1294e-05 2024-04-26T11:14:10.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418892+0000", 2024-04-26T11:14:10.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4599999999999997e-06 2024-04-26T11:14:10.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418899+0000", 2024-04-26T11:14:10.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0909999999999998e-06 2024-04-26T11:14:10.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421347+0000", 2024-04-26T11:14:10.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024484609999999999 2024-04-26T11:14:10.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:10.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421468+0000", 2024-04-26T11:14:10.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000121179 2024-04-26T11:14:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421605+0000", 2024-04-26T11:14:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013672200000000001 2024-04-26T11:14:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425456+0000", 2024-04-26T11:14:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038511719999999999 2024-04-26T11:14:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.439986+0000", 2024-04-26T11:14:10.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014530080000000001 2024-04-26T11:14:10.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:10.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440038+0000", 2024-04-26T11:14:10.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1916999999999998e-05 2024-04-26T11:14:10.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:10.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440070+0000", 2024-04-26T11:14:10.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2245e-05 2024-04-26T11:14:10.505 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.505 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.505 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.506 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44513 5.0 5:0a236ebb:::benchmark_data_smithi029_44842_object44512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:10.506 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:10.506 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 18.319894829999999, 2024-04-26T11:14:10.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020724414, 2024-04-26T11:14:10.506 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.506 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:10.506 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.506 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.506 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.506 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44513 2024-04-26T11:14:10.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.506 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:10.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:10.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:10.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170120+0000", 2024-04-26T11:14:10.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2941000000000002e-05 2024-04-26T11:14:10.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170127+0000", 2024-04-26T11:14:10.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.469e-06 2024-04-26T11:14:10.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170133+0000", 2024-04-26T11:14:10.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1340000000000001e-06 2024-04-26T11:14:10.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182383+0000", 2024-04-26T11:14:10.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012249970000000001 2024-04-26T11:14:10.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:10.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182477+0000", 2024-04-26T11:14:10.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3776999999999993e-05 2024-04-26T11:14:10.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:10.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182572+0000", 2024-04-26T11:14:10.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4841999999999998e-05 2024-04-26T11:14:10.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:10.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188262+0000", 2024-04-26T11:14:10.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005690077 2024-04-26T11:14:10.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:10.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190748+0000", 2024-04-26T11:14:10.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024857780000000001 2024-04-26T11:14:10.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:10.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190776+0000", 2024-04-26T11:14:10.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8419999999999999e-05 2024-04-26T11:14:10.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:10.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190812+0000", 2024-04-26T11:14:10.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5630999999999998e-05 2024-04-26T11:14:10.511 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.511 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.511 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.511 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:10.511 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:10.511 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.211191807999999, 2024-04-26T11:14:10.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:14:10.511 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.511 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:10.511 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.512 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.512 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.512 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:14:10.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.512 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:10.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:10.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:10.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:14:10.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:14:10.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:14:10.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:14:10.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:14:10.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:14:10.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:14:10.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:14:10.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:10.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:14:10.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:14:10.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:10.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:14:10.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:14:10.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:10.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:14:10.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:14:10.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:10.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:14:10.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:14:10.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:10.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:14:10.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:14:10.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:10.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:14:10.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:14:10.516 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.516 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.516 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.516 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:10.517 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:10.517 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.210542105999998, 2024-04-26T11:14:10.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:14:10.517 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.517 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:10.517 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.517 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.517 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.517 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:14:10.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.517 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:10.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:10.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:14:10.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:10.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:14:10.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:14:10.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:14:10.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:14:10.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:14:10.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:14:10.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:14:10.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:14:10.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:10.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:14:10.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:14:10.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:10.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:14:10.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:14:10.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:10.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:14:10.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:14:10.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:10.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:14:10.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:14:10.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:10.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:14:10.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:14:10.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:10.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:14:10.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:14:10.523 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.523 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.523 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.523 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:55093 5.e 5:7ebffa9e:::benchmark_data_smithi029_44842_object55092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:10.523 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:14:10.523 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.743410388000001, 2024-04-26T11:14:10.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020381660999999999, 2024-04-26T11:14:10.524 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.524 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:10.524 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.524 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.524 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.524 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 55093 2024-04-26T11:14:10.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.524 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:14:10.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:14:10.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746571+0000", 2024-04-26T11:14:10.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746599+0000", 2024-04-26T11:14:10.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8262000000000001e-05 2024-04-26T11:14:10.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746610+0000", 2024-04-26T11:14:10.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1070000000000001e-05 2024-04-26T11:14:10.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746617+0000", 2024-04-26T11:14:10.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8190000000000003e-06 2024-04-26T11:14:10.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748218+0000", 2024-04-26T11:14:10.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0016005889999999999 2024-04-26T11:14:10.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:10.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748350+0000", 2024-04-26T11:14:10.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132528 2024-04-26T11:14:10.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:10.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748499+0000", 2024-04-26T11:14:10.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014815600000000001 2024-04-26T11:14:10.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:10.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.750795+0000", 2024-04-26T11:14:10.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022960369999999999 2024-04-26T11:14:10.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:10.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766866+0000", 2024-04-26T11:14:10.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016071230999999998 2024-04-26T11:14:10.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:10.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766922+0000", 2024-04-26T11:14:10.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6643e-05 2024-04-26T11:14:10.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:10.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766953+0000", 2024-04-26T11:14:10.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0981e-05 2024-04-26T11:14:10.529 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.529 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.529 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.529 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:10.529 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:10.529 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.143900067000001, 2024-04-26T11:14:10.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:14:10.530 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.530 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:10.530 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.530 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.530 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.530 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:14:10.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.530 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:10.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:10.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:14:10.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:10.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:14:10.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:14:10.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:14:10.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:14:10.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:14:10.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:14:10.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:14:10.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:14:10.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:10.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:14:10.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:14:10.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:14:10.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:14:10.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:10.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:14:10.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:14:10.533 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.534 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.534 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.534 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:10.534 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:10.534 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.143804421, 2024-04-26T11:14:10.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:14:10.534 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.534 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:10.534 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.534 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.534 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.535 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:14:10.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.535 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:10.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:10.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:14:10.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:14:10.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:14:10.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:14:10.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:14:10.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:14:10.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:14:10.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:14:10.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:14:10.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:10.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:14:10.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:14:10.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:14:10.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:14:10.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:10.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:14:10.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:14:10.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.539 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.539 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:10.539 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:10.539 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.143672742, 2024-04-26T11:14:10.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:14:10.539 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.540 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:10.540 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.540 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.540 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.540 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:14:10.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.540 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:10.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:10.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:10.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:14:10.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:14:10.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:14:10.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:14:10.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:14:10.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:14:10.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:14:10.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:14:10.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:10.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:14:10.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:14:10.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:14:10.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:14:10.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:10.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:14:10.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:14:10.544 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.544 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.544 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.544 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:10.544 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:10.544 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.143564286, 2024-04-26T11:14:10.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:14:10.545 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.545 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:10.545 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.545 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.545 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.545 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:14:10.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.545 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:10.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:10.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:14:10.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:10.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:14:10.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:14:10.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:14:10.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:14:10.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:14:10.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:14:10.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:14:10.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:14:10.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:10.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:14:10.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:14:10.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:14:10.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:14:10.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:10.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:14:10.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:14:10.549 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.549 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.549 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.549 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:10.549 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:10.549 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.143463018, 2024-04-26T11:14:10.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:14:10.549 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.549 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:10.550 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.550 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.550 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.550 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:14:10.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.550 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:10.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:10.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:10.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:14:10.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:14:10.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:14:10.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:14:10.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:14:10.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:14:10.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:14:10.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:14:10.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:10.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:14:10.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:14:10.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:14:10.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:14:10.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:10.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:14:10.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:14:10.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:10.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:14:10.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:14:10.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:10.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:14:10.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:14:10.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:10.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:14:10.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:14:10.555 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.555 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.555 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.555 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:10.555 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:10.555 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.143394077, 2024-04-26T11:14:10.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:14:10.555 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.555 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:10.556 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.556 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.556 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.556 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:14:10.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.556 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:10.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:10.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:14:10.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:14:10.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:14:10.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:14:10.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:14:10.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:14:10.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:14:10.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:14:10.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:14:10.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:10.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:14:10.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:14:10.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:14:10.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:14:10.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:10.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:14:10.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:14:10.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:10.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:14:10.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:14:10.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:10.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:14:10.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:14:10.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:10.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:14:10.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:14:10.561 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.561 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.561 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.561 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:10.561 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:10.561 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.137398495999999, 2024-04-26T11:14:10.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:14:10.561 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.561 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:10.561 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.561 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.561 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.562 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:14:10.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.562 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:10.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:10.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:14:10.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:14:10.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:14:10.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:14:10.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:14:10.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:14:10.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:14:10.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:14:10.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:14:10.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:10.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:14:10.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:14:10.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:14:10.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:14:10.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:10.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:14:10.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:14:10.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:10.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:14:10.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:14:10.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:10.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:14:10.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:14:10.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:10.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:14:10.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:14:10.570 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.570 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.570 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.571 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:66093 5.e 5:70f73c77:::benchmark_data_smithi029_44842_object66092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:10.571 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:02.539855+0000", 2024-04-26T11:14:10.571 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.95012673, 2024-04-26T11:14:10.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019258168999999999, 2024-04-26T11:14:10.571 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.571 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:10.571 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.571 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.571 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.572 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 66093 2024-04-26T11:14:10.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.572 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.539855+0000", 2024-04-26T11:14:10.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.539855+0000", 2024-04-26T11:14:10.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.539855+0000", 2024-04-26T11:14:10.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.539880+0000", 2024-04-26T11:14:10.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4882e-05 2024-04-26T11:14:10.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.539888+0000", 2024-04-26T11:14:10.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8849999999999999e-06 2024-04-26T11:14:10.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.539894+0000", 2024-04-26T11:14:10.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.088e-06 2024-04-26T11:14:10.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.539924+0000", 2024-04-26T11:14:10.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0833000000000001e-05 2024-04-26T11:14:10.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:10.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.540002+0000", 2024-04-26T11:14:10.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7649000000000001e-05 2024-04-26T11:14:10.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:10.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.540085+0000", 2024-04-26T11:14:10.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3337000000000005e-05 2024-04-26T11:14:10.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:10.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.544628+0000", 2024-04-26T11:14:10.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045426080000000001 2024-04-26T11:14:10.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:10.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.559036+0000", 2024-04-26T11:14:10.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014407503 2024-04-26T11:14:10.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:10.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.559090+0000", 2024-04-26T11:14:10.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4598999999999997e-05 2024-04-26T11:14:10.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:10.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:02.559114+0000", 2024-04-26T11:14:10.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3422999999999999e-05 2024-04-26T11:14:10.581 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.581 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.581 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.582 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:75769 5.4 5:2d0fae00:::benchmark_data_smithi029_44842_object75768:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T11:14:10.582 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:06.752726+0000", 2024-04-26T11:14:10.582 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.737256017, 2024-04-26T11:14:10.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019959309000000001, 2024-04-26T11:14:10.582 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.582 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:10.583 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.583 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.583 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.583 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 75769 2024-04-26T11:14:10.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.583 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.752726+0000", 2024-04-26T11:14:10.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.752726+0000", 2024-04-26T11:14:10.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.752725+0000", 2024-04-26T11:14:10.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:14:10.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.752825+0000", 2024-04-26T11:14:10.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100272 2024-04-26T11:14:10.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.752837+0000", 2024-04-26T11:14:10.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1616e-05 2024-04-26T11:14:10.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.752845+0000", 2024-04-26T11:14:10.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.909e-06 2024-04-26T11:14:10.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.753601+0000", 2024-04-26T11:14:10.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00075602899999999997 2024-04-26T11:14:10.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:10.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.753690+0000", 2024-04-26T11:14:10.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9118999999999998e-05 2024-04-26T11:14:10.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:10.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.753780+0000", 2024-04-26T11:14:10.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0579000000000001e-05 2024-04-26T11:14:10.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:10.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.762563+0000", 2024-04-26T11:14:10.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087824930000000006 2024-04-26T11:14:10.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:10.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.772603+0000", 2024-04-26T11:14:10.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010039777999999999 2024-04-26T11:14:10.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:10.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.772650+0000", 2024-04-26T11:14:10.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7593999999999999e-05 2024-04-26T11:14:10.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:10.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:06.772685+0000", 2024-04-26T11:14:10.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5324000000000003e-05 2024-04-26T11:14:10.592 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.592 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.592 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.593 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:81242 5.0 5:0eb2d981:::benchmark_data_smithi029_44842_object81241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:10.593 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:10.110469+0000", 2024-04-26T11:14:10.593 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.379513459, 2024-04-26T11:14:10.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019839358000000001, 2024-04-26T11:14:10.593 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.593 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:10.593 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.593 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.593 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.593 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 81242 2024-04-26T11:14:10.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.593 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.110469+0000", 2024-04-26T11:14:10.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.110469+0000", 2024-04-26T11:14:10.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.110468+0000", 2024-04-26T11:14:10.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.110498+0000", 2024-04-26T11:14:10.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0324e-05 2024-04-26T11:14:10.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.110510+0000", 2024-04-26T11:14:10.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1894e-05 2024-04-26T11:14:10.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.110517+0000", 2024-04-26T11:14:10.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7950000000000002e-06 2024-04-26T11:14:10.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.110556+0000", 2024-04-26T11:14:10.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8590999999999997e-05 2024-04-26T11:14:10.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:10.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.110684+0000", 2024-04-26T11:14:10.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012829700000000001 2024-04-26T11:14:10.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:10.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.110804+0000", 2024-04-26T11:14:10.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000119902 2024-04-26T11:14:10.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:10.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.114388+0000", 2024-04-26T11:14:10.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035840339999999998 2024-04-26T11:14:10.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:10.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.130204+0000", 2024-04-26T11:14:10.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015816197000000001 2024-04-26T11:14:10.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:10.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.130256+0000", 2024-04-26T11:14:10.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1490000000000003e-05 2024-04-26T11:14:10.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:10.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.130308+0000", 2024-04-26T11:14:10.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2454000000000003e-05 2024-04-26T11:14:10.598 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.598 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.598 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.598 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:81250 5.e 5:7a98b2cc:::benchmark_data_smithi029_44842_object81249:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:10.599 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:10.112995+0000", 2024-04-26T11:14:10.599 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.37698741600000002, 2024-04-26T11:14:10.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019308568000000002, 2024-04-26T11:14:10.599 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.599 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:10.599 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.599 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.599 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.599 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 81250 2024-04-26T11:14:10.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.599 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.112995+0000", 2024-04-26T11:14:10.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.112995+0000", 2024-04-26T11:14:10.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.112994+0000", 2024-04-26T11:14:10.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.113028+0000", 2024-04-26T11:14:10.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3290000000000001e-05 2024-04-26T11:14:10.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.113035+0000", 2024-04-26T11:14:10.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4930000000000001e-06 2024-04-26T11:14:10.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.113041+0000", 2024-04-26T11:14:10.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4079999999999997e-06 2024-04-26T11:14:10.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.113084+0000", 2024-04-26T11:14:10.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3819999999999997e-05 2024-04-26T11:14:10.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:10.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.113220+0000", 2024-04-26T11:14:10.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000135368 2024-04-26T11:14:10.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:10.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.113381+0000", 2024-04-26T11:14:10.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016100199999999999 2024-04-26T11:14:10.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:10.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127536+0000", 2024-04-26T11:14:10.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014155235 2024-04-26T11:14:10.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:10.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.132212+0000", 2024-04-26T11:14:10.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0046756899999999997 2024-04-26T11:14:10.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:10.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.132261+0000", 2024-04-26T11:14:10.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9005000000000003e-05 2024-04-26T11:14:10.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:10.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.132303+0000", 2024-04-26T11:14:10.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2657999999999997e-05 2024-04-26T11:14:10.604 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.604 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.604 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.604 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:81256 5.8 5:1c0f3fd8:::benchmark_data_smithi029_44842_object81255:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:10.604 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:10.604 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.37393894700000002, 2024-04-26T11:14:10.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026193673000000001, 2024-04-26T11:14:10.604 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.604 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:10.604 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.604 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.605 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.605 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 81256 2024-04-26T11:14:10.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.605 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:10.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:10.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:10.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116073+0000", 2024-04-26T11:14:10.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0114e-05 2024-04-26T11:14:10.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116079+0000", 2024-04-26T11:14:10.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8939999999999998e-06 2024-04-26T11:14:10.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116082+0000", 2024-04-26T11:14:10.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:14:10.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127501+0000", 2024-04-26T11:14:10.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011418281000000001 2024-04-26T11:14:10.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:10.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127639+0000", 2024-04-26T11:14:10.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013828899999999999 2024-04-26T11:14:10.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:10.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127782+0000", 2024-04-26T11:14:10.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014328299999999999 2024-04-26T11:14:10.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:10.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.134767+0000", 2024-04-26T11:14:10.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0069844140000000004 2024-04-26T11:14:10.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:10.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142160+0000", 2024-04-26T11:14:10.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007392839 2024-04-26T11:14:10.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:10.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142202+0000", 2024-04-26T11:14:10.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2797999999999999e-05 2024-04-26T11:14:10.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:10.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142237+0000", 2024-04-26T11:14:10.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4464000000000001e-05 2024-04-26T11:14:10.609 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.609 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.610 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.610 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:81877 5.e 5:7bd0c708:::benchmark_data_smithi029_44842_object81876:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:10.610 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:10.384824+0000", 2024-04-26T11:14:10.610 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.105158629, 2024-04-26T11:14:10.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019282093, 2024-04-26T11:14:10.610 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.610 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:10.610 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.610 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.610 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.610 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 81877 2024-04-26T11:14:10.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.610 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.384824+0000", 2024-04-26T11:14:10.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.384824+0000", 2024-04-26T11:14:10.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.384823+0000", 2024-04-26T11:14:10.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.384874+0000", 2024-04-26T11:14:10.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1152000000000001e-05 2024-04-26T11:14:10.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.384878+0000", 2024-04-26T11:14:10.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.07e-06 2024-04-26T11:14:10.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.384882+0000", 2024-04-26T11:14:10.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.247e-06 2024-04-26T11:14:10.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.384922+0000", 2024-04-26T11:14:10.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0079e-05 2024-04-26T11:14:10.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:10.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.385025+0000", 2024-04-26T11:14:10.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010382099999999999 2024-04-26T11:14:10.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:10.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.385122+0000", 2024-04-26T11:14:10.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6328000000000003e-05 2024-04-26T11:14:10.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:10.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.391409+0000", 2024-04-26T11:14:10.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062873429999999999 2024-04-26T11:14:10.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:10.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.404025+0000", 2024-04-26T11:14:10.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012616318 2024-04-26T11:14:10.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:10.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.404070+0000", 2024-04-26T11:14:10.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4261000000000002e-05 2024-04-26T11:14:10.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:10.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.404106+0000", 2024-04-26T11:14:10.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5865000000000003e-05 2024-04-26T11:14:10.615 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.615 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.615 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.615 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:81878 5.e 5:7afd9a88:::benchmark_data_smithi029_44842_object81877:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:10.615 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:10.384888+0000", 2024-04-26T11:14:10.615 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.10509420799999999, 2024-04-26T11:14:10.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019295751999999999, 2024-04-26T11:14:10.616 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:10.616 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:10.616 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:10.616 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:10.616 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.616 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 81878 2024-04-26T11:14:10.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.616 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:10.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:10.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.384888+0000", 2024-04-26T11:14:10.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:10.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.384888+0000", 2024-04-26T11:14:10.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:10.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:10.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.384887+0000", 2024-04-26T11:14:10.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:10.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.384926+0000", 2024-04-26T11:14:10.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8736999999999999e-05 2024-04-26T11:14:10.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:10.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.384933+0000", 2024-04-26T11:14:10.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6409999999999996e-06 2024-04-26T11:14:10.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.384939+0000", 2024-04-26T11:14:10.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0190000000000003e-06 2024-04-26T11:14:10.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:10.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.388633+0000", 2024-04-26T11:14:10.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036945810000000002 2024-04-26T11:14:10.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:10.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.388740+0000", 2024-04-26T11:14:10.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010631700000000001 2024-04-26T11:14:10.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:10.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.388864+0000", 2024-04-26T11:14:10.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000124494 2024-04-26T11:14:10.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:10.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.391453+0000", 2024-04-26T11:14:10.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025885449999999998 2024-04-26T11:14:10.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:10.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.404114+0000", 2024-04-26T11:14:10.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012661172 2024-04-26T11:14:10.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:10.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.404154+0000", 2024-04-26T11:14:10.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9755999999999997e-05 2024-04-26T11:14:10.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:10.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:10.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:10.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.404184+0000", 2024-04-26T11:14:10.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9952000000000001e-05 2024-04-26T11:14:10.621 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.621 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.621 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.621 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:10.621 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:10.621 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:10.622 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:10.621+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:10.623 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:10.723 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:10.722+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:10.808 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:10.809 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:10.809 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.809 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:82831 5.7 5:e0eeb193:::benchmark_data_smithi029_44842_object82830:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:10.809 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:10.803623+0000", 2024-04-26T11:14:10.809 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0034048070000000001, 2024-04-26T11:14:10.809 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0034367719999999998, 2024-04-26T11:14:10.809 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:10.809 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:10.809 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:10.809 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:10.809 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.809 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 82831 2024-04-26T11:14:10.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.809 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:10.810 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.810 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:10.810 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.803623+0000", 2024-04-26T11:14:10.810 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:10.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.810 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.810 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:10.810 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.803623+0000", 2024-04-26T11:14:10.810 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:10.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.810 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.810 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:10.810 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.803622+0000", 2024-04-26T11:14:10.810 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.811 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:10.811 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.803748+0000", 2024-04-26T11:14:10.811 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000126029 2024-04-26T11:14:10.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.811 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:10.811 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.803758+0000", 2024-04-26T11:14:10.811 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.9080000000000007e-06 2024-04-26T11:14:10.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.811 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.811 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.803765+0000", 2024-04-26T11:14:10.812 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4159999999999998e-06 2024-04-26T11:14:10.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.812 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.812 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:10.812 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.803804+0000", 2024-04-26T11:14:10.812 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8083000000000001e-05 2024-04-26T11:14:10.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.812 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.812 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:10.812 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.803915+0000", 2024-04-26T11:14:10.813 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011176899999999999 2024-04-26T11:14:10.813 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:10.813 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:10.813 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:10.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.813 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.813 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:82835 5.5 5:a6b0a14c:::benchmark_data_smithi029_44842_object82834:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:10.813 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:10.803887+0000", 2024-04-26T11:14:10.813 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0031403889999999999, 2024-04-26T11:14:10.813 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0032663280000000002, 2024-04-26T11:14:10.813 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:10.813 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:10.813 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:10.813 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:10.813 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.814 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 82835 2024-04-26T11:14:10.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.814 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:10.814 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.814 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:10.814 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.803887+0000", 2024-04-26T11:14:10.814 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:10.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.814 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.814 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:10.814 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.803887+0000", 2024-04-26T11:14:10.814 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:10.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.814 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.815 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:10.815 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.803886+0000", 2024-04-26T11:14:10.815 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.815 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.815 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:10.815 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.803954+0000", 2024-04-26T11:14:10.815 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7336999999999996e-05 2024-04-26T11:14:10.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.815 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.815 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:10.815 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.803962+0000", 2024-04-26T11:14:10.815 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7730000000000005e-06 2024-04-26T11:14:10.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.816 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.816 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.816 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.803969+0000", 2024-04-26T11:14:10.816 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4980000000000003e-06 2024-04-26T11:14:10.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.816 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.816 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:10.816 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.804001+0000", 2024-04-26T11:14:10.816 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1792999999999999e-05 2024-04-26T11:14:10.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.816 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.816 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:10.816 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.804091+0000", 2024-04-26T11:14:10.816 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.0384999999999996e-05 2024-04-26T11:14:10.816 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:10.817 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:10.817 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:10.817 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.817 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.817 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:82832 5.4 e33/16 5:2ccff6d2:::benchmark_data_smithi029_44842_object82831:head v 33'5147, mlcod=33'5145)", 2024-04-26T11:14:10.817 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:10.804082+0000", 2024-04-26T11:14:10.817 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0029455369999999998, 2024-04-26T11:14:10.817 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0031117789999999998, 2024-04-26T11:14:10.818 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:10.818 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:10.818 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:10.818 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.818 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:10.818 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.804082+0000", 2024-04-26T11:14:10.818 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:10.818 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.818 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.818 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:10.818 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.804082+0000", 2024-04-26T11:14:10.819 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:10.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.819 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.819 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:10.819 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.804081+0000", 2024-04-26T11:14:10.819 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.819 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.819 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:10.819 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.804148+0000", 2024-04-26T11:14:10.819 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6828999999999993e-05 2024-04-26T11:14:10.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.819 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.819 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:10.820 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.804156+0000", 2024-04-26T11:14:10.820 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4050000000000003e-06 2024-04-26T11:14:10.820 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.820 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.820 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.820 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.804160+0000", 2024-04-26T11:14:10.820 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8790000000000002e-06 2024-04-26T11:14:10.820 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.820 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.820 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:10.820 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.804501+0000", 2024-04-26T11:14:10.820 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00034039399999999999 2024-04-26T11:14:10.820 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.820 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.821 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:10.821 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.804521+0000", 2024-04-26T11:14:10.821 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9826999999999998e-05 2024-04-26T11:14:10.821 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:10.821 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:10.821 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:10.821 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.821 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.821 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:82837 5.5 5:aa16ceec:::benchmark_data_smithi029_44842_object82836:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:10.821 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:10.804410+0000", 2024-04-26T11:14:10.821 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0026177209999999999, 2024-04-26T11:14:10.821 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002819322, 2024-04-26T11:14:10.821 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:10.821 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:10.821 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:10.822 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:10.822 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.822 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 82837 2024-04-26T11:14:10.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.822 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:10.822 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.822 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:10.822 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.804410+0000", 2024-04-26T11:14:10.822 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:10.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.822 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.822 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:10.822 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.804410+0000", 2024-04-26T11:14:10.822 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:10.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.823 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.823 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:10.823 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.804409+0000", 2024-04-26T11:14:10.823 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:10.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.823 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.823 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:10.823 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.804474+0000", 2024-04-26T11:14:10.823 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4869000000000005e-05 2024-04-26T11:14:10.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.823 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.823 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:10.823 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.804482+0000", 2024-04-26T11:14:10.824 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6389999999999998e-06 2024-04-26T11:14:10.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.824 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.824 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.824 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.804489+0000", 2024-04-26T11:14:10.824 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.083e-06 2024-04-26T11:14:10.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.824 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.824 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:10.824 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.805670+0000", 2024-04-26T11:14:10.824 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0011817729999999999 2024-04-26T11:14:10.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.824 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.824 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:10.824 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.805791+0000", 2024-04-26T11:14:10.825 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000121073 2024-04-26T11:14:10.825 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:10.825 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:10.825 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:10.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.825 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.825 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:82839 5.e e33/16 5:701fd5d0:::benchmark_data_smithi029_44842_object82838:head v 33'5192, mlcod=33'5190)", 2024-04-26T11:14:10.825 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:10.805283+0000", 2024-04-26T11:14:10.825 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.001744907, 2024-04-26T11:14:10.825 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019845750000000001, 2024-04-26T11:14:10.825 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:10.825 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:10.825 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:10.825 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.825 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:10.826 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.805283+0000", 2024-04-26T11:14:10.826 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:10.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.826 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.826 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:10.826 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.805283+0000", 2024-04-26T11:14:10.826 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:10.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.826 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.826 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:10.826 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.805282+0000", 2024-04-26T11:14:10.826 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.826 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.827 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:10.827 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.805358+0000", 2024-04-26T11:14:10.827 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6001000000000006e-05 2024-04-26T11:14:10.827 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.827 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.827 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:10.827 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.805365+0000", 2024-04-26T11:14:10.827 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9999999999999999e-06 2024-04-26T11:14:10.827 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.827 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.827 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.827 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.805369+0000", 2024-04-26T11:14:10.827 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.3869999999999997e-06 2024-04-26T11:14:10.827 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.828 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.828 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:10.828 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.805404+0000", 2024-04-26T11:14:10.828 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4212999999999999e-05 2024-04-26T11:14:10.828 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.828 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.828 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:10.828 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.805422+0000", 2024-04-26T11:14:10.828 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8128999999999999e-05 2024-04-26T11:14:10.828 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:10.828 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:10.828 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:10.828 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.828 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.828 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:82836 5.4 e33/16 5:22bd8613:::benchmark_data_smithi029_44842_object82835:head v 33'5148, mlcod=33'5145)", 2024-04-26T11:14:10.829 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:10.806154+0000", 2024-04-26T11:14:10.829 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00087386199999999999, 2024-04-26T11:14:10.829 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0011459790000000001, 2024-04-26T11:14:10.829 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:10.829 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:10.829 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:10.829 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.829 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:10.829 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.806154+0000", 2024-04-26T11:14:10.829 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:10.829 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.829 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.829 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:10.829 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.806154+0000", 2024-04-26T11:14:10.829 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:10.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.830 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.830 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:10.830 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.806153+0000", 2024-04-26T11:14:10.830 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.830 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.830 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:10.830 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.806265+0000", 2024-04-26T11:14:10.830 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011161 2024-04-26T11:14:10.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.830 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.830 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:10.830 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.806272+0000", 2024-04-26T11:14:10.831 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6029999999999999e-06 2024-04-26T11:14:10.831 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.831 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.831 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.831 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.806277+0000", 2024-04-26T11:14:10.831 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8879999999999996e-06 2024-04-26T11:14:10.831 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.831 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.831 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:10.831 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.806516+0000", 2024-04-26T11:14:10.831 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00023853500000000001 2024-04-26T11:14:10.831 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.831 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.831 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:10.831 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.806534+0000", 2024-04-26T11:14:10.832 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8080999999999998e-05 2024-04-26T11:14:10.832 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:10.832 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:10.832 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:10.832 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.832 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.832 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:82841 5.2 5:40bf9fde:::benchmark_data_smithi029_44842_object82840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:10.832 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:10.806195+0000", 2024-04-26T11:14:10.832 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00083245300000000003, 2024-04-26T11:14:10.832 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001139028, 2024-04-26T11:14:10.832 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:10.832 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:10.832 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:10.832 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:10.832 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:10.833 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 82841 2024-04-26T11:14:10.833 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.833 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:10.833 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.833 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:10.833 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.806195+0000", 2024-04-26T11:14:10.833 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:10.833 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.833 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.833 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:10.834 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.806195+0000", 2024-04-26T11:14:10.834 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:10.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.834 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.834 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:10.834 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.806194+0000", 2024-04-26T11:14:10.834 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:10.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.834 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.834 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:10.834 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.806279+0000", 2024-04-26T11:14:10.834 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4398000000000001e-05 2024-04-26T11:14:10.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.834 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.835 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:10.835 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.806288+0000", 2024-04-26T11:14:10.835 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.0520000000000007e-06 2024-04-26T11:14:10.835 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.835 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.835 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.835 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.806295+0000", 2024-04-26T11:14:10.835 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9519999999999997e-06 2024-04-26T11:14:10.835 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.835 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.835 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:10.835 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.806325+0000", 2024-04-26T11:14:10.835 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0669000000000001e-05 2024-04-26T11:14:10.835 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.835 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.836 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:10.836 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.806409+0000", 2024-04-26T11:14:10.836 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3345999999999998e-05 2024-04-26T11:14:10.836 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:10.836 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:10.836 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:10.836 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.836 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.836 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:82840 5.8 e33/16 5:154eab8c:::benchmark_data_smithi029_44842_object82839:head v 33'5214, mlcod=33'5212)", 2024-04-26T11:14:10.836 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:10.806456+0000", 2024-04-26T11:14:10.836 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00057129399999999997, 2024-04-26T11:14:10.836 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00091563400000000002, 2024-04-26T11:14:10.836 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:10.836 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:10.837 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:10.837 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.837 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:10.837 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.806456+0000", 2024-04-26T11:14:10.837 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:10.837 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.837 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.837 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:10.837 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.806456+0000", 2024-04-26T11:14:10.837 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:10.837 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.837 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.837 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:10.837 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.806456+0000", 2024-04-26T11:14:10.838 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:10.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.838 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.838 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:10.838 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.806508+0000", 2024-04-26T11:14:10.838 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2680999999999999e-05 2024-04-26T11:14:10.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.838 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.838 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:10.838 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.806517+0000", 2024-04-26T11:14:10.838 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9989999999999997e-06 2024-04-26T11:14:10.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.838 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.838 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:10.839 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.806523+0000", 2024-04-26T11:14:10.839 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9290000000000003e-06 2024-04-26T11:14:10.839 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.839 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.839 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:10.839 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.806583+0000", 2024-04-26T11:14:10.839 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9932999999999997e-05 2024-04-26T11:14:10.839 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:10.839 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:10.839 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:10.839 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:10.806602+0000", 2024-04-26T11:14:10.839 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8884000000000001e-05 2024-04-26T11:14:10.839 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:10.839 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:10.839 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:10.840 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:10.840 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:14:10.840 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 8 2024-04-26T11:14:10.840 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:10.841 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:10.842 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:10.840+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:10.941 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:10.941+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:11.046 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:11.045+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:11.064 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:11.064 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:14:11.064 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:14:11.064 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:14:11.064 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:11.080 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:11.143 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:11.142+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:11.244 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:11.242+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:11.307 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:11.308 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:14:11.310 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:14:11.310 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:11.310 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.310 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:11.310 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:11.310 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 18.033990588000002, 2024-04-26T11:14:11.310 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:14:11.310 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:11.310 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:11.310 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:11.310 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:11.310 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:11.310 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:14:11.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.311 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:11.311 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.311 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:11.311 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:11.311 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.311 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.311 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:11.311 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:11.311 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.311 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.311 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:11.311 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:14:11.312 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:11.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.312 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.312 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:11.312 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:14:11.312 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:14:11.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.312 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.312 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:11.312 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:14:11.312 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:14:11.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.312 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.312 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:11.313 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:14:11.313 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:14:11.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.313 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.313 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.313 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:14:11.313 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:14:11.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.313 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.313 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:11.313 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:14:11.313 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:14:11.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.314 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.314 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:11.314 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:14:11.314 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:14:11.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.314 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.314 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:11.314 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:14:11.314 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:14:11.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.314 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.314 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:11.315 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:14:11.315 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:14:11.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.315 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.315 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:11.315 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:14:11.315 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:14:11.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.315 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.315 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:11.315 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:14:11.315 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:14:11.315 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.315 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:11.316 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.316 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.316 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:11.316 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:11.316 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 18.033179022999999, 2024-04-26T11:14:11.316 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:14:11.316 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:11.316 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:11.316 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:11.316 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:11.316 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:11.316 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:14:11.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.317 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:11.317 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.317 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:11.317 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:11.317 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.317 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.317 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:11.317 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:11.317 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.317 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.317 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:11.318 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:11.318 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:11.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.318 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.318 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:11.318 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:14:11.318 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:14:11.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.318 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.318 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:11.318 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:14:11.318 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:14:11.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.319 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.319 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:11.319 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:14:11.319 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:14:11.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.319 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.319 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.319 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:14:11.319 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:14:11.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.319 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.319 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:11.320 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:14:11.320 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:14:11.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.320 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:11.320 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:14:11.320 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:14:11.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.320 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:11.320 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:14:11.320 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:14:11.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.321 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.321 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:11.321 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:14:11.321 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:14:11.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.321 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.321 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:11.321 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:14:11.321 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:14:11.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.321 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.321 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:11.321 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:14:11.321 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:14:11.321 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.322 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:11.322 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.322 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.322 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:11.322 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:11.322 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 18.025992186, 2024-04-26T11:14:11.322 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:14:11.322 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:11.322 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:11.322 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:11.322 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:11.322 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:11.322 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:14:11.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.323 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:11.323 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.323 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:11.323 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:11.323 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.323 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.323 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:11.323 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:11.323 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.324 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.324 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:11.324 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:14:11.324 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:11.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.324 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.324 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:11.324 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:14:11.324 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:14:11.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.324 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.324 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:11.324 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:14:11.324 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:14:11.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.325 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.325 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:11.325 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:14:11.325 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:14:11.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.325 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.325 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.325 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:14:11.325 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:14:11.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.325 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.325 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:11.325 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:14:11.325 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:14:11.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.326 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.326 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:11.326 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:14:11.326 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:14:11.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.326 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.326 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:11.326 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:14:11.326 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:14:11.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.326 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.326 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:11.326 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:14:11.327 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:14:11.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.327 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.327 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:11.327 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:14:11.327 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:14:11.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.327 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.327 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:11.327 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:14:11.327 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:14:11.327 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.327 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:11.327 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.328 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.328 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:11.328 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:11.328 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 18.025451307000001, 2024-04-26T11:14:11.328 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:14:11.328 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:11.328 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:11.328 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:11.328 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:11.328 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:11.328 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:14:11.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.328 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:11.328 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.329 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:11.329 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:11.329 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.329 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.329 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:11.329 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:11.329 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.329 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.329 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:11.329 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:11.329 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:11.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.330 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.330 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:11.330 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:14:11.330 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:14:11.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.330 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.330 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:11.330 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:14:11.330 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:14:11.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.330 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.330 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:11.330 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:14:11.330 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:14:11.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.331 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.331 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.331 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:14:11.331 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:14:11.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.331 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.331 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:11.331 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:14:11.331 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:14:11.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.331 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.331 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:11.331 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:14:11.332 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:14:11.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.332 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.332 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:11.332 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:14:11.332 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:14:11.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.332 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.332 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:11.332 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:14:11.332 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:14:11.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.332 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.332 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:11.332 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:14:11.333 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:14:11.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.333 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.333 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:11.333 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:14:11.333 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:14:11.333 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.333 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:11.333 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.333 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.333 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:55119 5.6 5:6ad50111:::benchmark_data_smithi029_44842_object55118:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:11.333 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:11.333 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 14.544387652999999, 2024-04-26T11:14:11.333 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018830264999999999, 2024-04-26T11:14:11.334 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:11.334 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:11.334 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:11.334 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:11.334 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:11.334 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 55119 2024-04-26T11:14:11.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.334 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:11.334 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.334 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:11.334 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:11.334 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.334 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.335 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:11.335 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:11.335 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.335 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:11.335 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760349+0000", 2024-04-26T11:14:11.335 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:11.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.335 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:11.335 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760402+0000", 2024-04-26T11:14:11.335 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2695999999999998e-05 2024-04-26T11:14:11.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.335 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:11.336 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760411+0000", 2024-04-26T11:14:11.336 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.0589999999999992e-06 2024-04-26T11:14:11.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.336 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:11.336 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760416+0000", 2024-04-26T11:14:11.336 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.587e-06 2024-04-26T11:14:11.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.336 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.336 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767638+0000", 2024-04-26T11:14:11.336 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0072214050000000002 2024-04-26T11:14:11.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.336 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:11.337 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767760+0000", 2024-04-26T11:14:11.337 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000122067 2024-04-26T11:14:11.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.337 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.337 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:11.337 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767927+0000", 2024-04-26T11:14:11.337 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00016747999999999999 2024-04-26T11:14:11.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.337 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.337 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:11.337 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.770877+0000", 2024-04-26T11:14:11.337 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002949335 2024-04-26T11:14:11.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.338 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:11.338 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779130+0000", 2024-04-26T11:14:11.338 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.008253491 2024-04-26T11:14:11.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.338 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:11.338 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779158+0000", 2024-04-26T11:14:11.338 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7849000000000001e-05 2024-04-26T11:14:11.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.338 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:11.338 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779180+0000", 2024-04-26T11:14:11.338 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2048999999999998e-05 2024-04-26T11:14:11.339 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.339 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:11.339 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.339 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:11.339 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:11.339 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 13.982266859999999, 2024-04-26T11:14:11.339 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:14:11.339 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:11.339 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:11.339 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:11.339 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:11.340 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:11.340 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:14:11.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.340 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:11.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.340 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:11.340 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:11.340 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.340 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:11.340 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:11.340 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.341 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:11.341 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:14:11.341 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:11.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.341 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:11.341 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:14:11.341 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:14:11.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.341 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:11.341 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:14:11.341 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:14:11.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.342 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:11.342 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:14:11.342 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:14:11.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.342 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.342 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:14:11.342 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:14:11.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.342 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:11.342 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:14:11.343 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:14:11.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.343 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:11.343 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:14:11.343 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:14:11.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.343 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:11.343 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:14:11.343 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:14:11.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.343 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.343 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:14:11.343 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:14:11.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.344 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:11.344 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:14:11.344 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:14:11.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.344 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.344 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:14:11.344 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:14:11.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.344 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:11.344 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:14:11.345 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:14:11.345 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.345 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:11.345 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.345 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.345 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:11.345 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:11.345 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 13.980073519999999, 2024-04-26T11:14:11.345 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:14:11.345 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:11.345 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:11.346 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:11.346 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:11.346 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:11.346 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:14:11.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.346 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:11.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.346 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:11.346 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:11.346 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.346 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:11.346 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:11.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.347 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:11.347 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:14:11.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:11.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.347 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:11.347 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:14:11.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:14:11.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.348 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:11.348 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:14:11.348 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:14:11.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.348 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:11.348 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:14:11.348 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:14:11.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.348 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.348 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:14:11.348 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:14:11.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.349 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:11.349 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:14:11.349 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:14:11.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.349 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:11.349 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:14:11.349 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:14:11.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.349 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:11.350 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:14:11.350 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:14:11.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.350 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.350 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.350 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:14:11.350 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:14:11.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.350 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.350 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:11.350 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:14:11.350 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:14:11.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.351 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.351 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:14:11.351 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:14:11.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.351 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:11.351 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:14:11.351 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:14:11.351 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.351 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:11.351 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.352 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:11.352 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:11.352 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 13.974861696, 2024-04-26T11:14:11.352 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:14:11.352 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:11.352 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:11.352 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:11.352 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:11.352 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:11.352 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:14:11.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.352 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:11.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.353 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:11.353 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:11.353 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.353 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:11.353 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:11.353 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.353 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:11.353 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:14:11.354 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:11.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.354 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:11.354 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:14:11.354 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:14:11.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.354 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:11.354 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:14:11.354 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:14:11.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.354 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:11.355 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:14:11.355 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:14:11.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.355 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.355 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.355 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:14:11.355 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:14:11.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.355 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.355 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:11.355 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:14:11.355 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:14:11.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.356 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:11.356 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:14:11.356 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:14:11.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.356 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:11.356 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:14:11.356 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:14:11.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.356 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.356 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:14:11.356 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:14:11.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.356 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:11.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:14:11.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:14:11.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.357 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:14:11.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:14:11.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.357 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:11.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:14:11.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:14:11.357 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.357 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:11.357 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.358 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:11.358 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:11.358 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 13.958412996, 2024-04-26T11:14:11.358 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:14:11.358 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:11.358 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:11.358 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:11.358 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:11.358 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:11.358 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:14:11.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.358 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:11.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:11.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:11.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:11.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:11.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:11.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:14:11.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:11.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.360 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:11.360 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:14:11.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:14:11.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.360 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:11.360 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:14:11.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:14:11.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.360 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:11.360 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:14:11.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:14:11.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.361 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.361 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:14:11.361 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:14:11.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.361 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:11.361 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:14:11.361 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:14:11.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.361 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.361 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:14:11.362 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:14:11.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.362 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.362 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:11.362 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:14:11.362 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:14:11.362 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.362 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:11.362 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.362 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.362 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:11.362 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:11.362 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 13.956715491000001, 2024-04-26T11:14:11.363 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:14:11.363 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:11.363 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:11.363 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:11.363 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:11.363 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:11.363 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:14:11.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.363 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:11.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.363 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:11.363 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:11.363 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.363 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:11.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:11.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:11.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:14:11.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:11.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:11.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:14:11.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:14:11.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:11.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:14:11.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:14:11.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.365 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:11.365 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:14:11.365 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:14:11.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.365 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.365 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:14:11.365 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:14:11.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.365 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:11.365 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:14:11.365 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:14:11.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.366 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.366 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:14:11.366 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:14:11.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.366 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:11.366 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:14:11.366 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:14:11.366 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.366 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:11.366 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.366 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:11.367 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:11.367 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 13.956651189, 2024-04-26T11:14:11.367 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:14:11.367 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:11.367 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:11.367 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:11.367 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:11.367 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:11.367 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:14:11.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.367 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:11.367 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.367 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:11.367 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:11.368 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.368 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:11.368 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:11.368 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.368 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:11.368 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:11.368 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:11.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.368 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:11.368 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:14:11.369 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:14:11.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.369 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:11.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:14:11.369 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:14:11.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.369 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:11.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:14:11.369 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:14:11.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.370 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.370 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:14:11.370 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:14:11.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.370 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.370 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:11.370 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:14:11.370 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:14:11.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.370 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.370 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.370 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:14:11.370 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:14:11.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.371 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.371 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:11.371 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:14:11.371 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:14:11.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.371 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.371 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:11.371 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:14:11.371 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:14:11.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.371 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.371 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:11.371 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:14:11.371 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:14:11.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.372 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:11.372 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:14:11.372 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:14:11.372 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.372 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:11.372 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.372 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:11.372 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:11.372 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 13.956596964999999, 2024-04-26T11:14:11.373 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:14:11.373 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:11.373 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:11.373 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:11.373 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:11.373 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:11.373 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:14:11.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.373 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:11.373 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.373 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:11.373 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:11.373 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.373 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.373 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:11.374 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:11.374 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.374 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.374 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:11.374 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:11.374 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:11.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.374 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.374 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:11.374 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:14:11.374 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:14:11.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.375 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:11.375 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:14:11.375 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:14:11.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.375 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:11.375 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:14:11.375 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:14:11.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.375 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.375 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:14:11.375 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:14:11.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.376 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:11.376 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:14:11.376 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:14:11.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.376 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.376 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:14:11.376 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:14:11.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.376 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:11.376 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:14:11.376 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:14:11.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.377 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:11.377 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:14:11.377 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:14:11.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.377 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:11.377 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:14:11.377 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:11.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.377 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:11.378 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:14:11.378 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:14:11.378 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.378 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:11.378 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.378 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.378 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:11.378 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:11.378 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 13.956552453, 2024-04-26T11:14:11.378 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:14:11.378 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:11.378 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:11.378 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:11.378 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:11.379 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:11.379 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:14:11.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.379 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:11.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.379 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:11.379 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:11.379 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.379 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:11.379 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:11.379 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.380 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:11.380 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:14:11.380 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:11.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.380 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:11.380 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:14:11.380 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:14:11.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.380 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:11.380 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:14:11.381 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:14:11.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.381 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:11.381 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:14:11.381 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:14:11.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.381 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.381 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:14:11.381 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:14:11.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.381 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:11.382 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:14:11.382 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:14:11.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.382 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.382 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.382 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:14:11.382 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:14:11.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.382 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.382 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:11.382 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:14:11.382 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:14:11.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.383 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:11.383 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:14:11.383 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:14:11.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.383 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:11.383 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:14:11.383 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:14:11.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.383 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:11.383 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:14:11.384 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:14:11.384 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.384 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:11.384 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.384 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.384 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:11.384 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:11.384 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 13.952331450999999, 2024-04-26T11:14:11.384 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:14:11.384 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:11.384 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:11.384 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:11.384 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:11.385 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:11.385 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:14:11.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.385 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:11.385 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.385 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:11.385 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:11.385 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.385 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.385 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:11.385 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:11.385 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.386 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.386 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:11.386 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:14:11.386 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:14:11.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.386 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.386 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:11.386 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:14:11.386 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:14:11.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.386 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.386 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:11.386 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:14:11.386 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:14:11.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.387 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:11.387 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:14:11.387 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:14:11.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.387 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.387 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:14:11.387 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:14:11.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.387 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:11.387 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:14:11.387 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:14:11.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.388 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.388 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.388 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:14:11.388 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:14:11.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.388 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.388 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:11.388 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:14:11.388 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:14:11.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.388 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.388 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:11.388 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:14:11.388 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:14:11.389 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.389 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.389 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:11.389 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:14:11.389 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:14:11.389 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.389 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.389 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:11.389 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:14:11.389 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:14:11.389 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.389 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:11.389 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.389 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.390 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.390 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:61817 5.a 5:5627ce7f:::benchmark_data_smithi029_44842_object61816:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:11.390 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:11.390 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 10.602205998000001, 2024-04-26T11:14:11.390 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020626958000000001, 2024-04-26T11:14:11.390 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:11.390 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:11.390 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:11.390 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:11.390 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:11.390 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 61817 2024-04-26T11:14:11.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.390 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:11.390 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.391 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:11.391 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:11.391 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.391 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.391 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:11.391 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:11.391 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.391 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.391 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:11.391 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:11.391 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:11.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.391 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.392 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:11.392 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702591+0000", 2024-04-26T11:14:11.392 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0665999999999998e-05 2024-04-26T11:14:11.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.392 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.392 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:11.392 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702599+0000", 2024-04-26T11:14:11.392 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7130000000000005e-06 2024-04-26T11:14:11.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.392 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.392 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:11.392 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702605+0000", 2024-04-26T11:14:11.392 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4310000000000002e-06 2024-04-26T11:14:11.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.392 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.392 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.393 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.707947+0000", 2024-04-26T11:14:11.393 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053424220000000003 2024-04-26T11:14:11.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.393 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.393 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:11.393 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.708052+0000", 2024-04-26T11:14:11.393 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010499 2024-04-26T11:14:11.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.393 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.393 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:14:11.393 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.708141+0000", 2024-04-26T11:14:11.393 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9514999999999999e-05 2024-04-26T11:14:11.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.393 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.393 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:11.393 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.711954+0000", 2024-04-26T11:14:11.394 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003812265 2024-04-26T11:14:11.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.394 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.394 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:11.394 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723070+0000", 2024-04-26T11:14:11.394 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011116727 2024-04-26T11:14:11.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.394 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.394 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:11.394 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723121+0000", 2024-04-26T11:14:11.394 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0362999999999999e-05 2024-04-26T11:14:11.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.394 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.395 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:11.395 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723158+0000", 2024-04-26T11:14:11.395 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7579000000000001e-05 2024-04-26T11:14:11.395 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.395 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:11.395 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.395 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.395 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:75771 5.c 5:3cc8f1b4:::benchmark_data_smithi029_44842_object75770:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T11:14:11.395 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:11.395 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.551761655, 2024-04-26T11:14:11.395 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019437949, 2024-04-26T11:14:11.395 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:11.395 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:11.396 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:11.396 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:11.396 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:11.396 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 75771 2024-04-26T11:14:11.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.396 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:11.396 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.396 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:11.396 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:11.396 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.396 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.396 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:11.396 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:11.396 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.397 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:11.397 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752975+0000", 2024-04-26T11:14:11.397 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:11.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.397 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:11.397 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753061+0000", 2024-04-26T11:14:11.397 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5890999999999995e-05 2024-04-26T11:14:11.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.397 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:11.398 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753071+0000", 2024-04-26T11:14:11.398 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.9990000000000003e-06 2024-04-26T11:14:11.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.398 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.398 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:11.398 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753078+0000", 2024-04-26T11:14:11.398 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1559999999999998e-06 2024-04-26T11:14:11.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.398 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.398 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.398 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.758559+0000", 2024-04-26T11:14:11.398 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0054812819999999996 2024-04-26T11:14:11.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.398 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.399 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:11.399 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.758692+0000", 2024-04-26T11:14:11.399 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000133301 2024-04-26T11:14:11.399 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.399 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.399 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:11.399 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772277+0000", 2024-04-26T11:14:11.399 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.013584839 2024-04-26T11:14:11.399 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.399 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.399 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:11.399 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772340+0000", 2024-04-26T11:14:11.399 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2360999999999995e-05 2024-04-26T11:14:11.399 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.399 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.399 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:11.399 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772414+0000", 2024-04-26T11:14:11.400 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4024999999999997e-05 2024-04-26T11:14:11.400 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.400 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:11.400 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.400 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.400 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83359 5.2 5:4939888c:::benchmark_data_smithi029_44842_object83358:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:11.400 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:11.400 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.26517107000000001, 2024-04-26T11:14:11.400 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018705583000000001, 2024-04-26T11:14:11.400 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:11.400 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:11.400 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:11.400 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:11.401 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:11.401 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83359 2024-04-26T11:14:11.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.401 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:11.401 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.401 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:11.401 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:11.401 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.401 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.401 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:11.401 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:11.401 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.402 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.402 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:11.402 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:11.402 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:11.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.402 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.402 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:11.402 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039625+0000", 2024-04-26T11:14:11.402 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9162e-05 2024-04-26T11:14:11.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.402 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.402 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:11.402 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039632+0000", 2024-04-26T11:14:11.402 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5399999999999998e-06 2024-04-26T11:14:11.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.403 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.403 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:11.403 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039638+0000", 2024-04-26T11:14:11.403 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1850000000000003e-06 2024-04-26T11:14:11.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.403 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.403 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.403 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.042375+0000", 2024-04-26T11:14:11.403 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0027371510000000002 2024-04-26T11:14:11.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.403 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.403 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:11.404 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.042502+0000", 2024-04-26T11:14:11.404 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000126966 2024-04-26T11:14:11.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.404 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.404 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:11.404 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058154+0000", 2024-04-26T11:14:11.404 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015652657 2024-04-26T11:14:11.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.404 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.404 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:11.404 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058201+0000", 2024-04-26T11:14:11.404 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6579000000000002e-05 2024-04-26T11:14:11.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.404 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.405 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:11.405 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058272+0000", 2024-04-26T11:14:11.405 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1009999999999999e-05 2024-04-26T11:14:11.405 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.405 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:11.405 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.405 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.405 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83360 5.2 5:42f8bfcd:::benchmark_data_smithi029_44842_object83359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:11.405 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:11.405 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.26509208099999998, 2024-04-26T11:14:11.405 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022279782000000001, 2024-04-26T11:14:11.405 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:11.405 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:11.406 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:11.406 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:11.406 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:11.406 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83360 2024-04-26T11:14:11.406 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.406 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:11.406 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.406 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:11.406 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:11.406 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.406 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.406 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.406 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:11.407 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:11.407 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.407 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.407 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:11.407 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:11.407 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:11.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.407 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.407 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:11.407 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039700+0000", 2024-04-26T11:14:11.407 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5541000000000002e-05 2024-04-26T11:14:11.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.408 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.408 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:11.408 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039706+0000", 2024-04-26T11:14:11.408 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3680000000000001e-06 2024-04-26T11:14:11.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.408 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.408 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:11.408 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039709+0000", 2024-04-26T11:14:11.408 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4659999999999999e-06 2024-04-26T11:14:11.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.408 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.408 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.409 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056305+0000", 2024-04-26T11:14:11.409 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016595649000000001 2024-04-26T11:14:11.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.409 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.409 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:11.409 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056487+0000", 2024-04-26T11:14:11.409 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000181886 2024-04-26T11:14:11.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.409 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.409 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:11.409 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061809+0000", 2024-04-26T11:14:11.409 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053223259999999996 2024-04-26T11:14:11.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.409 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.410 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:11.410 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061852+0000", 2024-04-26T11:14:11.410 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2738999999999999e-05 2024-04-26T11:14:11.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.410 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.410 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:11.410 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061925+0000", 2024-04-26T11:14:11.410 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3180000000000001e-05 2024-04-26T11:14:11.410 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.410 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:11.410 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.410 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.410 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83364 5.2 5:42c5cd8c:::benchmark_data_smithi029_44842_object83363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:11.411 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:11.411 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.26467634099999998, 2024-04-26T11:14:11.411 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022695336, 2024-04-26T11:14:11.411 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:11.411 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:11.411 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:11.411 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:11.411 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:11.411 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83364 2024-04-26T11:14:11.411 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.411 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:11.411 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.411 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:11.411 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:11.412 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.412 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.412 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:11.412 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:11.412 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.412 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.412 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:11.412 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040060+0000", 2024-04-26T11:14:11.412 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:11.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.412 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.413 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:11.413 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040086+0000", 2024-04-26T11:14:11.413 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5482000000000001e-05 2024-04-26T11:14:11.413 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.413 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.413 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:11.413 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040093+0000", 2024-04-26T11:14:11.413 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6409999999999996e-06 2024-04-26T11:14:11.413 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.413 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.413 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:11.413 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040098+0000", 2024-04-26T11:14:11.413 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879999999999996e-06 2024-04-26T11:14:11.413 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.413 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.414 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.414 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058292+0000", 2024-04-26T11:14:11.414 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018193504999999999 2024-04-26T11:14:11.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.414 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.414 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:11.414 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058412+0000", 2024-04-26T11:14:11.414 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011979199999999999 2024-04-26T11:14:11.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.414 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.414 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:11.414 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062642+0000", 2024-04-26T11:14:11.414 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042299449999999997 2024-04-26T11:14:11.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.415 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.415 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:11.415 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062688+0000", 2024-04-26T11:14:11.415 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6859e-05 2024-04-26T11:14:11.415 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.415 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.415 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:11.415 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062756+0000", 2024-04-26T11:14:11.415 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7995000000000002e-05 2024-04-26T11:14:11.415 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.415 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:11.415 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.415 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.415 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.415 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83378 5.2 5:44b3209a:::benchmark_data_smithi029_44842_object83377:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:11.416 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:11.416 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.25695588800000002, 2024-04-26T11:14:11.416 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020722529, 2024-04-26T11:14:11.416 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:11.416 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:11.416 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:11.416 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:11.416 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:11.416 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83378 2024-04-26T11:14:11.416 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.416 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:11.416 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.416 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:11.417 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:11.417 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.417 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.417 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:11.417 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:11.417 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:11.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.417 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.417 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:11.417 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047781+0000", 2024-04-26T11:14:11.417 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:11.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.418 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.418 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:11.418 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047832+0000", 2024-04-26T11:14:11.418 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1687000000000002e-05 2024-04-26T11:14:11.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.418 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.418 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:11.418 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047842+0000", 2024-04-26T11:14:11.418 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2439999999999999e-06 2024-04-26T11:14:11.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.418 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.418 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:11.418 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047847+0000", 2024-04-26T11:14:11.419 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6500000000000001e-06 2024-04-26T11:14:11.419 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.419 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.419 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:11.419 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.060082+0000", 2024-04-26T11:14:11.419 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.012235105 2024-04-26T11:14:11.419 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.419 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.419 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:11.419 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.060191+0000", 2024-04-26T11:14:11.419 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000108665 2024-04-26T11:14:11.419 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.419 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.420 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:11.420 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068363+0000", 2024-04-26T11:14:11.420 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0081715829999999996 2024-04-26T11:14:11.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.420 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.420 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:11.420 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068418+0000", 2024-04-26T11:14:11.420 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4984000000000001e-05 2024-04-26T11:14:11.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:11.420 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:11.420 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:11.420 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068504+0000", 2024-04-26T11:14:11.420 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6520000000000005e-05 2024-04-26T11:14:11.420 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.420 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:11.421 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.421 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:11.421 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:11.421 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:11.421 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:14:11.422 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 33 16 84227 84211 159.476 143.188 0.00441046 0.00626759 2024-04-26T11:14:11.424 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:11.424 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:11.421+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:11.523 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:11.521+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:11.575 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:11.597 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:11.597 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:11.597 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:11.597 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:11.599 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:11.599 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:11.600 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:11.600 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:11.601 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:14:11.613 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:11.624 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:11.623+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:11.724 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:11.723+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:11.825 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:11.824+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:11.830 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:11.830 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:11.842 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:11.925 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:11.924+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:12.014 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:12.015 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:12.028 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:12.026+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:12.031 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:12.128 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:12.127+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:12.223 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:12.223 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:12.229 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:12.227+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:12.239 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:12.329 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:12.327+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:12.413 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 34 16 86566 86550 159.085 146.188 0.002209 0.00628279 2024-04-26T11:14:12.430 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:12.429+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:12.459 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:12.459 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:12.472 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:12.557 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:12.556+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:12.594 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-04-26T11:14:12.594 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:14:12.594 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-04-26T11:14:12.595 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T11:14:12.595 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T11:14:12.595 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-04-26T11:14:12.599 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:14:12.640 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:12.639+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:12.711 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:12.711 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:12.724 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:12.768 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:12.766+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:12.781 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:12.781 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-26T11:14:12.781 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:12.834 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:12.833+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:12.891 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:12.891 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:12.905 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:12.948 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:12.946+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:13.036 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:13.035+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:13.118 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:13.118 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:13.133 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:13.137 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:13.135+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:13.237 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:13.236+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:13.304 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:13.305 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:13.320 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:13.368 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:13.364+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:13.413 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 35 16 88803 88787 158.534 139.812 0.00437756 0.00630538 2024-04-26T11:14:13.439 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:13.438+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:13.500 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:13.501 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:13.515 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:13.558 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:13.557+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:13.602 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:14:13.640 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:13.639+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:13.736 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:13.736 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:13.743 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:13.740+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:13.752 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:13.753 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:13.772 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:13.772 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:13.772 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:13.772 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:13.774 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:13.775 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:13.843 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:13.842+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:13.944 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:13.943+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:13.978 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:13.978 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:14:13.978 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:14:13.978 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:13.979 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.979 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:13.979 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:13.979 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 20.704464967, 2024-04-26T11:14:13.979 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:14:13.979 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:13.979 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:13.980 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:13.980 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:13.980 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:13.980 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:14:13.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.980 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:13.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.980 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:13.980 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:13.980 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:13.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.981 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:13.981 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:13.981 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:13.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.981 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.981 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:13.981 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:14:13.981 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:13.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.981 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.981 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:13.981 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:14:13.982 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:14:13.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.982 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.982 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:13.982 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:14:13.983 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:14:13.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.983 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:13.983 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:14:13.983 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:14:13.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.983 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:13.983 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:14:13.983 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:14:13.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.983 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:13.984 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:14:13.984 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:14:13.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.984 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:13.984 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:14:13.984 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:14:13.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.984 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:13.984 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:14:13.984 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:14:13.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.984 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:13.985 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:14:13.985 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:14:13.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.985 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.985 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:13.985 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:14:13.985 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:14:13.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.985 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.985 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:13.985 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:14:13.986 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:14:13.986 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:13.986 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:13.986 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:13.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.986 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:13.986 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:13.986 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 20.703653402, 2024-04-26T11:14:13.986 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:14:13.986 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:13.986 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:13.986 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:13.986 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:13.987 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:13.987 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:14:13.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.987 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:13.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.987 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:13.987 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:13.987 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:13.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.988 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:13.988 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:13.988 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:13.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.988 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.988 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:13.988 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:13.989 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:13.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.989 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.989 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:13.989 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:14:13.989 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:14:13.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.990 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.990 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:13.990 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:14:13.990 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:14:13.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.991 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:13.991 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:14:13.991 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:14:13.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.992 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.992 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:13.992 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:14:13.992 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:14:13.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.992 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.992 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:13.992 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:14:13.993 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:14:13.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.993 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.993 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:13.993 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:14:13.993 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:14:13.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.994 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.994 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:13.994 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:14:13.994 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:14:13.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.994 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.995 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:13.995 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:14:13.995 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:14:13.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.995 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:13.996 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:14:13.996 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:14:13.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.996 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.996 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:13.996 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:14:13.997 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:14:13.997 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:13.997 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:13.997 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:13.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:13.997 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:13.998 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:13.998 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 20.696466565000001, 2024-04-26T11:14:13.998 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:14:13.998 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:13.998 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:13.998 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:13.999 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:13.999 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:13.999 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:14:13.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:13.999 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:13.999 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.000 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:14.000 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:14.000 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.001 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:14.001 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:14.001 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.001 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.001 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:14.002 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:14:14.002 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:14.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.002 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.002 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:14.003 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:14:14.003 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:14:14.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.003 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.003 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:14.003 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:14:14.004 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:14:14.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.004 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.004 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.004 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:14:14.004 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:14:14.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.005 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.005 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:14:14.005 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:14:14.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.006 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.006 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:14.006 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:14:14.006 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:14:14.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.006 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.007 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:14.007 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:14:14.007 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:14:14.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.007 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:14.008 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:14:14.008 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:14:14.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.008 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.008 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:14.008 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:14:14.009 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:14:14.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.009 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:14.009 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:14:14.009 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:14:14.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.010 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.010 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:14.010 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:14:14.010 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:14:14.011 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.011 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:14.011 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.011 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:14.012 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:14.012 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 20.695925685999999, 2024-04-26T11:14:14.012 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:14:14.012 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:14.012 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.013 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:14.013 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:14.013 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.013 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:14:14.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.013 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:14.013 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.014 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:14.014 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:14.014 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.015 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:14.015 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:14.015 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.015 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:14.015 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:14.016 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:14.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.016 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.016 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:14.016 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:14:14.016 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:14:14.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.016 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.017 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:14.017 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:14:14.017 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:14:14.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.017 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.017 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:14:14.017 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:14:14.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.018 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.018 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.018 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:14:14.018 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:14:14.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.018 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.018 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:14.019 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:14:14.019 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:14:14.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.019 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.019 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:14.019 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:14:14.019 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:14:14.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.020 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:14.020 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:14:14.020 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:14:14.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.020 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:14.020 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:14:14.020 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:14:14.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.021 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.021 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:14.021 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:14:14.021 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:14:14.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.021 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.021 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:14.021 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:14:14.021 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:14:14.022 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.022 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:14.022 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.022 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:55119 5.6 5:6ad50111:::benchmark_data_smithi029_44842_object55118:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:14.022 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:14.022 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 17.214862031999999, 2024-04-26T11:14:14.022 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018830264999999999, 2024-04-26T11:14:14.022 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:14.023 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.023 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:14.023 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:14.023 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.023 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 55119 2024-04-26T11:14:14.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.023 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:14.023 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.023 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:14.023 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:14.023 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.023 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.023 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:14.023 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:14.024 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.024 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.024 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:14.024 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760349+0000", 2024-04-26T11:14:14.024 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:14.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.024 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.024 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:14.024 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760402+0000", 2024-04-26T11:14:14.024 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2695999999999998e-05 2024-04-26T11:14:14.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.024 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.024 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:14.024 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760411+0000", 2024-04-26T11:14:14.025 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.0589999999999992e-06 2024-04-26T11:14:14.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.025 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.025 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760416+0000", 2024-04-26T11:14:14.025 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.587e-06 2024-04-26T11:14:14.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.025 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.025 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767638+0000", 2024-04-26T11:14:14.025 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0072214050000000002 2024-04-26T11:14:14.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.025 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:14.026 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767760+0000", 2024-04-26T11:14:14.026 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000122067 2024-04-26T11:14:14.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.026 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.026 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:14.026 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767927+0000", 2024-04-26T11:14:14.026 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00016747999999999999 2024-04-26T11:14:14.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.026 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.026 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:14.026 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.770877+0000", 2024-04-26T11:14:14.026 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002949335 2024-04-26T11:14:14.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.027 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.027 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:14.027 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779130+0000", 2024-04-26T11:14:14.027 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.008253491 2024-04-26T11:14:14.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.027 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.027 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:14.027 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779158+0000", 2024-04-26T11:14:14.027 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7849000000000001e-05 2024-04-26T11:14:14.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.027 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.027 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:14.027 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779180+0000", 2024-04-26T11:14:14.027 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2048999999999998e-05 2024-04-26T11:14:14.028 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.028 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:14.028 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.028 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.028 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:14.028 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:14.028 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 16.652741239000001, 2024-04-26T11:14:14.028 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:14:14.028 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:14.028 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:14.028 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:14.028 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:14.028 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.029 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:14:14.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.029 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:14.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.029 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:14.029 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:14.029 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.029 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:14.029 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:14.029 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.029 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:14.030 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:14:14.030 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:14.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.030 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.030 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:14.030 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:14:14.030 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:14:14.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.030 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.030 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:14.030 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:14:14.030 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:14:14.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.030 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.031 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.031 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:14:14.031 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:14:14.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.031 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.031 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.031 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:14:14.031 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:14:14.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.031 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.031 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:14.031 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:14:14.031 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:14:14.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.032 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.032 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:14.032 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:14:14.032 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:14:14.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.032 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.032 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:14.033 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:14:14.033 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:14:14.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.033 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.033 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.033 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:14:14.033 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:14:14.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.033 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.033 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:14.033 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:14:14.033 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:14:14.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.033 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.034 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.034 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:14:14.034 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:14:14.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.034 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.034 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:14.034 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:14:14.034 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:14:14.034 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.034 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:14.034 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.034 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.035 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:14.035 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:14.035 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 16.650547898999999, 2024-04-26T11:14:14.035 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:14:14.035 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:14.035 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:14.035 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:14.035 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:14.035 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.035 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:14:14.035 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.035 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:14.035 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.035 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:14.036 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:14.036 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.036 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.036 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:14.036 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:14.036 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.036 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.036 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:14.036 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:14:14.036 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:14.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.036 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.036 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:14.037 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:14:14.037 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:14:14.037 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.037 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.037 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:14.037 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:14:14.037 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:14:14.037 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.037 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.037 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.037 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:14:14.037 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:14:14.037 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.037 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.037 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.038 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:14:14.038 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:14:14.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.038 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.038 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:14.038 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:14:14.038 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:14:14.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.038 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.038 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:14.038 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:14:14.038 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:14:14.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.038 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.039 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:14.039 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:14:14.039 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:14:14.039 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.039 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.039 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.039 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:14:14.039 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:14:14.039 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.039 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.039 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:14.039 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:14:14.039 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:14:14.039 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.040 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.040 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.040 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:14:14.040 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:14:14.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.040 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.040 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:14.040 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:14:14.040 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:14:14.040 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.040 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:14.040 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.040 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.040 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:14.041 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:14.041 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 16.645336074999999, 2024-04-26T11:14:14.041 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:14:14.041 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:14.041 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:14.041 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:14.041 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:14.041 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.041 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:14:14.041 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.041 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:14.041 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.041 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:14.041 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:14.041 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.042 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.042 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:14.042 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:14.042 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.042 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.043 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:14.043 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:14:14.043 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:14.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.043 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.043 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:14.043 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:14:14.043 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:14:14.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.043 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.044 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:14.044 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:14:14.044 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:14:14.044 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.044 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.044 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.044 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:14:14.044 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:14:14.044 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.044 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.044 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.045 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:14:14.045 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:14:14.045 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.045 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.045 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:14.045 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:14:14.045 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:14:14.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.046 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.046 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:14.046 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:14:14.046 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:14:14.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.046 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.046 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:14.046 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:14:14.046 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:14:14.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.046 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.046 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.047 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:14:14.047 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:14:14.047 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.047 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.047 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:14.047 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:14:14.047 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:14:14.047 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.047 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.047 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.047 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:14:14.047 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:14:14.047 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.047 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.048 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:14.048 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:14:14.048 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:14:14.048 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.048 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:14.048 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.048 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.048 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.048 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:14.048 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:14.048 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 16.628887375000001, 2024-04-26T11:14:14.048 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:14:14.048 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:14.048 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:14.048 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:14.048 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:14.049 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.049 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:14:14.049 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.049 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:14.049 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.049 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:14.049 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:14.049 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.049 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.049 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.049 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:14.049 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:14.049 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.049 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.049 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.050 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:14.050 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:14:14.050 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:14.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.050 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.050 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:14.050 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:14:14.050 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:14:14.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.050 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.050 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:14.051 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:14:14.051 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:14:14.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.051 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.051 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.051 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:14:14.051 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:14:14.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.051 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.051 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.051 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:14:14.051 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:14:14.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.051 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.051 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:14.052 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:14:14.052 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:14:14.052 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.052 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.052 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.052 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:14:14.052 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:14:14.052 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.052 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.053 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:14.053 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:14:14.053 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:14:14.053 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.053 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:14.053 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.053 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.053 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.053 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:14.054 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:14.054 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 16.627189869999999, 2024-04-26T11:14:14.054 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:14:14.054 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:14.054 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:14.054 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:14.054 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:14.055 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.055 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:14:14.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.055 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:14.055 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.055 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:14.055 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:14.055 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.055 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.055 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:14.056 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:14.056 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.056 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.056 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:14.056 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:14:14.056 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:14.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.056 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.056 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:14.056 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:14:14.056 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:14:14.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.056 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.057 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:14.057 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:14:14.057 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:14:14.057 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.057 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.057 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.057 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:14:14.057 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:14:14.057 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.057 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.057 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.057 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:14:14.057 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:14:14.057 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.057 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.058 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:14.058 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:14:14.058 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:14:14.058 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.058 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.058 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.058 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:14:14.058 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:14:14.058 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.058 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.058 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:14.058 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:14:14.058 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:14:14.058 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.059 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:14.059 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.059 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.059 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:14.059 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:14.059 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 16.627125568, 2024-04-26T11:14:14.059 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:14:14.059 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:14.059 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.059 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:14.059 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:14.059 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.059 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:14:14.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.060 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:14.060 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.060 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:14.060 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:14.060 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.060 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.060 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:14.060 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:14.060 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.060 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.060 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:14.060 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:14.061 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:14.061 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.061 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.061 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:14.061 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:14:14.061 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:14:14.061 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.061 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.061 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:14.061 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:14:14.061 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:14:14.061 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.061 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.061 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.062 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:14:14.062 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:14:14.062 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.062 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.062 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.062 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:14:14.062 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:14:14.062 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.062 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.062 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:14.062 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:14:14.062 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:14:14.062 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.062 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.063 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.063 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:14:14.063 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:14:14.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.063 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.063 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:14.063 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:14:14.063 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:14:14.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.063 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.063 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:14.063 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:14:14.063 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:14:14.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.063 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.064 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:14.064 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:14:14.064 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:14:14.064 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.064 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.064 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:14.064 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:14:14.064 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:14:14.064 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.064 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:14.064 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.064 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.064 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.064 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:14.065 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:14.065 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 16.627071344000001, 2024-04-26T11:14:14.065 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:14:14.065 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:14.065 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.065 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:14.065 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:14.065 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.065 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:14:14.065 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.065 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:14.065 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.065 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:14.065 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:14.066 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.066 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.066 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.066 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:14.066 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:14.066 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.066 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.066 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.066 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:14.066 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:14.066 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:14.066 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.066 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.066 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:14.067 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:14:14.067 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:14:14.067 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.067 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.067 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:14.067 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:14:14.067 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:14:14.067 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.067 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.067 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.067 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:14:14.067 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:14:14.067 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.067 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.067 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.067 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:14:14.068 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:14:14.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.068 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.068 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:14.068 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:14:14.068 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:14:14.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.068 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.068 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.068 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:14:14.068 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:14:14.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.068 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.068 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:14.068 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:14:14.069 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:14:14.069 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.069 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.069 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:14.069 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:14:14.069 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:14:14.069 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.069 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.069 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:14.069 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:14:14.069 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:14.069 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.069 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.069 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:14.069 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:14:14.070 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:14:14.070 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.070 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:14.070 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.070 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.070 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:14.070 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:14.070 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 16.627026831999999, 2024-04-26T11:14:14.070 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:14:14.070 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:14.070 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.070 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:14.071 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:14.071 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.071 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:14:14.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.071 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:14.071 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.071 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:14.071 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:14.071 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.071 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.071 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:14.071 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:14.071 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.072 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.072 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:14.072 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:14:14.072 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:14.072 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.072 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.072 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:14.072 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:14:14.072 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:14:14.072 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.072 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.072 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:14.072 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:14:14.072 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:14:14.072 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.073 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.073 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.073 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:14:14.073 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:14:14.073 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.073 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.073 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.073 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:14:14.073 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:14:14.073 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.073 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.073 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:14.073 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:14:14.073 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:14:14.073 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.074 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.074 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.074 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:14:14.074 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:14:14.074 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.074 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.074 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:14.074 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:14:14.074 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:14:14.074 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.074 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.074 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:14.074 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:14:14.074 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:14:14.074 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.075 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.075 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:14.075 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:14:14.075 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:14:14.075 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.075 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.075 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:14.075 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:14:14.075 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:14:14.075 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.075 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:14.075 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.075 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.075 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.076 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:14.076 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:14.076 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 16.622805830000001, 2024-04-26T11:14:14.076 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:14:14.076 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:14.076 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.076 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:14.076 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:14.076 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.076 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:14:14.076 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.076 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:14.076 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.076 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:14.076 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:14.077 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.077 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.077 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.077 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:14.077 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:14.077 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.077 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.077 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.077 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:14.077 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:14:14.077 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:14:14.077 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.077 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.077 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:14.077 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:14:14.078 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:14:14.078 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.078 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.078 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:14.078 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:14:14.078 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:14:14.078 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.078 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.078 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.078 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:14:14.078 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:14:14.078 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.078 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.078 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.079 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:14:14.079 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:14:14.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.079 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.079 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:14.079 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:14:14.079 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:14:14.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.079 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.079 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.079 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:14:14.079 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:14:14.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.079 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.080 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:14.080 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:14:14.080 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:14:14.080 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.080 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.080 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:14.080 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:14:14.080 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:14:14.080 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.080 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.080 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:14.080 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:14:14.080 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:14:14.081 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.081 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.081 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:14.081 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:14:14.081 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:14:14.081 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.081 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:14.081 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.081 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.081 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.081 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:61817 5.a 5:5627ce7f:::benchmark_data_smithi029_44842_object61816:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:14.081 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:14.081 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 13.272680377, 2024-04-26T11:14:14.081 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020626958000000001, 2024-04-26T11:14:14.081 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:14.082 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.082 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:14.082 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:14.082 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.082 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 61817 2024-04-26T11:14:14.082 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.082 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:14.082 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.082 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:14.082 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:14.082 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.082 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.083 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.083 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:14.083 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:14.083 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.083 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.083 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.083 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:14.083 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:14.083 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:14.083 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.083 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.083 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:14.083 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702591+0000", 2024-04-26T11:14:14.083 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0665999999999998e-05 2024-04-26T11:14:14.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.084 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.084 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:14.084 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702599+0000", 2024-04-26T11:14:14.084 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7130000000000005e-06 2024-04-26T11:14:14.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.084 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.084 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.084 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702605+0000", 2024-04-26T11:14:14.084 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4310000000000002e-06 2024-04-26T11:14:14.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.084 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.084 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.084 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.707947+0000", 2024-04-26T11:14:14.085 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053424220000000003 2024-04-26T11:14:14.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.085 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.085 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:14.085 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.708052+0000", 2024-04-26T11:14:14.085 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010499 2024-04-26T11:14:14.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.085 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.085 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:14:14.085 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.708141+0000", 2024-04-26T11:14:14.085 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9514999999999999e-05 2024-04-26T11:14:14.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.085 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.085 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:14.086 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.711954+0000", 2024-04-26T11:14:14.086 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003812265 2024-04-26T11:14:14.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.086 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.086 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:14.086 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723070+0000", 2024-04-26T11:14:14.086 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011116727 2024-04-26T11:14:14.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.086 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.086 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:14.086 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723121+0000", 2024-04-26T11:14:14.086 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0362999999999999e-05 2024-04-26T11:14:14.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.086 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.087 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:14.087 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723158+0000", 2024-04-26T11:14:14.087 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7579000000000001e-05 2024-04-26T11:14:14.087 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.087 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:14.087 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.087 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.087 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:75771 5.c 5:3cc8f1b4:::benchmark_data_smithi029_44842_object75770:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T11:14:14.087 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:14.087 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 7.2222360339999998, 2024-04-26T11:14:14.087 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019437949, 2024-04-26T11:14:14.087 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:14.087 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.088 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:14.088 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:14.088 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.088 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 75771 2024-04-26T11:14:14.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.088 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:14.088 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.088 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:14.088 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:14.088 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.088 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.088 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:14.088 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:14.088 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.089 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.089 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:14.089 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752975+0000", 2024-04-26T11:14:14.089 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:14.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.089 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.089 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:14.089 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753061+0000", 2024-04-26T11:14:14.089 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5890999999999995e-05 2024-04-26T11:14:14.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.089 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.089 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:14.089 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753071+0000", 2024-04-26T11:14:14.090 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.9990000000000003e-06 2024-04-26T11:14:14.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.090 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.090 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.090 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753078+0000", 2024-04-26T11:14:14.090 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1559999999999998e-06 2024-04-26T11:14:14.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.090 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.090 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.090 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.758559+0000", 2024-04-26T11:14:14.090 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0054812819999999996 2024-04-26T11:14:14.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.090 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.090 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:14.091 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.758692+0000", 2024-04-26T11:14:14.091 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000133301 2024-04-26T11:14:14.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.091 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.091 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:14.091 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772277+0000", 2024-04-26T11:14:14.091 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.013584839 2024-04-26T11:14:14.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.091 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.091 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:14.091 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772340+0000", 2024-04-26T11:14:14.091 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2360999999999995e-05 2024-04-26T11:14:14.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.091 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.092 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:14.092 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772414+0000", 2024-04-26T11:14:14.092 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4024999999999997e-05 2024-04-26T11:14:14.092 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.092 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:14.092 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.092 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.092 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83359 5.2 5:4939888c:::benchmark_data_smithi029_44842_object83358:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:14.092 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:14.092 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 2.9356454489999999, 2024-04-26T11:14:14.092 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018705583000000001, 2024-04-26T11:14:14.092 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:14.092 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.092 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:14.093 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:14.093 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.093 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83359 2024-04-26T11:14:14.093 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.093 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:14.093 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.093 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:14.093 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:14.093 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.093 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.093 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.093 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:14.093 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:14.093 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.094 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.094 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:14.094 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:14.094 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:14.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.094 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.094 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:14.094 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039625+0000", 2024-04-26T11:14:14.094 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9162e-05 2024-04-26T11:14:14.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.094 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.094 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:14.094 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039632+0000", 2024-04-26T11:14:14.094 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5399999999999998e-06 2024-04-26T11:14:14.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.095 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.095 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.095 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039638+0000", 2024-04-26T11:14:14.095 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1850000000000003e-06 2024-04-26T11:14:14.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.095 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.095 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.095 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.042375+0000", 2024-04-26T11:14:14.095 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0027371510000000002 2024-04-26T11:14:14.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.095 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.095 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:14.095 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.042502+0000", 2024-04-26T11:14:14.096 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000126966 2024-04-26T11:14:14.096 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.096 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.096 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:14.096 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058154+0000", 2024-04-26T11:14:14.096 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015652657 2024-04-26T11:14:14.096 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.096 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.096 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:14.096 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058201+0000", 2024-04-26T11:14:14.096 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6579000000000002e-05 2024-04-26T11:14:14.096 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.096 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.096 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:14.097 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058272+0000", 2024-04-26T11:14:14.097 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1009999999999999e-05 2024-04-26T11:14:14.097 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.097 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:14.097 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.097 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.097 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.097 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83360 5.2 5:42f8bfcd:::benchmark_data_smithi029_44842_object83359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:14.097 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:14.097 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 2.93556646, 2024-04-26T11:14:14.097 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022279782000000001, 2024-04-26T11:14:14.097 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:14.097 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.097 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:14.098 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:14.098 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.098 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83360 2024-04-26T11:14:14.098 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.098 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:14.098 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.098 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:14.098 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:14.098 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.098 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.098 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.098 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:14.098 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:14.098 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.099 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.099 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:14.099 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:14.099 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:14.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.099 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.099 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:14.099 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039700+0000", 2024-04-26T11:14:14.099 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5541000000000002e-05 2024-04-26T11:14:14.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.099 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.099 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:14.099 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039706+0000", 2024-04-26T11:14:14.100 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3680000000000001e-06 2024-04-26T11:14:14.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.100 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.100 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.100 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039709+0000", 2024-04-26T11:14:14.100 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4659999999999999e-06 2024-04-26T11:14:14.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.100 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.100 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.100 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056305+0000", 2024-04-26T11:14:14.100 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016595649000000001 2024-04-26T11:14:14.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.100 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.100 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:14.101 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056487+0000", 2024-04-26T11:14:14.101 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000181886 2024-04-26T11:14:14.101 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.101 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.101 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:14.101 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061809+0000", 2024-04-26T11:14:14.101 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053223259999999996 2024-04-26T11:14:14.101 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.101 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.101 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:14.101 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061852+0000", 2024-04-26T11:14:14.101 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2738999999999999e-05 2024-04-26T11:14:14.101 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.101 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.101 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:14.102 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061925+0000", 2024-04-26T11:14:14.102 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3180000000000001e-05 2024-04-26T11:14:14.102 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.102 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:14.102 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.102 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.102 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.102 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83364 5.2 5:42c5cd8c:::benchmark_data_smithi029_44842_object83363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:14.102 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:14.102 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 2.9351507200000002, 2024-04-26T11:14:14.102 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022695336, 2024-04-26T11:14:14.102 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:14.102 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.103 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:14.103 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:14.103 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.103 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83364 2024-04-26T11:14:14.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.103 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:14.103 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.103 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:14.103 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:14.103 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.103 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.103 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:14.103 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:14.103 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.104 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.104 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:14.104 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040060+0000", 2024-04-26T11:14:14.104 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:14.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.104 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.104 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:14.104 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040086+0000", 2024-04-26T11:14:14.104 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5482000000000001e-05 2024-04-26T11:14:14.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.104 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.104 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:14.104 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040093+0000", 2024-04-26T11:14:14.104 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6409999999999996e-06 2024-04-26T11:14:14.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.105 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.105 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.105 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040098+0000", 2024-04-26T11:14:14.105 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879999999999996e-06 2024-04-26T11:14:14.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.105 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.105 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.105 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058292+0000", 2024-04-26T11:14:14.105 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018193504999999999 2024-04-26T11:14:14.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.105 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.105 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:14.105 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058412+0000", 2024-04-26T11:14:14.105 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011979199999999999 2024-04-26T11:14:14.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.106 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:14.106 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062642+0000", 2024-04-26T11:14:14.106 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042299449999999997 2024-04-26T11:14:14.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.106 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:14.106 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062688+0000", 2024-04-26T11:14:14.106 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6859e-05 2024-04-26T11:14:14.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.106 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:14.106 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062756+0000", 2024-04-26T11:14:14.106 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7995000000000002e-05 2024-04-26T11:14:14.107 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.107 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:14.107 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.107 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.107 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83378 5.2 5:44b3209a:::benchmark_data_smithi029_44842_object83377:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:14.107 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:14.107 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 2.9274302670000001, 2024-04-26T11:14:14.107 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020722529, 2024-04-26T11:14:14.107 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:14.107 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.107 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:14.107 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:14.107 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.107 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83378 2024-04-26T11:14:14.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.108 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:14.108 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.108 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:14.108 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:14.108 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.108 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.108 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:14.108 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:14.108 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:14.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.108 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.108 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:14.108 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047781+0000", 2024-04-26T11:14:14.109 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:14.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.109 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.109 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:14.109 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047832+0000", 2024-04-26T11:14:14.109 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1687000000000002e-05 2024-04-26T11:14:14.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.109 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.109 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:14.109 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047842+0000", 2024-04-26T11:14:14.109 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2439999999999999e-06 2024-04-26T11:14:14.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.109 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.109 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.109 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047847+0000", 2024-04-26T11:14:14.109 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6500000000000001e-06 2024-04-26T11:14:14.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.110 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.110 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:14.110 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.060082+0000", 2024-04-26T11:14:14.110 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.012235105 2024-04-26T11:14:14.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.110 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.110 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:14.110 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.060191+0000", 2024-04-26T11:14:14.110 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000108665 2024-04-26T11:14:14.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.110 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.110 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:14.110 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068363+0000", 2024-04-26T11:14:14.110 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0081715829999999996 2024-04-26T11:14:14.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.111 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.111 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:14.111 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068418+0000", 2024-04-26T11:14:14.111 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4984000000000001e-05 2024-04-26T11:14:14.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:14.111 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:14.111 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:14.111 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068504+0000", 2024-04-26T11:14:14.111 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6520000000000005e-05 2024-04-26T11:14:14.111 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.111 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:14.111 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.111 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:14.111 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:14.112 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:14.113 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:14.114 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:14.112+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:14.214 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:14.213+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:14.289 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:14.289 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:14.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.289 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90738 5.0 5:07f68268:::benchmark_data_smithi029_44842_object90737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.283035+0000", 2024-04-26T11:14:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0044580150000000001, 2024-04-26T11:14:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044904080000000004, 2024-04-26T11:14:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90738 2024-04-26T11:14:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283035+0000", 2024-04-26T11:14:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283035+0000", 2024-04-26T11:14:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283035+0000", 2024-04-26T11:14:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283090+0000", 2024-04-26T11:14:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5371999999999998e-05 2024-04-26T11:14:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283104+0000", 2024-04-26T11:14:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3599e-05 2024-04-26T11:14:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283111+0000", 2024-04-26T11:14:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1749999999999999e-06 2024-04-26T11:14:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283161+0000", 2024-04-26T11:14:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0781000000000001e-05 2024-04-26T11:14:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283268+0000", 2024-04-26T11:14:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106511 2024-04-26T11:14:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283373+0000", 2024-04-26T11:14:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105334 2024-04-26T11:14:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.285903+0000", 2024-04-26T11:14:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025293849999999999 2024-04-26T11:14:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90740 5.e 5:7489e681:::benchmark_data_smithi029_44842_object90739:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.283129+0000", 2024-04-26T11:14:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0043646079999999999, 2024-04-26T11:14:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044868290000000003, 2024-04-26T11:14:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.294 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90740 2024-04-26T11:14:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283129+0000", 2024-04-26T11:14:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283129+0000", 2024-04-26T11:14:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283128+0000", 2024-04-26T11:14:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283193+0000", 2024-04-26T11:14:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4739999999999993e-05 2024-04-26T11:14:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283203+0000", 2024-04-26T11:14:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0002e-05 2024-04-26T11:14:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283209+0000", 2024-04-26T11:14:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4629999999999998e-06 2024-04-26T11:14:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283248+0000", 2024-04-26T11:14:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8535000000000003e-05 2024-04-26T11:14:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283378+0000", 2024-04-26T11:14:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012963100000000001 2024-04-26T11:14:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283521+0000", 2024-04-26T11:14:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143027 2024-04-26T11:14:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90741 5.d 5:b85b9ff7:::benchmark_data_smithi029_44842_object90740:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:14.298 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.283355+0000", 2024-04-26T11:14:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0041386519999999996, 2024-04-26T11:14:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043381310000000003, 2024-04-26T11:14:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90741 2024-04-26T11:14:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283355+0000", 2024-04-26T11:14:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283355+0000", 2024-04-26T11:14:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283354+0000", 2024-04-26T11:14:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283456+0000", 2024-04-26T11:14:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000101814 2024-04-26T11:14:14.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283465+0000", 2024-04-26T11:14:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7140000000000005e-06 2024-04-26T11:14:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283473+0000", 2024-04-26T11:14:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5000000000000002e-06 2024-04-26T11:14:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283500+0000", 2024-04-26T11:14:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7614999999999999e-05 2024-04-26T11:14:14.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283577+0000", 2024-04-26T11:14:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6637000000000005e-05 2024-04-26T11:14:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90743 5.8 5:1db350ce:::benchmark_data_smithi029_44842_object90742:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.283795+0000", 2024-04-26T11:14:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0036985590000000001, 2024-04-26T11:14:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003970838, 2024-04-26T11:14:14.302 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90743 2024-04-26T11:14:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283795+0000", 2024-04-26T11:14:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283795+0000", 2024-04-26T11:14:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283794+0000", 2024-04-26T11:14:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283873+0000", 2024-04-26T11:14:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9424000000000004e-05 2024-04-26T11:14:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283884+0000", 2024-04-26T11:14:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0331e-05 2024-04-26T11:14:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283907+0000", 2024-04-26T11:14:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3073000000000001e-05 2024-04-26T11:14:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283946+0000", 2024-04-26T11:14:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9539000000000002e-05 2024-04-26T11:14:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.284081+0000", 2024-04-26T11:14:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000134714 2024-04-26T11:14:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.284238+0000", 2024-04-26T11:14:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000157095 2024-04-26T11:14:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90744 5.d 5:b40d5eec:::benchmark_data_smithi029_44842_object90743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:14.306 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.283915+0000", 2024-04-26T11:14:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.003578618, 2024-04-26T11:14:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039292909999999997, 2024-04-26T11:14:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90744 2024-04-26T11:14:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283915+0000", 2024-04-26T11:14:14.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283915+0000", 2024-04-26T11:14:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283914+0000", 2024-04-26T11:14:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283937+0000", 2024-04-26T11:14:14.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2940000000000001e-05 2024-04-26T11:14:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283945+0000", 2024-04-26T11:14:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9209999999999992e-06 2024-04-26T11:14:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.283953+0000", 2024-04-26T11:14:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6140000000000003e-06 2024-04-26T11:14:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.285105+0000", 2024-04-26T11:14:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011523 2024-04-26T11:14:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.285212+0000", 2024-04-26T11:14:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106617 2024-04-26T11:14:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90747 5.4 5:2325e297:::benchmark_data_smithi029_44842_object90746:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:14.310 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.285836+0000", 2024-04-26T11:14:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.001657719, 2024-04-26T11:14:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020930570000000002, 2024-04-26T11:14:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90747 2024-04-26T11:14:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.285836+0000", 2024-04-26T11:14:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.285836+0000", 2024-04-26T11:14:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.285835+0000", 2024-04-26T11:14:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.285981+0000", 2024-04-26T11:14:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014604599999999999 2024-04-26T11:14:14.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.285991+0000", 2024-04-26T11:14:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8670000000000006e-06 2024-04-26T11:14:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.285997+0000", 2024-04-26T11:14:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5950000000000004e-06 2024-04-26T11:14:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.286041+0000", 2024-04-26T11:14:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3609000000000002e-05 2024-04-26T11:14:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.286164+0000", 2024-04-26T11:14:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012303600000000001 2024-04-26T11:14:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.286298+0000", 2024-04-26T11:14:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013433600000000001 2024-04-26T11:14:14.314 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90748 5.b 5:dda49ab4:::benchmark_data_smithi029_44842_object90747:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.286013+0000", 2024-04-26T11:14:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.001480117, 2024-04-26T11:14:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001997998, 2024-04-26T11:14:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90748 2024-04-26T11:14:14.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.286013+0000", 2024-04-26T11:14:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.286013+0000", 2024-04-26T11:14:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.286013+0000", 2024-04-26T11:14:14.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.286039+0000", 2024-04-26T11:14:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6395999999999999e-05 2024-04-26T11:14:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.286048+0000", 2024-04-26T11:14:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7690000000000002e-06 2024-04-26T11:14:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.286054+0000", 2024-04-26T11:14:14.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.054e-06 2024-04-26T11:14:14.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.286084+0000", 2024-04-26T11:14:14.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0546000000000002e-05 2024-04-26T11:14:14.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:14.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.286162+0000", 2024-04-26T11:14:14.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8071000000000005e-05 2024-04-26T11:14:14.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:14.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.286247+0000", 2024-04-26T11:14:14.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4289000000000006e-05 2024-04-26T11:14:14.319 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.319 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.319 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.319 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90749 5.0 5:0cf2393a:::benchmark_data_smithi029_44842_object90748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:14.319 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.286064+0000", 2024-04-26T11:14:14.319 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0014290049999999999, 2024-04-26T11:14:14.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020389940000000001, 2024-04-26T11:14:14.319 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.319 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:14.319 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.319 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.319 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.320 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90749 2024-04-26T11:14:14.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.320 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.286064+0000", 2024-04-26T11:14:14.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.286064+0000", 2024-04-26T11:14:14.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.286064+0000", 2024-04-26T11:14:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.286091+0000", 2024-04-26T11:14:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7492e-05 2024-04-26T11:14:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.286099+0000", 2024-04-26T11:14:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4109999999999999e-06 2024-04-26T11:14:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.286104+0000", 2024-04-26T11:14:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3310000000000003e-06 2024-04-26T11:14:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.286141+0000", 2024-04-26T11:14:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7416999999999998e-05 2024-04-26T11:14:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.286271+0000", 2024-04-26T11:14:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000129725 2024-04-26T11:14:14.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:14.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.286417+0000", 2024-04-26T11:14:14.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000145468 2024-04-26T11:14:14.323 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.323 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.323 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.323 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.323 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:14:14.323 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 8 2024-04-26T11:14:14.323 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:14.325 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:14.325 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:14.323+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:14.413 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 36 16 91032 91016 157.999 139.312 0.00446963 0.0063258 2024-04-26T11:14:14.426 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:14.425+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:14.527 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:14.526+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:14.538 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:14.538 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:14:14.538 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:14:14.538 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:14:14.538 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:14.553 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:14.612 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:14:14.628 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:14.627+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:14.728 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:14.729 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:14:14.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:14:14.729 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:14.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.729 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35483 5.b 5:d3dd14f6:::benchmark_data_smithi029_44842_object35482:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:14:14.729 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:14.729 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.305949144, 2024-04-26T11:14:14.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021245969, 2024-04-26T11:14:14.729 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.729 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.729 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.729 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.730 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.730 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35483 2024-04-26T11:14:14.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.730 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:14.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:14.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:14.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:14.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418885+0000", 2024-04-26T11:14:14.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1294e-05 2024-04-26T11:14:14.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418892+0000", 2024-04-26T11:14:14.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4599999999999997e-06 2024-04-26T11:14:14.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418899+0000", 2024-04-26T11:14:14.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0909999999999998e-06 2024-04-26T11:14:14.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421347+0000", 2024-04-26T11:14:14.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024484609999999999 2024-04-26T11:14:14.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:14.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421468+0000", 2024-04-26T11:14:14.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000121179 2024-04-26T11:14:14.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:14.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421605+0000", 2024-04-26T11:14:14.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013672200000000001 2024-04-26T11:14:14.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:14.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425456+0000", 2024-04-26T11:14:14.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038511719999999999 2024-04-26T11:14:14.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:14.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.439986+0000", 2024-04-26T11:14:14.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014530080000000001 2024-04-26T11:14:14.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:14.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440038+0000", 2024-04-26T11:14:14.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1916999999999998e-05 2024-04-26T11:14:14.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:14.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440070+0000", 2024-04-26T11:14:14.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2245e-05 2024-04-26T11:14:14.734 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.734 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.734 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.735 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44513 5.0 5:0a236ebb:::benchmark_data_smithi029_44842_object44512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:14.735 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:14.735 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.554686164, 2024-04-26T11:14:14.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020724414, 2024-04-26T11:14:14.735 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.735 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.735 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.735 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.735 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.735 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44513 2024-04-26T11:14:14.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.735 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:14.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:14.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:14.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:14.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170120+0000", 2024-04-26T11:14:14.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2941000000000002e-05 2024-04-26T11:14:14.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170127+0000", 2024-04-26T11:14:14.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.469e-06 2024-04-26T11:14:14.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170133+0000", 2024-04-26T11:14:14.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1340000000000001e-06 2024-04-26T11:14:14.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182383+0000", 2024-04-26T11:14:14.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012249970000000001 2024-04-26T11:14:14.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:14.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182477+0000", 2024-04-26T11:14:14.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3776999999999993e-05 2024-04-26T11:14:14.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:14.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182572+0000", 2024-04-26T11:14:14.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4841999999999998e-05 2024-04-26T11:14:14.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:14.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188262+0000", 2024-04-26T11:14:14.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005690077 2024-04-26T11:14:14.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:14.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190748+0000", 2024-04-26T11:14:14.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024857780000000001 2024-04-26T11:14:14.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:14.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190776+0000", 2024-04-26T11:14:14.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8419999999999999e-05 2024-04-26T11:14:14.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:14.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190812+0000", 2024-04-26T11:14:14.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5630999999999998e-05 2024-04-26T11:14:14.740 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.740 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.740 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.740 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:14.740 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:14.740 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.445983141999999, 2024-04-26T11:14:14.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:14:14.740 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.740 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.741 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.741 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.741 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.741 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:14:14.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.741 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:14.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:14.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:14.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:14.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:14:14.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:14:14.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:14:14.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:14:14.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:14:14.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:14:14.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:14:14.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:14:14.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:14.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:14:14.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:14:14.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:14.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:14:14.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:14:14.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:14.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:14:14.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:14:14.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:14.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:14:14.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:14:14.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:14.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:14:14.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:14:14.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:14.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:14:14.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:14:14.745 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.746 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.746 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.746 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:14.746 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:14.746 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.445333439999999, 2024-04-26T11:14:14.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:14:14.746 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.746 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.746 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.746 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.746 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.746 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:14:14.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.747 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:14.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:14.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:14:14.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:14.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:14:14.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:14:14.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:14:14.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:14:14.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:14:14.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:14:14.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:14:14.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:14:14.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:14.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:14:14.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:14:14.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:14.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:14:14.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:14:14.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:14.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:14:14.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:14:14.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:14.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:14:14.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:14:14.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:14.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:14:14.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:14:14.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:14.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:14:14.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:14:14.751 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.751 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.751 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.751 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:55093 5.e 5:7ebffa9e:::benchmark_data_smithi029_44842_object55092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:14.751 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:14:14.751 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.978201722000001, 2024-04-26T11:14:14.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020381660999999999, 2024-04-26T11:14:14.752 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.752 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.752 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.752 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.752 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.752 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 55093 2024-04-26T11:14:14.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.752 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:14:14.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:14:14.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746571+0000", 2024-04-26T11:14:14.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:14.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746599+0000", 2024-04-26T11:14:14.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8262000000000001e-05 2024-04-26T11:14:14.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746610+0000", 2024-04-26T11:14:14.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1070000000000001e-05 2024-04-26T11:14:14.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746617+0000", 2024-04-26T11:14:14.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8190000000000003e-06 2024-04-26T11:14:14.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748218+0000", 2024-04-26T11:14:14.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0016005889999999999 2024-04-26T11:14:14.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:14.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748350+0000", 2024-04-26T11:14:14.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132528 2024-04-26T11:14:14.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:14.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748499+0000", 2024-04-26T11:14:14.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014815600000000001 2024-04-26T11:14:14.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:14.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.750795+0000", 2024-04-26T11:14:14.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022960369999999999 2024-04-26T11:14:14.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:14.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766866+0000", 2024-04-26T11:14:14.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016071230999999998 2024-04-26T11:14:14.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:14.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766922+0000", 2024-04-26T11:14:14.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6643e-05 2024-04-26T11:14:14.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:14.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766953+0000", 2024-04-26T11:14:14.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0981e-05 2024-04-26T11:14:14.756 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.757 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.757 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.757 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:14.757 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:14.757 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.378691401000001, 2024-04-26T11:14:14.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:14:14.757 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.757 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:14.757 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.757 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.757 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.757 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:14:14.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.758 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:14.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:14.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:14:14.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:14.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:14:14.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:14:14.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:14:14.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:14:14.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:14:14.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:14:14.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:14:14.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:14:14.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:14.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:14:14.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:14:14.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:14:14.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:14:14.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:14.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:14:14.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:14:14.761 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.761 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.761 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.762 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:14.762 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:14.762 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.378595754999999, 2024-04-26T11:14:14.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:14:14.762 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.762 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:14.762 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.762 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.762 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.762 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:14:14.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.762 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:14.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:14.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:14:14.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:14.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:14:14.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:14:14.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:14:14.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:14:14.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:14:14.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:14:14.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:14:14.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:14:14.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:14.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:14:14.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:14:14.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:14:14.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:14:14.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:14.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:14:14.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:14:14.766 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.766 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.766 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.766 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:14.766 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:14.766 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.378464076, 2024-04-26T11:14:14.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:14:14.767 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.767 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:14.767 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.767 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.767 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.767 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:14:14.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.767 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:14.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:14.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:14.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:14.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:14:14.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:14:14.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:14:14.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:14:14.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:14:14.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:14:14.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:14:14.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:14:14.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:14.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:14:14.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:14:14.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:14:14.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:14:14.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:14.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:14:14.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:14:14.771 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.771 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.771 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.771 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:14.771 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:14.771 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.378355620000001, 2024-04-26T11:14:14.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:14:14.771 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.771 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:14.771 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.771 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.771 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.772 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:14:14.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.772 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:14.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:14.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:14:14.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:14.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:14:14.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:14:14.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:14:14.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:14:14.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:14:14.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:14:14.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:14:14.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:14:14.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:14.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:14:14.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:14:14.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:14:14.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:14:14.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:14.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:14:14.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:14:14.775 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.775 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.775 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.776 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:14.776 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:14.776 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.378254351999999, 2024-04-26T11:14:14.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:14:14.776 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.776 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.776 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.776 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.776 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.776 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:14:14.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.776 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:14.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:14.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:14.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:14.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:14:14.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:14:14.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:14:14.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:14:14.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:14:14.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:14:14.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:14:14.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:14:14.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:14.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:14:14.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:14:14.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:14:14.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:14:14.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:14.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:14:14.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:14:14.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:14.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:14:14.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:14:14.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:14.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:14:14.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:14:14.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:14.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:14:14.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:14:14.781 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.781 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.781 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.781 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:14.781 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:14.782 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.378185411, 2024-04-26T11:14:14.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:14:14.782 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.782 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.782 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.782 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.782 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.782 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:14:14.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.782 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:14.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:14.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:14:14.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:14.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:14:14.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:14:14.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:14:14.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:14:14.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:14:14.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:14:14.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:14:14.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:14:14.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:14.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:14:14.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:14:14.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:14:14.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:14:14.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:14.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:14:14.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:14:14.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:14.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:14:14.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:14:14.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:14.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:14:14.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:14:14.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:14.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:14:14.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:14:14.787 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.787 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.787 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.789 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:14.789 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:14.790 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.37218983, 2024-04-26T11:14:14.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:14:14.790 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.790 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.790 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.790 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.790 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.790 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:14:14.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.790 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:14.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:14.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:14:14.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:14.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:14:14.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:14:14.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:14:14.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:14:14.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:14:14.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:14:14.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:14:14.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:14:14.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:14.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:14:14.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:14:14.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:14:14.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:14:14.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:14.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:14:14.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:14:14.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:14.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:14:14.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:14:14.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:14.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:14:14.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:14:14.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:14.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:14:14.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:14:14.795 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.795 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.795 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.795 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:81256 5.8 5:1c0f3fd8:::benchmark_data_smithi029_44842_object81255:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:14.795 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:14.795 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.6087302809999997, 2024-04-26T11:14:14.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026193673000000001, 2024-04-26T11:14:14.795 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.795 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.795 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.795 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.795 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.796 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 81256 2024-04-26T11:14:14.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.796 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:14.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:14.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:14.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:14.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116073+0000", 2024-04-26T11:14:14.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0114e-05 2024-04-26T11:14:14.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116079+0000", 2024-04-26T11:14:14.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8939999999999998e-06 2024-04-26T11:14:14.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116082+0000", 2024-04-26T11:14:14.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:14:14.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127501+0000", 2024-04-26T11:14:14.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011418281000000001 2024-04-26T11:14:14.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:14.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127639+0000", 2024-04-26T11:14:14.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013828899999999999 2024-04-26T11:14:14.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:14.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127782+0000", 2024-04-26T11:14:14.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014328299999999999 2024-04-26T11:14:14.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:14.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.134767+0000", 2024-04-26T11:14:14.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0069844140000000004 2024-04-26T11:14:14.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:14.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142160+0000", 2024-04-26T11:14:14.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007392839 2024-04-26T11:14:14.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:14.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142202+0000", 2024-04-26T11:14:14.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2797999999999999e-05 2024-04-26T11:14:14.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:14.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142237+0000", 2024-04-26T11:14:14.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4464000000000001e-05 2024-04-26T11:14:14.800 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.800 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.800 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.800 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:82919 5.8 5:1863b1c3:::benchmark_data_smithi029_44842_object82918:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:14.801 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:10.837472+0000", 2024-04-26T11:14:14.801 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.8873014800000001, 2024-04-26T11:14:14.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020497832000000001, 2024-04-26T11:14:14.801 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.801 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.801 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.801 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.801 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.801 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 82919 2024-04-26T11:14:14.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.801 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.837472+0000", 2024-04-26T11:14:14.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.837472+0000", 2024-04-26T11:14:14.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.837471+0000", 2024-04-26T11:14:14.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:14.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.837532+0000", 2024-04-26T11:14:14.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1365000000000006e-05 2024-04-26T11:14:14.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.837542+0000", 2024-04-26T11:14:14.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2490000000000007e-06 2024-04-26T11:14:14.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.837549+0000", 2024-04-26T11:14:14.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5909999999999998e-06 2024-04-26T11:14:14.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.847015+0000", 2024-04-26T11:14:14.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0094659600000000007 2024-04-26T11:14:14.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:14.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.847134+0000", 2024-04-26T11:14:14.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011899 2024-04-26T11:14:14.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:14.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.847283+0000", 2024-04-26T11:14:14.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0001483 2024-04-26T11:14:14.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:14.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.852539+0000", 2024-04-26T11:14:14.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052565049999999999 2024-04-26T11:14:14.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:14.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.857887+0000", 2024-04-26T11:14:14.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053478789999999998 2024-04-26T11:14:14.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:14.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.857928+0000", 2024-04-26T11:14:14.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1439000000000001e-05 2024-04-26T11:14:14.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:14.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.857970+0000", 2024-04-26T11:14:14.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1448e-05 2024-04-26T11:14:14.806 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.806 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.806 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.806 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:83365 5.a 5:526f4e36:::benchmark_data_smithi029_44842_object83364:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:14.806 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:11.041087+0000", 2024-04-26T11:14:14.806 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.683686475, 2024-04-26T11:14:14.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020902897, 2024-04-26T11:14:14.806 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.806 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.806 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.806 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.806 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.807 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 83365 2024-04-26T11:14:14.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.807 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.041087+0000", 2024-04-26T11:14:14.807 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.807 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.807 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.807 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.041087+0000", 2024-04-26T11:14:14.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.041086+0000", 2024-04-26T11:14:14.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:14.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.041149+0000", 2024-04-26T11:14:14.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2738999999999997e-05 2024-04-26T11:14:14.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.041158+0000", 2024-04-26T11:14:14.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3100000000000006e-06 2024-04-26T11:14:14.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.041164+0000", 2024-04-26T11:14:14.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3489999999999997e-06 2024-04-26T11:14:14.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.043156+0000", 2024-04-26T11:14:14.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0019914170000000001 2024-04-26T11:14:14.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:14.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.043237+0000", 2024-04-26T11:14:14.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1442999999999999e-05 2024-04-26T11:14:14.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:14.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.043323+0000", 2024-04-26T11:14:14.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5507000000000007e-05 2024-04-26T11:14:14.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:14.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.045911+0000", 2024-04-26T11:14:14.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025878759999999998 2024-04-26T11:14:14.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:14.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.061916+0000", 2024-04-26T11:14:14.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016005130999999999 2024-04-26T11:14:14.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:14.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.061957+0000", 2024-04-26T11:14:14.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1329999999999999e-05 2024-04-26T11:14:14.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:14.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.061990+0000", 2024-04-26T11:14:14.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2703999999999997e-05 2024-04-26T11:14:14.811 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.812 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.812 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.812 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90441 5.4 5:2b047885:::benchmark_data_smithi029_44842_object90440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:14.812 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:14.812 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.57456692099999995, 2024-04-26T11:14:14.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026164084000000001, 2024-04-26T11:14:14.812 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.812 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.812 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.812 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.812 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.812 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90441 2024-04-26T11:14:14.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.813 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:14.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:14.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150206+0000", 2024-04-26T11:14:14.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:14.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150261+0000", 2024-04-26T11:14:14.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4580000000000003e-05 2024-04-26T11:14:14.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150269+0000", 2024-04-26T11:14:14.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9679999999999995e-06 2024-04-26T11:14:14.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150274+0000", 2024-04-26T11:14:14.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8470000000000003e-06 2024-04-26T11:14:14.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150312+0000", 2024-04-26T11:14:14.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7245e-05 2024-04-26T11:14:14.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:14.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150396+0000", 2024-04-26T11:14:14.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4778999999999996e-05 2024-04-26T11:14:14.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:14.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150491+0000", 2024-04-26T11:14:14.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4606999999999997e-05 2024-04-26T11:14:14.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:14.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.153991+0000", 2024-04-26T11:14:14.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035001339999999998 2024-04-26T11:14:14.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:14.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176295+0000", 2024-04-26T11:14:14.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022304280999999999 2024-04-26T11:14:14.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:14.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176335+0000", 2024-04-26T11:14:14.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:14.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.817 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:14.817 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176371+0000", 2024-04-26T11:14:14.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5448999999999999e-05 2024-04-26T11:14:14.817 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.817 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.817 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.817 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90446 5.4 5:2b42606b:::benchmark_data_smithi029_44842_object90445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:14.817 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.154339+0000", 2024-04-26T11:14:14.817 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.57043463800000005, 2024-04-26T11:14:14.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022116655999999998, 2024-04-26T11:14:14.818 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.818 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.818 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.818 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.818 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.818 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90446 2024-04-26T11:14:14.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.818 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154339+0000", 2024-04-26T11:14:14.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154339+0000", 2024-04-26T11:14:14.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154338+0000", 2024-04-26T11:14:14.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:14:14.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154394+0000", 2024-04-26T11:14:14.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6066999999999997e-05 2024-04-26T11:14:14.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154407+0000", 2024-04-26T11:14:14.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3125000000000001e-05 2024-04-26T11:14:14.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154416+0000", 2024-04-26T11:14:14.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6139999999999998e-06 2024-04-26T11:14:14.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154442+0000", 2024-04-26T11:14:14.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5729e-05 2024-04-26T11:14:14.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:14.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154528+0000", 2024-04-26T11:14:14.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6292999999999995e-05 2024-04-26T11:14:14.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:14.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154622+0000", 2024-04-26T11:14:14.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3524999999999996e-05 2024-04-26T11:14:14.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:14.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.160002+0000", 2024-04-26T11:14:14.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053799620000000003 2024-04-26T11:14:14.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:14.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176378+0000", 2024-04-26T11:14:14.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016376196999999999 2024-04-26T11:14:14.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:14.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176418+0000", 2024-04-26T11:14:14.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0207999999999999e-05 2024-04-26T11:14:14.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.822 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:14.822 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176455+0000", 2024-04-26T11:14:14.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7184000000000002e-05 2024-04-26T11:14:14.822 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.822 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.822 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.823 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90447 5.4 5:20b0d61b:::benchmark_data_smithi029_44842_object90446:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:14.823 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.154427+0000", 2024-04-26T11:14:14.823 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.57034666000000001, 2024-04-26T11:14:14.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022110727, 2024-04-26T11:14:14.823 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.823 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.823 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.823 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.823 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.823 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90447 2024-04-26T11:14:14.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.823 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154427+0000", 2024-04-26T11:14:14.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154427+0000", 2024-04-26T11:14:14.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154426+0000", 2024-04-26T11:14:14.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:14.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154459+0000", 2024-04-26T11:14:14.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3198000000000003e-05 2024-04-26T11:14:14.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154470+0000", 2024-04-26T11:14:14.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0353999999999999e-05 2024-04-26T11:14:14.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154476+0000", 2024-04-26T11:14:14.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.426e-06 2024-04-26T11:14:14.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.156612+0000", 2024-04-26T11:14:14.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021359439999999999 2024-04-26T11:14:14.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:14.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.156757+0000", 2024-04-26T11:14:14.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000144714 2024-04-26T11:14:14.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:14.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.156844+0000", 2024-04-26T11:14:14.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7585999999999998e-05 2024-04-26T11:14:14.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:14.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.163874+0000", 2024-04-26T11:14:14.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007029474 2024-04-26T11:14:14.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:14.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176463+0000", 2024-04-26T11:14:14.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012589301000000001 2024-04-26T11:14:14.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:14.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176504+0000", 2024-04-26T11:14:14.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0574999999999997e-05 2024-04-26T11:14:14.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:14.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176538+0000", 2024-04-26T11:14:14.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3784e-05 2024-04-26T11:14:14.828 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.828 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.828 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.828 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90452 5.4 5:292172c3:::benchmark_data_smithi029_44842_object90451:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:14.828 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.154968+0000", 2024-04-26T11:14:14.828 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.56980499699999998, 2024-04-26T11:14:14.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021657626999999999, 2024-04-26T11:14:14.828 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.828 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.828 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.829 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.829 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.829 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90452 2024-04-26T11:14:14.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.829 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154968+0000", 2024-04-26T11:14:14.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154968+0000", 2024-04-26T11:14:14.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154968+0000", 2024-04-26T11:14:14.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:14.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154997+0000", 2024-04-26T11:14:14.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8878e-05 2024-04-26T11:14:14.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.155004+0000", 2024-04-26T11:14:14.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4619999999999999e-06 2024-04-26T11:14:14.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.155010+0000", 2024-04-26T11:14:14.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2260000000000002e-06 2024-04-26T11:14:14.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.158395+0000", 2024-04-26T11:14:14.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0033841689999999998 2024-04-26T11:14:14.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:14.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.158478+0000", 2024-04-26T11:14:14.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3351999999999997e-05 2024-04-26T11:14:14.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:14.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.158567+0000", 2024-04-26T11:14:14.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8900999999999995e-05 2024-04-26T11:14:14.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:14.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.164769+0000", 2024-04-26T11:14:14.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062019229999999998 2024-04-26T11:14:14.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:14.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176549+0000", 2024-04-26T11:14:14.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011779784999999999 2024-04-26T11:14:14.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:14.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176589+0000", 2024-04-26T11:14:14.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0382000000000001e-05 2024-04-26T11:14:14.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:14.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176626+0000", 2024-04-26T11:14:14.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7141000000000002e-05 2024-04-26T11:14:14.833 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.833 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.833 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.833 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90999 5.a 5:5fd33f6d:::benchmark_data_smithi029_44842_object90998:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:14.833 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.395362+0000", 2024-04-26T11:14:14.834 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.32941116799999998, 2024-04-26T11:14:14.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020657322999999998, 2024-04-26T11:14:14.834 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:14.834 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:14.834 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:14.834 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:14.834 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:14.834 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90999 2024-04-26T11:14:14.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.834 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:14.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:14.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.395362+0000", 2024-04-26T11:14:14.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:14.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.395362+0000", 2024-04-26T11:14:14.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:14.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:14.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.395361+0000", 2024-04-26T11:14:14.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:14.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:14.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.395429+0000", 2024-04-26T11:14:14.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7417999999999997e-05 2024-04-26T11:14:14.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:14.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.395442+0000", 2024-04-26T11:14:14.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.323e-05 2024-04-26T11:14:14.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:14.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.395448+0000", 2024-04-26T11:14:14.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7559999999999996e-06 2024-04-26T11:14:14.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:14.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.405164+0000", 2024-04-26T11:14:14.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0097160289999999993 2024-04-26T11:14:14.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:14.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.405273+0000", 2024-04-26T11:14:14.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000109036 2024-04-26T11:14:14.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:14.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.405391+0000", 2024-04-26T11:14:14.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011811099999999999 2024-04-26T11:14:14.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:14.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.412162+0000", 2024-04-26T11:14:14.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067710749999999997 2024-04-26T11:14:14.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:14.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.415970+0000", 2024-04-26T11:14:14.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038079680000000001 2024-04-26T11:14:14.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:14.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.415998+0000", 2024-04-26T11:14:14.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8249999999999999e-05 2024-04-26T11:14:14.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:14.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:14.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:14.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.416020+0000", 2024-04-26T11:14:14.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1375000000000001e-05 2024-04-26T11:14:14.839 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.839 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.839 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.839 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:14.839 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:14.839 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:14.840 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:14.841 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:14.839+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:14.941 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:14.940+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:15.029 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:15.029 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:15.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.029 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:92435 5.7 5:e90625ce:::benchmark_data_smithi029_44842_object92434:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:15.029 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:15.020505+0000", 2024-04-26T11:14:15.029 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0063111210000000003, 2024-04-26T11:14:15.029 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0063523, 2024-04-26T11:14:15.029 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.029 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:15.029 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.029 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.030 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.030 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 92435 2024-04-26T11:14:15.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.030 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.030 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.030 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.030 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.020505+0000", 2024-04-26T11:14:15.030 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.030 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.030 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.030 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.020505+0000", 2024-04-26T11:14:15.030 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.031 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.031 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.031 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.020505+0000", 2024-04-26T11:14:15.031 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.031 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.031 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.031 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.020630+0000", 2024-04-26T11:14:15.031 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000125279 2024-04-26T11:14:15.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.031 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.031 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.031 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.020638+0000", 2024-04-26T11:14:15.031 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.1189999999999997e-06 2024-04-26T11:14:15.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.032 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.032 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.032 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.020647+0000", 2024-04-26T11:14:15.032 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.1429999999999998e-06 2024-04-26T11:14:15.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.032 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.032 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.032 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.022260+0000", 2024-04-26T11:14:15.032 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016132010000000001 2024-04-26T11:14:15.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.032 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.032 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.032 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.022413+0000", 2024-04-26T11:14:15.032 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015284000000000001 2024-04-26T11:14:15.033 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.033 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.033 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.033 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.033 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:92438 5.c 5:3413d56b:::benchmark_data_smithi029_44842_object92437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:15.033 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:15.020788+0000", 2024-04-26T11:14:15.033 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0060289389999999997, 2024-04-26T11:14:15.033 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0061618139999999998, 2024-04-26T11:14:15.033 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.033 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:15.033 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.033 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.033 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.034 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 92438 2024-04-26T11:14:15.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.034 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.034 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.034 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.034 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.020788+0000", 2024-04-26T11:14:15.034 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.034 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.034 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.034 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.020788+0000", 2024-04-26T11:14:15.034 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.034 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.035 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.035 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.020787+0000", 2024-04-26T11:14:15.035 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.035 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.035 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.035 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.035 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.020817+0000", 2024-04-26T11:14:15.035 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0165e-05 2024-04-26T11:14:15.035 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.035 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.035 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.035 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.020825+0000", 2024-04-26T11:14:15.035 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2710000000000003e-06 2024-04-26T11:14:15.035 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.036 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.036 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.036 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.020831+0000", 2024-04-26T11:14:15.036 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8780000000000003e-06 2024-04-26T11:14:15.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.036 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.036 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.036 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.023895+0000", 2024-04-26T11:14:15.036 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0030647069999999998 2024-04-26T11:14:15.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.036 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.036 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.036 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.024019+0000", 2024-04-26T11:14:15.036 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000123566 2024-04-26T11:14:15.037 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.037 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.037 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.037 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.037 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.037 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:92439 5.0 e34/16 5:0a2d6a5d:::benchmark_data_smithi029_44842_object92438:head v 34'5838, mlcod=34'5836)", 2024-04-26T11:14:15.037 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:15.022983+0000", 2024-04-26T11:14:15.037 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0038334770000000001, 2024-04-26T11:14:15.037 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0040348220000000004, 2024-04-26T11:14:15.037 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.037 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:15.037 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.037 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.037 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.037 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.022983+0000", 2024-04-26T11:14:15.038 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.038 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.038 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.038 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.022983+0000", 2024-04-26T11:14:15.038 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.038 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.038 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.038 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.022983+0000", 2024-04-26T11:14:15.038 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.038 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.038 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.039 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.023048+0000", 2024-04-26T11:14:15.039 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5046e-05 2024-04-26T11:14:15.039 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.039 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.039 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.039 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.023057+0000", 2024-04-26T11:14:15.039 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1090000000000004e-06 2024-04-26T11:14:15.039 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.039 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.039 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.039 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.023061+0000", 2024-04-26T11:14:15.039 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7530000000000001e-06 2024-04-26T11:14:15.039 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.039 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.039 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.040 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.023093+0000", 2024-04-26T11:14:15.040 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1658000000000001e-05 2024-04-26T11:14:15.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.040 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.040 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.040 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.023105+0000", 2024-04-26T11:14:15.040 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1790999999999999e-05 2024-04-26T11:14:15.040 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.040 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.040 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.040 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.040 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:92440 5.1 5:85a5670e:::benchmark_data_smithi029_44842_object92439:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:15.040 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:15.024284+0000", 2024-04-26T11:14:15.040 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0025324649999999998, 2024-04-26T11:14:15.041 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002796209, 2024-04-26T11:14:15.041 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.041 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:15.041 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.041 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.041 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.041 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 92440 2024-04-26T11:14:15.041 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.041 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.041 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.041 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.041 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.024284+0000", 2024-04-26T11:14:15.041 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.041 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.041 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.042 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.042 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.024284+0000", 2024-04-26T11:14:15.042 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.042 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.042 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.042 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.024283+0000", 2024-04-26T11:14:15.042 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:15.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.042 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.042 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.042 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.024371+0000", 2024-04-26T11:14:15.042 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7367000000000006e-05 2024-04-26T11:14:15.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.043 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.043 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.043 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.024382+0000", 2024-04-26T11:14:15.043 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0828e-05 2024-04-26T11:14:15.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.043 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.043 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.043 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.024389+0000", 2024-04-26T11:14:15.043 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7789999999999996e-06 2024-04-26T11:14:15.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.043 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.043 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.043 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.024439+0000", 2024-04-26T11:14:15.043 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.9302000000000003e-05 2024-04-26T11:14:15.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.044 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.044 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.044 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.024579+0000", 2024-04-26T11:14:15.044 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013993499999999999 2024-04-26T11:14:15.044 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.044 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.044 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.044 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.044 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.044 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:92441 5.8 e34/16 5:16758707:::benchmark_data_smithi029_44842_object92440:head v 34'5841, mlcod=34'5839)", 2024-04-26T11:14:15.044 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:15.025374+0000", 2024-04-26T11:14:15.044 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00144225, 2024-04-26T11:14:15.044 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0017705419999999999, 2024-04-26T11:14:15.044 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.045 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:15.045 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.045 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.045 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.045 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.025374+0000", 2024-04-26T11:14:15.045 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.045 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.045 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.045 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.045 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.025374+0000", 2024-04-26T11:14:15.045 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.045 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.045 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.045 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.046 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.025374+0000", 2024-04-26T11:14:15.046 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.046 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.046 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.046 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.025441+0000", 2024-04-26T11:14:15.046 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7016999999999999e-05 2024-04-26T11:14:15.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.046 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.046 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.046 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.025457+0000", 2024-04-26T11:14:15.046 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5923e-05 2024-04-26T11:14:15.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.046 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.047 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.047 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.025463+0000", 2024-04-26T11:14:15.047 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5019999999999998e-06 2024-04-26T11:14:15.047 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.047 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.047 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.047 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.025495+0000", 2024-04-26T11:14:15.047 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2005999999999998e-05 2024-04-26T11:14:15.047 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.047 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.047 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.047 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.025507+0000", 2024-04-26T11:14:15.047 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2259000000000001e-05 2024-04-26T11:14:15.047 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.047 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.048 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.048 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.048 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.048 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:92442 5.3 5:cdab2b15:::benchmark_data_smithi029_44842_object92441:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:15.048 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:15.025485+0000", 2024-04-26T11:14:15.048 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.001331849, 2024-04-26T11:14:15.048 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001721036, 2024-04-26T11:14:15.048 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.048 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:15.048 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.048 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.048 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.048 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 92442 2024-04-26T11:14:15.048 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.049 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.049 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.049 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.049 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.025485+0000", 2024-04-26T11:14:15.049 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.049 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.049 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.049 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.049 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.025485+0000", 2024-04-26T11:14:15.049 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.049 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.049 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.049 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.049 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.025484+0000", 2024-04-26T11:14:15.049 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:15.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.050 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.050 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.050 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.025512+0000", 2024-04-26T11:14:15.050 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8212999999999999e-05 2024-04-26T11:14:15.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.050 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.050 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.050 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.025521+0000", 2024-04-26T11:14:15.050 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2029999999999998e-06 2024-04-26T11:14:15.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.050 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.050 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.050 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.025530+0000", 2024-04-26T11:14:15.050 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3270000000000001e-06 2024-04-26T11:14:15.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.051 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.051 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.051 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.025565+0000", 2024-04-26T11:14:15.051 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5034999999999999e-05 2024-04-26T11:14:15.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.051 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.051 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.051 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.025675+0000", 2024-04-26T11:14:15.051 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011016 2024-04-26T11:14:15.051 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.051 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.051 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.051 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.052 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:92443 5.c 5:331ea80a:::benchmark_data_smithi029_44842_object92442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:15.052 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:15.025902+0000", 2024-04-26T11:14:15.052 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00091461600000000004, 2024-04-26T11:14:15.052 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0013742959999999999, 2024-04-26T11:14:15.052 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.052 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:15.052 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.052 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.052 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.052 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 92443 2024-04-26T11:14:15.052 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.052 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.052 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.052 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.052 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.025902+0000", 2024-04-26T11:14:15.053 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.053 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.053 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.053 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.053 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.025902+0000", 2024-04-26T11:14:15.053 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.053 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.053 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.053 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.053 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.025901+0000", 2024-04-26T11:14:15.053 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.053 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.053 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.053 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.054 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.025983+0000", 2024-04-26T11:14:15.054 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.1382000000000001e-05 2024-04-26T11:14:15.054 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.054 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.054 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.054 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.025998+0000", 2024-04-26T11:14:15.054 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4839e-05 2024-04-26T11:14:15.054 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.054 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.054 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.054 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026005+0000", 2024-04-26T11:14:15.054 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4340000000000003e-06 2024-04-26T11:14:15.054 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.055 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.055 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.055 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026090+0000", 2024-04-26T11:14:15.055 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5002999999999999e-05 2024-04-26T11:14:15.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.055 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.055 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.055 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026242+0000", 2024-04-26T11:14:15.055 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000152232 2024-04-26T11:14:15.055 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.055 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.055 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.055 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.056 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:92447 5.2 5:4fa94a6e:::benchmark_data_smithi029_44842_object92446:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:15.056 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:15.026017+0000", 2024-04-26T11:14:15.056 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00080002100000000004, 2024-04-26T11:14:15.056 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0013283979999999999, 2024-04-26T11:14:15.056 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.056 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:15.056 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.056 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.056 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.056 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 92447 2024-04-26T11:14:15.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.056 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.056 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.056 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.057 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026017+0000", 2024-04-26T11:14:15.057 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.057 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.057 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.057 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.057 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026017+0000", 2024-04-26T11:14:15.057 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.057 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.057 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.057 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.057 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026016+0000", 2024-04-26T11:14:15.057 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.057 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.057 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.058 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.058 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026118+0000", 2024-04-26T11:14:15.058 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000101969 2024-04-26T11:14:15.058 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.058 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.058 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.058 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026127+0000", 2024-04-26T11:14:15.058 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7439999999999996e-06 2024-04-26T11:14:15.058 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.058 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.058 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.058 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026133+0000", 2024-04-26T11:14:15.058 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.319e-06 2024-04-26T11:14:15.058 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.059 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.059 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.059 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026170+0000", 2024-04-26T11:14:15.059 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6835000000000002e-05 2024-04-26T11:14:15.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.059 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.059 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.059 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026267+0000", 2024-04-26T11:14:15.059 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6555e-05 2024-04-26T11:14:15.059 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.059 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.059 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.059 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.059 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:92451 5.3 5.8e5b6663 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:15.060 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:15.026271+0000", 2024-04-26T11:14:15.060 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00054528499999999995, 2024-04-26T11:14:15.060 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0011351930000000001, 2024-04-26T11:14:15.060 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.060 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:15.060 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.060 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.060 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.060 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 92451 2024-04-26T11:14:15.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.060 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.060 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.060 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.060 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026271+0000", 2024-04-26T11:14:15.060 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.061 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.061 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.061 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.061 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026271+0000", 2024-04-26T11:14:15.061 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.061 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.061 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.061 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.061 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026271+0000", 2024-04-26T11:14:15.061 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.061 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.061 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.061 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.061 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026393+0000", 2024-04-26T11:14:15.062 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000122421 2024-04-26T11:14:15.062 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.062 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.062 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.062 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026401+0000", 2024-04-26T11:14:15.062 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7950000000000008e-06 2024-04-26T11:14:15.062 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.062 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.062 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.062 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026407+0000", 2024-04-26T11:14:15.062 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1809999999999998e-06 2024-04-26T11:14:15.062 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.062 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.063 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.063 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.063 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:92446 5.a e34/31 5:54858ab9:::benchmark_data_smithi029_44842_object92445:head v 34'5945, mlcod=34'5943)", 2024-04-26T11:14:15.063 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:15.026679+0000", 2024-04-26T11:14:15.063 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00013770699999999999, 2024-04-26T11:14:15.063 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00078744500000000001, 2024-04-26T11:14:15.063 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.063 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:15.063 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.063 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.063 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.063 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026679+0000", 2024-04-26T11:14:15.063 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.064 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.064 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.064 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026679+0000", 2024-04-26T11:14:15.064 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.064 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.064 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.064 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.064 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026678+0000", 2024-04-26T11:14:15.064 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.064 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.064 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.064 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.064 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026743+0000", 2024-04-26T11:14:15.064 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4649999999999999e-05 2024-04-26T11:14:15.065 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.065 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.065 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.065 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026754+0000", 2024-04-26T11:14:15.065 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0841e-05 2024-04-26T11:14:15.065 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.065 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.065 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.065 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026760+0000", 2024-04-26T11:14:15.065 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2840000000000003e-06 2024-04-26T11:14:15.065 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.065 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.065 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.065 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026796+0000", 2024-04-26T11:14:15.065 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6214999999999998e-05 2024-04-26T11:14:15.066 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.066 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.066 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.066 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026814+0000", 2024-04-26T11:14:15.066 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7991000000000001e-05 2024-04-26T11:14:15.066 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.066 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.066 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.066 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.066 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.066 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:92448 5.b e34/16)", 2024-04-26T11:14:15.066 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:15.026784+0000", 2024-04-26T11:14:15.066 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 3.2181999999999998e-05, 2024-04-26T11:14:15.066 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000735883, 2024-04-26T11:14:15.066 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.067 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:15.067 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.067 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.067 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.067 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026784+0000", 2024-04-26T11:14:15.067 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.067 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.067 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.067 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.067 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026784+0000", 2024-04-26T11:14:15.067 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.067 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.067 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.067 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.067 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026784+0000", 2024-04-26T11:14:15.068 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.068 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.068 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.068 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026856+0000", 2024-04-26T11:14:15.068 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2306999999999997e-05 2024-04-26T11:14:15.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.068 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.068 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.068 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026865+0000", 2024-04-26T11:14:15.068 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.1780000000000003e-06 2024-04-26T11:14:15.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.068 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.068 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.068 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.026870+0000", 2024-04-26T11:14:15.069 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7760000000000003e-06 2024-04-26T11:14:15.069 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.069 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.069 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.069 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.069 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.069 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:92452 5.3 5.c8c6e463 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:15.069 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:15.027266+0000", 2024-04-26T11:14:15.069 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9995508, 2024-04-26T11:14:15.069 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00030299, 2024-04-26T11:14:15.069 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.069 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:15.069 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.069 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.070 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.070 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 92452 2024-04-26T11:14:15.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.070 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.070 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.070 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.070 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.027266+0000", 2024-04-26T11:14:15.070 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.070 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.070 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.070 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.027266+0000", 2024-04-26T11:14:15.070 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.071 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.071 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.071 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.027265+0000", 2024-04-26T11:14:15.071 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:15.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.071 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.071 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.071 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.027334+0000", 2024-04-26T11:14:15.071 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8767000000000001e-05 2024-04-26T11:14:15.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.071 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.071 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.071 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.027343+0000", 2024-04-26T11:14:15.071 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2220000000000008e-06 2024-04-26T11:14:15.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.072 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.072 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.072 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:15.027352+0000", 2024-04-26T11:14:15.072 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3720000000000005e-06 2024-04-26T11:14:15.072 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.072 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.072 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.072 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.072 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:14:15.072 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 12 2024-04-26T11:14:15.072 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:15.074 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:15.074 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:15.072+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:15.174 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:15.174+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:15.275 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:15.274+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:15.295 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:15.296 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:14:15.296 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:14:15.296 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:14:15.296 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:15.309 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:15.395 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:15.393+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:15.413 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 37 16 93312 93296 157.58 142.5 0.00696637 0.00634301 2024-04-26T11:14:15.477 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:15.476+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:15.531 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:15.531 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:14:15.532 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:14:15.532 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:15.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.532 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:15.532 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:15.532 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 22.257901337, 2024-04-26T11:14:15.532 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:14:15.532 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.532 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:15.532 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.532 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.532 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.532 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:14:15.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.532 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.533 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:15.533 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.533 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:15.533 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.534 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.534 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:14:15.534 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.534 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.534 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:14:15.534 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:14:15.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.534 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.535 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:14:15.535 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:14:15.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.535 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.535 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.535 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:14:15.535 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:14:15.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.535 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.535 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.535 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:14:15.536 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:14:15.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.536 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.536 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.536 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:14:15.536 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:14:15.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.536 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.536 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:15.536 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:14:15.536 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:14:15.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.537 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:15.537 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:14:15.537 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:14:15.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.537 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:15.537 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:14:15.537 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:14:15.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.537 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:15.538 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:14:15.538 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:14:15.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.538 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:15.538 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:14:15.538 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:14:15.538 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.538 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.538 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.538 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:15.538 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:15.539 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 22.257089772, 2024-04-26T11:14:15.539 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:14:15.539 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.539 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:15.539 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.539 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.539 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.539 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:14:15.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.539 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.539 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.539 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:15.539 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.540 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.540 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:15.540 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.540 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.540 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:15.540 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:15.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.540 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.540 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:14:15.540 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:14:15.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.541 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.541 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:14:15.541 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:14:15.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.541 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.541 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:14:15.541 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:14:15.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.541 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.541 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:14:15.541 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:14:15.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.542 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.542 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:14:15.542 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:14:15.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.542 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.542 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:15.542 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:14:15.542 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:14:15.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.542 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.542 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:15.542 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:14:15.542 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:14:15.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.543 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.543 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:15.543 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:14:15.543 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:14:15.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.543 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.543 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:15.543 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:14:15.543 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:14:15.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.543 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.543 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:15.543 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:14:15.543 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:14:15.543 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.544 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.544 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.544 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.544 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:15.544 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:15.544 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 22.249902935000001, 2024-04-26T11:14:15.544 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:14:15.544 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.545 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:15.545 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.545 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.545 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.545 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:14:15.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.545 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.545 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.545 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.545 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:15.545 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.545 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.545 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.545 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:15.546 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.546 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.546 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.546 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:14:15.546 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:15.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.546 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.546 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.546 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:14:15.546 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:14:15.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.546 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.546 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.547 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:14:15.547 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:14:15.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.547 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.547 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:14:15.547 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:14:15.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.547 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.547 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:14:15.547 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:14:15.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.547 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.548 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:14:15.548 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:14:15.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.548 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.548 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:15.548 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:14:15.548 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:14:15.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.548 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.548 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:15.548 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:14:15.548 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:14:15.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.548 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.548 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:15.548 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:14:15.549 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:14:15.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.549 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.549 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:15.549 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:14:15.549 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:14:15.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.549 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.549 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:15.549 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:14:15.549 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:14:15.549 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.549 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.549 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.550 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.550 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:15.550 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:15.550 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 22.249362055999999, 2024-04-26T11:14:15.550 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:14:15.550 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.550 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:15.550 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.550 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.551 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.551 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:14:15.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.551 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.551 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.551 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.551 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:15.551 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.552 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.552 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.552 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:15.552 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.552 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.553 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.553 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:15.553 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.553 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.553 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.554 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:14:15.554 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:14:15.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.554 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.554 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.554 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:14:15.555 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:14:15.555 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.555 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.555 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.555 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:14:15.555 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:14:15.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.556 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.556 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.556 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:14:15.556 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:14:15.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.556 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.556 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.557 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:14:15.557 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:14:15.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.557 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.557 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:15.557 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:14:15.557 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:14:15.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.557 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.558 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:15.558 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:14:15.558 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:14:15.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.558 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.558 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:15.559 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:14:15.559 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:14:15.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.559 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.559 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:15.559 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:14:15.559 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:14:15.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.560 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.560 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:15.560 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:14:15.560 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:14:15.560 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.560 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.561 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.561 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.561 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:55119 5.6 5:6ad50111:::benchmark_data_smithi029_44842_object55118:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:15.561 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:15.561 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 18.768298401999999, 2024-04-26T11:14:15.561 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018830264999999999, 2024-04-26T11:14:15.561 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.561 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:15.561 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.561 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.561 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.562 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 55119 2024-04-26T11:14:15.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.562 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.562 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.562 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.562 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:15.562 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.562 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.562 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.562 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:15.562 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.562 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.563 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.563 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760349+0000", 2024-04-26T11:14:15.563 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:15.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.563 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.563 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.563 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760402+0000", 2024-04-26T11:14:15.563 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2695999999999998e-05 2024-04-26T11:14:15.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.563 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.563 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.563 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760411+0000", 2024-04-26T11:14:15.563 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.0589999999999992e-06 2024-04-26T11:14:15.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.563 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.564 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.564 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760416+0000", 2024-04-26T11:14:15.564 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.587e-06 2024-04-26T11:14:15.564 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.564 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.564 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.564 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767638+0000", 2024-04-26T11:14:15.564 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0072214050000000002 2024-04-26T11:14:15.564 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.564 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.564 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.564 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767760+0000", 2024-04-26T11:14:15.565 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000122067 2024-04-26T11:14:15.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.565 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.565 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:15.565 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767927+0000", 2024-04-26T11:14:15.565 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00016747999999999999 2024-04-26T11:14:15.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.565 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.565 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:15.565 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.770877+0000", 2024-04-26T11:14:15.566 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002949335 2024-04-26T11:14:15.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.566 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.566 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:15.566 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779130+0000", 2024-04-26T11:14:15.566 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.008253491 2024-04-26T11:14:15.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.566 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.566 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:15.566 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779158+0000", 2024-04-26T11:14:15.566 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7849000000000001e-05 2024-04-26T11:14:15.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.567 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.567 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:15.567 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779180+0000", 2024-04-26T11:14:15.567 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2048999999999998e-05 2024-04-26T11:14:15.567 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.567 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.567 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.567 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.567 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:15.567 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:15.567 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 18.206177609000001, 2024-04-26T11:14:15.567 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:14:15.567 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.568 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:15.568 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.568 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.568 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.568 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:14:15.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.568 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.568 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.568 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.568 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:15.568 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.568 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.568 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.568 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:15.569 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.569 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.569 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.569 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:14:15.569 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:15.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.569 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.569 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.569 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:14:15.569 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:14:15.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.569 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.569 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.569 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:14:15.569 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:14:15.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.570 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.570 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.570 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:14:15.570 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:14:15.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.570 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.570 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.570 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:14:15.570 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:14:15.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.570 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.570 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.570 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:14:15.571 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:14:15.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.571 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.571 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:15.571 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:14:15.571 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:14:15.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.571 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.571 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:15.571 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:14:15.571 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:14:15.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.571 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.571 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.571 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:14:15.571 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:14:15.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.572 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.572 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:15.572 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:14:15.572 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:14:15.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.572 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.572 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.572 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:14:15.572 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:14:15.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.572 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.572 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:15.572 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:14:15.573 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:14:15.573 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.573 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.573 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.573 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.573 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.573 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:15.574 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:15.574 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 18.203984268999999, 2024-04-26T11:14:15.574 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:14:15.574 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.574 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:15.574 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.574 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.575 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.575 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:14:15.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.575 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.575 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.575 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.575 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:15.575 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.575 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.575 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.575 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:15.575 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.575 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.575 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.576 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:14:15.576 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:15.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.576 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.576 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.576 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:14:15.576 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:14:15.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.576 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.577 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.577 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:14:15.577 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:14:15.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.577 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.577 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.577 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:14:15.577 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:14:15.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.577 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.577 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.577 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:14:15.577 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:14:15.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.577 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.577 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.578 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:14:15.578 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:14:15.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.578 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.578 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:15.578 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:14:15.578 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:14:15.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.578 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.578 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:15.578 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:14:15.578 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:14:15.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.579 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.579 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.579 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:14:15.579 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:14:15.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.579 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.579 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:15.579 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:14:15.579 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:14:15.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.579 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.579 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.579 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:14:15.579 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:14:15.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.580 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.580 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:15.580 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:14:15.580 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:14:15.580 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.580 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.580 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.580 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.580 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:15.580 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:15.580 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 18.198772444999999, 2024-04-26T11:14:15.580 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:14:15.580 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.580 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:15.581 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.581 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.581 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.581 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:14:15.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.581 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.581 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.581 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.581 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:15.581 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.581 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.581 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.581 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:15.581 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.582 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.582 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.582 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:14:15.582 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:15.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.582 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.582 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.582 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:14:15.582 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:14:15.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.582 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.582 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.582 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:14:15.583 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:14:15.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.583 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.583 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.583 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:14:15.583 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:14:15.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.583 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.583 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.583 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:14:15.583 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:14:15.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.583 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.583 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.583 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:14:15.584 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:14:15.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.584 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.584 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:15.584 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:14:15.584 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:14:15.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.584 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.584 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:15.584 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:14:15.584 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:14:15.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.584 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.584 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.584 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:14:15.584 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:14:15.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.585 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:15.585 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:14:15.585 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:14:15.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.585 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.585 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:14:15.585 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:14:15.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.585 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:15.585 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:14:15.585 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:14:15.586 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.586 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.586 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.586 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.586 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:15.586 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:15.586 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 18.182323745000001, 2024-04-26T11:14:15.586 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:14:15.586 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.586 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:15.587 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.587 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.587 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.587 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:14:15.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.587 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.587 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.587 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.587 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:15.587 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.587 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.588 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.588 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:15.588 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.588 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.588 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:14:15.588 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:15.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.588 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.588 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:14:15.588 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:14:15.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.589 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.589 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:14:15.589 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:14:15.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.589 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.589 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:14:15.590 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:14:15.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.590 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.590 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.590 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:14:15.590 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:14:15.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.590 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.590 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:15.591 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:14:15.591 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:14:15.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.591 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.591 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:14:15.591 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:14:15.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.592 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:15.592 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:14:15.592 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:14:15.592 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.592 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.592 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.592 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:15.593 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:15.593 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 18.180626239999999, 2024-04-26T11:14:15.593 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:14:15.593 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.593 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:15.593 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.593 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.593 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.593 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:14:15.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.594 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.594 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.594 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.594 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:15.594 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.594 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.594 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.595 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:15.595 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.595 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.595 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.595 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:14:15.595 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:15.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.596 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.596 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.596 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:14:15.596 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:14:15.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.596 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.596 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.596 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:14:15.596 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:14:15.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.597 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.597 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.597 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:14:15.597 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:14:15.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.597 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.597 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.597 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:14:15.598 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:14:15.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.598 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.598 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:15.598 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:14:15.598 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:14:15.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.598 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.598 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.599 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:14:15.599 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:14:15.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.599 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.599 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:15.599 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:14:15.599 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:14:15.599 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.599 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.600 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.600 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.600 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:15.600 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:15.600 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 18.180561938, 2024-04-26T11:14:15.600 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:14:15.600 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.600 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:15.601 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.601 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.601 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.601 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:14:15.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.601 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.601 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.601 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.601 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:15.602 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.602 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.602 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.602 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:15.602 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.602 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.603 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.603 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:15.603 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.603 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.603 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:14:15.603 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:14:15.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.603 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.604 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:14:15.604 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:14:15.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.604 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.604 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:14:15.604 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:14:15.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.604 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.604 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:14:15.604 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:14:15.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.604 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:15.605 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:14:15.605 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:14:15.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.605 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.605 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.605 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:14:15.605 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:14:15.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.605 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.605 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.605 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:14:15.605 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:14:15.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.605 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.605 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:15.606 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:14:15.606 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:14:15.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.606 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.606 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:15.606 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:14:15.606 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:14:15.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.606 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.606 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:15.606 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:14:15.606 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:14:15.606 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.606 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.607 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.607 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.607 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:15.607 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:15.607 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 18.180507714000001, 2024-04-26T11:14:15.607 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:14:15.607 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.607 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:15.607 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.607 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.607 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.607 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:14:15.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.608 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.608 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.608 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.608 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:15.609 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.610 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.610 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.610 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:15.610 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.611 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.611 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.611 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:15.611 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.612 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.612 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.612 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:14:15.612 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:14:15.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.612 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.613 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.613 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:14:15.613 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:14:15.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.613 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.613 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.613 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:14:15.613 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:14:15.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.613 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.613 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.614 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:14:15.614 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:14:15.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.614 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.614 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:15.614 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:14:15.614 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:14:15.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.615 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.615 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.615 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:14:15.615 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:14:15.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.615 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.615 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.615 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:14:15.615 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:14:15.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.615 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.615 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:15.616 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:14:15.616 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:14:15.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.616 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.616 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:15.616 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:14:15.616 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:15.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.616 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.616 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:15.616 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:14:15.617 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:14:15.617 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.617 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.617 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.617 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.617 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:15.617 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:15.617 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 18.180463201999999, 2024-04-26T11:14:15.617 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:14:15.617 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.617 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:15.617 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.617 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.617 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.617 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:14:15.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.618 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.618 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.618 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.618 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:15.618 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.618 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.618 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.618 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:15.618 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.618 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.618 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.619 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:14:15.619 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.619 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.619 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.619 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:14:15.619 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:14:15.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.619 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.619 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.619 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:14:15.619 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:14:15.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.619 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.619 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.620 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:14:15.620 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:14:15.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.620 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.620 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.620 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:14:15.620 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:14:15.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.620 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.620 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:15.620 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:14:15.620 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:14:15.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.620 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.620 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.620 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:14:15.621 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:14:15.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.621 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.621 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.621 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:14:15.621 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:14:15.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.621 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.621 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:15.621 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:14:15.621 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:14:15.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.621 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.621 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:15.621 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:14:15.622 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:14:15.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.622 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.622 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:15.622 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:14:15.622 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:14:15.622 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.622 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.622 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.622 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.622 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:15.622 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:15.622 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 18.176242200000001, 2024-04-26T11:14:15.622 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:14:15.623 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.623 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:15.623 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.623 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.623 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.623 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:14:15.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.623 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.623 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.623 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.623 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:15.623 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.623 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.623 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.624 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:15.624 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.624 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.624 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.624 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:14:15.624 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:14:15.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.624 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.624 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.624 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:14:15.624 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:14:15.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.624 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.624 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.624 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:14:15.625 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:14:15.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.625 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.625 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.625 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:14:15.625 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:14:15.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.625 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.625 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.625 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:14:15.625 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:14:15.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.625 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.625 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:15.625 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:14:15.625 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:14:15.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.626 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.626 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.626 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:14:15.626 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:14:15.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.626 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.626 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.626 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:14:15.626 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:14:15.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.626 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.626 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:15.626 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:14:15.626 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:14:15.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.627 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.627 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:15.627 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:14:15.627 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:14:15.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.627 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.627 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:15.627 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:14:15.627 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:14:15.627 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.627 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.627 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.628 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:61817 5.a 5:5627ce7f:::benchmark_data_smithi029_44842_object61816:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:15.628 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:15.628 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 14.826116747, 2024-04-26T11:14:15.628 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020626958000000001, 2024-04-26T11:14:15.628 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.628 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:15.628 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.628 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.628 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.628 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 61817 2024-04-26T11:14:15.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.628 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.629 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.629 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:15.629 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.629 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.629 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.629 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:15.629 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.629 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.629 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.629 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:15.629 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.629 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.630 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.630 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702591+0000", 2024-04-26T11:14:15.630 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0665999999999998e-05 2024-04-26T11:14:15.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.630 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.630 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702599+0000", 2024-04-26T11:14:15.630 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7130000000000005e-06 2024-04-26T11:14:15.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.630 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.630 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702605+0000", 2024-04-26T11:14:15.630 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4310000000000002e-06 2024-04-26T11:14:15.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.631 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.707947+0000", 2024-04-26T11:14:15.631 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053424220000000003 2024-04-26T11:14:15.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.631 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.708052+0000", 2024-04-26T11:14:15.631 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010499 2024-04-26T11:14:15.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:14:15.631 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.708141+0000", 2024-04-26T11:14:15.631 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9514999999999999e-05 2024-04-26T11:14:15.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:15.632 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.711954+0000", 2024-04-26T11:14:15.632 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003812265 2024-04-26T11:14:15.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.632 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.632 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:15.632 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723070+0000", 2024-04-26T11:14:15.632 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011116727 2024-04-26T11:14:15.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.632 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.632 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:15.632 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723121+0000", 2024-04-26T11:14:15.632 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0362999999999999e-05 2024-04-26T11:14:15.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.632 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.632 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:15.633 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723158+0000", 2024-04-26T11:14:15.633 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7579000000000001e-05 2024-04-26T11:14:15.633 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.633 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.633 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.633 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:75771 5.c 5:3cc8f1b4:::benchmark_data_smithi029_44842_object75770:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T11:14:15.633 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:15.633 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.7756724039999998, 2024-04-26T11:14:15.633 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019437949, 2024-04-26T11:14:15.633 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.633 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:15.633 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.633 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.633 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.634 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 75771 2024-04-26T11:14:15.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.634 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.634 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.634 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:15.634 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.634 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.634 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:15.634 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.635 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.635 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752975+0000", 2024-04-26T11:14:15.635 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:15.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.635 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.635 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.635 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753061+0000", 2024-04-26T11:14:15.635 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5890999999999995e-05 2024-04-26T11:14:15.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.635 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.635 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.635 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753071+0000", 2024-04-26T11:14:15.635 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.9990000000000003e-06 2024-04-26T11:14:15.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.636 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.636 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753078+0000", 2024-04-26T11:14:15.636 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1559999999999998e-06 2024-04-26T11:14:15.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.636 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.636 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.758559+0000", 2024-04-26T11:14:15.636 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0054812819999999996 2024-04-26T11:14:15.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.636 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.636 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.758692+0000", 2024-04-26T11:14:15.636 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000133301 2024-04-26T11:14:15.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.637 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:15.637 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772277+0000", 2024-04-26T11:14:15.637 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.013584839 2024-04-26T11:14:15.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.637 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:15.637 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772340+0000", 2024-04-26T11:14:15.637 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2360999999999995e-05 2024-04-26T11:14:15.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.637 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:15.638 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772414+0000", 2024-04-26T11:14:15.638 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4024999999999997e-05 2024-04-26T11:14:15.638 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.638 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.638 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.638 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.638 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83359 5.2 5:4939888c:::benchmark_data_smithi029_44842_object83358:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:15.638 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:15.638 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.4890818189999999, 2024-04-26T11:14:15.638 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018705583000000001, 2024-04-26T11:14:15.638 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.639 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:15.639 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.639 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.639 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.639 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83359 2024-04-26T11:14:15.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.639 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.640 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.640 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.640 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:15.640 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.640 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.640 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.641 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:15.641 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.641 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.641 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.641 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:15.642 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.642 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.642 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.642 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.642 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039625+0000", 2024-04-26T11:14:15.642 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9162e-05 2024-04-26T11:14:15.642 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.643 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.643 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.643 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039632+0000", 2024-04-26T11:14:15.643 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5399999999999998e-06 2024-04-26T11:14:15.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.643 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.644 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.644 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039638+0000", 2024-04-26T11:14:15.644 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1850000000000003e-06 2024-04-26T11:14:15.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.644 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.644 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.644 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.042375+0000", 2024-04-26T11:14:15.645 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0027371510000000002 2024-04-26T11:14:15.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.645 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.645 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.042502+0000", 2024-04-26T11:14:15.645 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000126966 2024-04-26T11:14:15.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.646 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.646 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:15.646 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058154+0000", 2024-04-26T11:14:15.646 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015652657 2024-04-26T11:14:15.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.646 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.647 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:15.647 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058201+0000", 2024-04-26T11:14:15.647 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6579000000000002e-05 2024-04-26T11:14:15.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.647 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.647 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:15.647 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058272+0000", 2024-04-26T11:14:15.648 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1009999999999999e-05 2024-04-26T11:14:15.648 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.648 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.648 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.648 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.649 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83360 5.2 5:42f8bfcd:::benchmark_data_smithi029_44842_object83359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:15.649 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:15.649 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.4890028300000004, 2024-04-26T11:14:15.649 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022279782000000001, 2024-04-26T11:14:15.649 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.649 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:15.649 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.649 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.649 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.649 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83360 2024-04-26T11:14:15.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.650 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.650 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.650 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.650 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:15.650 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.651 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.651 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.651 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:15.651 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.652 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:15.652 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.653 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.653 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039700+0000", 2024-04-26T11:14:15.653 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5541000000000002e-05 2024-04-26T11:14:15.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.653 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.654 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039706+0000", 2024-04-26T11:14:15.654 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3680000000000001e-06 2024-04-26T11:14:15.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.654 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.654 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.654 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039709+0000", 2024-04-26T11:14:15.655 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4659999999999999e-06 2024-04-26T11:14:15.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.655 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.655 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.655 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056305+0000", 2024-04-26T11:14:15.655 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016595649000000001 2024-04-26T11:14:15.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.656 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.656 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056487+0000", 2024-04-26T11:14:15.656 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000181886 2024-04-26T11:14:15.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.657 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:15.657 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061809+0000", 2024-04-26T11:14:15.657 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053223259999999996 2024-04-26T11:14:15.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.657 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:15.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061852+0000", 2024-04-26T11:14:15.658 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2738999999999999e-05 2024-04-26T11:14:15.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.658 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:15.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061925+0000", 2024-04-26T11:14:15.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3180000000000001e-05 2024-04-26T11:14:15.659 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.659 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.659 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.660 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83364 5.2 5:42c5cd8c:::benchmark_data_smithi029_44842_object83363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:15.660 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:15.660 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.4885870900000002, 2024-04-26T11:14:15.660 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022695336, 2024-04-26T11:14:15.660 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.660 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:15.661 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.661 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.661 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.661 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83364 2024-04-26T11:14:15.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.661 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.661 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.662 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.662 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:15.662 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.662 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.663 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:15.663 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.663 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.663 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040060+0000", 2024-04-26T11:14:15.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.664 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.664 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040086+0000", 2024-04-26T11:14:15.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5482000000000001e-05 2024-04-26T11:14:15.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.665 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.665 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040093+0000", 2024-04-26T11:14:15.665 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6409999999999996e-06 2024-04-26T11:14:15.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.666 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.666 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040098+0000", 2024-04-26T11:14:15.666 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879999999999996e-06 2024-04-26T11:14:15.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.666 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.666 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.667 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058292+0000", 2024-04-26T11:14:15.667 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018193504999999999 2024-04-26T11:14:15.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.667 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.667 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.667 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058412+0000", 2024-04-26T11:14:15.668 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011979199999999999 2024-04-26T11:14:15.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.668 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:15.668 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062642+0000", 2024-04-26T11:14:15.668 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042299449999999997 2024-04-26T11:14:15.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:15.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062688+0000", 2024-04-26T11:14:15.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6859e-05 2024-04-26T11:14:15.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:15.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062756+0000", 2024-04-26T11:14:15.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7995000000000002e-05 2024-04-26T11:14:15.669 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83378 5.2 5:44b3209a:::benchmark_data_smithi029_44842_object83377:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.4808666370000001, 2024-04-26T11:14:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020722529, 2024-04-26T11:14:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.670 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83378 2024-04-26T11:14:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:15.671 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047781+0000", 2024-04-26T11:14:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047832+0000", 2024-04-26T11:14:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1687000000000002e-05 2024-04-26T11:14:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047842+0000", 2024-04-26T11:14:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2439999999999999e-06 2024-04-26T11:14:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047847+0000", 2024-04-26T11:14:15.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6500000000000001e-06 2024-04-26T11:14:15.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:15.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.060082+0000", 2024-04-26T11:14:15.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.012235105 2024-04-26T11:14:15.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:15.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.060191+0000", 2024-04-26T11:14:15.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000108665 2024-04-26T11:14:15.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:15.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068363+0000", 2024-04-26T11:14:15.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0081715829999999996 2024-04-26T11:14:15.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.674 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:15.674 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068418+0000", 2024-04-26T11:14:15.674 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4984000000000001e-05 2024-04-26T11:14:15.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:15.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:15.674 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:15.674 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068504+0000", 2024-04-26T11:14:15.674 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6520000000000005e-05 2024-04-26T11:14:15.674 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.674 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.674 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.674 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:15.674 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:15.675 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:15.676 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:15.675+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:15.677 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is set 2024-04-26T11:14:15.677 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:15.776 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:14:15.778 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:15.776+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:15.845 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:94273 5.d 5:bf2c1708:::benchmark_data_smithi029_44842_object94272:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:15.835228+0000", 2024-04-26T11:14:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0070166409999999997, 2024-04-26T11:14:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0070465689999999999, 2024-04-26T11:14:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.845 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 94273 2024-04-26T11:14:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.835228+0000", 2024-04-26T11:14:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.835228+0000", 2024-04-26T11:14:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:15.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.835227+0000", 2024-04-26T11:14:15.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:15.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:15.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.835300+0000", 2024-04-26T11:14:15.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3082000000000003e-05 2024-04-26T11:14:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.835313+0000", 2024-04-26T11:14:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2309e-05 2024-04-26T11:14:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.835320+0000", 2024-04-26T11:14:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8539999999999997e-06 2024-04-26T11:14:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:15.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.835365+0000", 2024-04-26T11:14:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4441999999999999e-05 2024-04-26T11:14:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.835498+0000", 2024-04-26T11:14:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013306599999999999 2024-04-26T11:14:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:94274 5.4 5:22ad4cde:::benchmark_data_smithi029_44842_object94273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:15.835332+0000", 2024-04-26T11:14:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0069121740000000001, 2024-04-26T11:14:15.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0070335839999999998, 2024-04-26T11:14:15.850 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:15.850 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:15.850 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:15.850 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:15.850 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.850 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 94274 2024-04-26T11:14:15.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.850 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:15.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:15.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.835332+0000", 2024-04-26T11:14:15.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:15.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.835332+0000", 2024-04-26T11:14:15.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:15.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.835332+0000", 2024-04-26T11:14:15.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:15.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.835360+0000", 2024-04-26T11:14:15.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8229999999999999e-05 2024-04-26T11:14:15.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:15.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.835368+0000", 2024-04-26T11:14:15.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8650000000000001e-06 2024-04-26T11:14:15.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.835374+0000", 2024-04-26T11:14:15.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0499999999999997e-06 2024-04-26T11:14:15.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:15.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.835407+0000", 2024-04-26T11:14:15.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2793999999999998e-05 2024-04-26T11:14:15.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:15.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.835528+0000", 2024-04-26T11:14:15.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012086099999999999 2024-04-26T11:14:15.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:15.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.835666+0000", 2024-04-26T11:14:15.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013793400000000001 2024-04-26T11:14:15.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:15.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.839603+0000", 2024-04-26T11:14:15.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039378019999999998 2024-04-26T11:14:15.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:15.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842322+0000", 2024-04-26T11:14:15.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002718214 2024-04-26T11:14:15.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:15.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842369+0000", 2024-04-26T11:14:15.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6925000000000002e-05 2024-04-26T11:14:15.855 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.855 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:15.855 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.855 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:94276 5.a 5:51b75754:::benchmark_data_smithi029_44842_object94275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:15.855 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:15.837042+0000", 2024-04-26T11:14:15.855 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0052031009999999999, 2024-04-26T11:14:15.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054372980000000001, 2024-04-26T11:14:15.856 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:15.856 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:15.856 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:15.856 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:15.856 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.856 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 94276 2024-04-26T11:14:15.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.856 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:15.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:15.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.837042+0000", 2024-04-26T11:14:15.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:15.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.837042+0000", 2024-04-26T11:14:15.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:15.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.837041+0000", 2024-04-26T11:14:15.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:15.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:15.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.837089+0000", 2024-04-26T11:14:15.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8817999999999999e-05 2024-04-26T11:14:15.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:15.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.837099+0000", 2024-04-26T11:14:15.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2969999999999992e-06 2024-04-26T11:14:15.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.837105+0000", 2024-04-26T11:14:15.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8250000000000001e-06 2024-04-26T11:14:15.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:15.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.837143+0000", 2024-04-26T11:14:15.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8337000000000002e-05 2024-04-26T11:14:15.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:15.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.837282+0000", 2024-04-26T11:14:15.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013928899999999999 2024-04-26T11:14:15.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:15.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.837432+0000", 2024-04-26T11:14:15.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014999499999999999 2024-04-26T11:14:15.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:15.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.839704+0000", 2024-04-26T11:14:15.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022715700000000001 2024-04-26T11:14:15.860 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.860 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:15.861 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.861 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:94277 5.9 5:971de59d:::benchmark_data_smithi029_44842_object94276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:15.861 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:15.838691+0000", 2024-04-26T11:14:15.861 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0035536629999999999, 2024-04-26T11:14:15.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038777630000000002, 2024-04-26T11:14:15.861 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:15.861 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:15.861 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:15.861 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:15.861 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.861 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 94277 2024-04-26T11:14:15.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.862 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:15.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:15.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.838691+0000", 2024-04-26T11:14:15.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:15.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.838691+0000", 2024-04-26T11:14:15.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:15.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.838690+0000", 2024-04-26T11:14:15.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:15.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.838763+0000", 2024-04-26T11:14:15.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2538000000000002e-05 2024-04-26T11:14:15.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:15.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.838770+0000", 2024-04-26T11:14:15.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7120000000000003e-06 2024-04-26T11:14:15.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.838774+0000", 2024-04-26T11:14:15.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7190000000000001e-06 2024-04-26T11:14:15.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:15.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.838804+0000", 2024-04-26T11:14:15.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9759000000000001e-05 2024-04-26T11:14:15.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:15.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.838900+0000", 2024-04-26T11:14:15.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5534999999999999e-05 2024-04-26T11:14:15.865 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.865 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:15.865 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.865 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:94279 5.9 5:9b0dad25:::benchmark_data_smithi029_44842_object94278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:15.865 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:15.838906+0000", 2024-04-26T11:14:15.865 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0033391110000000001, 2024-04-26T11:14:15.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037443490000000001, 2024-04-26T11:14:15.865 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:15.865 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:15.865 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:15.866 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:15.866 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.866 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 94279 2024-04-26T11:14:15.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.866 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:15.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:15.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.838906+0000", 2024-04-26T11:14:15.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:15.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.838906+0000", 2024-04-26T11:14:15.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:15.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.838905+0000", 2024-04-26T11:14:15.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:15.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.839039+0000", 2024-04-26T11:14:15.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013382100000000001 2024-04-26T11:14:15.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:15.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.839045+0000", 2024-04-26T11:14:15.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2380000000000002e-06 2024-04-26T11:14:15.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.839049+0000", 2024-04-26T11:14:15.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6569999999999999e-06 2024-04-26T11:14:15.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:15.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840617+0000", 2024-04-26T11:14:15.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0015685300000000001 2024-04-26T11:14:15.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:15.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840740+0000", 2024-04-26T11:14:15.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000122705 2024-04-26T11:14:15.869 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.869 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:15.869 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.870 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:94280 5.9 5:9e1cd768:::benchmark_data_smithi029_44842_object94279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:15.870 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:15.839624+0000", 2024-04-26T11:14:15.870 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0026201449999999999, 2024-04-26T11:14:15.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0031148809999999999, 2024-04-26T11:14:15.871 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:15.871 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:15.871 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:15.871 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:15.871 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.871 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 94280 2024-04-26T11:14:15.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.872 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:15.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:15.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.839624+0000", 2024-04-26T11:14:15.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:15.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.839624+0000", 2024-04-26T11:14:15.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:15.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.839624+0000", 2024-04-26T11:14:15.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:15.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.839706+0000", 2024-04-26T11:14:15.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2492999999999998e-05 2024-04-26T11:14:15.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:15.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.839717+0000", 2024-04-26T11:14:15.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0319999999999999e-05 2024-04-26T11:14:15.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.839724+0000", 2024-04-26T11:14:15.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2799999999999998e-06 2024-04-26T11:14:15.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:15.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842598+0000", 2024-04-26T11:14:15.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002874129 2024-04-26T11:14:15.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:15.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842714+0000", 2024-04-26T11:14:15.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011625000000000001 2024-04-26T11:14:15.875 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.875 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:15.875 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.875 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:94281 5.d 5:bf012ebe:::benchmark_data_smithi029_44842_object94280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:15.875 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:15.839732+0000", 2024-04-26T11:14:15.875 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0025128199999999998, 2024-04-26T11:14:15.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030948080000000001, 2024-04-26T11:14:15.875 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:15.875 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:15.875 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:15.876 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:15.876 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.876 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 94281 2024-04-26T11:14:15.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.876 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:15.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:15.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.839732+0000", 2024-04-26T11:14:15.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:15.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.839732+0000", 2024-04-26T11:14:15.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:15.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.839731+0000", 2024-04-26T11:14:15.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:15.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.839765+0000", 2024-04-26T11:14:15.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3599000000000001e-05 2024-04-26T11:14:15.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:15.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.839773+0000", 2024-04-26T11:14:15.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4400000000000005e-06 2024-04-26T11:14:15.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.839780+0000", 2024-04-26T11:14:15.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.511e-06 2024-04-26T11:14:15.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:15.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.839807+0000", 2024-04-26T11:14:15.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7178999999999998e-05 2024-04-26T11:14:15.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:15.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.839890+0000", 2024-04-26T11:14:15.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3367000000000003e-05 2024-04-26T11:14:15.879 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.879 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:15.879 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.879 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:94282 5.9 5.759590c9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:15.879 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:15.840112+0000", 2024-04-26T11:14:15.879 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0021325889999999998, 2024-04-26T11:14:15.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027922519999999998, 2024-04-26T11:14:15.879 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:15.879 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:15.879 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:15.879 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:15.880 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.880 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 94282 2024-04-26T11:14:15.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.880 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:15.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:15.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840112+0000", 2024-04-26T11:14:15.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:15.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840112+0000", 2024-04-26T11:14:15.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:15.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840111+0000", 2024-04-26T11:14:15.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:15.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:15.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840203+0000", 2024-04-26T11:14:15.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2079999999999999e-05 2024-04-26T11:14:15.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:15.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840210+0000", 2024-04-26T11:14:15.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8589999999999999e-06 2024-04-26T11:14:15.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840216+0000", 2024-04-26T11:14:15.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2570000000000004e-06 2024-04-26T11:14:15.883 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.883 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:15.883 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.884 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:94283 5.a 5:522fe92b:::benchmark_data_smithi029_44842_object94282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:15.884 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:15.840222+0000", 2024-04-26T11:14:15.884 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0020223770000000001, 2024-04-26T11:14:15.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002750391, 2024-04-26T11:14:15.884 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:15.885 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:15.885 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:15.885 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:15.885 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.885 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 94283 2024-04-26T11:14:15.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.886 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:15.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:15.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840222+0000", 2024-04-26T11:14:15.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:15.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840222+0000", 2024-04-26T11:14:15.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:15.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840222+0000", 2024-04-26T11:14:15.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:15.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840262+0000", 2024-04-26T11:14:15.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0076000000000001e-05 2024-04-26T11:14:15.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:15.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840268+0000", 2024-04-26T11:14:15.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8730000000000004e-06 2024-04-26T11:14:15.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840274+0000", 2024-04-26T11:14:15.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1829999999999999e-06 2024-04-26T11:14:15.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:15.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840311+0000", 2024-04-26T11:14:15.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7234999999999998e-05 2024-04-26T11:14:15.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:15.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840434+0000", 2024-04-26T11:14:15.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000122593 2024-04-26T11:14:15.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:15.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840580+0000", 2024-04-26T11:14:15.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014604900000000001 2024-04-26T11:14:15.894 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.894 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:15.894 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.894 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:94284 5.f 5:f86a4643:::benchmark_data_smithi029_44842_object94283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:15.895 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:15.840286+0000", 2024-04-26T11:14:15.895 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0019589469999999999, 2024-04-26T11:14:15.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027797099999999999, 2024-04-26T11:14:15.895 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:15.895 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:15.895 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:15.895 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:15.896 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.896 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 94284 2024-04-26T11:14:15.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.896 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:15.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:15.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840286+0000", 2024-04-26T11:14:15.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:15.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840286+0000", 2024-04-26T11:14:15.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:15.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840285+0000", 2024-04-26T11:14:15.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:15.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840328+0000", 2024-04-26T11:14:15.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2858000000000002e-05 2024-04-26T11:14:15.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:15.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840336+0000", 2024-04-26T11:14:15.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2220000000000002e-06 2024-04-26T11:14:15.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840342+0000", 2024-04-26T11:14:15.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8690000000000001e-06 2024-04-26T11:14:15.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:15.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840398+0000", 2024-04-26T11:14:15.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6285000000000001e-05 2024-04-26T11:14:15.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:15.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840520+0000", 2024-04-26T11:14:15.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000121178 2024-04-26T11:14:15.902 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.902 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:15.902 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.903 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:94285 5.9 5.f557f579 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:15.903 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:15.840354+0000", 2024-04-26T11:14:15.903 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.001890734, 2024-04-26T11:14:15.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002791361, 2024-04-26T11:14:15.903 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:15.904 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:15.904 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:15.904 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:15.904 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.904 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 94285 2024-04-26T11:14:15.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.905 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:15.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:15.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840354+0000", 2024-04-26T11:14:15.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:15.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840354+0000", 2024-04-26T11:14:15.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:15.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840353+0000", 2024-04-26T11:14:15.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:15.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840389+0000", 2024-04-26T11:14:15.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5272999999999999e-05 2024-04-26T11:14:15.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:15.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840397+0000", 2024-04-26T11:14:15.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0129999999999993e-06 2024-04-26T11:14:15.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.840402+0000", 2024-04-26T11:14:15.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6930000000000004e-06 2024-04-26T11:14:15.909 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.910 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:15.910 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.910 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:94290 5.e 5:7550798f:::benchmark_data_smithi029_44842_object94289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:15.910 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:15.842546+0000", 2024-04-26T11:14:15.911 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9996982, 2024-04-26T11:14:15.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00066772399999999997, 2024-04-26T11:14:15.911 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:15.911 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:15.911 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:15.911 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:15.911 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.911 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 94290 2024-04-26T11:14:15.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.911 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:15.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:15.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842546+0000", 2024-04-26T11:14:15.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:15.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842546+0000", 2024-04-26T11:14:15.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:15.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842545+0000", 2024-04-26T11:14:15.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:15.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:15.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842602+0000", 2024-04-26T11:14:15.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6354000000000003e-05 2024-04-26T11:14:15.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:15.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842612+0000", 2024-04-26T11:14:15.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9369999999999999e-06 2024-04-26T11:14:15.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842619+0000", 2024-04-26T11:14:15.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5820000000000004e-06 2024-04-26T11:14:15.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:15.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842657+0000", 2024-04-26T11:14:15.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7783000000000001e-05 2024-04-26T11:14:15.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:15.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842767+0000", 2024-04-26T11:14:15.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010949499999999999 2024-04-26T11:14:15.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:15.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842876+0000", 2024-04-26T11:14:15.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000109477 2024-04-26T11:14:15.916 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.916 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:15.916 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.917 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:94292 5.0 5:0e6571bc:::benchmark_data_smithi029_44842_object94291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:15.917 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:15.842630+0000", 2024-04-26T11:14:15.917 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9996152, 2024-04-26T11:14:15.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000676203, 2024-04-26T11:14:15.917 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:15.917 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:15.917 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:15.917 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:15.918 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.918 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 94292 2024-04-26T11:14:15.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.918 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:15.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:15.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842630+0000", 2024-04-26T11:14:15.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:15.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842630+0000", 2024-04-26T11:14:15.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:15.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842629+0000", 2024-04-26T11:14:15.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:15.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842721+0000", 2024-04-26T11:14:15.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2344999999999998e-05 2024-04-26T11:14:15.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:15.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842729+0000", 2024-04-26T11:14:15.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6510000000000001e-06 2024-04-26T11:14:15.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842735+0000", 2024-04-26T11:14:15.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9499999999999998e-06 2024-04-26T11:14:15.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:15.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842761+0000", 2024-04-26T11:14:15.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.586e-05 2024-04-26T11:14:15.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:15.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842840+0000", 2024-04-26T11:14:15.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8639000000000004e-05 2024-04-26T11:14:15.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:15.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842924+0000", 2024-04-26T11:14:15.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4250000000000001e-05 2024-04-26T11:14:15.924 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.924 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:15.924 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.924 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:94294 5.f 5:f163f573:::benchmark_data_smithi029_44842_object94293:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:15.925 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:15.842796+0000", 2024-04-26T11:14:15.925 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9994488, 2024-04-26T11:14:15.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00058750899999999995, 2024-04-26T11:14:15.925 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:15.925 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:15.925 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:15.925 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:15.925 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:15.926 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 94294 2024-04-26T11:14:15.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.926 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:15.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:15.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842796+0000", 2024-04-26T11:14:15.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:15.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842796+0000", 2024-04-26T11:14:15.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:15.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842795+0000", 2024-04-26T11:14:15.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:15.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:15.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842899+0000", 2024-04-26T11:14:15.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010397500000000001 2024-04-26T11:14:15.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:15.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842906+0000", 2024-04-26T11:14:15.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5310000000000004e-06 2024-04-26T11:14:15.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842913+0000", 2024-04-26T11:14:15.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4819999999999999e-06 2024-04-26T11:14:15.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:15.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.842955+0000", 2024-04-26T11:14:15.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2055000000000003e-05 2024-04-26T11:14:15.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:15.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.843084+0000", 2024-04-26T11:14:15.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128598 2024-04-26T11:14:15.930 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.930 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:15.930 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.931 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(client.4534.0:94283 5.a e35/31)", 2024-04-26T11:14:15.931 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:15.843386+0000", 2024-04-26T11:14:15.931 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9988589, 2024-04-26T11:14:15.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4963000000000002e-05, 2024-04-26T11:14:15.931 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:15.932 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:15.932 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:15.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:15.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.843386+0000", 2024-04-26T11:14:15.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:15.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.843386+0000", 2024-04-26T11:14:15.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:15.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:15.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.843385+0000", 2024-04-26T11:14:15.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:15.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:15.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.843389+0000", 2024-04-26T11:14:15.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8430000000000003e-06 2024-04-26T11:14:15.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:15.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.843399+0000", 2024-04-26T11:14:15.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6299999999999993e-06 2024-04-26T11:14:15.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:15.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.843405+0000", 2024-04-26T11:14:15.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1659999999999999e-06 2024-04-26T11:14:15.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:15.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:15.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:15.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:15.843438+0000", 2024-04-26T11:14:15.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3055000000000001e-05 2024-04-26T11:14:15.937 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.937 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:15.937 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.937 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:15.937 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:14:15.937 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 15 2024-04-26T11:14:15.938 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:15.939 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:15.939 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:15.940 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:15.938+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:15.949 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:15.950 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:15.950 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:15.950 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:15.952 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:15.952 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:16.040 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:16.039+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:16.141 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:16.140+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:16.147 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:16.147 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:16.162 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:16.242 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:16.241+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:16.335 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:16.335 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:16.343 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:16.342+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:16.349 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:16.413 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 38 16 95624 95608 157.236 144.5 0.00310678 0.00635727 2024-04-26T11:14:16.444 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~18s 2024-04-26T11:14:16.444 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:16.443+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:16.527 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:16.527 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:16.543 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:16.584 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:16.583+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:16.647 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:16.646+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:16.749 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:16.748+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:16.769 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:16.769 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:16.785 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:16.849 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:16.849+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:16.951 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:16.950+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:17.011 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:17.011 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:17.027 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:17.071 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:17.070+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:17.153 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:17.152+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:17.203 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:17.203 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:17.217 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:17.259 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:17.258+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:17.354 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:17.353+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:17.413 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 39 16 97835 97819 156.747 138.188 0.00280657 0.00637716 2024-04-26T11:14:17.431 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:17.431 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:17.450 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:17.456 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:17.455+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:17.556 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:17.555+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:17.622 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:17.622 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:17.636 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:17.678 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:14:17.680 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:17.679+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:17.758 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:17.757+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:17.796 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-04-26T11:14:17.796 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-04-26T11:14:17.796 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T11:14:17.796 INFO:teuthology.orchestra.console.smithi072:Power on 2024-04-26T11:14:17.796 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-26T11:14:17.818 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:17.819 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:17.822 DEBUG:teuthology.orchestra.console.smithi072:power on output: Chassis Power Control: Up/On 2024-04-26T11:14:17.822 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:14:17.834 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:17.845 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2024-04-26T11:14:17.862 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:17.858+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:17.953 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:14:17.960 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:17.959+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:18.060 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:18.060+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:18.066 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:18.066 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:18.081 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:18.107 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:18.128 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:18.128 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:18.128 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:18.129 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:18.131 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:18.131 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:18.162 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:18.160+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:18.262 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:18.261+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:18.274 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:18.274 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:14:18.274 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:14:18.274 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:18.274 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.274 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:18.274 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:18.274 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 24.999138459000001, 2024-04-26T11:14:18.274 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:14:18.274 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:18.274 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:18.275 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:18.275 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:18.275 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.275 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:14:18.275 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.275 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:18.275 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.275 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:18.275 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:18.275 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.275 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.275 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.275 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:18.275 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:18.276 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.276 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.276 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.276 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:18.276 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:14:18.276 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:18.276 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.276 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.276 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:18.276 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:14:18.276 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:14:18.276 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.276 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.276 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:18.276 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:14:18.277 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:14:18.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.277 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.277 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.277 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:14:18.277 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:14:18.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.277 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.278 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.278 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:14:18.278 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:14:18.278 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.278 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.278 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:18.278 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:14:18.278 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:14:18.278 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.278 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.278 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:18.278 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:14:18.278 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:14:18.279 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.279 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.279 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:18.279 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:14:18.279 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:14:18.279 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.279 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.279 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:18.279 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:14:18.279 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:14:18.279 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.279 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.279 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:18.279 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:14:18.280 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:14:18.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.280 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.280 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:18.280 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:14:18.280 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:14:18.280 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.280 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:18.280 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.280 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.280 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:18.280 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:18.280 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 24.998326894000002, 2024-04-26T11:14:18.281 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:14:18.281 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:18.281 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:18.281 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:18.281 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:18.281 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.281 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:14:18.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.281 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:18.281 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.281 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:18.281 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:18.281 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.282 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.282 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:18.282 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:18.282 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.282 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.282 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:18.282 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:18.282 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:18.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.282 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.282 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:18.282 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:14:18.282 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:14:18.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.283 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.283 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:18.283 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:14:18.283 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:14:18.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.283 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.283 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.283 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:14:18.283 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:14:18.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.283 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.284 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.284 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:14:18.284 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:14:18.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.284 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.284 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:18.284 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:14:18.284 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:14:18.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.284 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.284 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:18.284 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:14:18.284 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:14:18.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.285 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.285 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:18.285 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:14:18.285 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:14:18.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.285 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.285 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:18.285 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:14:18.285 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:14:18.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.285 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.285 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:18.285 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:14:18.285 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:14:18.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.286 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.286 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:18.286 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:14:18.286 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:14:18.286 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.286 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:18.286 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.286 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.286 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:18.286 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:18.286 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 24.991140056999999, 2024-04-26T11:14:18.286 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:14:18.287 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:18.287 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:18.287 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:18.287 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:18.287 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.287 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:14:18.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.287 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:18.287 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.287 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:18.287 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:18.287 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.287 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.288 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:18.288 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:18.288 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.288 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.288 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:18.288 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:14:18.288 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:18.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.288 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.288 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:18.288 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:14:18.288 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:14:18.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.289 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.289 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:18.289 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:14:18.289 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:14:18.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.289 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.289 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.289 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:14:18.289 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:14:18.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.289 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.289 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.289 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:14:18.290 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:14:18.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.290 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:18.290 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:14:18.290 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:14:18.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.290 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:18.290 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:14:18.290 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:14:18.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.291 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:18.291 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:14:18.291 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:14:18.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.291 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.291 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:18.291 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:14:18.291 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:14:18.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.291 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.291 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:18.291 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:14:18.291 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:14:18.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.292 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.292 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:18.292 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:14:18.292 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:14:18.292 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.292 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:18.292 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.292 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.292 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:18.292 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:18.292 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 24.990599178, 2024-04-26T11:14:18.292 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:14:18.293 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:18.293 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:18.293 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:18.293 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:18.293 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.293 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:14:18.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.293 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:18.293 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.293 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:18.293 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:18.293 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.293 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.293 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:18.294 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:18.294 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.294 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.294 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:18.294 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:18.294 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:18.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.294 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.294 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:18.294 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:14:18.294 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:14:18.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.295 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.295 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:18.295 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:14:18.295 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:14:18.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.295 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.295 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.295 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:14:18.295 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:14:18.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.295 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.295 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.295 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:14:18.295 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:14:18.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.296 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.296 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:18.296 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:14:18.296 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:14:18.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.296 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.296 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:18.296 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:14:18.296 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:14:18.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.296 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.296 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:18.296 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:14:18.296 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:14:18.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.297 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.297 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:18.297 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:14:18.297 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:14:18.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.297 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.297 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:18.297 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:14:18.297 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:14:18.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.297 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.297 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:18.297 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:14:18.297 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:14:18.298 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.298 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:18.298 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.298 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.298 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:55119 5.6 5:6ad50111:::benchmark_data_smithi029_44842_object55118:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:18.298 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:18.298 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 21.509535524, 2024-04-26T11:14:18.298 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018830264999999999, 2024-04-26T11:14:18.298 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:18.298 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:18.298 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:18.298 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:18.298 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.299 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 55119 2024-04-26T11:14:18.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.299 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:18.299 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.299 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:18.299 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:18.299 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.299 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.299 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:18.299 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:18.299 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.299 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.300 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:18.300 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760349+0000", 2024-04-26T11:14:18.300 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:18.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.300 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.300 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:18.300 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760402+0000", 2024-04-26T11:14:18.300 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2695999999999998e-05 2024-04-26T11:14:18.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.300 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.300 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:18.300 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760411+0000", 2024-04-26T11:14:18.300 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.0589999999999992e-06 2024-04-26T11:14:18.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.301 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.301 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.301 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760416+0000", 2024-04-26T11:14:18.301 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.587e-06 2024-04-26T11:14:18.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.301 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.301 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.301 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767638+0000", 2024-04-26T11:14:18.301 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0072214050000000002 2024-04-26T11:14:18.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.301 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.301 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:18.301 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767760+0000", 2024-04-26T11:14:18.301 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000122067 2024-04-26T11:14:18.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.302 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.302 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:18.302 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767927+0000", 2024-04-26T11:14:18.302 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00016747999999999999 2024-04-26T11:14:18.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.302 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.302 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:18.302 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.770877+0000", 2024-04-26T11:14:18.302 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002949335 2024-04-26T11:14:18.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.302 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.302 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:18.302 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779130+0000", 2024-04-26T11:14:18.303 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.008253491 2024-04-26T11:14:18.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.303 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.303 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:18.303 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779158+0000", 2024-04-26T11:14:18.303 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7849000000000001e-05 2024-04-26T11:14:18.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.303 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.303 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:18.303 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779180+0000", 2024-04-26T11:14:18.303 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2048999999999998e-05 2024-04-26T11:14:18.303 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.303 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:18.303 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.304 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.304 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:18.304 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:18.304 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 20.947414730999999, 2024-04-26T11:14:18.304 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:14:18.304 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:18.304 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:18.304 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:18.304 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:18.304 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.304 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:14:18.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.304 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:18.304 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.305 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:18.305 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:18.305 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.305 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:18.305 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:18.305 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.305 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:18.305 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:14:18.305 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:18.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.306 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.306 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:18.306 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:14:18.306 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:14:18.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.306 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.306 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:18.306 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:14:18.306 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:14:18.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.306 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.306 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.306 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:14:18.306 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:14:18.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.307 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.307 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.307 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:14:18.307 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:14:18.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.307 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.307 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:18.307 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:14:18.307 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:14:18.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.307 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.307 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:18.307 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:14:18.308 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:14:18.308 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.308 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.308 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:18.308 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:14:18.308 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:14:18.308 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.308 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.308 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.308 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:14:18.308 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:14:18.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.309 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.309 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:18.309 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:14:18.309 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:14:18.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.309 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.309 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.309 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:14:18.309 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:14:18.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.309 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.309 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:18.309 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:14:18.310 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:14:18.310 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.310 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:18.310 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.310 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.310 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:18.310 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:18.310 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 20.945221391, 2024-04-26T11:14:18.310 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:14:18.310 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:18.310 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:18.310 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:18.310 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:18.311 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.311 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:14:18.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.311 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:18.311 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.311 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:18.311 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:18.311 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.311 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.311 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:18.311 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:18.311 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.311 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.312 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:18.312 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:14:18.312 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:18.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.312 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.312 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:18.312 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:14:18.312 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:14:18.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.312 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.312 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:18.312 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:14:18.312 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:14:18.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.312 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.313 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.313 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:14:18.313 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:14:18.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.313 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.313 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.313 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:14:18.313 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:14:18.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.313 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.313 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:18.313 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:14:18.313 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:14:18.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.314 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.314 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:18.314 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:14:18.314 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:14:18.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.314 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.314 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:18.314 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:14:18.314 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:14:18.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.314 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.314 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.314 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:14:18.314 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:14:18.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.315 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.315 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:18.315 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:14:18.315 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:14:18.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.315 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.315 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.315 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:14:18.315 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:14:18.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.315 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.315 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:18.315 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:14:18.316 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:14:18.316 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.316 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:18.316 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.316 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.316 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:18.316 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:18.316 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 20.940009567000001, 2024-04-26T11:14:18.316 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:14:18.316 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:18.316 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:18.316 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:18.316 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:18.316 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.317 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:14:18.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.317 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:18.317 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.317 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:18.317 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:18.317 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.317 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.317 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:18.317 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:18.317 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.317 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.318 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:18.318 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:14:18.318 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:18.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.318 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.318 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:18.318 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:14:18.318 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:14:18.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.318 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.318 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:18.318 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:14:18.318 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:14:18.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.319 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.319 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.319 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:14:18.319 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:14:18.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.319 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.319 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.319 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:14:18.319 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:14:18.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.319 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.319 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:18.319 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:14:18.319 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:14:18.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.320 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:18.320 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:14:18.320 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:14:18.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.320 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:18.320 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:14:18.320 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:14:18.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.320 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.320 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:14:18.320 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:14:18.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.321 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.321 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:18.321 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:14:18.321 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:14:18.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.321 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.321 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.321 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:14:18.321 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:14:18.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.321 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.321 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:18.321 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:14:18.322 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:14:18.322 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.322 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:18.322 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.322 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.322 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:18.322 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:18.322 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 20.923560866999999, 2024-04-26T11:14:18.322 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:14:18.322 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:18.322 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:18.322 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:18.322 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:18.323 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.323 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:14:18.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.323 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:18.323 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.323 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:18.323 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:18.323 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.323 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.323 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:18.323 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:18.323 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.323 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.324 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:18.324 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:14:18.324 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:18.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.324 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.324 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:18.324 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:14:18.324 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:14:18.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.324 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.324 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:18.324 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:14:18.324 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:14:18.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.324 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.325 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.325 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:14:18.325 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:14:18.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.325 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.325 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.325 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:14:18.325 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:14:18.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.325 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.325 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:18.325 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:14:18.325 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:14:18.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.326 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.326 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.326 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:14:18.326 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:14:18.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.326 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.326 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:18.326 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:14:18.326 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:14:18.326 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.326 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:18.326 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.326 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.326 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:18.327 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:18.327 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 20.921863362, 2024-04-26T11:14:18.327 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:14:18.327 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:18.327 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:18.327 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:18.327 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:18.327 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.327 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:14:18.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.327 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:18.327 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.327 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:18.327 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:18.328 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.328 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.328 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:18.328 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:18.328 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.328 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.328 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:18.328 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:14:18.328 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:18.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.328 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.328 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:18.329 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:14:18.329 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:14:18.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.329 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.329 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:18.329 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:14:18.329 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:14:18.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.329 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.329 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.329 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:14:18.329 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:14:18.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.329 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.329 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.330 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:14:18.330 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:14:18.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.330 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.330 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:18.330 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:14:18.330 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:14:18.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.330 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.330 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.330 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:14:18.330 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:14:18.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.330 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.331 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:18.331 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:14:18.331 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:14:18.331 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.331 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:18.331 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.331 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.331 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:18.331 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:18.331 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 20.921799060000001, 2024-04-26T11:14:18.331 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:14:18.331 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:18.331 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:18.332 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:18.332 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:18.332 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.332 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:14:18.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.332 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:18.332 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.332 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:18.332 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:18.332 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.332 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.332 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:18.332 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:18.332 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.333 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.333 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:18.333 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:18.333 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:18.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.333 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.333 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:18.333 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:14:18.333 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:14:18.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.333 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.333 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:18.333 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:14:18.334 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:14:18.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.334 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.334 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.334 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:14:18.334 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:14:18.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.334 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.334 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.334 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:14:18.334 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:14:18.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.334 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.334 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:18.335 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:14:18.335 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:14:18.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.335 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.335 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:14:18.335 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:14:18.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.335 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:18.335 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:14:18.335 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:14:18.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.336 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:18.336 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:14:18.336 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:14:18.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.336 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:18.336 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:14:18.336 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:14:18.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.336 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:18.336 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:14:18.336 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:14:18.336 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.336 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:18.337 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.337 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.337 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:18.337 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:18.337 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 20.921744835999998, 2024-04-26T11:14:18.337 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:14:18.337 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:18.337 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:18.337 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:18.337 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:18.337 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.337 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:14:18.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.337 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:18.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.338 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:18.338 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:18.338 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.338 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:18.338 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:18.338 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.338 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:18.338 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:18.338 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:18.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.339 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:18.339 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:14:18.339 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:14:18.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.339 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:18.339 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:14:18.339 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:14:18.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.339 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.339 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:14:18.340 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:14:18.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.340 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.340 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:14:18.340 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:14:18.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.340 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:18.340 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:14:18.340 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:14:18.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.340 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.340 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:14:18.341 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:14:18.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.341 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:18.342 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:14:18.342 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:14:18.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.342 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:18.342 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:14:18.342 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:14:18.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.342 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:18.343 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:14:18.343 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:18.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.343 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:18.343 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:14:18.343 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:14:18.343 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.343 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:18.343 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.343 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:18.343 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:18.344 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 20.921700324, 2024-04-26T11:14:18.344 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:14:18.344 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:18.344 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:18.344 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:18.344 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:18.344 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.344 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:14:18.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.344 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:18.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.344 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:18.344 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:18.344 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.345 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.345 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:18.345 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:18.345 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.345 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.345 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:18.345 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:14:18.345 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:18.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.345 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.345 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:18.345 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:14:18.345 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:14:18.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.346 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:18.346 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:14:18.346 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:14:18.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.346 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.346 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:14:18.346 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:14:18.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.346 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.346 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:14:18.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:14:18.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.347 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:18.347 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:14:18.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:14:18.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.347 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.347 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:14:18.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:14:18.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.347 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:18.347 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:14:18.348 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:14:18.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.348 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:18.348 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:14:18.348 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:14:18.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.348 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:18.348 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:14:18.348 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:14:18.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.348 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:18.349 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:14:18.349 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:14:18.349 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.349 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:18.349 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.349 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:18.349 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:18.349 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 20.917479321999998, 2024-04-26T11:14:18.349 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:14:18.349 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:18.349 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:18.349 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:18.349 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:18.350 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.350 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:14:18.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.350 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:18.350 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.350 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:18.350 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:18.350 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.350 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.350 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:18.350 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:18.350 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.351 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:18.351 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:14:18.351 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:14:18.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.351 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:18.351 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:14:18.351 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:14:18.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.351 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:18.351 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:14:18.351 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:14:18.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.352 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.352 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.352 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:14:18.352 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:14:18.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.352 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.352 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.352 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:14:18.352 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:14:18.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.352 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.352 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:18.352 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:14:18.352 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:14:18.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.353 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.353 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:14:18.353 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:14:18.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.353 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:18.353 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:14:18.353 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:14:18.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.353 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:18.353 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:14:18.353 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:14:18.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.354 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:18.354 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:14:18.354 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:14:18.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.354 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:18.354 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:14:18.354 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:14:18.354 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.354 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:18.354 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.355 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.355 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:61817 5.a 5:5627ce7f:::benchmark_data_smithi029_44842_object61816:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:18.355 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:18.355 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 17.567353869000002, 2024-04-26T11:14:18.355 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020626958000000001, 2024-04-26T11:14:18.355 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:18.355 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:18.355 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:18.355 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:18.355 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.355 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 61817 2024-04-26T11:14:18.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.355 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:18.355 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.356 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:18.356 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:18.356 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.356 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:18.356 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:18.356 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.356 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:18.356 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:18.356 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:18.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.357 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:18.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702591+0000", 2024-04-26T11:14:18.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0665999999999998e-05 2024-04-26T11:14:18.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.357 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:18.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702599+0000", 2024-04-26T11:14:18.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7130000000000005e-06 2024-04-26T11:14:18.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.357 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702605+0000", 2024-04-26T11:14:18.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4310000000000002e-06 2024-04-26T11:14:18.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.358 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.358 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.707947+0000", 2024-04-26T11:14:18.358 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053424220000000003 2024-04-26T11:14:18.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.358 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:18.358 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.708052+0000", 2024-04-26T11:14:18.358 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010499 2024-04-26T11:14:18.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.358 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:14:18.358 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.708141+0000", 2024-04-26T11:14:18.358 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9514999999999999e-05 2024-04-26T11:14:18.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:18.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.711954+0000", 2024-04-26T11:14:18.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003812265 2024-04-26T11:14:18.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:18.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723070+0000", 2024-04-26T11:14:18.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011116727 2024-04-26T11:14:18.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:18.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723121+0000", 2024-04-26T11:14:18.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0362999999999999e-05 2024-04-26T11:14:18.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.360 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:18.360 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723158+0000", 2024-04-26T11:14:18.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7579000000000001e-05 2024-04-26T11:14:18.360 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.360 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:18.360 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.360 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:75771 5.c 5:3cc8f1b4:::benchmark_data_smithi029_44842_object75770:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T11:14:18.360 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:18.360 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 11.516909525999999, 2024-04-26T11:14:18.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019437949, 2024-04-26T11:14:18.361 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:18.361 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:18.361 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:18.361 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:18.361 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.361 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 75771 2024-04-26T11:14:18.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.361 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:18.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.361 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:18.361 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:18.361 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.362 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:18.362 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:18.362 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.362 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.362 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:18.362 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752975+0000", 2024-04-26T11:14:18.362 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:18.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.362 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.362 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:18.362 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753061+0000", 2024-04-26T11:14:18.362 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5890999999999995e-05 2024-04-26T11:14:18.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.363 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:18.363 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753071+0000", 2024-04-26T11:14:18.363 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.9990000000000003e-06 2024-04-26T11:14:18.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.363 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.363 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753078+0000", 2024-04-26T11:14:18.363 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1559999999999998e-06 2024-04-26T11:14:18.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.363 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.363 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.758559+0000", 2024-04-26T11:14:18.363 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0054812819999999996 2024-04-26T11:14:18.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:18.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.758692+0000", 2024-04-26T11:14:18.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000133301 2024-04-26T11:14:18.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:18.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772277+0000", 2024-04-26T11:14:18.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.013584839 2024-04-26T11:14:18.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:18.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772340+0000", 2024-04-26T11:14:18.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2360999999999995e-05 2024-04-26T11:14:18.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.365 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:18.365 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772414+0000", 2024-04-26T11:14:18.365 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4024999999999997e-05 2024-04-26T11:14:18.365 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.365 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:18.365 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.365 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83359 5.2 5:4939888c:::benchmark_data_smithi029_44842_object83358:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:18.365 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:18.365 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 7.2303189410000002, 2024-04-26T11:14:18.365 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018705583000000001, 2024-04-26T11:14:18.365 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:18.366 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:18.366 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:18.366 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:18.366 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.366 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83359 2024-04-26T11:14:18.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.366 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:18.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.366 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:18.366 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:18.366 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.366 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:18.367 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:18.367 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.367 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.367 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:18.367 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:18.367 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:18.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.367 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.367 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:18.367 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039625+0000", 2024-04-26T11:14:18.367 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9162e-05 2024-04-26T11:14:18.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.367 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.368 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:18.368 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039632+0000", 2024-04-26T11:14:18.368 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5399999999999998e-06 2024-04-26T11:14:18.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.368 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.368 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039638+0000", 2024-04-26T11:14:18.368 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1850000000000003e-06 2024-04-26T11:14:18.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.368 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.368 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.042375+0000", 2024-04-26T11:14:18.368 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0027371510000000002 2024-04-26T11:14:18.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.369 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:18.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.042502+0000", 2024-04-26T11:14:18.369 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000126966 2024-04-26T11:14:18.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.369 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:18.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058154+0000", 2024-04-26T11:14:18.369 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015652657 2024-04-26T11:14:18.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.369 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:18.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058201+0000", 2024-04-26T11:14:18.369 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6579000000000002e-05 2024-04-26T11:14:18.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.370 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.370 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:18.370 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058272+0000", 2024-04-26T11:14:18.370 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1009999999999999e-05 2024-04-26T11:14:18.370 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.370 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:18.370 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.370 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.370 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83360 5.2 5:42f8bfcd:::benchmark_data_smithi029_44842_object83359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:18.370 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:18.370 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 7.2302399519999998, 2024-04-26T11:14:18.370 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022279782000000001, 2024-04-26T11:14:18.371 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:18.371 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:18.371 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:18.371 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:18.371 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.371 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83360 2024-04-26T11:14:18.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.371 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:18.371 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.371 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:18.371 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:18.371 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.371 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.371 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:18.372 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:18.372 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.372 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:18.372 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:18.372 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:18.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.372 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:18.372 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039700+0000", 2024-04-26T11:14:18.372 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5541000000000002e-05 2024-04-26T11:14:18.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.373 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:18.373 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039706+0000", 2024-04-26T11:14:18.373 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3680000000000001e-06 2024-04-26T11:14:18.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.373 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.373 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.373 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039709+0000", 2024-04-26T11:14:18.373 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4659999999999999e-06 2024-04-26T11:14:18.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.373 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.373 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.373 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056305+0000", 2024-04-26T11:14:18.373 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016595649000000001 2024-04-26T11:14:18.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.373 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.374 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:18.374 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056487+0000", 2024-04-26T11:14:18.374 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000181886 2024-04-26T11:14:18.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.374 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.374 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:18.374 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061809+0000", 2024-04-26T11:14:18.374 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053223259999999996 2024-04-26T11:14:18.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.374 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.374 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:18.374 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061852+0000", 2024-04-26T11:14:18.374 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2738999999999999e-05 2024-04-26T11:14:18.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.375 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:18.375 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061925+0000", 2024-04-26T11:14:18.375 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3180000000000001e-05 2024-04-26T11:14:18.375 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.375 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:18.375 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.375 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83364 5.2 5:42c5cd8c:::benchmark_data_smithi029_44842_object83363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:18.375 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:18.375 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 7.2298242119999996, 2024-04-26T11:14:18.375 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022695336, 2024-04-26T11:14:18.375 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:18.375 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:18.376 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:18.376 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:18.376 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.376 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83364 2024-04-26T11:14:18.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.376 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:18.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.376 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:18.376 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:18.376 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.376 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:18.376 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:18.377 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.377 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:18.377 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040060+0000", 2024-04-26T11:14:18.377 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:18.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.377 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:18.377 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040086+0000", 2024-04-26T11:14:18.377 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5482000000000001e-05 2024-04-26T11:14:18.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.377 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:18.378 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040093+0000", 2024-04-26T11:14:18.378 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6409999999999996e-06 2024-04-26T11:14:18.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.378 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.378 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.378 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040098+0000", 2024-04-26T11:14:18.378 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879999999999996e-06 2024-04-26T11:14:18.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.378 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.378 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.378 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058292+0000", 2024-04-26T11:14:18.378 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018193504999999999 2024-04-26T11:14:18.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.378 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.379 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:18.379 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058412+0000", 2024-04-26T11:14:18.379 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011979199999999999 2024-04-26T11:14:18.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.379 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:18.379 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062642+0000", 2024-04-26T11:14:18.379 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042299449999999997 2024-04-26T11:14:18.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.379 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:18.379 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062688+0000", 2024-04-26T11:14:18.379 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6859e-05 2024-04-26T11:14:18.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.380 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:18.380 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062756+0000", 2024-04-26T11:14:18.380 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7995000000000002e-05 2024-04-26T11:14:18.380 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.380 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:18.380 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.380 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83378 5.2 5:44b3209a:::benchmark_data_smithi029_44842_object83377:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:18.380 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:18.380 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 7.2221037590000003, 2024-04-26T11:14:18.380 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020722529, 2024-04-26T11:14:18.380 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:18.380 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:18.380 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:18.381 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:18.381 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.381 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83378 2024-04-26T11:14:18.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.381 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:18.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.381 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:18.381 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:18.381 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.381 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:18.381 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:18.381 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:18.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.382 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.382 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:18.382 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047781+0000", 2024-04-26T11:14:18.382 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:18.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.382 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.382 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:18.382 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047832+0000", 2024-04-26T11:14:18.382 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1687000000000002e-05 2024-04-26T11:14:18.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.382 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.382 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:18.382 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047842+0000", 2024-04-26T11:14:18.382 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2439999999999999e-06 2024-04-26T11:14:18.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.383 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.383 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047847+0000", 2024-04-26T11:14:18.383 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6500000000000001e-06 2024-04-26T11:14:18.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.383 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:18.383 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.060082+0000", 2024-04-26T11:14:18.383 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.012235105 2024-04-26T11:14:18.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.383 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:18.383 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.060191+0000", 2024-04-26T11:14:18.384 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000108665 2024-04-26T11:14:18.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.384 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.384 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:18.384 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068363+0000", 2024-04-26T11:14:18.384 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0081715829999999996 2024-04-26T11:14:18.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.384 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.384 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:18.384 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068418+0000", 2024-04-26T11:14:18.384 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4984000000000001e-05 2024-04-26T11:14:18.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:18.384 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:18.384 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:18.385 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068504+0000", 2024-04-26T11:14:18.385 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6520000000000005e-05 2024-04-26T11:14:18.385 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.385 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:18.385 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.385 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:18.385 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:18.385 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:18.386 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:18.385+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:18.387 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:18.413 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:2024-04-26T11:14:18.413110+0000 min lat: 0.00112975 max lat: 1.0322 avg lat: 0.00639153 2024-04-26T11:14:18.413 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-26T11:14:18.414 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 40 16 100110 100094 156.382 142.188 0.00309206 0.00639153 2024-04-26T11:14:18.487 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:18.486+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:18.564 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:18.564 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:18.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.565 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:100454 5.b 5:d483308f:::benchmark_data_smithi029_44842_object100453:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:18.565 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:18.553526+0000", 2024-04-26T11:14:18.565 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0087238779999999991, 2024-04-26T11:14:18.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087623140000000002, 2024-04-26T11:14:18.565 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:18.565 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:18.565 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:18.565 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:18.565 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.565 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 100454 2024-04-26T11:14:18.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.565 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:18.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:18.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.553526+0000", 2024-04-26T11:14:18.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:18.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.553526+0000", 2024-04-26T11:14:18.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:18.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.553525+0000", 2024-04-26T11:14:18.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:18.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:18.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.553591+0000", 2024-04-26T11:14:18.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6289000000000002e-05 2024-04-26T11:14:18.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:18.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.553598+0000", 2024-04-26T11:14:18.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3550000000000001e-06 2024-04-26T11:14:18.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.553602+0000", 2024-04-26T11:14:18.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.104e-06 2024-04-26T11:14:18.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:18.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.555699+0000", 2024-04-26T11:14:18.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020966159999999999 2024-04-26T11:14:18.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:18.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.557383+0000", 2024-04-26T11:14:18.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001683985 2024-04-26T11:14:18.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:18.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.557500+0000", 2024-04-26T11:14:18.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117668 2024-04-26T11:14:18.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:18.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.561094+0000", 2024-04-26T11:14:18.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003593981 2024-04-26T11:14:18.569 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.569 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:18.569 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.569 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:100456 5.4 5:25c60105:::benchmark_data_smithi029_44842_object100455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:18.569 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:18.553607+0000", 2024-04-26T11:14:18.569 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0086424069999999995, 2024-04-26T11:14:18.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0087863379999999994, 2024-04-26T11:14:18.570 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:18.570 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:18.570 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:18.570 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:18.570 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.570 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 100456 2024-04-26T11:14:18.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.570 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:18.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:18.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.553607+0000", 2024-04-26T11:14:18.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:18.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.553607+0000", 2024-04-26T11:14:18.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:18.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.553607+0000", 2024-04-26T11:14:18.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:18.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:18.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.553711+0000", 2024-04-26T11:14:18.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010417 2024-04-26T11:14:18.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:18.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.553717+0000", 2024-04-26T11:14:18.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.28e-06 2024-04-26T11:14:18.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.553723+0000", 2024-04-26T11:14:18.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5809999999999996e-06 2024-04-26T11:14:18.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:18.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.555641+0000", 2024-04-26T11:14:18.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001917986 2024-04-26T11:14:18.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:18.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.555782+0000", 2024-04-26T11:14:18.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014090899999999999 2024-04-26T11:14:18.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:18.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.555941+0000", 2024-04-26T11:14:18.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000158927 2024-04-26T11:14:18.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:18.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.559978+0000", 2024-04-26T11:14:18.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004037166 2024-04-26T11:14:18.574 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.574 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:18.574 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.574 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:100460 5.e 5:7e53b707:::benchmark_data_smithi029_44842_object100459:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:18.574 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:18.553904+0000", 2024-04-26T11:14:18.574 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0083454779999999999, 2024-04-26T11:14:18.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0085722260000000005, 2024-04-26T11:14:18.574 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:18.574 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:18.574 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:18.575 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:18.575 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.575 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 100460 2024-04-26T11:14:18.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.575 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:18.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:18.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.553904+0000", 2024-04-26T11:14:18.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:18.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.553904+0000", 2024-04-26T11:14:18.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:18.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.553904+0000", 2024-04-26T11:14:18.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:18.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:18.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.553978+0000", 2024-04-26T11:14:18.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4561999999999995e-05 2024-04-26T11:14:18.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:18.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.553986+0000", 2024-04-26T11:14:18.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6869999999999994e-06 2024-04-26T11:14:18.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.553992+0000", 2024-04-26T11:14:18.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2249999999999997e-06 2024-04-26T11:14:18.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:18.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.555735+0000", 2024-04-26T11:14:18.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001742651 2024-04-26T11:14:18.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:18.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.555850+0000", 2024-04-26T11:14:18.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000114857 2024-04-26T11:14:18.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:18.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.555974+0000", 2024-04-26T11:14:18.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012400000000000001 2024-04-26T11:14:18.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:18.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.558950+0000", 2024-04-26T11:14:18.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0029759019999999999 2024-04-26T11:14:18.578 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.578 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:18.578 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.579 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:100463 5.b 5:d121e61e:::benchmark_data_smithi029_44842_object100462:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:18.579 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:18.554327+0000", 2024-04-26T11:14:18.579 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0079225909999999997, 2024-04-26T11:14:18.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0082431469999999993, 2024-04-26T11:14:18.579 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:18.579 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:18.579 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:18.579 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:18.579 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.579 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 100463 2024-04-26T11:14:18.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.579 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:18.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:18.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.554327+0000", 2024-04-26T11:14:18.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:18.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.554327+0000", 2024-04-26T11:14:18.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:18.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.554326+0000", 2024-04-26T11:14:18.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:18.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:18.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.554425+0000", 2024-04-26T11:14:18.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8204999999999999e-05 2024-04-26T11:14:18.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:18.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.554434+0000", 2024-04-26T11:14:18.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7359999999999996e-06 2024-04-26T11:14:18.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.554441+0000", 2024-04-26T11:14:18.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.793e-06 2024-04-26T11:14:18.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:18.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.559053+0000", 2024-04-26T11:14:18.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004611848 2024-04-26T11:14:18.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:18.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.559171+0000", 2024-04-26T11:14:18.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000118097 2024-04-26T11:14:18.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:18.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.559313+0000", 2024-04-26T11:14:18.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014143399999999999 2024-04-26T11:14:18.582 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.582 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:18.582 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.583 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:100466 5.4 5:2e73c160:::benchmark_data_smithi029_44842_object100465:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:18.583 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:18.558006+0000", 2024-04-26T11:14:18.583 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0042434580000000003, 2024-04-26T11:14:18.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0046365199999999999, 2024-04-26T11:14:18.583 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:18.583 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:18.583 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:18.583 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:18.583 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.583 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 100466 2024-04-26T11:14:18.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.583 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:18.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:18.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.558006+0000", 2024-04-26T11:14:18.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:18.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.558006+0000", 2024-04-26T11:14:18.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:18.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.558005+0000", 2024-04-26T11:14:18.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:18.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:18.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.558035+0000", 2024-04-26T11:14:18.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9669999999999999e-05 2024-04-26T11:14:18.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:18.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.558047+0000", 2024-04-26T11:14:18.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1734e-05 2024-04-26T11:14:18.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.558054+0000", 2024-04-26T11:14:18.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3030000000000002e-06 2024-04-26T11:14:18.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:18.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.558087+0000", 2024-04-26T11:14:18.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2727e-05 2024-04-26T11:14:18.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:18.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.558168+0000", 2024-04-26T11:14:18.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0796000000000004e-05 2024-04-26T11:14:18.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:18.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.558361+0000", 2024-04-26T11:14:18.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019295099999999999 2024-04-26T11:14:18.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:18.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560678+0000", 2024-04-26T11:14:18.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023173059999999999 2024-04-26T11:14:18.587 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.587 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:18.587 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.587 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:100468 5.e 5:783c7425:::benchmark_data_smithi029_44842_object100467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:18.588 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:18.559977+0000", 2024-04-26T11:14:18.588 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0022730929999999999, 2024-04-26T11:14:18.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027212629999999998, 2024-04-26T11:14:18.588 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:18.588 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:18.588 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:18.588 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:18.588 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.588 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 100468 2024-04-26T11:14:18.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.588 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:18.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:18.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.559977+0000", 2024-04-26T11:14:18.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:18.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.559977+0000", 2024-04-26T11:14:18.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:18.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.559976+0000", 2024-04-26T11:14:18.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:18.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:18.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560057+0000", 2024-04-26T11:14:18.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1056000000000005e-05 2024-04-26T11:14:18.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:18.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560066+0000", 2024-04-26T11:14:18.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6430000000000007e-06 2024-04-26T11:14:18.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560074+0000", 2024-04-26T11:14:18.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1600000000000001e-06 2024-04-26T11:14:18.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:18.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560311+0000", 2024-04-26T11:14:18.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000237476 2024-04-26T11:14:18.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:18.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560391+0000", 2024-04-26T11:14:18.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0320000000000003e-05 2024-04-26T11:14:18.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:18.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560486+0000", 2024-04-26T11:14:18.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4636000000000007e-05 2024-04-26T11:14:18.592 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.592 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:18.592 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.592 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:100469 5.b 5:d7f2ff56:::benchmark_data_smithi029_44842_object100468:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:18.592 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:18.560295+0000", 2024-04-26T11:14:18.592 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0019550309999999999, 2024-04-26T11:14:18.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024670220000000001, 2024-04-26T11:14:18.592 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:18.592 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:18.592 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:18.592 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:18.592 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.592 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 100469 2024-04-26T11:14:18.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.593 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:18.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:18.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560295+0000", 2024-04-26T11:14:18.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:18.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560295+0000", 2024-04-26T11:14:18.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:18.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560294+0000", 2024-04-26T11:14:18.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:18.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:18.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560332+0000", 2024-04-26T11:14:18.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8408000000000002e-05 2024-04-26T11:14:18.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:18.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560342+0000", 2024-04-26T11:14:18.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9210000000000004e-06 2024-04-26T11:14:18.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560349+0000", 2024-04-26T11:14:18.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1130000000000003e-06 2024-04-26T11:14:18.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:18.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.561110+0000", 2024-04-26T11:14:18.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00076029699999999995 2024-04-26T11:14:18.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:18.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.561179+0000", 2024-04-26T11:14:18.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9740000000000007e-05 2024-04-26T11:14:18.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:18.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.561265+0000", 2024-04-26T11:14:18.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5667999999999994e-05 2024-04-26T11:14:18.596 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.596 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:18.596 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.596 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:100471 5.e 5:76dbbaa6:::benchmark_data_smithi029_44842_object100470:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:18.596 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:18.560356+0000", 2024-04-26T11:14:18.596 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0018934379999999999, 2024-04-26T11:14:18.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024519139999999999, 2024-04-26T11:14:18.596 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:18.596 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:18.597 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:18.597 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:18.597 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.597 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 100471 2024-04-26T11:14:18.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.597 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:18.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:18.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560356+0000", 2024-04-26T11:14:18.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:18.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560356+0000", 2024-04-26T11:14:18.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:18.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560356+0000", 2024-04-26T11:14:18.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:18.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:18.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560385+0000", 2024-04-26T11:14:18.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8770000000000001e-05 2024-04-26T11:14:18.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:18.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560392+0000", 2024-04-26T11:14:18.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6140000000000003e-06 2024-04-26T11:14:18.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560398+0000", 2024-04-26T11:14:18.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8640000000000001e-06 2024-04-26T11:14:18.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:18.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562003+0000", 2024-04-26T11:14:18.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0016046459999999999 2024-04-26T11:14:18.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:18.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562130+0000", 2024-04-26T11:14:18.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012695100000000001 2024-04-26T11:14:18.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:18.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562296+0000", 2024-04-26T11:14:18.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016597399999999999 2024-04-26T11:14:18.600 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.600 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:18.600 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.600 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:100474 5.4 5:2445c2d8:::benchmark_data_smithi029_44842_object100473:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:18.601 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:18.560793+0000", 2024-04-26T11:14:18.601 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0014572389999999999, 2024-04-26T11:14:18.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002091589, 2024-04-26T11:14:18.601 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:18.601 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:18.601 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:18.601 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:18.601 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.601 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 100474 2024-04-26T11:14:18.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.601 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:18.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:18.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560793+0000", 2024-04-26T11:14:18.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:18.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560793+0000", 2024-04-26T11:14:18.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:18.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560792+0000", 2024-04-26T11:14:18.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:18.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:18.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560881+0000", 2024-04-26T11:14:18.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9117999999999996e-05 2024-04-26T11:14:18.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:18.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560897+0000", 2024-04-26T11:14:18.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6033999999999999e-05 2024-04-26T11:14:18.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560904+0000", 2024-04-26T11:14:18.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:14:18.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:18.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560936+0000", 2024-04-26T11:14:18.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2212999999999998e-05 2024-04-26T11:14:18.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:18.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.561040+0000", 2024-04-26T11:14:18.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010405599999999999 2024-04-26T11:14:18.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:18.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.561182+0000", 2024-04-26T11:14:18.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014159400000000001 2024-04-26T11:14:18.604 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.604 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:18.605 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.605 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:100475 5.8 5:1f938823:::benchmark_data_smithi029_44842_object100474:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:18.605 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:18.560913+0000", 2024-04-26T11:14:18.605 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.001336814, 2024-04-26T11:14:18.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020573990000000001, 2024-04-26T11:14:18.605 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:18.605 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:18.605 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:18.605 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:18.605 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.605 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 100475 2024-04-26T11:14:18.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.606 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:18.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:18.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560913+0000", 2024-04-26T11:14:18.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:18.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560913+0000", 2024-04-26T11:14:18.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:18.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560912+0000", 2024-04-26T11:14:18.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:18.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:18.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560941+0000", 2024-04-26T11:14:18.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9011000000000001e-05 2024-04-26T11:14:18.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:18.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560950+0000", 2024-04-26T11:14:18.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:14:18.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.560955+0000", 2024-04-26T11:14:18.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.101e-06 2024-04-26T11:14:18.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:18.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562026+0000", 2024-04-26T11:14:18.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001071439 2024-04-26T11:14:18.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:18.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562144+0000", 2024-04-26T11:14:18.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000118009 2024-04-26T11:14:18.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:18.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562273+0000", 2024-04-26T11:14:18.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128708 2024-04-26T11:14:18.609 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.609 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:18.609 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.609 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(client.4534.0:100460 5.e e35/16)", 2024-04-26T11:14:18.609 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:18.562067+0000", 2024-04-26T11:14:18.609 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00018231500000000001, 2024-04-26T11:14:18.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096525799999999998, 2024-04-26T11:14:18.609 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:18.609 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:18.609 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:18.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:18.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562067+0000", 2024-04-26T11:14:18.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:18.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562067+0000", 2024-04-26T11:14:18.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:18.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562067+0000", 2024-04-26T11:14:18.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:18.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:18.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562071+0000", 2024-04-26T11:14:18.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8700000000000002e-06 2024-04-26T11:14:18.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:18.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562077+0000", 2024-04-26T11:14:18.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7000000000000002e-06 2024-04-26T11:14:18.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562088+0000", 2024-04-26T11:14:18.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0684e-05 2024-04-26T11:14:18.611 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.612 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:18.612 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.612 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(client.4534.0:100456 5.4 e35/16)", 2024-04-26T11:14:18.612 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:18.562143+0000", 2024-04-26T11:14:18.612 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.000106854, 2024-04-26T11:14:18.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00091553100000000003, 2024-04-26T11:14:18.612 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:18.612 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:18.612 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:18.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:18.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562143+0000", 2024-04-26T11:14:18.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:18.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562143+0000", 2024-04-26T11:14:18.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:18.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562143+0000", 2024-04-26T11:14:18.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967296 2024-04-26T11:14:18.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:18.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562146+0000", 2024-04-26T11:14:18.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5860000000000001e-06 2024-04-26T11:14:18.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:18.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562151+0000", 2024-04-26T11:14:18.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9339999999999997e-06 2024-04-26T11:14:18.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562155+0000", 2024-04-26T11:14:18.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8600000000000003e-06 2024-04-26T11:14:18.614 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.614 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:18.614 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.615 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(client.4534.0:100466 5.4 e35/16)", 2024-04-26T11:14:18.615 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:18.562162+0000", 2024-04-26T11:14:18.615 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.8084000000000006e-05, 2024-04-26T11:14:18.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00092232600000000001, 2024-04-26T11:14:18.615 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:18.615 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:18.615 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:18.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:18.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562162+0000", 2024-04-26T11:14:18.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:18.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562162+0000", 2024-04-26T11:14:18.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:18.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562161+0000", 2024-04-26T11:14:18.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967296 2024-04-26T11:14:18.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:18.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562163+0000", 2024-04-26T11:14:18.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9479999999999998e-06 2024-04-26T11:14:18.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:18.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562169+0000", 2024-04-26T11:14:18.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1610000000000002e-06 2024-04-26T11:14:18.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562173+0000", 2024-04-26T11:14:18.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1099999999999996e-06 2024-04-26T11:14:18.617 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.617 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:18.617 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.618 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:100478 5.a 5:5222e40f:::benchmark_data_smithi029_44842_object100477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:18.618 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:18.562374+0000", 2024-04-26T11:14:18.618 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.999876, 2024-04-26T11:14:18.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00074777399999999999, 2024-04-26T11:14:18.618 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:18.618 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:18.618 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:18.618 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:18.618 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.618 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 100478 2024-04-26T11:14:18.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.618 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:18.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:18.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562374+0000", 2024-04-26T11:14:18.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:18.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562374+0000", 2024-04-26T11:14:18.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:18.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562373+0000", 2024-04-26T11:14:18.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:18.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:18.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562436+0000", 2024-04-26T11:14:18.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2708999999999999e-05 2024-04-26T11:14:18.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:18.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562445+0000", 2024-04-26T11:14:18.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6719999999999999e-06 2024-04-26T11:14:18.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562455+0000", 2024-04-26T11:14:18.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.166e-06 2024-04-26T11:14:18.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:18.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562526+0000", 2024-04-26T11:14:18.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1870000000000001e-05 2024-04-26T11:14:18.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:18.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562649+0000", 2024-04-26T11:14:18.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012293499999999999 2024-04-26T11:14:18.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:18.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562793+0000", 2024-04-26T11:14:18.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014312799999999999 2024-04-26T11:14:18.621 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.622 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:18.622 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.622 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:100479 5.9 5:99f0471c:::benchmark_data_smithi029_44842_object100478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T11:14:18.622 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:18.562859+0000", 2024-04-26T11:14:18.622 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9993906, 2024-04-26T11:14:18.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00030822400000000001, 2024-04-26T11:14:18.622 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:18.622 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:18.622 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:18.622 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:18.622 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:18.622 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 100479 2024-04-26T11:14:18.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.623 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:18.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:18.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562859+0000", 2024-04-26T11:14:18.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:18.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562859+0000", 2024-04-26T11:14:18.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:18.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:18.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562858+0000", 2024-04-26T11:14:18.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:18.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:18.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562935+0000", 2024-04-26T11:14:18.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7192000000000002e-05 2024-04-26T11:14:18.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:18.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562949+0000", 2024-04-26T11:14:18.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3688e-05 2024-04-26T11:14:18.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:18.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.562959+0000", 2024-04-26T11:14:18.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5889999999999992e-06 2024-04-26T11:14:18.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:18.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.563001+0000", 2024-04-26T11:14:18.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2280999999999997e-05 2024-04-26T11:14:18.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:18.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:18.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:18.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:18.563092+0000", 2024-04-26T11:14:18.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0719999999999999e-05 2024-04-26T11:14:18.625 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.625 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:18.625 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.625 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:18.626 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:14:18.626 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 15 2024-04-26T11:14:18.626 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:18.627 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:18.626+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:18.628 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:14:18.628 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:18.728 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:18.728+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:18.807 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:14:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:14:18.808 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:14:18.808 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:18.820 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:18.861 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:18.860+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:18.930 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:18.929+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:19.030 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:19.029+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:19.036 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:19.036 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:14:19.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:14:19.036 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:19.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.036 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:35483 5.b 5:d3dd14f6:::benchmark_data_smithi029_44842_object35482:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T11:14:19.036 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:19.036 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.613356599999999, 2024-04-26T11:14:19.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021245969, 2024-04-26T11:14:19.037 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:19.037 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.037 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:19.037 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:19.037 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.037 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 35483 2024-04-26T11:14:19.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.037 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:19.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:19.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:19.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:19.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:19.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:19.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418824+0000", 2024-04-26T11:14:19.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:19.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418885+0000", 2024-04-26T11:14:19.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1294e-05 2024-04-26T11:14:19.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:19.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418892+0000", 2024-04-26T11:14:19.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4599999999999997e-06 2024-04-26T11:14:19.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.418899+0000", 2024-04-26T11:14:19.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0909999999999998e-06 2024-04-26T11:14:19.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421347+0000", 2024-04-26T11:14:19.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024484609999999999 2024-04-26T11:14:19.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:19.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421468+0000", 2024-04-26T11:14:19.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000121179 2024-04-26T11:14:19.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:19.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.421605+0000", 2024-04-26T11:14:19.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013672200000000001 2024-04-26T11:14:19.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:19.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.425456+0000", 2024-04-26T11:14:19.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038511719999999999 2024-04-26T11:14:19.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:19.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.439986+0000", 2024-04-26T11:14:19.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014530080000000001 2024-04-26T11:14:19.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:19.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440038+0000", 2024-04-26T11:14:19.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1916999999999998e-05 2024-04-26T11:14:19.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:19.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:48.440070+0000", 2024-04-26T11:14:19.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2245e-05 2024-04-26T11:14:19.042 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.042 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:19.042 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.042 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:44513 5.0 5:0a236ebb:::benchmark_data_smithi029_44842_object44512:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:19.042 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:19.042 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.86209362, 2024-04-26T11:14:19.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020724414, 2024-04-26T11:14:19.042 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:19.042 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.042 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:19.043 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:19.043 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.043 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 44513 2024-04-26T11:14:19.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.043 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:19.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:19.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:19.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:19.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:19.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:19.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170087+0000", 2024-04-26T11:14:19.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:19.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170120+0000", 2024-04-26T11:14:19.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2941000000000002e-05 2024-04-26T11:14:19.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:19.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170127+0000", 2024-04-26T11:14:19.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.469e-06 2024-04-26T11:14:19.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.170133+0000", 2024-04-26T11:14:19.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1340000000000001e-06 2024-04-26T11:14:19.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182383+0000", 2024-04-26T11:14:19.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012249970000000001 2024-04-26T11:14:19.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:19.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182477+0000", 2024-04-26T11:14:19.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3776999999999993e-05 2024-04-26T11:14:19.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:19.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.182572+0000", 2024-04-26T11:14:19.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4841999999999998e-05 2024-04-26T11:14:19.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:19.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.188262+0000", 2024-04-26T11:14:19.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005690077 2024-04-26T11:14:19.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:19.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190748+0000", 2024-04-26T11:14:19.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024857780000000001 2024-04-26T11:14:19.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:19.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190776+0000", 2024-04-26T11:14:19.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8419999999999999e-05 2024-04-26T11:14:19.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:19.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:52.190812+0000", 2024-04-26T11:14:19.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5630999999999998e-05 2024-04-26T11:14:19.048 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.048 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:19.048 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.048 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:19.048 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:19.048 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.753390597999999, 2024-04-26T11:14:19.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:14:19.048 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:19.048 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.048 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:19.048 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:19.049 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.049 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:14:19.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.049 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:19.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:19.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:19.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:19.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:19.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:19.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:19.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:19.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:14:19.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:14:19.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:19.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:14:19.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:14:19.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:14:19.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:14:19.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:14:19.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:14:19.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:19.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:14:19.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:14:19.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:19.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:14:19.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:14:19.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:19.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:14:19.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:14:19.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:19.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:14:19.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:14:19.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:19.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:14:19.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:14:19.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:19.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:14:19.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:14:19.055 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.055 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:19.055 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.055 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:19.055 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:19.055 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.752740895999999, 2024-04-26T11:14:19.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:14:19.055 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:19.055 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.056 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:19.056 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:19.056 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.056 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:14:19.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.056 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:19.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:19.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:19.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:19.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:19.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:19.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:14:19.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:19.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:19.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:14:19.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:14:19.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:19.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:14:19.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:14:19.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:14:19.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:14:19.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:14:19.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:14:19.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:19.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:14:19.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:14:19.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:19.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:14:19.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:14:19.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:19.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:14:19.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:14:19.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:19.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:14:19.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:14:19.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:19.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:14:19.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:14:19.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:19.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:14:19.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:14:19.061 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.061 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:19.061 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.061 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:55093 5.e 5:7ebffa9e:::benchmark_data_smithi029_44842_object55092:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:19.061 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:14:19.061 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.285609178000001, 2024-04-26T11:14:19.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020381660999999999, 2024-04-26T11:14:19.061 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:19.061 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.062 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:19.062 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:19.062 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.062 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 55093 2024-04-26T11:14:19.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.062 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:19.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:19.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:14:19.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:19.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746572+0000", 2024-04-26T11:14:19.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:19.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746571+0000", 2024-04-26T11:14:19.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:19.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746599+0000", 2024-04-26T11:14:19.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8262000000000001e-05 2024-04-26T11:14:19.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:19.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746610+0000", 2024-04-26T11:14:19.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1070000000000001e-05 2024-04-26T11:14:19.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.746617+0000", 2024-04-26T11:14:19.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8190000000000003e-06 2024-04-26T11:14:19.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748218+0000", 2024-04-26T11:14:19.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0016005889999999999 2024-04-26T11:14:19.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:19.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748350+0000", 2024-04-26T11:14:19.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132528 2024-04-26T11:14:19.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:19.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.748499+0000", 2024-04-26T11:14:19.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014815600000000001 2024-04-26T11:14:19.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:19.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.750795+0000", 2024-04-26T11:14:19.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022960369999999999 2024-04-26T11:14:19.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:19.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766866+0000", 2024-04-26T11:14:19.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016071230999999998 2024-04-26T11:14:19.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:19.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766922+0000", 2024-04-26T11:14:19.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6643e-05 2024-04-26T11:14:19.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:19.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:56.766953+0000", 2024-04-26T11:14:19.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0981e-05 2024-04-26T11:14:19.067 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.067 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:19.067 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.067 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:19.067 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:19.067 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.686098857000001, 2024-04-26T11:14:19.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:14:19.068 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:19.068 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:19.068 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:19.068 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:19.068 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.068 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:14:19.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.068 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:19.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:19.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:19.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:19.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:19.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:19.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:14:19.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:19.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:19.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:14:19.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:14:19.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:19.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:14:19.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:14:19.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:14:19.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:14:19.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.070 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.070 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.070 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:14:19.070 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:14:19.070 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:19.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:14:19.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:14:19.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:14:19.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:14:19.071 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.071 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.071 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:19.071 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:14:19.071 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:14:19.072 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.072 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:19.072 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.072 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.072 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:19.072 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:19.072 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.686003210999999, 2024-04-26T11:14:19.072 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:14:19.072 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:19.072 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:19.072 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:19.072 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:19.072 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.073 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:14:19.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.073 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:19.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:19.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:19.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:19.073 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:19.073 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.073 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.073 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.073 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:19.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:14:19.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:19.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:14:19.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:14:19.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.074 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:19.074 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:14:19.074 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:14:19.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.074 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:14:19.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:14:19.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:14:19.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:14:19.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.075 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:19.075 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:14:19.075 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:14:19.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.075 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:14:19.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:14:19.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.076 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:19.076 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:14:19.076 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:14:19.076 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.076 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:19.076 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.076 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.076 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:19.076 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:19.077 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.685871532, 2024-04-26T11:14:19.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:14:19.077 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:19.077 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:19.077 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:19.077 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:19.077 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.077 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:14:19.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.077 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:19.077 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.077 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:19.077 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:19.077 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:19.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:19.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.078 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.078 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:19.078 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:19.078 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:19.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:14:19.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:14:19.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:19.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:14:19.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:14:19.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.079 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.079 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.079 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:14:19.079 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:14:19.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:14:19.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:14:19.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:19.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:14:19.080 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:14:19.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.080 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.080 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.080 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:14:19.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:14:19.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.081 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:19.081 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:14:19.081 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:14:19.081 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.081 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:19.081 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.081 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.081 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:19.081 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:19.081 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.685763076000001, 2024-04-26T11:14:19.082 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:14:19.082 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:19.082 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:19.082 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:19.082 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:19.082 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.082 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:14:19.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.082 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:19.082 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.082 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:19.082 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:19.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:19.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:19.083 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.083 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.083 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:19.083 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:14:19.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:19.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:19.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:14:19.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:14:19.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:19.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:14:19.084 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:14:19.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.084 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.084 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.084 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:14:19.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:14:19.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:14:19.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:14:19.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:19.085 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:14:19.085 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:14:19.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.085 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.085 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:14:19.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:14:19.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.086 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:19.086 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:14:19.086 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:14:19.086 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.086 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:19.086 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.086 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.086 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:19.086 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:19.087 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.685661807999999, 2024-04-26T11:14:19.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:14:19.087 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:19.087 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.087 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:19.087 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:19.087 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.087 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:14:19.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.087 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:19.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.087 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:19.087 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:19.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:19.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:19.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:19.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:19.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:19.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:14:19.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:14:19.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:19.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:14:19.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:14:19.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:14:19.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:14:19.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:14:19.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:14:19.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:19.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:14:19.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:14:19.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:14:19.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:14:19.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:19.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:14:19.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:14:19.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:19.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:14:19.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:14:19.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:19.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:14:19.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:14:19.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:19.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:14:19.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:14:19.092 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.092 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:19.092 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.092 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:19.092 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:19.092 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.685592867, 2024-04-26T11:14:19.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:14:19.092 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:19.093 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.093 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:19.093 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:19.093 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.093 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:14:19.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.093 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:19.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.093 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:19.093 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:19.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:19.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:19.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:19.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:14:19.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:19.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:14:19.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:14:19.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:19.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:14:19.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:14:19.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:14:19.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:14:19.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:14:19.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:14:19.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:19.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:14:19.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:14:19.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:14:19.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:14:19.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:19.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:14:19.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:14:19.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:19.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:14:19.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:14:19.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:19.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:14:19.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:14:19.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:19.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:14:19.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:14:19.098 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.098 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:19.098 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.098 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:19.099 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:19.099 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.679597286, 2024-04-26T11:14:19.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:14:19.099 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:19.099 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.099 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:19.099 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:19.099 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.099 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:14:19.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.099 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:19.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:19.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:19.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:19.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:19.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:19.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:14:19.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:19.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:14:19.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:14:19.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:19.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:14:19.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:14:19.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:14:19.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:14:19.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:14:19.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:14:19.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:19.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:14:19.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:14:19.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:14:19.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:14:19.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:19.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:14:19.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:14:19.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:19.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:14:19.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:14:19.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.103 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:19.103 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:14:19.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:14:19.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:19.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:14:19.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:14:19.104 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.104 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:19.104 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.104 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:81256 5.8 5:1c0f3fd8:::benchmark_data_smithi029_44842_object81255:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:19.104 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:19.104 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.9161377369999997, 2024-04-26T11:14:19.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026193673000000001, 2024-04-26T11:14:19.104 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:19.105 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.105 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:19.105 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:19.105 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.105 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 81256 2024-04-26T11:14:19.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.105 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:19.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:19.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:19.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:19.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:19.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:19.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:19.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:19.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116073+0000", 2024-04-26T11:14:19.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0114e-05 2024-04-26T11:14:19.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:19.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116079+0000", 2024-04-26T11:14:19.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8939999999999998e-06 2024-04-26T11:14:19.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116082+0000", 2024-04-26T11:14:19.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:14:19.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127501+0000", 2024-04-26T11:14:19.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011418281000000001 2024-04-26T11:14:19.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:19.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127639+0000", 2024-04-26T11:14:19.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013828899999999999 2024-04-26T11:14:19.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:19.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127782+0000", 2024-04-26T11:14:19.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014328299999999999 2024-04-26T11:14:19.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:19.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.134767+0000", 2024-04-26T11:14:19.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0069844140000000004 2024-04-26T11:14:19.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:19.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142160+0000", 2024-04-26T11:14:19.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007392839 2024-04-26T11:14:19.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:19.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142202+0000", 2024-04-26T11:14:19.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2797999999999999e-05 2024-04-26T11:14:19.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:19.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142237+0000", 2024-04-26T11:14:19.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4464000000000001e-05 2024-04-26T11:14:19.110 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.110 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:19.110 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.110 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:82919 5.8 5:1863b1c3:::benchmark_data_smithi029_44842_object82918:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:19.110 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:10.837472+0000", 2024-04-26T11:14:19.110 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.1947089359999996, 2024-04-26T11:14:19.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020497832000000001, 2024-04-26T11:14:19.110 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:19.110 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.111 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:19.111 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:19.111 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.111 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 82919 2024-04-26T11:14:19.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.111 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:19.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:19.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.837472+0000", 2024-04-26T11:14:19.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:19.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.837472+0000", 2024-04-26T11:14:19.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:19.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.837471+0000", 2024-04-26T11:14:19.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:19.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:19.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.837532+0000", 2024-04-26T11:14:19.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1365000000000006e-05 2024-04-26T11:14:19.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:19.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.837542+0000", 2024-04-26T11:14:19.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2490000000000007e-06 2024-04-26T11:14:19.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.837549+0000", 2024-04-26T11:14:19.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5909999999999998e-06 2024-04-26T11:14:19.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.847015+0000", 2024-04-26T11:14:19.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0094659600000000007 2024-04-26T11:14:19.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:19.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.847134+0000", 2024-04-26T11:14:19.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011899 2024-04-26T11:14:19.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:19.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.847283+0000", 2024-04-26T11:14:19.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0001483 2024-04-26T11:14:19.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:19.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.852539+0000", 2024-04-26T11:14:19.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052565049999999999 2024-04-26T11:14:19.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:19.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.857887+0000", 2024-04-26T11:14:19.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053478789999999998 2024-04-26T11:14:19.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:19.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.857928+0000", 2024-04-26T11:14:19.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1439000000000001e-05 2024-04-26T11:14:19.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:19.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.857970+0000", 2024-04-26T11:14:19.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1448e-05 2024-04-26T11:14:19.115 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.115 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:19.116 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.116 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:83365 5.a 5:526f4e36:::benchmark_data_smithi029_44842_object83364:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:19.116 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:11.041087+0000", 2024-04-26T11:14:19.116 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.991093931, 2024-04-26T11:14:19.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020902897, 2024-04-26T11:14:19.116 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:19.116 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.116 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:19.116 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:19.116 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.116 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 83365 2024-04-26T11:14:19.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.117 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:19.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:19.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.041087+0000", 2024-04-26T11:14:19.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:19.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.041087+0000", 2024-04-26T11:14:19.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:19.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.041086+0000", 2024-04-26T11:14:19.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:19.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:19.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.041149+0000", 2024-04-26T11:14:19.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2738999999999997e-05 2024-04-26T11:14:19.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:19.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.041158+0000", 2024-04-26T11:14:19.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3100000000000006e-06 2024-04-26T11:14:19.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.041164+0000", 2024-04-26T11:14:19.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3489999999999997e-06 2024-04-26T11:14:19.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.043156+0000", 2024-04-26T11:14:19.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0019914170000000001 2024-04-26T11:14:19.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:19.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.043237+0000", 2024-04-26T11:14:19.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1442999999999999e-05 2024-04-26T11:14:19.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:19.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.043323+0000", 2024-04-26T11:14:19.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5507000000000007e-05 2024-04-26T11:14:19.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:19.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.045911+0000", 2024-04-26T11:14:19.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025878759999999998 2024-04-26T11:14:19.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:19.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.061916+0000", 2024-04-26T11:14:19.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016005130999999999 2024-04-26T11:14:19.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:19.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.061957+0000", 2024-04-26T11:14:19.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1329999999999999e-05 2024-04-26T11:14:19.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:19.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:11.061990+0000", 2024-04-26T11:14:19.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2703999999999997e-05 2024-04-26T11:14:19.121 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.121 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:19.121 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.121 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90441 5.4 5:2b047885:::benchmark_data_smithi029_44842_object90440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:19.121 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:19.122 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.8819743769999997, 2024-04-26T11:14:19.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026164084000000001, 2024-04-26T11:14:19.122 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:19.122 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.122 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:19.122 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:19.122 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.122 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90441 2024-04-26T11:14:19.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.122 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:19.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:19.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:19.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:19.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:19.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:19.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150206+0000", 2024-04-26T11:14:19.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:19.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150261+0000", 2024-04-26T11:14:19.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4580000000000003e-05 2024-04-26T11:14:19.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:19.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150269+0000", 2024-04-26T11:14:19.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9679999999999995e-06 2024-04-26T11:14:19.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150274+0000", 2024-04-26T11:14:19.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8470000000000003e-06 2024-04-26T11:14:19.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150312+0000", 2024-04-26T11:14:19.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7245e-05 2024-04-26T11:14:19.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:19.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150396+0000", 2024-04-26T11:14:19.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4778999999999996e-05 2024-04-26T11:14:19.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:19.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150491+0000", 2024-04-26T11:14:19.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4606999999999997e-05 2024-04-26T11:14:19.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:19.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.153991+0000", 2024-04-26T11:14:19.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035001339999999998 2024-04-26T11:14:19.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:19.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176295+0000", 2024-04-26T11:14:19.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022304280999999999 2024-04-26T11:14:19.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:19.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176335+0000", 2024-04-26T11:14:19.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:19.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:19.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176371+0000", 2024-04-26T11:14:19.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5448999999999999e-05 2024-04-26T11:14:19.127 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.127 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:19.127 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.127 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90446 5.4 5:2b42606b:::benchmark_data_smithi029_44842_object90445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:19.127 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.154339+0000", 2024-04-26T11:14:19.127 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.877842094, 2024-04-26T11:14:19.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022116655999999998, 2024-04-26T11:14:19.127 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:19.127 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.128 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:19.128 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:19.128 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.128 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90446 2024-04-26T11:14:19.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.128 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:19.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:19.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154339+0000", 2024-04-26T11:14:19.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:19.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154339+0000", 2024-04-26T11:14:19.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:19.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154338+0000", 2024-04-26T11:14:19.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:14:19.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:19.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154394+0000", 2024-04-26T11:14:19.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6066999999999997e-05 2024-04-26T11:14:19.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:19.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154407+0000", 2024-04-26T11:14:19.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3125000000000001e-05 2024-04-26T11:14:19.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154416+0000", 2024-04-26T11:14:19.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6139999999999998e-06 2024-04-26T11:14:19.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154442+0000", 2024-04-26T11:14:19.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5729e-05 2024-04-26T11:14:19.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:19.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154528+0000", 2024-04-26T11:14:19.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6292999999999995e-05 2024-04-26T11:14:19.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:19.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154622+0000", 2024-04-26T11:14:19.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3524999999999996e-05 2024-04-26T11:14:19.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:19.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.160002+0000", 2024-04-26T11:14:19.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053799620000000003 2024-04-26T11:14:19.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:19.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176378+0000", 2024-04-26T11:14:19.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016376196999999999 2024-04-26T11:14:19.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:19.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176418+0000", 2024-04-26T11:14:19.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0207999999999999e-05 2024-04-26T11:14:19.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:19.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176455+0000", 2024-04-26T11:14:19.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7184000000000002e-05 2024-04-26T11:14:19.132 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.132 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:19.133 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.133 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90447 5.4 5:20b0d61b:::benchmark_data_smithi029_44842_object90446:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:19.133 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.154427+0000", 2024-04-26T11:14:19.133 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.8777541160000002, 2024-04-26T11:14:19.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022110727, 2024-04-26T11:14:19.133 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:19.133 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.133 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:19.133 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:19.133 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.133 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90447 2024-04-26T11:14:19.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.133 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:19.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:19.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154427+0000", 2024-04-26T11:14:19.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:19.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154427+0000", 2024-04-26T11:14:19.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:19.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154426+0000", 2024-04-26T11:14:19.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:19.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154459+0000", 2024-04-26T11:14:19.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3198000000000003e-05 2024-04-26T11:14:19.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:19.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154470+0000", 2024-04-26T11:14:19.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0353999999999999e-05 2024-04-26T11:14:19.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154476+0000", 2024-04-26T11:14:19.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.426e-06 2024-04-26T11:14:19.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.156612+0000", 2024-04-26T11:14:19.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021359439999999999 2024-04-26T11:14:19.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:19.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.156757+0000", 2024-04-26T11:14:19.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000144714 2024-04-26T11:14:19.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:19.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.156844+0000", 2024-04-26T11:14:19.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7585999999999998e-05 2024-04-26T11:14:19.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:19.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.163874+0000", 2024-04-26T11:14:19.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007029474 2024-04-26T11:14:19.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:19.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176463+0000", 2024-04-26T11:14:19.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.012589301000000001 2024-04-26T11:14:19.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:19.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176504+0000", 2024-04-26T11:14:19.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0574999999999997e-05 2024-04-26T11:14:19.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:19.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176538+0000", 2024-04-26T11:14:19.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3784e-05 2024-04-26T11:14:19.141 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.141 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:19.141 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.141 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90452 5.4 5:292172c3:::benchmark_data_smithi029_44842_object90451:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:19.141 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.154968+0000", 2024-04-26T11:14:19.141 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.8772124530000003, 2024-04-26T11:14:19.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021657626999999999, 2024-04-26T11:14:19.141 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:19.141 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.141 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:19.142 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:19.142 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.142 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90452 2024-04-26T11:14:19.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.142 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:19.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:19.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154968+0000", 2024-04-26T11:14:19.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:19.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154968+0000", 2024-04-26T11:14:19.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:19.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154968+0000", 2024-04-26T11:14:19.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:19.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.154997+0000", 2024-04-26T11:14:19.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8878e-05 2024-04-26T11:14:19.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:19.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.155004+0000", 2024-04-26T11:14:19.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4619999999999999e-06 2024-04-26T11:14:19.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.155010+0000", 2024-04-26T11:14:19.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2260000000000002e-06 2024-04-26T11:14:19.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.158395+0000", 2024-04-26T11:14:19.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0033841689999999998 2024-04-26T11:14:19.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:19.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.158478+0000", 2024-04-26T11:14:19.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3351999999999997e-05 2024-04-26T11:14:19.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:19.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.158567+0000", 2024-04-26T11:14:19.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8900999999999995e-05 2024-04-26T11:14:19.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:19.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.164769+0000", 2024-04-26T11:14:19.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062019229999999998 2024-04-26T11:14:19.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:19.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176549+0000", 2024-04-26T11:14:19.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011779784999999999 2024-04-26T11:14:19.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:19.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176589+0000", 2024-04-26T11:14:19.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0382000000000001e-05 2024-04-26T11:14:19.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:19.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176626+0000", 2024-04-26T11:14:19.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7141000000000002e-05 2024-04-26T11:14:19.146 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.146 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:19.147 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.147 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90999 5.a 5:5fd33f6d:::benchmark_data_smithi029_44842_object90998:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:19.147 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.395362+0000", 2024-04-26T11:14:19.147 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.636818624, 2024-04-26T11:14:19.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.020657322999999998, 2024-04-26T11:14:19.147 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:19.147 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.147 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:19.147 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:19.147 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.147 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90999 2024-04-26T11:14:19.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.147 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:19.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:19.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.395362+0000", 2024-04-26T11:14:19.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:19.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.395362+0000", 2024-04-26T11:14:19.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:19.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:19.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.395361+0000", 2024-04-26T11:14:19.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:19.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:19.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.395429+0000", 2024-04-26T11:14:19.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7417999999999997e-05 2024-04-26T11:14:19.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:19.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.395442+0000", 2024-04-26T11:14:19.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.323e-05 2024-04-26T11:14:19.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.395448+0000", 2024-04-26T11:14:19.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7559999999999996e-06 2024-04-26T11:14:19.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:19.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.405164+0000", 2024-04-26T11:14:19.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0097160289999999993 2024-04-26T11:14:19.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:19.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.405273+0000", 2024-04-26T11:14:19.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000109036 2024-04-26T11:14:19.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:19.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.405391+0000", 2024-04-26T11:14:19.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011811099999999999 2024-04-26T11:14:19.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:19.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.412162+0000", 2024-04-26T11:14:19.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067710749999999997 2024-04-26T11:14:19.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:19.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.415970+0000", 2024-04-26T11:14:19.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038079680000000001 2024-04-26T11:14:19.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:19.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.415998+0000", 2024-04-26T11:14:19.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8249999999999999e-05 2024-04-26T11:14:19.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:19.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:19.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:19.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.416020+0000", 2024-04-26T11:14:19.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1375000000000001e-05 2024-04-26T11:14:19.152 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.152 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:19.152 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.152 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:19.152 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:19.152 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:19.154 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:19.159 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:19.153+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:19.254 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:19.253+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:19.333 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:19.333 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:19.333 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.333 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:102123 5.1 5:82fe1c4c:::benchmark_data_smithi029_44842_object102122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:19.333 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:19.324095+0000", 2024-04-26T11:14:19.333 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0065792530000000002, 2024-04-26T11:14:19.333 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0066125810000000002, 2024-04-26T11:14:19.333 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.333 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:19.333 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.334 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.334 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.334 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 102123 2024-04-26T11:14:19.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.334 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.334 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.334 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.334 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324095+0000", 2024-04-26T11:14:19.334 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.334 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.334 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.334 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324095+0000", 2024-04-26T11:14:19.334 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.335 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.335 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324095+0000", 2024-04-26T11:14:19.335 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.335 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.335 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324180+0000", 2024-04-26T11:14:19.335 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5266000000000007e-05 2024-04-26T11:14:19.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.335 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.335 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324187+0000", 2024-04-26T11:14:19.336 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.289e-06 2024-04-26T11:14:19.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.336 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.336 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324195+0000", 2024-04-26T11:14:19.336 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3139999999999998e-06 2024-04-26T11:14:19.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.336 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.336 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324233+0000", 2024-04-26T11:14:19.336 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8155000000000003e-05 2024-04-26T11:14:19.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.336 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.336 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324349+0000", 2024-04-26T11:14:19.337 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000116468 2024-04-26T11:14:19.337 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.337 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.337 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.337 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.337 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:102124 5.1 5:846302ab:::benchmark_data_smithi029_44842_object102123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:19.337 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:19.324203+0000", 2024-04-26T11:14:19.337 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0064712229999999999, 2024-04-26T11:14:19.337 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0065812379999999997, 2024-04-26T11:14:19.337 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.337 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:19.337 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.337 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.337 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.338 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 102124 2024-04-26T11:14:19.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.338 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.338 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.338 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324203+0000", 2024-04-26T11:14:19.338 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.338 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.338 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324203+0000", 2024-04-26T11:14:19.338 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.339 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.339 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324203+0000", 2024-04-26T11:14:19.339 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.339 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.339 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324271+0000", 2024-04-26T11:14:19.339 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7600000000000003e-05 2024-04-26T11:14:19.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.339 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.339 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324280+0000", 2024-04-26T11:14:19.339 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.0000000000000002e-06 2024-04-26T11:14:19.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.340 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.340 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324287+0000", 2024-04-26T11:14:19.340 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.52e-06 2024-04-26T11:14:19.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.340 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.340 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.326367+0000", 2024-04-26T11:14:19.340 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020801639999999998 2024-04-26T11:14:19.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.340 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.340 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.326495+0000", 2024-04-26T11:14:19.341 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000128183 2024-04-26T11:14:19.341 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.341 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.341 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.341 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:102122 5.4 e36/16 5:25d54f02:::benchmark_data_smithi029_44842_object102121:head v 36'6364, mlcod=36'6359)", 2024-04-26T11:14:19.341 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:19.324483+0000", 2024-04-26T11:14:19.341 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0061918870000000001, 2024-04-26T11:14:19.341 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0063680830000000001, 2024-04-26T11:14:19.341 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.341 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:19.341 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.341 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.342 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324483+0000", 2024-04-26T11:14:19.342 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.342 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.342 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324483+0000", 2024-04-26T11:14:19.342 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.342 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.342 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324482+0000", 2024-04-26T11:14:19.342 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:19.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.343 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.343 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324539+0000", 2024-04-26T11:14:19.343 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7068999999999999e-05 2024-04-26T11:14:19.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.343 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.343 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324548+0000", 2024-04-26T11:14:19.343 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3689999999999996e-06 2024-04-26T11:14:19.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.343 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.343 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324555+0000", 2024-04-26T11:14:19.343 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5520000000000001e-06 2024-04-26T11:14:19.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.344 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.344 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324588+0000", 2024-04-26T11:14:19.344 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3265000000000001e-05 2024-04-26T11:14:19.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.344 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.344 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324607+0000", 2024-04-26T11:14:19.344 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8444000000000002e-05 2024-04-26T11:14:19.344 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.344 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.344 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.344 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:102127 5.3 5:cd3c9c16:::benchmark_data_smithi029_44842_object102126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:19.345 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:19.324822+0000", 2024-04-26T11:14:19.345 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0058522929999999997, 2024-04-26T11:14:19.345 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.006092091, 2024-04-26T11:14:19.345 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.345 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:19.345 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.345 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.345 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.345 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 102127 2024-04-26T11:14:19.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.345 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.345 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.345 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.345 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324822+0000", 2024-04-26T11:14:19.346 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.346 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.346 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324822+0000", 2024-04-26T11:14:19.346 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.346 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.346 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324821+0000", 2024-04-26T11:14:19.346 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:19.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.346 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.347 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324869+0000", 2024-04-26T11:14:19.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7085000000000001e-05 2024-04-26T11:14:19.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.347 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.347 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324879+0000", 2024-04-26T11:14:19.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0576e-05 2024-04-26T11:14:19.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.347 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.347 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324887+0000", 2024-04-26T11:14:19.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9209999999999992e-06 2024-04-26T11:14:19.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.348 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.348 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.325603+0000", 2024-04-26T11:14:19.348 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00071570800000000001 2024-04-26T11:14:19.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.348 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.348 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.325736+0000", 2024-04-26T11:14:19.348 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013296599999999999 2024-04-26T11:14:19.348 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.348 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.348 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.348 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:102125 5.4 e36/16 5:2c224e59:::benchmark_data_smithi029_44842_object102124:head v 36'6365, mlcod=36'6359)", 2024-04-26T11:14:19.348 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:19.325767+0000", 2024-04-26T11:14:19.349 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0049077950000000004, 2024-04-26T11:14:19.349 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0052135699999999998, 2024-04-26T11:14:19.349 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.349 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:19.349 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.349 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.349 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.325767+0000", 2024-04-26T11:14:19.349 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.349 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.349 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.325767+0000", 2024-04-26T11:14:19.349 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.350 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.350 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.350 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.325766+0000", 2024-04-26T11:14:19.350 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.350 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.350 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.350 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.325826+0000", 2024-04-26T11:14:19.350 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.982e-05 2024-04-26T11:14:19.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.350 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.350 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.350 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.325835+0000", 2024-04-26T11:14:19.350 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9870000000000005e-06 2024-04-26T11:14:19.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.351 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.351 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.325842+0000", 2024-04-26T11:14:19.351 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3429999999999998e-06 2024-04-26T11:14:19.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.351 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.351 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.326458+0000", 2024-04-26T11:14:19.351 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00061578499999999999 2024-04-26T11:14:19.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.351 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.351 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.326476+0000", 2024-04-26T11:14:19.352 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7751999999999999e-05 2024-04-26T11:14:19.352 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.352 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.352 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.352 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.352 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:102128 5.6 5:61d40bd6:::benchmark_data_smithi029_44842_object102127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:19.352 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:19.325972+0000", 2024-04-26T11:14:19.352 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0047026780000000001, 2024-04-26T11:14:19.352 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0050702710000000003, 2024-04-26T11:14:19.352 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.352 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:19.352 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.352 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.352 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.353 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 102128 2024-04-26T11:14:19.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.353 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.353 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.353 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.325972+0000", 2024-04-26T11:14:19.353 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.353 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.353 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.325972+0000", 2024-04-26T11:14:19.353 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.353 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.354 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.325971+0000", 2024-04-26T11:14:19.354 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:19.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.354 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.354 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.326024+0000", 2024-04-26T11:14:19.354 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3248000000000002e-05 2024-04-26T11:14:19.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.354 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.354 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.326034+0000", 2024-04-26T11:14:19.354 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0046e-05 2024-04-26T11:14:19.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.355 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.355 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.326040+0000", 2024-04-26T11:14:19.355 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2489999999999998e-06 2024-04-26T11:14:19.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.355 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.355 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.355 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.326602+0000", 2024-04-26T11:14:19.355 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00056165900000000005 2024-04-26T11:14:19.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.355 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.355 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.355 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.326718+0000", 2024-04-26T11:14:19.355 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011593499999999999 2024-04-26T11:14:19.355 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.355 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.356 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.356 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:102129 5.5 5:a17938a2:::benchmark_data_smithi029_44842_object102128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:19.356 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:19.326305+0000", 2024-04-26T11:14:19.356 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0043696810000000003, 2024-04-26T11:14:19.356 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.004804755, 2024-04-26T11:14:19.356 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.356 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:19.356 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.356 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.356 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.356 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 102129 2024-04-26T11:14:19.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.356 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.357 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.326305+0000", 2024-04-26T11:14:19.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.357 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.326305+0000", 2024-04-26T11:14:19.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.357 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.326304+0000", 2024-04-26T11:14:19.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:19.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.358 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.358 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.326371+0000", 2024-04-26T11:14:19.358 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6482000000000005e-05 2024-04-26T11:14:19.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.358 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.358 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.326380+0000", 2024-04-26T11:14:19.358 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.55e-06 2024-04-26T11:14:19.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.358 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.358 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.326389+0000", 2024-04-26T11:14:19.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3550000000000005e-06 2024-04-26T11:14:19.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.326620+0000", 2024-04-26T11:14:19.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000231327 2024-04-26T11:14:19.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.326734+0000", 2024-04-26T11:14:19.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011390100000000001 2024-04-26T11:14:19.359 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.359 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.359 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.360 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:102130 5.0 e36/16 5:081f8a1a:::benchmark_data_smithi029_44842_object102129:head v 36'6436, mlcod=36'6434)", 2024-04-26T11:14:19.360 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:19.328478+0000", 2024-04-26T11:14:19.360 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0021966820000000001, 2024-04-26T11:14:19.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026975940000000002, 2024-04-26T11:14:19.360 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.360 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:19.360 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.360 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.360 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.328478+0000", 2024-04-26T11:14:19.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.361 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.361 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.328478+0000", 2024-04-26T11:14:19.361 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.361 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.361 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.328477+0000", 2024-04-26T11:14:19.361 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:19.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.361 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.361 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.328504+0000", 2024-04-26T11:14:19.361 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7144e-05 2024-04-26T11:14:19.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.362 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.362 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.328515+0000", 2024-04-26T11:14:19.362 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1059e-05 2024-04-26T11:14:19.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.362 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.362 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.362 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.328522+0000", 2024-04-26T11:14:19.362 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2750000000000001e-06 2024-04-26T11:14:19.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.362 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.362 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.362 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.328567+0000", 2024-04-26T11:14:19.362 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5328999999999999e-05 2024-04-26T11:14:19.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.363 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.363 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.328587+0000", 2024-04-26T11:14:19.363 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0472999999999999e-05 2024-04-26T11:14:19.363 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.363 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.363 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.363 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:102132 5.4 e36/16 5:2746b2bc:::benchmark_data_smithi029_44842_object102131:head v 36'6366, mlcod=36'6361)", 2024-04-26T11:14:19.363 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:19.328542+0000", 2024-04-26T11:14:19.363 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.002133139, 2024-04-26T11:14:19.363 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026913869999999999, 2024-04-26T11:14:19.363 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.364 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:19.364 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.328542+0000", 2024-04-26T11:14:19.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.328542+0000", 2024-04-26T11:14:19.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.365 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.328541+0000", 2024-04-26T11:14:19.365 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.365 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.365 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.328571+0000", 2024-04-26T11:14:19.365 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0487000000000001e-05 2024-04-26T11:14:19.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.365 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.365 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.328579+0000", 2024-04-26T11:14:19.365 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9759999999999995e-06 2024-04-26T11:14:19.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.366 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.366 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.328587+0000", 2024-04-26T11:14:19.366 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2359999999999998e-06 2024-04-26T11:14:19.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.366 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.366 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.328620+0000", 2024-04-26T11:14:19.366 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3042e-05 2024-04-26T11:14:19.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.366 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.366 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.328634+0000", 2024-04-26T11:14:19.367 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4701e-05 2024-04-26T11:14:19.367 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.367 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.367 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.367 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.367 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:102133 5.4 e36/16)", 2024-04-26T11:14:19.367 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:19.329321+0000", 2024-04-26T11:14:19.367 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0013535979999999999, 2024-04-26T11:14:19.367 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001965269, 2024-04-26T11:14:19.367 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.367 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:19.367 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.367 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.367 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.368 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.329321+0000", 2024-04-26T11:14:19.368 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.368 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.368 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.329321+0000", 2024-04-26T11:14:19.368 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.368 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.368 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.329320+0000", 2024-04-26T11:14:19.368 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.368 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.329382+0000", 2024-04-26T11:14:19.369 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1210999999999994e-05 2024-04-26T11:14:19.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.369 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.329390+0000", 2024-04-26T11:14:19.369 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7849999999999997e-06 2024-04-26T11:14:19.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.369 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.329401+0000", 2024-04-26T11:14:19.369 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0750999999999999e-05 2024-04-26T11:14:19.369 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.369 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.370 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.370 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.370 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:102135 5.1 5:8dd2f7c2:::benchmark_data_smithi029_44842_object102134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:19.370 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:19.329736+0000", 2024-04-26T11:14:19.370 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00093870300000000004, 2024-04-26T11:14:19.370 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016008769999999999, 2024-04-26T11:14:19.370 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.370 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:19.370 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.370 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.370 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.370 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 102135 2024-04-26T11:14:19.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.371 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.371 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.371 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.371 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.329736+0000", 2024-04-26T11:14:19.371 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.371 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.371 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.371 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.329736+0000", 2024-04-26T11:14:19.371 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.371 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.371 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.371 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.329735+0000", 2024-04-26T11:14:19.371 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:19.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.372 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.372 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.329795+0000", 2024-04-26T11:14:19.372 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0009000000000001e-05 2024-04-26T11:14:19.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.372 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.372 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.329804+0000", 2024-04-26T11:14:19.372 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2110000000000004e-06 2024-04-26T11:14:19.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.372 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.372 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.329813+0000", 2024-04-26T11:14:19.372 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9169999999999995e-06 2024-04-26T11:14:19.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.373 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.373 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.373 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.329854+0000", 2024-04-26T11:14:19.373 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1096000000000001e-05 2024-04-26T11:14:19.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.373 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.373 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.373 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.329999+0000", 2024-04-26T11:14:19.373 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014447700000000001 2024-04-26T11:14:19.373 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.373 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.373 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.374 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.374 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:102136 5.7 5:ee93117e:::benchmark_data_smithi029_44842_object102135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:19.374 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:19.329829+0000", 2024-04-26T11:14:19.374 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00084536500000000005, 2024-04-26T11:14:19.374 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0015760679999999999, 2024-04-26T11:14:19.374 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.374 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:19.374 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.374 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.374 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.374 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 102136 2024-04-26T11:14:19.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.374 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.375 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.375 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.329829+0000", 2024-04-26T11:14:19.375 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.375 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.375 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.329829+0000", 2024-04-26T11:14:19.375 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.375 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.375 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.329829+0000", 2024-04-26T11:14:19.375 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.376 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.376 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.329874+0000", 2024-04-26T11:14:19.376 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5469999999999997e-05 2024-04-26T11:14:19.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.376 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.376 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.329881+0000", 2024-04-26T11:14:19.376 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2869999999999999e-06 2024-04-26T11:14:19.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.376 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.376 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.329888+0000", 2024-04-26T11:14:19.377 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.348e-06 2024-04-26T11:14:19.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.377 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.377 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.329936+0000", 2024-04-26T11:14:19.377 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8270999999999999e-05 2024-04-26T11:14:19.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.377 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.377 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.330089+0000", 2024-04-26T11:14:19.377 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015336899999999999 2024-04-26T11:14:19.377 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.377 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.377 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.378 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.378 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:102137 5.e e36/16)", 2024-04-26T11:14:19.378 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:19.331374+0000", 2024-04-26T11:14:19.378 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9993005, 2024-04-26T11:14:19.378 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.9554000000000003e-05, 2024-04-26T11:14:19.378 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.378 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:19.378 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.378 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.378 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.378 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.331374+0000", 2024-04-26T11:14:19.378 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.379 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.379 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.331374+0000", 2024-04-26T11:14:19.379 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.379 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.379 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.331374+0000", 2024-04-26T11:14:19.379 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.379 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.379 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.331426+0000", 2024-04-26T11:14:19.379 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1924e-05 2024-04-26T11:14:19.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.380 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.380 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.331435+0000", 2024-04-26T11:14:19.380 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.8019999999999998e-06 2024-04-26T11:14:19.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.380 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.380 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.331439+0000", 2024-04-26T11:14:19.380 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4379999999999997e-06 2024-04-26T11:14:19.380 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.380 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.380 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.381 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:102114 5.4 e36/16 5:255621a3:::benchmark_data_smithi029_44842_object102113:head v 36'6363, mlcod=36'6359)", 2024-04-26T11:14:19.381 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:19.318461+0000", 2024-04-26T11:14:19.381 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.012214084, 2024-04-26T11:14:19.381 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.013063744, 2024-04-26T11:14:19.381 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.381 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:19.381 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.381 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.381 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.318461+0000", 2024-04-26T11:14:19.381 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.381 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.381 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.318461+0000", 2024-04-26T11:14:19.382 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.382 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.382 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.382 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.318460+0000", 2024-04-26T11:14:19.382 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.382 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.382 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.382 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.318554+0000", 2024-04-26T11:14:19.382 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3795999999999994e-05 2024-04-26T11:14:19.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.382 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.383 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.383 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.318562+0000", 2024-04-26T11:14:19.383 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4300000000000006e-06 2024-04-26T11:14:19.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.383 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.383 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.318568+0000", 2024-04-26T11:14:19.383 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:14:19.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.383 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.383 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.320730+0000", 2024-04-26T11:14:19.383 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002161764 2024-04-26T11:14:19.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.384 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.384 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.320754+0000", 2024-04-26T11:14:19.384 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4383999999999999e-05 2024-04-26T11:14:19.384 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.384 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.384 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.384 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.385 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:102118 5.5 5:a14d58a1:::benchmark_data_smithi029_44842_object102117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:19.385 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:19.322315+0000", 2024-04-26T11:14:19.385 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0083593339999999995, 2024-04-26T11:14:19.385 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0092735379999999996, 2024-04-26T11:14:19.385 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.385 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:19.385 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.385 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.385 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.385 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 102118 2024-04-26T11:14:19.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.385 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.385 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.385 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.385 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.322315+0000", 2024-04-26T11:14:19.386 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.386 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.386 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.386 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.322315+0000", 2024-04-26T11:14:19.386 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.386 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.386 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.386 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.322315+0000", 2024-04-26T11:14:19.386 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:19.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.386 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.386 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.387 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.322377+0000", 2024-04-26T11:14:19.387 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2833e-05 2024-04-26T11:14:19.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.387 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.387 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.322386+0000", 2024-04-26T11:14:19.387 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6489999999999997e-06 2024-04-26T11:14:19.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.387 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.387 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.322391+0000", 2024-04-26T11:14:19.387 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3580000000000002e-06 2024-04-26T11:14:19.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.388 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.388 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324742+0000", 2024-04-26T11:14:19.388 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0023509199999999998 2024-04-26T11:14:19.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.388 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.388 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.388 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:19.324870+0000", 2024-04-26T11:14:19.388 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000128126 2024-04-26T11:14:19.388 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.388 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.388 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.388 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.388 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:14:19.388 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 15 2024-04-26T11:14:19.388 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:19.390 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:19.391 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:19.389+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:19.413 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 41 16 102328 102312 155.949 138.625 0.00889502 0.00640983 2024-04-26T11:14:19.491 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:19.490+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:19.574 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:19.575 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:14:19.575 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:14:19.575 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:14:19.575 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:19.590 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:19.592 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:19.591+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:19.694 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:19.692+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:19.775 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:19.775 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:14:19.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:14:19.776 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:19.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.776 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:19.776 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:19.776 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 26.500487191000001, 2024-04-26T11:14:19.777 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:14:19.777 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.777 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.777 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.777 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.778 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.778 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:14:19.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.778 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.778 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.779 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.779 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:19.779 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.779 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.780 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:19.780 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.780 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.780 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:14:19.781 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.781 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.781 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.781 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:14:19.781 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:14:19.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.782 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.783 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:14:19.783 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:14:19.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.783 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.783 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.783 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:14:19.784 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:14:19.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.784 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.784 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:14:19.784 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:14:19.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.785 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.785 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:14:19.785 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:14:19.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.786 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:19.786 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:14:19.786 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:14:19.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.787 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.787 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:19.787 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:14:19.787 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:14:19.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.788 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:19.788 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:14:19.788 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:14:19.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.789 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:19.789 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:14:19.789 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:14:19.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.789 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:19.790 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:14:19.790 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:14:19.790 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.790 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.790 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.791 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:19.791 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:19.791 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 26.499675625999998, 2024-04-26T11:14:19.791 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:14:19.792 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.792 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.792 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.792 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.792 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.792 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:14:19.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.793 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.793 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.793 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:19.793 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.794 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.794 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:19.794 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.795 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.795 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:19.795 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:19.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.796 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.796 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:14:19.796 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:14:19.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.797 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.797 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:14:19.797 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:14:19.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.797 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.797 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.798 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:14:19.798 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:14:19.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.798 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.798 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.799 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:14:19.799 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:14:19.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.799 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.799 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:14:19.800 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:14:19.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.800 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:19.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:14:19.800 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:14:19.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.801 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:19.801 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:14:19.801 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:14:19.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.802 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:19.802 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:14:19.802 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:14:19.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.803 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:19.803 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:14:19.803 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:14:19.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.804 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:19.804 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:14:19.804 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:14:19.804 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.804 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.804 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.805 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:19.805 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:19.805 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 26.492488788999999, 2024-04-26T11:14:19.805 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:14:19.806 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.806 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.806 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.806 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.806 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.807 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:14:19.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.807 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.807 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.807 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:19.808 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.808 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.808 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.808 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:19.808 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.809 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.809 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.809 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:14:19.809 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:19.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.810 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.810 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.810 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:14:19.810 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:14:19.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.811 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.811 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:14:19.811 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:14:19.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.812 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.812 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:14:19.812 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:14:19.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.812 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.812 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.813 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:14:19.813 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:14:19.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.813 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.813 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.814 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:14:19.814 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:14:19.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.814 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.814 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:19.814 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:14:19.815 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:14:19.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.815 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.815 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:19.815 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:14:19.815 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:14:19.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.816 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.816 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:19.816 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:14:19.816 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:14:19.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.816 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.816 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:19.816 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:14:19.816 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:14:19.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.817 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.817 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:19.817 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:14:19.817 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:14:19.817 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.817 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.818 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.818 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.818 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.818 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:19.818 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:19.818 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 26.49194791, 2024-04-26T11:14:19.818 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:14:19.818 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.818 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:14:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:19.820 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.820 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.820 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.820 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.820 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:19.820 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.820 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.820 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.820 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.820 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:14:19.820 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:14:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:14:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:14:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:14:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:14:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:14:19.822 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:14:19.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.822 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.822 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.822 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:14:19.822 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:14:19.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.822 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.822 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:14:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:14:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:14:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:14:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:14:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:14:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:14:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:14:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:14:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:14:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:55119 5.6 5:6ad50111:::benchmark_data_smithi029_44842_object55118:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:19.825 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:19.825 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 23.010884256000001, 2024-04-26T11:14:19.825 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018830264999999999, 2024-04-26T11:14:19.825 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.825 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.825 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.825 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.825 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.825 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 55119 2024-04-26T11:14:19.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.825 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.826 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.826 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.826 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:19.826 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.826 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.826 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.826 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760349+0000", 2024-04-26T11:14:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760402+0000", 2024-04-26T11:14:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2695999999999998e-05 2024-04-26T11:14:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760411+0000", 2024-04-26T11:14:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.0589999999999992e-06 2024-04-26T11:14:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760416+0000", 2024-04-26T11:14:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.587e-06 2024-04-26T11:14:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767638+0000", 2024-04-26T11:14:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0072214050000000002 2024-04-26T11:14:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767760+0000", 2024-04-26T11:14:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000122067 2024-04-26T11:14:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767927+0000", 2024-04-26T11:14:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00016747999999999999 2024-04-26T11:14:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.770877+0000", 2024-04-26T11:14:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002949335 2024-04-26T11:14:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779130+0000", 2024-04-26T11:14:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.008253491 2024-04-26T11:14:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779158+0000", 2024-04-26T11:14:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7849000000000001e-05 2024-04-26T11:14:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779180+0000", 2024-04-26T11:14:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2048999999999998e-05 2024-04-26T11:14:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 22.448763462999999, 2024-04-26T11:14:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:14:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:14:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:14:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:14:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:14:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:14:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:14:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:14:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:14:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:14:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:14:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:14:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:14:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:14:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:14:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:14:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:14:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:14:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:14:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:14:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:14:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:14:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:14:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:19.837 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:14:19.837 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:14:19.837 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.837 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.837 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.837 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.837 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.837 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:19.837 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:19.837 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 22.446570123000001, 2024-04-26T11:14:19.837 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:14:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:14:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:14:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:14:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:14:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:14:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:14:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:14:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:14:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:14:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:14:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:14:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:14:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:14:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:14:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:14:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:14:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:14:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:14:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:14:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:14:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:14:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:14:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:14:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:14:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 22.441358299000001, 2024-04-26T11:14:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:14:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:14:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:14:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:14:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:14:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:14:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:14:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:14:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:14:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.847 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:14:19.847 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:14:19.847 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.847 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.847 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.847 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:14:19.847 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:14:19.847 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.847 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.847 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:19.848 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:14:19.848 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:14:19.848 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.848 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.848 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:14:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:14:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:14:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:14:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:14:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:14:19.850 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.850 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.850 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.850 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:14:19.850 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:14:19.850 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.850 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.850 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:19.850 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:14:19.850 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:14:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 22.424909598999999, 2024-04-26T11:14:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:14:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.852 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.852 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:14:19.852 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.852 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.852 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:14:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:19.854 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.854 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.854 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.854 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:14:19.854 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:14:19.854 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.854 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.854 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.854 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:14:19.854 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:14:19.854 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.854 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:14:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:14:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:14:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:14:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:14:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:14:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:14:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:14:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:14:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:14:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 22.423212094, 2024-04-26T11:14:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:14:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:14:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.858 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:19.858 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.858 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.858 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.858 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.858 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:19.858 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:14:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:14:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:14:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:14:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:14:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:14:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:14:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:14:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:14:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:14:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:14:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:14:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:14:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:14:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:14:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.862 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.862 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:19.862 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:19.862 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 22.423147792000002, 2024-04-26T11:14:19.862 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:14:19.862 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.862 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.862 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.862 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.863 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.863 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:14:19.863 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.863 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.863 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.863 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.863 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:19.863 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.863 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.863 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.863 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.863 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:19.864 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.864 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.864 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.864 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.864 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:19.864 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.864 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.864 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.864 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.864 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:14:19.864 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:14:19.864 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.864 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.864 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.865 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:14:19.865 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:14:19.865 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.865 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.865 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.865 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:14:19.865 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:14:19.865 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.865 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.865 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.865 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:14:19.865 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:14:19.866 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.866 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.866 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:19.866 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:14:19.866 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:14:19.866 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.866 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.866 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.866 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:14:19.866 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:14:19.866 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.866 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:14:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:14:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:14:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:14:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:14:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:14:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:14:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:14:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 22.423093567999999, 2024-04-26T11:14:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:14:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:14:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:14:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:14:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:14:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:14:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:14:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:14:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:14:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:14:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.873 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.873 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:19.873 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:14:19.873 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:14:19.873 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.873 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.873 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.873 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:14:19.873 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:14:19.874 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.874 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.874 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.874 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:14:19.874 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:14:19.874 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.874 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.874 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:19.874 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:14:19.874 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:14:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:14:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:14:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:14:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 22.423049056, 2024-04-26T11:14:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:14:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:14:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:14:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:14:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:14:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:14:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:14:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:14:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:14:19.879 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.879 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.879 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.879 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:14:19.879 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:14:19.879 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.879 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.879 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:19.879 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:14:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:14:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:14:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:14:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:14:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:14:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:14:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:14:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:14:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:14:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:14:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:14:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 22.418828053999999, 2024-04-26T11:14:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:14:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:14:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.884 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:14:19.884 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:14:19.884 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.884 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.884 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.884 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:14:19.884 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:14:19.885 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.885 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.885 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.885 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:14:19.885 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:14:19.885 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.885 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.885 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.885 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:14:19.885 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:14:19.885 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.885 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:14:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:14:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:14:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:14:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:14:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:14:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:14:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:14:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:14:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:14:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:14:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:14:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:14:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:14:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:61817 5.a 5:5627ce7f:::benchmark_data_smithi029_44842_object61816:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 19.068702600999998, 2024-04-26T11:14:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020626958000000001, 2024-04-26T11:14:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 61817 2024-04-26T11:14:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.890 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:19.890 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.890 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.890 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.890 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.890 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:19.890 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.890 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.890 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.890 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702591+0000", 2024-04-26T11:14:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0665999999999998e-05 2024-04-26T11:14:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702599+0000", 2024-04-26T11:14:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7130000000000005e-06 2024-04-26T11:14:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702605+0000", 2024-04-26T11:14:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4310000000000002e-06 2024-04-26T11:14:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.707947+0000", 2024-04-26T11:14:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053424220000000003 2024-04-26T11:14:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.708052+0000", 2024-04-26T11:14:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010499 2024-04-26T11:14:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:14:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.708141+0000", 2024-04-26T11:14:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9514999999999999e-05 2024-04-26T11:14:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.711954+0000", 2024-04-26T11:14:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003812265 2024-04-26T11:14:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723070+0000", 2024-04-26T11:14:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011116727 2024-04-26T11:14:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.894 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.894 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:19.894 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723121+0000", 2024-04-26T11:14:19.894 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0362999999999999e-05 2024-04-26T11:14:19.894 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.894 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.894 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:19.894 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723158+0000", 2024-04-26T11:14:19.894 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7579000000000001e-05 2024-04-26T11:14:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:75771 5.c 5:3cc8f1b4:::benchmark_data_smithi029_44842_object75770:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T11:14:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 13.018258257999999, 2024-04-26T11:14:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019437949, 2024-04-26T11:14:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 75771 2024-04-26T11:14:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752975+0000", 2024-04-26T11:14:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753061+0000", 2024-04-26T11:14:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5890999999999995e-05 2024-04-26T11:14:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753071+0000", 2024-04-26T11:14:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.9990000000000003e-06 2024-04-26T11:14:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753078+0000", 2024-04-26T11:14:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1559999999999998e-06 2024-04-26T11:14:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.758559+0000", 2024-04-26T11:14:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0054812819999999996 2024-04-26T11:14:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.758692+0000", 2024-04-26T11:14:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000133301 2024-04-26T11:14:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.899 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.899 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:19.899 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772277+0000", 2024-04-26T11:14:19.899 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.013584839 2024-04-26T11:14:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772340+0000", 2024-04-26T11:14:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2360999999999995e-05 2024-04-26T11:14:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772414+0000", 2024-04-26T11:14:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4024999999999997e-05 2024-04-26T11:14:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83359 5.2 5:4939888c:::benchmark_data_smithi029_44842_object83358:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.7316676730000005, 2024-04-26T11:14:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018705583000000001, 2024-04-26T11:14:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83359 2024-04-26T11:14:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.906 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.906 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.906 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039625+0000", 2024-04-26T11:14:19.906 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9162e-05 2024-04-26T11:14:19.906 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.906 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.906 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.906 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039632+0000", 2024-04-26T11:14:19.906 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5399999999999998e-06 2024-04-26T11:14:19.906 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.906 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.906 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.906 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039638+0000", 2024-04-26T11:14:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1850000000000003e-06 2024-04-26T11:14:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.042375+0000", 2024-04-26T11:14:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0027371510000000002 2024-04-26T11:14:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.042502+0000", 2024-04-26T11:14:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000126966 2024-04-26T11:14:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058154+0000", 2024-04-26T11:14:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015652657 2024-04-26T11:14:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058201+0000", 2024-04-26T11:14:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6579000000000002e-05 2024-04-26T11:14:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058272+0000", 2024-04-26T11:14:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1009999999999999e-05 2024-04-26T11:14:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83360 5.2 5:42f8bfcd:::benchmark_data_smithi029_44842_object83359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.7315886840000001, 2024-04-26T11:14:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022279782000000001, 2024-04-26T11:14:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83360 2024-04-26T11:14:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.911 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.911 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:19.911 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.911 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.911 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.911 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.911 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039700+0000", 2024-04-26T11:14:19.911 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5541000000000002e-05 2024-04-26T11:14:19.911 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.911 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.911 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.911 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039706+0000", 2024-04-26T11:14:19.911 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3680000000000001e-06 2024-04-26T11:14:19.911 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039709+0000", 2024-04-26T11:14:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4659999999999999e-06 2024-04-26T11:14:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056305+0000", 2024-04-26T11:14:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016595649000000001 2024-04-26T11:14:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056487+0000", 2024-04-26T11:14:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000181886 2024-04-26T11:14:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061809+0000", 2024-04-26T11:14:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053223259999999996 2024-04-26T11:14:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061852+0000", 2024-04-26T11:14:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2738999999999999e-05 2024-04-26T11:14:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061925+0000", 2024-04-26T11:14:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3180000000000001e-05 2024-04-26T11:14:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83364 5.2 5:42c5cd8c:::benchmark_data_smithi029_44842_object83363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.7311729440000008, 2024-04-26T11:14:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022695336, 2024-04-26T11:14:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83364 2024-04-26T11:14:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040060+0000", 2024-04-26T11:14:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040086+0000", 2024-04-26T11:14:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5482000000000001e-05 2024-04-26T11:14:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040093+0000", 2024-04-26T11:14:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6409999999999996e-06 2024-04-26T11:14:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040098+0000", 2024-04-26T11:14:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879999999999996e-06 2024-04-26T11:14:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058292+0000", 2024-04-26T11:14:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018193504999999999 2024-04-26T11:14:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058412+0000", 2024-04-26T11:14:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011979199999999999 2024-04-26T11:14:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062642+0000", 2024-04-26T11:14:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042299449999999997 2024-04-26T11:14:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062688+0000", 2024-04-26T11:14:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6859e-05 2024-04-26T11:14:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062756+0000", 2024-04-26T11:14:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7995000000000002e-05 2024-04-26T11:14:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83378 5.2 5:44b3209a:::benchmark_data_smithi029_44842_object83377:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.7234524909999998, 2024-04-26T11:14:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020722529, 2024-04-26T11:14:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83378 2024-04-26T11:14:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047781+0000", 2024-04-26T11:14:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047832+0000", 2024-04-26T11:14:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1687000000000002e-05 2024-04-26T11:14:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047842+0000", 2024-04-26T11:14:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2439999999999999e-06 2024-04-26T11:14:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047847+0000", 2024-04-26T11:14:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6500000000000001e-06 2024-04-26T11:14:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.060082+0000", 2024-04-26T11:14:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.012235105 2024-04-26T11:14:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.060191+0000", 2024-04-26T11:14:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000108665 2024-04-26T11:14:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068363+0000", 2024-04-26T11:14:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0081715829999999996 2024-04-26T11:14:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068418+0000", 2024-04-26T11:14:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4984000000000001e-05 2024-04-26T11:14:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068504+0000", 2024-04-26T11:14:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6520000000000005e-05 2024-04-26T11:14:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:19.924 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:19.924 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:19.925 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:19.926 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:19.924+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:20.026 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:20.025+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:20.093 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:20.093 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:20.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.093 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:103742 5.9 5:913bb1bc:::benchmark_data_smithi029_44842_object103741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:20.093 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:20.082774+0000", 2024-04-26T11:14:20.093 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0083717740000000002, 2024-04-26T11:14:20.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0084018960000000007, 2024-04-26T11:14:20.093 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:20.093 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:20.093 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:20.094 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:20.094 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:20.094 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 103742 2024-04-26T11:14:20.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.094 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:20.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:20.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.082774+0000", 2024-04-26T11:14:20.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:20.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:20.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.082774+0000", 2024-04-26T11:14:20.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:20.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:20.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.082766+0000", 2024-04-26T11:14:20.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999919 2024-04-26T11:14:20.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:20.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.082820+0000", 2024-04-26T11:14:20.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3541000000000001e-05 2024-04-26T11:14:20.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:20.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.082830+0000", 2024-04-26T11:14:20.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004e-05 2024-04-26T11:14:20.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:20.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.082837+0000", 2024-04-26T11:14:20.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4080000000000001e-06 2024-04-26T11:14:20.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:20.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.085379+0000", 2024-04-26T11:14:20.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025416829999999999 2024-04-26T11:14:20.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:20.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.085501+0000", 2024-04-26T11:14:20.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012156500000000001 2024-04-26T11:14:20.099 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:20.099 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:20.099 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:20.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.101 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:103743 5.d 5:b981cf64:::benchmark_data_smithi029_44842_object103742:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:20.101 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:20.083321+0000", 2024-04-26T11:14:20.101 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0078249770000000003, 2024-04-26T11:14:20.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0079379489999999997, 2024-04-26T11:14:20.101 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:20.101 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:20.101 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:20.101 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:20.101 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:20.101 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 103743 2024-04-26T11:14:20.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.101 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:20.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:20.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.083321+0000", 2024-04-26T11:14:20.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:20.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:20.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.083321+0000", 2024-04-26T11:14:20.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:20.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:20.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.083320+0000", 2024-04-26T11:14:20.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:20.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:20.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.083377+0000", 2024-04-26T11:14:20.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6464e-05 2024-04-26T11:14:20.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:20.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.083386+0000", 2024-04-26T11:14:20.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5650000000000007e-06 2024-04-26T11:14:20.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:20.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.083393+0000", 2024-04-26T11:14:20.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8979999999999999e-06 2024-04-26T11:14:20.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:20.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.083656+0000", 2024-04-26T11:14:20.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00026297099999999997 2024-04-26T11:14:20.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:20.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.083743+0000", 2024-04-26T11:14:20.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6995000000000003e-05 2024-04-26T11:14:20.108 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:20.108 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:20.108 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:20.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.108 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:103745 5.4 5:2778dbea:::benchmark_data_smithi029_44842_object103744:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:20.108 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:20.084460+0000", 2024-04-26T11:14:20.108 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0066858719999999998, 2024-04-26T11:14:20.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0068809079999999998, 2024-04-26T11:14:20.108 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:20.108 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:20.108 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:20.109 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:20.109 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:20.109 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 103745 2024-04-26T11:14:20.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.109 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:20.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:20.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.084460+0000", 2024-04-26T11:14:20.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:20.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:20.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.084460+0000", 2024-04-26T11:14:20.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:20.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:20.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.084459+0000", 2024-04-26T11:14:20.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:20.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:20.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.084545+0000", 2024-04-26T11:14:20.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5908000000000005e-05 2024-04-26T11:14:20.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:20.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.084554+0000", 2024-04-26T11:14:20.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7450000000000001e-06 2024-04-26T11:14:20.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.112 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:20.112 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.084559+0000", 2024-04-26T11:14:20.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.164e-06 2024-04-26T11:14:20.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:20.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.084600+0000", 2024-04-26T11:14:20.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1130000000000001e-05 2024-04-26T11:14:20.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:20.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.084738+0000", 2024-04-26T11:14:20.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137222 2024-04-26T11:14:20.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:20.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.084821+0000", 2024-04-26T11:14:20.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3798e-05 2024-04-26T11:14:20.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:20.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.088588+0000", 2024-04-26T11:14:20.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037660910000000001 2024-04-26T11:14:20.114 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:20.114 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:20.114 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:20.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.114 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:103749 5.8 5:18df3488:::benchmark_data_smithi029_44842_object103748:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:20.114 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:20.085990+0000", 2024-04-26T11:14:20.114 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.005156211, 2024-04-26T11:14:20.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054373049999999999, 2024-04-26T11:14:20.114 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:20.115 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:20.115 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:20.115 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:20.115 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:20.115 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 103749 2024-04-26T11:14:20.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.115 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:20.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:20.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.085990+0000", 2024-04-26T11:14:20.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:20.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.085990+0000", 2024-04-26T11:14:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.085989+0000", 2024-04-26T11:14:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.086104+0000", 2024-04-26T11:14:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000114473 2024-04-26T11:14:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.086119+0000", 2024-04-26T11:14:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5075999999999999e-05 2024-04-26T11:14:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.086127+0000", 2024-04-26T11:14:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2889999999999998e-06 2024-04-26T11:14:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.086156+0000", 2024-04-26T11:14:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8600999999999999e-05 2024-04-26T11:14:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.086235+0000", 2024-04-26T11:14:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9658000000000002e-05 2024-04-26T11:14:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.086327+0000", 2024-04-26T11:14:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1316999999999993e-05 2024-04-26T11:14:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.091355+0000", 2024-04-26T11:14:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005028416 2024-04-26T11:14:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:20.119 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:20.119 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:20.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.119 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:103752 5.9 5:90ff999a:::benchmark_data_smithi029_44842_object103751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:20.119 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:20.087249+0000", 2024-04-26T11:14:20.119 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0038969370000000001, 2024-04-26T11:14:20.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0042822499999999996, 2024-04-26T11:14:20.119 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:20.119 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:20.119 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:20.119 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:20.120 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:20.120 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 103752 2024-04-26T11:14:20.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.120 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:20.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:20.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.087249+0000", 2024-04-26T11:14:20.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:20.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:20.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.087249+0000", 2024-04-26T11:14:20.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:20.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.087248+0000", 2024-04-26T11:14:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.087316+0000", 2024-04-26T11:14:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7805000000000006e-05 2024-04-26T11:14:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.087344+0000", 2024-04-26T11:14:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8557000000000001e-05 2024-04-26T11:14:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:20.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.087358+0000", 2024-04-26T11:14:20.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3910999999999999e-05 2024-04-26T11:14:20.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:20.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.088541+0000", 2024-04-26T11:14:20.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00118234 2024-04-26T11:14:20.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:20.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.088662+0000", 2024-04-26T11:14:20.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000121669 2024-04-26T11:14:20.123 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:20.123 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:20.123 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:20.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.124 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:103753 5.0 5:01967a08:::benchmark_data_smithi029_44842_object103752:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:20.124 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:20.087369+0000", 2024-04-26T11:14:20.124 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0037771810000000001, 2024-04-26T11:14:20.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0042401840000000001, 2024-04-26T11:14:20.125 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:20.125 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:20.125 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:20.125 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:20.125 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:20.125 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 103753 2024-04-26T11:14:20.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.126 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:20.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:20.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.087369+0000", 2024-04-26T11:14:20.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:20.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:20.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.087369+0000", 2024-04-26T11:14:20.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:20.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:20.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.087368+0000", 2024-04-26T11:14:20.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:20.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:20.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.087395+0000", 2024-04-26T11:14:20.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.635e-05 2024-04-26T11:14:20.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.087404+0000", 2024-04-26T11:14:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7270000000000002e-06 2024-04-26T11:14:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.087412+0000", 2024-04-26T11:14:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4080000000000001e-06 2024-04-26T11:14:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.087439+0000", 2024-04-26T11:14:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7373999999999999e-05 2024-04-26T11:14:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.087524+0000", 2024-04-26T11:14:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5214000000000001e-05 2024-04-26T11:14:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.087612+0000", 2024-04-26T11:14:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8131e-05 2024-04-26T11:14:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:103757 5.8 5:1c0ff308:::benchmark_data_smithi029_44842_object103756:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:20.088963+0000", 2024-04-26T11:14:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0021826010000000002, 2024-04-26T11:14:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027232609999999998, 2024-04-26T11:14:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 103757 2024-04-26T11:14:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.088963+0000", 2024-04-26T11:14:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.088963+0000", 2024-04-26T11:14:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.088963+0000", 2024-04-26T11:14:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.089016+0000", 2024-04-26T11:14:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3065000000000001e-05 2024-04-26T11:14:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.089024+0000", 2024-04-26T11:14:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9780000000000005e-06 2024-04-26T11:14:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.089029+0000", 2024-04-26T11:14:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.643e-06 2024-04-26T11:14:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.089071+0000", 2024-04-26T11:14:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2061000000000003e-05 2024-04-26T11:14:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.089223+0000", 2024-04-26T11:14:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015112599999999999 2024-04-26T11:14:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.089390+0000", 2024-04-26T11:14:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016769500000000001 2024-04-26T11:14:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:103759 5.9 5:961817a6:::benchmark_data_smithi029_44842_object103758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:20.090462+0000", 2024-04-26T11:14:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00068413700000000003, 2024-04-26T11:14:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001303685, 2024-04-26T11:14:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 103759 2024-04-26T11:14:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.090462+0000", 2024-04-26T11:14:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.090462+0000", 2024-04-26T11:14:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.090461+0000", 2024-04-26T11:14:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.090509+0000", 2024-04-26T11:14:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8035999999999999e-05 2024-04-26T11:14:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.090518+0000", 2024-04-26T11:14:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.952e-06 2024-04-26T11:14:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.090526+0000", 2024-04-26T11:14:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8169999999999999e-06 2024-04-26T11:14:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.090553+0000", 2024-04-26T11:14:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6825000000000002e-05 2024-04-26T11:14:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.090638+0000", 2024-04-26T11:14:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4918000000000002e-05 2024-04-26T11:14:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:103760 5.e 5.8b0bbcae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:20.091684+0000", 2024-04-26T11:14:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9994617, 2024-04-26T11:14:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014976200000000001, 2024-04-26T11:14:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 103760 2024-04-26T11:14:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.091684+0000", 2024-04-26T11:14:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.091684+0000", 2024-04-26T11:14:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.091684+0000", 2024-04-26T11:14:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.091796+0000", 2024-04-26T11:14:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011233700000000001 2024-04-26T11:14:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.091806+0000", 2024-04-26T11:14:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0169999999999999e-05 2024-04-26T11:14:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.091812+0000", 2024-04-26T11:14:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2720000000000003e-06 2024-04-26T11:14:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:20.091843+0000", 2024-04-26T11:14:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1058e-05 2024-04-26T11:14:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:14:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 9 2024-04-26T11:14:20.143 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:20.144 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:14:20.146 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:20.146 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:20.144+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:20.245 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:20.244+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:20.300 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:20.325 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:20.325 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:20.325 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:20.325 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:20.328 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:20.328 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:20.346 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:20.345+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:20.360 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:20.360 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:20.372 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:20.413 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 42 16 104488 104472 155.45 135 0.00709616 0.0064305 2024-04-26T11:14:20.447 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:20.446+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:20.548 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:20.547+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:20.586 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:20.586 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:20.603 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:20.630 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:14:20.651 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:20.648+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:20.750 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:20.749+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:20.780 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:20.781 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:20.796 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:20.850 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:20.850+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:20.951 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:20.950+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:21.018 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:21.018 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:21.034 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:21.076 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:21.075+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:21.156 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:21.155+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:21.256 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:21.255+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:21.261 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:21.261 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:21.275 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:21.357 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:21.356+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:21.414 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 43 16 106611 106595 154.921 132.688 0.0134406 0.00645268 2024-04-26T11:14:21.443 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:21.443 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:21.457 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:21.498 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:21.497+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:21.559 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:21.558+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:21.619 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:14:21.659 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:21.659+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:21.668 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:21.668 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:21.681 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:21.761 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:21.760+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:21.846 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:14:21.862 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:21.861+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:21.889 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:21.889 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:21.902 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:21.957 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2024-04-26T11:14:21.963 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:21.962+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:22.064 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:22.063+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:22.064 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:22.064 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:22.074 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:22.165 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:22.164+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:22.257 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~24s 2024-04-26T11:14:22.265 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:22.264+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:22.290 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:22.290 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:22.303 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:22.329 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:14:22.388 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:22.387+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:22.414 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 44 16 108464 108448 154.032 115.812 0.00303862 0.00648943 2024-04-26T11:14:22.468 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:22.467+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:22.481 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:22.502 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:22.502 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:22.502 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:22.503 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:22.505 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:22.505 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:22.530 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:22.530 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:14:22.530 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:14:22.530 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:22.530 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.530 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:22.530 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:22.530 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 29.255023850000001, 2024-04-26T11:14:22.530 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:14:22.530 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:22.530 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:22.531 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:22.531 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:22.531 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.531 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:14:22.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.531 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:22.531 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.531 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:22.531 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:22.531 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.531 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.531 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:22.531 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:22.532 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.532 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:22.532 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:14:22.532 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:22.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.532 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:22.532 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:14:22.532 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:14:22.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.532 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:22.532 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:14:22.533 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:14:22.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.533 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:14:22.533 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:14:22.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.533 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:14:22.533 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:14:22.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:22.534 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:14:22.534 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:14:22.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.534 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:22.534 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:14:22.534 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:14:22.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.534 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:22.534 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:14:22.534 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:14:22.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.535 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.535 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:22.535 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:14:22.535 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:14:22.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.535 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.535 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:22.535 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:14:22.535 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:14:22.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.535 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.535 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:22.535 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:14:22.536 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:14:22.536 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.536 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:22.536 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.536 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.536 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:22.536 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:22.536 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 29.254212285000001, 2024-04-26T11:14:22.536 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:14:22.537 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:22.537 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:22.537 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:22.537 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:22.537 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.537 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:14:22.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.537 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:22.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.537 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:22.537 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:22.537 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.537 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:22.538 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:22.538 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.538 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:22.538 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:22.538 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:22.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.538 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:22.538 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:14:22.539 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:14:22.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.539 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:22.539 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:14:22.539 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:14:22.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.539 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.539 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:14:22.539 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:14:22.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.539 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.539 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:14:22.540 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:14:22.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.540 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:22.540 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:14:22.540 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:14:22.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.541 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:22.541 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:14:22.541 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:14:22.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.541 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:22.541 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:14:22.541 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:14:22.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.541 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:22.541 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:14:22.542 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:14:22.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.542 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.542 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:22.542 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:14:22.542 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:14:22.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.542 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.542 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:22.542 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:14:22.542 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:14:22.542 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.542 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:22.542 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.543 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.543 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:22.543 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:22.543 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 29.247025447999999, 2024-04-26T11:14:22.543 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:14:22.543 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:22.543 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:22.543 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:22.543 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:22.543 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.543 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:14:22.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.544 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:22.544 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.544 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:22.544 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:22.544 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.544 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.544 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:22.544 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:22.545 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.545 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.545 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:22.545 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:14:22.545 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:22.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.545 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.546 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:22.546 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:14:22.546 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:14:22.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.546 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.546 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:22.546 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:14:22.546 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:14:22.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.546 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.546 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.546 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:14:22.546 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:14:22.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.547 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.547 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:14:22.547 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:14:22.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.547 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:22.547 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:14:22.547 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:14:22.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.547 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:22.547 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:14:22.547 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:14:22.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.548 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.548 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:22.548 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:14:22.548 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:14:22.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.548 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.548 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:22.548 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:14:22.548 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:14:22.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.548 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.548 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:22.548 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:14:22.548 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:14:22.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.549 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.549 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:22.549 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:14:22.549 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:14:22.549 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.549 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:22.549 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.549 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.549 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:22.549 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:22.549 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 29.246484569, 2024-04-26T11:14:22.549 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:14:22.549 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:22.549 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:22.550 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:22.550 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:22.550 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.550 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:14:22.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.550 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:22.550 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.550 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:22.550 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:22.550 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.550 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.551 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:22.551 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:22.551 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.551 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.551 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:22.551 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:22.551 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:22.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.551 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.552 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:22.552 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:14:22.552 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:14:22.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.552 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.552 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:22.552 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:14:22.552 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:14:22.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.552 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.552 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.552 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:14:22.552 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:14:22.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.553 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.553 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.553 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:14:22.553 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:14:22.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.553 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.553 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:22.553 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:14:22.553 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:14:22.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.553 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.553 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:22.553 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:14:22.553 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:14:22.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.553 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.554 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:22.554 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:14:22.554 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:14:22.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.554 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.554 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:22.554 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:14:22.554 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:14:22.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.554 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.554 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:22.554 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:14:22.554 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:14:22.555 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.555 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.555 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:22.555 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:14:22.555 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:14:22.555 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.555 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:22.555 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.555 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.555 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.555 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:55119 5.6 5:6ad50111:::benchmark_data_smithi029_44842_object55118:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:22.555 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:22.555 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.765420915, 2024-04-26T11:14:22.555 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018830264999999999, 2024-04-26T11:14:22.556 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:22.556 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:22.556 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:22.556 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:22.556 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.556 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 55119 2024-04-26T11:14:22.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.556 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:22.556 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.556 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:22.557 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:22.557 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.557 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.557 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:22.557 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:22.557 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.557 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.557 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:22.557 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760349+0000", 2024-04-26T11:14:22.557 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:22.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.557 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.557 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:22.558 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760402+0000", 2024-04-26T11:14:22.558 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2695999999999998e-05 2024-04-26T11:14:22.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.558 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.558 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:22.558 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760411+0000", 2024-04-26T11:14:22.558 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.0589999999999992e-06 2024-04-26T11:14:22.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.558 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.558 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.558 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760416+0000", 2024-04-26T11:14:22.558 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.587e-06 2024-04-26T11:14:22.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.558 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.559 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.559 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767638+0000", 2024-04-26T11:14:22.559 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0072214050000000002 2024-04-26T11:14:22.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.559 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.559 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:22.559 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767760+0000", 2024-04-26T11:14:22.559 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000122067 2024-04-26T11:14:22.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.559 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.559 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:22.559 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767927+0000", 2024-04-26T11:14:22.560 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00016747999999999999 2024-04-26T11:14:22.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.560 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.560 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:22.560 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.770877+0000", 2024-04-26T11:14:22.560 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002949335 2024-04-26T11:14:22.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.560 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.560 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:22.560 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779130+0000", 2024-04-26T11:14:22.560 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.008253491 2024-04-26T11:14:22.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.560 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.560 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:22.560 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779158+0000", 2024-04-26T11:14:22.560 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7849000000000001e-05 2024-04-26T11:14:22.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.561 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.561 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:22.561 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779180+0000", 2024-04-26T11:14:22.561 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2048999999999998e-05 2024-04-26T11:14:22.561 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.561 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:22.561 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.561 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.562 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:22.562 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:22.562 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.203300122000002, 2024-04-26T11:14:22.562 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:14:22.562 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:22.562 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:22.562 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:22.562 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:22.562 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.562 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:14:22.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.563 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:22.563 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.563 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:22.563 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:22.563 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.563 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.563 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:22.563 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:22.563 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.563 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.564 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:22.564 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:14:22.564 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:22.564 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.564 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.564 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:22.564 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:14:22.564 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:14:22.564 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.564 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.564 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:22.565 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:14:22.565 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:14:22.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.565 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.565 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.565 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:14:22.565 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:14:22.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.565 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.565 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.565 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:14:22.565 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:14:22.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.565 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.565 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:22.566 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:14:22.566 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:14:22.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.566 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.566 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:22.566 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:14:22.566 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:14:22.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.566 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.566 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:22.567 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:14:22.567 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:14:22.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.567 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.567 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.567 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:14:22.567 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:14:22.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.567 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.567 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:22.567 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:14:22.567 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:14:22.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.568 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.568 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.568 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:14:22.568 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:14:22.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.568 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.568 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:22.568 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:14:22.568 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:14:22.568 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.568 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:22.568 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.568 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.568 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:22.569 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:22.569 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.201106782, 2024-04-26T11:14:22.569 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:14:22.569 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:22.569 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:22.569 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:22.569 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:22.569 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.569 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:14:22.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.569 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:22.569 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.569 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:22.569 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:22.569 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.570 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.570 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:22.570 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:22.570 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.570 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.570 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:22.570 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:14:22.570 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:22.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.570 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.570 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:22.571 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:14:22.571 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:14:22.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.571 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.571 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:22.571 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:14:22.571 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:14:22.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.571 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.571 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.571 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:14:22.571 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:14:22.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.571 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.571 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.572 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:14:22.572 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:14:22.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.572 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.572 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:22.573 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:14:22.573 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:14:22.573 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.574 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.574 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:22.574 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:14:22.574 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:14:22.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.574 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.574 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:22.574 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:14:22.574 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:14:22.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.574 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.574 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.574 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:14:22.575 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:14:22.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.575 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.575 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:22.575 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:14:22.575 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:14:22.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.575 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.575 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.575 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:14:22.576 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:14:22.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.576 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.576 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:22.576 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:14:22.576 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:14:22.576 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.576 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:22.576 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.576 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.576 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:22.576 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:22.576 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.195894958, 2024-04-26T11:14:22.576 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:14:22.577 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:22.577 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:22.577 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:22.577 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:22.577 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.577 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:14:22.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.577 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:22.578 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.578 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:22.578 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:22.578 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.578 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.578 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:22.578 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:22.578 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.578 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.578 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:22.578 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:14:22.579 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:22.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.579 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.579 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:22.579 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:14:22.579 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:14:22.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.579 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.579 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:22.579 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:14:22.579 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:14:22.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.579 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.579 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.580 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:14:22.580 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:14:22.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.580 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.580 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.580 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:14:22.580 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:14:22.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.580 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.580 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:22.580 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:14:22.580 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:14:22.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.581 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.581 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:22.581 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:14:22.581 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:14:22.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.581 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.581 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:22.581 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:14:22.581 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:14:22.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.581 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.581 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.581 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:14:22.581 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:14:22.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.582 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.582 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:22.582 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:14:22.582 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:14:22.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.582 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.582 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.582 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:14:22.582 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:14:22.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.582 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.582 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:22.582 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:14:22.582 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:14:22.583 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.583 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:22.583 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.583 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.583 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:22.583 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:22.584 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.179446257999999, 2024-04-26T11:14:22.584 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:14:22.584 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:22.584 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:22.584 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:22.584 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:22.584 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.584 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:14:22.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.584 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:22.584 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.584 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:22.584 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:22.584 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.585 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:22.585 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:22.585 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.585 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:22.585 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:14:22.585 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:22.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.585 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:22.585 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:14:22.585 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:14:22.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.586 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.586 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:22.586 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:14:22.586 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:14:22.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.586 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.586 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.586 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:14:22.586 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:14:22.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.586 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.586 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.586 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:14:22.586 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:14:22.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.587 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.587 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:22.587 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:14:22.587 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:14:22.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.587 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.587 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.587 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:14:22.587 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:14:22.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.587 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.587 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:22.587 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:14:22.588 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:14:22.588 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.588 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:22.588 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.588 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:22.588 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:22.588 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.177748752999999, 2024-04-26T11:14:22.588 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:14:22.589 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:22.589 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:22.589 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:22.589 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:22.589 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.589 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:14:22.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.589 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:22.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.589 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:22.589 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:22.589 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.590 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:22.590 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:22.590 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.590 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.590 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:22.590 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:14:22.590 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:22.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.590 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.591 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:22.591 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:14:22.591 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:14:22.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.591 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:22.591 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:14:22.591 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:14:22.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.592 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.592 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:14:22.592 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:14:22.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.592 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.592 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:14:22.592 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:14:22.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.592 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:22.592 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:14:22.592 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:14:22.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.593 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.593 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.593 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:14:22.593 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:14:22.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.593 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.593 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:22.593 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:14:22.593 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:14:22.593 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.593 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:22.593 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.593 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.594 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:22.594 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:22.594 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.177684451000001, 2024-04-26T11:14:22.594 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:14:22.594 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:22.594 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:22.594 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:22.594 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:22.595 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.595 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:14:22.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.595 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:22.595 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.595 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:22.595 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:22.595 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.595 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.595 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:22.595 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:22.595 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:14:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:14:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:14:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:14:22.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.597 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.597 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.597 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:14:22.597 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:14:22.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.597 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.597 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.597 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:14:22.597 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:14:22.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.597 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.597 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:22.598 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:14:22.598 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:14:22.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.598 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.598 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.598 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:14:22.598 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:14:22.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.598 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.599 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:22.599 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:14:22.599 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:14:22.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.599 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.599 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:22.599 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:14:22.599 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:14:22.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.600 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.600 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:22.600 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:14:22.600 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:14:22.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.600 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.600 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:22.600 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:14:22.600 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:14:22.600 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.600 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:22.600 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.177630227000002, 2024-04-26T11:14:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:14:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:14:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:22.601 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:22.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:14:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:14:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:14:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:14:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.603 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:14:22.604 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:14:22.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.604 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.604 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:14:22.604 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:14:22.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.604 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:22.604 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:14:22.604 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:14:22.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.605 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.605 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.605 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:14:22.605 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:14:22.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.605 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.605 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:22.605 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:14:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:14:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:14:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:14:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:14:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.606 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.607 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:22.607 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:14:22.607 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:14:22.607 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.607 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:22.607 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.607 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.607 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:22.607 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:22.607 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.177585714999999, 2024-04-26T11:14:22.607 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:14:22.608 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:22.608 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:22.608 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:22.608 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:22.608 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.608 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:14:22.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.608 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:22.608 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.608 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:22.608 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:22.608 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.608 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.609 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:22.609 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:22.609 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.609 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.609 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:22.609 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:14:22.609 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:22.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.609 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.609 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:22.610 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:14:22.610 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:14:22.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.610 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.610 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:22.610 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:14:22.610 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:14:22.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.610 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.610 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.610 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:14:22.611 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:14:22.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.611 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.611 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.611 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:14:22.611 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:14:22.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.611 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.611 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:22.611 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:14:22.611 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:14:22.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.611 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.611 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.611 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:14:22.611 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:14:22.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.612 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.612 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:22.612 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:14:22.612 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:14:22.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.612 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.612 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:22.612 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:14:22.612 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:14:22.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.612 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.613 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:22.613 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:14:22.613 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:14:22.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.613 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.613 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:22.613 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:14:22.613 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:14:22.613 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.613 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:22.613 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.613 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.614 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:22.614 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:22.614 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.173364713000002, 2024-04-26T11:14:22.614 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:14:22.614 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:22.614 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:22.614 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:22.614 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:22.614 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.614 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:14:22.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.614 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:22.614 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.614 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:22.614 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:22.615 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.615 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.615 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:22.615 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:22.615 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.615 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.615 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:22.615 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:14:22.615 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:14:22.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.616 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.616 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:22.616 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:14:22.616 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:14:22.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.616 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.616 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:22.616 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:14:22.616 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:14:22.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.616 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.617 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.617 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:14:22.617 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:14:22.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.617 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.617 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.617 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:14:22.617 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:14:22.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.617 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.617 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:22.617 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:14:22.617 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:14:22.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.617 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.618 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.618 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:14:22.618 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:14:22.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.618 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.618 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:22.618 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:14:22.618 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:14:22.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.618 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.618 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:22.618 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:14:22.618 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:14:22.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.619 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.619 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:22.619 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:14:22.619 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:14:22.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.619 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.619 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:22.619 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:14:22.619 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:14:22.619 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.619 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:22.619 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.620 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.620 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:61817 5.a 5:5627ce7f:::benchmark_data_smithi029_44842_object61816:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:22.620 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:22.620 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 21.823239260000001, 2024-04-26T11:14:22.620 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020626958000000001, 2024-04-26T11:14:22.620 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:22.620 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:22.620 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:22.621 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:22.621 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.621 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 61817 2024-04-26T11:14:22.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.621 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:22.621 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.621 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:22.621 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:22.621 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.621 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.621 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:22.621 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:22.621 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.622 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.622 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:22.622 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:22.622 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:22.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.622 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.622 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:22.622 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702591+0000", 2024-04-26T11:14:22.622 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0665999999999998e-05 2024-04-26T11:14:22.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.622 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.622 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:22.622 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702599+0000", 2024-04-26T11:14:22.623 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7130000000000005e-06 2024-04-26T11:14:22.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.623 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.623 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.623 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702605+0000", 2024-04-26T11:14:22.623 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4310000000000002e-06 2024-04-26T11:14:22.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.623 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.623 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.623 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.707947+0000", 2024-04-26T11:14:22.623 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053424220000000003 2024-04-26T11:14:22.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.623 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.623 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:22.623 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.708052+0000", 2024-04-26T11:14:22.624 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010499 2024-04-26T11:14:22.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.624 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.624 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:14:22.624 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.708141+0000", 2024-04-26T11:14:22.624 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9514999999999999e-05 2024-04-26T11:14:22.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.624 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.624 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:22.624 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.711954+0000", 2024-04-26T11:14:22.624 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003812265 2024-04-26T11:14:22.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.624 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.624 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:22.624 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723070+0000", 2024-04-26T11:14:22.625 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011116727 2024-04-26T11:14:22.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.625 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.625 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:22.625 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723121+0000", 2024-04-26T11:14:22.625 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0362999999999999e-05 2024-04-26T11:14:22.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.625 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.625 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:22.625 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723158+0000", 2024-04-26T11:14:22.625 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7579000000000001e-05 2024-04-26T11:14:22.625 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.625 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:22.625 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.626 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.626 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:75771 5.c 5:3cc8f1b4:::benchmark_data_smithi029_44842_object75770:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T11:14:22.626 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:22.626 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 15.772794917000001, 2024-04-26T11:14:22.626 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019437949, 2024-04-26T11:14:22.626 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:22.626 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:22.626 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:22.627 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:22.627 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.627 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 75771 2024-04-26T11:14:22.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.627 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:22.627 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.627 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:22.627 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:22.627 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.627 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.627 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:22.627 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:22.628 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.628 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:22.628 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752975+0000", 2024-04-26T11:14:22.628 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:22.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.628 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:22.628 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753061+0000", 2024-04-26T11:14:22.628 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5890999999999995e-05 2024-04-26T11:14:22.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.628 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:22.628 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753071+0000", 2024-04-26T11:14:22.629 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.9990000000000003e-06 2024-04-26T11:14:22.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.629 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.629 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.629 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753078+0000", 2024-04-26T11:14:22.629 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1559999999999998e-06 2024-04-26T11:14:22.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.629 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.629 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.629 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.758559+0000", 2024-04-26T11:14:22.629 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0054812819999999996 2024-04-26T11:14:22.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.630 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:22.630 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.758692+0000", 2024-04-26T11:14:22.630 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000133301 2024-04-26T11:14:22.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.630 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:22.630 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772277+0000", 2024-04-26T11:14:22.630 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.013584839 2024-04-26T11:14:22.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.630 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:22.630 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772340+0000", 2024-04-26T11:14:22.630 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2360999999999995e-05 2024-04-26T11:14:22.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:22.631 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772414+0000", 2024-04-26T11:14:22.631 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4024999999999997e-05 2024-04-26T11:14:22.631 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.631 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:22.631 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.632 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.632 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83359 5.2 5:4939888c:::benchmark_data_smithi029_44842_object83358:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:22.632 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:22.632 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 11.486204332, 2024-04-26T11:14:22.632 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018705583000000001, 2024-04-26T11:14:22.632 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:22.632 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:22.632 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:22.632 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:22.632 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.632 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83359 2024-04-26T11:14:22.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.632 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:22.632 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.633 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:22.633 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:22.633 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.633 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:22.633 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:22.633 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.633 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:22.633 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:22.633 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:22.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.634 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:22.634 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039625+0000", 2024-04-26T11:14:22.634 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9162e-05 2024-04-26T11:14:22.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.634 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:22.634 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039632+0000", 2024-04-26T11:14:22.634 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5399999999999998e-06 2024-04-26T11:14:22.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.634 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.634 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039638+0000", 2024-04-26T11:14:22.634 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1850000000000003e-06 2024-04-26T11:14:22.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.635 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.635 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.635 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.042375+0000", 2024-04-26T11:14:22.635 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0027371510000000002 2024-04-26T11:14:22.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.636 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:22.636 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.042502+0000", 2024-04-26T11:14:22.636 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000126966 2024-04-26T11:14:22.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.636 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:22.636 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058154+0000", 2024-04-26T11:14:22.637 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015652657 2024-04-26T11:14:22.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.637 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:22.637 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058201+0000", 2024-04-26T11:14:22.637 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6579000000000002e-05 2024-04-26T11:14:22.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.638 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:22.638 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058272+0000", 2024-04-26T11:14:22.638 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1009999999999999e-05 2024-04-26T11:14:22.638 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.638 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:22.638 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.638 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.638 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83360 5.2 5:42f8bfcd:::benchmark_data_smithi029_44842_object83359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:22.638 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:22.638 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 11.486125342999999, 2024-04-26T11:14:22.638 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022279782000000001, 2024-04-26T11:14:22.638 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:22.638 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:22.639 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:22.639 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:22.639 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.639 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83360 2024-04-26T11:14:22.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.639 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:22.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.639 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:22.639 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:22.639 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.639 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:22.639 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:22.639 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.640 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.640 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:22.640 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:22.640 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:22.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.640 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.640 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:22.640 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039700+0000", 2024-04-26T11:14:22.640 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5541000000000002e-05 2024-04-26T11:14:22.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.640 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.640 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:22.640 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039706+0000", 2024-04-26T11:14:22.640 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3680000000000001e-06 2024-04-26T11:14:22.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.641 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.641 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.641 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039709+0000", 2024-04-26T11:14:22.641 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4659999999999999e-06 2024-04-26T11:14:22.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.641 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.641 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.641 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056305+0000", 2024-04-26T11:14:22.641 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016595649000000001 2024-04-26T11:14:22.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.641 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.641 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:22.642 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056487+0000", 2024-04-26T11:14:22.642 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000181886 2024-04-26T11:14:22.642 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.642 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.642 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:22.643 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061809+0000", 2024-04-26T11:14:22.643 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053223259999999996 2024-04-26T11:14:22.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.643 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.643 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:22.643 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061852+0000", 2024-04-26T11:14:22.643 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2738999999999999e-05 2024-04-26T11:14:22.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.643 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.643 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:22.643 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061925+0000", 2024-04-26T11:14:22.643 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3180000000000001e-05 2024-04-26T11:14:22.643 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.643 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:22.644 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.644 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.644 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83364 5.2 5:42c5cd8c:::benchmark_data_smithi029_44842_object83363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:22.644 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:22.644 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 11.485709603, 2024-04-26T11:14:22.644 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022695336, 2024-04-26T11:14:22.644 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:22.644 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:22.644 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:22.644 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:22.644 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.644 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83364 2024-04-26T11:14:22.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.645 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:22.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.645 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:22.645 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:22.645 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.645 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:22.645 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:22.645 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.646 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:22.646 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040060+0000", 2024-04-26T11:14:22.646 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:22.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.646 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.646 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:22.646 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040086+0000", 2024-04-26T11:14:22.646 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5482000000000001e-05 2024-04-26T11:14:22.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.646 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.646 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:22.646 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040093+0000", 2024-04-26T11:14:22.646 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6409999999999996e-06 2024-04-26T11:14:22.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.646 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.647 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.647 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040098+0000", 2024-04-26T11:14:22.647 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879999999999996e-06 2024-04-26T11:14:22.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.647 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.647 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.647 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058292+0000", 2024-04-26T11:14:22.647 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018193504999999999 2024-04-26T11:14:22.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.647 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.647 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:22.647 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058412+0000", 2024-04-26T11:14:22.647 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011979199999999999 2024-04-26T11:14:22.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.648 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.648 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:22.648 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062642+0000", 2024-04-26T11:14:22.648 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042299449999999997 2024-04-26T11:14:22.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.648 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.648 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:22.648 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062688+0000", 2024-04-26T11:14:22.649 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6859e-05 2024-04-26T11:14:22.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.649 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:22.649 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062756+0000", 2024-04-26T11:14:22.649 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7995000000000002e-05 2024-04-26T11:14:22.649 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.649 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:22.649 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.649 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83378 5.2 5:44b3209a:::benchmark_data_smithi029_44842_object83377:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:22.649 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:22.649 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 11.477989149999999, 2024-04-26T11:14:22.650 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020722529, 2024-04-26T11:14:22.650 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:22.650 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:22.650 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:22.650 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:22.650 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.650 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83378 2024-04-26T11:14:22.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.650 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:22.650 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.650 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:22.650 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:22.650 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.650 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.651 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:22.651 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:22.651 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:22.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.651 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.651 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:22.651 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047781+0000", 2024-04-26T11:14:22.651 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:22.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.651 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.651 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:22.651 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047832+0000", 2024-04-26T11:14:22.651 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1687000000000002e-05 2024-04-26T11:14:22.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:22.652 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047842+0000", 2024-04-26T11:14:22.652 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2439999999999999e-06 2024-04-26T11:14:22.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.652 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047847+0000", 2024-04-26T11:14:22.652 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6500000000000001e-06 2024-04-26T11:14:22.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:22.652 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.060082+0000", 2024-04-26T11:14:22.652 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.012235105 2024-04-26T11:14:22.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.653 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:22.653 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.060191+0000", 2024-04-26T11:14:22.653 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000108665 2024-04-26T11:14:22.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.653 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:22.653 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068363+0000", 2024-04-26T11:14:22.653 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0081715829999999996 2024-04-26T11:14:22.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.654 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.654 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:22.654 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068418+0000", 2024-04-26T11:14:22.654 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4984000000000001e-05 2024-04-26T11:14:22.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:22.654 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:22.654 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:22.654 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068504+0000", 2024-04-26T11:14:22.654 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6520000000000005e-05 2024-04-26T11:14:22.654 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.654 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:22.654 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.654 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:22.655 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:22.655 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:22.656 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:22.657 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:22.655+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:22.757 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:22.756+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:22.827 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:22.828 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:22.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.828 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:109350 5.f 5:f4578174:::benchmark_data_smithi029_44842_object109349:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:22.828 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:22.813093+0000", 2024-04-26T11:14:22.828 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.011898885999999999, 2024-04-26T11:14:22.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011920675, 2024-04-26T11:14:22.828 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:22.828 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:22.828 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:22.828 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:22.829 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.829 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 109350 2024-04-26T11:14:22.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.829 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:22.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:22.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.813093+0000", 2024-04-26T11:14:22.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:22.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.813093+0000", 2024-04-26T11:14:22.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:22.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.813092+0000", 2024-04-26T11:14:22.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:22.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:22.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.813151+0000", 2024-04-26T11:14:22.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8202999999999998e-05 2024-04-26T11:14:22.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:22.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.813158+0000", 2024-04-26T11:14:22.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0859999999999996e-06 2024-04-26T11:14:22.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.813162+0000", 2024-04-26T11:14:22.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0860000000000004e-06 2024-04-26T11:14:22.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:22.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.813194+0000", 2024-04-26T11:14:22.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2076999999999998e-05 2024-04-26T11:14:22.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.831 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:22.831 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.813283+0000", 2024-04-26T11:14:22.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9524999999999994e-05 2024-04-26T11:14:22.832 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.832 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:22.832 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.832 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:109351 5.e 5:7985d121:::benchmark_data_smithi029_44842_object109350:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:22.832 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:22.815396+0000", 2024-04-26T11:14:22.832 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0095958689999999999, 2024-04-26T11:14:22.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096799690000000001, 2024-04-26T11:14:22.832 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:22.832 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:22.832 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:22.832 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:22.832 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.833 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 109351 2024-04-26T11:14:22.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.833 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:22.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:22.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.815396+0000", 2024-04-26T11:14:22.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:22.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.815396+0000", 2024-04-26T11:14:22.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:22.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.815396+0000", 2024-04-26T11:14:22.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:22.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:22.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.815455+0000", 2024-04-26T11:14:22.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9024000000000003e-05 2024-04-26T11:14:22.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:22.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.815465+0000", 2024-04-26T11:14:22.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9480000000000003e-06 2024-04-26T11:14:22.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.815470+0000", 2024-04-26T11:14:22.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1599999999999997e-06 2024-04-26T11:14:22.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:22.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.815506+0000", 2024-04-26T11:14:22.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6746999999999999e-05 2024-04-26T11:14:22.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:22.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.815625+0000", 2024-04-26T11:14:22.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011894499999999999 2024-04-26T11:14:22.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:22.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.815785+0000", 2024-04-26T11:14:22.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000159331 2024-04-26T11:14:22.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:22.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.819004+0000", 2024-04-26T11:14:22.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0032190109999999999 2024-04-26T11:14:22.837 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.838 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:22.838 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.838 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:109352 5.8 5:1e94a3bd:::benchmark_data_smithi029_44842_object109351:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:22.838 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:22.815476+0000", 2024-04-26T11:14:22.838 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0095156930000000004, 2024-04-26T11:14:22.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096502189999999998, 2024-04-26T11:14:22.838 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:22.839 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:22.839 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:22.839 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:22.839 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.839 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 109352 2024-04-26T11:14:22.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.839 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:22.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:22.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.815476+0000", 2024-04-26T11:14:22.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:22.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.815476+0000", 2024-04-26T11:14:22.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:22.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.815476+0000", 2024-04-26T11:14:22.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:22.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:22.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.815512+0000", 2024-04-26T11:14:22.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5815000000000002e-05 2024-04-26T11:14:22.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.840 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:22.840 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.815517+0000", 2024-04-26T11:14:22.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9799999999999998e-06 2024-04-26T11:14:22.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.815520+0000", 2024-04-26T11:14:22.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2499999999999998e-06 2024-04-26T11:14:22.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:22.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.815555+0000", 2024-04-26T11:14:22.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4773000000000001e-05 2024-04-26T11:14:22.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:22.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.815693+0000", 2024-04-26T11:14:22.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013811800000000001 2024-04-26T11:14:22.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:22.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.815833+0000", 2024-04-26T11:14:22.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014005300000000001 2024-04-26T11:14:22.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:22.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.819334+0000", 2024-04-26T11:14:22.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035012860000000002 2024-04-26T11:14:22.842 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.842 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:22.842 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.842 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:109355 5.b 5:d0433564:::benchmark_data_smithi029_44842_object109354:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:22.843 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:22.818323+0000", 2024-04-26T11:14:22.843 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.006668752, 2024-04-26T11:14:22.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.006850676, 2024-04-26T11:14:22.843 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:22.843 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:22.843 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:22.843 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:22.843 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.843 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 109355 2024-04-26T11:14:22.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.843 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:22.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:22.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.818323+0000", 2024-04-26T11:14:22.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:22.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.818323+0000", 2024-04-26T11:14:22.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:22.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.818322+0000", 2024-04-26T11:14:22.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:22.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:22.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.818353+0000", 2024-04-26T11:14:22.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0358e-05 2024-04-26T11:14:22.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:22.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.818364+0000", 2024-04-26T11:14:22.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1093e-05 2024-04-26T11:14:22.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.818370+0000", 2024-04-26T11:14:22.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0909999999999998e-06 2024-04-26T11:14:22.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:22.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.818401+0000", 2024-04-26T11:14:22.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0874999999999998e-05 2024-04-26T11:14:22.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:22.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.818483+0000", 2024-04-26T11:14:22.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1952000000000004e-05 2024-04-26T11:14:22.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:22.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.818571+0000", 2024-04-26T11:14:22.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8473000000000005e-05 2024-04-26T11:14:22.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:22.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.820788+0000", 2024-04-26T11:14:22.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022166859999999998 2024-04-26T11:14:22.847 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.847 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:22.848 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.848 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:109357 5.d 5:bb06c586:::benchmark_data_smithi029_44842_object109356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:22.848 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:22.820749+0000", 2024-04-26T11:14:22.848 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0042430840000000003, 2024-04-26T11:14:22.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044709479999999998, 2024-04-26T11:14:22.848 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:22.848 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:22.848 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:22.848 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:22.848 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.848 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 109357 2024-04-26T11:14:22.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.848 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:22.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:22.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.820749+0000", 2024-04-26T11:14:22.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:22.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.820749+0000", 2024-04-26T11:14:22.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:22.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.820748+0000", 2024-04-26T11:14:22.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:22.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:22.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.820806+0000", 2024-04-26T11:14:22.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8056000000000001e-05 2024-04-26T11:14:22.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:22.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.820818+0000", 2024-04-26T11:14:22.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1445e-05 2024-04-26T11:14:22.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.820823+0000", 2024-04-26T11:14:22.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9509999999999997e-06 2024-04-26T11:14:22.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:22.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.820848+0000", 2024-04-26T11:14:22.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.512e-05 2024-04-26T11:14:22.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:22.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.820947+0000", 2024-04-26T11:14:22.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8968000000000005e-05 2024-04-26T11:14:22.851 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.851 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:22.851 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.851 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:109358 5.0 5:0013c915:::benchmark_data_smithi029_44842_object109357:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:22.852 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:22.820831+0000", 2024-04-26T11:14:22.852 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0041611260000000002, 2024-04-26T11:14:22.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044280810000000004, 2024-04-26T11:14:22.852 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:22.852 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:22.852 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:22.852 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:22.852 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.852 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 109358 2024-04-26T11:14:22.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.852 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:22.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.852 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:22.852 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.820831+0000", 2024-04-26T11:14:22.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:22.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.820831+0000", 2024-04-26T11:14:22.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:22.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.820830+0000", 2024-04-26T11:14:22.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:22.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:22.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.820877+0000", 2024-04-26T11:14:22.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.655e-05 2024-04-26T11:14:22.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:22.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.820882+0000", 2024-04-26T11:14:22.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2730000000000002e-06 2024-04-26T11:14:22.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.820890+0000", 2024-04-26T11:14:22.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1170000000000004e-06 2024-04-26T11:14:22.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:22.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.820933+0000", 2024-04-26T11:14:22.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2892000000000002e-05 2024-04-26T11:14:22.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:22.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821155+0000", 2024-04-26T11:14:22.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000222072 2024-04-26T11:14:22.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:22.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821343+0000", 2024-04-26T11:14:22.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00018736100000000001 2024-04-26T11:14:22.856 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.856 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:22.856 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.856 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:109360 5.4 5:2acc1069:::benchmark_data_smithi029_44842_object109359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:22.857 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:22.820897+0000", 2024-04-26T11:14:22.857 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0040948740000000001, 2024-04-26T11:14:22.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044988160000000001, 2024-04-26T11:14:22.857 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:22.857 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:22.857 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:22.857 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:22.857 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.857 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 109360 2024-04-26T11:14:22.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.857 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:22.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:22.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.820897+0000", 2024-04-26T11:14:22.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:22.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.820897+0000", 2024-04-26T11:14:22.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:22.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.820897+0000", 2024-04-26T11:14:22.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:22.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:22.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.820980+0000", 2024-04-26T11:14:22.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2867999999999993e-05 2024-04-26T11:14:22.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:22.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.820984+0000", 2024-04-26T11:14:22.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6909999999999996e-06 2024-04-26T11:14:22.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.820988+0000", 2024-04-26T11:14:22.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4379999999999999e-06 2024-04-26T11:14:22.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:22.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821020+0000", 2024-04-26T11:14:22.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2326999999999997e-05 2024-04-26T11:14:22.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:22.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821136+0000", 2024-04-26T11:14:22.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000116313 2024-04-26T11:14:22.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:22.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821288+0000", 2024-04-26T11:14:22.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000151366 2024-04-26T11:14:22.861 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.861 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:22.861 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.861 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:109362 5.b 5:d09b9b98:::benchmark_data_smithi029_44842_object109361:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:22.861 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:22.821009+0000", 2024-04-26T11:14:22.861 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.003983019, 2024-04-26T11:14:22.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044804379999999998, 2024-04-26T11:14:22.861 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:22.861 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:22.861 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:22.861 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:22.861 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.862 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 109362 2024-04-26T11:14:22.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.862 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:22.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:22.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821009+0000", 2024-04-26T11:14:22.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:22.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821009+0000", 2024-04-26T11:14:22.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:22.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821008+0000", 2024-04-26T11:14:22.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:22.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:22.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821108+0000", 2024-04-26T11:14:22.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9116000000000004e-05 2024-04-26T11:14:22.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:22.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821115+0000", 2024-04-26T11:14:22.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8110000000000003e-06 2024-04-26T11:14:22.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821122+0000", 2024-04-26T11:14:22.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6619999999999999e-06 2024-04-26T11:14:22.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:22.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821158+0000", 2024-04-26T11:14:22.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5858000000000001e-05 2024-04-26T11:14:22.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:22.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821285+0000", 2024-04-26T11:14:22.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000126861 2024-04-26T11:14:22.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:22.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821414+0000", 2024-04-26T11:14:22.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000129107 2024-04-26T11:14:22.865 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.865 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:22.865 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.866 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:109363 5.9 5:9be2dd95:::benchmark_data_smithi029_44842_object109362:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:22.866 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:22.821131+0000", 2024-04-26T11:14:22.866 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.003860713, 2024-04-26T11:14:22.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044675319999999998, 2024-04-26T11:14:22.866 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:22.866 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:22.866 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:22.867 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:22.867 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.867 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 109363 2024-04-26T11:14:22.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.867 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:22.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:22.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821131+0000", 2024-04-26T11:14:22.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:22.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821131+0000", 2024-04-26T11:14:22.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:22.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821131+0000", 2024-04-26T11:14:22.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:22.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:22.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821192+0000", 2024-04-26T11:14:22.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1409999999999996e-05 2024-04-26T11:14:22.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:22.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821199+0000", 2024-04-26T11:14:22.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1810000000000004e-06 2024-04-26T11:14:22.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821207+0000", 2024-04-26T11:14:22.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2350000000000002e-06 2024-04-26T11:14:22.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:22.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821251+0000", 2024-04-26T11:14:22.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4011000000000003e-05 2024-04-26T11:14:22.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:22.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821409+0000", 2024-04-26T11:14:22.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000158498 2024-04-26T11:14:22.869 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.869 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:22.869 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.870 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:109365 5.8 5:136a4b0d:::benchmark_data_smithi029_44842_object109364:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:22.870 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:22.821218+0000", 2024-04-26T11:14:22.870 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0037740349999999998, 2024-04-26T11:14:22.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044693409999999999, 2024-04-26T11:14:22.870 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:22.870 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:22.870 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:22.870 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:22.870 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.870 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 109365 2024-04-26T11:14:22.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.870 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:22.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:22.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821218+0000", 2024-04-26T11:14:22.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:22.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821218+0000", 2024-04-26T11:14:22.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:22.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821217+0000", 2024-04-26T11:14:22.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:22.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:22.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821249+0000", 2024-04-26T11:14:22.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1476999999999997e-05 2024-04-26T11:14:22.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:22.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821256+0000", 2024-04-26T11:14:22.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3150000000000003e-06 2024-04-26T11:14:22.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.821262+0000", 2024-04-26T11:14:22.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9560000000000002e-06 2024-04-26T11:14:22.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:22.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.823150+0000", 2024-04-26T11:14:22.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001887985 2024-04-26T11:14:22.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:22.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.823299+0000", 2024-04-26T11:14:22.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014916699999999999 2024-04-26T11:14:22.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:22.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.823450+0000", 2024-04-26T11:14:22.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015034299999999999 2024-04-26T11:14:22.875 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.875 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:22.875 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.875 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:109367 5.4 5:2eae6adb:::benchmark_data_smithi029_44842_object109366:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:22.875 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:22.825339+0000", 2024-04-26T11:14:22.875 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9996529, 2024-04-26T11:14:22.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00044825699999999997, 2024-04-26T11:14:22.875 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:22.875 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:22.875 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:22.876 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:22.876 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.876 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 109367 2024-04-26T11:14:22.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.876 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:22.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:22.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825339+0000", 2024-04-26T11:14:22.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:22.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825339+0000", 2024-04-26T11:14:22.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:22.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825338+0000", 2024-04-26T11:14:22.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:22.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:22.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825401+0000", 2024-04-26T11:14:22.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2618000000000003e-05 2024-04-26T11:14:22.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:22.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825409+0000", 2024-04-26T11:14:22.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4800000000000001e-06 2024-04-26T11:14:22.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825418+0000", 2024-04-26T11:14:22.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1780000000000003e-06 2024-04-26T11:14:22.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:22.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825447+0000", 2024-04-26T11:14:22.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9765999999999999e-05 2024-04-26T11:14:22.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:22.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825535+0000", 2024-04-26T11:14:22.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7696999999999997e-05 2024-04-26T11:14:22.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:22.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825637+0000", 2024-04-26T11:14:22.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010176899999999999 2024-04-26T11:14:22.879 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.880 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:22.880 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.880 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:109368 5.b 5:d46a9629:::benchmark_data_smithi029_44842_object109367:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:22.880 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:22.825518+0000", 2024-04-26T11:14:22.880 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9994736, 2024-04-26T11:14:22.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036562500000000001, 2024-04-26T11:14:22.880 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:22.880 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:22.880 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:22.880 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:22.880 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.880 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 109368 2024-04-26T11:14:22.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.881 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:22.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:22.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825518+0000", 2024-04-26T11:14:22.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:22.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825518+0000", 2024-04-26T11:14:22.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:22.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825517+0000", 2024-04-26T11:14:22.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:22.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:22.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825572+0000", 2024-04-26T11:14:22.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4122000000000001e-05 2024-04-26T11:14:22.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:22.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825586+0000", 2024-04-26T11:14:22.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4941e-05 2024-04-26T11:14:22.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825599+0000", 2024-04-26T11:14:22.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.24e-05 2024-04-26T11:14:22.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:22.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825640+0000", 2024-04-26T11:14:22.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.074e-05 2024-04-26T11:14:22.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:22.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825764+0000", 2024-04-26T11:14:22.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012436599999999999 2024-04-26T11:14:22.883 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.884 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:22.884 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.884 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:109369 5.9 5:95a71d91:::benchmark_data_smithi029_44842_object109368:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:22.884 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:22.825610+0000", 2024-04-26T11:14:22.884 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.999382, 2024-04-26T11:14:22.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00036956400000000001, 2024-04-26T11:14:22.884 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:22.884 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:22.884 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:22.884 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:22.884 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.884 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 109369 2024-04-26T11:14:22.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.885 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:22.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:22.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825610+0000", 2024-04-26T11:14:22.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:22.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825610+0000", 2024-04-26T11:14:22.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:22.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825609+0000", 2024-04-26T11:14:22.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:22.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:22.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825653+0000", 2024-04-26T11:14:22.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3841000000000003e-05 2024-04-26T11:14:22.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:22.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825659+0000", 2024-04-26T11:14:22.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0379999999999996e-06 2024-04-26T11:14:22.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825669+0000", 2024-04-26T11:14:22.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3330000000000003e-06 2024-04-26T11:14:22.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:22.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825704+0000", 2024-04-26T11:14:22.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4932999999999999e-05 2024-04-26T11:14:22.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:22.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825833+0000", 2024-04-26T11:14:22.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012940299999999999 2024-04-26T11:14:22.888 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.888 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:22.888 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.888 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:109370 5.f 5:f8feb7a7:::benchmark_data_smithi029_44842_object109369:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:22.888 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:22.825677+0000", 2024-04-26T11:14:22.888 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9993153, 2024-04-26T11:14:22.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00038801100000000001, 2024-04-26T11:14:22.888 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:22.889 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:22.889 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:22.889 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:22.889 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:22.889 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 109370 2024-04-26T11:14:22.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.889 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:22.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:22.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825677+0000", 2024-04-26T11:14:22.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:22.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825677+0000", 2024-04-26T11:14:22.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:22.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:22.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825676+0000", 2024-04-26T11:14:22.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:22.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:22.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825774+0000", 2024-04-26T11:14:22.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7446000000000002e-05 2024-04-26T11:14:22.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:22.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825783+0000", 2024-04-26T11:14:22.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1409999999999994e-06 2024-04-26T11:14:22.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:22.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825789+0000", 2024-04-26T11:14:22.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2720000000000003e-06 2024-04-26T11:14:22.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:22.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825817+0000", 2024-04-26T11:14:22.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8140000000000002e-05 2024-04-26T11:14:22.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:22.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:22.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:22.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:22.825905+0000", 2024-04-26T11:14:22.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8146000000000006e-05 2024-04-26T11:14:22.892 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.892 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:22.893 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.893 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:22.893 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:14:22.893 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 14 2024-04-26T11:14:22.893 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:22.894 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:22.895 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:22.893+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:22.996 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:22.995+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:23.096 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:23.095+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:23.104 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:23.104 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:14:23.104 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:14:23.104 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:14:23.104 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:23.120 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:23.197 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:23.196+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:23.290 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:23.290 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:14:23.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:14:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.007633568999999, 2024-04-26T11:14:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:14:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:14:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:23.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:14:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:14:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:14:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:14:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:14:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:14:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:14:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:14:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:14:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:14:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:14:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:14:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:14:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:14:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:14:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:14:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:14:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:14:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:23.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:14:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:14:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.006983866999999, 2024-04-26T11:14:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:14:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:23.296 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:14:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:14:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:14:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:14:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:14:23.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:14:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:14:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:14:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:14:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:14:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:14:23.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:14:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:14:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:14:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:14:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:14:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:23.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:14:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:14:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:14:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:14:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:14:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:14:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.940341828000001, 2024-04-26T11:14:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:14:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:14:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:23.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:14:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:14:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:14:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:14:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:14:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:14:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:14:23.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:14:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:14:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:14:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:14:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:14:23.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:14:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:14:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:14:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:23.306 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.940246181999999, 2024-04-26T11:14:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:14:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:14:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:14:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:14:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:14:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:23.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:14:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:14:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:14:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:14:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:14:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:14:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:14:23.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:14:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:14:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:14:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:14:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:14:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:23.310 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.940114503, 2024-04-26T11:14:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:14:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:14:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:23.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:23.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:14:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:14:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:14:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:14:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:14:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:14:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:14:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:14:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:14:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:14:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:14:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:14:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:14:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:14:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:23.315 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.940006047000001, 2024-04-26T11:14:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:14:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:14:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:14:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:14:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:14:23.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:14:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:14:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:14:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:14:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:14:23.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:14:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:14:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:14:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:14:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:14:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:23.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:14:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:14:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.939904778999999, 2024-04-26T11:14:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:14:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:23.320 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.321 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:14:23.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.321 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:23.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:23.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:23.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:23.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:23.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:23.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:23.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:23.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:14:23.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:14:23.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:23.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:14:23.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:14:23.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:14:23.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:14:23.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:14:23.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:14:23.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:23.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:14:23.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:14:23.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:14:23.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:14:23.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:23.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:14:23.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:14:23.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:23.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:14:23.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:14:23.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:23.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:14:23.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:14:23.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:23.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:14:23.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:14:23.325 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.325 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:23.325 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.325 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:23.326 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:23.326 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.939835838, 2024-04-26T11:14:23.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:14:23.326 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:23.326 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:23.326 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:23.326 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:23.326 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.326 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:14:23.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.326 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:23.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:23.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:23.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:23.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:23.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:23.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:14:23.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:23.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:14:23.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:14:23.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:23.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:14:23.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:14:23.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:14:23.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:14:23.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:14:23.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:14:23.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:23.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:14:23.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:14:23.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:14:23.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:14:23.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:23.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:14:23.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:14:23.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:23.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:14:23.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:14:23.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:23.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:14:23.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:14:23.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:23.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:14:23.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:14:23.331 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.331 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:23.331 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.331 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:23.331 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:23.331 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.933840257, 2024-04-26T11:14:23.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:14:23.331 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:23.331 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:23.332 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:23.332 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:23.332 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.332 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:14:23.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.332 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:23.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:23.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:23.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:23.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:23.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:23.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:14:23.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:23.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:14:23.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:14:23.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:23.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:14:23.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:14:23.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:14:23.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:14:23.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:14:23.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:14:23.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:23.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:14:23.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:14:23.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:14:23.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:14:23.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:23.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:14:23.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:14:23.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:23.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:14:23.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:14:23.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:23.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:14:23.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:14:23.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:23.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:14:23.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:14:23.336 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.336 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:23.337 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.337 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:81256 5.8 5:1c0f3fd8:::benchmark_data_smithi029_44842_object81255:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:23.337 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:23.337 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.170380708, 2024-04-26T11:14:23.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026193673000000001, 2024-04-26T11:14:23.337 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:23.337 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:23.337 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:23.337 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:23.337 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.337 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 81256 2024-04-26T11:14:23.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.338 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:23.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:23.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:23.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:23.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:23.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:23.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:23.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:23.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116073+0000", 2024-04-26T11:14:23.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0114e-05 2024-04-26T11:14:23.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:23.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116079+0000", 2024-04-26T11:14:23.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8939999999999998e-06 2024-04-26T11:14:23.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116082+0000", 2024-04-26T11:14:23.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:14:23.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127501+0000", 2024-04-26T11:14:23.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011418281000000001 2024-04-26T11:14:23.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:23.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127639+0000", 2024-04-26T11:14:23.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013828899999999999 2024-04-26T11:14:23.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:23.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127782+0000", 2024-04-26T11:14:23.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014328299999999999 2024-04-26T11:14:23.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:23.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.134767+0000", 2024-04-26T11:14:23.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0069844140000000004 2024-04-26T11:14:23.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:23.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142160+0000", 2024-04-26T11:14:23.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007392839 2024-04-26T11:14:23.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:23.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142202+0000", 2024-04-26T11:14:23.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2797999999999999e-05 2024-04-26T11:14:23.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:23.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142237+0000", 2024-04-26T11:14:23.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4464000000000001e-05 2024-04-26T11:14:23.342 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.342 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:23.342 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.342 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90441 5.4 5:2b047885:::benchmark_data_smithi029_44842_object90440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:23.342 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:23.343 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.1362173480000006, 2024-04-26T11:14:23.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026164084000000001, 2024-04-26T11:14:23.343 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:23.343 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:23.343 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:23.343 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:23.343 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.343 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90441 2024-04-26T11:14:23.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.343 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:23.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:23.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:23.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:23.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:23.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:23.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150206+0000", 2024-04-26T11:14:23.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:23.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150261+0000", 2024-04-26T11:14:23.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4580000000000003e-05 2024-04-26T11:14:23.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:23.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150269+0000", 2024-04-26T11:14:23.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9679999999999995e-06 2024-04-26T11:14:23.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150274+0000", 2024-04-26T11:14:23.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8470000000000003e-06 2024-04-26T11:14:23.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150312+0000", 2024-04-26T11:14:23.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7245e-05 2024-04-26T11:14:23.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:23.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150396+0000", 2024-04-26T11:14:23.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4778999999999996e-05 2024-04-26T11:14:23.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:23.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150491+0000", 2024-04-26T11:14:23.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4606999999999997e-05 2024-04-26T11:14:23.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:23.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.153991+0000", 2024-04-26T11:14:23.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035001339999999998 2024-04-26T11:14:23.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:23.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176295+0000", 2024-04-26T11:14:23.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022304280999999999 2024-04-26T11:14:23.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:23.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176335+0000", 2024-04-26T11:14:23.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:23.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:23.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176371+0000", 2024-04-26T11:14:23.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5448999999999999e-05 2024-04-26T11:14:23.348 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.348 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:23.348 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.348 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101746 5.b 5:dcf04831:::benchmark_data_smithi029_44842_object101745:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:23.348 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.115039+0000", 2024-04-26T11:14:23.348 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.1713849999999999, 2024-04-26T11:14:23.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025752292999999999, 2024-04-26T11:14:23.348 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:23.348 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:23.349 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:23.349 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:23.349 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.349 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101746 2024-04-26T11:14:23.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.349 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:23.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:23.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115039+0000", 2024-04-26T11:14:23.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:23.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115039+0000", 2024-04-26T11:14:23.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:23.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115038+0000", 2024-04-26T11:14:23.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:23.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:23.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115105+0000", 2024-04-26T11:14:23.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6908000000000004e-05 2024-04-26T11:14:23.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:23.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115115+0000", 2024-04-26T11:14:23.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5200000000000003e-06 2024-04-26T11:14:23.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115122+0000", 2024-04-26T11:14:23.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5519999999999999e-06 2024-04-26T11:14:23.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115883+0000", 2024-04-26T11:14:23.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00076097600000000001 2024-04-26T11:14:23.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:23.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115971+0000", 2024-04-26T11:14:23.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7771999999999999e-05 2024-04-26T11:14:23.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:23.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.116055+0000", 2024-04-26T11:14:23.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3963999999999998e-05 2024-04-26T11:14:23.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:23.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.117903+0000", 2024-04-26T11:14:23.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001847932 2024-04-26T11:14:23.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:23.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140703+0000", 2024-04-26T11:14:23.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022800276000000001 2024-04-26T11:14:23.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:23.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140755+0000", 2024-04-26T11:14:23.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2052000000000002e-05 2024-04-26T11:14:23.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:23.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140791+0000", 2024-04-26T11:14:23.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6060999999999999e-05 2024-04-26T11:14:23.353 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.353 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:23.353 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.353 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101754 5.e 5:7ca15a5c:::benchmark_data_smithi029_44842_object101753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:23.354 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:23.354 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.1678925150000001, 2024-04-26T11:14:23.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039171048999999999, 2024-04-26T11:14:23.354 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:23.354 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:23.354 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:23.354 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:23.354 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.354 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101754 2024-04-26T11:14:23.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.354 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:23.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:23.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:23.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:23.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:23.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:23.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:23.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:23.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118604+0000", 2024-04-26T11:14:23.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3399000000000007e-05 2024-04-26T11:14:23.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:23.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118613+0000", 2024-04-26T11:14:23.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6989999999999992e-06 2024-04-26T11:14:23.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118618+0000", 2024-04-26T11:14:23.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3850000000000001e-06 2024-04-26T11:14:23.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118646+0000", 2024-04-26T11:14:23.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7878e-05 2024-04-26T11:14:23.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:23.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118720+0000", 2024-04-26T11:14:23.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3461999999999996e-05 2024-04-26T11:14:23.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:23.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118807+0000", 2024-04-26T11:14:23.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7269999999999996e-05 2024-04-26T11:14:23.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:23.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142317+0000", 2024-04-26T11:14:23.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023510105999999999 2024-04-26T11:14:23.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:23.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.143287+0000", 2024-04-26T11:14:23.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096983599999999996 2024-04-26T11:14:23.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:23.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157662+0000", 2024-04-26T11:14:23.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014375393 2024-04-26T11:14:23.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:23.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157702+0000", 2024-04-26T11:14:23.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0295e-05 2024-04-26T11:14:23.359 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.359 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:23.359 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.359 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101755 5.f 5:fa973a83:::benchmark_data_smithi029_44842_object101754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:23.359 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:23.359 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.1677268190000003, 2024-04-26T11:14:23.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039139064000000001, 2024-04-26T11:14:23.359 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:23.359 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:23.359 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:23.359 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:23.360 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.360 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101755 2024-04-26T11:14:23.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.360 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:23.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:23.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:23.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:23.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:23.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:23.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118696+0000", 2024-04-26T11:14:23.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:23.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118766+0000", 2024-04-26T11:14:23.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9423000000000003e-05 2024-04-26T11:14:23.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:23.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118774+0000", 2024-04-26T11:14:23.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9710000000000004e-06 2024-04-26T11:14:23.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118779+0000", 2024-04-26T11:14:23.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5629999999999999e-06 2024-04-26T11:14:23.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118817+0000", 2024-04-26T11:14:23.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7771000000000001e-05 2024-04-26T11:14:23.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:23.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118929+0000", 2024-04-26T11:14:23.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011222699999999999 2024-04-26T11:14:23.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:23.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157661+0000", 2024-04-26T11:14:23.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038731120000000001 2024-04-26T11:14:23.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:23.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157757+0000", 2024-04-26T11:14:23.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6910000000000006e-05 2024-04-26T11:14:23.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:23.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157836+0000", 2024-04-26T11:14:23.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8727999999999996e-05 2024-04-26T11:14:23.364 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.364 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:23.364 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.364 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101758 5.4 5:2525a4eb:::benchmark_data_smithi029_44842_object101757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:23.364 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:23.364 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.1655439679999997, 2024-04-26T11:14:23.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.03686739, 2024-04-26T11:14:23.364 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:23.364 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:23.364 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:23.364 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:23.364 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.365 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101758 2024-04-26T11:14:23.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.365 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:23.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:23.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:23.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:23.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:23.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:23.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120879+0000", 2024-04-26T11:14:23.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:23.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120971+0000", 2024-04-26T11:14:23.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2133999999999996e-05 2024-04-26T11:14:23.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:23.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120977+0000", 2024-04-26T11:14:23.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5509999999999999e-06 2024-04-26T11:14:23.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120981+0000", 2024-04-26T11:14:23.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.245e-06 2024-04-26T11:14:23.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121010+0000", 2024-04-26T11:14:23.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9084000000000001e-05 2024-04-26T11:14:23.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:23.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121083+0000", 2024-04-26T11:14:23.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2942999999999996e-05 2024-04-26T11:14:23.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:23.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121163+0000", 2024-04-26T11:14:23.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0197000000000005e-05 2024-04-26T11:14:23.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:23.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142822+0000", 2024-04-26T11:14:23.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021658535999999999 2024-04-26T11:14:23.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:23.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157674+0000", 2024-04-26T11:14:23.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014851573999999999 2024-04-26T11:14:23.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:23.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157714+0000", 2024-04-26T11:14:23.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0473999999999999e-05 2024-04-26T11:14:23.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:23.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157747+0000", 2024-04-26T11:14:23.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3278999999999998e-05 2024-04-26T11:14:23.369 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.369 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:23.369 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.370 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101760 5.4 5:2510211a:::benchmark_data_smithi029_44842_object101759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:23.370 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:23.370 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.1651116229999996, 2024-04-26T11:14:23.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039182383000000001, 2024-04-26T11:14:23.370 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:23.370 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:23.370 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:23.370 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:23.370 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.370 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101760 2024-04-26T11:14:23.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.371 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:23.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:23.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:23.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:23.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:23.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:23.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:23.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:23.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121389+0000", 2024-04-26T11:14:23.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6667000000000003e-05 2024-04-26T11:14:23.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:23.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121394+0000", 2024-04-26T11:14:23.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0839999999999999e-06 2024-04-26T11:14:23.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121397+0000", 2024-04-26T11:14:23.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4489999999999999e-06 2024-04-26T11:14:23.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122921+0000", 2024-04-26T11:14:23.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001524067 2024-04-26T11:14:23.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:23.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.123010+0000", 2024-04-26T11:14:23.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8449000000000006e-05 2024-04-26T11:14:23.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:23.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140838+0000", 2024-04-26T11:14:23.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017828796000000001 2024-04-26T11:14:23.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:23.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157665+0000", 2024-04-26T11:14:23.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016826574 2024-04-26T11:14:23.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:23.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160407+0000", 2024-04-26T11:14:23.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027423970000000002 2024-04-26T11:14:23.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:23.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160456+0000", 2024-04-26T11:14:23.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8678999999999999e-05 2024-04-26T11:14:23.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:23.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160495+0000", 2024-04-26T11:14:23.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8658000000000002e-05 2024-04-26T11:14:23.375 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.375 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:23.375 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.376 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101761 5.e 5:70294421:::benchmark_data_smithi029_44842_object101760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:23.376 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:23.376 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.1636872499999997, 2024-04-26T11:14:23.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035270448000000003, 2024-04-26T11:14:23.376 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:23.376 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:23.376 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:23.376 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:23.376 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.376 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101761 2024-04-26T11:14:23.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.376 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:23.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:23.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:23.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:23.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:23.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:23.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122736+0000", 2024-04-26T11:14:23.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:23.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122805+0000", 2024-04-26T11:14:23.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9076000000000001e-05 2024-04-26T11:14:23.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:23.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122811+0000", 2024-04-26T11:14:23.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:14:23.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122815+0000", 2024-04-26T11:14:23.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2860000000000001e-06 2024-04-26T11:14:23.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122842+0000", 2024-04-26T11:14:23.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6429000000000001e-05 2024-04-26T11:14:23.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:23.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122916+0000", 2024-04-26T11:14:23.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4122999999999995e-05 2024-04-26T11:14:23.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:23.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122997+0000", 2024-04-26T11:14:23.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1428999999999996e-05 2024-04-26T11:14:23.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:23.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142344+0000", 2024-04-26T11:14:23.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019346452 2024-04-26T11:14:23.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:23.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157934+0000", 2024-04-26T11:14:23.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015589911999999999 2024-04-26T11:14:23.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:23.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157975+0000", 2024-04-26T11:14:23.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1604999999999999e-05 2024-04-26T11:14:23.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:23.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.158007+0000", 2024-04-26T11:14:23.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1921000000000002e-05 2024-04-26T11:14:23.381 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.381 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:23.381 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.381 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110145 5.9 5:9b275f16:::benchmark_data_smithi029_44842_object110144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:23.381 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:23.381 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.13812561200000001, 2024-04-26T11:14:23.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032844496000000001, 2024-04-26T11:14:23.381 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:23.381 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:23.382 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:23.382 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:23.382 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.382 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110145 2024-04-26T11:14:23.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.382 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:23.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:23.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:23.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:23.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:23.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:23.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148297+0000", 2024-04-26T11:14:23.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:23.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:23.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148325+0000", 2024-04-26T11:14:23.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7511000000000001e-05 2024-04-26T11:14:23.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:23.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148338+0000", 2024-04-26T11:14:23.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2808e-05 2024-04-26T11:14:23.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148345+0000", 2024-04-26T11:14:23.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7200000000000006e-06 2024-04-26T11:14:23.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149888+0000", 2024-04-26T11:14:23.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001542666 2024-04-26T11:14:23.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:23.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149977+0000", 2024-04-26T11:14:23.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9247999999999997e-05 2024-04-26T11:14:23.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:23.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181006+0000", 2024-04-26T11:14:23.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031028535999999999 2024-04-26T11:14:23.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:23.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181051+0000", 2024-04-26T11:14:23.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5393999999999999e-05 2024-04-26T11:14:23.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:23.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181143+0000", 2024-04-26T11:14:23.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1458000000000004e-05 2024-04-26T11:14:23.386 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.386 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:23.386 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.386 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110155 5.9 5:9ebc6158:::benchmark_data_smithi029_44842_object110154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:23.386 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:23.386 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.13304982000000001, 2024-04-26T11:14:23.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027886826999999999, 2024-04-26T11:14:23.387 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:23.387 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:23.387 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:23.387 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:23.387 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.387 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110155 2024-04-26T11:14:23.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.387 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:23.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:23.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:23.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:23.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:23.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:23.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153373+0000", 2024-04-26T11:14:23.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:23.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153479+0000", 2024-04-26T11:14:23.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105728 2024-04-26T11:14:23.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:23.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153491+0000", 2024-04-26T11:14:23.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2207e-05 2024-04-26T11:14:23.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153499+0000", 2024-04-26T11:14:23.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7729999999999999e-06 2024-04-26T11:14:23.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153655+0000", 2024-04-26T11:14:23.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015573 2024-04-26T11:14:23.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:23.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153770+0000", 2024-04-26T11:14:23.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011562500000000001 2024-04-26T11:14:23.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:23.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181153+0000", 2024-04-26T11:14:23.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027382113 2024-04-26T11:14:23.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:23.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181195+0000", 2024-04-26T11:14:23.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1921000000000001e-05 2024-04-26T11:14:23.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:23.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181261+0000", 2024-04-26T11:14:23.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6402999999999994e-05 2024-04-26T11:14:23.391 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.391 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:23.391 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.391 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110162 5.9 5:98f89097:::benchmark_data_smithi029_44842_object110161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:23.391 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.156486+0000", 2024-04-26T11:14:23.391 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.12993806699999999, 2024-04-26T11:14:23.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025002745999999999, 2024-04-26T11:14:23.391 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:23.392 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:23.392 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:23.392 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:23.392 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.392 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110162 2024-04-26T11:14:23.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.392 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:23.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:23.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.156486+0000", 2024-04-26T11:14:23.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:23.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.156486+0000", 2024-04-26T11:14:23.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:23.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:23.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.156485+0000", 2024-04-26T11:14:23.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:23.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.156517+0000", 2024-04-26T11:14:23.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1958999999999997e-05 2024-04-26T11:14:23.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:23.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.156524+0000", 2024-04-26T11:14:23.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:14:23.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.156529+0000", 2024-04-26T11:14:23.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8930000000000004e-06 2024-04-26T11:14:23.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:23.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.170559+0000", 2024-04-26T11:14:23.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014030331 2024-04-26T11:14:23.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:23.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.170693+0000", 2024-04-26T11:14:23.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013373000000000001 2024-04-26T11:14:23.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:23.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181386+0000", 2024-04-26T11:14:23.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010693326 2024-04-26T11:14:23.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:23.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181423+0000", 2024-04-26T11:14:23.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6857999999999998e-05 2024-04-26T11:14:23.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:23.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:23.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:23.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181489+0000", 2024-04-26T11:14:23.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5450000000000005e-05 2024-04-26T11:14:23.396 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.396 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:23.396 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.396 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:23.396 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:23.396 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:23.397 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:23.396+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:23.398 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:23.413 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 45 16 110735 110719 153.763 141.938 0.00636371 0.00650109 2024-04-26T11:14:23.498 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:23.497+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:23.575 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:23.575 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:23.576 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.576 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:111071 5.3 5.2608b373 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:23.576 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:23.571864+0000", 2024-04-26T11:14:23.576 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0015032310000000001, 2024-04-26T11:14:23.576 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001524021, 2024-04-26T11:14:23.576 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:23.576 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:23.576 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:23.576 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:23.576 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.576 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 111071 2024-04-26T11:14:23.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.577 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:23.577 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.577 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:23.577 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571864+0000", 2024-04-26T11:14:23.577 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.577 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.577 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:23.577 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571864+0000", 2024-04-26T11:14:23.577 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.577 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.577 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:23.577 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571863+0000", 2024-04-26T11:14:23.578 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:23.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.578 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.578 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:23.578 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571891+0000", 2024-04-26T11:14:23.578 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7625000000000001e-05 2024-04-26T11:14:23.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.578 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.578 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:23.578 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571900+0000", 2024-04-26T11:14:23.578 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2930000000000006e-06 2024-04-26T11:14:23.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.578 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.579 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.579 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571907+0000", 2024-04-26T11:14:23.579 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7959999999999998e-06 2024-04-26T11:14:23.579 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.579 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:23.579 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.579 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.579 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:111046 5.3 5:c060d8c3:::benchmark_data_smithi029_44842_object111045:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:23.579 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:23.557408+0000", 2024-04-26T11:14:23.579 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.015959053000000001, 2024-04-26T11:14:23.579 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016025014000000001, 2024-04-26T11:14:23.579 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:23.579 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:23.580 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:23.580 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:23.580 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.580 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 111046 2024-04-26T11:14:23.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.580 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:23.580 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.580 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:23.580 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.557408+0000", 2024-04-26T11:14:23.580 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.580 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.580 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:23.580 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.557408+0000", 2024-04-26T11:14:23.581 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.581 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.581 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:23.581 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.557407+0000", 2024-04-26T11:14:23.581 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.581 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.581 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:23.581 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.557468+0000", 2024-04-26T11:14:23.581 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0928999999999999e-05 2024-04-26T11:14:23.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.581 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.581 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:23.582 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.557478+0000", 2024-04-26T11:14:23.582 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0063e-05 2024-04-26T11:14:23.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.582 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.582 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.582 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.557486+0000", 2024-04-26T11:14:23.582 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5850000000000002e-06 2024-04-26T11:14:23.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.582 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.582 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:23.583 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.558508+0000", 2024-04-26T11:14:23.583 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0010221309999999999 2024-04-26T11:14:23.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.583 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.583 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:23.583 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.558636+0000", 2024-04-26T11:14:23.583 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000127661 2024-04-26T11:14:23.583 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.583 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:23.584 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.584 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.584 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:111050 5.b e37/16 5:d03895d3:::benchmark_data_smithi029_44842_object111049:head v 37'7086, mlcod=37'7083)", 2024-04-26T11:14:23.584 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:23.559517+0000", 2024-04-26T11:14:23.584 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.013850177, 2024-04-26T11:14:23.584 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.013963481999999999, 2024-04-26T11:14:23.584 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:23.584 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:23.584 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:23.584 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.584 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:23.584 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.559517+0000", 2024-04-26T11:14:23.585 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.585 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:23.585 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.559517+0000", 2024-04-26T11:14:23.585 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.585 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:23.585 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.559516+0000", 2024-04-26T11:14:23.585 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.585 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:23.586 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.559613+0000", 2024-04-26T11:14:23.586 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6323000000000006e-05 2024-04-26T11:14:23.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.586 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.586 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:23.586 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.559620+0000", 2024-04-26T11:14:23.586 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.17e-06 2024-04-26T11:14:23.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.586 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.586 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.586 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.559625+0000", 2024-04-26T11:14:23.586 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3870000000000003e-06 2024-04-26T11:14:23.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.587 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.587 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:23.587 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.562782+0000", 2024-04-26T11:14:23.587 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0031569499999999999 2024-04-26T11:14:23.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.587 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.587 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:23.587 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.562802+0000", 2024-04-26T11:14:23.587 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9539999999999999e-05 2024-04-26T11:14:23.587 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.587 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:23.587 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.587 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.587 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:111052 5.b e37/16 5:d3ac1f96:::benchmark_data_smithi029_44842_object111051:head v 37'7087, mlcod=37'7083)", 2024-04-26T11:14:23.588 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:23.561340+0000", 2024-04-26T11:14:23.588 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.012026828, 2024-04-26T11:14:23.588 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.012174717999999999, 2024-04-26T11:14:23.588 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:23.588 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:23.588 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:23.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.588 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:23.588 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.561340+0000", 2024-04-26T11:14:23.588 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.588 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:23.588 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.561340+0000", 2024-04-26T11:14:23.589 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.589 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:23.589 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.561339+0000", 2024-04-26T11:14:23.589 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:23.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.589 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:23.589 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.561404+0000", 2024-04-26T11:14:23.589 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5128000000000004e-05 2024-04-26T11:14:23.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.589 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:23.590 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.561415+0000", 2024-04-26T11:14:23.590 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0855e-05 2024-04-26T11:14:23.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.590 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.590 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.590 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.561422+0000", 2024-04-26T11:14:23.590 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9539999999999998e-06 2024-04-26T11:14:23.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.590 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.590 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:23.590 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.564855+0000", 2024-04-26T11:14:23.590 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0034331639999999998 2024-04-26T11:14:23.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.590 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.591 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:23.591 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.564872+0000", 2024-04-26T11:14:23.591 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6779e-05 2024-04-26T11:14:23.591 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.591 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:23.591 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.591 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:111054 5.b e37/16 5:da37d028:::benchmark_data_smithi029_44842_object111053:head v 37'7088, mlcod=37'7083)", 2024-04-26T11:14:23.591 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:23.562844+0000", 2024-04-26T11:14:23.591 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.010523278, 2024-04-26T11:14:23.591 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.010705409000000001, 2024-04-26T11:14:23.591 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:23.591 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:23.592 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:23.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.592 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:23.592 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.562844+0000", 2024-04-26T11:14:23.592 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.592 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:23.592 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.562844+0000", 2024-04-26T11:14:23.592 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.592 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:23.592 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.562843+0000", 2024-04-26T11:14:23.592 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.593 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.593 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:23.593 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.562898+0000", 2024-04-26T11:14:23.593 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5139999999999997e-05 2024-04-26T11:14:23.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.594 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.594 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:23.594 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.562906+0000", 2024-04-26T11:14:23.594 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3220000000000004e-06 2024-04-26T11:14:23.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.594 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.594 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.594 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.562911+0000", 2024-04-26T11:14:23.594 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8869999999999997e-06 2024-04-26T11:14:23.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.594 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.594 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:23.594 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.568537+0000", 2024-04-26T11:14:23.595 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0056259589999999998 2024-04-26T11:14:23.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.595 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.595 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:23.595 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.568555+0000", 2024-04-26T11:14:23.595 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7382000000000001e-05 2024-04-26T11:14:23.595 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.595 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:23.595 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.595 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.595 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:111056 5.b e37/16 5:d38e90a2:::benchmark_data_smithi029_44842_object111055:head v 37'7089, mlcod=37'7083)", 2024-04-26T11:14:23.595 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:23.564036+0000", 2024-04-26T11:14:23.595 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0093307830000000005, 2024-04-26T11:14:23.595 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0095458910000000008, 2024-04-26T11:14:23.596 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:23.596 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:23.596 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:23.596 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.596 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:23.596 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.564036+0000", 2024-04-26T11:14:23.596 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.596 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.596 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:23.596 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.564036+0000", 2024-04-26T11:14:23.596 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.596 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.597 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:23.597 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.564035+0000", 2024-04-26T11:14:23.597 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.597 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.597 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:23.597 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.564063+0000", 2024-04-26T11:14:23.597 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7898e-05 2024-04-26T11:14:23.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.597 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.597 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:23.597 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.564073+0000", 2024-04-26T11:14:23.597 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0003999999999999e-05 2024-04-26T11:14:23.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.598 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.598 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.598 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.564078+0000", 2024-04-26T11:14:23.598 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0320000000000003e-06 2024-04-26T11:14:23.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.598 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.598 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:23.598 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569818+0000", 2024-04-26T11:14:23.598 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057394660000000004 2024-04-26T11:14:23.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.598 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.598 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:23.598 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569891+0000", 2024-04-26T11:14:23.598 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3135999999999999e-05 2024-04-26T11:14:23.598 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.599 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:23.599 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.599 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.599 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:111062 5.3 5:cb64850a:::benchmark_data_smithi029_44842_object111061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:23.599 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:23.569199+0000", 2024-04-26T11:14:23.599 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0041683909999999996, 2024-04-26T11:14:23.599 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0044197419999999999, 2024-04-26T11:14:23.599 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:23.599 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:23.599 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:23.599 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:23.599 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.599 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 111062 2024-04-26T11:14:23.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.600 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:23.600 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.600 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:23.600 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569199+0000", 2024-04-26T11:14:23.600 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.600 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.600 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:23.600 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569199+0000", 2024-04-26T11:14:23.600 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.600 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.600 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:23.600 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569198+0000", 2024-04-26T11:14:23.600 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:23.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.601 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.601 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:23.601 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569303+0000", 2024-04-26T11:14:23.601 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010534100000000001 2024-04-26T11:14:23.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.601 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.601 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:23.601 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569312+0000", 2024-04-26T11:14:23.601 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6479999999999992e-06 2024-04-26T11:14:23.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.601 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.601 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.601 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569317+0000", 2024-04-26T11:14:23.602 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4559999999999999e-06 2024-04-26T11:14:23.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.602 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.602 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:23.602 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569809+0000", 2024-04-26T11:14:23.602 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00049224999999999996 2024-04-26T11:14:23.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.602 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.602 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:23.602 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569927+0000", 2024-04-26T11:14:23.602 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000118078 2024-04-26T11:14:23.602 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.602 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:23.602 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.603 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:111064 5.2 5:4c9fee6b:::benchmark_data_smithi029_44842_object111063:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:23.603 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:23.569343+0000", 2024-04-26T11:14:23.603 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0040242749999999999, 2024-04-26T11:14:23.603 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0043150719999999997, 2024-04-26T11:14:23.603 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:23.603 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:23.603 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:23.603 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:23.603 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.603 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 111064 2024-04-26T11:14:23.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.604 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:23.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.604 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:23.604 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569343+0000", 2024-04-26T11:14:23.604 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.604 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:23.604 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569343+0000", 2024-04-26T11:14:23.604 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.604 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:23.604 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569342+0000", 2024-04-26T11:14:23.605 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.605 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.605 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:23.605 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569405+0000", 2024-04-26T11:14:23.605 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2896000000000002e-05 2024-04-26T11:14:23.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.605 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.605 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:23.605 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569412+0000", 2024-04-26T11:14:23.605 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.131e-06 2024-04-26T11:14:23.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.605 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.605 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.606 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569418+0000", 2024-04-26T11:14:23.606 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0700000000000003e-06 2024-04-26T11:14:23.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.606 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.606 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:23.606 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569444+0000", 2024-04-26T11:14:23.606 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6157999999999999e-05 2024-04-26T11:14:23.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.606 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.606 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:23.606 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569580+0000", 2024-04-26T11:14:23.606 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013612100000000001 2024-04-26T11:14:23.606 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.606 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:23.607 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.607 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.607 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:111065 5.2 5:41a06b13:::benchmark_data_smithi029_44842_object111064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:23.607 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:23.569425+0000", 2024-04-26T11:14:23.607 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0039423380000000001, 2024-04-26T11:14:23.607 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042897450000000002, 2024-04-26T11:14:23.607 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:23.607 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:23.607 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:23.607 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:23.607 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.607 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 111065 2024-04-26T11:14:23.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.607 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:23.608 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.608 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:23.608 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569425+0000", 2024-04-26T11:14:23.608 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.608 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.608 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:23.608 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569425+0000", 2024-04-26T11:14:23.608 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.608 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.608 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:23.608 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569424+0000", 2024-04-26T11:14:23.608 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.609 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.609 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:23.609 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569482+0000", 2024-04-26T11:14:23.609 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7846999999999997e-05 2024-04-26T11:14:23.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.609 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.609 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:23.609 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569491+0000", 2024-04-26T11:14:23.609 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6940000000000001e-06 2024-04-26T11:14:23.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.609 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.609 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.609 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569501+0000", 2024-04-26T11:14:23.609 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0291e-05 2024-04-26T11:14:23.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.610 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.610 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:23.610 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571422+0000", 2024-04-26T11:14:23.610 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001921191 2024-04-26T11:14:23.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.610 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.610 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:23.610 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571588+0000", 2024-04-26T11:14:23.610 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00016596100000000001 2024-04-26T11:14:23.610 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.610 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:23.610 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.610 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:111060 5.e e37/16 5:754b1745:::benchmark_data_smithi029_44842_object111059:head v 37'6969, mlcod=37'6965)", 2024-04-26T11:14:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:23.569447+0000", 2024-04-26T11:14:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0039195979999999998, 2024-04-26T11:14:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0043123479999999997, 2024-04-26T11:14:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569447+0000", 2024-04-26T11:14:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569447+0000", 2024-04-26T11:14:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569447+0000", 2024-04-26T11:14:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569538+0000", 2024-04-26T11:14:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1335999999999994e-05 2024-04-26T11:14:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.613 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:23.613 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569545+0000", 2024-04-26T11:14:23.613 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.489e-06 2024-04-26T11:14:23.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.613 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.613 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.613 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569548+0000", 2024-04-26T11:14:23.613 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5870000000000001e-06 2024-04-26T11:14:23.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.613 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.613 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:23.613 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569578+0000", 2024-04-26T11:14:23.613 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9390000000000002e-05 2024-04-26T11:14:23.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.614 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.614 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:23.614 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569595+0000", 2024-04-26T11:14:23.614 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7354e-05 2024-04-26T11:14:23.614 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.614 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:23.614 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.614 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.614 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:111066 5.1 5:8b75399d:::benchmark_data_smithi029_44842_object111065:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:23.614 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:23.569520+0000", 2024-04-26T11:14:23.614 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0038473449999999998, 2024-04-26T11:14:23.614 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042947300000000001, 2024-04-26T11:14:23.614 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:23.615 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:23.615 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:23.615 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:23.615 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.615 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 111066 2024-04-26T11:14:23.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.615 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:23.615 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.615 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:23.615 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569520+0000", 2024-04-26T11:14:23.615 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.615 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.615 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:23.615 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569520+0000", 2024-04-26T11:14:23.616 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.616 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.616 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:23.616 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569519+0000", 2024-04-26T11:14:23.616 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.616 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.616 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:23.616 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569577+0000", 2024-04-26T11:14:23.616 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8471999999999999e-05 2024-04-26T11:14:23.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.616 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.616 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:23.616 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569585+0000", 2024-04-26T11:14:23.617 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8490000000000006e-06 2024-04-26T11:14:23.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.617 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.617 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.617 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569592+0000", 2024-04-26T11:14:23.617 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6939999999999998e-06 2024-04-26T11:14:23.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.617 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.617 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:23.617 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569628+0000", 2024-04-26T11:14:23.617 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5858000000000001e-05 2024-04-26T11:14:23.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.617 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.617 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:23.618 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569709+0000", 2024-04-26T11:14:23.618 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0987000000000002e-05 2024-04-26T11:14:23.618 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.618 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:23.618 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.618 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.618 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:111063 5.a e37/31 5:57cbb69f:::benchmark_data_smithi029_44842_object111062:head v 37'7042, mlcod=37'7040)", 2024-04-26T11:14:23.618 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:23.569771+0000", 2024-04-26T11:14:23.618 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0035963010000000001, 2024-04-26T11:14:23.618 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0040831050000000001, 2024-04-26T11:14:23.618 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:23.618 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:23.618 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:23.619 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.619 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:23.619 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569771+0000", 2024-04-26T11:14:23.619 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.619 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.619 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:23.619 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569771+0000", 2024-04-26T11:14:23.619 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.619 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.619 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:23.619 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569770+0000", 2024-04-26T11:14:23.619 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.620 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.620 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:23.620 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569857+0000", 2024-04-26T11:14:23.620 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6885000000000006e-05 2024-04-26T11:14:23.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.620 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.620 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:23.620 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569865+0000", 2024-04-26T11:14:23.620 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8800000000000008e-06 2024-04-26T11:14:23.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.620 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.620 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.620 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.569871+0000", 2024-04-26T11:14:23.620 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7230000000000001e-06 2024-04-26T11:14:23.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.621 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.621 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:23.621 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.570955+0000", 2024-04-26T11:14:23.621 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0010845379999999999 2024-04-26T11:14:23.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.621 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.621 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:23.621 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.570967+0000", 2024-04-26T11:14:23.621 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1663e-05 2024-04-26T11:14:23.621 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.621 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:23.621 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.622 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.622 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:111068 5.2 5.79ab7b42 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:23.622 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:23.571033+0000", 2024-04-26T11:14:23.622 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.002334086, 2024-04-26T11:14:23.622 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002856159, 2024-04-26T11:14:23.622 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:23.622 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:23.622 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:23.622 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:23.622 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.622 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 111068 2024-04-26T11:14:23.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.622 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:23.622 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.623 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:23.623 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571033+0000", 2024-04-26T11:14:23.623 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.623 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.623 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:23.623 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571033+0000", 2024-04-26T11:14:23.623 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.623 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.623 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:23.623 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571032+0000", 2024-04-26T11:14:23.623 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:23.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.624 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.624 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:23.624 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571085+0000", 2024-04-26T11:14:23.624 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3109999999999998e-05 2024-04-26T11:14:23.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.624 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.624 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:23.624 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571096+0000", 2024-04-26T11:14:23.624 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1433999999999999e-05 2024-04-26T11:14:23.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.624 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.624 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.624 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571105+0000", 2024-04-26T11:14:23.624 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.1189999999999997e-06 2024-04-26T11:14:23.624 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.625 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:23.625 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.625 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.625 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:111069 5.6 5:6b4bf8b4:::benchmark_data_smithi029_44842_object111068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:23.625 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:23.571112+0000", 2024-04-26T11:14:23.625 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0022551749999999999, 2024-04-26T11:14:23.625 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0028253010000000001, 2024-04-26T11:14:23.625 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:23.625 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:23.625 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:23.625 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:23.625 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:23.625 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 111069 2024-04-26T11:14:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571112+0000", 2024-04-26T11:14:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571112+0000", 2024-04-26T11:14:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571111+0000", 2024-04-26T11:14:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571143+0000", 2024-04-26T11:14:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2225999999999999e-05 2024-04-26T11:14:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571152+0000", 2024-04-26T11:14:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.14e-06 2024-04-26T11:14:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571157+0000", 2024-04-26T11:14:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5210000000000002e-06 2024-04-26T11:14:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571578+0000", 2024-04-26T11:14:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00042076199999999998 2024-04-26T11:14:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571691+0000", 2024-04-26T11:14:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000113449 2024-04-26T11:14:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:111067 5.a e37/31)", 2024-04-26T11:14:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:23.571587+0000", 2024-04-26T11:14:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.001779618, 2024-04-26T11:14:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0023873599999999998, 2024-04-26T11:14:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571587+0000", 2024-04-26T11:14:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571587+0000", 2024-04-26T11:14:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571587+0000", 2024-04-26T11:14:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571671+0000", 2024-04-26T11:14:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4660000000000006e-05 2024-04-26T11:14:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571681+0000", 2024-04-26T11:14:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.5780000000000005e-06 2024-04-26T11:14:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571687+0000", 2024-04-26T11:14:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4250000000000003e-06 2024-04-26T11:14:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.573964+0000", 2024-04-26T11:14:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022765189999999999 2024-04-26T11:14:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.573976+0000", 2024-04-26T11:14:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2157000000000001e-05 2024-04-26T11:14:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:111070 5.0 e37/16 5:0d1e4e69:::benchmark_data_smithi029_44842_object111069:head v 37'6995, mlcod=37'6993)", 2024-04-26T11:14:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:23.571694+0000", 2024-04-26T11:14:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0016730429999999999, 2024-04-26T11:14:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002378706, 2024-04-26T11:14:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571694+0000", 2024-04-26T11:14:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571694+0000", 2024-04-26T11:14:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571694+0000", 2024-04-26T11:14:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571758+0000", 2024-04-26T11:14:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4190999999999996e-05 2024-04-26T11:14:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571765+0000", 2024-04-26T11:14:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7449999999999995e-06 2024-04-26T11:14:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571771+0000", 2024-04-26T11:14:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3739999999999997e-06 2024-04-26T11:14:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571816+0000", 2024-04-26T11:14:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5676000000000001e-05 2024-04-26T11:14:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:23.571829+0000", 2024-04-26T11:14:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2826000000000001e-05 2024-04-26T11:14:23.636 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.636 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:23.636 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.636 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:23.636 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:14:23.636 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 16 2024-04-26T11:14:23.636 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:23.636 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:14:23.638 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:23.639 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:23.635+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:23.738 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:23.737+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:23.838 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:23.836+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:23.869 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:23.869 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:14:23.869 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:14:23.869 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:14:23.869 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:23.877 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:23.939 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:23.939+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:24.040 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:24.038+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:24.102 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:24.102 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:14:24.102 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:14:24.102 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 30.827242402, 2024-04-26T11:14:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:14:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:14:24.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.104 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:24.104 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.104 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:24.104 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:24.104 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.105 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.105 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:24.105 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:24.105 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.105 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.105 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:24.105 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:14:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:14:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:14:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:14:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:14:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.107 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.107 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:14:24.107 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:14:24.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.107 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.107 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:14:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:14:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:14:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:14:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:14:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:14:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:14:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:14:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:14:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:14:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:14:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:14:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:14:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:14:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 30.826430837, 2024-04-26T11:14:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:14:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:14:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:14:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:14:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:14:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:14:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:14:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:14:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:14:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:14:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:14:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:14:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:14:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:14:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:14:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:14:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:14:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:14:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:14:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:14:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:14:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:14:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 30.819244000000001, 2024-04-26T11:14:24.117 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:14:24.117 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:24.117 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:24.117 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:24.117 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:24.117 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.117 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:14:24.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:14:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:14:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:14:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:14:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:14:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:14:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:14:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:14:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:14:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:14:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:14:24.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:14:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:14:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:14:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:14:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:14:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:14:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:14:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:14:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:14:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:14:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 30.818703120999999, 2024-04-26T11:14:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:14:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:14:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:14:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:14:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:14:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:14:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:14:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:14:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:14:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:14:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:14:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:14:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:14:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:14:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:14:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:14:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:14:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:14:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:14:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:14:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:14:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:14:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:55119 5.6 5:6ad50111:::benchmark_data_smithi029_44842_object55118:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 27.337639466999999, 2024-04-26T11:14:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018830264999999999, 2024-04-26T11:14:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 55119 2024-04-26T11:14:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760350+0000", 2024-04-26T11:14:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760349+0000", 2024-04-26T11:14:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760402+0000", 2024-04-26T11:14:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2695999999999998e-05 2024-04-26T11:14:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760411+0000", 2024-04-26T11:14:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.0589999999999992e-06 2024-04-26T11:14:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.760416+0000", 2024-04-26T11:14:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.587e-06 2024-04-26T11:14:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767638+0000", 2024-04-26T11:14:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0072214050000000002 2024-04-26T11:14:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767760+0000", 2024-04-26T11:14:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000122067 2024-04-26T11:14:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.767927+0000", 2024-04-26T11:14:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00016747999999999999 2024-04-26T11:14:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.770877+0000", 2024-04-26T11:14:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002949335 2024-04-26T11:14:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779130+0000", 2024-04-26T11:14:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.008253491 2024-04-26T11:14:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779158+0000", 2024-04-26T11:14:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7849000000000001e-05 2024-04-26T11:14:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:56.779180+0000", 2024-04-26T11:14:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2048999999999998e-05 2024-04-26T11:14:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 26.775518674000001, 2024-04-26T11:14:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:14:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:14:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:14:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:14:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:14:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:14:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:14:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:14:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:14:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:14:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:14:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:14:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:14:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:14:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:14:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:14:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:14:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:14:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:14:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:14:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:14:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:14:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:14:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:14:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:14:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 26.773325333999999, 2024-04-26T11:14:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:14:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:14:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:14:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:14:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:14:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:14:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:14:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:14:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:14:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:14:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:14:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:14:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:14:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:14:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:14:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:14:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:14:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:14:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:14:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.146 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:24.146 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:14:24.146 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:14:24.146 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.146 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.146 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.146 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:14:24.146 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:14:24.146 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.146 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.146 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:24.146 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:14:24.146 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:14:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 26.768113509999999, 2024-04-26T11:14:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:14:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:14:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:14:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:14:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:14:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:14:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:14:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:14:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:14:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:14:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:14:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:14:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:14:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:14:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:14:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:14:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:14:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:14:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:14:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:14:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:14:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:14:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:14:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:14:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:14:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 26.751664810000001, 2024-04-26T11:14:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:14:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:14:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:14:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:14:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:14:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:14:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:14:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:14:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:14:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:14:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:14:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:14:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:14:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:14:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:14:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:14:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:14:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 26.749967304999998, 2024-04-26T11:14:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:14:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:14:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:14:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:14:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:14:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:14:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:14:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:14:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:14:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:14:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:14:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:14:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:14:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:14:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:14:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:14:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:14:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 26.749903003, 2024-04-26T11:14:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:14:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:14:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:14:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:14:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:14:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:14:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:14:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:14:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:14:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:14:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:14:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:14:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:14:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:14:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:14:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:14:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:14:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:14:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:14:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:14:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:14:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:14:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 26.749848779000001, 2024-04-26T11:14:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:14:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:14:24.168 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:14:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:14:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:14:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:14:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:14:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:14:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:14:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:14:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:14:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:14:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:14:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:14:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:14:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:14:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:14:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:14:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:14:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:14:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:14:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 26.749804267000002, 2024-04-26T11:14:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:14:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:14:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:14:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:14:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:14:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:14:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:14:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:14:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:14:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:14:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:14:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:14:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:14:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:14:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:14:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:14:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:14:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:14:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:14:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:14:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:14:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:14:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:14:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 26.745583265, 2024-04-26T11:14:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:14:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:14:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:14:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:14:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:14:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:14:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:14:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:14:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:14:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:14:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:14:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:14:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:14:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:14:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:14:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:14:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:14:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:14:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:14:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:14:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:14:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:14:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:14:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:14:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:61817 5.a 5:5627ce7f:::benchmark_data_smithi029_44842_object61816:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 23.395457812, 2024-04-26T11:14:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020626958000000001, 2024-04-26T11:14:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 61817 2024-04-26T11:14:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702591+0000", 2024-04-26T11:14:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0665999999999998e-05 2024-04-26T11:14:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702599+0000", 2024-04-26T11:14:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7130000000000005e-06 2024-04-26T11:14:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702605+0000", 2024-04-26T11:14:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4310000000000002e-06 2024-04-26T11:14:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.707947+0000", 2024-04-26T11:14:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053424220000000003 2024-04-26T11:14:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.708052+0000", 2024-04-26T11:14:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010499 2024-04-26T11:14:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:14:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.708141+0000", 2024-04-26T11:14:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9514999999999999e-05 2024-04-26T11:14:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.711954+0000", 2024-04-26T11:14:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003812265 2024-04-26T11:14:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723070+0000", 2024-04-26T11:14:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011116727 2024-04-26T11:14:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723121+0000", 2024-04-26T11:14:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0362999999999999e-05 2024-04-26T11:14:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723158+0000", 2024-04-26T11:14:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7579000000000001e-05 2024-04-26T11:14:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:75771 5.c 5:3cc8f1b4:::benchmark_data_smithi029_44842_object75770:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T11:14:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 17.345013469000001, 2024-04-26T11:14:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019437949, 2024-04-26T11:14:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 75771 2024-04-26T11:14:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:24.192 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752975+0000", 2024-04-26T11:14:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753061+0000", 2024-04-26T11:14:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5890999999999995e-05 2024-04-26T11:14:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753071+0000", 2024-04-26T11:14:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.9990000000000003e-06 2024-04-26T11:14:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.193 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753078+0000", 2024-04-26T11:14:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1559999999999998e-06 2024-04-26T11:14:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.758559+0000", 2024-04-26T11:14:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0054812819999999996 2024-04-26T11:14:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.758692+0000", 2024-04-26T11:14:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000133301 2024-04-26T11:14:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:24.194 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772277+0000", 2024-04-26T11:14:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.013584839 2024-04-26T11:14:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772340+0000", 2024-04-26T11:14:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2360999999999995e-05 2024-04-26T11:14:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772414+0000", 2024-04-26T11:14:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4024999999999997e-05 2024-04-26T11:14:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83359 5.2 5:4939888c:::benchmark_data_smithi029_44842_object83358:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 13.058422884000001, 2024-04-26T11:14:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018705583000000001, 2024-04-26T11:14:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83359 2024-04-26T11:14:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.196 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039566+0000", 2024-04-26T11:14:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.197 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:24.198 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039625+0000", 2024-04-26T11:14:24.198 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9162e-05 2024-04-26T11:14:24.198 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.198 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.198 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:24.198 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039632+0000", 2024-04-26T11:14:24.198 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5399999999999998e-06 2024-04-26T11:14:24.198 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.198 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.198 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.198 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039638+0000", 2024-04-26T11:14:24.198 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1850000000000003e-06 2024-04-26T11:14:24.198 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.198 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.042375+0000", 2024-04-26T11:14:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0027371510000000002 2024-04-26T11:14:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.042502+0000", 2024-04-26T11:14:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000126966 2024-04-26T11:14:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058154+0000", 2024-04-26T11:14:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015652657 2024-04-26T11:14:24.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058201+0000", 2024-04-26T11:14:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6579000000000002e-05 2024-04-26T11:14:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058272+0000", 2024-04-26T11:14:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1009999999999999e-05 2024-04-26T11:14:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.200 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83360 5.2 5:42f8bfcd:::benchmark_data_smithi029_44842_object83359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:24.201 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:24.201 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 13.058343895, 2024-04-26T11:14:24.201 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022279782000000001, 2024-04-26T11:14:24.201 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:24.201 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:24.201 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:24.201 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:24.201 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.201 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83360 2024-04-26T11:14:24.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.201 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:24.201 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.201 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:24.202 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039700+0000", 2024-04-26T11:14:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5541000000000002e-05 2024-04-26T11:14:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039706+0000", 2024-04-26T11:14:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3680000000000001e-06 2024-04-26T11:14:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039709+0000", 2024-04-26T11:14:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4659999999999999e-06 2024-04-26T11:14:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056305+0000", 2024-04-26T11:14:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016595649000000001 2024-04-26T11:14:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056487+0000", 2024-04-26T11:14:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000181886 2024-04-26T11:14:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061809+0000", 2024-04-26T11:14:24.204 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053223259999999996 2024-04-26T11:14:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061852+0000", 2024-04-26T11:14:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2738999999999999e-05 2024-04-26T11:14:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061925+0000", 2024-04-26T11:14:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3180000000000001e-05 2024-04-26T11:14:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.205 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83364 5.2 5:42c5cd8c:::benchmark_data_smithi029_44842_object83363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 13.057928155000001, 2024-04-26T11:14:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022695336, 2024-04-26T11:14:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83364 2024-04-26T11:14:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:24.206 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040060+0000", 2024-04-26T11:14:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040086+0000", 2024-04-26T11:14:24.207 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5482000000000001e-05 2024-04-26T11:14:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040093+0000", 2024-04-26T11:14:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6409999999999996e-06 2024-04-26T11:14:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040098+0000", 2024-04-26T11:14:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879999999999996e-06 2024-04-26T11:14:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058292+0000", 2024-04-26T11:14:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018193504999999999 2024-04-26T11:14:24.208 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058412+0000", 2024-04-26T11:14:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011979199999999999 2024-04-26T11:14:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062642+0000", 2024-04-26T11:14:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042299449999999997 2024-04-26T11:14:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062688+0000", 2024-04-26T11:14:24.209 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6859e-05 2024-04-26T11:14:24.210 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.210 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.210 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:24.210 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062756+0000", 2024-04-26T11:14:24.210 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7995000000000002e-05 2024-04-26T11:14:24.210 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.210 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:24.210 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.210 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.210 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.210 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83378 5.2 5:44b3209a:::benchmark_data_smithi029_44842_object83377:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:24.210 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 13.050207702, 2024-04-26T11:14:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020722529, 2024-04-26T11:14:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83378 2024-04-26T11:14:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.211 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047781+0000", 2024-04-26T11:14:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047832+0000", 2024-04-26T11:14:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1687000000000002e-05 2024-04-26T11:14:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.212 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047842+0000", 2024-04-26T11:14:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2439999999999999e-06 2024-04-26T11:14:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047847+0000", 2024-04-26T11:14:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6500000000000001e-06 2024-04-26T11:14:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.060082+0000", 2024-04-26T11:14:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.012235105 2024-04-26T11:14:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.213 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.060191+0000", 2024-04-26T11:14:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000108665 2024-04-26T11:14:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068363+0000", 2024-04-26T11:14:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0081715829999999996 2024-04-26T11:14:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068418+0000", 2024-04-26T11:14:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4984000000000001e-05 2024-04-26T11:14:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:24.214 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:24.215 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:24.215 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068504+0000", 2024-04-26T11:14:24.215 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6520000000000005e-05 2024-04-26T11:14:24.215 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.215 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:24.215 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.215 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:24.215 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:24.215 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:24.217 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:24.217 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:24.214+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:24.317 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:24.316+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:24.388 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:112931 5.d 5:ba580843:::benchmark_data_smithi029_44842_object112930:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:24.381215+0000", 2024-04-26T11:14:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0060853249999999999, 2024-04-26T11:14:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0061057899999999998, 2024-04-26T11:14:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 112931 2024-04-26T11:14:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.381215+0000", 2024-04-26T11:14:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.381215+0000", 2024-04-26T11:14:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.381214+0000", 2024-04-26T11:14:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.381266+0000", 2024-04-26T11:14:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2726000000000003e-05 2024-04-26T11:14:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.381281+0000", 2024-04-26T11:14:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5012e-05 2024-04-26T11:14:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.381287+0000", 2024-04-26T11:14:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9719999999999997e-06 2024-04-26T11:14:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.384111+0000", 2024-04-26T11:14:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002823421 2024-04-26T11:14:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.384232+0000", 2024-04-26T11:14:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012136100000000001 2024-04-26T11:14:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:112932 5.0 5:09257137:::benchmark_data_smithi029_44842_object112931:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:24.381293+0000", 2024-04-26T11:14:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.006006806, 2024-04-26T11:14:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060756680000000002, 2024-04-26T11:14:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 112932 2024-04-26T11:14:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.381293+0000", 2024-04-26T11:14:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.381293+0000", 2024-04-26T11:14:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.381293+0000", 2024-04-26T11:14:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.381337+0000", 2024-04-26T11:14:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3937000000000003e-05 2024-04-26T11:14:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.381342+0000", 2024-04-26T11:14:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5130000000000004e-06 2024-04-26T11:14:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.381346+0000", 2024-04-26T11:14:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4240000000000002e-06 2024-04-26T11:14:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.381380+0000", 2024-04-26T11:14:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4459999999999999e-05 2024-04-26T11:14:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.381509+0000", 2024-04-26T11:14:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012887700000000001 2024-04-26T11:14:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.381606+0000", 2024-04-26T11:14:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6679000000000001e-05 2024-04-26T11:14:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.383106+0000", 2024-04-26T11:14:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0014999530000000001 2024-04-26T11:14:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:112936 5.e 5:7c8c5724:::benchmark_data_smithi029_44842_object112935:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:24.381415+0000", 2024-04-26T11:14:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0058848279999999999, 2024-04-26T11:14:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060019289999999996, 2024-04-26T11:14:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 112936 2024-04-26T11:14:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.381415+0000", 2024-04-26T11:14:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.381415+0000", 2024-04-26T11:14:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.381415+0000", 2024-04-26T11:14:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.381539+0000", 2024-04-26T11:14:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012459600000000001 2024-04-26T11:14:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:24.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.381547+0000", 2024-04-26T11:14:24.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4000000000000003e-06 2024-04-26T11:14:24.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.381553+0000", 2024-04-26T11:14:24.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:14:24.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:24.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.381599+0000", 2024-04-26T11:14:24.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5654e-05 2024-04-26T11:14:24.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:24.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.381726+0000", 2024-04-26T11:14:24.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000127386 2024-04-26T11:14:24.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:24.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.381866+0000", 2024-04-26T11:14:24.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000139443 2024-04-26T11:14:24.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:24.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.385732+0000", 2024-04-26T11:14:24.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038663479999999999 2024-04-26T11:14:24.401 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:24.401 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:24.402 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:24.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.402 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:112941 5.e 5:74e716dc:::benchmark_data_smithi029_44842_object112940:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:24.402 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:24.383610+0000", 2024-04-26T11:14:24.402 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0036894530000000001, 2024-04-26T11:14:24.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038553849999999998, 2024-04-26T11:14:24.402 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:24.402 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:24.402 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:24.402 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:24.402 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.402 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 112941 2024-04-26T11:14:24.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.403 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:24.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:24.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.383610+0000", 2024-04-26T11:14:24.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:24.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:24.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.383610+0000", 2024-04-26T11:14:24.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:24.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:24.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.383609+0000", 2024-04-26T11:14:24.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:24.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:24.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.383713+0000", 2024-04-26T11:14:24.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103767 2024-04-26T11:14:24.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:24.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.383722+0000", 2024-04-26T11:14:24.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9919999999999996e-06 2024-04-26T11:14:24.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.383729+0000", 2024-04-26T11:14:24.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6969999999999996e-06 2024-04-26T11:14:24.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:24.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.384111+0000", 2024-04-26T11:14:24.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00038184999999999998 2024-04-26T11:14:24.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:24.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.384232+0000", 2024-04-26T11:14:24.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120918 2024-04-26T11:14:24.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.406 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:24.406 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.384375+0000", 2024-04-26T11:14:24.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000142905 2024-04-26T11:14:24.406 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:24.406 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:24.406 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:24.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.406 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:112942 5.8 5:1d42813a:::benchmark_data_smithi029_44842_object112941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:24.411 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:24.383776+0000", 2024-04-26T11:14:24.412 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0035241999999999999, 2024-04-26T11:14:24.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0037325729999999999, 2024-04-26T11:14:24.412 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:24.412 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:24.412 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:24.412 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:24.412 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.412 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 112942 2024-04-26T11:14:24.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.412 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:24.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.412 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:24.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.383776+0000", 2024-04-26T11:14:24.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:24.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:24.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.383776+0000", 2024-04-26T11:14:24.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:24.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:24.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.383775+0000", 2024-04-26T11:14:24.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:24.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:24.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.383840+0000", 2024-04-26T11:14:24.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5115000000000003e-05 2024-04-26T11:14:24.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:24.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.383846+0000", 2024-04-26T11:14:24.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1380000000000004e-06 2024-04-26T11:14:24.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.383850+0000", 2024-04-26T11:14:24.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6959999999999998e-06 2024-04-26T11:14:24.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:24.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.383870+0000", 2024-04-26T11:14:24.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9828999999999999e-05 2024-04-26T11:14:24.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:24.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.383966+0000", 2024-04-26T11:14:24.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6348000000000007e-05 2024-04-26T11:14:24.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:24.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.384097+0000", 2024-04-26T11:14:24.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000131104 2024-04-26T11:14:24.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:24.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.387195+0000", 2024-04-26T11:14:24.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030971639999999999 2024-04-26T11:14:24.416 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:24.416 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:24.416 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:24.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.416 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:112944 5.f 5:f2e38e8f:::benchmark_data_smithi029_44842_object112943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:24.416 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:24.385126+0000", 2024-04-26T11:14:24.416 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.002174339, 2024-04-26T11:14:24.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024290919999999999, 2024-04-26T11:14:24.416 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:24.416 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:24.416 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:24.417 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:24.417 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.417 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 112944 2024-04-26T11:14:24.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.417 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:24.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:24.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.385126+0000", 2024-04-26T11:14:24.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:24.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:24.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.385126+0000", 2024-04-26T11:14:24.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:24.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:24.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.385125+0000", 2024-04-26T11:14:24.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:24.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:24.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.385265+0000", 2024-04-26T11:14:24.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014019400000000001 2024-04-26T11:14:24.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:24.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.385275+0000", 2024-04-26T11:14:24.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0156000000000001e-05 2024-04-26T11:14:24.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.385286+0000", 2024-04-26T11:14:24.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1338999999999999e-05 2024-04-26T11:14:24.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:24.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.385331+0000", 2024-04-26T11:14:24.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4521000000000003e-05 2024-04-26T11:14:24.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:24.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.385460+0000", 2024-04-26T11:14:24.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000129264 2024-04-26T11:14:24.420 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:24.420 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:24.420 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:24.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.420 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:112950 5.a 5:59d79c83:::benchmark_data_smithi029_44842_object112949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:24.420 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:24.386236+0000", 2024-04-26T11:14:24.420 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.001063624, 2024-04-26T11:14:24.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0014056369999999999, 2024-04-26T11:14:24.420 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:24.420 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:24.420 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:24.421 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:24.421 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:24.421 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 112950 2024-04-26T11:14:24.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.421 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:24.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:24.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.386236+0000", 2024-04-26T11:14:24.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:24.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:24.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.386236+0000", 2024-04-26T11:14:24.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:24.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:24.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.386236+0000", 2024-04-26T11:14:24.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:24.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:24.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.386301+0000", 2024-04-26T11:14:24.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5773999999999997e-05 2024-04-26T11:14:24.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:24.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.386311+0000", 2024-04-26T11:14:24.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6989999999999998e-06 2024-04-26T11:14:24.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:24.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.386316+0000", 2024-04-26T11:14:24.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.622e-06 2024-04-26T11:14:24.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:24.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.386346+0000", 2024-04-26T11:14:24.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0173000000000001e-05 2024-04-26T11:14:24.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:24.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.386431+0000", 2024-04-26T11:14:24.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5523000000000001e-05 2024-04-26T11:14:24.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:24.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:24.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:24.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:24.386512+0000", 2024-04-26T11:14:24.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0337e-05 2024-04-26T11:14:24.424 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:24.424 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:24.424 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:24.424 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:24.424 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:14:24.424 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 7 2024-04-26T11:14:24.424 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:24.425 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 46 16 113012 112996 153.513 142.312 0.00891794 0.00651147 2024-04-26T11:14:24.426 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:24.427 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:24.424+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:24.507 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:14:24.526 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:24.525+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:24.624 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:14:24.629 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:24.626+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:24.641 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:24.641 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:14:24.641 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:14:24.641 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:14:24.641 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:24.655 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:24.668 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:24.690 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:24.690 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:24.690 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:24.690 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:24.692 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:24.692 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:24.728 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:24.726+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:24.829 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:24.827+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:24.868 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:24.868 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:24.882 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:24.930 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:24.929+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:25.033 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:25.029+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:25.063 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:25.063 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:25.080 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:25.164 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:25.162+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:25.234 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:25.232+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:25.310 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:25.311 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:25.327 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:25.368 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:25.366+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:25.414 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 47 16 115255 115239 153.229 140.188 0.00550307 0.00652379 2024-04-26T11:14:25.438 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:25.438+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:25.539 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:25.538+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:25.557 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:25.557 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:25.573 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:25.642 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:25.641+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:25.743 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:25.741+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:25.750 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:25.751 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:25.767 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:25.843 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:25.841+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:25.944 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:25.942+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:25.959 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:14:25.973 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:25.973 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:25.989 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:26.046 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:26.045+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:26.068 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2024-04-26T11:14:26.147 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:26.145+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:26.160 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:26.160 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:26.170 INFO:teuthology.orchestra.console.smithi072:Power on completed 2024-04-26T11:14:26.175 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:26.248 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:26.247+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:26.271 DEBUG:teuthology.orchestra.console.smithi072:Waiting for login prompt 2024-04-26T11:14:26.271 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi072 2024-04-26T11:14:26.350 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:26.348+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:26.352 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:26.352 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:26.368 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:26.414 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 48 16 117526 117510 152.994 141.938 0.00751159 0.00653352 2024-04-26T11:14:26.452 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:26.450+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:26.554 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:26.552+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:26.591 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:26.591 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:26.603 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:26.638 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:14:26.687 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:26.685+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:26.693 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:14:26.754 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:26.752+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:26.829 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:26.829 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:26.845 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:26.877 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:26.888 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:26.887+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:26.898 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:26.898 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:26.898 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:26.898 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:26.902 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:26.902 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:26.955 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:26.953+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:27.022 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:27.022 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:27.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.023 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:118841 5.0 5:0d02c248:::benchmark_data_smithi029_44842_object118840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T11:14:27.023 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:27.012920+0000", 2024-04-26T11:14:27.023 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0075048900000000002, 2024-04-26T11:14:27.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0075435909999999997, 2024-04-26T11:14:27.023 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.023 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:27.023 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.023 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.023 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.023 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 118841 2024-04-26T11:14:27.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.023 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.012920+0000", 2024-04-26T11:14:27.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.012920+0000", 2024-04-26T11:14:27.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.012919+0000", 2024-04-26T11:14:27.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:27.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.013003+0000", 2024-04-26T11:14:27.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4091999999999994e-05 2024-04-26T11:14:27.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.013014+0000", 2024-04-26T11:14:27.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1014e-05 2024-04-26T11:14:27.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.013024+0000", 2024-04-26T11:14:27.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8099999999999992e-06 2024-04-26T11:14:27.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.015825+0000", 2024-04-26T11:14:27.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0028010869999999998 2024-04-26T11:14:27.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.015912+0000", 2024-04-26T11:14:27.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6688999999999996e-05 2024-04-26T11:14:27.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:27.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.016004+0000", 2024-04-26T11:14:27.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1712000000000006e-05 2024-04-26T11:14:27.027 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.027 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.027 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.027 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:118846 5.0 5:04082a1a:::benchmark_data_smithi029_44842_object118845:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T11:14:27.027 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:27.015110+0000", 2024-04-26T11:14:27.027 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0053147669999999998, 2024-04-26T11:14:27.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054436859999999997, 2024-04-26T11:14:27.028 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.028 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:27.028 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.028 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.028 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.028 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 118846 2024-04-26T11:14:27.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.028 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.015110+0000", 2024-04-26T11:14:27.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.015110+0000", 2024-04-26T11:14:27.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.015109+0000", 2024-04-26T11:14:27.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:27.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.015175+0000", 2024-04-26T11:14:27.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5884999999999997e-05 2024-04-26T11:14:27.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.015187+0000", 2024-04-26T11:14:27.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1408e-05 2024-04-26T11:14:27.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.015193+0000", 2024-04-26T11:14:27.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:14:27.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.017208+0000", 2024-04-26T11:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00201512 2024-04-26T11:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.017351+0000", 2024-04-26T11:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014372699999999999 2024-04-26T11:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.017474+0000", 2024-04-26T11:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012249299999999999 2024-04-26T11:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.031 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:118849 5.4 5:2074f905:::benchmark_data_smithi029_44842_object118848:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T11:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:27.017715+0000", 2024-04-26T11:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.002710428, 2024-04-26T11:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0029205920000000001, 2024-04-26T11:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 118849 2024-04-26T11:14:27.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.017715+0000", 2024-04-26T11:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.017715+0000", 2024-04-26T11:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.017714+0000", 2024-04-26T11:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.017817+0000", 2024-04-26T11:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010365 2024-04-26T11:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.017829+0000", 2024-04-26T11:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1936999999999999e-05 2024-04-26T11:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.017838+0000", 2024-04-26T11:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5369999999999997e-06 2024-04-26T11:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.017874+0000", 2024-04-26T11:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6368999999999997e-05 2024-04-26T11:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.017995+0000", 2024-04-26T11:14:27.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120569 2024-04-26T11:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018133+0000", 2024-04-26T11:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013796500000000001 2024-04-26T11:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:118850 5.a 5:57ccf15f:::benchmark_data_smithi029_44842_object118849:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T11:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:27.017847+0000", 2024-04-26T11:14:27.036 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0025780070000000002, 2024-04-26T11:14:27.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0028652399999999998, 2024-04-26T11:14:27.037 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.037 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:27.037 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.037 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.037 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.037 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 118850 2024-04-26T11:14:27.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.037 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.017847+0000", 2024-04-26T11:14:27.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.017847+0000", 2024-04-26T11:14:27.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.017846+0000", 2024-04-26T11:14:27.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.017879+0000", 2024-04-26T11:14:27.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2194999999999999e-05 2024-04-26T11:14:27.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.017886+0000", 2024-04-26T11:14:27.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.097e-06 2024-04-26T11:14:27.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.017891+0000", 2024-04-26T11:14:27.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4650000000000002e-06 2024-04-26T11:14:27.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.017923+0000", 2024-04-26T11:14:27.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1557999999999998e-05 2024-04-26T11:14:27.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018001+0000", 2024-04-26T11:14:27.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8669000000000002e-05 2024-04-26T11:14:27.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:27.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018084+0000", 2024-04-26T11:14:27.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2127999999999997e-05 2024-04-26T11:14:27.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:27.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.020594+0000", 2024-04-26T11:14:27.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025105779999999999 2024-04-26T11:14:27.041 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.041 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.041 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.041 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:118851 5.b 5:dd7c632a:::benchmark_data_smithi029_44842_object118850:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T11:14:27.041 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:27.018405+0000", 2024-04-26T11:14:27.041 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0020196519999999998, 2024-04-26T11:14:27.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023873570000000001, 2024-04-26T11:14:27.041 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.042 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:27.042 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.042 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.042 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.042 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 118851 2024-04-26T11:14:27.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.042 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018405+0000", 2024-04-26T11:14:27.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018405+0000", 2024-04-26T11:14:27.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018405+0000", 2024-04-26T11:14:27.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:27.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018454+0000", 2024-04-26T11:14:27.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9529e-05 2024-04-26T11:14:27.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018464+0000", 2024-04-26T11:14:27.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5920000000000007e-06 2024-04-26T11:14:27.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018471+0000", 2024-04-26T11:14:27.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8299999999999998e-06 2024-04-26T11:14:27.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018624+0000", 2024-04-26T11:14:27.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015320500000000001 2024-04-26T11:14:27.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018739+0000", 2024-04-26T11:14:27.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000115555 2024-04-26T11:14:27.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:27.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018868+0000", 2024-04-26T11:14:27.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012900800000000001 2024-04-26T11:14:27.045 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.045 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.045 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.045 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:118852 5.0 5:0964b032:::benchmark_data_smithi029_44842_object118851:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T11:14:27.046 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:27.018595+0000", 2024-04-26T11:14:27.046 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0018300320000000001, 2024-04-26T11:14:27.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002273302, 2024-04-26T11:14:27.046 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.046 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:27.046 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.046 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.046 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.046 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 118852 2024-04-26T11:14:27.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.046 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018595+0000", 2024-04-26T11:14:27.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018595+0000", 2024-04-26T11:14:27.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018594+0000", 2024-04-26T11:14:27.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018667+0000", 2024-04-26T11:14:27.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2729000000000001e-05 2024-04-26T11:14:27.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018677+0000", 2024-04-26T11:14:27.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6309999999999998e-06 2024-04-26T11:14:27.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018683+0000", 2024-04-26T11:14:27.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2530000000000001e-06 2024-04-26T11:14:27.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.019846+0000", 2024-04-26T11:14:27.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001163056 2024-04-26T11:14:27.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.019983+0000", 2024-04-26T11:14:27.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000137224 2024-04-26T11:14:27.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:27.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.020124+0000", 2024-04-26T11:14:27.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014070700000000001 2024-04-26T11:14:27.049 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.050 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.050 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.050 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:118853 5.8 5:1fd3dd81:::benchmark_data_smithi029_44842_object118852:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T11:14:27.050 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:27.018713+0000", 2024-04-26T11:14:27.050 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.001712475, 2024-04-26T11:14:27.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002239427, 2024-04-26T11:14:27.050 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.050 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:27.050 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.050 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.050 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.051 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 118853 2024-04-26T11:14:27.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.051 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018713+0000", 2024-04-26T11:14:27.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018713+0000", 2024-04-26T11:14:27.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018712+0000", 2024-04-26T11:14:27.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018835+0000", 2024-04-26T11:14:27.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123416 2024-04-26T11:14:27.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018848+0000", 2024-04-26T11:14:27.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2429000000000001e-05 2024-04-26T11:14:27.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018855+0000", 2024-04-26T11:14:27.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9349999999999997e-06 2024-04-26T11:14:27.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018891+0000", 2024-04-26T11:14:27.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5908999999999998e-05 2024-04-26T11:14:27.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.019014+0000", 2024-04-26T11:14:27.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012296799999999999 2024-04-26T11:14:27.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:27.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.019171+0000", 2024-04-26T11:14:27.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015746400000000001 2024-04-26T11:14:27.054 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.054 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.054 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.054 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:118856 5.4 5:21d620d7:::benchmark_data_smithi029_44842_object118855:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T11:14:27.054 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:27.018862+0000", 2024-04-26T11:14:27.054 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0015630380000000001, 2024-04-26T11:14:27.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021727970000000002, 2024-04-26T11:14:27.055 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.055 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:27.055 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.055 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.055 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.055 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 118856 2024-04-26T11:14:27.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.055 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018862+0000", 2024-04-26T11:14:27.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018862+0000", 2024-04-26T11:14:27.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018861+0000", 2024-04-26T11:14:27.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018911+0000", 2024-04-26T11:14:27.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9608999999999999e-05 2024-04-26T11:14:27.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018919+0000", 2024-04-26T11:14:27.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8879999999999997e-06 2024-04-26T11:14:27.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018925+0000", 2024-04-26T11:14:27.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4010000000000002e-06 2024-04-26T11:14:27.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.019937+0000", 2024-04-26T11:14:27.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010119650000000001 2024-04-26T11:14:27.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.020052+0000", 2024-04-26T11:14:27.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000114757 2024-04-26T11:14:27.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:27.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.020182+0000", 2024-04-26T11:14:27.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012974899999999999 2024-04-26T11:14:27.058 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.058 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.058 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.058 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:118838 5.0 5:0c9c763d:::benchmark_data_smithi029_44842_object118837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T11:14:27.059 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:27.011144+0000", 2024-04-26T11:14:27.059 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0092805230000000006, 2024-04-26T11:14:27.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0099736019999999998, 2024-04-26T11:14:27.059 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.059 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:27.059 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.059 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.059 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.059 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 118838 2024-04-26T11:14:27.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.059 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.011144+0000", 2024-04-26T11:14:27.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.011144+0000", 2024-04-26T11:14:27.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.011144+0000", 2024-04-26T11:14:27.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:27.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.011252+0000", 2024-04-26T11:14:27.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108436 2024-04-26T11:14:27.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.011260+0000", 2024-04-26T11:14:27.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7519999999999996e-06 2024-04-26T11:14:27.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.011266+0000", 2024-04-26T11:14:27.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7429999999999999e-06 2024-04-26T11:14:27.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.013385+0000", 2024-04-26T11:14:27.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021196499999999998 2024-04-26T11:14:27.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.013472+0000", 2024-04-26T11:14:27.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.666e-05 2024-04-26T11:14:27.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:27.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.013555+0000", 2024-04-26T11:14:27.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2719999999999994e-05 2024-04-26T11:14:27.063 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.063 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.063 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.063 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:118840 5.8 5:16b72daf:::benchmark_data_smithi029_44842_object118839:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T11:14:27.063 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:27.011355+0000", 2024-04-26T11:14:27.063 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0090702890000000005, 2024-04-26T11:14:27.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0098314990000000005, 2024-04-26T11:14:27.063 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.063 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:27.063 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.064 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.064 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.064 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 118840 2024-04-26T11:14:27.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.064 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.011355+0000", 2024-04-26T11:14:27.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.064 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.064 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.011355+0000", 2024-04-26T11:14:27.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.011354+0000", 2024-04-26T11:14:27.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.011430+0000", 2024-04-26T11:14:27.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6052999999999998e-05 2024-04-26T11:14:27.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.011439+0000", 2024-04-26T11:14:27.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8980000000000002e-06 2024-04-26T11:14:27.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.011444+0000", 2024-04-26T11:14:27.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.361e-06 2024-04-26T11:14:27.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.013410+0000", 2024-04-26T11:14:27.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0019657670000000002 2024-04-26T11:14:27.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.013542+0000", 2024-04-26T11:14:27.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013184899999999999 2024-04-26T11:14:27.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:27.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.013731+0000", 2024-04-26T11:14:27.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000189335 2024-04-26T11:14:27.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:27.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:27.018705+0000", 2024-04-26T11:14:27.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049736260000000001 2024-04-26T11:14:27.068 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.068 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.068 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.068 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.068 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:14:27.068 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 10 2024-04-26T11:14:27.068 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:27.070 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:27.070 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:27.067+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:27.171 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:27.169+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:27.272 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:27.270+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:27.277 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:27.277 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:14:27.277 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:14:27.277 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:14:27.278 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:27.293 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:27.378 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:27.376+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:27.414 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 49 16 119761 119745 152.722 139.688 0.0051811 0.00654489 2024-04-26T11:14:27.475 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:27.473+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:27.515 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:27.515 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:14:27.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:14:27.516 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:27.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.516 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:27.516 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:27.516 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.232393842999997, 2024-04-26T11:14:27.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:14:27.516 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.517 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:27.517 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.517 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.517 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.517 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:14:27.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.517 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:27.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:14:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:14:27.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:14:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:14:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:14:27.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:14:27.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:14:27.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:14:27.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:14:27.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:14:27.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:27.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:14:27.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:14:27.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:27.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:14:27.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:14:27.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:27.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:14:27.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:14:27.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:27.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:14:27.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:14:27.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:27.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:14:27.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:14:27.527 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.527 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.527 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.527 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:27.527 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:27.527 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.231744141, 2024-04-26T11:14:27.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:14:27.528 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.528 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:27.528 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.528 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.528 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.528 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:14:27.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.528 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:27.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:27.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:14:27.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:27.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:14:27.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:14:27.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:14:27.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:14:27.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:14:27.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:14:27.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:14:27.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:14:27.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:14:27.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:14:27.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:27.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:14:27.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:14:27.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:27.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:14:27.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:14:27.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:27.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:14:27.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:14:27.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:27.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:14:27.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:14:27.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:27.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:14:27.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:14:27.533 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.533 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.533 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.533 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:27.533 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:27.533 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.165102101999999, 2024-04-26T11:14:27.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:14:27.533 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.533 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:27.533 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.533 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.534 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.534 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:14:27.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.534 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:27.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:27.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:14:27.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:27.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:14:27.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:14:27.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:14:27.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:14:27.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:14:27.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:14:27.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:14:27.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:14:27.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:27.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:14:27.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:14:27.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:14:27.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:14:27.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:27.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:14:27.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:14:27.537 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.537 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.537 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.538 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:27.538 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:27.538 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.165006456, 2024-04-26T11:14:27.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:14:27.538 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.538 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:27.538 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.538 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.538 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.538 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:14:27.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.538 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:27.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:27.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:14:27.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:14:27.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:14:27.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:14:27.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:14:27.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:14:27.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:14:27.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:14:27.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:14:27.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:27.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:14:27.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:14:27.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:14:27.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:14:27.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:27.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:14:27.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:14:27.542 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.542 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.542 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.542 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:27.542 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:27.542 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.164874777000001, 2024-04-26T11:14:27.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:14:27.542 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.542 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:27.542 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.543 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.543 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.543 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:14:27.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.543 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:27.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:27.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:27.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:14:27.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:14:27.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:14:27.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:14:27.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:14:27.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:14:27.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:14:27.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:14:27.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:27.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:14:27.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:14:27.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:14:27.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:14:27.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:27.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:14:27.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:14:27.546 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.546 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.546 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.547 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:27.547 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:27.547 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.164766320999998, 2024-04-26T11:14:27.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:14:27.547 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.547 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:27.547 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.547 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.547 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.548 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:14:27.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.548 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:27.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:27.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:14:27.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:27.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:14:27.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:14:27.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:14:27.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:14:27.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:14:27.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:14:27.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:14:27.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:14:27.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:27.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:14:27.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:14:27.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:14:27.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:14:27.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:27.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:14:27.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:14:27.551 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.552 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.552 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.552 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:27.552 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:27.552 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.164665053, 2024-04-26T11:14:27.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:14:27.552 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.552 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:27.552 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.552 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.552 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.552 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:14:27.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.553 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:27.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:27.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:27.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:14:27.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:14:27.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:14:27.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:14:27.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:14:27.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:14:27.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:14:27.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:14:27.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:27.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:14:27.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:14:27.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:14:27.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:14:27.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:14:27.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:14:27.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:27.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:14:27.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:14:27.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:27.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:14:27.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:14:27.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:27.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:14:27.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:14:27.557 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.557 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.557 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.557 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:27.557 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:27.558 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.164596112000002, 2024-04-26T11:14:27.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:14:27.558 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.558 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:27.558 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.558 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.558 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.558 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:14:27.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.558 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:27.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:27.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:14:27.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:14:27.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:14:27.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:14:27.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:14:27.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:14:27.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:14:27.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:14:27.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:14:27.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:27.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:14:27.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:14:27.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:14:27.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:14:27.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:14:27.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:14:27.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:27.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:14:27.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:14:27.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:27.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:14:27.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:14:27.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:27.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:14:27.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:14:27.563 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.563 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.563 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.563 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:27.563 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:27.563 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.158600531000001, 2024-04-26T11:14:27.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:14:27.563 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.563 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:27.563 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.563 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.563 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.564 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:14:27.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.564 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:27.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:27.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:14:27.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:14:27.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:14:27.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:14:27.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:14:27.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:14:27.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:14:27.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:14:27.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:14:27.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:27.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:14:27.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:14:27.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:14:27.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:14:27.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:14:27.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:14:27.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:27.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:14:27.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:14:27.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:27.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:14:27.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:14:27.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:27.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:14:27.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:14:27.568 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.568 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.568 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.569 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:81256 5.8 5:1c0f3fd8:::benchmark_data_smithi029_44842_object81255:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:27.569 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:27.569 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.395140982000001, 2024-04-26T11:14:27.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026193673000000001, 2024-04-26T11:14:27.569 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.569 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:27.569 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.569 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.569 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.569 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 81256 2024-04-26T11:14:27.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.569 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:27.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:27.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:27.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116073+0000", 2024-04-26T11:14:27.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0114e-05 2024-04-26T11:14:27.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116079+0000", 2024-04-26T11:14:27.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8939999999999998e-06 2024-04-26T11:14:27.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116082+0000", 2024-04-26T11:14:27.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:14:27.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127501+0000", 2024-04-26T11:14:27.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011418281000000001 2024-04-26T11:14:27.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127639+0000", 2024-04-26T11:14:27.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013828899999999999 2024-04-26T11:14:27.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:27.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127782+0000", 2024-04-26T11:14:27.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014328299999999999 2024-04-26T11:14:27.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:27.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.134767+0000", 2024-04-26T11:14:27.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0069844140000000004 2024-04-26T11:14:27.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:27.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142160+0000", 2024-04-26T11:14:27.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007392839 2024-04-26T11:14:27.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:27.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142202+0000", 2024-04-26T11:14:27.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2797999999999999e-05 2024-04-26T11:14:27.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:27.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142237+0000", 2024-04-26T11:14:27.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4464000000000001e-05 2024-04-26T11:14:27.574 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.574 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.574 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.574 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90441 5.4 5:2b047885:::benchmark_data_smithi029_44842_object90440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:27.574 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:27.574 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.360977622, 2024-04-26T11:14:27.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026164084000000001, 2024-04-26T11:14:27.574 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.574 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:27.575 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.575 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.575 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.575 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90441 2024-04-26T11:14:27.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.575 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:27.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:27.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150206+0000", 2024-04-26T11:14:27.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150261+0000", 2024-04-26T11:14:27.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4580000000000003e-05 2024-04-26T11:14:27.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150269+0000", 2024-04-26T11:14:27.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9679999999999995e-06 2024-04-26T11:14:27.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150274+0000", 2024-04-26T11:14:27.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8470000000000003e-06 2024-04-26T11:14:27.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150312+0000", 2024-04-26T11:14:27.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7245e-05 2024-04-26T11:14:27.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150396+0000", 2024-04-26T11:14:27.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4778999999999996e-05 2024-04-26T11:14:27.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:27.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150491+0000", 2024-04-26T11:14:27.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4606999999999997e-05 2024-04-26T11:14:27.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:27.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.153991+0000", 2024-04-26T11:14:27.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035001339999999998 2024-04-26T11:14:27.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:27.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176295+0000", 2024-04-26T11:14:27.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022304280999999999 2024-04-26T11:14:27.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:27.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176335+0000", 2024-04-26T11:14:27.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:27.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:27.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176371+0000", 2024-04-26T11:14:27.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5448999999999999e-05 2024-04-26T11:14:27.579 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.579 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.579 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.580 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101746 5.b 5:dcf04831:::benchmark_data_smithi029_44842_object101745:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:27.580 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.115039+0000", 2024-04-26T11:14:27.580 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.3961452740000002, 2024-04-26T11:14:27.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025752292999999999, 2024-04-26T11:14:27.580 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.580 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:27.580 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.580 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.580 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.580 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101746 2024-04-26T11:14:27.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.580 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115039+0000", 2024-04-26T11:14:27.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115039+0000", 2024-04-26T11:14:27.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115038+0000", 2024-04-26T11:14:27.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:27.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115105+0000", 2024-04-26T11:14:27.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6908000000000004e-05 2024-04-26T11:14:27.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115115+0000", 2024-04-26T11:14:27.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5200000000000003e-06 2024-04-26T11:14:27.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115122+0000", 2024-04-26T11:14:27.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5519999999999999e-06 2024-04-26T11:14:27.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115883+0000", 2024-04-26T11:14:27.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00076097600000000001 2024-04-26T11:14:27.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115971+0000", 2024-04-26T11:14:27.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7771999999999999e-05 2024-04-26T11:14:27.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:27.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.116055+0000", 2024-04-26T11:14:27.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3963999999999998e-05 2024-04-26T11:14:27.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:27.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.117903+0000", 2024-04-26T11:14:27.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001847932 2024-04-26T11:14:27.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:27.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140703+0000", 2024-04-26T11:14:27.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022800276000000001 2024-04-26T11:14:27.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:27.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140755+0000", 2024-04-26T11:14:27.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2052000000000002e-05 2024-04-26T11:14:27.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:27.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140791+0000", 2024-04-26T11:14:27.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6060999999999999e-05 2024-04-26T11:14:27.585 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.585 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.585 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.585 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101754 5.e 5:7ca15a5c:::benchmark_data_smithi029_44842_object101753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:27.585 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:27.585 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.3926527889999996, 2024-04-26T11:14:27.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039171048999999999, 2024-04-26T11:14:27.585 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.585 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:27.586 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.586 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.586 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.586 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101754 2024-04-26T11:14:27.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.586 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:27.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:27.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:27.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118604+0000", 2024-04-26T11:14:27.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3399000000000007e-05 2024-04-26T11:14:27.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118613+0000", 2024-04-26T11:14:27.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6989999999999992e-06 2024-04-26T11:14:27.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118618+0000", 2024-04-26T11:14:27.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3850000000000001e-06 2024-04-26T11:14:27.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118646+0000", 2024-04-26T11:14:27.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7878e-05 2024-04-26T11:14:27.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118720+0000", 2024-04-26T11:14:27.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3461999999999996e-05 2024-04-26T11:14:27.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:27.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118807+0000", 2024-04-26T11:14:27.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7269999999999996e-05 2024-04-26T11:14:27.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:27.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142317+0000", 2024-04-26T11:14:27.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023510105999999999 2024-04-26T11:14:27.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:27.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.143287+0000", 2024-04-26T11:14:27.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096983599999999996 2024-04-26T11:14:27.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:27.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157662+0000", 2024-04-26T11:14:27.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014375393 2024-04-26T11:14:27.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:27.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157702+0000", 2024-04-26T11:14:27.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0295e-05 2024-04-26T11:14:27.590 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.590 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.590 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.591 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101755 5.f 5:fa973a83:::benchmark_data_smithi029_44842_object101754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:27.591 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:27.591 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.3924870929999997, 2024-04-26T11:14:27.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039139064000000001, 2024-04-26T11:14:27.591 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.591 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:27.591 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.591 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.591 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.591 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101755 2024-04-26T11:14:27.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.591 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:27.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:27.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118696+0000", 2024-04-26T11:14:27.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118766+0000", 2024-04-26T11:14:27.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9423000000000003e-05 2024-04-26T11:14:27.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118774+0000", 2024-04-26T11:14:27.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9710000000000004e-06 2024-04-26T11:14:27.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118779+0000", 2024-04-26T11:14:27.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5629999999999999e-06 2024-04-26T11:14:27.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118817+0000", 2024-04-26T11:14:27.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7771000000000001e-05 2024-04-26T11:14:27.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118929+0000", 2024-04-26T11:14:27.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011222699999999999 2024-04-26T11:14:27.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:27.594 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157661+0000", 2024-04-26T11:14:27.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038731120000000001 2024-04-26T11:14:27.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:27.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157757+0000", 2024-04-26T11:14:27.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6910000000000006e-05 2024-04-26T11:14:27.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:27.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157836+0000", 2024-04-26T11:14:27.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8727999999999996e-05 2024-04-26T11:14:27.595 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.595 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.595 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.595 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101758 5.4 5:2525a4eb:::benchmark_data_smithi029_44842_object101757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:27.595 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:27.596 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.3903042419999991, 2024-04-26T11:14:27.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.03686739, 2024-04-26T11:14:27.596 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.596 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:27.596 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.596 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.596 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.596 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101758 2024-04-26T11:14:27.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.596 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:27.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:27.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120879+0000", 2024-04-26T11:14:27.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120971+0000", 2024-04-26T11:14:27.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2133999999999996e-05 2024-04-26T11:14:27.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120977+0000", 2024-04-26T11:14:27.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5509999999999999e-06 2024-04-26T11:14:27.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120981+0000", 2024-04-26T11:14:27.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.245e-06 2024-04-26T11:14:27.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121010+0000", 2024-04-26T11:14:27.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9084000000000001e-05 2024-04-26T11:14:27.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121083+0000", 2024-04-26T11:14:27.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2942999999999996e-05 2024-04-26T11:14:27.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:27.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121163+0000", 2024-04-26T11:14:27.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0197000000000005e-05 2024-04-26T11:14:27.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:27.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142822+0000", 2024-04-26T11:14:27.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021658535999999999 2024-04-26T11:14:27.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:27.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157674+0000", 2024-04-26T11:14:27.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014851573999999999 2024-04-26T11:14:27.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:27.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157714+0000", 2024-04-26T11:14:27.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0473999999999999e-05 2024-04-26T11:14:27.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:27.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157747+0000", 2024-04-26T11:14:27.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3278999999999998e-05 2024-04-26T11:14:27.601 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.601 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.601 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.601 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101760 5.4 5:2510211a:::benchmark_data_smithi029_44842_object101759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:27.601 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:27.601 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.3898718970000008, 2024-04-26T11:14:27.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039182383000000001, 2024-04-26T11:14:27.601 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.601 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:27.601 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.601 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.601 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.601 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101760 2024-04-26T11:14:27.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.602 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:27.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:27.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:27.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121389+0000", 2024-04-26T11:14:27.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6667000000000003e-05 2024-04-26T11:14:27.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121394+0000", 2024-04-26T11:14:27.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0839999999999999e-06 2024-04-26T11:14:27.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121397+0000", 2024-04-26T11:14:27.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4489999999999999e-06 2024-04-26T11:14:27.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122921+0000", 2024-04-26T11:14:27.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001524067 2024-04-26T11:14:27.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.123010+0000", 2024-04-26T11:14:27.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8449000000000006e-05 2024-04-26T11:14:27.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:27.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140838+0000", 2024-04-26T11:14:27.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017828796000000001 2024-04-26T11:14:27.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:27.605 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157665+0000", 2024-04-26T11:14:27.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016826574 2024-04-26T11:14:27.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.605 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:27.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160407+0000", 2024-04-26T11:14:27.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027423970000000002 2024-04-26T11:14:27.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:27.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160456+0000", 2024-04-26T11:14:27.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8678999999999999e-05 2024-04-26T11:14:27.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:27.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160495+0000", 2024-04-26T11:14:27.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8658000000000002e-05 2024-04-26T11:14:27.606 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.606 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.607 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.607 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101761 5.e 5:70294421:::benchmark_data_smithi029_44842_object101760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:27.607 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:27.607 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.388447524, 2024-04-26T11:14:27.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035270448000000003, 2024-04-26T11:14:27.607 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.607 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:27.607 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.607 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.607 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.607 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101761 2024-04-26T11:14:27.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.607 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:27.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:27.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122736+0000", 2024-04-26T11:14:27.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122805+0000", 2024-04-26T11:14:27.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9076000000000001e-05 2024-04-26T11:14:27.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122811+0000", 2024-04-26T11:14:27.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:14:27.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122815+0000", 2024-04-26T11:14:27.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2860000000000001e-06 2024-04-26T11:14:27.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122842+0000", 2024-04-26T11:14:27.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6429000000000001e-05 2024-04-26T11:14:27.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122916+0000", 2024-04-26T11:14:27.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4122999999999995e-05 2024-04-26T11:14:27.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:27.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122997+0000", 2024-04-26T11:14:27.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1428999999999996e-05 2024-04-26T11:14:27.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:27.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142344+0000", 2024-04-26T11:14:27.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019346452 2024-04-26T11:14:27.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:27.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157934+0000", 2024-04-26T11:14:27.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015589911999999999 2024-04-26T11:14:27.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:27.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157975+0000", 2024-04-26T11:14:27.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1604999999999999e-05 2024-04-26T11:14:27.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:27.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.158007+0000", 2024-04-26T11:14:27.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1921000000000002e-05 2024-04-26T11:14:27.612 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.612 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.612 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.612 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110145 5.9 5:9b275f16:::benchmark_data_smithi029_44842_object110144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:27.612 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:27.612 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.3628858859999999, 2024-04-26T11:14:27.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032844496000000001, 2024-04-26T11:14:27.613 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.613 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:27.613 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.613 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.613 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.613 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110145 2024-04-26T11:14:27.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.613 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:27.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:27.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148297+0000", 2024-04-26T11:14:27.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:27.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148325+0000", 2024-04-26T11:14:27.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7511000000000001e-05 2024-04-26T11:14:27.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148338+0000", 2024-04-26T11:14:27.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2808e-05 2024-04-26T11:14:27.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148345+0000", 2024-04-26T11:14:27.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7200000000000006e-06 2024-04-26T11:14:27.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149888+0000", 2024-04-26T11:14:27.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001542666 2024-04-26T11:14:27.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149977+0000", 2024-04-26T11:14:27.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9247999999999997e-05 2024-04-26T11:14:27.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:27.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181006+0000", 2024-04-26T11:14:27.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031028535999999999 2024-04-26T11:14:27.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:27.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181051+0000", 2024-04-26T11:14:27.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5393999999999999e-05 2024-04-26T11:14:27.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:27.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181143+0000", 2024-04-26T11:14:27.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1458000000000004e-05 2024-04-26T11:14:27.617 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.617 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.617 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.617 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110155 5.9 5:9ebc6158:::benchmark_data_smithi029_44842_object110154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:27.617 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:27.617 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.3578100940000004, 2024-04-26T11:14:27.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027886826999999999, 2024-04-26T11:14:27.618 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.618 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:27.618 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.618 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.618 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.618 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110155 2024-04-26T11:14:27.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.618 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:27.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:27.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153373+0000", 2024-04-26T11:14:27.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153479+0000", 2024-04-26T11:14:27.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105728 2024-04-26T11:14:27.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153491+0000", 2024-04-26T11:14:27.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2207e-05 2024-04-26T11:14:27.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153499+0000", 2024-04-26T11:14:27.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7729999999999999e-06 2024-04-26T11:14:27.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153655+0000", 2024-04-26T11:14:27.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015573 2024-04-26T11:14:27.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153770+0000", 2024-04-26T11:14:27.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011562500000000001 2024-04-26T11:14:27.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:27.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181153+0000", 2024-04-26T11:14:27.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027382113 2024-04-26T11:14:27.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.621 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:27.621 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181195+0000", 2024-04-26T11:14:27.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1921000000000001e-05 2024-04-26T11:14:27.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:27.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181261+0000", 2024-04-26T11:14:27.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6402999999999994e-05 2024-04-26T11:14:27.622 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.622 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.622 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.622 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110162 5.9 5:98f89097:::benchmark_data_smithi029_44842_object110161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:27.622 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.156486+0000", 2024-04-26T11:14:27.622 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.3546983409999998, 2024-04-26T11:14:27.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025002745999999999, 2024-04-26T11:14:27.622 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:27.622 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:27.622 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:27.623 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:27.623 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.623 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110162 2024-04-26T11:14:27.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.623 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:27.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:27.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.156486+0000", 2024-04-26T11:14:27.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:27.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.156486+0000", 2024-04-26T11:14:27.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:27.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:27.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.156485+0000", 2024-04-26T11:14:27.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:27.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.156517+0000", 2024-04-26T11:14:27.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1958999999999997e-05 2024-04-26T11:14:27.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:27.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.156524+0000", 2024-04-26T11:14:27.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:14:27.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.156529+0000", 2024-04-26T11:14:27.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8930000000000004e-06 2024-04-26T11:14:27.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:27.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.170559+0000", 2024-04-26T11:14:27.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014030331 2024-04-26T11:14:27.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:27.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.170693+0000", 2024-04-26T11:14:27.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013373000000000001 2024-04-26T11:14:27.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:27.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181386+0000", 2024-04-26T11:14:27.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010693326 2024-04-26T11:14:27.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:27.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181423+0000", 2024-04-26T11:14:27.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6857999999999998e-05 2024-04-26T11:14:27.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:27.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:27.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:27.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181489+0000", 2024-04-26T11:14:27.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5450000000000005e-05 2024-04-26T11:14:27.627 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.627 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.627 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.627 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:27.627 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:27.627 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:27.628 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is set 2024-04-26T11:14:27.629 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:27.629 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:27.626+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:27.729 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:27.727+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:27.819 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:120633 5.0 e39/16 5:0b5580df:::benchmark_data_smithi029_44842_object120632:head v 39'7626, mlcod=39'7623)", 2024-04-26T11:14:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:27.814881+0000", 2024-04-26T11:14:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.003087167, 2024-04-26T11:14:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00311276, 2024-04-26T11:14:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.814881+0000", 2024-04-26T11:14:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.820 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.821 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:27.821 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.814881+0000", 2024-04-26T11:14:27.821 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:27.821 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.821 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.821 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:27.821 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.814880+0000", 2024-04-26T11:14:27.821 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.821 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.821 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.821 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:27.821 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.814939+0000", 2024-04-26T11:14:27.821 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8242999999999998e-05 2024-04-26T11:14:27.821 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.814946+0000", 2024-04-26T11:14:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3270000000000003e-06 2024-04-26T11:14:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.814952+0000", 2024-04-26T11:14:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1090000000000003e-06 2024-04-26T11:14:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.814985+0000", 2024-04-26T11:14:27.822 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2953000000000001e-05 2024-04-26T11:14:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.815002+0000", 2024-04-26T11:14:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6518e-05 2024-04-26T11:14:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:120635 5.b e39/16 5:dc81bf6e:::benchmark_data_smithi029_44842_object120634:head v 39'7696, mlcod=39'7694)", 2024-04-26T11:14:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:27.815573+0000", 2024-04-26T11:14:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00239551, 2024-04-26T11:14:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0024847770000000001, 2024-04-26T11:14:27.823 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.815573+0000", 2024-04-26T11:14:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.815573+0000", 2024-04-26T11:14:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:27.824 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.815572+0000", 2024-04-26T11:14:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.815631+0000", 2024-04-26T11:14:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8749000000000003e-05 2024-04-26T11:14:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.815638+0000", 2024-04-26T11:14:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5100000000000001e-06 2024-04-26T11:14:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.825 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.815643+0000", 2024-04-26T11:14:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6e-06 2024-04-26T11:14:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.815675+0000", 2024-04-26T11:14:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1739999999999998e-05 2024-04-26T11:14:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.815688+0000", 2024-04-26T11:14:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3190000000000001e-05 2024-04-26T11:14:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:27.826 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:120640 5.3 5:ce6751ba:::benchmark_data_smithi029_44842_object120639:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T11:14:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:27.816582+0000", 2024-04-26T11:14:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0013864470000000001, 2024-04-26T11:14:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0015417779999999999, 2024-04-26T11:14:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 120640 2024-04-26T11:14:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.827 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:27.828 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816582+0000", 2024-04-26T11:14:27.828 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:27.828 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.828 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.828 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:27.828 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816582+0000", 2024-04-26T11:14:27.828 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:27.828 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.828 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.828 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:27.828 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816580+0000", 2024-04-26T11:14:27.829 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:27.829 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.829 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.829 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:27.829 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816652+0000", 2024-04-26T11:14:27.829 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1686000000000004e-05 2024-04-26T11:14:27.829 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.829 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.829 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:27.829 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816663+0000", 2024-04-26T11:14:27.829 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0464e-05 2024-04-26T11:14:27.829 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.829 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.829 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.829 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816670+0000", 2024-04-26T11:14:27.830 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1790000000000002e-06 2024-04-26T11:14:27.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.830 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.830 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:27.830 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816745+0000", 2024-04-26T11:14:27.830 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5303999999999996e-05 2024-04-26T11:14:27.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.830 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.830 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:27.830 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816886+0000", 2024-04-26T11:14:27.830 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014066999999999999 2024-04-26T11:14:27.830 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:27.830 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:120641 5.2 5:444ff9b4:::benchmark_data_smithi029_44842_object120640:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T11:14:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:27.816680+0000", 2024-04-26T11:14:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0012882390000000001, 2024-04-26T11:14:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001513246, 2024-04-26T11:14:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 120641 2024-04-26T11:14:27.831 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816680+0000", 2024-04-26T11:14:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816680+0000", 2024-04-26T11:14:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816679+0000", 2024-04-26T11:14:27.832 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816758+0000", 2024-04-26T11:14:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8424999999999995e-05 2024-04-26T11:14:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816771+0000", 2024-04-26T11:14:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3638000000000001e-05 2024-04-26T11:14:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.833 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816778+0000", 2024-04-26T11:14:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0849999999999999e-06 2024-04-26T11:14:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816828+0000", 2024-04-26T11:14:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.9298999999999997e-05 2024-04-26T11:14:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816958+0000", 2024-04-26T11:14:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000130653 2024-04-26T11:14:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:27.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:120636 5.4 e39/16 5:273c759d:::benchmark_data_smithi029_44842_object120635:head v 39'7476, mlcod=39'7474)", 2024-04-26T11:14:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:27.816897+0000", 2024-04-26T11:14:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0010715729999999999, 2024-04-26T11:14:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0013605069999999999, 2024-04-26T11:14:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816897+0000", 2024-04-26T11:14:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.835 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816897+0000", 2024-04-26T11:14:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816896+0000", 2024-04-26T11:14:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816958+0000", 2024-04-26T11:14:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2075000000000005e-05 2024-04-26T11:14:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.836 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816966+0000", 2024-04-26T11:14:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3089999999999996e-06 2024-04-26T11:14:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816971+0000", 2024-04-26T11:14:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.464e-06 2024-04-26T11:14:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.817002+0000", 2024-04-26T11:14:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0806000000000003e-05 2024-04-26T11:14:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.837 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.817014+0000", 2024-04-26T11:14:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1997000000000001e-05 2024-04-26T11:14:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:120638 5.e e39/16 5:7eaba21c:::benchmark_data_smithi029_44842_object120637:head v 39'7552, mlcod=39'7550)", 2024-04-26T11:14:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:27.817175+0000", 2024-04-26T11:14:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00079268600000000002, 2024-04-26T11:14:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001138071, 2024-04-26T11:14:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:27.838 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:27.839 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.839 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:27.839 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.817175+0000", 2024-04-26T11:14:27.839 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:27.839 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.839 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.839 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:27.839 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.817175+0000", 2024-04-26T11:14:27.839 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:27.839 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.839 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.839 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:27.839 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.817175+0000", 2024-04-26T11:14:27.839 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.839 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.840 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.840 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:27.840 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.817240+0000", 2024-04-26T11:14:27.840 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4820999999999995e-05 2024-04-26T11:14:27.840 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.840 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.840 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:27.840 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.817250+0000", 2024-04-26T11:14:27.840 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.8209999999999997e-06 2024-04-26T11:14:27.840 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.840 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.840 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.840 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.817255+0000", 2024-04-26T11:14:27.840 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6339999999999998e-06 2024-04-26T11:14:27.840 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.840 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.841 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:27.841 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.817291+0000", 2024-04-26T11:14:27.841 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:14:27.841 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.841 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.841 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:27.841 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.817309+0000", 2024-04-26T11:14:27.841 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7404000000000001e-05 2024-04-26T11:14:27.841 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:27.841 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:27.841 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:27.841 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.841 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.841 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:120642 5.3 5.52da5153 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T11:14:27.841 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:27.816791+0000", 2024-04-26T11:14:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0011770389999999999, 2024-04-26T11:14:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0015780359999999999, 2024-04-26T11:14:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 120642 2024-04-26T11:14:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.842 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816791+0000", 2024-04-26T11:14:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816791+0000", 2024-04-26T11:14:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.816790+0000", 2024-04-26T11:14:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.843 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:27.844 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.817486+0000", 2024-04-26T11:14:27.844 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00069604900000000002 2024-04-26T11:14:27.844 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.844 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.844 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:27.844 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.817497+0000", 2024-04-26T11:14:27.844 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0360000000000001e-05 2024-04-26T11:14:27.844 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.844 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.844 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.844 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.817503+0000", 2024-04-26T11:14:27.844 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5459999999999997e-06 2024-04-26T11:14:27.844 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:27.844 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:27.844 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:27.845 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.845 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.845 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:120644 5.3 5.7d5a6a33 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T11:14:27.845 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:27.817510+0000", 2024-04-26T11:14:27.845 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.000458281, 2024-04-26T11:14:27.845 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00091056399999999999, 2024-04-26T11:14:27.845 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:27.845 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:27.845 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:27.845 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:27.845 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:27.845 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 120644 2024-04-26T11:14:27.845 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.845 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:27.845 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.845 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:27.846 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.817510+0000", 2024-04-26T11:14:27.846 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:27.846 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.846 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.846 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:27.846 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.817510+0000", 2024-04-26T11:14:27.846 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:27.846 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.846 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.846 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:27.846 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.817509+0000", 2024-04-26T11:14:27.846 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:27.846 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.846 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.847 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:27.847 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.817535+0000", 2024-04-26T11:14:27.847 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6305999999999999e-05 2024-04-26T11:14:27.847 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.847 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.847 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:27.847 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.817543+0000", 2024-04-26T11:14:27.847 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5039999999999996e-06 2024-04-26T11:14:27.847 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:27.847 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:27.847 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:27.847 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.817549+0000", 2024-04-26T11:14:27.847 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6450000000000002e-06 2024-04-26T11:14:27.847 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:27.847 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:27.848 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:27.848 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:27.848 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:14:27.848 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 8 2024-04-26T11:14:27.848 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:27.850 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:27.850 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:27.847+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:27.950 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:27.948+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:28.050 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:28.048+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:28.079 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:28.080 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:14:28.080 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:14:28.080 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:14:28.080 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:28.094 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:28.150 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~29s 2024-04-26T11:14:28.151 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:28.149+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:28.251 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:28.249+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:28.276 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:28.276 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:14:28.276 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:14:28.276 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:28.276 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.276 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:28.276 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:28.277 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 35.001421338, 2024-04-26T11:14:28.277 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:14:28.277 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:28.277 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:28.277 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:28.277 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:28.277 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.277 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:14:28.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.277 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:28.277 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.277 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:28.277 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:28.277 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.278 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.278 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:28.278 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:28.278 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.278 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.278 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.278 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:28.278 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:14:28.278 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:28.278 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.278 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.278 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:28.278 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:14:28.278 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:14:28.279 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.279 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.279 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:28.279 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:14:28.279 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:14:28.279 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.279 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.279 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.279 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:14:28.279 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:14:28.279 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.279 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.279 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.279 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:14:28.280 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:14:28.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.280 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.280 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:28.280 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:14:28.280 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:14:28.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.280 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.280 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:28.280 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:14:28.280 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:14:28.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.280 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.280 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:28.281 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:14:28.281 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:14:28.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.281 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.281 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:28.281 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:14:28.281 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:14:28.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.281 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.281 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:28.281 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:14:28.281 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:14:28.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.281 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.281 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:28.281 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:14:28.282 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:14:28.282 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.282 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:28.282 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.282 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.282 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:28.282 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:28.282 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 35.000609773000001, 2024-04-26T11:14:28.282 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:14:28.282 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:28.282 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:28.282 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:28.282 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:28.282 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.283 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:14:28.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.283 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:28.283 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.283 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:28.283 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:28.283 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.283 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.283 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:28.283 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:28.283 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.283 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.283 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:28.284 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:28.284 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:28.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.284 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.284 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:28.284 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:14:28.284 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:14:28.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.284 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.284 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:28.284 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:14:28.284 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:14:28.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.284 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.284 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:14:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:14:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:14:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:14:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:14:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:14:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:14:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:14:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:14:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:14:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:14:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:14:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:14:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:14:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:14:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:14:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 34.993422936000002, 2024-04-26T11:14:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:14:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:14:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:14:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:14:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:14:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:14:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:14:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:14:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:14:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:14:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:14:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:14:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:14:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:14:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:14:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:14:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:14:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:14:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:14:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:14:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:14:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:14:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:14:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 34.992882057000003, 2024-04-26T11:14:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:14:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:14:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.295 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.295 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:28.295 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:28.295 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:28.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.295 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.295 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:28.295 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:14:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:14:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:14:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:14:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:14:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:14:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:14:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:14:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:14:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:14:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:14:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:14:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:14:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:14:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:14:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:14:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:14:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:14:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:14:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:14:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 30.949697610000001, 2024-04-26T11:14:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:14:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:14:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:14:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:14:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:14:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:14:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:14:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:14:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:14:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:14:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:14:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:14:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:14:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:14:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:14:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:14:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:14:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:14:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:14:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:14:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:14:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:14:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:14:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:14:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:14:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 30.94750427, 2024-04-26T11:14:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:14:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:14:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:14:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:14:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:14:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:14:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:14:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:14:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:14:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:14:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:14:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:14:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:14:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:14:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:14:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:14:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:14:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:14:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:14:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:14:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:14:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:14:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:14:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:14:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:14:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 30.942292446, 2024-04-26T11:14:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:14:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:14:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:14:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:14:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:14:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:14:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:14:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:14:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:14:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:14:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:14:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:14:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:14:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:14:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:14:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:14:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:14:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:14:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:14:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:14:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:14:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:14:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:14:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:14:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:14:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 30.925843745999998, 2024-04-26T11:14:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:14:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:14:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:14:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:14:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:14:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:14:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:14:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:14:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:14:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:14:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:14:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:14:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:14:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:14:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:14:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:14:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:14:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 30.924146240999999, 2024-04-26T11:14:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:14:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:14:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:14:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:14:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:14:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:14:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:14:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:14:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:14:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:14:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:14:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:14:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:14:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:14:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:14:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:14:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:14:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 30.924081939000001, 2024-04-26T11:14:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:14:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:14:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:14:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:14:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:14:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:14:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:14:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:14:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:14:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:14:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:14:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:14:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:14:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:14:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:14:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:14:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:14:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:14:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:14:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:14:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:14:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:14:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 30.924027715000001, 2024-04-26T11:14:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:14:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:14:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:14:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:14:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:14:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:14:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:14:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:14:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:14:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:14:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:14:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:14:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:14:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:14:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:14:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:14:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:14:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:14:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:14:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:14:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:14:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 30.923983202999999, 2024-04-26T11:14:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:14:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:14:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:14:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:14:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:14:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:14:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:14:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:14:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:14:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:14:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:14:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:14:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:14:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:14:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:14:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:14:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:14:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:14:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:14:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:14:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:14:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:14:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:14:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 30.919762201000001, 2024-04-26T11:14:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:14:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:14:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:28.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.343 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:28.343 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:28.343 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.343 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:28.343 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:28.343 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.343 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:28.343 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:14:28.343 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:14:28.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:14:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:14:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:14:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:14:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:14:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:14:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.345 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.345 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.345 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:14:28.345 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:14:28.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.345 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.345 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:28.345 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:14:28.345 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:14:28.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.345 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.345 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.345 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:14:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:14:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:14:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:14:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:14:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:14:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:14:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:14:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:14:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:14:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:61817 5.a 5:5627ce7f:::benchmark_data_smithi029_44842_object61816:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 27.569636748000001, 2024-04-26T11:14:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020626958000000001, 2024-04-26T11:14:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 61817 2024-04-26T11:14:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702591+0000", 2024-04-26T11:14:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0665999999999998e-05 2024-04-26T11:14:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702599+0000", 2024-04-26T11:14:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7130000000000005e-06 2024-04-26T11:14:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702605+0000", 2024-04-26T11:14:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4310000000000002e-06 2024-04-26T11:14:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.707947+0000", 2024-04-26T11:14:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053424220000000003 2024-04-26T11:14:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.708052+0000", 2024-04-26T11:14:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010499 2024-04-26T11:14:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:14:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.708141+0000", 2024-04-26T11:14:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9514999999999999e-05 2024-04-26T11:14:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.711954+0000", 2024-04-26T11:14:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003812265 2024-04-26T11:14:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723070+0000", 2024-04-26T11:14:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011116727 2024-04-26T11:14:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723121+0000", 2024-04-26T11:14:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0362999999999999e-05 2024-04-26T11:14:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723158+0000", 2024-04-26T11:14:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7579000000000001e-05 2024-04-26T11:14:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:75771 5.c 5:3cc8f1b4:::benchmark_data_smithi029_44842_object75770:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T11:14:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 21.519192404999998, 2024-04-26T11:14:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019437949, 2024-04-26T11:14:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 75771 2024-04-26T11:14:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752975+0000", 2024-04-26T11:14:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753061+0000", 2024-04-26T11:14:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5890999999999995e-05 2024-04-26T11:14:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753071+0000", 2024-04-26T11:14:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.9990000000000003e-06 2024-04-26T11:14:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753078+0000", 2024-04-26T11:14:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1559999999999998e-06 2024-04-26T11:14:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.758559+0000", 2024-04-26T11:14:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0054812819999999996 2024-04-26T11:14:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.758692+0000", 2024-04-26T11:14:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000133301 2024-04-26T11:14:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772277+0000", 2024-04-26T11:14:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.013584839 2024-04-26T11:14:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772340+0000", 2024-04-26T11:14:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2360999999999995e-05 2024-04-26T11:14:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772414+0000", 2024-04-26T11:14:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4024999999999997e-05 2024-04-26T11:14:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83360 5.2 5:42f8bfcd:::benchmark_data_smithi029_44842_object83359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 17.232522831000001, 2024-04-26T11:14:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022279782000000001, 2024-04-26T11:14:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83360 2024-04-26T11:14:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039700+0000", 2024-04-26T11:14:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5541000000000002e-05 2024-04-26T11:14:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039706+0000", 2024-04-26T11:14:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3680000000000001e-06 2024-04-26T11:14:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039709+0000", 2024-04-26T11:14:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4659999999999999e-06 2024-04-26T11:14:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056305+0000", 2024-04-26T11:14:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016595649000000001 2024-04-26T11:14:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056487+0000", 2024-04-26T11:14:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000181886 2024-04-26T11:14:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061809+0000", 2024-04-26T11:14:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053223259999999996 2024-04-26T11:14:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061852+0000", 2024-04-26T11:14:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2738999999999999e-05 2024-04-26T11:14:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061925+0000", 2024-04-26T11:14:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3180000000000001e-05 2024-04-26T11:14:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83364 5.2 5:42c5cd8c:::benchmark_data_smithi029_44842_object83363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 17.232107091, 2024-04-26T11:14:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022695336, 2024-04-26T11:14:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83364 2024-04-26T11:14:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040060+0000", 2024-04-26T11:14:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040086+0000", 2024-04-26T11:14:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5482000000000001e-05 2024-04-26T11:14:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040093+0000", 2024-04-26T11:14:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6409999999999996e-06 2024-04-26T11:14:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040098+0000", 2024-04-26T11:14:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879999999999996e-06 2024-04-26T11:14:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058292+0000", 2024-04-26T11:14:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018193504999999999 2024-04-26T11:14:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058412+0000", 2024-04-26T11:14:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011979199999999999 2024-04-26T11:14:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062642+0000", 2024-04-26T11:14:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042299449999999997 2024-04-26T11:14:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062688+0000", 2024-04-26T11:14:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6859e-05 2024-04-26T11:14:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062756+0000", 2024-04-26T11:14:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7995000000000002e-05 2024-04-26T11:14:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83378 5.2 5:44b3209a:::benchmark_data_smithi029_44842_object83377:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 17.224386637999999, 2024-04-26T11:14:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020722529, 2024-04-26T11:14:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83378 2024-04-26T11:14:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047781+0000", 2024-04-26T11:14:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047832+0000", 2024-04-26T11:14:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1687000000000002e-05 2024-04-26T11:14:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047842+0000", 2024-04-26T11:14:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2439999999999999e-06 2024-04-26T11:14:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047847+0000", 2024-04-26T11:14:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6500000000000001e-06 2024-04-26T11:14:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.060082+0000", 2024-04-26T11:14:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.012235105 2024-04-26T11:14:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.060191+0000", 2024-04-26T11:14:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000108665 2024-04-26T11:14:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068363+0000", 2024-04-26T11:14:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0081715829999999996 2024-04-26T11:14:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068418+0000", 2024-04-26T11:14:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4984000000000001e-05 2024-04-26T11:14:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068504+0000", 2024-04-26T11:14:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6520000000000005e-05 2024-04-26T11:14:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:119982 5.1 5:838cc2bc:::benchmark_data_smithi029_44842_object119981:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T11:14:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:27.506073+0000", 2024-04-26T11:14:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.76609550199999998, 2024-04-26T11:14:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019036035, 2024-04-26T11:14:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 119982 2024-04-26T11:14:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.506073+0000", 2024-04-26T11:14:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.506073+0000", 2024-04-26T11:14:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.506072+0000", 2024-04-26T11:14:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.506178+0000", 2024-04-26T11:14:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010645900000000001 2024-04-26T11:14:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.506186+0000", 2024-04-26T11:14:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2800000000000003e-06 2024-04-26T11:14:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.506192+0000", 2024-04-26T11:14:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8329999999999999e-06 2024-04-26T11:14:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.508898+0000", 2024-04-26T11:14:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0027058109999999998 2024-04-26T11:14:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.508999+0000", 2024-04-26T11:14:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000101056 2024-04-26T11:14:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.525009+0000", 2024-04-26T11:14:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016010216000000001 2024-04-26T11:14:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.525056+0000", 2024-04-26T11:14:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6439e-05 2024-04-26T11:14:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.525109+0000", 2024-04-26T11:14:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2899000000000003e-05 2024-04-26T11:14:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:119985 5.3 5:c1cceb39:::benchmark_data_smithi029_44842_object119984:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T11:14:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:27.506441+0000", 2024-04-26T11:14:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.76572753400000004, 2024-04-26T11:14:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020515384000000001, 2024-04-26T11:14:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 119985 2024-04-26T11:14:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.506441+0000", 2024-04-26T11:14:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.506441+0000", 2024-04-26T11:14:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.506440+0000", 2024-04-26T11:14:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.506516+0000", 2024-04-26T11:14:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5584e-05 2024-04-26T11:14:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.506523+0000", 2024-04-26T11:14:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8220000000000001e-06 2024-04-26T11:14:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.506526+0000", 2024-04-26T11:14:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8430000000000003e-06 2024-04-26T11:14:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.506582+0000", 2024-04-26T11:14:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5155999999999998e-05 2024-04-26T11:14:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.506724+0000", 2024-04-26T11:14:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014225899999999999 2024-04-26T11:14:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.526835+0000", 2024-04-26T11:14:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020111653 2024-04-26T11:14:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.526880+0000", 2024-04-26T11:14:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4994000000000003e-05 2024-04-26T11:14:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.526956+0000", 2024-04-26T11:14:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5562999999999995e-05 2024-04-26T11:14:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:28.381 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:28.382 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:28.380+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:28.383 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:28.414 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 50 16 121957 121941 152.412 137.25 0.0113674 0.0065585 2024-04-26T11:14:28.483 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:28.481+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:28.557 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:28.557 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:28.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:122278 5.0 5:0ed18ae5:::benchmark_data_smithi029_44842_object122277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T11:14:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:28.555382+0000", 2024-04-26T11:14:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00040887900000000001, 2024-04-26T11:14:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0004392, 2024-04-26T11:14:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 122278 2024-04-26T11:14:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555382+0000", 2024-04-26T11:14:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555382+0000", 2024-04-26T11:14:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555381+0000", 2024-04-26T11:14:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555470+0000", 2024-04-26T11:14:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8689000000000004e-05 2024-04-26T11:14:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555479+0000", 2024-04-26T11:14:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0850000000000003e-06 2024-04-26T11:14:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555486+0000", 2024-04-26T11:14:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1550000000000001e-06 2024-04-26T11:14:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555519+0000", 2024-04-26T11:14:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2678000000000001e-05 2024-04-26T11:14:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555631+0000", 2024-04-26T11:14:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011181299999999999 2024-04-26T11:14:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555760+0000", 2024-04-26T11:14:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012929799999999999 2024-04-26T11:14:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:122280 5.e 5:79ab2cc5:::benchmark_data_smithi029_44842_object122279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T11:14:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:28.555638+0000", 2024-04-26T11:14:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00015269799999999999, 2024-04-26T11:14:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027071700000000002, 2024-04-26T11:14:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 122280 2024-04-26T11:14:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555638+0000", 2024-04-26T11:14:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555638+0000", 2024-04-26T11:14:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555638+0000", 2024-04-26T11:14:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555705+0000", 2024-04-26T11:14:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7213999999999997e-05 2024-04-26T11:14:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555713+0000", 2024-04-26T11:14:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2660000000000001e-06 2024-04-26T11:14:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555720+0000", 2024-04-26T11:14:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8190000000000003e-06 2024-04-26T11:14:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555765+0000", 2024-04-26T11:14:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5479000000000003e-05 2024-04-26T11:14:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555907+0000", 2024-04-26T11:14:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000141187 2024-04-26T11:14:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:122260 5.0 5:02e167a8:::benchmark_data_smithi029_44842_object122259:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T11:14:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:28.548831+0000", 2024-04-26T11:14:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0069595960000000002, 2024-04-26T11:14:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0071497430000000001, 2024-04-26T11:14:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 122260 2024-04-26T11:14:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.548831+0000", 2024-04-26T11:14:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.548831+0000", 2024-04-26T11:14:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.548831+0000", 2024-04-26T11:14:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.548901+0000", 2024-04-26T11:14:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9877999999999997e-05 2024-04-26T11:14:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.548910+0000", 2024-04-26T11:14:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0010000000000007e-06 2024-04-26T11:14:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.548916+0000", 2024-04-26T11:14:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1500000000000004e-06 2024-04-26T11:14:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.551112+0000", 2024-04-26T11:14:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021967480000000001 2024-04-26T11:14:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.551229+0000", 2024-04-26T11:14:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000116482 2024-04-26T11:14:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.551361+0000", 2024-04-26T11:14:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132142 2024-04-26T11:14:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.553974+0000", 2024-04-26T11:14:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026131050000000001 2024-04-26T11:14:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:122262 5.e 5:7ecd30c2:::benchmark_data_smithi029_44842_object122261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T11:14:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:28.548977+0000", 2024-04-26T11:14:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0068139990000000003, 2024-04-26T11:14:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007086022, 2024-04-26T11:14:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 122262 2024-04-26T11:14:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.548977+0000", 2024-04-26T11:14:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.548977+0000", 2024-04-26T11:14:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.548977+0000", 2024-04-26T11:14:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.550782+0000", 2024-04-26T11:14:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018053629999999999 2024-04-26T11:14:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.550791+0000", 2024-04-26T11:14:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4679999999999998e-06 2024-04-26T11:14:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.550798+0000", 2024-04-26T11:14:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8719999999999996e-06 2024-04-26T11:14:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.550899+0000", 2024-04-26T11:14:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010093499999999999 2024-04-26T11:14:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.550994+0000", 2024-04-26T11:14:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4580000000000006e-05 2024-04-26T11:14:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.551086+0000", 2024-04-26T11:14:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1965999999999993e-05 2024-04-26T11:14:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.553963+0000", 2024-04-26T11:14:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0028777199999999998 2024-04-26T11:14:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:122270 5.f 5:f74649d8:::benchmark_data_smithi029_44842_object122269:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T11:14:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:28.551571+0000", 2024-04-26T11:14:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.004219525, 2024-04-26T11:14:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045800859999999997, 2024-04-26T11:14:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 122270 2024-04-26T11:14:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.551571+0000", 2024-04-26T11:14:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.551571+0000", 2024-04-26T11:14:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.551571+0000", 2024-04-26T11:14:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.551642+0000", 2024-04-26T11:14:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1221000000000001e-05 2024-04-26T11:14:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.551650+0000", 2024-04-26T11:14:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0879999999999995e-06 2024-04-26T11:14:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.551657+0000", 2024-04-26T11:14:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9210000000000003e-06 2024-04-26T11:14:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.551700+0000", 2024-04-26T11:14:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3350999999999999e-05 2024-04-26T11:14:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.551845+0000", 2024-04-26T11:14:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014443 2024-04-26T11:14:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:122272 5.d 5:be6f2379:::benchmark_data_smithi029_44842_object122271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T11:14:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:28.553121+0000", 2024-04-26T11:14:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0026700959999999998, 2024-04-26T11:14:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030976179999999999, 2024-04-26T11:14:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 122272 2024-04-26T11:14:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.553121+0000", 2024-04-26T11:14:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.553121+0000", 2024-04-26T11:14:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.553120+0000", 2024-04-26T11:14:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.553180+0000", 2024-04-26T11:14:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0024e-05 2024-04-26T11:14:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.553191+0000", 2024-04-26T11:14:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0753e-05 2024-04-26T11:14:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.553199+0000", 2024-04-26T11:14:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6580000000000008e-06 2024-04-26T11:14:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.553231+0000", 2024-04-26T11:14:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2060000000000001e-05 2024-04-26T11:14:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.553323+0000", 2024-04-26T11:14:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1675000000000006e-05 2024-04-26T11:14:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:122274 5.a 5:5cee3162:::benchmark_data_smithi029_44842_object122273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T11:14:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:28.554842+0000", 2024-04-26T11:14:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00094930000000000004, 2024-04-26T11:14:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0014524200000000001, 2024-04-26T11:14:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 122274 2024-04-26T11:14:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.554842+0000", 2024-04-26T11:14:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.554842+0000", 2024-04-26T11:14:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.554841+0000", 2024-04-26T11:14:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.554910+0000", 2024-04-26T11:14:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9373000000000001e-05 2024-04-26T11:14:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.554918+0000", 2024-04-26T11:14:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4499999999999998e-06 2024-04-26T11:14:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.554925+0000", 2024-04-26T11:14:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2690000000000002e-06 2024-04-26T11:14:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.554959+0000", 2024-04-26T11:14:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3714999999999998e-05 2024-04-26T11:14:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555050+0000", 2024-04-26T11:14:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1501000000000004e-05 2024-04-26T11:14:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555147+0000", 2024-04-26T11:14:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6092000000000001e-05 2024-04-26T11:14:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.586 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:122276 5.b 5:d28298ac:::benchmark_data_smithi029_44842_object122275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T11:14:28.586 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:28.555045+0000", 2024-04-26T11:14:28.586 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00074588499999999995, 2024-04-26T11:14:28.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013276869999999999, 2024-04-26T11:14:28.586 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:28.586 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:28.586 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:28.586 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:28.586 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.586 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 122276 2024-04-26T11:14:28.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.586 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:28.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:28.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555045+0000", 2024-04-26T11:14:28.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:28.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555045+0000", 2024-04-26T11:14:28.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:28.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555045+0000", 2024-04-26T11:14:28.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:28.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:28.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555159+0000", 2024-04-26T11:14:28.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011437100000000001 2024-04-26T11:14:28.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:28.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555168+0000", 2024-04-26T11:14:28.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5510000000000005e-06 2024-04-26T11:14:28.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555174+0000", 2024-04-26T11:14:28.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9889999999999997e-06 2024-04-26T11:14:28.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:28.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555273+0000", 2024-04-26T11:14:28.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8350000000000005e-05 2024-04-26T11:14:28.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:28.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555400+0000", 2024-04-26T11:14:28.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012681199999999999 2024-04-26T11:14:28.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.589 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:28.589 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:28.555525+0000", 2024-04-26T11:14:28.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012562700000000001 2024-04-26T11:14:28.589 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.589 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:28.590 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.590 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.590 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:14:28.590 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 8 2024-04-26T11:14:28.590 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:28.591 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:28.592 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:28.589+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:28.692 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:28.690+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:28.764 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:28.764 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:14:28.764 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:14:28.764 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:14:28.765 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:28.780 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:28.793 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:28.791+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:28.894 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:28.892+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:28.903 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:14:28.949 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:14:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:14:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 35.667090051000002, 2024-04-26T11:14:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:14:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:28.950 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:28.950 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:28.950 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.950 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:14:28.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.950 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:28.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:28.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:28.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:14:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:14:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:14:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:14:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:14:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:14:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:14:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:14:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:14:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:14:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:14:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:14:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:14:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:14:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:14:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:14:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:14:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:14:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:14:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:14:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 35.666440348999998, 2024-04-26T11:14:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:14:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:14:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:14:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:14:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:14:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:14:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:14:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:14:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:14:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:14:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:14:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:14:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:14:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:14:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:14:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:14:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:14:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:14:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:14:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:14:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:14:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:14:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:14:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 31.599798310000001, 2024-04-26T11:14:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:14:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:14:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:14:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:14:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:14:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:14:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:14:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:14:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:14:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:14:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:14:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:14:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:14:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:14:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:14:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:14:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:14:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 31.599702663999999, 2024-04-26T11:14:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:14:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:14:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:14:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:14:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:14:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:14:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:14:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:14:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:14:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:14:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:14:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:14:28.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:14:28.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:28.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:14:28.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:14:28.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:28.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:14:28.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:14:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 31.599570985, 2024-04-26T11:14:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:14:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:14:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:14:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:14:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:14:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:14:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:14:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:14:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:14:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:14:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:14:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:14:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:14:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:14:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:14:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:14:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 31.599462529, 2024-04-26T11:14:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:14:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:14:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:14:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:14:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:14:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:14:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:14:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:14:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:14:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:14:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:14:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:14:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:14:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:14:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:14:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:14:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:14:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 31.599361260999999, 2024-04-26T11:14:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:14:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:14:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:14:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:14:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:14:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:14:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:14:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:14:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:14:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:14:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:14:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:14:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:14:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:14:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:14:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:14:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:14:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:14:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:14:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:14:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:14:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:14:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 31.59929232, 2024-04-26T11:14:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:14:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:14:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:14:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:14:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:14:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:14:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:14:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:14:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:14:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:14:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:14:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:14:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:14:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:14:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:14:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:14:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:14:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:14:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:14:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:14:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:14:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:14:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:14:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 31.593296738999999, 2024-04-26T11:14:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:14:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:14:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:14:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:14:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:14:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:14:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:14:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:14:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:14:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:14:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:14:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:14:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:14:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:14:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:14:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:14:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:14:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:14:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:14:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:14:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:14:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:14:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:14:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:81256 5.8 5:1c0f3fd8:::benchmark_data_smithi029_44842_object81255:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 18.829837189999999, 2024-04-26T11:14:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026193673000000001, 2024-04-26T11:14:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 81256 2024-04-26T11:14:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116073+0000", 2024-04-26T11:14:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0114e-05 2024-04-26T11:14:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116079+0000", 2024-04-26T11:14:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8939999999999998e-06 2024-04-26T11:14:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116082+0000", 2024-04-26T11:14:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:14:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127501+0000", 2024-04-26T11:14:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011418281000000001 2024-04-26T11:14:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127639+0000", 2024-04-26T11:14:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013828899999999999 2024-04-26T11:14:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127782+0000", 2024-04-26T11:14:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014328299999999999 2024-04-26T11:14:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.134767+0000", 2024-04-26T11:14:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0069844140000000004 2024-04-26T11:14:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142160+0000", 2024-04-26T11:14:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007392839 2024-04-26T11:14:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142202+0000", 2024-04-26T11:14:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2797999999999999e-05 2024-04-26T11:14:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142237+0000", 2024-04-26T11:14:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4464000000000001e-05 2024-04-26T11:14:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90441 5.4 5:2b047885:::benchmark_data_smithi029_44842_object90440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 14.79567383, 2024-04-26T11:14:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026164084000000001, 2024-04-26T11:14:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90441 2024-04-26T11:14:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150206+0000", 2024-04-26T11:14:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150261+0000", 2024-04-26T11:14:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4580000000000003e-05 2024-04-26T11:14:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150269+0000", 2024-04-26T11:14:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9679999999999995e-06 2024-04-26T11:14:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150274+0000", 2024-04-26T11:14:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8470000000000003e-06 2024-04-26T11:14:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150312+0000", 2024-04-26T11:14:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7245e-05 2024-04-26T11:14:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150396+0000", 2024-04-26T11:14:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4778999999999996e-05 2024-04-26T11:14:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150491+0000", 2024-04-26T11:14:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4606999999999997e-05 2024-04-26T11:14:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.153991+0000", 2024-04-26T11:14:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035001339999999998 2024-04-26T11:14:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176295+0000", 2024-04-26T11:14:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022304280999999999 2024-04-26T11:14:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176335+0000", 2024-04-26T11:14:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176371+0000", 2024-04-26T11:14:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5448999999999999e-05 2024-04-26T11:14:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101746 5.b 5:dcf04831:::benchmark_data_smithi029_44842_object101745:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.115039+0000", 2024-04-26T11:14:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.8308414820000003, 2024-04-26T11:14:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025752292999999999, 2024-04-26T11:14:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101746 2024-04-26T11:14:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115039+0000", 2024-04-26T11:14:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115039+0000", 2024-04-26T11:14:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115038+0000", 2024-04-26T11:14:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115105+0000", 2024-04-26T11:14:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6908000000000004e-05 2024-04-26T11:14:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115115+0000", 2024-04-26T11:14:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5200000000000003e-06 2024-04-26T11:14:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115122+0000", 2024-04-26T11:14:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5519999999999999e-06 2024-04-26T11:14:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115883+0000", 2024-04-26T11:14:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00076097600000000001 2024-04-26T11:14:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115971+0000", 2024-04-26T11:14:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7771999999999999e-05 2024-04-26T11:14:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.116055+0000", 2024-04-26T11:14:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3963999999999998e-05 2024-04-26T11:14:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.117903+0000", 2024-04-26T11:14:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001847932 2024-04-26T11:14:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140703+0000", 2024-04-26T11:14:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022800276000000001 2024-04-26T11:14:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140755+0000", 2024-04-26T11:14:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2052000000000002e-05 2024-04-26T11:14:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140791+0000", 2024-04-26T11:14:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6060999999999999e-05 2024-04-26T11:14:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101754 5.e 5:7ca15a5c:::benchmark_data_smithi029_44842_object101753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.8273489969999996, 2024-04-26T11:14:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039171048999999999, 2024-04-26T11:14:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101754 2024-04-26T11:14:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118604+0000", 2024-04-26T11:14:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3399000000000007e-05 2024-04-26T11:14:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118613+0000", 2024-04-26T11:14:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6989999999999992e-06 2024-04-26T11:14:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118618+0000", 2024-04-26T11:14:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3850000000000001e-06 2024-04-26T11:14:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118646+0000", 2024-04-26T11:14:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7878e-05 2024-04-26T11:14:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118720+0000", 2024-04-26T11:14:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3461999999999996e-05 2024-04-26T11:14:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118807+0000", 2024-04-26T11:14:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7269999999999996e-05 2024-04-26T11:14:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142317+0000", 2024-04-26T11:14:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023510105999999999 2024-04-26T11:14:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.143287+0000", 2024-04-26T11:14:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096983599999999996 2024-04-26T11:14:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157662+0000", 2024-04-26T11:14:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014375393 2024-04-26T11:14:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157702+0000", 2024-04-26T11:14:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0295e-05 2024-04-26T11:14:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101755 5.f 5:fa973a83:::benchmark_data_smithi029_44842_object101754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.8271833009999998, 2024-04-26T11:14:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039139064000000001, 2024-04-26T11:14:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101755 2024-04-26T11:14:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118696+0000", 2024-04-26T11:14:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118766+0000", 2024-04-26T11:14:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9423000000000003e-05 2024-04-26T11:14:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118774+0000", 2024-04-26T11:14:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9710000000000004e-06 2024-04-26T11:14:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118779+0000", 2024-04-26T11:14:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5629999999999999e-06 2024-04-26T11:14:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118817+0000", 2024-04-26T11:14:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7771000000000001e-05 2024-04-26T11:14:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118929+0000", 2024-04-26T11:14:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011222699999999999 2024-04-26T11:14:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157661+0000", 2024-04-26T11:14:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038731120000000001 2024-04-26T11:14:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157757+0000", 2024-04-26T11:14:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6910000000000006e-05 2024-04-26T11:14:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157836+0000", 2024-04-26T11:14:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8727999999999996e-05 2024-04-26T11:14:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101758 5.4 5:2525a4eb:::benchmark_data_smithi029_44842_object101757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.8250004499999992, 2024-04-26T11:14:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.03686739, 2024-04-26T11:14:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101758 2024-04-26T11:14:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120879+0000", 2024-04-26T11:14:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120971+0000", 2024-04-26T11:14:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2133999999999996e-05 2024-04-26T11:14:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120977+0000", 2024-04-26T11:14:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5509999999999999e-06 2024-04-26T11:14:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120981+0000", 2024-04-26T11:14:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.245e-06 2024-04-26T11:14:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121010+0000", 2024-04-26T11:14:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9084000000000001e-05 2024-04-26T11:14:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121083+0000", 2024-04-26T11:14:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2942999999999996e-05 2024-04-26T11:14:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121163+0000", 2024-04-26T11:14:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0197000000000005e-05 2024-04-26T11:14:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142822+0000", 2024-04-26T11:14:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021658535999999999 2024-04-26T11:14:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157674+0000", 2024-04-26T11:14:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014851573999999999 2024-04-26T11:14:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157714+0000", 2024-04-26T11:14:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0473999999999999e-05 2024-04-26T11:14:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157747+0000", 2024-04-26T11:14:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3278999999999998e-05 2024-04-26T11:14:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101760 5.4 5:2510211a:::benchmark_data_smithi029_44842_object101759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.8245681050000009, 2024-04-26T11:14:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039182383000000001, 2024-04-26T11:14:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101760 2024-04-26T11:14:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121389+0000", 2024-04-26T11:14:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6667000000000003e-05 2024-04-26T11:14:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121394+0000", 2024-04-26T11:14:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0839999999999999e-06 2024-04-26T11:14:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121397+0000", 2024-04-26T11:14:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4489999999999999e-06 2024-04-26T11:14:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122921+0000", 2024-04-26T11:14:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001524067 2024-04-26T11:14:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.123010+0000", 2024-04-26T11:14:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8449000000000006e-05 2024-04-26T11:14:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140838+0000", 2024-04-26T11:14:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017828796000000001 2024-04-26T11:14:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157665+0000", 2024-04-26T11:14:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016826574 2024-04-26T11:14:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160407+0000", 2024-04-26T11:14:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027423970000000002 2024-04-26T11:14:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160456+0000", 2024-04-26T11:14:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8678999999999999e-05 2024-04-26T11:14:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160495+0000", 2024-04-26T11:14:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8658000000000002e-05 2024-04-26T11:14:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101761 5.e 5:70294421:::benchmark_data_smithi029_44842_object101760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.8231437320000001, 2024-04-26T11:14:29.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035270448000000003, 2024-04-26T11:14:29.040 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:29.040 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:29.040 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:29.040 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:29.040 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:29.040 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101761 2024-04-26T11:14:29.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122736+0000", 2024-04-26T11:14:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122805+0000", 2024-04-26T11:14:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9076000000000001e-05 2024-04-26T11:14:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122811+0000", 2024-04-26T11:14:29.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:14:29.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:29.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122815+0000", 2024-04-26T11:14:29.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2860000000000001e-06 2024-04-26T11:14:29.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:29.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122842+0000", 2024-04-26T11:14:29.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6429000000000001e-05 2024-04-26T11:14:29.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:29.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122916+0000", 2024-04-26T11:14:29.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4122999999999995e-05 2024-04-26T11:14:29.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:29.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122997+0000", 2024-04-26T11:14:29.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1428999999999996e-05 2024-04-26T11:14:29.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:29.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142344+0000", 2024-04-26T11:14:29.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019346452 2024-04-26T11:14:29.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:29.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157934+0000", 2024-04-26T11:14:29.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015589911999999999 2024-04-26T11:14:29.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:29.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157975+0000", 2024-04-26T11:14:29.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1604999999999999e-05 2024-04-26T11:14:29.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:29.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.158007+0000", 2024-04-26T11:14:29.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1921000000000002e-05 2024-04-26T11:14:29.045 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:29.046 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:29.046 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:29.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.046 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110145 5.9 5:9b275f16:::benchmark_data_smithi029_44842_object110144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:29.046 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:29.046 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.797582094, 2024-04-26T11:14:29.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032844496000000001, 2024-04-26T11:14:29.046 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:29.046 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:29.046 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:29.046 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:29.047 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:29.047 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110145 2024-04-26T11:14:29.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.047 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:29.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:29.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:29.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:29.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:29.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:29.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:29.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:29.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148297+0000", 2024-04-26T11:14:29.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:29.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:29.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148325+0000", 2024-04-26T11:14:29.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7511000000000001e-05 2024-04-26T11:14:29.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:29.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148338+0000", 2024-04-26T11:14:29.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2808e-05 2024-04-26T11:14:29.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:29.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148345+0000", 2024-04-26T11:14:29.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7200000000000006e-06 2024-04-26T11:14:29.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:29.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149888+0000", 2024-04-26T11:14:29.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001542666 2024-04-26T11:14:29.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:29.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149977+0000", 2024-04-26T11:14:29.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9247999999999997e-05 2024-04-26T11:14:29.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:29.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181006+0000", 2024-04-26T11:14:29.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031028535999999999 2024-04-26T11:14:29.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:29.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181051+0000", 2024-04-26T11:14:29.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5393999999999999e-05 2024-04-26T11:14:29.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:29.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181143+0000", 2024-04-26T11:14:29.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1458000000000004e-05 2024-04-26T11:14:29.051 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:29.051 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:29.051 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:29.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.051 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110155 5.9 5:9ebc6158:::benchmark_data_smithi029_44842_object110154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:29.051 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:29.051 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.7925063019999996, 2024-04-26T11:14:29.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027886826999999999, 2024-04-26T11:14:29.052 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:29.052 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:29.052 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:29.052 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:29.052 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:29.052 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110155 2024-04-26T11:14:29.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.052 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:29.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:29.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:29.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:29.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:29.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:29.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:29.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:29.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153373+0000", 2024-04-26T11:14:29.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:29.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:29.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153479+0000", 2024-04-26T11:14:29.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105728 2024-04-26T11:14:29.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:29.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153491+0000", 2024-04-26T11:14:29.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2207e-05 2024-04-26T11:14:29.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:29.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153499+0000", 2024-04-26T11:14:29.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7729999999999999e-06 2024-04-26T11:14:29.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:29.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153655+0000", 2024-04-26T11:14:29.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015573 2024-04-26T11:14:29.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:29.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153770+0000", 2024-04-26T11:14:29.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011562500000000001 2024-04-26T11:14:29.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:29.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181153+0000", 2024-04-26T11:14:29.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027382113 2024-04-26T11:14:29.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:29.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181195+0000", 2024-04-26T11:14:29.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1921000000000001e-05 2024-04-26T11:14:29.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:29.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181261+0000", 2024-04-26T11:14:29.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6402999999999994e-05 2024-04-26T11:14:29.056 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:29.056 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:29.056 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:29.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.057 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110162 5.9 5:98f89097:::benchmark_data_smithi029_44842_object110161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:29.057 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.156486+0000", 2024-04-26T11:14:29.057 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.7893945489999998, 2024-04-26T11:14:29.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025002745999999999, 2024-04-26T11:14:29.057 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:29.057 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:29.057 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:29.057 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:29.057 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:29.057 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110162 2024-04-26T11:14:29.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.058 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:29.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:29.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.156486+0000", 2024-04-26T11:14:29.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:29.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.058 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:29.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.156486+0000", 2024-04-26T11:14:29.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:29.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:29.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.156485+0000", 2024-04-26T11:14:29.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:29.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:29.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.156517+0000", 2024-04-26T11:14:29.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1958999999999997e-05 2024-04-26T11:14:29.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:29.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.156524+0000", 2024-04-26T11:14:29.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:14:29.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:29.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.156529+0000", 2024-04-26T11:14:29.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8930000000000004e-06 2024-04-26T11:14:29.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:29.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.170559+0000", 2024-04-26T11:14:29.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014030331 2024-04-26T11:14:29.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:29.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.170693+0000", 2024-04-26T11:14:29.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013373000000000001 2024-04-26T11:14:29.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:29.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181386+0000", 2024-04-26T11:14:29.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010693326 2024-04-26T11:14:29.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:29.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181423+0000", 2024-04-26T11:14:29.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6857999999999998e-05 2024-04-26T11:14:29.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:29.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:29.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:29.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181489+0000", 2024-04-26T11:14:29.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5450000000000005e-05 2024-04-26T11:14:29.062 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:29.062 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:29.062 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:29.062 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:29.062 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:29.062 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:29.063 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:29.064 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:29.061+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:29.064 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:29.082 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:29.083 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:29.083 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:29.083 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:29.085 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:29.086 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:29.164 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:29.162+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:29.249 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:29.249 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:29.266 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:29.266 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:29.263+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:29.366 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:29.365+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:29.414 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 51 16 124281 124265 152.272 145.25 0.00665375 0.00656457 2024-04-26T11:14:29.468 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:29.466+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:29.489 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:29.490 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:29.506 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:29.571 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:29.567+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:29.639 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:14:29.669 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:29.667+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:29.690 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:29.690 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:29.705 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:29.770 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:29.768+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:29.871 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:29.869+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:29.881 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:29.881 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:29.894 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:29.973 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:29.971+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:30.073 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:30.072+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:30.110 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:30.110 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:30.124 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:30.210 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:30.207+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:30.275 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:30.273+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:30.334 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:30.334 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:30.349 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:30.391 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:30.389+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:30.414 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 52 16 126538 126522 152.056 141.062 0.00769805 0.00657375 2024-04-26T11:14:30.479 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:30.477+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:30.534 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:30.534 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:30.545 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:30.586 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:30.584+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:30.635 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:14:30.681 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:30.679+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:30.772 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:30.772 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:30.780 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:30.778+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:30.782 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:30.881 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:30.879+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:30.981 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:30.979+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:31.004 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:31.004 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:31.018 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:31.082 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:31.080+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:31.086 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:14:31.183 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:31.181+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:31.187 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:31.187 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:31.201 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:31.241 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:31.262 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:31.262 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:31.262 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:31.262 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:31.264 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:31.265 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:31.286 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:31.285+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:31.386 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:31.384+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:31.410 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:31.410 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:14:31.411 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:14:31.411 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:14:31.411 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:31.414 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 53 16 128764 128748 151.812 139.125 0.00692735 0.00658458 2024-04-26T11:14:31.426 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:31.486 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:31.484+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:31.589 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:31.586+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:31.640 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:31.640 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:14:31.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:14:31.640 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:31.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.641 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:31.641 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:31.641 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.357435285999998, 2024-04-26T11:14:31.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:14:31.641 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:31.641 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:31.641 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:31.641 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:31.641 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.641 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:14:31.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.641 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:31.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:31.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:31.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:31.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:31.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:31.642 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:31.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.642 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:31.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:14:31.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:14:31.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:31.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:14:31.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:14:31.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:14:31.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:14:31.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:14:31.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:14:31.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:31.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:14:31.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:14:31.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:31.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:14:31.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:14:31.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:31.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:14:31.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:14:31.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:31.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:14:31.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:14:31.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:31.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:14:31.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:14:31.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:31.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:14:31.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:14:31.646 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.646 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:31.646 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.646 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:31.646 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:31.646 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.356785584000001, 2024-04-26T11:14:31.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:14:31.647 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:31.647 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:31.647 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:31.647 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:31.647 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.647 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:14:31.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.647 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:31.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:31.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:31.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:31.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:31.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:31.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:14:31.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:31.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:31.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:14:31.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:14:31.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:31.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:14:31.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:14:31.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:14:31.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:14:31.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:14:31.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:14:31.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:31.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:14:31.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:14:31.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:31.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:14:31.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:14:31.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:31.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:14:31.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:14:31.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:31.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:14:31.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:14:31.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:31.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:14:31.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:14:31.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:31.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:14:31.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:14:31.651 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.651 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:31.652 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.652 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:31.652 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:31.652 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.290143544999999, 2024-04-26T11:14:31.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:14:31.652 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:31.652 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:31.652 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:31.652 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:31.652 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.652 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:14:31.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.652 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:31.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:31.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:31.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:31.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:31.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:31.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:14:31.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:31.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:31.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:14:31.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:14:31.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:31.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:14:31.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:14:31.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:14:31.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:14:31.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:14:31.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:14:31.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:31.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:14:31.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:14:31.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:14:31.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:14:31.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:31.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:14:31.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:14:31.656 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.656 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:31.656 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.656 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:31.656 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:31.656 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.290047899000001, 2024-04-26T11:14:31.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:14:31.657 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:31.657 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:31.657 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:31.657 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:31.657 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.657 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:14:31.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.657 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:31.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:31.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:31.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:31.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:31.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:31.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:14:31.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:31.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:14:31.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:14:31.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:31.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:14:31.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:14:31.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:14:31.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:14:31.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:14:31.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:14:31.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:31.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:14:31.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:14:31.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:14:31.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:14:31.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:31.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:14:31.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:14:31.660 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.660 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:31.661 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.661 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:31.661 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:31.661 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.289916220000002, 2024-04-26T11:14:31.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:14:31.661 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:31.661 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:31.661 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:31.661 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:31.661 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.661 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:14:31.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.661 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:31.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:31.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:31.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:31.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:31.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:31.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:31.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:31.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:14:31.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:14:31.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:31.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:14:31.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:14:31.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:14:31.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:14:31.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:14:31.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:14:31.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.664 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:31.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:14:31.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:14:31.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:14:31.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:14:31.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:31.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:14:31.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:14:31.665 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.665 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:31.665 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.666 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:31.666 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:31.666 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.289807764000003, 2024-04-26T11:14:31.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:14:31.666 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:31.666 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:31.666 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:31.666 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:31.666 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.666 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:14:31.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.666 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:31.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:31.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:31.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:31.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:31.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:31.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:14:31.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:31.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:31.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:14:31.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:14:31.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:31.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:14:31.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:14:31.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:14:31.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:14:31.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:14:31.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:14:31.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:31.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:14:31.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:14:31.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:14:31.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:14:31.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.670 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:31.670 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:14:31.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:14:31.670 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.670 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:31.670 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.670 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:31.670 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:31.670 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.289706496000001, 2024-04-26T11:14:31.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:14:31.671 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:31.671 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:31.671 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:31.671 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:31.671 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.671 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:14:31.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.671 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:31.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:31.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:31.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:31.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:31.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:31.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:31.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:31.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:14:31.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:14:31.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:31.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:14:31.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:14:31.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:14:31.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:14:31.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:14:31.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:14:31.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:31.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:14:31.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:14:31.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:14:31.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:14:31.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:31.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:14:31.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:14:31.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:31.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:14:31.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:14:31.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:31.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:14:31.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:14:31.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:31.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:14:31.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:14:31.675 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.676 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:31.676 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.676 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:31.676 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:31.676 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.289637554999999, 2024-04-26T11:14:31.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:14:31.676 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:31.676 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:31.676 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:31.676 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:31.676 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.676 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:14:31.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.677 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:31.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:31.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:31.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:31.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:31.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:31.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:14:31.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:31.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:14:31.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:14:31.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:31.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:14:31.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:14:31.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:14:31.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:14:31.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:14:31.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:14:31.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:31.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:14:31.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:14:31.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:14:31.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:14:31.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:31.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:14:31.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:14:31.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:31.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:14:31.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:14:31.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:31.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:14:31.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:14:31.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:31.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:14:31.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:14:31.681 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.681 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:31.681 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.681 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:31.681 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:31.682 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.283641973999998, 2024-04-26T11:14:31.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:14:31.682 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:31.682 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:31.682 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:31.682 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:31.682 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.682 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:14:31.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.682 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:31.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:31.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:31.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:31.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:31.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:31.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:14:31.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:31.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:14:31.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:14:31.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:31.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:14:31.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:14:31.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:14:31.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:14:31.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:14:31.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:14:31.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:31.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:14:31.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:14:31.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:14:31.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:14:31.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:31.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:14:31.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:14:31.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:31.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:14:31.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:14:31.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:31.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:14:31.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:14:31.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:31.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:14:31.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:14:31.687 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.687 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:31.687 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.687 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:81256 5.8 5:1c0f3fd8:::benchmark_data_smithi029_44842_object81255:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:31.687 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:31.687 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.520182425000002, 2024-04-26T11:14:31.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026193673000000001, 2024-04-26T11:14:31.687 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:31.688 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:31.688 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:31.688 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:31.688 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.688 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 81256 2024-04-26T11:14:31.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.688 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:31.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:31.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:31.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:31.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:31.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:31.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:31.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:31.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116073+0000", 2024-04-26T11:14:31.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0114e-05 2024-04-26T11:14:31.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:31.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116079+0000", 2024-04-26T11:14:31.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8939999999999998e-06 2024-04-26T11:14:31.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116082+0000", 2024-04-26T11:14:31.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:14:31.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127501+0000", 2024-04-26T11:14:31.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011418281000000001 2024-04-26T11:14:31.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:31.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127639+0000", 2024-04-26T11:14:31.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013828899999999999 2024-04-26T11:14:31.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:31.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127782+0000", 2024-04-26T11:14:31.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014328299999999999 2024-04-26T11:14:31.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:31.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.134767+0000", 2024-04-26T11:14:31.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0069844140000000004 2024-04-26T11:14:31.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:31.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142160+0000", 2024-04-26T11:14:31.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007392839 2024-04-26T11:14:31.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:31.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142202+0000", 2024-04-26T11:14:31.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2797999999999999e-05 2024-04-26T11:14:31.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:31.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142237+0000", 2024-04-26T11:14:31.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4464000000000001e-05 2024-04-26T11:14:31.692 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.693 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:31.693 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.693 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90441 5.4 5:2b047885:::benchmark_data_smithi029_44842_object90440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:31.693 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:31.693 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.486019065000001, 2024-04-26T11:14:31.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026164084000000001, 2024-04-26T11:14:31.693 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:31.693 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:31.693 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:31.693 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:31.693 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.693 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90441 2024-04-26T11:14:31.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.694 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:31.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:31.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:31.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:31.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:31.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:31.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150206+0000", 2024-04-26T11:14:31.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:31.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150261+0000", 2024-04-26T11:14:31.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4580000000000003e-05 2024-04-26T11:14:31.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:31.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150269+0000", 2024-04-26T11:14:31.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9679999999999995e-06 2024-04-26T11:14:31.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150274+0000", 2024-04-26T11:14:31.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8470000000000003e-06 2024-04-26T11:14:31.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150312+0000", 2024-04-26T11:14:31.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7245e-05 2024-04-26T11:14:31.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:31.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150396+0000", 2024-04-26T11:14:31.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4778999999999996e-05 2024-04-26T11:14:31.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:31.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150491+0000", 2024-04-26T11:14:31.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4606999999999997e-05 2024-04-26T11:14:31.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:31.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.153991+0000", 2024-04-26T11:14:31.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035001339999999998 2024-04-26T11:14:31.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:31.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176295+0000", 2024-04-26T11:14:31.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022304280999999999 2024-04-26T11:14:31.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:31.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176335+0000", 2024-04-26T11:14:31.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:31.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:31.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176371+0000", 2024-04-26T11:14:31.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5448999999999999e-05 2024-04-26T11:14:31.698 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.698 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:31.698 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.699 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101746 5.b 5:dcf04831:::benchmark_data_smithi029_44842_object101745:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:31.699 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.115039+0000", 2024-04-26T11:14:31.699 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.521186716999999, 2024-04-26T11:14:31.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025752292999999999, 2024-04-26T11:14:31.699 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:31.699 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:31.699 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:31.699 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:31.699 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.699 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101746 2024-04-26T11:14:31.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.699 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:31.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:31.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115039+0000", 2024-04-26T11:14:31.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:31.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115039+0000", 2024-04-26T11:14:31.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:31.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115038+0000", 2024-04-26T11:14:31.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:31.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:31.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115105+0000", 2024-04-26T11:14:31.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6908000000000004e-05 2024-04-26T11:14:31.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:31.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115115+0000", 2024-04-26T11:14:31.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5200000000000003e-06 2024-04-26T11:14:31.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115122+0000", 2024-04-26T11:14:31.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5519999999999999e-06 2024-04-26T11:14:31.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115883+0000", 2024-04-26T11:14:31.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00076097600000000001 2024-04-26T11:14:31.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:31.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.115971+0000", 2024-04-26T11:14:31.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7771999999999999e-05 2024-04-26T11:14:31.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:31.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.116055+0000", 2024-04-26T11:14:31.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3963999999999998e-05 2024-04-26T11:14:31.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:31.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.117903+0000", 2024-04-26T11:14:31.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001847932 2024-04-26T11:14:31.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:31.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140703+0000", 2024-04-26T11:14:31.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022800276000000001 2024-04-26T11:14:31.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:31.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140755+0000", 2024-04-26T11:14:31.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2052000000000002e-05 2024-04-26T11:14:31.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:31.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140791+0000", 2024-04-26T11:14:31.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6060999999999999e-05 2024-04-26T11:14:31.704 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.704 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:31.704 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.704 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101754 5.e 5:7ca15a5c:::benchmark_data_smithi029_44842_object101753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:31.705 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:31.705 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.517694232, 2024-04-26T11:14:31.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039171048999999999, 2024-04-26T11:14:31.705 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:31.705 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:31.705 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:31.705 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:31.705 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.705 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101754 2024-04-26T11:14:31.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.705 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:31.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:31.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:31.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:31.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:31.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:31.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:31.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:31.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118604+0000", 2024-04-26T11:14:31.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3399000000000007e-05 2024-04-26T11:14:31.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:31.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118613+0000", 2024-04-26T11:14:31.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6989999999999992e-06 2024-04-26T11:14:31.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118618+0000", 2024-04-26T11:14:31.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3850000000000001e-06 2024-04-26T11:14:31.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118646+0000", 2024-04-26T11:14:31.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7878e-05 2024-04-26T11:14:31.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:31.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118720+0000", 2024-04-26T11:14:31.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3461999999999996e-05 2024-04-26T11:14:31.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:31.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118807+0000", 2024-04-26T11:14:31.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7269999999999996e-05 2024-04-26T11:14:31.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:31.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142317+0000", 2024-04-26T11:14:31.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023510105999999999 2024-04-26T11:14:31.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:31.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.143287+0000", 2024-04-26T11:14:31.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096983599999999996 2024-04-26T11:14:31.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:31.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157662+0000", 2024-04-26T11:14:31.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014375393 2024-04-26T11:14:31.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:31.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157702+0000", 2024-04-26T11:14:31.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0295e-05 2024-04-26T11:14:31.710 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.710 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:31.710 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.710 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101755 5.f 5:fa973a83:::benchmark_data_smithi029_44842_object101754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:31.710 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:31.710 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.517528536, 2024-04-26T11:14:31.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039139064000000001, 2024-04-26T11:14:31.710 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:31.710 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:31.710 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:31.711 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:31.711 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.711 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101755 2024-04-26T11:14:31.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.711 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:31.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:31.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:31.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:31.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:31.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:31.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118696+0000", 2024-04-26T11:14:31.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:31.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118766+0000", 2024-04-26T11:14:31.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9423000000000003e-05 2024-04-26T11:14:31.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:31.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118774+0000", 2024-04-26T11:14:31.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9710000000000004e-06 2024-04-26T11:14:31.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118779+0000", 2024-04-26T11:14:31.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5629999999999999e-06 2024-04-26T11:14:31.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118817+0000", 2024-04-26T11:14:31.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7771000000000001e-05 2024-04-26T11:14:31.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:31.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118929+0000", 2024-04-26T11:14:31.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011222699999999999 2024-04-26T11:14:31.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:31.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157661+0000", 2024-04-26T11:14:31.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038731120000000001 2024-04-26T11:14:31.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:31.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157757+0000", 2024-04-26T11:14:31.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6910000000000006e-05 2024-04-26T11:14:31.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:31.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157836+0000", 2024-04-26T11:14:31.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8727999999999996e-05 2024-04-26T11:14:31.715 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.715 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:31.715 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.715 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101758 5.4 5:2525a4eb:::benchmark_data_smithi029_44842_object101757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:31.715 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:31.715 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.515345685, 2024-04-26T11:14:31.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.03686739, 2024-04-26T11:14:31.716 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:31.716 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:31.716 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:31.716 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:31.716 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.716 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101758 2024-04-26T11:14:31.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.716 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:31.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:31.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:31.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:31.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:31.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:31.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120879+0000", 2024-04-26T11:14:31.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:31.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120971+0000", 2024-04-26T11:14:31.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2133999999999996e-05 2024-04-26T11:14:31.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:31.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120977+0000", 2024-04-26T11:14:31.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5509999999999999e-06 2024-04-26T11:14:31.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120981+0000", 2024-04-26T11:14:31.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.245e-06 2024-04-26T11:14:31.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121010+0000", 2024-04-26T11:14:31.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9084000000000001e-05 2024-04-26T11:14:31.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:31.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121083+0000", 2024-04-26T11:14:31.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2942999999999996e-05 2024-04-26T11:14:31.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:31.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121163+0000", 2024-04-26T11:14:31.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0197000000000005e-05 2024-04-26T11:14:31.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:31.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142822+0000", 2024-04-26T11:14:31.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021658535999999999 2024-04-26T11:14:31.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:31.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157674+0000", 2024-04-26T11:14:31.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014851573999999999 2024-04-26T11:14:31.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:31.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157714+0000", 2024-04-26T11:14:31.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0473999999999999e-05 2024-04-26T11:14:31.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:31.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157747+0000", 2024-04-26T11:14:31.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3278999999999998e-05 2024-04-26T11:14:31.721 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.721 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:31.721 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.721 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101760 5.4 5:2510211a:::benchmark_data_smithi029_44842_object101759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:31.721 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:31.721 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.51491334, 2024-04-26T11:14:31.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039182383000000001, 2024-04-26T11:14:31.721 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:31.721 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:31.722 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:31.722 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:31.722 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.722 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101760 2024-04-26T11:14:31.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.722 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:31.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:31.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:31.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:31.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:31.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:31.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:31.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:31.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121389+0000", 2024-04-26T11:14:31.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6667000000000003e-05 2024-04-26T11:14:31.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:31.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121394+0000", 2024-04-26T11:14:31.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0839999999999999e-06 2024-04-26T11:14:31.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121397+0000", 2024-04-26T11:14:31.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4489999999999999e-06 2024-04-26T11:14:31.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122921+0000", 2024-04-26T11:14:31.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001524067 2024-04-26T11:14:31.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:31.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.123010+0000", 2024-04-26T11:14:31.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8449000000000006e-05 2024-04-26T11:14:31.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:31.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140838+0000", 2024-04-26T11:14:31.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017828796000000001 2024-04-26T11:14:31.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:31.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157665+0000", 2024-04-26T11:14:31.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016826574 2024-04-26T11:14:31.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:31.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160407+0000", 2024-04-26T11:14:31.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027423970000000002 2024-04-26T11:14:31.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:31.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160456+0000", 2024-04-26T11:14:31.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8678999999999999e-05 2024-04-26T11:14:31.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:31.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160495+0000", 2024-04-26T11:14:31.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8658000000000002e-05 2024-04-26T11:14:31.726 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.726 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:31.726 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.727 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101761 5.e 5:70294421:::benchmark_data_smithi029_44842_object101760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:31.727 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:31.727 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.513488967000001, 2024-04-26T11:14:31.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035270448000000003, 2024-04-26T11:14:31.727 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:31.727 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:31.727 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:31.727 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:31.727 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.727 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101761 2024-04-26T11:14:31.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.728 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:31.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:31.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:31.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:31.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:31.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:31.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122736+0000", 2024-04-26T11:14:31.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:31.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122805+0000", 2024-04-26T11:14:31.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9076000000000001e-05 2024-04-26T11:14:31.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:31.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122811+0000", 2024-04-26T11:14:31.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:14:31.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122815+0000", 2024-04-26T11:14:31.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2860000000000001e-06 2024-04-26T11:14:31.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122842+0000", 2024-04-26T11:14:31.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6429000000000001e-05 2024-04-26T11:14:31.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:31.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122916+0000", 2024-04-26T11:14:31.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4122999999999995e-05 2024-04-26T11:14:31.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:31.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122997+0000", 2024-04-26T11:14:31.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1428999999999996e-05 2024-04-26T11:14:31.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:31.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142344+0000", 2024-04-26T11:14:31.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019346452 2024-04-26T11:14:31.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:31.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157934+0000", 2024-04-26T11:14:31.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015589911999999999 2024-04-26T11:14:31.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:31.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157975+0000", 2024-04-26T11:14:31.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1604999999999999e-05 2024-04-26T11:14:31.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:31.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.158007+0000", 2024-04-26T11:14:31.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1921000000000002e-05 2024-04-26T11:14:31.732 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.732 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:31.732 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.732 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110145 5.9 5:9b275f16:::benchmark_data_smithi029_44842_object110144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:31.733 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:31.733 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.4879273289999997, 2024-04-26T11:14:31.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032844496000000001, 2024-04-26T11:14:31.733 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:31.733 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:31.733 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:31.733 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:31.733 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.733 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110145 2024-04-26T11:14:31.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.733 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:31.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:31.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:31.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:31.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:31.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:31.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148297+0000", 2024-04-26T11:14:31.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:31.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:31.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148325+0000", 2024-04-26T11:14:31.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7511000000000001e-05 2024-04-26T11:14:31.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:31.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148338+0000", 2024-04-26T11:14:31.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2808e-05 2024-04-26T11:14:31.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148345+0000", 2024-04-26T11:14:31.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7200000000000006e-06 2024-04-26T11:14:31.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149888+0000", 2024-04-26T11:14:31.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001542666 2024-04-26T11:14:31.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:31.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149977+0000", 2024-04-26T11:14:31.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9247999999999997e-05 2024-04-26T11:14:31.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:31.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181006+0000", 2024-04-26T11:14:31.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031028535999999999 2024-04-26T11:14:31.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:31.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181051+0000", 2024-04-26T11:14:31.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5393999999999999e-05 2024-04-26T11:14:31.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:31.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181143+0000", 2024-04-26T11:14:31.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1458000000000004e-05 2024-04-26T11:14:31.737 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.737 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:31.737 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.737 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110155 5.9 5:9ebc6158:::benchmark_data_smithi029_44842_object110154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:31.737 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:31.738 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.4828515370000002, 2024-04-26T11:14:31.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027886826999999999, 2024-04-26T11:14:31.738 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:31.738 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:31.738 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:31.738 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:31.738 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.738 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110155 2024-04-26T11:14:31.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.738 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:31.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:31.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:31.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:31.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:31.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:31.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153373+0000", 2024-04-26T11:14:31.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:31.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153479+0000", 2024-04-26T11:14:31.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105728 2024-04-26T11:14:31.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:31.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153491+0000", 2024-04-26T11:14:31.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2207e-05 2024-04-26T11:14:31.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153499+0000", 2024-04-26T11:14:31.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7729999999999999e-06 2024-04-26T11:14:31.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153655+0000", 2024-04-26T11:14:31.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015573 2024-04-26T11:14:31.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:31.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153770+0000", 2024-04-26T11:14:31.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011562500000000001 2024-04-26T11:14:31.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:31.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181153+0000", 2024-04-26T11:14:31.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027382113 2024-04-26T11:14:31.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:31.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181195+0000", 2024-04-26T11:14:31.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1921000000000001e-05 2024-04-26T11:14:31.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:31.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181261+0000", 2024-04-26T11:14:31.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6402999999999994e-05 2024-04-26T11:14:31.742 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.742 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:31.742 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.742 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110162 5.9 5:98f89097:::benchmark_data_smithi029_44842_object110161:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:31.742 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.156486+0000", 2024-04-26T11:14:31.742 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.4797397839999995, 2024-04-26T11:14:31.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.025002745999999999, 2024-04-26T11:14:31.743 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:31.743 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:31.743 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:31.743 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:31.743 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.743 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110162 2024-04-26T11:14:31.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.743 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:31.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:31.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.156486+0000", 2024-04-26T11:14:31.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:31.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.156486+0000", 2024-04-26T11:14:31.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:31.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:31.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.156485+0000", 2024-04-26T11:14:31.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:31.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.156517+0000", 2024-04-26T11:14:31.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1958999999999997e-05 2024-04-26T11:14:31.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:31.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.156524+0000", 2024-04-26T11:14:31.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6599999999999998e-06 2024-04-26T11:14:31.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.156529+0000", 2024-04-26T11:14:31.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8930000000000004e-06 2024-04-26T11:14:31.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:31.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.170559+0000", 2024-04-26T11:14:31.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014030331 2024-04-26T11:14:31.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:31.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.170693+0000", 2024-04-26T11:14:31.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013373000000000001 2024-04-26T11:14:31.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:31.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181386+0000", 2024-04-26T11:14:31.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.010693326 2024-04-26T11:14:31.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:31.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181423+0000", 2024-04-26T11:14:31.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6857999999999998e-05 2024-04-26T11:14:31.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:31.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:31.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:31.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181489+0000", 2024-04-26T11:14:31.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5450000000000005e-05 2024-04-26T11:14:31.747 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.747 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:31.747 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.747 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:31.747 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:31.747 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:31.749 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:31.746+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:31.749 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:31.849 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:31.848+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:31.936 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:31.936 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:31.936 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.937 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:129960 5.c 5:3903ffc8:::benchmark_data_smithi029_44842_object129959:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:31.937 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:31.923071+0000", 2024-04-26T11:14:31.937 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.011256379, 2024-04-26T11:14:31.937 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011286559, 2024-04-26T11:14:31.937 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:31.937 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:31.937 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:31.937 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:31.937 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.937 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 129960 2024-04-26T11:14:31.937 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.937 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:31.937 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.937 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:31.938 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.923071+0000", 2024-04-26T11:14:31.938 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.938 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.938 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.938 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:31.938 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.923071+0000", 2024-04-26T11:14:31.938 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.938 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.938 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.938 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:31.938 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.923070+0000", 2024-04-26T11:14:31.938 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.938 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.938 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.939 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:31.939 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.923153+0000", 2024-04-26T11:14:31.939 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2573999999999999e-05 2024-04-26T11:14:31.939 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.939 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.939 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:31.939 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.923158+0000", 2024-04-26T11:14:31.939 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.9660000000000004e-06 2024-04-26T11:14:31.939 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.939 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.939 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.939 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.923161+0000", 2024-04-26T11:14:31.939 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.444e-06 2024-04-26T11:14:31.939 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.940 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.940 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:31.940 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.923198+0000", 2024-04-26T11:14:31.940 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6185e-05 2024-04-26T11:14:31.940 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.940 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.940 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:31.940 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.923313+0000", 2024-04-26T11:14:31.940 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011558800000000001 2024-04-26T11:14:31.940 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.940 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:31.940 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.941 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.941 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.941 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:129962 5.c 5:32192c1d:::benchmark_data_smithi029_44842_object129961:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:31.941 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:31.923708+0000", 2024-04-26T11:14:31.941 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.010619452, 2024-04-26T11:14:31.941 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.010728125, 2024-04-26T11:14:31.941 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:31.941 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:31.941 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:31.941 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:31.941 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.941 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 129962 2024-04-26T11:14:31.941 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.941 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:31.942 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.942 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:31.942 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.923708+0000", 2024-04-26T11:14:31.942 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.942 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.942 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.942 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:31.942 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.923708+0000", 2024-04-26T11:14:31.942 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.942 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.942 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.942 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:31.942 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.923707+0000", 2024-04-26T11:14:31.943 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.943 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.943 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.943 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:31.943 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.923762+0000", 2024-04-26T11:14:31.943 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4744000000000003e-05 2024-04-26T11:14:31.943 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.943 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.943 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:31.943 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.923772+0000", 2024-04-26T11:14:31.943 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.8349999999999999e-06 2024-04-26T11:14:31.943 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.943 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.943 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.944 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.923780+0000", 2024-04-26T11:14:31.944 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5120000000000008e-06 2024-04-26T11:14:31.944 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.944 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.944 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:31.944 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.925052+0000", 2024-04-26T11:14:31.944 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0012720889999999999 2024-04-26T11:14:31.944 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.944 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.944 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:31.944 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.925174+0000", 2024-04-26T11:14:31.944 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000121913 2024-04-26T11:14:31.944 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.944 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:31.945 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.945 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.945 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.945 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:129966 5.c 5:31001ad4:::benchmark_data_smithi029_44842_object129965:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:31.945 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:31.925288+0000", 2024-04-26T11:14:31.945 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0090387680000000008, 2024-04-26T11:14:31.945 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0092310350000000003, 2024-04-26T11:14:31.945 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:31.945 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:31.945 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:31.945 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:31.945 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.945 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 129966 2024-04-26T11:14:31.945 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.946 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:31.946 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.946 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:31.946 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.925288+0000", 2024-04-26T11:14:31.946 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.946 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.946 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.946 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:31.946 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.925288+0000", 2024-04-26T11:14:31.946 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.946 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.946 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.946 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:31.947 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.925288+0000", 2024-04-26T11:14:31.947 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.947 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.947 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.947 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:31.947 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.925442+0000", 2024-04-26T11:14:31.947 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015433800000000001 2024-04-26T11:14:31.947 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.947 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.947 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:31.947 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.925453+0000", 2024-04-26T11:14:31.947 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.132e-05 2024-04-26T11:14:31.947 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.947 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.947 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.948 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.925461+0000", 2024-04-26T11:14:31.948 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4569999999999999e-06 2024-04-26T11:14:31.948 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.948 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.948 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:31.948 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.927153+0000", 2024-04-26T11:14:31.948 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001692367 2024-04-26T11:14:31.948 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.948 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.948 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:31.948 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.927346+0000", 2024-04-26T11:14:31.948 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000193272 2024-04-26T11:14:31.948 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.948 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:31.948 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.949 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.949 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.949 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:129969 5.c 5:39fef329:::benchmark_data_smithi029_44842_object129968:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:31.949 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:31.926457+0000", 2024-04-26T11:14:31.949 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0078704229999999997, 2024-04-26T11:14:31.949 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.008147919, 2024-04-26T11:14:31.949 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:31.949 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:31.949 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:31.949 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:31.949 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.949 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 129969 2024-04-26T11:14:31.949 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.949 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:31.949 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.950 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:31.950 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.926457+0000", 2024-04-26T11:14:31.950 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.950 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.950 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.950 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:31.950 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.926457+0000", 2024-04-26T11:14:31.950 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.950 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.950 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.950 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:31.950 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.926456+0000", 2024-04-26T11:14:31.950 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:31.950 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.951 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.951 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:31.951 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.926567+0000", 2024-04-26T11:14:31.951 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000111544 2024-04-26T11:14:31.951 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.951 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.951 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:31.951 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.926580+0000", 2024-04-26T11:14:31.951 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2388999999999999e-05 2024-04-26T11:14:31.951 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.951 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.951 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.951 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.926586+0000", 2024-04-26T11:14:31.951 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7460000000000003e-06 2024-04-26T11:14:31.952 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.952 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.952 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:31.952 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.929281+0000", 2024-04-26T11:14:31.952 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026946729999999999 2024-04-26T11:14:31.952 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.952 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.952 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:31.952 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.929468+0000", 2024-04-26T11:14:31.952 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000186925 2024-04-26T11:14:31.952 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.952 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:31.952 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.952 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.952 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.953 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:129974 5.c 5:30ceb4a8:::benchmark_data_smithi029_44842_object129973:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:31.953 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:31.928118+0000", 2024-04-26T11:14:31.953 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0062089939999999998, 2024-04-26T11:14:31.953 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0065704420000000001, 2024-04-26T11:14:31.953 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:31.953 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:31.953 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:31.953 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:31.953 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.953 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 129974 2024-04-26T11:14:31.953 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.953 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:31.953 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.954 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:31.954 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.928118+0000", 2024-04-26T11:14:31.954 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.954 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.954 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.954 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:31.954 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.928118+0000", 2024-04-26T11:14:31.954 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.954 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.954 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.954 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:31.954 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.928117+0000", 2024-04-26T11:14:31.954 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:31.955 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.955 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.955 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:31.955 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.928219+0000", 2024-04-26T11:14:31.955 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000101945 2024-04-26T11:14:31.955 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.955 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.955 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:31.955 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.928229+0000", 2024-04-26T11:14:31.955 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.9539999999999999e-06 2024-04-26T11:14:31.955 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.955 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.955 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.955 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.928236+0000", 2024-04-26T11:14:31.955 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1199999999999996e-06 2024-04-26T11:14:31.956 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.956 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.956 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:31.956 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.933026+0000", 2024-04-26T11:14:31.956 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0047896550000000003 2024-04-26T11:14:31.956 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.956 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.956 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:31.956 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.933151+0000", 2024-04-26T11:14:31.956 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012458099999999999 2024-04-26T11:14:31.956 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.956 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:31.956 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.956 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.957 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.957 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:129975 5.e e40/16 5:766588db:::benchmark_data_smithi029_44842_object129974:head v 40'8113, mlcod=40'8110)", 2024-04-26T11:14:31.957 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:31.929891+0000", 2024-04-26T11:14:31.957 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0044362050000000004, 2024-04-26T11:14:31.957 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0048631150000000003, 2024-04-26T11:14:31.957 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:31.957 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:31.957 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:31.957 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.957 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:31.957 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.929891+0000", 2024-04-26T11:14:31.957 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.957 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.957 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.958 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:31.958 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.929891+0000", 2024-04-26T11:14:31.958 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.958 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.958 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.958 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:31.958 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.929890+0000", 2024-04-26T11:14:31.958 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:31.958 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.958 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.958 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:31.958 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930018+0000", 2024-04-26T11:14:31.958 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000127875 2024-04-26T11:14:31.958 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.959 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.959 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:31.959 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930026+0000", 2024-04-26T11:14:31.959 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4400000000000005e-06 2024-04-26T11:14:31.959 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.959 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.959 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.959 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930034+0000", 2024-04-26T11:14:31.959 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6459999999999993e-06 2024-04-26T11:14:31.959 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.959 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.959 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:31.959 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930075+0000", 2024-04-26T11:14:31.959 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0614000000000001e-05 2024-04-26T11:14:31.959 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.959 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.960 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:31.960 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930092+0000", 2024-04-26T11:14:31.960 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7243000000000001e-05 2024-04-26T11:14:31.960 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.960 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:31.960 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.960 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.960 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.960 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:129979 5.7 5:e7d2d054:::benchmark_data_smithi029_44842_object129978:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:31.960 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:31.930306+0000", 2024-04-26T11:14:31.960 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0040207970000000004, 2024-04-26T11:14:31.960 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0044847769999999997, 2024-04-26T11:14:31.960 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:31.960 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:31.960 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:31.961 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:31.961 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.961 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 129979 2024-04-26T11:14:31.961 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.961 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:31.961 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.961 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:31.961 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930306+0000", 2024-04-26T11:14:31.961 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.961 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.961 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.961 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:31.961 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930306+0000", 2024-04-26T11:14:31.961 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.961 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.962 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.962 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:31.962 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930306+0000", 2024-04-26T11:14:31.962 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.962 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.962 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.962 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:31.962 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930375+0000", 2024-04-26T11:14:31.962 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8805000000000003e-05 2024-04-26T11:14:31.962 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.962 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.962 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:31.962 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930384+0000", 2024-04-26T11:14:31.963 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.8650000000000007e-06 2024-04-26T11:14:31.963 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.963 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.963 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.963 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930391+0000", 2024-04-26T11:14:31.963 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4070000000000004e-06 2024-04-26T11:14:31.963 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.963 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.963 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:31.963 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930419+0000", 2024-04-26T11:14:31.963 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8098000000000001e-05 2024-04-26T11:14:31.963 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.963 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.963 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:31.963 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930524+0000", 2024-04-26T11:14:31.964 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010514399999999999 2024-04-26T11:14:31.964 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.964 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:31.964 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.964 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.964 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.964 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:129977 5.4 e40/16 5:2de03f70:::benchmark_data_smithi029_44842_object129976:head v 40'8045, mlcod=40'8043)", 2024-04-26T11:14:31.964 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:31.930356+0000", 2024-04-26T11:14:31.964 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0039708699999999996, 2024-04-26T11:14:31.964 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0044780419999999998, 2024-04-26T11:14:31.964 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:31.964 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:31.964 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:31.964 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.965 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:31.965 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930356+0000", 2024-04-26T11:14:31.965 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.965 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.965 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.965 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:31.965 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930356+0000", 2024-04-26T11:14:31.965 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.965 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.965 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.965 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:31.965 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930356+0000", 2024-04-26T11:14:31.965 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.965 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.966 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.966 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:31.966 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930540+0000", 2024-04-26T11:14:31.966 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000184069 2024-04-26T11:14:31.966 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.966 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.966 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:31.966 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930551+0000", 2024-04-26T11:14:31.966 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0720000000000001e-05 2024-04-26T11:14:31.966 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.966 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.966 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.966 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930557+0000", 2024-04-26T11:14:31.966 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1859999999999997e-06 2024-04-26T11:14:31.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.967 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.967 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:31.967 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.931677+0000", 2024-04-26T11:14:31.967 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001120364 2024-04-26T11:14:31.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.967 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.967 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:31.967 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.931698+0000", 2024-04-26T11:14:31.967 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1302e-05 2024-04-26T11:14:31.967 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.967 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:31.967 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.967 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.968 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:129978 5.a e40/31 5:59c709d6:::benchmark_data_smithi029_44842_object129977:head v 40'8222, mlcod=40'8220)", 2024-04-26T11:14:31.968 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:31.930563+0000", 2024-04-26T11:14:31.968 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0037640130000000001, 2024-04-26T11:14:31.968 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0043037880000000002, 2024-04-26T11:14:31.968 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:31.968 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:31.968 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:31.968 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.968 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:31.968 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930563+0000", 2024-04-26T11:14:31.968 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.968 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.968 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.968 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:31.969 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930563+0000", 2024-04-26T11:14:31.969 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.969 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.969 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.969 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:31.969 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930563+0000", 2024-04-26T11:14:31.969 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.969 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.969 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.969 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:31.969 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930620+0000", 2024-04-26T11:14:31.969 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6954999999999999e-05 2024-04-26T11:14:31.969 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.969 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.970 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:31.970 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930626+0000", 2024-04-26T11:14:31.970 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7050000000000002e-06 2024-04-26T11:14:31.970 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.970 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.970 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.970 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930632+0000", 2024-04-26T11:14:31.970 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6450000000000002e-06 2024-04-26T11:14:31.970 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.970 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.970 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:31.970 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.931971+0000", 2024-04-26T11:14:31.970 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001338679 2024-04-26T11:14:31.970 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.970 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.971 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:31.971 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.931989+0000", 2024-04-26T11:14:31.971 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7929999999999999e-05 2024-04-26T11:14:31.971 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.971 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:31.971 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.971 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.971 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.971 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:129980 5.6 5:69616478:::benchmark_data_smithi029_44842_object129979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:31.971 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:31.930496+0000", 2024-04-26T11:14:31.971 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00383074, 2024-04-26T11:14:31.971 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0044054690000000004, 2024-04-26T11:14:31.971 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:31.971 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:31.971 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:31.972 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:31.972 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.972 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 129980 2024-04-26T11:14:31.972 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.972 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:31.972 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.972 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:31.972 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930496+0000", 2024-04-26T11:14:31.972 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.972 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.972 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.972 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:31.972 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930496+0000", 2024-04-26T11:14:31.972 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.972 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.973 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.973 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:31.973 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.930496+0000", 2024-04-26T11:14:31.973 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:31.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.973 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.973 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:31.973 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.931091+0000", 2024-04-26T11:14:31.973 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000595438 2024-04-26T11:14:31.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.973 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.973 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:31.973 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.931102+0000", 2024-04-26T11:14:31.973 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1001e-05 2024-04-26T11:14:31.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.974 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.974 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.974 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.931109+0000", 2024-04-26T11:14:31.974 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9750000000000001e-06 2024-04-26T11:14:31.974 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.974 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.974 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:31.974 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.931146+0000", 2024-04-26T11:14:31.974 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7302999999999998e-05 2024-04-26T11:14:31.974 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.974 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.974 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:31.974 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.931270+0000", 2024-04-26T11:14:31.974 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000123891 2024-04-26T11:14:31.974 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.975 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:31.975 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.975 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.975 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:129982 5.3 5:c0d1a0f1:::benchmark_data_smithi029_44842_object129981:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:31.975 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:31.931119+0000", 2024-04-26T11:14:31.975 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0032086250000000001, 2024-04-26T11:14:31.975 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0038212139999999999, 2024-04-26T11:14:31.975 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:31.975 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:31.975 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:31.975 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:31.975 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:31.975 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 129982 2024-04-26T11:14:31.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.976 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:31.976 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.976 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:31.976 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.931119+0000", 2024-04-26T11:14:31.976 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.976 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.976 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:31.976 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.931119+0000", 2024-04-26T11:14:31.976 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.976 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.976 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:31.976 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.931118+0000", 2024-04-26T11:14:31.977 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.977 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.977 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:31.977 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.931143+0000", 2024-04-26T11:14:31.977 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5275000000000001e-05 2024-04-26T11:14:31.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.977 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.977 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:31.977 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.931150+0000", 2024-04-26T11:14:31.977 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8040000000000004e-06 2024-04-26T11:14:31.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.977 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.977 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.978 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.931155+0000", 2024-04-26T11:14:31.978 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2360000000000004e-06 2024-04-26T11:14:31.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.978 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.978 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:31.978 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.931191+0000", 2024-04-26T11:14:31.978 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5989999999999999e-05 2024-04-26T11:14:31.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.978 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.978 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:31.978 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.931318+0000", 2024-04-26T11:14:31.978 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012666700000000001 2024-04-26T11:14:31.978 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.978 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:31.979 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.979 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.979 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:129981 5.4 e40/16)", 2024-04-26T11:14:31.979 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:31.932232+0000", 2024-04-26T11:14:31.979 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0020955269999999998, 2024-04-26T11:14:31.979 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0027418030000000001, 2024-04-26T11:14:31.979 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:31.979 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:31.979 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:31.979 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.979 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:31.979 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.932232+0000", 2024-04-26T11:14:31.979 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.980 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:31.980 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.932232+0000", 2024-04-26T11:14:31.980 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.980 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:31.980 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.932231+0000", 2024-04-26T11:14:31.980 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.980 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:31.980 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.932275+0000", 2024-04-26T11:14:31.980 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4363000000000002e-05 2024-04-26T11:14:31.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.981 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.981 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:31.981 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.932284+0000", 2024-04-26T11:14:31.981 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6999999999999997e-06 2024-04-26T11:14:31.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.981 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.981 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.981 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.932291+0000", 2024-04-26T11:14:31.981 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3960000000000003e-06 2024-04-26T11:14:31.981 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.981 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:31.981 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.982 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.982 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:129985 5.a e40/31 5:555bfa08:::benchmark_data_smithi029_44842_object129984:head v 40'8223, mlcod=40'8220)", 2024-04-26T11:14:31.982 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:31.934436+0000", 2024-04-26T11:14:31.982 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9998908, 2024-04-26T11:14:31.982 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00056392900000000001, 2024-04-26T11:14:31.982 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:31.982 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:31.982 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:31.982 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.982 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:31.982 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.934436+0000", 2024-04-26T11:14:31.982 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.982 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.983 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:31.983 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.934436+0000", 2024-04-26T11:14:31.983 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.983 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:31.983 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.934436+0000", 2024-04-26T11:14:31.983 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.983 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:31.983 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.934483+0000", 2024-04-26T11:14:31.983 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7046999999999999e-05 2024-04-26T11:14:31.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.984 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:31.984 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.934494+0000", 2024-04-26T11:14:31.984 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.099e-05 2024-04-26T11:14:31.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.984 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.984 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.934501+0000", 2024-04-26T11:14:31.984 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9e-06 2024-04-26T11:14:31.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.984 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:31.984 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.934532+0000", 2024-04-26T11:14:31.985 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1548999999999999e-05 2024-04-26T11:14:31.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.985 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.985 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:31.985 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.934553+0000", 2024-04-26T11:14:31.985 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.092e-05 2024-04-26T11:14:31.985 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.985 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:31.985 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.985 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.985 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:129986 5.b e40/16 5:dc8e76f8:::benchmark_data_smithi029_44842_object129985:head v 40'8269, mlcod=40'8267)", 2024-04-26T11:14:31.985 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:31.934617+0000", 2024-04-26T11:14:31.985 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9997101, 2024-04-26T11:14:31.985 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000416067, 2024-04-26T11:14:31.986 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:31.986 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:31.986 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:31.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.986 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:31.986 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.934617+0000", 2024-04-26T11:14:31.986 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.986 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:31.986 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.934617+0000", 2024-04-26T11:14:31.986 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:31.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.987 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:31.987 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.934617+0000", 2024-04-26T11:14:31.987 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:31.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.987 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:31.987 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.934682+0000", 2024-04-26T11:14:31.987 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4929000000000001e-05 2024-04-26T11:14:31.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.987 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:31.987 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.934691+0000", 2024-04-26T11:14:31.987 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6080000000000002e-06 2024-04-26T11:14:31.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.988 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.988 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:31.988 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.934699+0000", 2024-04-26T11:14:31.988 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5220000000000001e-06 2024-04-26T11:14:31.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.988 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.988 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:31.988 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.934735+0000", 2024-04-26T11:14:31.988 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5995999999999999e-05 2024-04-26T11:14:31.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:31.988 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:31.988 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:31.988 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.934753+0000", 2024-04-26T11:14:31.988 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.806e-05 2024-04-26T11:14:31.988 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.988 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:31.989 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.989 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:31.989 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:14:31.989 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 14 2024-04-26T11:14:31.989 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:31.990 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:31.988+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:31.993 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:32.090 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:32.088+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:32.170 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:32.170 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:14:32.170 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:14:32.171 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:14:32.171 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:32.185 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:32.226 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:32.224+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:32.293 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:32.291+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:32.393 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:32.391+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:32.400 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:32.400 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:14:32.400 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:14:32.400 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:32.400 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.400 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:32.400 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:32.400 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 39.126380662000003, 2024-04-26T11:14:32.401 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:14:32.401 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:32.401 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:32.401 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:32.401 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:32.401 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.401 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:14:32.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.401 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:32.401 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.401 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:32.401 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:32.401 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.402 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.402 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:32.402 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:32.402 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.402 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.402 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:32.402 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:14:32.402 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:32.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.402 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.402 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:32.402 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:14:32.402 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:14:32.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.403 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.403 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:32.403 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:14:32.403 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:14:32.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.403 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.403 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.403 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:14:32.403 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:14:32.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.403 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.403 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.403 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:14:32.403 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:14:32.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.405 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.405 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:32.405 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:14:32.405 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:14:32.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.405 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.406 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:32.406 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:14:32.406 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:14:32.406 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.406 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.406 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:32.406 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:14:32.406 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:14:32.406 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.406 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.406 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:32.406 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:14:32.406 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:14:32.406 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.407 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.407 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:32.407 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:14:32.407 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:14:32.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.407 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.407 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:32.407 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:14:32.407 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:14:32.407 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.407 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:32.407 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.407 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.408 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:32.408 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:32.408 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 39.125569097000003, 2024-04-26T11:14:32.408 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:14:32.408 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:32.408 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:32.408 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:32.408 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:32.408 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.408 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:14:32.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.408 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:32.408 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.408 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:32.408 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:32.409 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.409 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.409 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:32.409 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:32.409 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.409 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.409 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:32.409 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:32.409 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:32.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.409 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.409 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:32.409 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:14:32.409 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:14:32.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.410 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.410 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:32.410 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:14:32.410 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:14:32.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.410 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.410 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.410 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:14:32.410 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:14:32.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.410 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.410 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.410 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:14:32.411 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:14:32.411 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.411 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.411 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:32.411 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:14:32.411 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:14:32.411 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.411 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.411 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:32.411 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:14:32.411 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:14:32.411 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.411 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.411 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:32.411 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:14:32.411 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:14:32.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.412 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.412 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:32.412 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:14:32.412 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:14:32.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.412 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.412 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:32.412 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:14:32.412 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:14:32.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.412 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.412 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:32.412 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:14:32.412 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:14:32.413 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.413 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:32.413 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.413 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.413 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.413 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:32.413 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:32.413 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 39.118382259999997, 2024-04-26T11:14:32.413 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:14:32.413 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:32.413 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:32.413 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:32.413 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:32.413 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.414 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:14:32.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.414 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:32.414 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.414 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:32.414 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:32.414 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.414 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.414 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:32.414 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:32.414 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.414 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.415 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:32.415 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:14:32.415 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:32.415 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.415 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.415 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:32.415 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:14:32.415 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:14:32.415 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.415 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.415 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:32.415 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:14:32.415 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:14:32.415 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.416 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.416 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.416 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:14:32.416 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:14:32.416 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.416 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.416 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.416 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:14:32.416 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:14:32.416 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.416 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.416 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:32.416 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:14:32.416 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:14:32.416 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.417 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.417 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:32.417 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:14:32.417 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:14:32.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.417 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.417 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:32.417 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:14:32.417 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:14:32.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.417 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.417 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:32.417 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:14:32.417 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:14:32.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.418 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.418 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:32.418 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:14:32.418 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:14:32.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.418 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.418 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:32.418 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:14:32.418 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:14:32.418 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.418 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:32.418 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.418 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.418 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:32.419 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:32.419 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 39.117841380999998, 2024-04-26T11:14:32.419 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:14:32.419 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:32.419 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:32.419 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:32.419 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:32.419 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.419 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:14:32.419 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.419 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:32.419 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.419 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:32.419 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:32.419 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.420 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.420 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:32.420 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:32.420 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.420 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.420 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:32.420 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:32.420 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:32.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.420 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.420 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:32.420 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:14:32.420 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:14:32.421 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.421 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.421 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:32.421 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:14:32.421 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:14:32.421 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.421 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.421 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.421 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:14:32.421 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:14:32.421 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.421 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.421 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.421 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:14:32.421 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:14:32.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.422 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.422 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:32.422 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:14:32.422 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:14:32.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.422 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.422 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:32.422 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:14:32.422 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:14:32.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.422 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.422 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:32.422 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:14:32.422 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:14:32.423 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.423 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.423 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:32.423 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:14:32.423 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:14:32.423 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.423 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.423 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:32.423 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:14:32.423 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:14:32.423 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.423 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.423 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:32.423 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:14:32.423 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:14:32.423 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.424 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:32.424 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.424 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.424 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.424 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:32.424 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:32.424 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 35.074656933999997, 2024-04-26T11:14:32.424 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:14:32.424 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:32.424 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:32.424 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:32.424 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:32.424 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.424 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:14:32.424 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.425 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:32.425 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.425 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:32.425 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:32.425 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.425 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.425 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.425 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:32.425 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:32.425 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.425 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.425 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.425 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:32.425 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:14:32.425 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:32.426 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.426 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.426 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:32.426 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:14:32.426 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:14:32.426 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.426 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.426 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:32.426 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:14:32.426 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:14:32.426 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.426 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.426 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.426 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:14:32.426 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:14:32.427 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.427 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.427 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.427 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:14:32.427 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:14:32.427 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.427 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.427 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:32.427 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:14:32.427 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:14:32.427 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.427 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.427 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:32.427 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:14:32.427 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:14:32.428 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.428 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.428 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:32.428 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:14:32.428 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:14:32.428 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.428 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.428 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.428 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:14:32.428 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:14:32.428 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.428 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.428 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:32.428 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:14:32.428 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:14:32.429 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.429 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.429 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.429 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:14:32.429 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:14:32.429 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.429 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.429 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:32.429 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:14:32.429 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:14:32.429 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.429 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:32.429 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.429 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.429 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.430 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:32.430 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:32.430 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 35.072463593999998, 2024-04-26T11:14:32.430 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:14:32.430 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:32.430 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:32.430 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:32.430 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:32.430 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.430 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:14:32.430 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.430 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:32.430 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.430 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:32.431 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:32.431 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.431 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.431 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:32.431 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:32.431 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.431 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.431 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:32.431 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:14:32.431 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:32.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.431 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.431 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:32.432 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:14:32.432 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:14:32.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.432 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.432 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:32.432 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:14:32.432 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:14:32.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.432 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.432 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.432 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:14:32.432 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:14:32.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.432 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.432 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.433 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:14:32.433 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:14:32.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.433 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.433 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:32.433 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:14:32.433 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:14:32.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.433 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.433 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:32.433 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:14:32.433 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:14:32.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.433 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.433 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:32.433 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:14:32.434 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:14:32.434 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.434 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.434 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.434 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:14:32.434 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:14:32.434 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.434 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.434 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:32.434 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:14:32.434 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:14:32.434 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.434 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.434 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.435 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:14:32.435 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:14:32.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.435 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.435 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:32.435 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:14:32.435 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:14:32.435 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.435 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:32.435 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.435 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.435 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:32.436 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:32.436 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 35.067251769999999, 2024-04-26T11:14:32.436 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:14:32.436 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:32.436 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:32.436 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:32.436 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:32.436 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.436 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:14:32.436 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.436 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:32.436 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.436 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:32.436 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:32.437 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.437 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.437 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.437 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:32.437 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:32.437 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.437 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.437 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.437 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:32.437 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:14:32.437 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:32.437 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.437 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.437 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:32.437 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:14:32.438 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:14:32.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.438 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.438 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:32.438 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:14:32.438 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:14:32.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.438 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.438 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.438 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:14:32.438 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:14:32.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.438 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.438 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.439 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:14:32.439 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:14:32.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.439 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.439 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:32.439 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:14:32.439 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:14:32.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.439 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.439 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:32.439 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:14:32.439 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:14:32.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.440 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.440 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:32.440 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:14:32.440 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:14:32.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.440 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.440 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.440 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:14:32.440 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:14:32.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.440 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.440 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:32.440 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:14:32.441 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:14:32.441 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.441 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.441 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.441 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:14:32.441 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:14:32.441 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.441 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.441 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:32.441 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:14:32.441 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:14:32.441 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.441 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:32.441 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.441 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.441 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.442 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:32.442 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:32.442 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 35.050803070000001, 2024-04-26T11:14:32.443 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:14:32.443 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:32.443 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:32.443 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:32.443 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:32.443 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.443 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:14:32.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.444 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:32.444 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.444 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:32.444 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:32.444 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.444 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.444 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:32.444 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:32.445 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.445 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.445 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:32.445 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:14:32.445 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:32.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.445 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.446 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:32.446 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:14:32.446 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:14:32.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.446 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.446 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:32.446 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:14:32.446 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:14:32.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.446 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.446 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.446 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:14:32.446 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:14:32.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.447 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.447 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.447 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:14:32.447 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:14:32.447 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.447 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.447 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:32.447 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:14:32.447 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:14:32.447 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.447 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.447 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.447 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:14:32.447 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:14:32.447 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.448 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.448 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:32.448 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:14:32.448 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:14:32.448 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.448 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:32.448 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.448 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.448 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.448 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:32.448 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:32.448 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 35.049105564999998, 2024-04-26T11:14:32.448 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:14:32.448 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:32.449 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:32.449 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:32.449 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:32.449 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.449 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:14:32.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.449 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:32.449 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.449 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:32.449 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:32.449 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.449 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.449 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:32.449 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:32.450 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.450 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.450 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:32.450 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:14:32.450 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:32.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.450 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.450 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:32.450 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:14:32.450 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:14:32.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.450 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.450 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:32.451 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:14:32.451 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:14:32.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.451 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.451 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.451 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:14:32.451 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:14:32.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.451 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.451 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.451 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:14:32.451 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:14:32.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.451 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.452 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:32.452 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:14:32.452 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:14:32.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.452 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.452 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.452 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:14:32.452 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:14:32.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.452 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.452 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:32.452 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:14:32.452 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:14:32.452 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.452 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:32.453 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.453 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.453 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.453 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:32.453 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:32.453 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 35.049041262999999, 2024-04-26T11:14:32.453 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:14:32.453 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:32.453 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:32.453 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:32.453 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:32.453 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.453 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:14:32.453 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.453 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:32.454 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.454 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:32.454 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:32.454 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.454 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.454 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:32.454 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:32.454 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.454 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.454 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:32.454 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:32.454 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:32.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.455 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.455 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:32.455 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:14:32.455 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:14:32.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.455 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.455 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:32.455 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:14:32.455 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:14:32.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.455 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.455 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.455 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:14:32.456 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:14:32.456 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.456 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.456 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.456 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:14:32.456 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:14:32.456 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.456 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.456 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:32.456 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:14:32.456 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:14:32.456 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.456 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.456 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.457 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:14:32.457 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:14:32.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.457 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.457 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:32.457 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:14:32.457 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:14:32.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.457 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.457 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:32.457 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:14:32.457 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:14:32.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.457 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.458 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:32.458 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:14:32.458 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:14:32.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.458 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.458 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:32.458 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:14:32.458 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:14:32.458 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.458 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:32.458 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.458 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.458 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:32.459 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:32.459 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 35.048987038999996, 2024-04-26T11:14:32.459 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:14:32.459 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:32.459 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:32.459 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:32.459 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:32.459 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.459 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:14:32.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.459 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:32.459 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.459 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:32.460 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:32.460 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.460 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.460 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:32.460 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:32.460 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.460 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.460 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:32.460 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:32.460 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:32.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.460 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.460 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:32.461 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:14:32.461 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:14:32.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.461 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:32.461 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:14:32.461 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:14:32.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.461 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.461 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:14:32.461 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:14:32.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.462 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.462 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:14:32.462 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:14:32.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.462 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.462 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:32.462 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:14:32.462 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:14:32.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.462 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.462 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.462 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:14:32.462 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:14:32.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.463 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.463 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:32.463 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:14:32.463 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:14:32.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.463 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.463 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:32.463 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:14:32.463 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:14:32.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.463 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.463 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:32.463 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:14:32.464 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:32.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.464 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.464 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:32.464 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:14:32.464 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:14:32.464 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.464 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:32.464 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.464 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.464 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:32.465 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:32.465 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 35.048942527000001, 2024-04-26T11:14:32.465 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:14:32.465 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:32.465 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:32.465 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:32.465 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:32.465 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.465 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:14:32.465 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.465 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:32.465 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.466 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:32.466 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:32.466 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.466 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.466 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:32.466 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:32.466 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.466 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.466 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:32.466 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:14:32.466 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:32.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.467 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:32.467 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:14:32.467 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:14:32.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.467 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:32.468 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:14:32.468 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:14:32.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.468 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.468 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.468 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:14:32.468 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:14:32.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.468 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.468 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.468 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:14:32.468 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:14:32.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.469 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:32.469 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:14:32.469 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:14:32.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.469 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.469 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:14:32.469 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:14:32.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.470 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:32.470 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:14:32.470 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:14:32.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.470 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.470 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:32.470 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:14:32.470 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:14:32.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.470 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.470 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:32.470 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:14:32.470 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:14:32.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.471 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.471 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:32.471 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:14:32.471 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:14:32.471 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.471 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:32.471 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.471 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.471 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:32.471 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:32.471 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 35.044721525, 2024-04-26T11:14:32.471 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:14:32.472 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:32.472 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:32.472 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:32.472 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:32.472 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.472 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:14:32.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.472 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:32.472 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.472 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:32.472 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:32.472 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.472 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.472 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:32.472 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:32.473 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.473 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:32.473 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:14:32.473 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:14:32.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.473 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:32.473 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:14:32.473 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:14:32.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.473 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:32.473 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:14:32.474 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:14:32.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.474 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.474 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:14:32.474 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:14:32.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.474 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.474 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:14:32.474 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:14:32.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.474 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:32.474 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:14:32.475 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:14:32.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.475 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.475 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:14:32.475 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:14:32.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.475 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:32.475 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:14:32.475 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:14:32.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.475 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:32.475 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:14:32.476 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:14:32.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.476 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.476 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:32.476 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:14:32.476 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:14:32.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.476 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.476 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:32.476 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:14:32.476 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:14:32.476 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.476 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:32.476 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.477 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.477 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:61817 5.a 5:5627ce7f:::benchmark_data_smithi029_44842_object61816:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T11:14:32.477 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:32.477 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 31.694596072, 2024-04-26T11:14:32.477 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020626958000000001, 2024-04-26T11:14:32.477 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:32.477 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:32.477 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:32.477 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:32.477 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.477 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 61817 2024-04-26T11:14:32.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.477 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:32.478 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.478 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:32.478 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:32.478 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.478 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.478 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:32.478 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:32.478 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.478 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.478 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:32.478 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702531+0000", 2024-04-26T11:14:32.478 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:32.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.479 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.479 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:32.479 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702591+0000", 2024-04-26T11:14:32.479 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0665999999999998e-05 2024-04-26T11:14:32.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.479 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.479 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:32.479 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702599+0000", 2024-04-26T11:14:32.479 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7130000000000005e-06 2024-04-26T11:14:32.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.479 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.479 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.479 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.702605+0000", 2024-04-26T11:14:32.480 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4310000000000002e-06 2024-04-26T11:14:32.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.480 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.480 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.480 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.707947+0000", 2024-04-26T11:14:32.480 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053424220000000003 2024-04-26T11:14:32.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.480 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.480 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:32.480 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.708052+0000", 2024-04-26T11:14:32.480 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010499 2024-04-26T11:14:32.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.480 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.480 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 2", 2024-04-26T11:14:32.480 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.708141+0000", 2024-04-26T11:14:32.481 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9514999999999999e-05 2024-04-26T11:14:32.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.481 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.481 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:32.481 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.711954+0000", 2024-04-26T11:14:32.481 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003812265 2024-04-26T11:14:32.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.481 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.481 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:32.481 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723070+0000", 2024-04-26T11:14:32.481 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.011116727 2024-04-26T11:14:32.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.481 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.481 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:32.481 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723121+0000", 2024-04-26T11:14:32.482 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0362999999999999e-05 2024-04-26T11:14:32.482 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.482 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.482 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:32.482 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:00.723158+0000", 2024-04-26T11:14:32.482 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7579000000000001e-05 2024-04-26T11:14:32.482 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.482 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:32.482 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.482 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.482 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.482 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:75771 5.c 5:3cc8f1b4:::benchmark_data_smithi029_44842_object75770:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T11:14:32.482 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:32.482 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.644151729000001, 2024-04-26T11:14:32.483 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019437949, 2024-04-26T11:14:32.483 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:32.483 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:32.483 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:32.483 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:32.483 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.483 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 75771 2024-04-26T11:14:32.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.483 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:32.483 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.483 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:32.483 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:32.483 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.484 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.484 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:32.484 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752976+0000", 2024-04-26T11:14:32.484 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.484 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.484 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:32.484 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.752975+0000", 2024-04-26T11:14:32.484 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:32.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.484 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.484 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:32.484 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753061+0000", 2024-04-26T11:14:32.484 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5890999999999995e-05 2024-04-26T11:14:32.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.485 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.485 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:32.485 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753071+0000", 2024-04-26T11:14:32.485 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.9990000000000003e-06 2024-04-26T11:14:32.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.485 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.485 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.485 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.753078+0000", 2024-04-26T11:14:32.485 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1559999999999998e-06 2024-04-26T11:14:32.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.485 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.485 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.485 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.758559+0000", 2024-04-26T11:14:32.485 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0054812819999999996 2024-04-26T11:14:32.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.486 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.486 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:32.486 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.758692+0000", 2024-04-26T11:14:32.486 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000133301 2024-04-26T11:14:32.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.486 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.486 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:32.486 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772277+0000", 2024-04-26T11:14:32.486 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.013584839 2024-04-26T11:14:32.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.486 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.486 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:32.487 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772340+0000", 2024-04-26T11:14:32.487 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2360999999999995e-05 2024-04-26T11:14:32.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.487 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.487 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:32.487 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:06.772414+0000", 2024-04-26T11:14:32.487 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4024999999999997e-05 2024-04-26T11:14:32.487 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.487 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:32.487 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.487 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.487 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83360 5.2 5:42f8bfcd:::benchmark_data_smithi029_44842_object83359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:32.487 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:32.487 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 21.357482155, 2024-04-26T11:14:32.488 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022279782000000001, 2024-04-26T11:14:32.488 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:32.488 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:32.488 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:32.488 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:32.488 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.488 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83360 2024-04-26T11:14:32.488 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.488 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:32.488 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.488 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:32.488 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:32.488 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.488 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.489 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.489 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:32.489 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:32.489 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.489 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.489 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:32.489 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:32.489 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:32.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.489 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.489 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:32.489 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039700+0000", 2024-04-26T11:14:32.489 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5541000000000002e-05 2024-04-26T11:14:32.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.490 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.490 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:32.490 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039706+0000", 2024-04-26T11:14:32.490 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3680000000000001e-06 2024-04-26T11:14:32.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.490 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.490 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.490 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039709+0000", 2024-04-26T11:14:32.490 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4659999999999999e-06 2024-04-26T11:14:32.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.490 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.490 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.490 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056305+0000", 2024-04-26T11:14:32.490 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016595649000000001 2024-04-26T11:14:32.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.491 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.491 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:32.491 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056487+0000", 2024-04-26T11:14:32.491 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000181886 2024-04-26T11:14:32.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.491 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.491 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:32.491 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061809+0000", 2024-04-26T11:14:32.491 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053223259999999996 2024-04-26T11:14:32.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.491 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.491 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:32.491 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061852+0000", 2024-04-26T11:14:32.492 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2738999999999999e-05 2024-04-26T11:14:32.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.492 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.492 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:32.492 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061925+0000", 2024-04-26T11:14:32.492 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3180000000000001e-05 2024-04-26T11:14:32.492 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.492 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:32.492 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.492 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.492 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83364 5.2 5:42c5cd8c:::benchmark_data_smithi029_44842_object83363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:32.492 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:32.492 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 21.357066414999998, 2024-04-26T11:14:32.493 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022695336, 2024-04-26T11:14:32.493 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:32.493 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:32.493 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:32.493 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:32.493 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.493 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83364 2024-04-26T11:14:32.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.493 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:32.493 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.493 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:32.493 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:32.493 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.494 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.494 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:32.494 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:32.494 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.494 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.494 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:32.494 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040060+0000", 2024-04-26T11:14:32.494 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:32.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.494 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.494 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:32.494 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040086+0000", 2024-04-26T11:14:32.494 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5482000000000001e-05 2024-04-26T11:14:32.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.495 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.495 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:32.495 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040093+0000", 2024-04-26T11:14:32.495 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6409999999999996e-06 2024-04-26T11:14:32.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.495 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.495 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.495 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040098+0000", 2024-04-26T11:14:32.495 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879999999999996e-06 2024-04-26T11:14:32.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.495 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.495 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.495 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058292+0000", 2024-04-26T11:14:32.495 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018193504999999999 2024-04-26T11:14:32.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.496 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.496 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:32.496 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058412+0000", 2024-04-26T11:14:32.496 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011979199999999999 2024-04-26T11:14:32.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.496 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.496 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:32.496 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062642+0000", 2024-04-26T11:14:32.496 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042299449999999997 2024-04-26T11:14:32.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.496 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.496 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:32.496 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062688+0000", 2024-04-26T11:14:32.496 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6859e-05 2024-04-26T11:14:32.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.497 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.497 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:32.497 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062756+0000", 2024-04-26T11:14:32.497 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7995000000000002e-05 2024-04-26T11:14:32.497 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.497 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:32.497 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.497 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.497 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83378 5.2 5:44b3209a:::benchmark_data_smithi029_44842_object83377:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:32.497 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:32.497 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 21.349345962000001, 2024-04-26T11:14:32.497 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020722529, 2024-04-26T11:14:32.498 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:32.498 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:32.498 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:32.498 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:32.498 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.498 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83378 2024-04-26T11:14:32.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.498 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:32.498 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.498 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:32.498 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:32.498 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.498 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.498 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:32.499 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047782+0000", 2024-04-26T11:14:32.499 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.499 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.499 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:32.499 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047781+0000", 2024-04-26T11:14:32.499 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:32.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.499 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.499 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:32.499 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047832+0000", 2024-04-26T11:14:32.499 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1687000000000002e-05 2024-04-26T11:14:32.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.499 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.499 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:32.500 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047842+0000", 2024-04-26T11:14:32.500 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2439999999999999e-06 2024-04-26T11:14:32.500 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.500 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.500 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.500 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.047847+0000", 2024-04-26T11:14:32.500 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6500000000000001e-06 2024-04-26T11:14:32.500 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.500 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.500 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.500 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.060082+0000", 2024-04-26T11:14:32.500 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.012235105 2024-04-26T11:14:32.500 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.500 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.500 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:32.501 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.060191+0000", 2024-04-26T11:14:32.501 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000108665 2024-04-26T11:14:32.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.501 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.501 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:32.501 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068363+0000", 2024-04-26T11:14:32.501 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0081715829999999996 2024-04-26T11:14:32.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.501 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.501 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:32.501 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068418+0000", 2024-04-26T11:14:32.501 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4984000000000001e-05 2024-04-26T11:14:32.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.501 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.501 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:32.502 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.068504+0000", 2024-04-26T11:14:32.502 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6520000000000005e-05 2024-04-26T11:14:32.502 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.502 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:32.502 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.502 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.502 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:119985 5.3 5:c1cceb39:::benchmark_data_smithi029_44842_object119984:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T11:14:32.502 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:27.506441+0000", 2024-04-26T11:14:32.502 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.8906868580000005, 2024-04-26T11:14:32.502 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020515384000000001, 2024-04-26T11:14:32.502 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:32.502 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:32.502 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:32.503 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:32.503 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.503 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 119985 2024-04-26T11:14:32.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.503 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:32.503 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.503 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:32.503 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.506441+0000", 2024-04-26T11:14:32.503 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.503 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.503 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:32.503 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.506441+0000", 2024-04-26T11:14:32.503 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.504 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.504 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:32.504 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.506440+0000", 2024-04-26T11:14:32.504 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:32.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.504 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.504 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:32.504 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.506516+0000", 2024-04-26T11:14:32.504 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5584e-05 2024-04-26T11:14:32.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.504 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.504 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:32.504 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.506523+0000", 2024-04-26T11:14:32.504 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8220000000000001e-06 2024-04-26T11:14:32.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.505 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.505 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.505 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.506526+0000", 2024-04-26T11:14:32.505 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8430000000000003e-06 2024-04-26T11:14:32.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.505 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.505 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.505 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.506582+0000", 2024-04-26T11:14:32.505 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5155999999999998e-05 2024-04-26T11:14:32.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.505 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.505 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:32.505 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.506724+0000", 2024-04-26T11:14:32.505 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014225899999999999 2024-04-26T11:14:32.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.506 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.506 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:32.506 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.526835+0000", 2024-04-26T11:14:32.506 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020111653 2024-04-26T11:14:32.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.506 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.506 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:32.506 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.526880+0000", 2024-04-26T11:14:32.506 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4994000000000003e-05 2024-04-26T11:14:32.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.506 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.506 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:32.506 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:27.526956+0000", 2024-04-26T11:14:32.506 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5562999999999995e-05 2024-04-26T11:14:32.507 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.507 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:32.507 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.507 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.507 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:129903 5.0 e40/16 5:00b2d390:::benchmark_data_smithi029_44842_object129902:head v 40'8238, mlcod=40'8234)", 2024-04-26T11:14:32.507 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:32.507 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.503317032, 2024-04-26T11:14:32.507 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.02228639, 2024-04-26T11:14:32.507 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:32.507 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:32.507 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:32.507 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.507 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:32.508 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:32.508 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.508 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.508 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:32.508 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:32.508 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:32.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.508 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.508 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:32.508 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:32.508 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:32.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.508 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.508 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:32.509 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893874+0000", 2024-04-26T11:14:32.509 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3849000000000005e-05 2024-04-26T11:14:32.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.509 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.509 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:32.509 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893884+0000", 2024-04-26T11:14:32.509 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0149000000000001e-05 2024-04-26T11:14:32.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.509 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.509 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.509 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893892+0000", 2024-04-26T11:14:32.509 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0299999999999994e-06 2024-04-26T11:14:32.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.509 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.510 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:32.510 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.894003+0000", 2024-04-26T11:14:32.510 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011128099999999999 2024-04-26T11:14:32.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.510 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.510 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:32.510 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.894024+0000", 2024-04-26T11:14:32.510 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0979e-05 2024-04-26T11:14:32.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.510 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.510 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:32.510 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.916077+0000", 2024-04-26T11:14:32.510 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022053461 2024-04-26T11:14:32.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:32.510 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:32.511 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:32.511 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.916097+0000", 2024-04-26T11:14:32.511 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9389999999999999e-05 2024-04-26T11:14:32.511 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.511 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:32.511 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.511 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:32.511 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:32.511 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:32.512 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 54 16 131026 131010 151.618 141.375 0.0039704 0.00659307 2024-04-26T11:14:32.512 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:32.510+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:32.513 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:32.613 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:32.611+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:32.647 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:14:32.688 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:32.688 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:32.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.689 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:131685 5.e 5:756a3cff:::benchmark_data_smithi029_44842_object131684:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:32.689 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:32.686624+0000", 2024-04-26T11:14:32.689 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.000424096, 2024-04-26T11:14:32.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00045284999999999998, 2024-04-26T11:14:32.689 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:32.689 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:32.689 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:32.689 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:32.689 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.689 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 131685 2024-04-26T11:14:32.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.689 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:32.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:32.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686624+0000", 2024-04-26T11:14:32.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:32.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:32.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686624+0000", 2024-04-26T11:14:32.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:32.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:32.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686623+0000", 2024-04-26T11:14:32.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:14:32.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:32.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686678+0000", 2024-04-26T11:14:32.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5322000000000003e-05 2024-04-26T11:14:32.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:32.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686691+0000", 2024-04-26T11:14:32.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2639999999999999e-05 2024-04-26T11:14:32.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686700+0000", 2024-04-26T11:14:32.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0880000000000001e-06 2024-04-26T11:14:32.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:32.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686759+0000", 2024-04-26T11:14:32.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8731999999999999e-05 2024-04-26T11:14:32.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:32.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686888+0000", 2024-04-26T11:14:32.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012908599999999999 2024-04-26T11:14:32.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.692 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:32.692 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686977+0000", 2024-04-26T11:14:32.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9095e-05 2024-04-26T11:14:32.693 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:32.693 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:32.693 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:32.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.693 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:131686 5.4 5:27d671b5:::benchmark_data_smithi029_44842_object131685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:32.693 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:32.686710+0000", 2024-04-26T11:14:32.693 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00033856499999999998, 2024-04-26T11:14:32.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00044727200000000002, 2024-04-26T11:14:32.693 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:32.693 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:32.693 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:32.693 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:32.694 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.694 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 131686 2024-04-26T11:14:32.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.694 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:32.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:32.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686710+0000", 2024-04-26T11:14:32.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:32.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:32.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686710+0000", 2024-04-26T11:14:32.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:32.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:32.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686709+0000", 2024-04-26T11:14:32.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:32.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:32.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686745+0000", 2024-04-26T11:14:32.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6103999999999999e-05 2024-04-26T11:14:32.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:32.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686754+0000", 2024-04-26T11:14:32.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8519999999999993e-06 2024-04-26T11:14:32.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686761+0000", 2024-04-26T11:14:32.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1579999999999999e-06 2024-04-26T11:14:32.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:32.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686791+0000", 2024-04-26T11:14:32.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9743e-05 2024-04-26T11:14:32.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:32.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686900+0000", 2024-04-26T11:14:32.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000109375 2024-04-26T11:14:32.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:32.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.687042+0000", 2024-04-26T11:14:32.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014155400000000001 2024-04-26T11:14:32.697 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:32.697 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:32.697 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:32.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.697 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:131687 5.a 5:5bf0546e:::benchmark_data_smithi029_44842_object131686:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:32.697 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:32.686772+0000", 2024-04-26T11:14:32.697 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00027631900000000002, 2024-04-26T11:14:32.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00046064400000000002, 2024-04-26T11:14:32.697 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:32.697 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:32.697 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:32.698 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:32.698 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.698 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 131687 2024-04-26T11:14:32.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.698 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:32.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:32.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686772+0000", 2024-04-26T11:14:32.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:32.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:32.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686772+0000", 2024-04-26T11:14:32.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:32.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:32.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686771+0000", 2024-04-26T11:14:32.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:32.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:32.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686804+0000", 2024-04-26T11:14:32.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3031000000000003e-05 2024-04-26T11:14:32.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:32.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686814+0000", 2024-04-26T11:14:32.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7820000000000005e-06 2024-04-26T11:14:32.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686821+0000", 2024-04-26T11:14:32.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3749999999999999e-06 2024-04-26T11:14:32.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:32.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686856+0000", 2024-04-26T11:14:32.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5763000000000003e-05 2024-04-26T11:14:32.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:32.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686972+0000", 2024-04-26T11:14:32.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011581700000000001 2024-04-26T11:14:32.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:32.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.687143+0000", 2024-04-26T11:14:32.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000171099 2024-04-26T11:14:32.701 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:32.701 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:32.701 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:32.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.701 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:131688 5.9 5:947285b1:::benchmark_data_smithi029_44842_object131687:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:32.701 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:32.686830+0000", 2024-04-26T11:14:32.701 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.000217949, 2024-04-26T11:14:32.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00048597799999999997, 2024-04-26T11:14:32.702 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:32.702 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:32.702 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:32.702 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:32.702 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.702 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 131688 2024-04-26T11:14:32.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.702 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:32.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:32.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686830+0000", 2024-04-26T11:14:32.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:32.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:32.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686830+0000", 2024-04-26T11:14:32.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:32.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:32.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686830+0000", 2024-04-26T11:14:32.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:32.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:32.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686865+0000", 2024-04-26T11:14:32.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5249000000000001e-05 2024-04-26T11:14:32.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:32.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686874+0000", 2024-04-26T11:14:32.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3400000000000004e-06 2024-04-26T11:14:32.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686881+0000", 2024-04-26T11:14:32.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5679999999999996e-06 2024-04-26T11:14:32.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:32.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686922+0000", 2024-04-26T11:14:32.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0911999999999997e-05 2024-04-26T11:14:32.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:32.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.687059+0000", 2024-04-26T11:14:32.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000136966 2024-04-26T11:14:32.705 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:32.705 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:32.705 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:32.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.705 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:131689 5.f 5.154339af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:32.705 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:32.687230+0000", 2024-04-26T11:14:32.705 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9998178, 2024-04-26T11:14:32.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000151867, 2024-04-26T11:14:32.705 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:32.705 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:32.706 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:32.706 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:32.706 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.706 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 131689 2024-04-26T11:14:32.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.706 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:32.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:32.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.687230+0000", 2024-04-26T11:14:32.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:32.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:32.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.687230+0000", 2024-04-26T11:14:32.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:32.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:32.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.687230+0000", 2024-04-26T11:14:32.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:32.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:32.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.687309+0000", 2024-04-26T11:14:32.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9783000000000005e-05 2024-04-26T11:14:32.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:32.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.687320+0000", 2024-04-26T11:14:32.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0488e-05 2024-04-26T11:14:32.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.687327+0000", 2024-04-26T11:14:32.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5079999999999999e-06 2024-04-26T11:14:32.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:32.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.687371+0000", 2024-04-26T11:14:32.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3906000000000003e-05 2024-04-26T11:14:32.708 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:32.708 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:32.708 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:32.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.709 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:131668 5.4 5:2b045597:::benchmark_data_smithi029_44842_object131667:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:32.709 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:32.680322+0000", 2024-04-26T11:14:32.709 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0067262260000000001, 2024-04-26T11:14:32.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0070989629999999998, 2024-04-26T11:14:32.709 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:32.709 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:32.709 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:32.709 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:32.709 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.709 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 131668 2024-04-26T11:14:32.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.709 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:32.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:32.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.680322+0000", 2024-04-26T11:14:32.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:32.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:32.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.680322+0000", 2024-04-26T11:14:32.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:32.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:32.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.680321+0000", 2024-04-26T11:14:32.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:32.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:32.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.680378+0000", 2024-04-26T11:14:32.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6455000000000001e-05 2024-04-26T11:14:32.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:32.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.680386+0000", 2024-04-26T11:14:32.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9659999999999996e-06 2024-04-26T11:14:32.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.680391+0000", 2024-04-26T11:14:32.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9139999999999999e-06 2024-04-26T11:14:32.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:32.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.680418+0000", 2024-04-26T11:14:32.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7766000000000001e-05 2024-04-26T11:14:32.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:32.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.680528+0000", 2024-04-26T11:14:32.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000109351 2024-04-26T11:14:32.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:32.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.680635+0000", 2024-04-26T11:14:32.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106959 2024-04-26T11:14:32.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:32.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.686526+0000", 2024-04-26T11:14:32.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0058909310000000003 2024-04-26T11:14:32.713 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:32.713 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:32.713 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:32.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.713 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:131671 5.4 5:21bd21d8:::benchmark_data_smithi029_44842_object131670:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:32.713 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:32.680810+0000", 2024-04-26T11:14:32.713 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0062381820000000001, 2024-04-26T11:14:32.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0066569919999999996, 2024-04-26T11:14:32.713 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:32.713 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:32.713 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:32.713 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:32.714 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.714 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 131671 2024-04-26T11:14:32.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.714 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:32.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:32.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.680810+0000", 2024-04-26T11:14:32.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:32.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:32.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.680810+0000", 2024-04-26T11:14:32.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:32.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:32.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.680809+0000", 2024-04-26T11:14:32.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:32.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:32.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.680916+0000", 2024-04-26T11:14:32.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106619 2024-04-26T11:14:32.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:32.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.680925+0000", 2024-04-26T11:14:32.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3540000000000006e-06 2024-04-26T11:14:32.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.680936+0000", 2024-04-26T11:14:32.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0475999999999999e-05 2024-04-26T11:14:32.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:32.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.682096+0000", 2024-04-26T11:14:32.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011601750000000001 2024-04-26T11:14:32.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:32.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.682216+0000", 2024-04-26T11:14:32.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011957500000000001 2024-04-26T11:14:32.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:32.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.682352+0000", 2024-04-26T11:14:32.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000136012 2024-04-26T11:14:32.717 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:32.717 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:32.717 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:32.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.717 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:131678 5.4 5:2970a24f:::benchmark_data_smithi029_44842_object131677:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:32.717 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:32.681507+0000", 2024-04-26T11:14:32.717 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0055412980000000001, 2024-04-26T11:14:32.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060142090000000004, 2024-04-26T11:14:32.717 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:32.717 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:32.717 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:32.718 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:32.718 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:32.718 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 131678 2024-04-26T11:14:32.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.718 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:32.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:32.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.681507+0000", 2024-04-26T11:14:32.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:32.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:32.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.681507+0000", 2024-04-26T11:14:32.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:32.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:32.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.681507+0000", 2024-04-26T11:14:32.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:32.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:32.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.681629+0000", 2024-04-26T11:14:32.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012253500000000001 2024-04-26T11:14:32.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:32.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.681637+0000", 2024-04-26T11:14:32.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0169999999999996e-06 2024-04-26T11:14:32.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:32.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.681645+0000", 2024-04-26T11:14:32.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7729999999999999e-06 2024-04-26T11:14:32.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:32.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.684736+0000", 2024-04-26T11:14:32.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003090916 2024-04-26T11:14:32.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:32.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.684837+0000", 2024-04-26T11:14:32.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010084 2024-04-26T11:14:32.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:32.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:32.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:32.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.684925+0000", 2024-04-26T11:14:32.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8362999999999994e-05 2024-04-26T11:14:32.721 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:32.721 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:32.721 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:32.721 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:32.721 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:14:32.721 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 8 2024-04-26T11:14:32.721 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:32.723 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:32.723 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:32.720+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:32.823 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:32.821+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:32.927 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:32.924+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:32.940 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:32.940 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:14:32.940 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:14:32.940 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:14:32.940 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:32.956 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:33.039 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:33.038+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:33.125 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:33.123+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:33.170 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:33.170 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:14:33.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:14:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.888130238999999, 2024-04-26T11:14:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:14:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:14:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:14:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:14:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:14:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:14:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:14:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:14:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:14:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:14:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:14:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:14:33.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:33.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:14:33.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:14:33.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:33.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:14:33.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:14:33.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:33.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:14:33.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:14:33.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:33.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:14:33.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:14:33.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:33.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:14:33.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:14:33.177 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.177 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:33.177 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.887480537000002, 2024-04-26T11:14:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:14:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:14:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:14:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:14:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:14:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:14:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:14:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:14:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:14:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:14:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:14:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:14:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:14:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:14:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:14:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:14:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:14:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:14:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:14:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:14:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:14:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:14:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:14:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 35.820838498000001, 2024-04-26T11:14:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:14:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:14:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:14:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:14:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:14:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:14:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:14:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:14:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:14:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:14:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:14:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:14:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:14:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:14:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:14:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:14:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:14:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 35.820742852000002, 2024-04-26T11:14:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:14:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:14:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:14:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:14:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:14:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:14:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:14:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:14:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:14:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:14:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:14:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:14:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:14:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:14:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:14:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:14:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:14:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 35.820611173000003, 2024-04-26T11:14:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:14:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:14:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:14:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:14:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:33.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:14:33.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:14:33.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:33.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:14:33.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:14:33.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:14:33.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:14:33.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:33.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:14:33.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:14:33.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:14:33.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:14:33.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:33.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:14:33.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:14:33.196 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.196 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:33.197 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.197 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:33.197 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:33.197 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 35.820502716999997, 2024-04-26T11:14:33.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:14:33.197 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:33.197 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:33.197 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:33.197 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:33.197 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:33.197 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:14:33.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.198 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:33.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:33.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:33.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:33.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:33.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:33.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:14:33.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:33.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:33.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:14:33.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:14:33.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:33.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:14:33.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:14:33.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:33.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:14:33.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:14:33.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:14:33.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:14:33.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:33.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:14:33.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:14:33.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:14:33.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:14:33.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:33.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:14:33.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:14:33.202 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.202 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:33.202 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.202 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:33.202 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:33.202 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 35.820401449000002, 2024-04-26T11:14:33.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:14:33.202 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:33.202 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:33.202 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:33.202 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:33.203 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:33.203 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:14:33.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.203 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:33.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:33.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:33.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:33.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:33.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:33.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:33.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:33.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:33.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:14:33.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:14:33.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:33.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:14:33.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:14:33.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:33.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:14:33.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:14:33.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:14:33.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:14:33.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:33.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:14:33.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:14:33.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:14:33.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:14:33.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:33.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:14:33.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:14:33.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:33.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:14:33.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:14:33.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:33.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:14:33.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:14:33.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:33.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:14:33.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:14:33.207 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.207 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:33.208 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.208 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:33.208 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:33.208 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 35.820332508, 2024-04-26T11:14:33.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:14:33.208 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:33.208 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:33.208 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:33.208 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:33.208 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:33.208 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:14:33.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.209 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:33.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:33.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:33.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:33.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:33.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:33.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:14:33.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:33.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:33.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:14:33.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:14:33.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:33.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:14:33.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:14:33.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:33.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:14:33.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:14:33.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:14:33.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:14:33.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:33.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:14:33.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:14:33.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:14:33.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:14:33.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:33.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:14:33.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:14:33.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:33.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:14:33.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:14:33.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:33.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:14:33.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:14:33.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:33.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:14:33.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:14:33.213 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.213 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:33.213 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.214 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:33.214 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:33.214 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 35.814336926999999, 2024-04-26T11:14:33.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:14:33.214 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:33.214 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:33.214 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:33.214 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:33.214 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:33.214 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:14:33.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.214 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:33.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:33.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:33.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:33.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:33.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:33.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:14:33.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:33.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:33.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:14:33.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:14:33.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:33.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:14:33.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:14:33.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:33.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:14:33.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:14:33.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:14:33.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:14:33.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:33.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:14:33.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:14:33.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:14:33.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:14:33.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:33.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:14:33.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:14:33.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:33.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:14:33.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:14:33.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:33.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:14:33.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:14:33.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:33.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:14:33.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:14:33.219 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.219 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:33.219 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.219 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:81256 5.8 5:1c0f3fd8:::benchmark_data_smithi029_44842_object81255:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:33.219 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:33.219 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.050877377999999, 2024-04-26T11:14:33.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026193673000000001, 2024-04-26T11:14:33.221 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:33.221 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:33.221 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:33.221 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:33.221 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:33.221 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 81256 2024-04-26T11:14:33.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.221 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:33.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:33.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:33.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:33.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:33.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:33.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:33.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:33.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:33.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116073+0000", 2024-04-26T11:14:33.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0114e-05 2024-04-26T11:14:33.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:33.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116079+0000", 2024-04-26T11:14:33.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8939999999999998e-06 2024-04-26T11:14:33.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:33.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116082+0000", 2024-04-26T11:14:33.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:14:33.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127501+0000", 2024-04-26T11:14:33.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011418281000000001 2024-04-26T11:14:33.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:33.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127639+0000", 2024-04-26T11:14:33.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013828899999999999 2024-04-26T11:14:33.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:33.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127782+0000", 2024-04-26T11:14:33.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014328299999999999 2024-04-26T11:14:33.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:33.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.134767+0000", 2024-04-26T11:14:33.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0069844140000000004 2024-04-26T11:14:33.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:33.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142160+0000", 2024-04-26T11:14:33.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007392839 2024-04-26T11:14:33.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:33.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142202+0000", 2024-04-26T11:14:33.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2797999999999999e-05 2024-04-26T11:14:33.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:33.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142237+0000", 2024-04-26T11:14:33.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4464000000000001e-05 2024-04-26T11:14:33.226 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.226 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:33.226 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.226 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90441 5.4 5:2b047885:::benchmark_data_smithi029_44842_object90440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:33.226 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:33.227 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 19.016714017999998, 2024-04-26T11:14:33.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026164084000000001, 2024-04-26T11:14:33.227 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:33.227 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:33.227 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:33.227 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:33.227 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:33.227 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90441 2024-04-26T11:14:33.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.227 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:33.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:33.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:33.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:33.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:33.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:33.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150206+0000", 2024-04-26T11:14:33.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:33.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:33.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150261+0000", 2024-04-26T11:14:33.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4580000000000003e-05 2024-04-26T11:14:33.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:33.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150269+0000", 2024-04-26T11:14:33.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9679999999999995e-06 2024-04-26T11:14:33.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:33.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150274+0000", 2024-04-26T11:14:33.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8470000000000003e-06 2024-04-26T11:14:33.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150312+0000", 2024-04-26T11:14:33.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7245e-05 2024-04-26T11:14:33.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:33.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150396+0000", 2024-04-26T11:14:33.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4778999999999996e-05 2024-04-26T11:14:33.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:33.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150491+0000", 2024-04-26T11:14:33.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4606999999999997e-05 2024-04-26T11:14:33.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:33.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.153991+0000", 2024-04-26T11:14:33.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035001339999999998 2024-04-26T11:14:33.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:33.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176295+0000", 2024-04-26T11:14:33.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022304280999999999 2024-04-26T11:14:33.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:33.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176335+0000", 2024-04-26T11:14:33.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:33.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:33.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176371+0000", 2024-04-26T11:14:33.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5448999999999999e-05 2024-04-26T11:14:33.232 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.232 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:33.232 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.232 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101754 5.e 5:7ca15a5c:::benchmark_data_smithi029_44842_object101753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:33.232 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:33.232 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 14.048389185, 2024-04-26T11:14:33.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039171048999999999, 2024-04-26T11:14:33.233 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:33.233 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:33.233 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:33.233 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:33.233 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:33.233 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101754 2024-04-26T11:14:33.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.233 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:33.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:33.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:33.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:33.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:33.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:33.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:33.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:33.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:33.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118604+0000", 2024-04-26T11:14:33.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3399000000000007e-05 2024-04-26T11:14:33.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:33.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118613+0000", 2024-04-26T11:14:33.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6989999999999992e-06 2024-04-26T11:14:33.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:33.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118618+0000", 2024-04-26T11:14:33.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3850000000000001e-06 2024-04-26T11:14:33.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118646+0000", 2024-04-26T11:14:33.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7878e-05 2024-04-26T11:14:33.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:33.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118720+0000", 2024-04-26T11:14:33.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3461999999999996e-05 2024-04-26T11:14:33.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:33.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118807+0000", 2024-04-26T11:14:33.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7269999999999996e-05 2024-04-26T11:14:33.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:33.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142317+0000", 2024-04-26T11:14:33.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023510105999999999 2024-04-26T11:14:33.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:33.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.143287+0000", 2024-04-26T11:14:33.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096983599999999996 2024-04-26T11:14:33.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:33.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157662+0000", 2024-04-26T11:14:33.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014375393 2024-04-26T11:14:33.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:33.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157702+0000", 2024-04-26T11:14:33.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0295e-05 2024-04-26T11:14:33.237 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.237 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:33.238 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.238 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101755 5.f 5:fa973a83:::benchmark_data_smithi029_44842_object101754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:33.238 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:33.238 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 14.048223489, 2024-04-26T11:14:33.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039139064000000001, 2024-04-26T11:14:33.238 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:33.238 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:33.238 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:33.238 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:33.238 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:33.238 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101755 2024-04-26T11:14:33.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.239 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:33.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:33.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:33.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:33.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:33.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:33.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118696+0000", 2024-04-26T11:14:33.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:33.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:33.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118766+0000", 2024-04-26T11:14:33.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9423000000000003e-05 2024-04-26T11:14:33.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:33.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118774+0000", 2024-04-26T11:14:33.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9710000000000004e-06 2024-04-26T11:14:33.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:33.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118779+0000", 2024-04-26T11:14:33.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5629999999999999e-06 2024-04-26T11:14:33.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118817+0000", 2024-04-26T11:14:33.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7771000000000001e-05 2024-04-26T11:14:33.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:33.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118929+0000", 2024-04-26T11:14:33.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011222699999999999 2024-04-26T11:14:33.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:33.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157661+0000", 2024-04-26T11:14:33.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038731120000000001 2024-04-26T11:14:33.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:33.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157757+0000", 2024-04-26T11:14:33.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6910000000000006e-05 2024-04-26T11:14:33.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:33.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157836+0000", 2024-04-26T11:14:33.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8727999999999996e-05 2024-04-26T11:14:33.242 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.242 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:33.242 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.243 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101758 5.4 5:2525a4eb:::benchmark_data_smithi029_44842_object101757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:33.243 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:33.243 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 14.046040637999999, 2024-04-26T11:14:33.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.03686739, 2024-04-26T11:14:33.243 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:33.243 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:33.243 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:33.243 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:33.243 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:33.243 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101758 2024-04-26T11:14:33.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.243 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:33.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:33.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:33.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:33.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:33.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:33.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120879+0000", 2024-04-26T11:14:33.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:33.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:33.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120971+0000", 2024-04-26T11:14:33.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2133999999999996e-05 2024-04-26T11:14:33.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:33.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120977+0000", 2024-04-26T11:14:33.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5509999999999999e-06 2024-04-26T11:14:33.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:33.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120981+0000", 2024-04-26T11:14:33.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.245e-06 2024-04-26T11:14:33.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121010+0000", 2024-04-26T11:14:33.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9084000000000001e-05 2024-04-26T11:14:33.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:33.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121083+0000", 2024-04-26T11:14:33.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2942999999999996e-05 2024-04-26T11:14:33.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:33.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121163+0000", 2024-04-26T11:14:33.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0197000000000005e-05 2024-04-26T11:14:33.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:33.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142822+0000", 2024-04-26T11:14:33.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021658535999999999 2024-04-26T11:14:33.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:33.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157674+0000", 2024-04-26T11:14:33.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014851573999999999 2024-04-26T11:14:33.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:33.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157714+0000", 2024-04-26T11:14:33.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0473999999999999e-05 2024-04-26T11:14:33.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:33.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157747+0000", 2024-04-26T11:14:33.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3278999999999998e-05 2024-04-26T11:14:33.248 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.249 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:33.249 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.249 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101760 5.4 5:2510211a:::benchmark_data_smithi029_44842_object101759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:33.249 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:33.249 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 14.045608293000001, 2024-04-26T11:14:33.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039182383000000001, 2024-04-26T11:14:33.249 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:33.249 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:33.249 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:33.249 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:33.249 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:33.249 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101760 2024-04-26T11:14:33.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.250 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:33.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:33.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:33.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:33.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:33.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:33.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:33.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:33.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:33.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121389+0000", 2024-04-26T11:14:33.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6667000000000003e-05 2024-04-26T11:14:33.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:33.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121394+0000", 2024-04-26T11:14:33.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0839999999999999e-06 2024-04-26T11:14:33.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:33.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121397+0000", 2024-04-26T11:14:33.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4489999999999999e-06 2024-04-26T11:14:33.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122921+0000", 2024-04-26T11:14:33.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001524067 2024-04-26T11:14:33.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:33.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.123010+0000", 2024-04-26T11:14:33.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8449000000000006e-05 2024-04-26T11:14:33.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:33.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140838+0000", 2024-04-26T11:14:33.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017828796000000001 2024-04-26T11:14:33.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:33.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157665+0000", 2024-04-26T11:14:33.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016826574 2024-04-26T11:14:33.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:33.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160407+0000", 2024-04-26T11:14:33.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027423970000000002 2024-04-26T11:14:33.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:33.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160456+0000", 2024-04-26T11:14:33.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8678999999999999e-05 2024-04-26T11:14:33.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:33.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160495+0000", 2024-04-26T11:14:33.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8658000000000002e-05 2024-04-26T11:14:33.254 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.254 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:33.254 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.254 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101761 5.e 5:70294421:::benchmark_data_smithi029_44842_object101760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:33.255 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:33.255 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 14.04418392, 2024-04-26T11:14:33.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035270448000000003, 2024-04-26T11:14:33.255 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:33.255 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:33.255 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:33.255 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:33.255 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:33.255 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101761 2024-04-26T11:14:33.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.255 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:33.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:33.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:33.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:33.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:33.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:33.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122736+0000", 2024-04-26T11:14:33.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:33.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:33.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122805+0000", 2024-04-26T11:14:33.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9076000000000001e-05 2024-04-26T11:14:33.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:33.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122811+0000", 2024-04-26T11:14:33.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:14:33.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:33.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122815+0000", 2024-04-26T11:14:33.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2860000000000001e-06 2024-04-26T11:14:33.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122842+0000", 2024-04-26T11:14:33.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6429000000000001e-05 2024-04-26T11:14:33.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:33.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122916+0000", 2024-04-26T11:14:33.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4122999999999995e-05 2024-04-26T11:14:33.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:33.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122997+0000", 2024-04-26T11:14:33.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1428999999999996e-05 2024-04-26T11:14:33.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:33.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142344+0000", 2024-04-26T11:14:33.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019346452 2024-04-26T11:14:33.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:33.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157934+0000", 2024-04-26T11:14:33.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015589911999999999 2024-04-26T11:14:33.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:33.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157975+0000", 2024-04-26T11:14:33.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1604999999999999e-05 2024-04-26T11:14:33.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:33.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.158007+0000", 2024-04-26T11:14:33.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1921000000000002e-05 2024-04-26T11:14:33.260 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.260 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:33.260 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.260 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110145 5.9 5:9b275f16:::benchmark_data_smithi029_44842_object110144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:33.260 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:33.260 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 10.018622282000001, 2024-04-26T11:14:33.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032844496000000001, 2024-04-26T11:14:33.260 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:33.260 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:33.261 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:33.261 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:33.261 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:33.261 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110145 2024-04-26T11:14:33.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.261 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:33.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:33.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:33.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:33.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:33.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:33.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148297+0000", 2024-04-26T11:14:33.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:33.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:33.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148325+0000", 2024-04-26T11:14:33.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7511000000000001e-05 2024-04-26T11:14:33.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:33.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148338+0000", 2024-04-26T11:14:33.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2808e-05 2024-04-26T11:14:33.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:33.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148345+0000", 2024-04-26T11:14:33.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7200000000000006e-06 2024-04-26T11:14:33.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149888+0000", 2024-04-26T11:14:33.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001542666 2024-04-26T11:14:33.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:33.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149977+0000", 2024-04-26T11:14:33.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9247999999999997e-05 2024-04-26T11:14:33.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:33.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181006+0000", 2024-04-26T11:14:33.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031028535999999999 2024-04-26T11:14:33.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:33.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181051+0000", 2024-04-26T11:14:33.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5393999999999999e-05 2024-04-26T11:14:33.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:33.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181143+0000", 2024-04-26T11:14:33.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1458000000000004e-05 2024-04-26T11:14:33.265 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.265 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:33.265 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.265 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110155 5.9 5:9ebc6158:::benchmark_data_smithi029_44842_object110154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:33.265 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:33.265 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 10.01354649, 2024-04-26T11:14:33.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027886826999999999, 2024-04-26T11:14:33.266 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:33.266 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:33.266 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:33.266 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:33.266 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:33.266 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110155 2024-04-26T11:14:33.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.266 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:33.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:33.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:33.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:33.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:33.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:33.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153373+0000", 2024-04-26T11:14:33.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:33.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:33.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153479+0000", 2024-04-26T11:14:33.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105728 2024-04-26T11:14:33.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:33.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153491+0000", 2024-04-26T11:14:33.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2207e-05 2024-04-26T11:14:33.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:33.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153499+0000", 2024-04-26T11:14:33.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7729999999999999e-06 2024-04-26T11:14:33.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153655+0000", 2024-04-26T11:14:33.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015573 2024-04-26T11:14:33.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:33.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153770+0000", 2024-04-26T11:14:33.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011562500000000001 2024-04-26T11:14:33.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:33.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181153+0000", 2024-04-26T11:14:33.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027382113 2024-04-26T11:14:33.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:33.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181195+0000", 2024-04-26T11:14:33.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1921000000000001e-05 2024-04-26T11:14:33.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:33.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181261+0000", 2024-04-26T11:14:33.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6402999999999994e-05 2024-04-26T11:14:33.270 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.270 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:33.270 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.270 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:129903 5.0 5:00b2d390:::benchmark_data_smithi029_44842_object129902:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:33.270 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:31.889868+0000", 2024-04-26T11:14:33.270 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 1.27705209, 2024-04-26T11:14:33.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026543418999999999, 2024-04-26T11:14:33.271 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:33.271 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:33.271 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:33.271 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:33.271 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:33.271 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 129903 2024-04-26T11:14:33.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.271 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:33.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:33.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889868+0000", 2024-04-26T11:14:33.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:33.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889868+0000", 2024-04-26T11:14:33.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:33.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889868+0000", 2024-04-26T11:14:33.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:33.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:33.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889936+0000", 2024-04-26T11:14:33.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7655000000000002e-05 2024-04-26T11:14:33.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:33.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889943+0000", 2024-04-26T11:14:33.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7319999999999998e-06 2024-04-26T11:14:33.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:33.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889948+0000", 2024-04-26T11:14:33.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5909999999999998e-06 2024-04-26T11:14:33.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.893510+0000", 2024-04-26T11:14:33.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035624540000000001 2024-04-26T11:14:33.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:33.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.893637+0000", 2024-04-26T11:14:33.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000126604 2024-04-26T11:14:33.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:33.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.893784+0000", 2024-04-26T11:14:33.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014726299999999999 2024-04-26T11:14:33.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:33.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.903173+0000", 2024-04-26T11:14:33.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0093891370000000005 2024-04-26T11:14:33.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:33.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.916373+0000", 2024-04-26T11:14:33.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013199407999999999 2024-04-26T11:14:33.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:33.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.916395+0000", 2024-04-26T11:14:33.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2447e-05 2024-04-26T11:14:33.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:33.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.916412+0000", 2024-04-26T11:14:33.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6688e-05 2024-04-26T11:14:33.275 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.276 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:33.276 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.276 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:130965 5.0 5:02e1af30:::benchmark_data_smithi029_44842_object130964:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:33.276 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:32.376041+0000", 2024-04-26T11:14:33.276 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.79087985599999999, 2024-04-26T11:14:33.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027463617999999999, 2024-04-26T11:14:33.276 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:33.276 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:33.276 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:33.276 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:33.276 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:33.276 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 130965 2024-04-26T11:14:33.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.277 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:33.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:33.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376041+0000", 2024-04-26T11:14:33.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:33.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376041+0000", 2024-04-26T11:14:33.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:33.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:33.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376040+0000", 2024-04-26T11:14:33.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:33.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:33.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376126+0000", 2024-04-26T11:14:33.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6070999999999996e-05 2024-04-26T11:14:33.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:33.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376133+0000", 2024-04-26T11:14:33.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7739999999999999e-06 2024-04-26T11:14:33.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:33.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376137+0000", 2024-04-26T11:14:33.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3669999999999999e-06 2024-04-26T11:14:33.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:33.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.378033+0000", 2024-04-26T11:14:33.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001895484 2024-04-26T11:14:33.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:33.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.378108+0000", 2024-04-26T11:14:33.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5201e-05 2024-04-26T11:14:33.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:33.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.378200+0000", 2024-04-26T11:14:33.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1712999999999994e-05 2024-04-26T11:14:33.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:33.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.381666+0000", 2024-04-26T11:14:33.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003466701 2024-04-26T11:14:33.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:33.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.403451+0000", 2024-04-26T11:14:33.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021784583 2024-04-26T11:14:33.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:33.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.403484+0000", 2024-04-26T11:14:33.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3265000000000001e-05 2024-04-26T11:14:33.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:33.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:33.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:33.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.403504+0000", 2024-04-26T11:14:33.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0123999999999999e-05 2024-04-26T11:14:33.282 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.282 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:33.282 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.282 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:33.282 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:33.282 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:33.282 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:14:33.284 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:33.281+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:33.284 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:33.383 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:33.381+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:33.523 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 55 16 133384 133368 151.541 147.375 0.00586911 0.00659626 2024-04-26T11:14:33.523 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:33.521+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:33.524 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:33.524 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:33.524 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:33.524 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:33.525 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:33.525 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:33.526 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:33.526 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:33.526 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:33.526 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:33.624 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:33.622+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:33.638 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:14:33.725 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:33.723+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:33.753 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:33.753 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:33.769 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:33.827 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:33.825+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:33.927 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:33.926+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:33.955 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:33.955 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:33.973 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:34.028 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~35s 2024-04-26T11:14:34.029 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:34.027+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:34.130 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:34.128+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:34.146 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:34.146 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:34.161 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:34.246 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:34.244+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:34.331 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:34.329+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:34.377 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:34.377 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:34.393 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:34.415 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 56 16 135663 135647 151.378 142.438 0.00332459 0.00660341 2024-04-26T11:14:34.434 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:34.432+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:34.533 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:34.531+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:34.609 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:34.610 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:34.623 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:34.634 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:34.633+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:34.737 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:34.735+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:34.808 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:34.809 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:34.824 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:34.836 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:34.835+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:34.938 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:34.936+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:35.038 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:35.036+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:35.039 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:35.039 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:35.054 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:35.139 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:35.138+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:35.240 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:35.238+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:35.274 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:35.274 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:35.287 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:35.341 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:35.339+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:35.415 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 57 16 137852 137836 151.122 136.812 0.00784133 0.00661469 2024-04-26T11:14:35.442 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:35.440+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:35.467 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:35.467 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:35.480 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:35.526 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:14:35.566 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:35.564+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:35.643 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:35.641+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:35.651 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:14:35.685 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:35.695 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:35.695 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:35.706 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:35.707 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:35.707 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:35.707 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:35.709 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:35.710 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:35.710 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:35.744 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:35.743+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:35.845 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:35.844+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:35.917 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:35.917 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:14:35.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:14:35.917 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:35.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.917 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:35.917 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:35.917 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.634916379000003, 2024-04-26T11:14:35.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:14:35.917 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:35.917 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:14:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:14:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:14:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:14:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:14:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:14:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:14:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:14:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:14:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:14:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:14:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:14:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:14:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:14:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:14:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:14:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:14:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:14:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:14:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:14:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:14:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.922 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.634266676999999, 2024-04-26T11:14:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:14:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:14:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.923 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:14:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:35.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:14:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:14:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:14:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:14:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:14:35.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:14:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:14:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:14:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:14:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:14:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:14:35.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:14:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:14:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:14:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:14:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:14:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:14:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:14:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:14:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:14:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.928 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.567624637999998, 2024-04-26T11:14:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:14:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:14:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:35.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:14:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:14:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:14:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:14:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:14:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:14:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:14:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:14:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:14:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:14:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:14:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:14:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:14:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:14:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:14:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.567528992, 2024-04-26T11:14:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:14:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:35.933 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:14:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:35.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:14:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:14:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:14:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:14:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:14:35.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:14:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:14:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:14:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:14:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:14:35.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:14:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:14:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:14:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:14:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:14:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.567397313000001, 2024-04-26T11:14:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:14:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:14:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:14:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:14:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:14:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:14:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:14:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:14:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:35.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:14:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:14:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:14:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:14:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:14:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:14:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:14:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:14:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.567288857000001, 2024-04-26T11:14:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:14:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:35.942 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:14:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:14:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:14:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:14:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:14:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:14:35.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:14:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:14:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:14:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:14:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:14:35.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:14:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:14:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:14:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:14:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:14:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.567187589, 2024-04-26T11:14:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:14:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:14:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:35.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:14:35.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:14:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:14:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:14:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:14:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:14:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:14:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:14:35.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:14:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:14:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:14:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:14:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:14:35.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:14:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:14:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:14:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:14:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:14:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:14:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:14:35.951 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.567118647999997, 2024-04-26T11:14:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:14:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:14:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.952 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:14:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:35.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:14:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:14:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:14:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:14:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:14:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:14:35.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:14:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:14:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:14:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:14:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:14:35.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:14:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:14:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:14:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:14:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:14:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:35.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:14:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:14:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:14:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:14:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:35.957 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.561123066999997, 2024-04-26T11:14:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:14:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:14:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:14:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:14:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:14:35.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:14:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:14:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:14:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:14:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:14:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:14:35.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:14:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:14:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:14:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:14:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:14:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:14:35.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:14:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:14:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:14:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:14:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:14:35.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:14:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:81256 5.8 5:1c0f3fd8:::benchmark_data_smithi029_44842_object81255:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 25.797663518, 2024-04-26T11:14:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026193673000000001, 2024-04-26T11:14:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:35.963 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 81256 2024-04-26T11:14:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116073+0000", 2024-04-26T11:14:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0114e-05 2024-04-26T11:14:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116079+0000", 2024-04-26T11:14:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8939999999999998e-06 2024-04-26T11:14:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116082+0000", 2024-04-26T11:14:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:14:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127501+0000", 2024-04-26T11:14:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011418281000000001 2024-04-26T11:14:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127639+0000", 2024-04-26T11:14:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013828899999999999 2024-04-26T11:14:35.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127782+0000", 2024-04-26T11:14:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014328299999999999 2024-04-26T11:14:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.134767+0000", 2024-04-26T11:14:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0069844140000000004 2024-04-26T11:14:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142160+0000", 2024-04-26T11:14:35.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007392839 2024-04-26T11:14:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142202+0000", 2024-04-26T11:14:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2797999999999999e-05 2024-04-26T11:14:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142237+0000", 2024-04-26T11:14:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4464000000000001e-05 2024-04-26T11:14:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90441 5.4 5:2b047885:::benchmark_data_smithi029_44842_object90440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.763500157999999, 2024-04-26T11:14:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026164084000000001, 2024-04-26T11:14:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90441 2024-04-26T11:14:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150206+0000", 2024-04-26T11:14:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150261+0000", 2024-04-26T11:14:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4580000000000003e-05 2024-04-26T11:14:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150269+0000", 2024-04-26T11:14:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9679999999999995e-06 2024-04-26T11:14:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150274+0000", 2024-04-26T11:14:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8470000000000003e-06 2024-04-26T11:14:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150312+0000", 2024-04-26T11:14:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7245e-05 2024-04-26T11:14:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150396+0000", 2024-04-26T11:14:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4778999999999996e-05 2024-04-26T11:14:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150491+0000", 2024-04-26T11:14:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4606999999999997e-05 2024-04-26T11:14:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.153991+0000", 2024-04-26T11:14:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035001339999999998 2024-04-26T11:14:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176295+0000", 2024-04-26T11:14:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022304280999999999 2024-04-26T11:14:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176335+0000", 2024-04-26T11:14:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:35.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176371+0000", 2024-04-26T11:14:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5448999999999999e-05 2024-04-26T11:14:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101754 5.e 5:7ca15a5c:::benchmark_data_smithi029_44842_object101753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.795175324999999, 2024-04-26T11:14:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039171048999999999, 2024-04-26T11:14:35.974 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101754 2024-04-26T11:14:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118604+0000", 2024-04-26T11:14:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3399000000000007e-05 2024-04-26T11:14:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118613+0000", 2024-04-26T11:14:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6989999999999992e-06 2024-04-26T11:14:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118618+0000", 2024-04-26T11:14:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3850000000000001e-06 2024-04-26T11:14:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118646+0000", 2024-04-26T11:14:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7878e-05 2024-04-26T11:14:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118720+0000", 2024-04-26T11:14:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3461999999999996e-05 2024-04-26T11:14:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118807+0000", 2024-04-26T11:14:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7269999999999996e-05 2024-04-26T11:14:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142317+0000", 2024-04-26T11:14:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023510105999999999 2024-04-26T11:14:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.143287+0000", 2024-04-26T11:14:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096983599999999996 2024-04-26T11:14:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157662+0000", 2024-04-26T11:14:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014375393 2024-04-26T11:14:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157702+0000", 2024-04-26T11:14:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0295e-05 2024-04-26T11:14:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:35.979 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101755 5.f 5:fa973a83:::benchmark_data_smithi029_44842_object101754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.795009628999999, 2024-04-26T11:14:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039139064000000001, 2024-04-26T11:14:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101755 2024-04-26T11:14:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:35.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118696+0000", 2024-04-26T11:14:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:35.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118766+0000", 2024-04-26T11:14:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9423000000000003e-05 2024-04-26T11:14:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118774+0000", 2024-04-26T11:14:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9710000000000004e-06 2024-04-26T11:14:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118779+0000", 2024-04-26T11:14:35.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5629999999999999e-06 2024-04-26T11:14:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118817+0000", 2024-04-26T11:14:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7771000000000001e-05 2024-04-26T11:14:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118929+0000", 2024-04-26T11:14:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011222699999999999 2024-04-26T11:14:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157661+0000", 2024-04-26T11:14:35.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038731120000000001 2024-04-26T11:14:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157757+0000", 2024-04-26T11:14:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6910000000000006e-05 2024-04-26T11:14:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157836+0000", 2024-04-26T11:14:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8727999999999996e-05 2024-04-26T11:14:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101758 5.4 5:2525a4eb:::benchmark_data_smithi029_44842_object101757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.792826777999998, 2024-04-26T11:14:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.03686739, 2024-04-26T11:14:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101758 2024-04-26T11:14:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:35.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120879+0000", 2024-04-26T11:14:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120971+0000", 2024-04-26T11:14:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2133999999999996e-05 2024-04-26T11:14:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120977+0000", 2024-04-26T11:14:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5509999999999999e-06 2024-04-26T11:14:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120981+0000", 2024-04-26T11:14:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.245e-06 2024-04-26T11:14:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121010+0000", 2024-04-26T11:14:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9084000000000001e-05 2024-04-26T11:14:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121083+0000", 2024-04-26T11:14:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2942999999999996e-05 2024-04-26T11:14:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121163+0000", 2024-04-26T11:14:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0197000000000005e-05 2024-04-26T11:14:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142822+0000", 2024-04-26T11:14:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021658535999999999 2024-04-26T11:14:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157674+0000", 2024-04-26T11:14:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014851573999999999 2024-04-26T11:14:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157714+0000", 2024-04-26T11:14:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0473999999999999e-05 2024-04-26T11:14:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:35.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157747+0000", 2024-04-26T11:14:35.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3278999999999998e-05 2024-04-26T11:14:35.990 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.990 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:35.990 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.990 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101760 5.4 5:2510211a:::benchmark_data_smithi029_44842_object101759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:35.990 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:35.990 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.792394432999998, 2024-04-26T11:14:35.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039182383000000001, 2024-04-26T11:14:35.990 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:35.990 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:35.990 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:35.991 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:35.991 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:35.991 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101760 2024-04-26T11:14:35.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.991 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:35.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:35.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:35.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:35.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:35.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:35.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:35.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:35.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:35.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121389+0000", 2024-04-26T11:14:35.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6667000000000003e-05 2024-04-26T11:14:35.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:35.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121394+0000", 2024-04-26T11:14:35.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0839999999999999e-06 2024-04-26T11:14:35.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:35.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121397+0000", 2024-04-26T11:14:35.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4489999999999999e-06 2024-04-26T11:14:35.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:35.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122921+0000", 2024-04-26T11:14:35.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001524067 2024-04-26T11:14:35.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:35.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.123010+0000", 2024-04-26T11:14:35.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8449000000000006e-05 2024-04-26T11:14:35.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:35.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140838+0000", 2024-04-26T11:14:35.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017828796000000001 2024-04-26T11:14:35.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:35.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157665+0000", 2024-04-26T11:14:35.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016826574 2024-04-26T11:14:35.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:35.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160407+0000", 2024-04-26T11:14:35.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027423970000000002 2024-04-26T11:14:35.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:35.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160456+0000", 2024-04-26T11:14:35.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8678999999999999e-05 2024-04-26T11:14:35.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:35.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160495+0000", 2024-04-26T11:14:35.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8658000000000002e-05 2024-04-26T11:14:35.995 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.996 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:35.996 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:35.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.996 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101761 5.e 5:70294421:::benchmark_data_smithi029_44842_object101760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:35.996 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:35.996 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.790970059999999, 2024-04-26T11:14:35.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035270448000000003, 2024-04-26T11:14:35.996 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:35.996 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:35.996 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:35.996 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:35.996 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:35.996 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101761 2024-04-26T11:14:35.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.997 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:35.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:35.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:35.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:35.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:35.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:35.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:35.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122736+0000", 2024-04-26T11:14:35.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:35.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:35.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122805+0000", 2024-04-26T11:14:35.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9076000000000001e-05 2024-04-26T11:14:35.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:35.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122811+0000", 2024-04-26T11:14:35.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:14:35.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:35.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122815+0000", 2024-04-26T11:14:35.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2860000000000001e-06 2024-04-26T11:14:35.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:35.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122842+0000", 2024-04-26T11:14:35.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6429000000000001e-05 2024-04-26T11:14:35.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:35.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122916+0000", 2024-04-26T11:14:35.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4122999999999995e-05 2024-04-26T11:14:35.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:35.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:35.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:36.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122997+0000", 2024-04-26T11:14:36.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1428999999999996e-05 2024-04-26T11:14:36.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:36.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142344+0000", 2024-04-26T11:14:36.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019346452 2024-04-26T11:14:36.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:36.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157934+0000", 2024-04-26T11:14:36.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015589911999999999 2024-04-26T11:14:36.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:36.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157975+0000", 2024-04-26T11:14:36.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1604999999999999e-05 2024-04-26T11:14:36.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:36.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.158007+0000", 2024-04-26T11:14:36.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1921000000000002e-05 2024-04-26T11:14:36.001 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.001 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:36.001 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.001 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110145 5.9 5:9b275f16:::benchmark_data_smithi029_44842_object110144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:36.001 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:36.002 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.765408422, 2024-04-26T11:14:36.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032844496000000001, 2024-04-26T11:14:36.002 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:36.002 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:36.002 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:36.002 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:36.002 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.002 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110145 2024-04-26T11:14:36.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.002 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:36.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:36.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:36.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:36.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:36.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:36.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:36.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:36.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148297+0000", 2024-04-26T11:14:36.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:36.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:36.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148325+0000", 2024-04-26T11:14:36.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7511000000000001e-05 2024-04-26T11:14:36.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:36.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148338+0000", 2024-04-26T11:14:36.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2808e-05 2024-04-26T11:14:36.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148345+0000", 2024-04-26T11:14:36.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7200000000000006e-06 2024-04-26T11:14:36.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:36.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149888+0000", 2024-04-26T11:14:36.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001542666 2024-04-26T11:14:36.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:36.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149977+0000", 2024-04-26T11:14:36.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9247999999999997e-05 2024-04-26T11:14:36.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:36.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181006+0000", 2024-04-26T11:14:36.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031028535999999999 2024-04-26T11:14:36.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:36.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181051+0000", 2024-04-26T11:14:36.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5393999999999999e-05 2024-04-26T11:14:36.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:36.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181143+0000", 2024-04-26T11:14:36.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1458000000000004e-05 2024-04-26T11:14:36.006 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.006 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:36.006 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.006 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110155 5.9 5:9ebc6158:::benchmark_data_smithi029_44842_object110154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:36.006 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:36.006 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.760332630000001, 2024-04-26T11:14:36.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027886826999999999, 2024-04-26T11:14:36.007 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:36.007 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:36.007 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:36.007 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:36.007 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.007 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110155 2024-04-26T11:14:36.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.007 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:36.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:36.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:36.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:36.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:36.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:36.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:36.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:36.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153373+0000", 2024-04-26T11:14:36.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:36.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153479+0000", 2024-04-26T11:14:36.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105728 2024-04-26T11:14:36.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:36.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153491+0000", 2024-04-26T11:14:36.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2207e-05 2024-04-26T11:14:36.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153499+0000", 2024-04-26T11:14:36.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7729999999999999e-06 2024-04-26T11:14:36.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:36.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153655+0000", 2024-04-26T11:14:36.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015573 2024-04-26T11:14:36.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:36.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153770+0000", 2024-04-26T11:14:36.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011562500000000001 2024-04-26T11:14:36.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:36.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181153+0000", 2024-04-26T11:14:36.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027382113 2024-04-26T11:14:36.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:36.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181195+0000", 2024-04-26T11:14:36.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1921000000000001e-05 2024-04-26T11:14:36.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:36.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181261+0000", 2024-04-26T11:14:36.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6402999999999994e-05 2024-04-26T11:14:36.011 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.011 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:36.011 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.011 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:129903 5.0 5:00b2d390:::benchmark_data_smithi029_44842_object129902:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:36.011 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:31.889868+0000", 2024-04-26T11:14:36.011 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.02383823, 2024-04-26T11:14:36.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026543418999999999, 2024-04-26T11:14:36.012 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:36.012 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:36.012 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:36.012 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:36.012 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.012 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 129903 2024-04-26T11:14:36.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.012 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:36.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:36.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889868+0000", 2024-04-26T11:14:36.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:36.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:36.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889868+0000", 2024-04-26T11:14:36.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:36.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:36.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889868+0000", 2024-04-26T11:14:36.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:36.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889936+0000", 2024-04-26T11:14:36.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7655000000000002e-05 2024-04-26T11:14:36.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:36.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889943+0000", 2024-04-26T11:14:36.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7319999999999998e-06 2024-04-26T11:14:36.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889948+0000", 2024-04-26T11:14:36.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5909999999999998e-06 2024-04-26T11:14:36.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:36.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.893510+0000", 2024-04-26T11:14:36.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035624540000000001 2024-04-26T11:14:36.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:36.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.893637+0000", 2024-04-26T11:14:36.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000126604 2024-04-26T11:14:36.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:36.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.893784+0000", 2024-04-26T11:14:36.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014726299999999999 2024-04-26T11:14:36.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:36.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.903173+0000", 2024-04-26T11:14:36.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0093891370000000005 2024-04-26T11:14:36.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:36.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.916373+0000", 2024-04-26T11:14:36.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013199407999999999 2024-04-26T11:14:36.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:36.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.916395+0000", 2024-04-26T11:14:36.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2447e-05 2024-04-26T11:14:36.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:36.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.916412+0000", 2024-04-26T11:14:36.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6688e-05 2024-04-26T11:14:36.016 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.016 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:36.016 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.017 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:130965 5.0 5:02e1af30:::benchmark_data_smithi029_44842_object130964:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:36.017 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:32.376041+0000", 2024-04-26T11:14:36.017 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.5376659959999999, 2024-04-26T11:14:36.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027463617999999999, 2024-04-26T11:14:36.017 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:36.017 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:36.017 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:36.017 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:36.017 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.017 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 130965 2024-04-26T11:14:36.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.017 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:36.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:36.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376041+0000", 2024-04-26T11:14:36.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:36.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:36.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376041+0000", 2024-04-26T11:14:36.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:36.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:36.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376040+0000", 2024-04-26T11:14:36.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:36.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376126+0000", 2024-04-26T11:14:36.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6070999999999996e-05 2024-04-26T11:14:36.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:36.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376133+0000", 2024-04-26T11:14:36.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7739999999999999e-06 2024-04-26T11:14:36.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376137+0000", 2024-04-26T11:14:36.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3669999999999999e-06 2024-04-26T11:14:36.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:36.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.378033+0000", 2024-04-26T11:14:36.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001895484 2024-04-26T11:14:36.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:36.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.378108+0000", 2024-04-26T11:14:36.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5201e-05 2024-04-26T11:14:36.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:36.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.378200+0000", 2024-04-26T11:14:36.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1712999999999994e-05 2024-04-26T11:14:36.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:36.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.381666+0000", 2024-04-26T11:14:36.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003466701 2024-04-26T11:14:36.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:36.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.403451+0000", 2024-04-26T11:14:36.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021784583 2024-04-26T11:14:36.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:36.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.403484+0000", 2024-04-26T11:14:36.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3265000000000001e-05 2024-04-26T11:14:36.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:36.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.403504+0000", 2024-04-26T11:14:36.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0123999999999999e-05 2024-04-26T11:14:36.022 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.022 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:36.022 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.022 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.022 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:36.022 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:36.024 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:36.024 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:36.021+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:36.124 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:36.122+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:36.209 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:36.209 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:36.209 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.209 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:139620 5.8 e41/16 5:11dbc9dc:::benchmark_data_smithi029_44842_object139619:head v 41'8716, mlcod=41'8713)", 2024-04-26T11:14:36.209 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:36.196755+0000", 2024-04-26T11:14:36.209 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.010793148000000001, 2024-04-26T11:14:36.209 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.010817303, 2024-04-26T11:14:36.210 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.210 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:36.210 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.210 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.210 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.210 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.196755+0000", 2024-04-26T11:14:36.210 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.210 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.210 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.210 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.210 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.196755+0000", 2024-04-26T11:14:36.210 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.210 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.210 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.210 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.211 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.196754+0000", 2024-04-26T11:14:36.211 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.211 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.211 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.211 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.211 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.196830+0000", 2024-04-26T11:14:36.211 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-05 2024-04-26T11:14:36.211 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.211 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.211 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.211 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.196839+0000", 2024-04-26T11:14:36.211 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9379999999999998e-06 2024-04-26T11:14:36.211 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.211 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.211 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.212 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.196845+0000", 2024-04-26T11:14:36.212 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4450000000000004e-06 2024-04-26T11:14:36.212 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.212 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.212 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.212 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.197307+0000", 2024-04-26T11:14:36.212 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000462736 2024-04-26T11:14:36.212 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.212 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.212 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.212 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.197324+0000", 2024-04-26T11:14:36.212 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6460000000000002e-05 2024-04-26T11:14:36.212 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.212 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.212 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.213 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.213 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.213 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:139621 5.0 e41/16 5:09b83d50:::benchmark_data_smithi029_44842_object139620:head v 41'8883, mlcod=41'8880)", 2024-04-26T11:14:36.213 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:36.198954+0000", 2024-04-26T11:14:36.213 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0085938720000000007, 2024-04-26T11:14:36.213 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0086585559999999995, 2024-04-26T11:14:36.213 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.213 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:36.213 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.213 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.213 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.214 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.198954+0000", 2024-04-26T11:14:36.214 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.214 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.214 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.214 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.198954+0000", 2024-04-26T11:14:36.214 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.214 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.214 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.214 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.198954+0000", 2024-04-26T11:14:36.214 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.214 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.215 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.215 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.199015+0000", 2024-04-26T11:14:36.215 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1226e-05 2024-04-26T11:14:36.215 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.215 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.215 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.215 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.199023+0000", 2024-04-26T11:14:36.215 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6319999999999997e-06 2024-04-26T11:14:36.215 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.215 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.215 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.215 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.199030+0000", 2024-04-26T11:14:36.215 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5100000000000004e-06 2024-04-26T11:14:36.215 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.215 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.215 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.216 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.199621+0000", 2024-04-26T11:14:36.216 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000591513 2024-04-26T11:14:36.216 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.216 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.216 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.216 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.199641+0000", 2024-04-26T11:14:36.216 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9534999999999998e-05 2024-04-26T11:14:36.216 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.216 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.216 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.216 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.216 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.216 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:139622 5.0 e41/16 5:09e567b5:::benchmark_data_smithi029_44842_object139621:head v 41'8884, mlcod=41'8880)", 2024-04-26T11:14:36.216 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:36.200647+0000", 2024-04-26T11:14:36.217 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00690086, 2024-04-26T11:14:36.217 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0070010439999999997, 2024-04-26T11:14:36.217 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.217 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:36.217 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.217 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.217 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.217 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.200647+0000", 2024-04-26T11:14:36.217 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.217 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.217 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.217 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.217 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.200647+0000", 2024-04-26T11:14:36.217 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.217 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.218 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.218 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.218 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.200647+0000", 2024-04-26T11:14:36.218 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.218 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.218 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.218 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.218 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.200768+0000", 2024-04-26T11:14:36.218 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000121792 2024-04-26T11:14:36.218 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.218 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.218 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.218 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.200783+0000", 2024-04-26T11:14:36.218 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4715999999999999e-05 2024-04-26T11:14:36.219 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.219 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.219 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.219 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.200789+0000", 2024-04-26T11:14:36.219 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8969999999999996e-06 2024-04-26T11:14:36.219 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.219 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.219 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.219 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.201734+0000", 2024-04-26T11:14:36.219 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000945187 2024-04-26T11:14:36.219 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.219 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.219 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.219 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.201756+0000", 2024-04-26T11:14:36.219 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1319e-05 2024-04-26T11:14:36.219 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.220 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.220 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.220 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.220 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.220 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:139623 5.8 e41/16 5:1292c883:::benchmark_data_smithi029_44842_object139622:head v 41'8717, mlcod=41'8714)", 2024-04-26T11:14:36.220 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:36.200795+0000", 2024-04-26T11:14:36.220 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0067526629999999999, 2024-04-26T11:14:36.220 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0068866700000000001, 2024-04-26T11:14:36.220 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.220 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:36.220 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.220 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.220 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.220 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.200795+0000", 2024-04-26T11:14:36.221 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.221 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.221 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.221 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.221 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.200795+0000", 2024-04-26T11:14:36.221 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.221 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.221 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.221 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.221 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.200795+0000", 2024-04-26T11:14:36.221 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.221 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.221 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.221 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.221 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.200840+0000", 2024-04-26T11:14:36.222 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4904999999999998e-05 2024-04-26T11:14:36.222 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.222 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.222 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.222 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.200847+0000", 2024-04-26T11:14:36.222 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1210000000000001e-06 2024-04-26T11:14:36.222 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.222 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.222 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.222 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.200852+0000", 2024-04-26T11:14:36.222 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4840000000000003e-06 2024-04-26T11:14:36.222 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.222 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.222 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.223 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.201717+0000", 2024-04-26T11:14:36.223 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00086499400000000001 2024-04-26T11:14:36.223 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.223 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.223 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.223 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.201734+0000", 2024-04-26T11:14:36.223 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6997999999999999e-05 2024-04-26T11:14:36.223 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.223 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.223 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.223 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.223 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.223 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:139628 5.4 e41/16 5:2b883cbc:::benchmark_data_smithi029_44842_object139627:head v 41'8653, mlcod=41'8650)", 2024-04-26T11:14:36.223 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:36.200857+0000", 2024-04-26T11:14:36.224 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0066905869999999996, 2024-04-26T11:14:36.224 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0068594229999999999, 2024-04-26T11:14:36.224 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.224 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:36.224 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.224 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.224 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.224 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.200857+0000", 2024-04-26T11:14:36.224 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.224 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.224 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.224 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.224 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.200857+0000", 2024-04-26T11:14:36.224 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.224 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.225 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.225 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.225 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.200857+0000", 2024-04-26T11:14:36.225 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.225 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.225 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.225 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.225 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.200889+0000", 2024-04-26T11:14:36.225 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2036000000000003e-05 2024-04-26T11:14:36.225 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.225 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.225 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.225 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.200895+0000", 2024-04-26T11:14:36.225 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9889999999999997e-06 2024-04-26T11:14:36.226 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.226 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.226 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.226 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.200900+0000", 2024-04-26T11:14:36.226 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.9010000000000002e-06 2024-04-26T11:14:36.226 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.226 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.226 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.226 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.200933+0000", 2024-04-26T11:14:36.226 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2909e-05 2024-04-26T11:14:36.226 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.226 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.226 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.226 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.200945+0000", 2024-04-26T11:14:36.226 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1715999999999999e-05 2024-04-26T11:14:36.227 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.227 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.227 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.227 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.227 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.227 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:139624 5.0 e41/16 5:08cd492f:::benchmark_data_smithi029_44842_object139623:head v 41'8885, mlcod=41'8880)", 2024-04-26T11:14:36.227 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:36.202360+0000", 2024-04-26T11:14:36.227 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.005187713, 2024-04-26T11:14:36.227 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053895360000000003, 2024-04-26T11:14:36.227 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.227 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:36.227 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.227 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.227 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.227 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202360+0000", 2024-04-26T11:14:36.228 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.228 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.228 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.228 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.228 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202360+0000", 2024-04-26T11:14:36.228 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.228 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.228 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.228 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.228 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202360+0000", 2024-04-26T11:14:36.228 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.228 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.229 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.229 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.229 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202418+0000", 2024-04-26T11:14:36.229 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8257999999999997e-05 2024-04-26T11:14:36.229 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.229 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.229 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.229 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202427+0000", 2024-04-26T11:14:36.229 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4730000000000006e-06 2024-04-26T11:14:36.229 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.229 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.229 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.229 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202434+0000", 2024-04-26T11:14:36.229 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5350000000000001e-06 2024-04-26T11:14:36.229 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.230 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.230 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.230 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.203815+0000", 2024-04-26T11:14:36.230 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0013811610000000001 2024-04-26T11:14:36.230 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.230 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.230 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.230 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.203833+0000", 2024-04-26T11:14:36.230 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8039000000000001e-05 2024-04-26T11:14:36.230 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.230 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.230 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.230 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.230 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.231 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:139625 5.8 e41/16 5:1650acf6:::benchmark_data_smithi029_44842_object139624:head v 41'8718, mlcod=41'8714)", 2024-04-26T11:14:36.231 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:36.202601+0000", 2024-04-26T11:14:36.231 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.004946565, 2024-04-26T11:14:36.231 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0051814299999999999, 2024-04-26T11:14:36.231 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.231 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:36.231 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.231 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.231 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.231 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202601+0000", 2024-04-26T11:14:36.231 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.231 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.231 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.231 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.231 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202601+0000", 2024-04-26T11:14:36.232 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.232 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.232 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.232 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.232 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202601+0000", 2024-04-26T11:14:36.232 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.232 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.232 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.232 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.232 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202661+0000", 2024-04-26T11:14:36.232 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0170999999999997e-05 2024-04-26T11:14:36.232 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.232 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.232 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.232 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202671+0000", 2024-04-26T11:14:36.233 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.5189999999999998e-06 2024-04-26T11:14:36.233 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.233 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.233 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.233 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202678+0000", 2024-04-26T11:14:36.233 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1280000000000002e-06 2024-04-26T11:14:36.233 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.233 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.233 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.233 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.203804+0000", 2024-04-26T11:14:36.233 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001126541 2024-04-26T11:14:36.233 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.233 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.233 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.233 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.203824+0000", 2024-04-26T11:14:36.234 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9400000000000001e-05 2024-04-26T11:14:36.234 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.234 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.234 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.234 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.234 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.234 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:139633 5.b e41/16 5:d10011ef:::benchmark_data_smithi029_44842_object139632:head v 41'8847, mlcod=41'8845)", 2024-04-26T11:14:36.234 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:36.202683+0000", 2024-04-26T11:14:36.234 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0048646389999999996, 2024-04-26T11:14:36.234 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0051323549999999999, 2024-04-26T11:14:36.234 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.234 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:36.234 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.234 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.234 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.235 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202683+0000", 2024-04-26T11:14:36.235 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.235 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.235 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.235 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202683+0000", 2024-04-26T11:14:36.235 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.235 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.235 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.236 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202683+0000", 2024-04-26T11:14:36.236 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.236 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.236 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.236 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.236 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202736+0000", 2024-04-26T11:14:36.237 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3498000000000002e-05 2024-04-26T11:14:36.237 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.237 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.237 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.237 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202745+0000", 2024-04-26T11:14:36.237 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0669999999999992e-06 2024-04-26T11:14:36.237 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.237 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.237 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.237 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202750+0000", 2024-04-26T11:14:36.237 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7799999999999997e-06 2024-04-26T11:14:36.238 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.238 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.238 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.238 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202790+0000", 2024-04-26T11:14:36.238 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9440000000000002e-05 2024-04-26T11:14:36.238 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.239 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.239 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.239 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202810+0000", 2024-04-26T11:14:36.239 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9873000000000001e-05 2024-04-26T11:14:36.239 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.239 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.239 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.240 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.240 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:139634 5.5 5:a0bfde61:::benchmark_data_smithi029_44842_object139633:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T11:14:36.240 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:36.202877+0000", 2024-04-26T11:14:36.240 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0046712469999999999, 2024-04-26T11:14:36.240 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0049781219999999998, 2024-04-26T11:14:36.240 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.240 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:36.240 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:36.240 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:36.240 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.240 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 139634 2024-04-26T11:14:36.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.240 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.240 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.240 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.241 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202877+0000", 2024-04-26T11:14:36.241 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.241 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.241 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.241 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.241 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202877+0000", 2024-04-26T11:14:36.241 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.241 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.241 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.241 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.241 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202876+0000", 2024-04-26T11:14:36.241 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:36.241 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.241 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.241 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.241 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202957+0000", 2024-04-26T11:14:36.242 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.1062000000000004e-05 2024-04-26T11:14:36.242 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.242 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.242 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.242 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202968+0000", 2024-04-26T11:14:36.242 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1693e-05 2024-04-26T11:14:36.242 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.242 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.242 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.242 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.202977+0000", 2024-04-26T11:14:36.242 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3100000000000001e-06 2024-04-26T11:14:36.242 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.243 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.243 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.243 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.203015+0000", 2024-04-26T11:14:36.243 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8099999999999998e-05 2024-04-26T11:14:36.243 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.243 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.243 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.243 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.203109+0000", 2024-04-26T11:14:36.243 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4637999999999998e-05 2024-04-26T11:14:36.243 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.243 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.243 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.243 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.243 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.243 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:139627 5.8 e41/16 5:1afa99ba:::benchmark_data_smithi029_44842_object139626:head v 41'8719, mlcod=41'8714)", 2024-04-26T11:14:36.244 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:36.204469+0000", 2024-04-26T11:14:36.244 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.003079409, 2024-04-26T11:14:36.244 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0034249409999999999, 2024-04-26T11:14:36.244 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.244 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:36.244 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.244 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.244 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.244 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.204469+0000", 2024-04-26T11:14:36.244 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.244 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.244 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.244 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.244 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.204469+0000", 2024-04-26T11:14:36.244 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.245 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.245 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.245 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.245 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.204468+0000", 2024-04-26T11:14:36.245 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.245 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.245 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.245 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.245 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.204506+0000", 2024-04-26T11:14:36.245 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.799e-05 2024-04-26T11:14:36.245 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.245 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.245 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.246 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.204515+0000", 2024-04-26T11:14:36.246 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6780000000000006e-06 2024-04-26T11:14:36.246 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.246 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.246 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.246 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.204521+0000", 2024-04-26T11:14:36.246 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5989999999999998e-06 2024-04-26T11:14:36.246 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.246 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.246 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.246 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.205743+0000", 2024-04-26T11:14:36.246 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001222028 2024-04-26T11:14:36.247 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.247 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.247 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.247 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.205755+0000", 2024-04-26T11:14:36.247 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1694e-05 2024-04-26T11:14:36.247 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.247 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.247 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.247 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.247 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.247 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:139636 5.4 e41/16 5:25f3b4ac:::benchmark_data_smithi029_44842_object139635:head v 41'8654, mlcod=41'8651)", 2024-04-26T11:14:36.247 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:36.204620+0000", 2024-04-26T11:14:36.247 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0029280970000000002, 2024-04-26T11:14:36.247 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0033066459999999999, 2024-04-26T11:14:36.248 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.248 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:36.248 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.248 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.248 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.248 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.204620+0000", 2024-04-26T11:14:36.249 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.249 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.249 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.249 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.249 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.204620+0000", 2024-04-26T11:14:36.249 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.250 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.250 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.250 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.250 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.204619+0000", 2024-04-26T11:14:36.250 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.250 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.251 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.251 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.251 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.204683+0000", 2024-04-26T11:14:36.251 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3767000000000001e-05 2024-04-26T11:14:36.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.251 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.251 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.251 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.204691+0000", 2024-04-26T11:14:36.251 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2060000000000007e-06 2024-04-26T11:14:36.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.251 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.251 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.251 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.204698+0000", 2024-04-26T11:14:36.251 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1630000000000001e-06 2024-04-26T11:14:36.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.252 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.252 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.252 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.204735+0000", 2024-04-26T11:14:36.252 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7049999999999999e-05 2024-04-26T11:14:36.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.252 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.252 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.253 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.204747+0000", 2024-04-26T11:14:36.253 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2670999999999999e-05 2024-04-26T11:14:36.253 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.253 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.253 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.253 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.253 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.253 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:139638 5.c 5:34b43957:::benchmark_data_smithi029_44842_object139637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T11:14:36.253 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:36.205979+0000", 2024-04-26T11:14:36.254 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.001569373, 2024-04-26T11:14:36.254 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019830220000000001, 2024-04-26T11:14:36.254 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.254 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:36.254 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:36.254 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:36.254 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.254 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 139638 2024-04-26T11:14:36.254 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.254 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.254 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.254 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.254 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.205979+0000", 2024-04-26T11:14:36.255 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.255 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.255 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.255 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.255 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.205979+0000", 2024-04-26T11:14:36.255 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.255 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.255 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.255 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.255 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.205977+0000", 2024-04-26T11:14:36.255 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999986 2024-04-26T11:14:36.255 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.255 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.255 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.255 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.206078+0000", 2024-04-26T11:14:36.256 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100758 2024-04-26T11:14:36.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.256 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.256 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.256 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.206090+0000", 2024-04-26T11:14:36.256 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2394e-05 2024-04-26T11:14:36.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.256 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.256 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.256 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.206098+0000", 2024-04-26T11:14:36.256 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5089999999999996e-06 2024-04-26T11:14:36.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.256 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.256 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.256 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.206143+0000", 2024-04-26T11:14:36.256 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5271000000000001e-05 2024-04-26T11:14:36.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.257 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.257 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.257 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.206296+0000", 2024-04-26T11:14:36.257 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015286600000000001 2024-04-26T11:14:36.257 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.257 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.257 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.257 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.257 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:139629 5.8 e41/16)", 2024-04-26T11:14:36.257 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:36.206179+0000", 2024-04-26T11:14:36.257 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.001369086, 2024-04-26T11:14:36.257 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001817358, 2024-04-26T11:14:36.257 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.258 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:36.258 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.258 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.258 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.258 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.206179+0000", 2024-04-26T11:14:36.258 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.258 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.259 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.259 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.259 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.206179+0000", 2024-04-26T11:14:36.259 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.259 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.259 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.259 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.206178+0000", 2024-04-26T11:14:36.259 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.259 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.260 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.260 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.206248+0000", 2024-04-26T11:14:36.260 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.991e-05 2024-04-26T11:14:36.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.260 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.260 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.260 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.206256+0000", 2024-04-26T11:14:36.261 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0779999999999996e-06 2024-04-26T11:14:36.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.261 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.261 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.261 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.206265+0000", 2024-04-26T11:14:36.261 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.8759999999999994e-06 2024-04-26T11:14:36.261 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.261 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.261 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.261 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.261 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:139630 5.0 e41/16)", 2024-04-26T11:14:36.261 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:36.207417+0000", 2024-04-26T11:14:36.261 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00013086799999999999, 2024-04-26T11:14:36.262 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00060400700000000005, 2024-04-26T11:14:36.262 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.262 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:36.262 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.262 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.262 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.262 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.207417+0000", 2024-04-26T11:14:36.263 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.263 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.263 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.263 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.263 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.207417+0000", 2024-04-26T11:14:36.263 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.263 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.263 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.263 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.263 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.207417+0000", 2024-04-26T11:14:36.263 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.264 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.264 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.264 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.264 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.207490+0000", 2024-04-26T11:14:36.264 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3195000000000006e-05 2024-04-26T11:14:36.264 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.264 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.264 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.264 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.207498+0000", 2024-04-26T11:14:36.264 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:14:36.264 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.265 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.265 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.265 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:36.207503+0000", 2024-04-26T11:14:36.265 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5079999999999999e-06 2024-04-26T11:14:36.265 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.265 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.265 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.265 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.265 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:14:36.265 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 14 2024-04-26T11:14:36.265 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:36.267 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:36.267 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:36.264+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:36.367 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:36.366+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:36.415 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 58 16 140087 140071 150.925 139.688 0.00663045 0.00662315 2024-04-26T11:14:36.468 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:36.466+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:36.494 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:36.495 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:14:36.495 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:14:36.495 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:14:36.495 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:36.508 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:36.569 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:36.567+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:36.643 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:14:36.671 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:36.669+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:36.690 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:36.690 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:14:36.690 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:14:36.690 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:36.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.691 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:36.691 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:36.691 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 43.415810749999999, 2024-04-26T11:14:36.691 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:14:36.691 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.691 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:36.691 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:36.691 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:36.691 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.691 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:14:36.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.691 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.692 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.692 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:36.692 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.692 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.692 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:36.692 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.692 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.692 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:14:36.693 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.693 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.693 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:14:36.693 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:14:36.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.693 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.693 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:14:36.693 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:14:36.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.693 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.693 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:14:36.694 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:14:36.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.694 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.694 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:14:36.694 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:14:36.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.694 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.694 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:14:36.694 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:14:36.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.694 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:36.695 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:14:36.695 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:14:36.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.695 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:36.695 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:14:36.695 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:14:36.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.695 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:36.695 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:14:36.695 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:14:36.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.695 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:36.696 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:14:36.696 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:14:36.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.696 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:36.696 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:14:36.696 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:14:36.696 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.696 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.696 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.696 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:36.697 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:36.697 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 43.414999184999999, 2024-04-26T11:14:36.697 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:14:36.697 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.697 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:36.697 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:36.697 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:36.697 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.697 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:14:36.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.697 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.697 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.698 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:36.698 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.698 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.698 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.698 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:36.698 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.698 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.698 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.698 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:36.698 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:36.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.698 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.699 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.699 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:14:36.699 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:14:36.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.699 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.699 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:14:36.699 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:14:36.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.699 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.699 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:14:36.699 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:14:36.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.700 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.700 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:14:36.700 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:14:36.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.700 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.700 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:14:36.700 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:14:36.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.700 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:36.700 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:14:36.700 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:14:36.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.701 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:36.701 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:14:36.701 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:14:36.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.701 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:36.701 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:14:36.701 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:14:36.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.701 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:36.701 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:14:36.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:14:36.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.702 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:36.702 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:14:36.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:14:36.702 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.702 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.702 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.702 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:36.702 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:36.702 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 43.407812348, 2024-04-26T11:14:36.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:14:36.703 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.703 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:36.703 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:36.703 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:36.703 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.703 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:14:36.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.703 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:36.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:36.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:14:36.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:36.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:14:36.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:14:36.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:14:36.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:14:36.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:14:36.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:14:36.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:14:36.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:14:36.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:14:36.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:14:36.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:36.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:14:36.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:14:36.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:36.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:14:36.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:14:36.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:36.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:14:36.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:14:36.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:36.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:14:36.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:14:36.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:36.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:14:36.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:14:36.708 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.708 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.708 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.708 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:36.708 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:36.708 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 43.407271469000001, 2024-04-26T11:14:36.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:14:36.709 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.709 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:36.709 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:36.709 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:36.709 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.709 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:14:36.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.709 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:36.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:36.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:36.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:14:36.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:14:36.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.711 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.711 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:14:36.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:14:36.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.711 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.711 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:14:36.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:14:36.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.711 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.711 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:14:36.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:14:36.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:14:36.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:14:36.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:36.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:14:36.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:14:36.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:36.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:14:36.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:14:36.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:36.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:14:36.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:14:36.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:36.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:14:36.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:14:36.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:36.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:14:36.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:14:36.714 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.714 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.714 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.714 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:36.714 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:36.714 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 39.364087022, 2024-04-26T11:14:36.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:14:36.714 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.714 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:36.715 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:36.715 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:36.715 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.715 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:14:36.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.715 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:36.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:36.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.716 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:14:36.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:36.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.716 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:14:36.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:14:36.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.716 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:14:36.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:14:36.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:14:36.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:14:36.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:14:36.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:14:36.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:14:36.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:14:36.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:36.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:14:36.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:14:36.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:36.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:14:36.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:14:36.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:14:36.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:14:36.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:36.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:14:36.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:14:36.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:14:36.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:14:36.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:36.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:14:36.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:14:36.720 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.720 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.720 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.720 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:36.720 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:36.720 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 39.361893682000002, 2024-04-26T11:14:36.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:14:36.720 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.720 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:36.721 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:36.721 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:36.721 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.721 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:14:36.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.721 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:36.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:36.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:14:36.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:36.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:14:36.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:14:36.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:14:36.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:14:36.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:14:36.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:14:36.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:14:36.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:14:36.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:14:36.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:14:36.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:36.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:14:36.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:14:36.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:36.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:14:36.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:14:36.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:14:36.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:14:36.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:36.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:14:36.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:14:36.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:14:36.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:14:36.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:36.726 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:14:36.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:14:36.726 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.726 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.726 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.726 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:36.726 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:36.726 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 39.356681858000002, 2024-04-26T11:14:36.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:14:36.726 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.726 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:36.727 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:36.727 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:36.727 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.727 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:14:36.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.727 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:36.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:36.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:14:36.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:36.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:14:36.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:14:36.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:14:36.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:14:36.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:14:36.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:14:36.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:14:36.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:14:36.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:14:36.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:14:36.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:36.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:14:36.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:14:36.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:36.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:14:36.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:14:36.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:14:36.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:14:36.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:36.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:14:36.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:14:36.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:14:36.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:14:36.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:36.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:14:36.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:14:36.732 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.732 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.732 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.732 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:36.732 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:36.732 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 39.340233157999997, 2024-04-26T11:14:36.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:14:36.732 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.732 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:36.732 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:36.733 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:36.733 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.733 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:14:36.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.733 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:36.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:36.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:14:36.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:36.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:14:36.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:14:36.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:14:36.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:14:36.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:14:36.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:14:36.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:14:36.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:14:36.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:36.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:14:36.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:14:36.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:14:36.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:14:36.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:36.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:14:36.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:14:36.736 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.736 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.736 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.737 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:36.737 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:36.737 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 39.338535653000001, 2024-04-26T11:14:36.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:14:36.737 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.737 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:36.737 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:36.737 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:36.737 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.737 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:14:36.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.737 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:36.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:36.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:14:36.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:36.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:14:36.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:14:36.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:14:36.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:14:36.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:14:36.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:14:36.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:14:36.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:14:36.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:36.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:14:36.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:14:36.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:14:36.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:14:36.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:36.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:14:36.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:14:36.741 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.741 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.741 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.741 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:36.741 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:36.741 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 39.338471351000003, 2024-04-26T11:14:36.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:14:36.741 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.742 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:36.742 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:36.742 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:36.742 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.742 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:14:36.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.742 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:36.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:36.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:36.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:14:36.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:14:36.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:14:36.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:14:36.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:14:36.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:14:36.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:14:36.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:14:36.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:36.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:14:36.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:14:36.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:14:36.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:14:36.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:14:36.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:14:36.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:36.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:14:36.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:14:36.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:36.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:14:36.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:14:36.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:36.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:14:36.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:14:36.747 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.747 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.747 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.747 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:36.747 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:36.747 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 39.338417127, 2024-04-26T11:14:36.747 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:14:36.747 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.747 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:36.747 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:36.747 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:36.747 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.748 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:14:36.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.748 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:36.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:36.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:36.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:14:36.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:14:36.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:14:36.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:14:36.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:14:36.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:14:36.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:14:36.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:14:36.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:36.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:14:36.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:14:36.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:14:36.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:14:36.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:14:36.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:14:36.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:36.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:14:36.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:14:36.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:36.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:14:36.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:36.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:36.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:14:36.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:14:36.752 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.752 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.752 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.752 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:36.753 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:36.753 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 39.338372614999997, 2024-04-26T11:14:36.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:14:36.753 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.753 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:36.753 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:36.753 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:36.753 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.753 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:14:36.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.753 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:36.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:36.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:14:36.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:14:36.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:14:36.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:14:36.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:14:36.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:14:36.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:14:36.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:14:36.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:14:36.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.756 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:36.756 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:14:36.756 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:14:36.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.756 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.756 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:14:36.756 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:14:36.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.756 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.756 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:14:36.756 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:14:36.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.757 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:36.757 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:14:36.757 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:14:36.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.757 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:36.757 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:14:36.757 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:14:36.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.757 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:36.757 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:14:36.758 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:14:36.758 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.758 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.758 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.758 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:36.758 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:36.758 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 39.334151613000003, 2024-04-26T11:14:36.758 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:14:36.758 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.758 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:36.758 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:36.758 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:36.759 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.759 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:14:36.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.759 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.759 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:36.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.759 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:36.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.760 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:14:36.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:14:36.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.760 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:14:36.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:14:36.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.760 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:14:36.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:14:36.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.761 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.761 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:14:36.761 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:14:36.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.761 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.761 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:14:36.761 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:14:36.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.761 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:36.761 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:14:36.762 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:14:36.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.762 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.762 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:14:36.762 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:14:36.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.762 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.762 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:14:36.762 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:14:36.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.762 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:36.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:14:36.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:14:36.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.763 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:36.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:14:36.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:14:36.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.763 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:36.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:14:36.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:14:36.763 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.763 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.763 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.764 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83360 5.2 5:42f8bfcd:::benchmark_data_smithi029_44842_object83359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:36.764 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:36.764 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.646912242999999, 2024-04-26T11:14:36.764 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022279782000000001, 2024-04-26T11:14:36.764 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.764 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:36.764 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:36.764 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:36.764 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.764 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83360 2024-04-26T11:14:36.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.764 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:36.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:36.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:36.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.766 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.766 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039700+0000", 2024-04-26T11:14:36.766 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5541000000000002e-05 2024-04-26T11:14:36.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.766 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.766 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.766 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039706+0000", 2024-04-26T11:14:36.766 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3680000000000001e-06 2024-04-26T11:14:36.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.766 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.766 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.766 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039709+0000", 2024-04-26T11:14:36.766 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4659999999999999e-06 2024-04-26T11:14:36.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.767 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.767 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056305+0000", 2024-04-26T11:14:36.767 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016595649000000001 2024-04-26T11:14:36.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.767 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.767 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056487+0000", 2024-04-26T11:14:36.767 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000181886 2024-04-26T11:14:36.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.767 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:36.767 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061809+0000", 2024-04-26T11:14:36.767 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053223259999999996 2024-04-26T11:14:36.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.768 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:36.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061852+0000", 2024-04-26T11:14:36.768 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2738999999999999e-05 2024-04-26T11:14:36.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.768 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:36.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061925+0000", 2024-04-26T11:14:36.768 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3180000000000001e-05 2024-04-26T11:14:36.768 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.768 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.768 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.769 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83364 5.2 5:42c5cd8c:::benchmark_data_smithi029_44842_object83363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:36.769 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:36.769 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.646496503000002, 2024-04-26T11:14:36.769 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022695336, 2024-04-26T11:14:36.769 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.769 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:36.769 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:36.769 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:36.769 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.769 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83364 2024-04-26T11:14:36.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.769 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.769 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.770 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:36.770 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.770 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.770 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.770 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:36.770 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.770 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.770 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.770 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040060+0000", 2024-04-26T11:14:36.770 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.771 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.771 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.771 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040086+0000", 2024-04-26T11:14:36.771 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5482000000000001e-05 2024-04-26T11:14:36.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.771 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.771 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.771 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040093+0000", 2024-04-26T11:14:36.771 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6409999999999996e-06 2024-04-26T11:14:36.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.771 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.771 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.771 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040098+0000", 2024-04-26T11:14:36.771 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879999999999996e-06 2024-04-26T11:14:36.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.772 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.772 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.772 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058292+0000", 2024-04-26T11:14:36.772 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018193504999999999 2024-04-26T11:14:36.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.772 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.772 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.772 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058412+0000", 2024-04-26T11:14:36.772 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011979199999999999 2024-04-26T11:14:36.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.772 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.772 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:36.772 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062642+0000", 2024-04-26T11:14:36.772 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042299449999999997 2024-04-26T11:14:36.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.773 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.773 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:36.773 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062688+0000", 2024-04-26T11:14:36.773 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6859e-05 2024-04-26T11:14:36.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.773 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.773 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:36.773 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062756+0000", 2024-04-26T11:14:36.773 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7995000000000002e-05 2024-04-26T11:14:36.773 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.773 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.773 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.773 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.774 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:129903 5.0 e40/16 5:00b2d390:::benchmark_data_smithi029_44842_object129902:head v 40'8238, mlcod=40'8234)", 2024-04-26T11:14:36.774 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:36.774 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.7927471199999996, 2024-04-26T11:14:36.774 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.02228639, 2024-04-26T11:14:36.774 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.774 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:36.774 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.774 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.774 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.774 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:36.774 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.774 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.774 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.775 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:36.775 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.775 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.775 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.775 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:36.775 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:36.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.775 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.775 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.775 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893874+0000", 2024-04-26T11:14:36.775 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3849000000000005e-05 2024-04-26T11:14:36.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.775 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893884+0000", 2024-04-26T11:14:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0149000000000001e-05 2024-04-26T11:14:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893892+0000", 2024-04-26T11:14:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0299999999999994e-06 2024-04-26T11:14:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.894003+0000", 2024-04-26T11:14:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011128099999999999 2024-04-26T11:14:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.777 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.777 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.894024+0000", 2024-04-26T11:14:36.777 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0979e-05 2024-04-26T11:14:36.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.777 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:36.777 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.916077+0000", 2024-04-26T11:14:36.777 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022053461 2024-04-26T11:14:36.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.777 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:36.777 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.916097+0000", 2024-04-26T11:14:36.777 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9389999999999999e-05 2024-04-26T11:14:36.777 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.778 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.778 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.778 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.778 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:130959 5.7 5:ee32f7f7:::benchmark_data_smithi029_44842_object130958:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:36.778 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:32.375500+0000", 2024-04-26T11:14:36.778 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.3110578479999999, 2024-04-26T11:14:36.778 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022235456000000001, 2024-04-26T11:14:36.778 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.778 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:36.778 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:36.778 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:36.778 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.778 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 130959 2024-04-26T11:14:36.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.779 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.779 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.779 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375500+0000", 2024-04-26T11:14:36.779 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.779 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.779 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375500+0000", 2024-04-26T11:14:36.779 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.779 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.780 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375499+0000", 2024-04-26T11:14:36.780 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.780 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.780 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375530+0000", 2024-04-26T11:14:36.780 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0556999999999999e-05 2024-04-26T11:14:36.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.780 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.780 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375537+0000", 2024-04-26T11:14:36.780 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7849999999999992e-06 2024-04-26T11:14:36.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.781 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.781 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375543+0000", 2024-04-26T11:14:36.781 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6060000000000002e-06 2024-04-26T11:14:36.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.781 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.781 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.781 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.377410+0000", 2024-04-26T11:14:36.781 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0018671149999999999 2024-04-26T11:14:36.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.781 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.781 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.781 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.377544+0000", 2024-04-26T11:14:36.781 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013380999999999999 2024-04-26T11:14:36.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.781 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.782 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:36.782 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397624+0000", 2024-04-26T11:14:36.782 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020079889 2024-04-26T11:14:36.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.782 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:36.782 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397662+0000", 2024-04-26T11:14:36.782 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8269999999999998e-05 2024-04-26T11:14:36.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.782 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:36.782 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397735+0000", 2024-04-26T11:14:36.782 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3017999999999998e-05 2024-04-26T11:14:36.782 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.782 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.783 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.783 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.783 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:130960 5.0 e40/16 5:042df53c:::benchmark_data_smithi029_44842_object130959:head v 40'8310, mlcod=40'8308)", 2024-04-26T11:14:36.783 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:32.375983+0000", 2024-04-26T11:14:36.783 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.3105749380000002, 2024-04-26T11:14:36.783 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.021699000999999999, 2024-04-26T11:14:36.783 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.783 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:36.783 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.783 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.783 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.783 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375983+0000", 2024-04-26T11:14:36.783 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.784 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.784 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375983+0000", 2024-04-26T11:14:36.784 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.784 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.784 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375982+0000", 2024-04-26T11:14:36.784 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:36.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.784 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.784 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376039+0000", 2024-04-26T11:14:36.784 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7240000000000001e-05 2024-04-26T11:14:36.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.785 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.785 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376047+0000", 2024-04-26T11:14:36.785 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6699999999999994e-06 2024-04-26T11:14:36.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.785 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.785 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376053+0000", 2024-04-26T11:14:36.785 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:14:36.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.785 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.785 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376504+0000", 2024-04-26T11:14:36.785 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00045143100000000002 2024-04-26T11:14:36.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.786 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.786 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376521+0000", 2024-04-26T11:14:36.786 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6820000000000002e-05 2024-04-26T11:14:36.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.786 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:36.786 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397656+0000", 2024-04-26T11:14:36.786 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.021134824 2024-04-26T11:14:36.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.786 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:36.786 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397682+0000", 2024-04-26T11:14:36.787 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.597e-05 2024-04-26T11:14:36.787 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.787 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.787 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.787 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.787 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:130966 5.3 5:ce21bfb4:::benchmark_data_smithi029_44842_object130965:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:36.787 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:32.376761+0000", 2024-04-26T11:14:36.787 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.3097969320000002, 2024-04-26T11:14:36.787 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.023879659000000001, 2024-04-26T11:14:36.787 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.787 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:36.787 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:36.787 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:36.787 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.788 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 130966 2024-04-26T11:14:36.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.788 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.788 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.788 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376761+0000", 2024-04-26T11:14:36.788 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.788 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.788 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376761+0000", 2024-04-26T11:14:36.788 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.788 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.789 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376760+0000", 2024-04-26T11:14:36.789 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:36.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.789 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.789 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376807+0000", 2024-04-26T11:14:36.789 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7089000000000003e-05 2024-04-26T11:14:36.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.789 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.789 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376817+0000", 2024-04-26T11:14:36.789 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.7329999999999998e-06 2024-04-26T11:14:36.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.790 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.790 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376824+0000", 2024-04-26T11:14:36.790 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6240000000000002e-06 2024-04-26T11:14:36.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.790 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.790 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378825+0000", 2024-04-26T11:14:36.790 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020004799999999998 2024-04-26T11:14:36.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.790 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.790 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378963+0000", 2024-04-26T11:14:36.790 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013860399999999999 2024-04-26T11:14:36.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.791 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:36.791 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.400519+0000", 2024-04-26T11:14:36.791 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.021555405 2024-04-26T11:14:36.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.791 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:36.791 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.400568+0000", 2024-04-26T11:14:36.791 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8989999999999997e-05 2024-04-26T11:14:36.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.791 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:36.791 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.400640+0000", 2024-04-26T11:14:36.791 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2556000000000001e-05 2024-04-26T11:14:36.791 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.791 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.791 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.792 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.792 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:130965 5.0 e40/16 5:02e1af30:::benchmark_data_smithi029_44842_object130964:head v 40'8311, mlcod=40'8308)", 2024-04-26T11:14:36.792 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:32.378228+0000", 2024-04-26T11:14:36.792 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.3083291109999999, 2024-04-26T11:14:36.792 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.023551810999999999, 2024-04-26T11:14:36.792 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:36.792 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:36.792 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:36.792 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.792 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:36.792 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378228+0000", 2024-04-26T11:14:36.792 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.792 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.792 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:36.793 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378228+0000", 2024-04-26T11:14:36.793 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:36.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.793 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:36.793 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378228+0000", 2024-04-26T11:14:36.793 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:36.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.793 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:36.793 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378275+0000", 2024-04-26T11:14:36.793 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:14:36.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.793 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:36.793 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378284+0000", 2024-04-26T11:14:36.793 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3740000000000004e-06 2024-04-26T11:14:36.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.794 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.794 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378291+0000", 2024-04-26T11:14:36.794 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4359999999999999e-06 2024-04-26T11:14:36.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.794 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:36.794 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378322+0000", 2024-04-26T11:14:36.794 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1260000000000002e-05 2024-04-26T11:14:36.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.794 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:36.794 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378336+0000", 2024-04-26T11:14:36.795 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3937999999999999e-05 2024-04-26T11:14:36.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.795 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:36.795 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.401744+0000", 2024-04-26T11:14:36.795 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.023407715999999999 2024-04-26T11:14:36.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:36.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:36.795 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:36.795 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.401780+0000", 2024-04-26T11:14:36.795 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6433999999999997e-05 2024-04-26T11:14:36.795 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.795 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.795 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.795 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:36.795 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:36.796 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:36.798 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:36.798 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:36.795+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:36.898 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:36.896+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:36.970 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.970 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:141344 5.d 5:bc744654:::benchmark_data_smithi029_44842_object141343:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T11:14:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:36.962462+0000", 2024-04-26T11:14:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0054912609999999999, 2024-04-26T11:14:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055263120000000002, 2024-04-26T11:14:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141344 2024-04-26T11:14:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:36.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962462+0000", 2024-04-26T11:14:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962462+0000", 2024-04-26T11:14:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962462+0000", 2024-04-26T11:14:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:36.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962530+0000", 2024-04-26T11:14:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8739999999999996e-05 2024-04-26T11:14:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962537+0000", 2024-04-26T11:14:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3829999999999997e-06 2024-04-26T11:14:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962541+0000", 2024-04-26T11:14:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1740000000000002e-06 2024-04-26T11:14:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962571+0000", 2024-04-26T11:14:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9496e-05 2024-04-26T11:14:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962677+0000", 2024-04-26T11:14:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106053 2024-04-26T11:14:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.974 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:141345 5.f 5:f80eb089:::benchmark_data_smithi029_44842_object141344:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T11:14:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:36.962549+0000", 2024-04-26T11:14:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0054042880000000001, 2024-04-26T11:14:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055237000000000003, 2024-04-26T11:14:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141345 2024-04-26T11:14:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:36.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962549+0000", 2024-04-26T11:14:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962549+0000", 2024-04-26T11:14:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962549+0000", 2024-04-26T11:14:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962584+0000", 2024-04-26T11:14:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4786999999999997e-05 2024-04-26T11:14:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962588+0000", 2024-04-26T11:14:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6800000000000001e-06 2024-04-26T11:14:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962592+0000", 2024-04-26T11:14:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.019e-06 2024-04-26T11:14:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962624+0000", 2024-04-26T11:14:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1921000000000002e-05 2024-04-26T11:14:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962738+0000", 2024-04-26T11:14:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113645 2024-04-26T11:14:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.978 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:141346 5.8 5:19b5dc0a:::benchmark_data_smithi029_44842_object141345:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T11:14:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:36.962599+0000", 2024-04-26T11:14:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0053549319999999997, 2024-04-26T11:14:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055531290000000004, 2024-04-26T11:14:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141346 2024-04-26T11:14:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:36.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962599+0000", 2024-04-26T11:14:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962599+0000", 2024-04-26T11:14:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962598+0000", 2024-04-26T11:14:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:36.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962643+0000", 2024-04-26T11:14:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4428999999999998e-05 2024-04-26T11:14:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962647+0000", 2024-04-26T11:14:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1150000000000004e-06 2024-04-26T11:14:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962650+0000", 2024-04-26T11:14:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2380000000000002e-06 2024-04-26T11:14:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:36.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962710+0000", 2024-04-26T11:14:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0069999999999999e-05 2024-04-26T11:14:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962831+0000", 2024-04-26T11:14:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000121236 2024-04-26T11:14:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962973+0000", 2024-04-26T11:14:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014124100000000001 2024-04-26T11:14:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.966024+0000", 2024-04-26T11:14:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030510020000000001 2024-04-26T11:14:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:141347 5.b 5:d3f29734:::benchmark_data_smithi029_44842_object141346:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T11:14:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:36.962661+0000", 2024-04-26T11:14:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0052929409999999998, 2024-04-26T11:14:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055789949999999998, 2024-04-26T11:14:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:36.983 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141347 2024-04-26T11:14:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962661+0000", 2024-04-26T11:14:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:36.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962661+0000", 2024-04-26T11:14:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962660+0000", 2024-04-26T11:14:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962696+0000", 2024-04-26T11:14:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6162999999999999e-05 2024-04-26T11:14:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962703+0000", 2024-04-26T11:14:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3990000000000001e-06 2024-04-26T11:14:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962706+0000", 2024-04-26T11:14:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2310000000000001e-06 2024-04-26T11:14:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962735+0000", 2024-04-26T11:14:36.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9037999999999999e-05 2024-04-26T11:14:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962854+0000", 2024-04-26T11:14:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000118808 2024-04-26T11:14:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962993+0000", 2024-04-26T11:14:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013924299999999999 2024-04-26T11:14:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:141348 5.b 5:d20e710c:::benchmark_data_smithi029_44842_object141347:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T11:14:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:36.962713+0000", 2024-04-26T11:14:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0052406809999999996, 2024-04-26T11:14:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00559926, 2024-04-26T11:14:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141348 2024-04-26T11:14:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.988 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962713+0000", 2024-04-26T11:14:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962713+0000", 2024-04-26T11:14:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962713+0000", 2024-04-26T11:14:36.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962792+0000", 2024-04-26T11:14:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9900000000000004e-05 2024-04-26T11:14:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962801+0000", 2024-04-26T11:14:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0830000000000004e-06 2024-04-26T11:14:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962806+0000", 2024-04-26T11:14:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8749999999999997e-06 2024-04-26T11:14:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.965204+0000", 2024-04-26T11:14:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023974589999999998 2024-04-26T11:14:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.965334+0000", 2024-04-26T11:14:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012968999999999999 2024-04-26T11:14:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.965477+0000", 2024-04-26T11:14:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014393300000000001 2024-04-26T11:14:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:141349 5.f 5:f22f2ae5:::benchmark_data_smithi029_44842_object141348:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T11:14:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:36.962813+0000", 2024-04-26T11:14:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0051406940000000003, 2024-04-26T11:14:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055425479999999996, 2024-04-26T11:14:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:36.992 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141349 2024-04-26T11:14:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962813+0000", 2024-04-26T11:14:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962813+0000", 2024-04-26T11:14:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962812+0000", 2024-04-26T11:14:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962889+0000", 2024-04-26T11:14:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6977999999999994e-05 2024-04-26T11:14:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962898+0000", 2024-04-26T11:14:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8300000000000002e-06 2024-04-26T11:14:36.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962905+0000", 2024-04-26T11:14:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9079999999999998e-06 2024-04-26T11:14:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.965208+0000", 2024-04-26T11:14:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023025160000000001 2024-04-26T11:14:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.965334+0000", 2024-04-26T11:14:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012610599999999999 2024-04-26T11:14:36.995 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:141350 5.d 5:bd673e9c:::benchmark_data_smithi029_44842_object141349:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T11:14:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:36.962913+0000", 2024-04-26T11:14:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0050406050000000001, 2024-04-26T11:14:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00548067, 2024-04-26T11:14:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141350 2024-04-26T11:14:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.996 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962913+0000", 2024-04-26T11:14:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962913+0000", 2024-04-26T11:14:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962912+0000", 2024-04-26T11:14:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:36.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962974+0000", 2024-04-26T11:14:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1458999999999996e-05 2024-04-26T11:14:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962983+0000", 2024-04-26T11:14:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6929999999999996e-06 2024-04-26T11:14:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962990+0000", 2024-04-26T11:14:36.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.075e-06 2024-04-26T11:14:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.965166+0000", 2024-04-26T11:14:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021759980000000002 2024-04-26T11:14:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.965296+0000", 2024-04-26T11:14:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130495 2024-04-26T11:14:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:36.999 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:141352 5.b 5:dd3df12d:::benchmark_data_smithi029_44842_object141351:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T11:14:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:36.962998+0000", 2024-04-26T11:14:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0049555449999999996, 2024-04-26T11:14:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054725099999999999, 2024-04-26T11:14:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141352 2024-04-26T11:14:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962998+0000", 2024-04-26T11:14:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962998+0000", 2024-04-26T11:14:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962998+0000", 2024-04-26T11:14:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.963060+0000", 2024-04-26T11:14:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2175999999999996e-05 2024-04-26T11:14:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.963068+0000", 2024-04-26T11:14:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7940000000000003e-06 2024-04-26T11:14:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.963074+0000", 2024-04-26T11:14:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6969999999999996e-06 2024-04-26T11:14:37.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.967305+0000", 2024-04-26T11:14:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0042309749999999997 2024-04-26T11:14:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.967389+0000", 2024-04-26T11:14:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3975999999999997e-05 2024-04-26T11:14:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.967472+0000", 2024-04-26T11:14:37.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2896000000000001e-05 2024-04-26T11:14:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:141354 5.e 5:730cf883:::benchmark_data_smithi029_44842_object141353:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T11:14:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:36.963080+0000", 2024-04-26T11:14:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0048734090000000004, 2024-04-26T11:14:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054642379999999997, 2024-04-26T11:14:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141354 2024-04-26T11:14:37.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.963080+0000", 2024-04-26T11:14:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.963080+0000", 2024-04-26T11:14:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.963080+0000", 2024-04-26T11:14:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.963134+0000", 2024-04-26T11:14:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4311999999999998e-05 2024-04-26T11:14:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.963142+0000", 2024-04-26T11:14:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7970000000000001e-06 2024-04-26T11:14:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.963147+0000", 2024-04-26T11:14:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4689999999999996e-06 2024-04-26T11:14:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.963180+0000", 2024-04-26T11:14:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2196999999999997e-05 2024-04-26T11:14:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.963316+0000", 2024-04-26T11:14:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000136811 2024-04-26T11:14:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.963468+0000", 2024-04-26T11:14:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000151652 2024-04-26T11:14:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:141355 5.f 5:f7b1de5d:::benchmark_data_smithi029_44842_object141354:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T11:14:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:36.963157+0000", 2024-04-26T11:14:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0047963140000000003, 2024-04-26T11:14:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0054301940000000002, 2024-04-26T11:14:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.008 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141355 2024-04-26T11:14:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.963157+0000", 2024-04-26T11:14:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.963157+0000", 2024-04-26T11:14:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.963157+0000", 2024-04-26T11:14:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.963207+0000", 2024-04-26T11:14:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0339e-05 2024-04-26T11:14:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.963214+0000", 2024-04-26T11:14:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9269999999999999e-06 2024-04-26T11:14:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.963219+0000", 2024-04-26T11:14:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2360000000000004e-06 2024-04-26T11:14:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.967194+0000", 2024-04-26T11:14:37.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039748209999999999 2024-04-26T11:14:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.967286+0000", 2024-04-26T11:14:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1656999999999993e-05 2024-04-26T11:14:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:141356 5.d 5:b34707e4:::benchmark_data_smithi029_44842_object141355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T11:14:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:36.965625+0000", 2024-04-26T11:14:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0023283459999999998, 2024-04-26T11:14:37.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030007089999999998, 2024-04-26T11:14:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141356 2024-04-26T11:14:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.965625+0000", 2024-04-26T11:14:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.965625+0000", 2024-04-26T11:14:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.965625+0000", 2024-04-26T11:14:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.965689+0000", 2024-04-26T11:14:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4560000000000005e-05 2024-04-26T11:14:37.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.965698+0000", 2024-04-26T11:14:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2790000000000004e-06 2024-04-26T11:14:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.965705+0000", 2024-04-26T11:14:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3040000000000001e-06 2024-04-26T11:14:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.966787+0000", 2024-04-26T11:14:37.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001081846 2024-04-26T11:14:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.966866+0000", 2024-04-26T11:14:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9651e-05 2024-04-26T11:14:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(client.4534.0:141354 5.e e42/16)", 2024-04-26T11:14:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:36.966178+0000", 2024-04-26T11:14:37.016 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0017757700000000001, 2024-04-26T11:14:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024837769999999999, 2024-04-26T11:14:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.966178+0000", 2024-04-26T11:14:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.966178+0000", 2024-04-26T11:14:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.966177+0000", 2024-04-26T11:14:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.966181+0000", 2024-04-26T11:14:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1429999999999998e-06 2024-04-26T11:14:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.966186+0000", 2024-04-26T11:14:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.485e-06 2024-04-26T11:14:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.966189+0000", 2024-04-26T11:14:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3210000000000001e-06 2024-04-26T11:14:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(client.4534.0:141347 5.b e42/16)", 2024-04-26T11:14:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:36.967157+0000", 2024-04-26T11:14:37.019 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00079686000000000004, 2024-04-26T11:14:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0015323050000000001, 2024-04-26T11:14:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.967157+0000", 2024-04-26T11:14:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.967157+0000", 2024-04-26T11:14:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.967156+0000", 2024-04-26T11:14:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.967160+0000", 2024-04-26T11:14:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1949999999999996e-06 2024-04-26T11:14:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.967167+0000", 2024-04-26T11:14:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8970000000000002e-06 2024-04-26T11:14:37.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.967174+0000", 2024-04-26T11:14:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.472e-06 2024-04-26T11:14:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(client.4534.0:141348 5.b e42/16)", 2024-04-26T11:14:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:36.967536+0000", 2024-04-26T11:14:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00041801000000000002, 2024-04-26T11:14:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001181236, 2024-04-26T11:14:37.022 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.967536+0000", 2024-04-26T11:14:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.967536+0000", 2024-04-26T11:14:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.967535+0000", 2024-04-26T11:14:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.967539+0000", 2024-04-26T11:14:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9339999999999999e-06 2024-04-26T11:14:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.967548+0000", 2024-04-26T11:14:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5739999999999996e-06 2024-04-26T11:14:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.967554+0000", 2024-04-26T11:14:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0070000000000003e-06 2024-04-26T11:14:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:141334 5.b 5:dd2469ec:::benchmark_data_smithi029_44842_object141333:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T11:14:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:36.957307+0000", 2024-04-26T11:14:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.010646223999999999, 2024-04-26T11:14:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011444899, 2024-04-26T11:14:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.025 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141334 2024-04-26T11:14:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.957307+0000", 2024-04-26T11:14:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.957307+0000", 2024-04-26T11:14:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.957307+0000", 2024-04-26T11:14:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.957415+0000", 2024-04-26T11:14:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107738 2024-04-26T11:14:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.957425+0000", 2024-04-26T11:14:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0305999999999999e-05 2024-04-26T11:14:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.957431+0000", 2024-04-26T11:14:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7019999999999998e-06 2024-04-26T11:14:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.959237+0000", 2024-04-26T11:14:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001806357 2024-04-26T11:14:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.959403+0000", 2024-04-26T11:14:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00016637600000000001 2024-04-26T11:14:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.959544+0000", 2024-04-26T11:14:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014115899999999999 2024-04-26T11:14:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.965180+0000", 2024-04-26T11:14:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0056356380000000001 2024-04-26T11:14:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:141341 5.4 5:22cea143:::benchmark_data_smithi029_44842_object141340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T11:14:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:36.959166+0000", 2024-04-26T11:14:37.029 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0087874579999999997, 2024-04-26T11:14:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096316879999999994, 2024-04-26T11:14:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141341 2024-04-26T11:14:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.959166+0000", 2024-04-26T11:14:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.959166+0000", 2024-04-26T11:14:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.959165+0000", 2024-04-26T11:14:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.959237+0000", 2024-04-26T11:14:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1522999999999999e-05 2024-04-26T11:14:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.959247+0000", 2024-04-26T11:14:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0068000000000001e-05 2024-04-26T11:14:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.959255+0000", 2024-04-26T11:14:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7100000000000007e-06 2024-04-26T11:14:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.959317+0000", 2024-04-26T11:14:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2172e-05 2024-04-26T11:14:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.959424+0000", 2024-04-26T11:14:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107076 2024-04-26T11:14:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.959562+0000", 2024-04-26T11:14:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013798700000000001 2024-04-26T11:14:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:37.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.962904+0000", 2024-04-26T11:14:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0033417820000000002 2024-04-26T11:14:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:141343 5.d 5:b4d3c6df:::benchmark_data_smithi029_44842_object141342:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T11:14:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:36.959670+0000", 2024-04-26T11:14:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0082837080000000007, 2024-04-26T11:14:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0091729770000000006, 2024-04-26T11:14:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:37.034 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 141343 2024-04-26T11:14:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.959670+0000", 2024-04-26T11:14:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.959670+0000", 2024-04-26T11:14:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.959669+0000", 2024-04-26T11:14:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.959732+0000", 2024-04-26T11:14:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2817999999999994e-05 2024-04-26T11:14:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.959742+0000", 2024-04-26T11:14:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9599999999999995e-06 2024-04-26T11:14:37.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.959749+0000", 2024-04-26T11:14:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9970000000000001e-06 2024-04-26T11:14:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.959791+0000", 2024-04-26T11:14:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1644000000000003e-05 2024-04-26T11:14:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:36.959916+0000", 2024-04-26T11:14:37.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000125217 2024-04-26T11:14:37.038 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.038 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.038 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.038 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.038 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:14:37.038 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 17 2024-04-26T11:14:37.038 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:37.039 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:37.037+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:37.040 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:37.140 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:37.138+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:37.241 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:37.239+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:37.253 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:37.253 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:14:37.253 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:14:37.253 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:14:37.254 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:37.265 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:37.350 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:37.348+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:37.415 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 59 16 142438 142422 150.857 146.938 0.00792104 0.00662625 2024-04-26T11:14:37.446 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:37.442+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:37.479 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:37.480 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:14:37.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:14:37.480 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:37.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.480 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:37.480 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:37.480 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 44.197993373999999, 2024-04-26T11:14:37.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:14:37.480 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.480 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:37.480 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.480 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.480 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.481 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:14:37.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.481 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:37.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:37.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:37.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:14:37.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:14:37.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:14:37.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:14:37.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:14:37.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:14:37.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:14:37.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:14:37.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:37.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:14:37.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:14:37.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:37.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:14:37.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:14:37.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:37.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:14:37.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:14:37.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:37.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:14:37.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:14:37.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:37.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:14:37.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:14:37.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:37.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:14:37.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:14:37.485 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.485 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.485 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.485 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:37.485 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:37.486 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 44.197343672000002, 2024-04-26T11:14:37.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:14:37.486 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.486 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:37.486 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.486 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.486 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.486 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:14:37.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.486 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:37.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:37.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:14:37.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:37.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:14:37.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:14:37.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:14:37.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:14:37.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:14:37.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:14:37.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:14:37.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:14:37.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:37.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:14:37.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:14:37.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:37.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:14:37.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:14:37.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:37.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:14:37.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:14:37.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:37.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:14:37.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:14:37.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:37.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:14:37.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:14:37.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:37.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:14:37.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:14:37.491 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.491 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.491 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.491 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:37.491 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:37.491 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 40.130701633000001, 2024-04-26T11:14:37.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:14:37.491 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.491 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:37.491 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.492 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.492 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.492 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:14:37.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.492 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:37.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:37.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:14:37.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:37.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:14:37.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:14:37.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:14:37.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:14:37.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:14:37.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:14:37.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:14:37.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:14:37.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:37.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:14:37.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:14:37.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:14:37.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:14:37.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:37.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:14:37.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:14:37.495 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.495 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.495 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.495 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:37.496 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:37.496 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 40.130605987000003, 2024-04-26T11:14:37.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:14:37.496 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.496 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:37.496 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.496 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.496 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.496 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:14:37.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.496 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:37.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:37.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:14:37.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:14:37.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:14:37.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:14:37.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:14:37.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:14:37.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:14:37.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:14:37.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:14:37.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:37.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:14:37.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:14:37.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:14:37.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:14:37.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:37.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:14:37.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:14:37.500 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.500 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.500 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.500 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:37.500 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:37.500 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 40.130474307999997, 2024-04-26T11:14:37.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:14:37.500 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.500 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:37.500 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.500 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.500 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.500 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:14:37.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.501 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:37.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:37.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:37.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:14:37.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:14:37.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:14:37.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:14:37.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:14:37.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:14:37.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:14:37.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:14:37.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:37.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:14:37.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:14:37.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:14:37.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:14:37.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:37.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:14:37.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:14:37.504 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.504 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.504 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.504 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:37.504 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:37.504 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 40.130365851999997, 2024-04-26T11:14:37.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:14:37.505 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.505 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:37.505 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.505 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.505 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.505 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:14:37.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.505 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:37.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:37.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:14:37.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:37.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:14:37.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:14:37.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:14:37.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:14:37.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:14:37.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:14:37.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:14:37.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:14:37.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:37.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:14:37.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:14:37.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:14:37.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:14:37.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:37.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:14:37.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:14:37.509 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.509 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.509 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.509 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:37.509 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:37.509 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 40.130264584000003, 2024-04-26T11:14:37.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:14:37.509 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.509 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:37.509 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.509 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.510 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.510 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:14:37.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.510 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:37.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:37.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:37.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:14:37.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:14:37.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:14:37.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:14:37.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:14:37.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:14:37.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:14:37.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:14:37.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:37.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:14:37.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:14:37.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:14:37.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:14:37.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:37.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:14:37.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:14:37.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:37.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:14:37.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:14:37.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:37.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:14:37.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:14:37.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:37.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:14:37.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:14:37.514 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.514 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.514 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.515 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:37.515 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:37.515 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 40.130195643, 2024-04-26T11:14:37.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:14:37.515 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.515 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:37.515 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.515 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.515 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.515 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:14:37.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.515 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:37.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:37.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:14:37.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:14:37.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:14:37.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:14:37.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:14:37.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:14:37.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:14:37.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:14:37.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:14:37.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:37.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:14:37.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:14:37.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:14:37.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:14:37.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:37.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:14:37.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:14:37.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:37.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:14:37.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:14:37.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:37.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:14:37.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:14:37.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:37.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:14:37.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:14:37.522 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.522 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.522 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.522 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:37.522 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:37.522 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 40.124200062, 2024-04-26T11:14:37.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:14:37.523 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.523 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:37.523 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.523 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.523 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.523 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:14:37.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.523 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:37.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:14:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:14:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:14:37.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:14:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:14:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:14:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:14:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:14:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:14:37.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:14:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:14:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:14:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:14:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:14:37.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:14:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:14:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:14:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:14:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:14:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:14:37.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:14:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:81256 5.8 5:1c0f3fd8:::benchmark_data_smithi029_44842_object81255:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.360740513, 2024-04-26T11:14:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026193673000000001, 2024-04-26T11:14:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.528 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 81256 2024-04-26T11:14:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:37.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116073+0000", 2024-04-26T11:14:37.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0114e-05 2024-04-26T11:14:37.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116079+0000", 2024-04-26T11:14:37.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8939999999999998e-06 2024-04-26T11:14:37.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116082+0000", 2024-04-26T11:14:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:14:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127501+0000", 2024-04-26T11:14:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011418281000000001 2024-04-26T11:14:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127639+0000", 2024-04-26T11:14:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013828899999999999 2024-04-26T11:14:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:37.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127782+0000", 2024-04-26T11:14:37.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014328299999999999 2024-04-26T11:14:37.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:37.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.134767+0000", 2024-04-26T11:14:37.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0069844140000000004 2024-04-26T11:14:37.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:37.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142160+0000", 2024-04-26T11:14:37.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007392839 2024-04-26T11:14:37.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:37.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142202+0000", 2024-04-26T11:14:37.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2797999999999999e-05 2024-04-26T11:14:37.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:37.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142237+0000", 2024-04-26T11:14:37.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4464000000000001e-05 2024-04-26T11:14:37.533 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.533 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.533 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.533 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:90441 5.4 5:2b047885:::benchmark_data_smithi029_44842_object90440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T11:14:37.534 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:37.534 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 23.326577152999999, 2024-04-26T11:14:37.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026164084000000001, 2024-04-26T11:14:37.534 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.534 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:37.534 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.534 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.534 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.534 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 90441 2024-04-26T11:14:37.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.534 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:37.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150207+0000", 2024-04-26T11:14:37.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150206+0000", 2024-04-26T11:14:37.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150261+0000", 2024-04-26T11:14:37.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4580000000000003e-05 2024-04-26T11:14:37.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150269+0000", 2024-04-26T11:14:37.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9679999999999995e-06 2024-04-26T11:14:37.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150274+0000", 2024-04-26T11:14:37.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8470000000000003e-06 2024-04-26T11:14:37.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150312+0000", 2024-04-26T11:14:37.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7245e-05 2024-04-26T11:14:37.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:37.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150396+0000", 2024-04-26T11:14:37.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4778999999999996e-05 2024-04-26T11:14:37.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:37.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.150491+0000", 2024-04-26T11:14:37.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4606999999999997e-05 2024-04-26T11:14:37.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:37.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.153991+0000", 2024-04-26T11:14:37.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035001339999999998 2024-04-26T11:14:37.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:37.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176295+0000", 2024-04-26T11:14:37.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.022304280999999999 2024-04-26T11:14:37.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:37.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176335+0000", 2024-04-26T11:14:37.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:37.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:37.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:14.176371+0000", 2024-04-26T11:14:37.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5448999999999999e-05 2024-04-26T11:14:37.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.539 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.539 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101754 5.e 5:7ca15a5c:::benchmark_data_smithi029_44842_object101753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:37.539 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:37.539 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 18.358252319999998, 2024-04-26T11:14:37.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039171048999999999, 2024-04-26T11:14:37.540 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.540 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:37.540 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.540 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.540 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.540 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101754 2024-04-26T11:14:37.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.540 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:37.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:37.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:37.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118604+0000", 2024-04-26T11:14:37.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3399000000000007e-05 2024-04-26T11:14:37.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118613+0000", 2024-04-26T11:14:37.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6989999999999992e-06 2024-04-26T11:14:37.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118618+0000", 2024-04-26T11:14:37.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3850000000000001e-06 2024-04-26T11:14:37.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118646+0000", 2024-04-26T11:14:37.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7878e-05 2024-04-26T11:14:37.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:37.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118720+0000", 2024-04-26T11:14:37.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3461999999999996e-05 2024-04-26T11:14:37.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:37.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118807+0000", 2024-04-26T11:14:37.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7269999999999996e-05 2024-04-26T11:14:37.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:37.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142317+0000", 2024-04-26T11:14:37.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023510105999999999 2024-04-26T11:14:37.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:37.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.143287+0000", 2024-04-26T11:14:37.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096983599999999996 2024-04-26T11:14:37.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:37.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157662+0000", 2024-04-26T11:14:37.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014375393 2024-04-26T11:14:37.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:37.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157702+0000", 2024-04-26T11:14:37.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0295e-05 2024-04-26T11:14:37.544 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.544 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.544 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.545 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101755 5.f 5:fa973a83:::benchmark_data_smithi029_44842_object101754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:37.545 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:37.545 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 18.358086623999998, 2024-04-26T11:14:37.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039139064000000001, 2024-04-26T11:14:37.545 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.545 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:37.545 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.545 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.545 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.545 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101755 2024-04-26T11:14:37.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.545 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:37.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:37.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118696+0000", 2024-04-26T11:14:37.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118766+0000", 2024-04-26T11:14:37.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9423000000000003e-05 2024-04-26T11:14:37.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118774+0000", 2024-04-26T11:14:37.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9710000000000004e-06 2024-04-26T11:14:37.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118779+0000", 2024-04-26T11:14:37.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5629999999999999e-06 2024-04-26T11:14:37.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118817+0000", 2024-04-26T11:14:37.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7771000000000001e-05 2024-04-26T11:14:37.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:37.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118929+0000", 2024-04-26T11:14:37.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011222699999999999 2024-04-26T11:14:37.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:37.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157661+0000", 2024-04-26T11:14:37.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038731120000000001 2024-04-26T11:14:37.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:37.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157757+0000", 2024-04-26T11:14:37.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6910000000000006e-05 2024-04-26T11:14:37.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:37.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157836+0000", 2024-04-26T11:14:37.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8727999999999996e-05 2024-04-26T11:14:37.549 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.549 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.549 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.550 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101758 5.4 5:2525a4eb:::benchmark_data_smithi029_44842_object101757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:37.550 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:37.550 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 18.355903773000001, 2024-04-26T11:14:37.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.03686739, 2024-04-26T11:14:37.550 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.550 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:37.550 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.550 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.550 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.550 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101758 2024-04-26T11:14:37.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.550 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:37.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:37.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120879+0000", 2024-04-26T11:14:37.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120971+0000", 2024-04-26T11:14:37.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2133999999999996e-05 2024-04-26T11:14:37.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120977+0000", 2024-04-26T11:14:37.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5509999999999999e-06 2024-04-26T11:14:37.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120981+0000", 2024-04-26T11:14:37.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.245e-06 2024-04-26T11:14:37.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121010+0000", 2024-04-26T11:14:37.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9084000000000001e-05 2024-04-26T11:14:37.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:37.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121083+0000", 2024-04-26T11:14:37.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2942999999999996e-05 2024-04-26T11:14:37.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:37.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121163+0000", 2024-04-26T11:14:37.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0197000000000005e-05 2024-04-26T11:14:37.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142822+0000", 2024-04-26T11:14:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021658535999999999 2024-04-26T11:14:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157674+0000", 2024-04-26T11:14:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014851573999999999 2024-04-26T11:14:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157714+0000", 2024-04-26T11:14:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0473999999999999e-05 2024-04-26T11:14:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157747+0000", 2024-04-26T11:14:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3278999999999998e-05 2024-04-26T11:14:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101760 5.4 5:2510211a:::benchmark_data_smithi029_44842_object101759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 18.355471428000001, 2024-04-26T11:14:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039182383000000001, 2024-04-26T11:14:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.555 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101760 2024-04-26T11:14:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121389+0000", 2024-04-26T11:14:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6667000000000003e-05 2024-04-26T11:14:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121394+0000", 2024-04-26T11:14:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0839999999999999e-06 2024-04-26T11:14:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121397+0000", 2024-04-26T11:14:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4489999999999999e-06 2024-04-26T11:14:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122921+0000", 2024-04-26T11:14:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001524067 2024-04-26T11:14:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.123010+0000", 2024-04-26T11:14:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8449000000000006e-05 2024-04-26T11:14:37.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140838+0000", 2024-04-26T11:14:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017828796000000001 2024-04-26T11:14:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157665+0000", 2024-04-26T11:14:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016826574 2024-04-26T11:14:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160407+0000", 2024-04-26T11:14:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027423970000000002 2024-04-26T11:14:37.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:37.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160456+0000", 2024-04-26T11:14:37.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8678999999999999e-05 2024-04-26T11:14:37.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:37.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160495+0000", 2024-04-26T11:14:37.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8658000000000002e-05 2024-04-26T11:14:37.560 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.560 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.560 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.561 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101761 5.e 5:70294421:::benchmark_data_smithi029_44842_object101760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:37.561 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:37.561 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 18.354047054999999, 2024-04-26T11:14:37.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035270448000000003, 2024-04-26T11:14:37.561 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.561 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:37.561 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.561 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.561 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.561 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101761 2024-04-26T11:14:37.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.561 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:37.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122736+0000", 2024-04-26T11:14:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122805+0000", 2024-04-26T11:14:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9076000000000001e-05 2024-04-26T11:14:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122811+0000", 2024-04-26T11:14:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:14:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122815+0000", 2024-04-26T11:14:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2860000000000001e-06 2024-04-26T11:14:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122842+0000", 2024-04-26T11:14:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6429000000000001e-05 2024-04-26T11:14:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122916+0000", 2024-04-26T11:14:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4122999999999995e-05 2024-04-26T11:14:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122997+0000", 2024-04-26T11:14:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1428999999999996e-05 2024-04-26T11:14:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:37.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142344+0000", 2024-04-26T11:14:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019346452 2024-04-26T11:14:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157934+0000", 2024-04-26T11:14:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015589911999999999 2024-04-26T11:14:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157975+0000", 2024-04-26T11:14:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1604999999999999e-05 2024-04-26T11:14:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:37.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.158007+0000", 2024-04-26T11:14:37.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1921000000000002e-05 2024-04-26T11:14:37.566 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.566 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.566 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110145 5.9 5:9b275f16:::benchmark_data_smithi029_44842_object110144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 14.328485417, 2024-04-26T11:14:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032844496000000001, 2024-04-26T11:14:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110145 2024-04-26T11:14:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148297+0000", 2024-04-26T11:14:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148325+0000", 2024-04-26T11:14:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7511000000000001e-05 2024-04-26T11:14:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148338+0000", 2024-04-26T11:14:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2808e-05 2024-04-26T11:14:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148345+0000", 2024-04-26T11:14:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7200000000000006e-06 2024-04-26T11:14:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149888+0000", 2024-04-26T11:14:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001542666 2024-04-26T11:14:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149977+0000", 2024-04-26T11:14:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9247999999999997e-05 2024-04-26T11:14:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181006+0000", 2024-04-26T11:14:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031028535999999999 2024-04-26T11:14:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:37.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181051+0000", 2024-04-26T11:14:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5393999999999999e-05 2024-04-26T11:14:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181143+0000", 2024-04-26T11:14:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1458000000000004e-05 2024-04-26T11:14:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110155 5.9 5:9ebc6158:::benchmark_data_smithi029_44842_object110154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 14.323409625, 2024-04-26T11:14:37.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027886826999999999, 2024-04-26T11:14:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110155 2024-04-26T11:14:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153373+0000", 2024-04-26T11:14:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153479+0000", 2024-04-26T11:14:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105728 2024-04-26T11:14:37.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153491+0000", 2024-04-26T11:14:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2207e-05 2024-04-26T11:14:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153499+0000", 2024-04-26T11:14:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7729999999999999e-06 2024-04-26T11:14:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153655+0000", 2024-04-26T11:14:37.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015573 2024-04-26T11:14:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153770+0000", 2024-04-26T11:14:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011562500000000001 2024-04-26T11:14:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181153+0000", 2024-04-26T11:14:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027382113 2024-04-26T11:14:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181195+0000", 2024-04-26T11:14:37.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1921000000000001e-05 2024-04-26T11:14:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181261+0000", 2024-04-26T11:14:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6402999999999994e-05 2024-04-26T11:14:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:129903 5.0 5:00b2d390:::benchmark_data_smithi029_44842_object129902:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:31.889868+0000", 2024-04-26T11:14:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.5869152250000003, 2024-04-26T11:14:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026543418999999999, 2024-04-26T11:14:37.576 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 129903 2024-04-26T11:14:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889868+0000", 2024-04-26T11:14:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889868+0000", 2024-04-26T11:14:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889868+0000", 2024-04-26T11:14:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889936+0000", 2024-04-26T11:14:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7655000000000002e-05 2024-04-26T11:14:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889943+0000", 2024-04-26T11:14:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7319999999999998e-06 2024-04-26T11:14:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889948+0000", 2024-04-26T11:14:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5909999999999998e-06 2024-04-26T11:14:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.893510+0000", 2024-04-26T11:14:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035624540000000001 2024-04-26T11:14:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.893637+0000", 2024-04-26T11:14:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000126604 2024-04-26T11:14:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.893784+0000", 2024-04-26T11:14:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014726299999999999 2024-04-26T11:14:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.903173+0000", 2024-04-26T11:14:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0093891370000000005 2024-04-26T11:14:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.916373+0000", 2024-04-26T11:14:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013199407999999999 2024-04-26T11:14:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.916395+0000", 2024-04-26T11:14:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2447e-05 2024-04-26T11:14:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.916412+0000", 2024-04-26T11:14:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6688e-05 2024-04-26T11:14:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.581 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:130965 5.0 5:02e1af30:::benchmark_data_smithi029_44842_object130964:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:32.376041+0000", 2024-04-26T11:14:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.1007429909999997, 2024-04-26T11:14:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027463617999999999, 2024-04-26T11:14:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 130965 2024-04-26T11:14:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:37.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376041+0000", 2024-04-26T11:14:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376041+0000", 2024-04-26T11:14:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376040+0000", 2024-04-26T11:14:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376126+0000", 2024-04-26T11:14:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6070999999999996e-05 2024-04-26T11:14:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376133+0000", 2024-04-26T11:14:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7739999999999999e-06 2024-04-26T11:14:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376137+0000", 2024-04-26T11:14:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3669999999999999e-06 2024-04-26T11:14:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.378033+0000", 2024-04-26T11:14:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001895484 2024-04-26T11:14:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.378108+0000", 2024-04-26T11:14:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5201e-05 2024-04-26T11:14:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.378200+0000", 2024-04-26T11:14:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1712999999999994e-05 2024-04-26T11:14:37.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.381666+0000", 2024-04-26T11:14:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003466701 2024-04-26T11:14:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.403451+0000", 2024-04-26T11:14:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021784583 2024-04-26T11:14:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.403484+0000", 2024-04-26T11:14:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3265000000000001e-05 2024-04-26T11:14:37.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.403504+0000", 2024-04-26T11:14:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0123999999999999e-05 2024-04-26T11:14:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:37.587 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:37.587 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:37.588 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:37.586+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:37.589 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:37.690 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:37.687+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:37.711 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:14:37.776 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:37.776 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:37.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.776 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:143230 5.e e42/16 5:708f0197:::benchmark_data_smithi029_44842_object143229:head v 42'8918, mlcod=42'8914)", 2024-04-26T11:14:37.776 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:37.767487+0000", 2024-04-26T11:14:37.776 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.005792185, 2024-04-26T11:14:37.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0058494979999999999, 2024-04-26T11:14:37.776 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:37.776 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:37.777 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:37.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.777 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:37.777 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.767487+0000", 2024-04-26T11:14:37.777 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.777 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:37.777 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.767487+0000", 2024-04-26T11:14:37.777 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.777 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:37.777 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.767487+0000", 2024-04-26T11:14:37.778 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.778 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.778 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:37.778 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.767514+0000", 2024-04-26T11:14:37.778 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6911999999999999e-05 2024-04-26T11:14:37.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.778 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.778 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:37.778 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.767521+0000", 2024-04-26T11:14:37.778 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9779999999999999e-06 2024-04-26T11:14:37.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.778 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.778 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.779 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.767526+0000", 2024-04-26T11:14:37.779 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0409999999999997e-06 2024-04-26T11:14:37.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.779 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:37.779 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769872+0000", 2024-04-26T11:14:37.779 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0023463339999999998 2024-04-26T11:14:37.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.779 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:37.779 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769888+0000", 2024-04-26T11:14:37.779 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5981000000000002e-05 2024-04-26T11:14:37.779 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.779 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:37.780 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.780 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:143234 5.1 5:8be97892:::benchmark_data_smithi029_44842_object143233:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T11:14:37.780 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:37.768063+0000", 2024-04-26T11:14:37.780 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0052163130000000002, 2024-04-26T11:14:37.780 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053966719999999999, 2024-04-26T11:14:37.780 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:37.780 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:37.780 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:37.780 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:37.780 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.780 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 143234 2024-04-26T11:14:37.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.781 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:37.781 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.781 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:37.781 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.768063+0000", 2024-04-26T11:14:37.781 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.781 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.781 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:37.781 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.768063+0000", 2024-04-26T11:14:37.781 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.781 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.781 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:37.781 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.768063+0000", 2024-04-26T11:14:37.781 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.782 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:37.782 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.768116+0000", 2024-04-26T11:14:37.782 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3736000000000002e-05 2024-04-26T11:14:37.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.782 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:37.782 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.768124+0000", 2024-04-26T11:14:37.782 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:14:37.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.782 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.782 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.768130+0000", 2024-04-26T11:14:37.783 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5649999999999998e-06 2024-04-26T11:14:37.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.783 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.783 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:37.783 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.768171+0000", 2024-04-26T11:14:37.783 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0503000000000002e-05 2024-04-26T11:14:37.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.783 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.783 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:37.783 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.768261+0000", 2024-04-26T11:14:37.783 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.0235999999999995e-05 2024-04-26T11:14:37.783 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.783 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:37.783 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.784 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:143238 5.1 5:8a7da794:::benchmark_data_smithi029_44842_object143237:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T11:14:37.784 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:37.769050+0000", 2024-04-26T11:14:37.784 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0042294409999999996, 2024-04-26T11:14:37.784 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0045368759999999996, 2024-04-26T11:14:37.784 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:37.784 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:37.784 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:37.784 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:37.784 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.784 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 143238 2024-04-26T11:14:37.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.784 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:37.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.785 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:37.785 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769050+0000", 2024-04-26T11:14:37.785 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.785 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:37.785 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769050+0000", 2024-04-26T11:14:37.785 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.785 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:37.785 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769049+0000", 2024-04-26T11:14:37.785 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:37.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.786 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:37.786 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769133+0000", 2024-04-26T11:14:37.786 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3937999999999995e-05 2024-04-26T11:14:37.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.786 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:37.786 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769145+0000", 2024-04-26T11:14:37.786 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1433e-05 2024-04-26T11:14:37.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.786 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.786 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769152+0000", 2024-04-26T11:14:37.786 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.294e-06 2024-04-26T11:14:37.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.787 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.787 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:37.787 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.771051+0000", 2024-04-26T11:14:37.787 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001899113 2024-04-26T11:14:37.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.787 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.787 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:37.787 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.771174+0000", 2024-04-26T11:14:37.787 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012326399999999999 2024-04-26T11:14:37.787 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.787 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:37.787 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.787 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.787 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:143231 5.4 e42/16 5:2975c3af:::benchmark_data_smithi029_44842_object143230:head v 42'8879, mlcod=42'8876)", 2024-04-26T11:14:37.788 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:37.769611+0000", 2024-04-26T11:14:37.788 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0036680749999999998, 2024-04-26T11:14:37.788 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0040813430000000003, 2024-04-26T11:14:37.788 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:37.788 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:37.788 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:37.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.788 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:37.788 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769611+0000", 2024-04-26T11:14:37.788 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.788 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:37.788 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769611+0000", 2024-04-26T11:14:37.788 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.789 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:37.789 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769611+0000", 2024-04-26T11:14:37.789 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.789 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:37.789 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769644+0000", 2024-04-26T11:14:37.789 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2746999999999997e-05 2024-04-26T11:14:37.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.789 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:37.789 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769661+0000", 2024-04-26T11:14:37.790 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7516999999999998e-05 2024-04-26T11:14:37.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.790 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.790 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769668+0000", 2024-04-26T11:14:37.790 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1960000000000002e-06 2024-04-26T11:14:37.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.790 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:37.790 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.770062+0000", 2024-04-26T11:14:37.790 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00039332000000000001 2024-04-26T11:14:37.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.790 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:37.791 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.770079+0000", 2024-04-26T11:14:37.791 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7316000000000002e-05 2024-04-26T11:14:37.791 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.791 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:37.791 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.791 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:143233 5.8 e42/16 5:1906df3b:::benchmark_data_smithi029_44842_object143232:head v 42'8959, mlcod=42'8957)", 2024-04-26T11:14:37.791 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:37.769678+0000", 2024-04-26T11:14:37.791 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0036017100000000002, 2024-04-26T11:14:37.791 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0041024859999999998, 2024-04-26T11:14:37.791 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:37.791 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:37.791 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:37.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.792 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:37.792 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769678+0000", 2024-04-26T11:14:37.792 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.792 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.792 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:37.792 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769678+0000", 2024-04-26T11:14:37.792 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.792 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.792 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:37.792 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769678+0000", 2024-04-26T11:14:37.792 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.793 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:37.793 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769705+0000", 2024-04-26T11:14:37.793 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7229999999999998e-05 2024-04-26T11:14:37.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.793 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:37.793 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769712+0000", 2024-04-26T11:14:37.793 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2710000000000003e-06 2024-04-26T11:14:37.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.793 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.793 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769722+0000", 2024-04-26T11:14:37.793 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0433e-05 2024-04-26T11:14:37.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.794 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:37.794 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769750+0000", 2024-04-26T11:14:37.794 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7917000000000001e-05 2024-04-26T11:14:37.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.794 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:37.794 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769765+0000", 2024-04-26T11:14:37.794 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4187e-05 2024-04-26T11:14:37.794 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.794 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:37.794 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.795 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:143236 5.a e42/31 5:5de7fc72:::benchmark_data_smithi029_44842_object143235:head v 42'9024, mlcod=42'9021)", 2024-04-26T11:14:37.795 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:37.769731+0000", 2024-04-26T11:14:37.795 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0035484729999999999, 2024-04-26T11:14:37.795 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0045532089999999999, 2024-04-26T11:14:37.795 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:37.795 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:37.795 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:37.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.795 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:37.795 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769731+0000", 2024-04-26T11:14:37.795 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.795 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:37.796 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769731+0000", 2024-04-26T11:14:37.796 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.796 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:37.796 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769731+0000", 2024-04-26T11:14:37.796 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.796 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:37.796 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769758+0000", 2024-04-26T11:14:37.796 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7668999999999999e-05 2024-04-26T11:14:37.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.797 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:37.797 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769765+0000", 2024-04-26T11:14:37.797 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5719999999999999e-06 2024-04-26T11:14:37.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.797 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.797 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.797 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769770+0000", 2024-04-26T11:14:37.797 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.9389999999999996e-06 2024-04-26T11:14:37.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.797 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.797 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:37.797 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769806+0000", 2024-04-26T11:14:37.797 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5902000000000003e-05 2024-04-26T11:14:37.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.797 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.798 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:37.798 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.769818+0000", 2024-04-26T11:14:37.798 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2308e-05 2024-04-26T11:14:37.798 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.798 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:37.798 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.798 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.798 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:143239 5.8 e42/16 5:1594bf34:::benchmark_data_smithi029_44842_object143238:head v 42'8960, mlcod=42'8957)", 2024-04-26T11:14:37.798 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:37.770624+0000", 2024-04-26T11:14:37.798 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0026551069999999999, 2024-04-26T11:14:37.798 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0037183440000000002, 2024-04-26T11:14:37.798 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:37.798 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:37.799 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:37.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.799 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:37.799 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.770624+0000", 2024-04-26T11:14:37.799 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.799 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:37.799 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.770624+0000", 2024-04-26T11:14:37.799 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.799 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:37.799 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.770624+0000", 2024-04-26T11:14:37.799 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.800 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:37.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.770683+0000", 2024-04-26T11:14:37.800 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8798000000000002e-05 2024-04-26T11:14:37.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.800 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:37.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.770705+0000", 2024-04-26T11:14:37.800 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2572999999999999e-05 2024-04-26T11:14:37.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.800 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.770713+0000", 2024-04-26T11:14:37.801 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6990000000000003e-06 2024-04-26T11:14:37.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.801 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:37.801 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.771566+0000", 2024-04-26T11:14:37.801 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00085288400000000004 2024-04-26T11:14:37.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.801 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:37.801 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.771582+0000", 2024-04-26T11:14:37.801 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6490999999999998e-05 2024-04-26T11:14:37.801 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.801 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:37.801 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.802 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:143241 5.6 5:6fa35e8b:::benchmark_data_smithi029_44842_object143240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T11:14:37.802 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:37.770814+0000", 2024-04-26T11:14:37.802 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.002465105, 2024-04-26T11:14:37.802 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0035909039999999998, 2024-04-26T11:14:37.802 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:37.802 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:37.802 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:37.802 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:37.802 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.802 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 143241 2024-04-26T11:14:37.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.802 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:37.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.803 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:37.803 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.770814+0000", 2024-04-26T11:14:37.803 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.803 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:37.803 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.770814+0000", 2024-04-26T11:14:37.803 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.803 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:37.803 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.770813+0000", 2024-04-26T11:14:37.803 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:37.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.804 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:37.804 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.770924+0000", 2024-04-26T11:14:37.804 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000110373 2024-04-26T11:14:37.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.804 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:37.804 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.770947+0000", 2024-04-26T11:14:37.804 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3249999999999999e-05 2024-04-26T11:14:37.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.804 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.804 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.770955+0000", 2024-04-26T11:14:37.804 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7659999999999998e-06 2024-04-26T11:14:37.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.805 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:37.805 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.770999+0000", 2024-04-26T11:14:37.805 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4305999999999999e-05 2024-04-26T11:14:37.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.805 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:37.805 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.771150+0000", 2024-04-26T11:14:37.805 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015090899999999999 2024-04-26T11:14:37.805 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.805 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:37.805 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.806 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.806 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:143242 5.1 5:8ad084ff:::benchmark_data_smithi029_44842_object143241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T11:14:37.806 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:37.770970+0000", 2024-04-26T11:14:37.806 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0023096649999999998, 2024-04-26T11:14:37.806 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0035114629999999998, 2024-04-26T11:14:37.806 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:37.806 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:37.806 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:37.806 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:37.806 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.806 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 143242 2024-04-26T11:14:37.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.806 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:37.806 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.806 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:37.807 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.770970+0000", 2024-04-26T11:14:37.807 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.807 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:37.807 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.770970+0000", 2024-04-26T11:14:37.807 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.807 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:37.807 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.770969+0000", 2024-04-26T11:14:37.807 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.808 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:37.808 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.770998+0000", 2024-04-26T11:14:37.808 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8283e-05 2024-04-26T11:14:37.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.808 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.808 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:37.808 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.771005+0000", 2024-04-26T11:14:37.808 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.131e-06 2024-04-26T11:14:37.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.808 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.808 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.808 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.771012+0000", 2024-04-26T11:14:37.808 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1919999999999999e-06 2024-04-26T11:14:37.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.808 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.809 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:37.809 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.773267+0000", 2024-04-26T11:14:37.809 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022554929999999999 2024-04-26T11:14:37.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.809 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.809 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:37.809 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.773401+0000", 2024-04-26T11:14:37.809 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000133771 2024-04-26T11:14:37.809 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.809 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:37.809 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.809 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.809 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:143240 5.a e42/31 5:59818bf7:::benchmark_data_smithi029_44842_object143239:head v 42'9025, mlcod=42'9022)", 2024-04-26T11:14:37.809 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:37.771351+0000", 2024-04-26T11:14:37.810 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.001928873, 2024-04-26T11:14:37.810 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0031959950000000001, 2024-04-26T11:14:37.810 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:37.810 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:37.810 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:37.810 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.810 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:37.810 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.771351+0000", 2024-04-26T11:14:37.810 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.810 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.810 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:37.810 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.771351+0000", 2024-04-26T11:14:37.810 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.811 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:37.811 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.771350+0000", 2024-04-26T11:14:37.811 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.811 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:37.811 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.771380+0000", 2024-04-26T11:14:37.811 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9981e-05 2024-04-26T11:14:37.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.811 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:37.811 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.771388+0000", 2024-04-26T11:14:37.811 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3960000000000006e-06 2024-04-26T11:14:37.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.812 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.812 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.812 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.771395+0000", 2024-04-26T11:14:37.812 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4169999999999997e-06 2024-04-26T11:14:37.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.812 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.812 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:37.812 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.771787+0000", 2024-04-26T11:14:37.812 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000392579 2024-04-26T11:14:37.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.812 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.812 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:37.812 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.771801+0000", 2024-04-26T11:14:37.813 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3343000000000001e-05 2024-04-26T11:14:37.813 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.813 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:37.813 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.813 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.813 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:143243 5.a e42/31 5:5ac0b68d:::benchmark_data_smithi029_44842_object143242:head v 42'9026, mlcod=42'9022)", 2024-04-26T11:14:37.813 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:37.772729+0000", 2024-04-26T11:14:37.813 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00055017399999999995, 2024-04-26T11:14:37.813 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0018737210000000001, 2024-04-26T11:14:37.813 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:37.813 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:37.813 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:37.813 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.813 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:37.814 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.772729+0000", 2024-04-26T11:14:37.814 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.814 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.814 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:37.814 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.772729+0000", 2024-04-26T11:14:37.814 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.814 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.814 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:37.814 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.772729+0000", 2024-04-26T11:14:37.814 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.814 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.815 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:37.815 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.772785+0000", 2024-04-26T11:14:37.815 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5961000000000002e-05 2024-04-26T11:14:37.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.815 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.815 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:37.815 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.772795+0000", 2024-04-26T11:14:37.815 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0587999999999999e-05 2024-04-26T11:14:37.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.815 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.815 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.815 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.772801+0000", 2024-04-26T11:14:37.815 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2450000000000003e-06 2024-04-26T11:14:37.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.815 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.816 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:37.816 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.773357+0000", 2024-04-26T11:14:37.816 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000555796 2024-04-26T11:14:37.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.816 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.816 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:37.816 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.773379+0000", 2024-04-26T11:14:37.816 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1963999999999998e-05 2024-04-26T11:14:37.816 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.816 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:37.816 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.816 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.816 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:143245 5.2 5:41909999:::benchmark_data_smithi029_44842_object143244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T11:14:37.816 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:37.773285+0000", 2024-04-26T11:14:37.817 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9999943, 2024-04-26T11:14:37.817 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001379276, 2024-04-26T11:14:37.817 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:37.817 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:37.817 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:37.817 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:37.817 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.817 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 143245 2024-04-26T11:14:37.817 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.817 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:37.817 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.817 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:37.817 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.773285+0000", 2024-04-26T11:14:37.817 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.818 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.818 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.818 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:37.818 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.773285+0000", 2024-04-26T11:14:37.818 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.818 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.818 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.818 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:37.818 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.773285+0000", 2024-04-26T11:14:37.818 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:37.818 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.818 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.818 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:37.818 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.773344+0000", 2024-04-26T11:14:37.818 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9070999999999997e-05 2024-04-26T11:14:37.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.819 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.819 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:37.819 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.773353+0000", 2024-04-26T11:14:37.819 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9109999999999999e-06 2024-04-26T11:14:37.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.819 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.819 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.819 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.773360+0000", 2024-04-26T11:14:37.819 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2570000000000001e-06 2024-04-26T11:14:37.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.820 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.820 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:37.820 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.773393+0000", 2024-04-26T11:14:37.820 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.294e-05 2024-04-26T11:14:37.820 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.820 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.820 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:37.820 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.773480+0000", 2024-04-26T11:14:37.820 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7163000000000006e-05 2024-04-26T11:14:37.820 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.820 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:37.820 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.820 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.820 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.820 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:143246 5.3 5:c26d677a:::benchmark_data_smithi029_44842_object143245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T11:14:37.821 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:37.773371+0000", 2024-04-26T11:14:37.821 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9999089, 2024-04-26T11:14:37.821 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001360986, 2024-04-26T11:14:37.821 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:37.821 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:37.821 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:37.821 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:37.821 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:37.821 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 143246 2024-04-26T11:14:37.821 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.821 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:37.821 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.821 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:37.821 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.773371+0000", 2024-04-26T11:14:37.821 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.822 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.822 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:37.822 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.773371+0000", 2024-04-26T11:14:37.822 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:37.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.822 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.822 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:37.822 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.773370+0000", 2024-04-26T11:14:37.822 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:37.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.822 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.822 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:37.822 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.773400+0000", 2024-04-26T11:14:37.823 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0083e-05 2024-04-26T11:14:37.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.823 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.823 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:37.823 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.773408+0000", 2024-04-26T11:14:37.823 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2409999999999998e-06 2024-04-26T11:14:37.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.823 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.823 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:37.823 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.773414+0000", 2024-04-26T11:14:37.823 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.263e-06 2024-04-26T11:14:37.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.823 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.823 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:37.823 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.773460+0000", 2024-04-26T11:14:37.824 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5704999999999997e-05 2024-04-26T11:14:37.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:37.824 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:37.824 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:37.824 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:37.773587+0000", 2024-04-26T11:14:37.824 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000127658 2024-04-26T11:14:37.824 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.824 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:37.824 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.824 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:37.824 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:14:37.824 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 13 2024-04-26T11:14:37.824 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:37.826 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:37.826 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:37.824+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:37.862 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:37.883 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:37.883 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:37.883 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:37.883 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:37.885 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:37.886 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:37.927 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:37.925+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:38.027 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:38.025+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:38.044 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:38.044 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:38.060 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:38.145 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:38.143+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:38.228 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:38.227+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:38.285 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:38.285 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:38.301 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:38.345 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:38.343+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:38.415 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:2024-04-26T11:14:38.414860+0000 min lat: 0.00112975 max lat: 1.0322 avg lat: 0.0066356 2024-04-26T11:14:38.415 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-26T11:14:38.415 INFO:tasks.radosbench.radosbench.0.smithi029.stdout: 60 1 144635 144634 150.647 138.25 0.00699141 0.0066356 2024-04-26T11:14:38.431 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:38.429+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:38.454 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:38.454 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:38.464 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:38.531 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:38.530+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:38.630 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:38.630 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:38.632 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:38.630+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:38.639 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:38.655 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:14:38.733 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:38.731+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:38.765 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:38.765 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:38.775 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:38.834 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:38.832+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:38.906 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:38.906 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:38.916 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:38.957 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:38.955+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:39.035 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:39.033+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:39.083 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:39.084 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:39.094 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:39.137 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:39.135+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:39.237 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:39.236+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:39.259 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:39.260 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:39.269 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:39.338 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:39.336+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:39.402 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:39.403 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:39.412 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:39.415 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:Total time run: 60.0055 2024-04-26T11:14:39.415 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:Total writes made: 144635 2024-04-26T11:14:39.415 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:Write size: 65536 2024-04-26T11:14:39.415 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:Object size: 65536 2024-04-26T11:14:39.415 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:Bandwidth (MB/sec): 150.648 2024-04-26T11:14:39.416 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:Stddev Bandwidth: 44.0934 2024-04-26T11:14:39.416 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:Max bandwidth (MB/sec): 323.875 2024-04-26T11:14:39.416 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:Min bandwidth (MB/sec): 8.5625 2024-04-26T11:14:39.416 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:Average IOPS: 2410 2024-04-26T11:14:39.416 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:Stddev IOPS: 705.495 2024-04-26T11:14:39.416 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:Max IOPS: 5182 2024-04-26T11:14:39.416 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:Min IOPS: 137 2024-04-26T11:14:39.416 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:Average Latency(s): 0.00663559 2024-04-26T11:14:39.416 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:Stddev Latency(s): 0.0153359 2024-04-26T11:14:39.416 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:Max latency(s): 1.0322 2024-04-26T11:14:39.416 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:Min latency(s): 0.00112975 2024-04-26T11:14:39.421 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:Cleaning up (deleting benchmark objects) 2024-04-26T11:14:39.455 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:39.453+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:39.540 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:39.538+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:39.621 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:39.621 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:39.634 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:39.641 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:39.639+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:39.654 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is set 2024-04-26T11:14:39.742 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:39.740+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:39.805 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:39.806 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:39.818 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:39.832 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~41s 2024-04-26T11:14:39.862 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:39.860+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:39.887 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:14:39.944 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:39.942+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:40.006 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:40.006 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:40.021 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:40.043 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:40.045 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:40.044+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:40.064 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:40.064 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:40.065 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:40.065 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:40.067 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:40.067 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:40.149 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:40.146+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:40.242 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:40.243 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:14:40.243 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:14:40.243 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:14:40.243 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:40.248 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:40.246+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:40.258 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:40.349 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:40.347+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:40.447 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:40.447 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:14:40.447 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:14:40.447 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:40.447 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.447 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:40.447 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:40.447 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 47.171125918999998, 2024-04-26T11:14:40.447 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:14:40.447 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:40.447 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:40.448 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:40.448 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:40.448 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:40.448 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:14:40.448 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.448 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:40.448 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.448 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:40.448 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:40.448 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.448 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.448 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.449 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:40.449 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:40.449 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.449 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.449 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:40.449 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:14:40.449 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:40.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.449 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.449 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:40.449 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:14:40.449 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:14:40.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.450 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.450 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:40.450 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:14:40.450 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:14:40.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.450 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.450 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.450 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:14:40.450 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:14:40.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.450 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.450 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.450 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:14:40.451 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:14:40.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.451 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.451 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:40.451 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:14:40.451 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:14:40.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.451 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.451 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:40.451 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:14:40.451 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:14:40.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.451 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.452 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:40.452 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:14:40.452 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:14:40.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.452 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.452 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:40.452 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:14:40.452 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:14:40.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.452 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.452 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:40.452 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:14:40.452 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:14:40.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.452 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.453 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:40.453 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:14:40.453 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:14:40.453 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.453 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:40.453 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.453 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.453 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.453 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:40.453 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:40.453 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 47.170314353999999, 2024-04-26T11:14:40.453 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:14:40.454 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:40.454 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:40.454 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:40.454 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:40.454 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:40.454 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:14:40.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.454 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:40.454 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.454 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:40.454 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:40.454 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.455 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.455 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:40.455 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:40.455 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.455 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.455 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:40.455 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:40.455 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:40.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.455 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.455 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:40.456 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:14:40.456 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:14:40.456 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.456 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.456 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:40.456 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:14:40.456 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:14:40.456 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.456 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.456 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.456 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:14:40.457 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:14:40.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.457 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.457 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.457 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:14:40.457 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:14:40.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.457 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.457 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:40.458 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:14:40.458 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:14:40.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.458 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.458 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:40.458 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:14:40.458 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:14:40.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.458 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.458 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:40.458 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:14:40.458 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:14:40.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.458 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.459 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:40.459 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:14:40.459 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:14:40.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.459 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.459 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:40.459 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:14:40.459 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:14:40.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.459 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.459 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:40.459 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:14:40.459 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:14:40.459 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.460 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:40.460 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.460 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.460 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:40.460 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:40.460 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 47.163127517, 2024-04-26T11:14:40.460 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:14:40.460 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:40.460 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:40.460 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:40.460 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:40.461 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:40.461 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:14:40.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.461 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:40.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.461 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:40.461 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:40.461 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.461 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:40.461 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:40.461 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.462 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.462 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:40.462 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:14:40.462 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:40.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.462 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.462 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:40.462 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:14:40.462 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:14:40.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.462 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.462 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:40.462 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:14:40.463 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:14:40.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.463 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.463 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.463 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:14:40.463 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:14:40.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.463 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.463 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.463 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:14:40.463 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:14:40.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.463 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.463 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:40.464 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:14:40.464 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:14:40.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.464 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.464 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:40.464 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:14:40.464 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:14:40.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.464 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.464 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:40.464 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:14:40.464 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:14:40.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.464 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.465 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:40.465 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:14:40.465 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:14:40.465 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.465 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.465 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:40.465 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:14:40.465 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:14:40.465 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.465 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.465 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:40.465 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:14:40.465 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:14:40.465 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.466 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:40.466 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.466 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.466 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:40.466 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:40.466 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 47.162586638000001, 2024-04-26T11:14:40.466 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:14:40.466 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:40.466 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:40.466 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:40.466 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:40.466 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:40.466 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:14:40.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.467 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:40.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.467 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:40.467 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:40.467 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.467 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:40.467 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:40.467 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.467 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:40.467 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:40.468 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:40.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.468 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.468 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:40.468 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:14:40.468 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:14:40.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.468 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.468 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:40.468 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:14:40.468 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:14:40.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.468 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.468 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.469 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:14:40.469 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:14:40.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.469 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.469 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:14:40.469 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:14:40.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.469 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:40.469 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:14:40.469 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:14:40.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.470 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.470 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:40.470 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:14:40.470 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:14:40.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.470 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.470 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:40.470 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:14:40.470 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:14:40.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.470 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.470 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:40.470 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:14:40.470 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:14:40.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.471 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.471 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:40.471 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:14:40.471 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:14:40.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.471 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.471 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:40.471 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:14:40.471 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:14:40.471 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.471 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:40.472 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.472 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.472 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:40.472 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:40.472 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 43.119402190999999, 2024-04-26T11:14:40.472 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:14:40.472 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:40.472 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:40.472 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:40.472 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:40.472 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:40.472 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:14:40.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.473 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:40.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.473 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:40.473 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:40.473 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.473 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:40.473 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:40.473 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.473 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:40.473 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:14:40.474 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:40.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.474 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:40.474 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:14:40.474 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:14:40.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.474 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:40.474 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:14:40.474 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:14:40.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.474 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.475 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:14:40.475 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:14:40.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.475 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.475 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:14:40.475 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:14:40.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.475 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:40.475 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:14:40.475 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:14:40.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.475 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:40.476 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:14:40.476 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:14:40.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.476 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.476 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:40.476 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:14:40.476 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:14:40.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.476 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.476 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.476 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:14:40.476 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:14:40.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.476 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.476 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:40.477 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:14:40.477 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:14:40.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.477 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.477 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.477 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:14:40.477 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:14:40.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.477 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.477 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:40.477 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:14:40.477 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:14:40.477 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.477 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:40.477 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.478 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.478 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:40.478 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:40.478 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 43.117208851000001, 2024-04-26T11:14:40.478 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:14:40.478 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:40.478 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:40.478 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:40.478 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:40.478 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:40.478 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:14:40.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.479 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:40.479 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.479 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:40.479 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:40.479 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.479 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.479 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:40.479 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:40.479 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.479 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.479 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:40.479 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:14:40.479 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:40.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.480 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.480 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:40.480 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:14:40.480 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:14:40.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.480 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.480 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:40.480 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:14:40.480 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:14:40.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.480 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.480 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.480 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:14:40.480 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:14:40.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.481 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.481 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.481 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:14:40.481 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:14:40.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.481 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.481 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:40.481 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:14:40.481 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:14:40.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.481 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.481 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:40.481 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:14:40.481 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:14:40.482 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.482 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.482 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:40.482 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:14:40.482 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:14:40.482 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.482 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.482 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.482 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:14:40.482 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:14:40.482 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.482 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.482 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:40.482 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:14:40.483 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:14:40.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.483 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.483 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.483 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:14:40.483 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:14:40.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.483 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.483 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:40.483 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:14:40.483 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:14:40.483 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.483 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:40.483 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.484 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.484 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:40.484 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:40.484 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 43.111997027000001, 2024-04-26T11:14:40.484 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:14:40.484 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:40.484 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:40.484 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:40.484 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:40.484 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:40.484 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:14:40.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.484 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:40.484 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.485 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:40.485 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:40.485 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.485 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.485 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:40.485 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:40.485 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.485 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.485 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:40.485 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:14:40.485 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:40.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.486 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.486 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:40.486 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:14:40.486 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:14:40.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.486 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.486 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:40.486 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:14:40.486 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:14:40.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.486 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.486 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.486 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:14:40.487 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:14:40.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.487 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.487 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.487 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:14:40.487 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:14:40.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.487 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.487 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:40.487 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:14:40.487 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:14:40.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.487 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.487 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:40.487 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:14:40.488 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:14:40.488 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.488 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.488 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:40.488 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:14:40.488 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:14:40.488 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.488 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.488 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.489 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:14:40.489 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:14:40.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.489 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.489 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:40.489 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:14:40.489 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:14:40.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.489 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.489 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.489 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:14:40.489 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:14:40.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.489 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.490 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:40.490 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:14:40.490 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:14:40.490 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.490 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:40.490 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.490 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.490 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:40.490 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:40.490 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 43.095548327000003, 2024-04-26T11:14:40.491 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:14:40.491 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:40.491 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:40.491 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:40.491 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:40.491 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:40.491 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:14:40.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.491 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:40.491 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.491 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:40.492 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:40.492 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.492 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.492 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:40.492 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:40.492 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.492 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.492 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:40.492 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:14:40.492 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:40.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.492 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.492 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:40.493 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:14:40.493 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:14:40.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.493 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.493 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:40.493 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:14:40.493 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:14:40.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.493 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.493 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.493 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:14:40.493 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:14:40.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.493 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.494 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.494 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:14:40.494 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:14:40.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.494 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.494 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:40.494 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:14:40.494 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:14:40.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.494 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.494 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.494 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:14:40.494 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:14:40.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.495 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.495 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:40.495 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:14:40.495 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:14:40.495 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.495 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:40.495 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.495 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.495 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:40.495 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:40.495 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 43.093850822, 2024-04-26T11:14:40.495 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:14:40.495 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:40.495 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:40.496 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:40.496 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:40.496 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:40.496 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:14:40.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.496 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:40.496 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.496 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:40.496 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:40.496 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.496 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.496 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:40.496 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:40.496 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.497 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.497 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:40.497 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:14:40.497 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:40.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.497 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.497 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:40.497 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:14:40.497 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:14:40.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.497 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.497 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:40.497 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:14:40.497 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:14:40.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.498 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.498 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.498 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:14:40.498 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:14:40.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.498 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.498 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.498 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:14:40.498 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:14:40.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.498 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.498 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:40.498 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:14:40.498 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:14:40.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.499 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.499 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.499 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:14:40.499 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:14:40.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.499 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.499 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:40.499 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:14:40.499 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:14:40.499 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.499 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:40.499 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.500 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.500 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:40.500 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:40.500 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 43.093786520000002, 2024-04-26T11:14:40.500 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:14:40.500 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:40.500 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:40.500 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:40.500 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:40.500 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:40.500 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:14:40.500 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.500 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:40.501 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.501 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:40.501 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:40.501 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.501 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.501 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:40.501 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:40.501 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.501 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.501 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:40.501 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:40.501 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:40.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.502 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.502 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:40.502 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:14:40.502 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:14:40.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.502 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.502 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:40.502 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:14:40.502 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:14:40.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.503 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.503 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.503 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:14:40.503 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:14:40.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.503 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.503 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.503 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:14:40.503 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:14:40.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.504 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.504 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:40.504 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:14:40.504 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:14:40.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.504 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.504 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.504 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:14:40.504 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:14:40.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.504 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.504 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:40.504 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:14:40.504 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:14:40.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.505 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.505 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:40.505 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:14:40.505 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:14:40.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.505 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.505 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:40.505 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:14:40.505 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:14:40.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.505 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.505 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:40.505 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:14:40.505 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:14:40.506 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.506 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:40.506 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.506 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.506 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:40.506 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:40.506 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 43.093732295999999, 2024-04-26T11:14:40.506 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:14:40.506 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:40.507 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:40.507 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:40.507 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:40.507 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:40.507 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:14:40.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.507 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:40.507 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.507 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:40.507 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:40.507 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.507 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.508 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:40.508 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:40.508 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.508 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.508 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:40.508 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:40.508 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:40.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.508 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.508 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:40.508 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:14:40.508 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:14:40.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.508 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.509 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:40.509 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:14:40.509 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:14:40.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.509 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.509 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.509 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:14:40.509 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:14:40.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.509 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.509 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.509 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:14:40.509 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:14:40.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.510 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.510 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:40.510 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:14:40.510 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:14:40.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.510 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.510 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.510 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:14:40.510 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:14:40.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.510 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.511 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:40.511 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:14:40.511 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:14:40.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.511 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.511 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:40.511 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:14:40.511 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:14:40.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.511 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.511 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:40.511 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:14:40.511 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:40.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.511 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.512 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:40.512 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:14:40.512 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:14:40.512 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.512 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:40.512 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.512 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.512 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:40.512 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:40.512 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 43.093687783999997, 2024-04-26T11:14:40.512 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:14:40.512 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:40.512 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:40.512 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:40.513 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:40.513 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:40.513 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:14:40.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.513 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:40.513 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.513 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:40.513 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:40.513 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.513 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.513 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:40.513 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:40.513 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.514 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.514 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:40.514 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:14:40.514 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:40.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.514 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.514 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:40.514 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:14:40.514 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:14:40.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.514 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.514 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:40.514 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:14:40.515 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:14:40.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.515 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.515 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.515 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:14:40.515 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:14:40.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.515 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.515 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.515 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:14:40.515 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:14:40.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.515 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.515 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:40.516 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:14:40.516 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:14:40.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.516 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.516 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.516 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:14:40.516 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:14:40.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.516 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.516 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:40.516 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:14:40.516 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:14:40.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.516 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.517 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:40.517 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:14:40.517 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:14:40.517 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.517 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.517 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:40.517 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:14:40.517 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:14:40.517 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.517 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.517 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:40.517 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:14:40.517 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:14:40.517 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.518 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:40.518 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.518 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.518 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:40.518 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:40.518 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 43.089466782000002, 2024-04-26T11:14:40.518 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:14:40.518 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:40.518 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:40.518 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:40.518 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:40.519 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:40.519 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:14:40.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.519 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:40.519 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.519 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:40.519 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:40.519 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.519 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.519 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:40.519 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:40.519 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.520 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.520 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:40.520 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:14:40.520 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:14:40.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.520 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.520 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:40.520 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:14:40.520 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:14:40.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.520 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.520 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:40.520 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:14:40.521 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:14:40.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.521 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.521 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.521 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:14:40.521 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:14:40.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.521 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.521 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.521 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:14:40.521 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:14:40.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.521 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.521 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:40.521 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:14:40.522 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:14:40.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.522 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.522 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.522 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:14:40.522 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:14:40.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.522 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.522 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:40.522 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:14:40.522 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:14:40.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.522 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.522 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:40.523 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:14:40.523 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:14:40.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.523 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.523 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:40.523 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:14:40.523 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:14:40.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.523 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.523 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:40.523 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:14:40.523 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:14:40.523 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.523 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:40.524 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.524 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.524 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83360 5.2 5:42f8bfcd:::benchmark_data_smithi029_44842_object83359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:40.524 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:40.524 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 29.402227411999998, 2024-04-26T11:14:40.524 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022279782000000001, 2024-04-26T11:14:40.524 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:40.524 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:40.524 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:40.524 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:40.524 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:40.524 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83360 2024-04-26T11:14:40.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.525 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:40.525 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.525 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:40.525 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:40.525 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.525 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.525 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:40.525 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:40.525 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.525 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.525 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:40.525 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:40.526 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:40.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.526 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.526 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:40.526 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039700+0000", 2024-04-26T11:14:40.526 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5541000000000002e-05 2024-04-26T11:14:40.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.526 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.526 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:40.526 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039706+0000", 2024-04-26T11:14:40.526 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3680000000000001e-06 2024-04-26T11:14:40.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.526 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.526 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.527 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039709+0000", 2024-04-26T11:14:40.527 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4659999999999999e-06 2024-04-26T11:14:40.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.527 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.527 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.527 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056305+0000", 2024-04-26T11:14:40.527 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016595649000000001 2024-04-26T11:14:40.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.527 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.527 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:40.527 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056487+0000", 2024-04-26T11:14:40.527 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000181886 2024-04-26T11:14:40.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.527 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.528 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:40.528 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061809+0000", 2024-04-26T11:14:40.528 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053223259999999996 2024-04-26T11:14:40.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.528 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.528 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:40.528 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061852+0000", 2024-04-26T11:14:40.528 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2738999999999999e-05 2024-04-26T11:14:40.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.528 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.528 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:40.528 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061925+0000", 2024-04-26T11:14:40.529 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3180000000000001e-05 2024-04-26T11:14:40.529 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.529 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:40.529 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.529 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.529 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83364 5.2 5:42c5cd8c:::benchmark_data_smithi029_44842_object83363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:40.529 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:40.529 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 29.401811672000001, 2024-04-26T11:14:40.529 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022695336, 2024-04-26T11:14:40.529 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:40.529 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:40.529 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:40.529 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:40.529 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:40.530 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83364 2024-04-26T11:14:40.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.530 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:40.530 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.530 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:40.530 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:40.530 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.530 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.530 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:40.530 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:40.530 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.531 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.531 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:40.531 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040060+0000", 2024-04-26T11:14:40.531 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:40.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.531 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.531 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:40.531 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040086+0000", 2024-04-26T11:14:40.531 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5482000000000001e-05 2024-04-26T11:14:40.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.531 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.531 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:40.532 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040093+0000", 2024-04-26T11:14:40.532 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6409999999999996e-06 2024-04-26T11:14:40.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.532 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.532 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040098+0000", 2024-04-26T11:14:40.532 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879999999999996e-06 2024-04-26T11:14:40.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.532 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.532 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058292+0000", 2024-04-26T11:14:40.532 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018193504999999999 2024-04-26T11:14:40.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:40.533 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058412+0000", 2024-04-26T11:14:40.533 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011979199999999999 2024-04-26T11:14:40.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:40.533 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062642+0000", 2024-04-26T11:14:40.533 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042299449999999997 2024-04-26T11:14:40.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:40.534 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062688+0000", 2024-04-26T11:14:40.534 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6859e-05 2024-04-26T11:14:40.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.534 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:40.534 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062756+0000", 2024-04-26T11:14:40.534 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7995000000000002e-05 2024-04-26T11:14:40.534 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.534 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:40.534 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.535 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:129903 5.0 e40/16 5:00b2d390:::benchmark_data_smithi029_44842_object129902:head v 40'8238, mlcod=40'8234)", 2024-04-26T11:14:40.535 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:40.535 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.5480622890000006, 2024-04-26T11:14:40.535 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.02228639, 2024-04-26T11:14:40.535 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:40.535 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:40.535 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:40.535 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.535 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:40.535 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:40.535 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.535 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.536 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:40.536 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:40.536 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.536 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.536 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:40.536 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:40.536 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:40.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.536 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.536 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:40.536 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893874+0000", 2024-04-26T11:14:40.536 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3849000000000005e-05 2024-04-26T11:14:40.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.537 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:40.537 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893884+0000", 2024-04-26T11:14:40.537 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0149000000000001e-05 2024-04-26T11:14:40.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.537 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.537 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893892+0000", 2024-04-26T11:14:40.537 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0299999999999994e-06 2024-04-26T11:14:40.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.537 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.537 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.894003+0000", 2024-04-26T11:14:40.537 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011128099999999999 2024-04-26T11:14:40.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.538 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:40.538 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.894024+0000", 2024-04-26T11:14:40.538 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0979e-05 2024-04-26T11:14:40.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.538 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:40.538 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.916077+0000", 2024-04-26T11:14:40.538 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022053461 2024-04-26T11:14:40.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.538 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:40.538 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.916097+0000", 2024-04-26T11:14:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9389999999999999e-05 2024-04-26T11:14:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:130959 5.7 5:ee32f7f7:::benchmark_data_smithi029_44842_object130958:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:32.375500+0000", 2024-04-26T11:14:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.0663730170000001, 2024-04-26T11:14:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022235456000000001, 2024-04-26T11:14:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:40.539 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:40.540 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 130959 2024-04-26T11:14:40.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.540 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:40.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.540 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:40.540 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375500+0000", 2024-04-26T11:14:40.540 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.540 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:40.540 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375500+0000", 2024-04-26T11:14:40.540 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.541 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:40.541 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375499+0000", 2024-04-26T11:14:40.541 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:40.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.541 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:40.541 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375530+0000", 2024-04-26T11:14:40.541 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0556999999999999e-05 2024-04-26T11:14:40.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.541 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:40.541 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375537+0000", 2024-04-26T11:14:40.541 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7849999999999992e-06 2024-04-26T11:14:40.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.542 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.542 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.542 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375543+0000", 2024-04-26T11:14:40.542 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6060000000000002e-06 2024-04-26T11:14:40.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.542 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.542 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.542 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.377410+0000", 2024-04-26T11:14:40.542 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0018671149999999999 2024-04-26T11:14:40.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.542 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.542 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:40.543 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.377544+0000", 2024-04-26T11:14:40.543 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013380999999999999 2024-04-26T11:14:40.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.543 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.543 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:40.543 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397624+0000", 2024-04-26T11:14:40.543 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020079889 2024-04-26T11:14:40.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.543 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.543 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:40.543 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397662+0000", 2024-04-26T11:14:40.543 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8269999999999998e-05 2024-04-26T11:14:40.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.543 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.544 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:40.544 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397735+0000", 2024-04-26T11:14:40.544 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3017999999999998e-05 2024-04-26T11:14:40.544 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.544 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:40.544 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.544 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.544 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:130960 5.0 e40/16 5:042df53c:::benchmark_data_smithi029_44842_object130959:head v 40'8310, mlcod=40'8308)", 2024-04-26T11:14:40.544 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:32.375983+0000", 2024-04-26T11:14:40.544 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.0658901069999995, 2024-04-26T11:14:40.544 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.021699000999999999, 2024-04-26T11:14:40.544 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:40.544 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:40.545 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:40.545 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.545 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:40.545 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375983+0000", 2024-04-26T11:14:40.545 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.545 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.545 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:40.545 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375983+0000", 2024-04-26T11:14:40.546 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.546 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.546 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:40.546 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375982+0000", 2024-04-26T11:14:40.546 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:40.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.546 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.546 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:40.546 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376039+0000", 2024-04-26T11:14:40.546 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7240000000000001e-05 2024-04-26T11:14:40.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.546 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.546 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:40.547 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376047+0000", 2024-04-26T11:14:40.547 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6699999999999994e-06 2024-04-26T11:14:40.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.547 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.547 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376053+0000", 2024-04-26T11:14:40.547 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:14:40.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.547 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.547 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376504+0000", 2024-04-26T11:14:40.547 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00045143100000000002 2024-04-26T11:14:40.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.548 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:40.548 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376521+0000", 2024-04-26T11:14:40.548 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6820000000000002e-05 2024-04-26T11:14:40.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.548 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.548 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:40.548 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397656+0000", 2024-04-26T11:14:40.548 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.021134824 2024-04-26T11:14:40.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.548 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.548 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:40.548 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397682+0000", 2024-04-26T11:14:40.548 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.597e-05 2024-04-26T11:14:40.548 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.549 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:40.549 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.549 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.549 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:130966 5.3 5:ce21bfb4:::benchmark_data_smithi029_44842_object130965:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:40.549 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:32.376761+0000", 2024-04-26T11:14:40.549 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.0651121010000004, 2024-04-26T11:14:40.549 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.023879659000000001, 2024-04-26T11:14:40.549 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:40.549 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:40.549 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:40.549 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:40.549 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:40.550 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 130966 2024-04-26T11:14:40.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.550 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:40.550 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.550 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:40.550 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376761+0000", 2024-04-26T11:14:40.550 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.550 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.550 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:40.550 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376761+0000", 2024-04-26T11:14:40.550 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.551 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.551 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:40.551 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376760+0000", 2024-04-26T11:14:40.551 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:40.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.551 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.551 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:40.551 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376807+0000", 2024-04-26T11:14:40.551 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7089000000000003e-05 2024-04-26T11:14:40.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.551 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.551 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:40.551 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376817+0000", 2024-04-26T11:14:40.551 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.7329999999999998e-06 2024-04-26T11:14:40.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.552 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.552 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.552 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376824+0000", 2024-04-26T11:14:40.552 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6240000000000002e-06 2024-04-26T11:14:40.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.552 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.552 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.552 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378825+0000", 2024-04-26T11:14:40.552 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020004799999999998 2024-04-26T11:14:40.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.552 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.552 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:40.553 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378963+0000", 2024-04-26T11:14:40.553 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013860399999999999 2024-04-26T11:14:40.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.553 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.553 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:40.553 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.400519+0000", 2024-04-26T11:14:40.553 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.021555405 2024-04-26T11:14:40.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.553 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.553 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:40.553 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.400568+0000", 2024-04-26T11:14:40.553 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8989999999999997e-05 2024-04-26T11:14:40.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.553 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.554 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:40.554 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.400640+0000", 2024-04-26T11:14:40.554 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2556000000000001e-05 2024-04-26T11:14:40.554 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.554 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:40.554 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.554 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.554 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:130965 5.0 e40/16 5:02e1af30:::benchmark_data_smithi029_44842_object130964:head v 40'8311, mlcod=40'8308)", 2024-04-26T11:14:40.554 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:32.378228+0000", 2024-04-26T11:14:40.554 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.0636442800000001, 2024-04-26T11:14:40.554 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.023551810999999999, 2024-04-26T11:14:40.555 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:40.555 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:40.555 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:40.555 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.555 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:40.555 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378228+0000", 2024-04-26T11:14:40.555 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.555 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.555 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.555 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:40.555 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378228+0000", 2024-04-26T11:14:40.556 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:40.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.556 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.556 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:40.556 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378228+0000", 2024-04-26T11:14:40.556 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:40.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.556 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.556 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:40.556 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378275+0000", 2024-04-26T11:14:40.556 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:14:40.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.556 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.557 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:40.557 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378284+0000", 2024-04-26T11:14:40.557 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3740000000000004e-06 2024-04-26T11:14:40.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.557 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.557 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.557 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378291+0000", 2024-04-26T11:14:40.557 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4359999999999999e-06 2024-04-26T11:14:40.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.557 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.557 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:40.557 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378322+0000", 2024-04-26T11:14:40.557 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1260000000000002e-05 2024-04-26T11:14:40.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.557 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.558 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:40.558 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378336+0000", 2024-04-26T11:14:40.558 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3937999999999999e-05 2024-04-26T11:14:40.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.558 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.558 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:40.558 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.401744+0000", 2024-04-26T11:14:40.558 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.023407715999999999 2024-04-26T11:14:40.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:40.558 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:40.558 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:40.558 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.401780+0000", 2024-04-26T11:14:40.558 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6433999999999997e-05 2024-04-26T11:14:40.558 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.559 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:40.559 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.559 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:40.559 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:40.559 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:40.560 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:40.563 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:40.561+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:40.661 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:40.659+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:40.731 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:40.732 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:40.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.732 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:148250 5.a 5:59adb074:::benchmark_data_smithi029_44842_object3612:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T11:14:40.732 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:40.724369+0000", 2024-04-26T11:14:40.732 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0062397470000000003, 2024-04-26T11:14:40.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0062671990000000002, 2024-04-26T11:14:40.732 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:40.732 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:40.732 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 148250 2024-04-26T11:14:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.724369+0000", 2024-04-26T11:14:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.724369+0000", 2024-04-26T11:14:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.724368+0000", 2024-04-26T11:14:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:40.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.724372+0000", 2024-04-26T11:14:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9149999999999998e-06 2024-04-26T11:14:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.724382+0000", 2024-04-26T11:14:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7559999999999994e-06 2024-04-26T11:14:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.724388+0000", 2024-04-26T11:14:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6880000000000002e-06 2024-04-26T11:14:40.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:40.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.724415+0000", 2024-04-26T11:14:40.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6754000000000002e-05 2024-04-26T11:14:40.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:40.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.724500+0000", 2024-04-26T11:14:40.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5246000000000003e-05 2024-04-26T11:14:40.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:40.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.724564+0000", 2024-04-26T11:14:40.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3131000000000003e-05 2024-04-26T11:14:40.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:40.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.728162+0000", 2024-04-26T11:14:40.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003598506 2024-04-26T11:14:40.737 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:40.738 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:40.738 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:40.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.738 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:148254 5.8 5:13b412e5:::benchmark_data_smithi029_44842_object3616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T11:14:40.738 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:40.726104+0000", 2024-04-26T11:14:40.738 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0045040879999999998, 2024-04-26T11:14:40.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045841659999999998, 2024-04-26T11:14:40.738 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:40.739 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:40.739 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:40.739 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:40.739 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:40.739 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 148254 2024-04-26T11:14:40.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.739 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:40.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:40.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726104+0000", 2024-04-26T11:14:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726104+0000", 2024-04-26T11:14:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726104+0000", 2024-04-26T11:14:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:40.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726107+0000", 2024-04-26T11:14:40.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5130000000000001e-06 2024-04-26T11:14:40.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:40.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726116+0000", 2024-04-26T11:14:40.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6079999999999996e-06 2024-04-26T11:14:40.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726123+0000", 2024-04-26T11:14:40.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9110000000000004e-06 2024-04-26T11:14:40.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:40.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726156+0000", 2024-04-26T11:14:40.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3586e-05 2024-04-26T11:14:40.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:40.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726237+0000", 2024-04-26T11:14:40.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0488999999999995e-05 2024-04-26T11:14:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726308+0000", 2024-04-26T11:14:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1481000000000002e-05 2024-04-26T11:14:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.728730+0000", 2024-04-26T11:14:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024218389999999998 2024-04-26T11:14:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:40.743 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:148259 5.e 5:7be3af2f:::benchmark_data_smithi029_44842_object3621:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T11:14:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:40.726148+0000", 2024-04-26T11:14:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0044601880000000003, 2024-04-26T11:14:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045855269999999998, 2024-04-26T11:14:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:40.744 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 148259 2024-04-26T11:14:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726148+0000", 2024-04-26T11:14:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726148+0000", 2024-04-26T11:14:40.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:40.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:40.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726148+0000", 2024-04-26T11:14:40.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:40.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:40.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726151+0000", 2024-04-26T11:14:40.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5499999999999999e-06 2024-04-26T11:14:40.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:40.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726159+0000", 2024-04-26T11:14:40.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5920000000000003e-06 2024-04-26T11:14:40.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726165+0000", 2024-04-26T11:14:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7070000000000003e-06 2024-04-26T11:14:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726187+0000", 2024-04-26T11:14:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1724000000000001e-05 2024-04-26T11:14:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726256+0000", 2024-04-26T11:14:40.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8794999999999994e-05 2024-04-26T11:14:40.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:40.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726333+0000", 2024-04-26T11:14:40.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6669999999999996e-05 2024-04-26T11:14:40.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:40.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.727956+0000", 2024-04-26T11:14:40.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0016232519999999999 2024-04-26T11:14:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:148261 5.a 5:5162c0a6:::benchmark_data_smithi029_44842_object3623:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T11:14:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:40.726265+0000", 2024-04-26T11:14:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0043430370000000001, 2024-04-26T11:14:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045129059999999997, 2024-04-26T11:14:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:40.751 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 148261 2024-04-26T11:14:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726265+0000", 2024-04-26T11:14:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726265+0000", 2024-04-26T11:14:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:40.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726265+0000", 2024-04-26T11:14:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726268+0000", 2024-04-26T11:14:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2780000000000002e-06 2024-04-26T11:14:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726280+0000", 2024-04-26T11:14:40.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2191000000000001e-05 2024-04-26T11:14:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726288+0000", 2024-04-26T11:14:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4780000000000002e-06 2024-04-26T11:14:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726323+0000", 2024-04-26T11:14:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5302999999999997e-05 2024-04-26T11:14:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726439+0000", 2024-04-26T11:14:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000116414 2024-04-26T11:14:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.726542+0000", 2024-04-26T11:14:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102209 2024-04-26T11:14:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.729469+0000", 2024-04-26T11:14:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0029275130000000001 2024-04-26T11:14:40.755 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:148263 5.0 5:0106d866:::benchmark_data_smithi029_44842_object3625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T11:14:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:40.728400+0000", 2024-04-26T11:14:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0022086549999999999, 2024-04-26T11:14:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024220330000000001, 2024-04-26T11:14:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:40.756 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 148263 2024-04-26T11:14:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.728400+0000", 2024-04-26T11:14:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:40.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.728400+0000", 2024-04-26T11:14:40.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:40.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:40.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.728399+0000", 2024-04-26T11:14:40.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:40.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:40.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.728403+0000", 2024-04-26T11:14:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3790000000000002e-06 2024-04-26T11:14:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.728410+0000", 2024-04-26T11:14:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6369999999999999e-06 2024-04-26T11:14:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.728417+0000", 2024-04-26T11:14:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3740000000000003e-06 2024-04-26T11:14:40.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.728443+0000", 2024-04-26T11:14:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6361999999999999e-05 2024-04-26T11:14:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.728517+0000", 2024-04-26T11:14:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3708999999999995e-05 2024-04-26T11:14:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:40.728578+0000", 2024-04-26T11:14:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1026999999999997e-05 2024-04-26T11:14:40.760 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:40.761 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:40.761 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:40.761 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:40.761 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:14:40.761 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 5 2024-04-26T11:14:40.761 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:40.762 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:40.760+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:40.763 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:40.863 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:40.861+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:40.940 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:40.940 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:14:40.940 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:14:40.940 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:14:40.940 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:40.953 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:40.964 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:40.962+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:41.064 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:41.062+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:41.127 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:41.127 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:14:41.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:14:41.127 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:41.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.127 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:41.127 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:41.127 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.844087934000001, 2024-04-26T11:14:41.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:14:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:14:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:41.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:41.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:41.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:41.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:41.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:14:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:14:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:14:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:14:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:14:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:14:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:14:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:14:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:14:41.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:14:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:14:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:14:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:14:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:14:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:14:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:14:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:14:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:14:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:14:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:14:41.133 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.843438231999997, 2024-04-26T11:14:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:14:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:14:41.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:14:41.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:14:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:14:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:14:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:14:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:14:41.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:14:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:14:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:14:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:14:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:14:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:14:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:14:41.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:14:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:14:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:14:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:14:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:41.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:14:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:14:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:14:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:14:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 43.776796193000003, 2024-04-26T11:14:41.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:14:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:14:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:41.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:14:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:14:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:14:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:14:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:14:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:14:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:14:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:14:41.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:14:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:14:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:14:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:14:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:14:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:41.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:14:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:14:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 43.776700546999997, 2024-04-26T11:14:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:14:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:41.144 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:14:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:14:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:14:41.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:14:41.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:41.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:14:41.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:14:41.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:14:41.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:14:41.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:14:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:14:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:14:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:14:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:14:41.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:14:41.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:41.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:14:41.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:14:41.149 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.149 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:41.149 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.150 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:41.150 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:41.150 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 43.776568867999998, 2024-04-26T11:14:41.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:14:41.150 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:41.150 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:41.150 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:41.150 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:41.150 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.150 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:14:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:14:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:14:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:41.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:14:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:14:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:14:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:14:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:14:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:14:41.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:14:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:14:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:14:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:14:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:14:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:14:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 43.776460411999999, 2024-04-26T11:14:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:14:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:41.155 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:14:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:41.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:41.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:41.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:14:41.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:41.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:14:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:14:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:14:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:14:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:14:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:14:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:14:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:14:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:14:41.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:14:41.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:14:41.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:14:41.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:41.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:14:41.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:14:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 43.776359143999997, 2024-04-26T11:14:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:14:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:41.161 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:41.162 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:41.162 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.162 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:14:41.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.162 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:41.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:41.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:41.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:14:41.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:14:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:14:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:14:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:14:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:14:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:14:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:14:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:14:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:14:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:14:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:14:41.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:14:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:14:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:14:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:14:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:14:41.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:14:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:14:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:14:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 43.776290203000002, 2024-04-26T11:14:41.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:14:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:14:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:41.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:14:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:14:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:14:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:41.169 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:14:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:14:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:14:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:14:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:14:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:14:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:14:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:14:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:14:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:14:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:14:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:14:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:14:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:14:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:14:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:14:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:14:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:14:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.172 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 43.770294622000002, 2024-04-26T11:14:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:14:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.173 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:14:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:14:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:14:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:14:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:14:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:14:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:14:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:14:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:14:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:14:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:14:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:14:41.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:14:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:14:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:14:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:14:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:14:41.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:14:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:14:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:14:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:14:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:14:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.178 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:81256 5.8 5:1c0f3fd8:::benchmark_data_smithi029_44842_object81255:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 31.006835073000001, 2024-04-26T11:14:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026193673000000001, 2024-04-26T11:14:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:41.179 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 81256 2024-04-26T11:14:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116073+0000", 2024-04-26T11:14:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0114e-05 2024-04-26T11:14:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:41.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116079+0000", 2024-04-26T11:14:41.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8939999999999998e-06 2024-04-26T11:14:41.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116082+0000", 2024-04-26T11:14:41.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:14:41.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127501+0000", 2024-04-26T11:14:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011418281000000001 2024-04-26T11:14:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127639+0000", 2024-04-26T11:14:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013828899999999999 2024-04-26T11:14:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127782+0000", 2024-04-26T11:14:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014328299999999999 2024-04-26T11:14:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.134767+0000", 2024-04-26T11:14:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0069844140000000004 2024-04-26T11:14:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142160+0000", 2024-04-26T11:14:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007392839 2024-04-26T11:14:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142202+0000", 2024-04-26T11:14:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2797999999999999e-05 2024-04-26T11:14:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142237+0000", 2024-04-26T11:14:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4464000000000001e-05 2024-04-26T11:14:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101754 5.e 5:7ca15a5c:::benchmark_data_smithi029_44842_object101753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.00434688, 2024-04-26T11:14:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039171048999999999, 2024-04-26T11:14:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101754 2024-04-26T11:14:41.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118604+0000", 2024-04-26T11:14:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3399000000000007e-05 2024-04-26T11:14:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118613+0000", 2024-04-26T11:14:41.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6989999999999992e-06 2024-04-26T11:14:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118618+0000", 2024-04-26T11:14:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3850000000000001e-06 2024-04-26T11:14:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118646+0000", 2024-04-26T11:14:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7878e-05 2024-04-26T11:14:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118720+0000", 2024-04-26T11:14:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3461999999999996e-05 2024-04-26T11:14:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118807+0000", 2024-04-26T11:14:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7269999999999996e-05 2024-04-26T11:14:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:41.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142317+0000", 2024-04-26T11:14:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023510105999999999 2024-04-26T11:14:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.143287+0000", 2024-04-26T11:14:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096983599999999996 2024-04-26T11:14:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157662+0000", 2024-04-26T11:14:41.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014375393 2024-04-26T11:14:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157702+0000", 2024-04-26T11:14:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0295e-05 2024-04-26T11:14:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101755 5.f 5:fa973a83:::benchmark_data_smithi029_44842_object101754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:41.192 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.004181184, 2024-04-26T11:14:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039139064000000001, 2024-04-26T11:14:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101755 2024-04-26T11:14:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:41.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:41.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118696+0000", 2024-04-26T11:14:41.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:41.195 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118766+0000", 2024-04-26T11:14:41.195 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9423000000000003e-05 2024-04-26T11:14:41.195 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.195 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.195 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118774+0000", 2024-04-26T11:14:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9710000000000004e-06 2024-04-26T11:14:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118779+0000", 2024-04-26T11:14:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5629999999999999e-06 2024-04-26T11:14:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118817+0000", 2024-04-26T11:14:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7771000000000001e-05 2024-04-26T11:14:41.196 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118929+0000", 2024-04-26T11:14:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011222699999999999 2024-04-26T11:14:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157661+0000", 2024-04-26T11:14:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038731120000000001 2024-04-26T11:14:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:41.197 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157757+0000", 2024-04-26T11:14:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6910000000000006e-05 2024-04-26T11:14:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157836+0000", 2024-04-26T11:14:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8727999999999996e-05 2024-04-26T11:14:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101758 5.4 5:2525a4eb:::benchmark_data_smithi029_44842_object101757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:41.198 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.001998333, 2024-04-26T11:14:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.03686739, 2024-04-26T11:14:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101758 2024-04-26T11:14:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120879+0000", 2024-04-26T11:14:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120971+0000", 2024-04-26T11:14:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2133999999999996e-05 2024-04-26T11:14:41.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120977+0000", 2024-04-26T11:14:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5509999999999999e-06 2024-04-26T11:14:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120981+0000", 2024-04-26T11:14:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.245e-06 2024-04-26T11:14:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121010+0000", 2024-04-26T11:14:41.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9084000000000001e-05 2024-04-26T11:14:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121083+0000", 2024-04-26T11:14:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2942999999999996e-05 2024-04-26T11:14:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121163+0000", 2024-04-26T11:14:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0197000000000005e-05 2024-04-26T11:14:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142822+0000", 2024-04-26T11:14:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021658535999999999 2024-04-26T11:14:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157674+0000", 2024-04-26T11:14:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014851573999999999 2024-04-26T11:14:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157714+0000", 2024-04-26T11:14:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0473999999999999e-05 2024-04-26T11:14:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.203 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157747+0000", 2024-04-26T11:14:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3278999999999998e-05 2024-04-26T11:14:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101760 5.4 5:2510211a:::benchmark_data_smithi029_44842_object101759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.001565987999999, 2024-04-26T11:14:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039182383000000001, 2024-04-26T11:14:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:41.204 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101760 2024-04-26T11:14:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121389+0000", 2024-04-26T11:14:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6667000000000003e-05 2024-04-26T11:14:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121394+0000", 2024-04-26T11:14:41.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0839999999999999e-06 2024-04-26T11:14:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121397+0000", 2024-04-26T11:14:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4489999999999999e-06 2024-04-26T11:14:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122921+0000", 2024-04-26T11:14:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001524067 2024-04-26T11:14:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.123010+0000", 2024-04-26T11:14:41.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8449000000000006e-05 2024-04-26T11:14:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140838+0000", 2024-04-26T11:14:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017828796000000001 2024-04-26T11:14:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157665+0000", 2024-04-26T11:14:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016826574 2024-04-26T11:14:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160407+0000", 2024-04-26T11:14:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027423970000000002 2024-04-26T11:14:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160456+0000", 2024-04-26T11:14:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8678999999999999e-05 2024-04-26T11:14:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160495+0000", 2024-04-26T11:14:41.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8658000000000002e-05 2024-04-26T11:14:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101761 5.e 5:70294421:::benchmark_data_smithi029_44842_object101760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.000141615, 2024-04-26T11:14:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035270448000000003, 2024-04-26T11:14:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:41.210 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101761 2024-04-26T11:14:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:41.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122736+0000", 2024-04-26T11:14:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122805+0000", 2024-04-26T11:14:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9076000000000001e-05 2024-04-26T11:14:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122811+0000", 2024-04-26T11:14:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:14:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122815+0000", 2024-04-26T11:14:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2860000000000001e-06 2024-04-26T11:14:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122842+0000", 2024-04-26T11:14:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6429000000000001e-05 2024-04-26T11:14:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122916+0000", 2024-04-26T11:14:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4122999999999995e-05 2024-04-26T11:14:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122997+0000", 2024-04-26T11:14:41.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1428999999999996e-05 2024-04-26T11:14:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142344+0000", 2024-04-26T11:14:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019346452 2024-04-26T11:14:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157934+0000", 2024-04-26T11:14:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015589911999999999 2024-04-26T11:14:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157975+0000", 2024-04-26T11:14:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1604999999999999e-05 2024-04-26T11:14:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.158007+0000", 2024-04-26T11:14:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1921000000000002e-05 2024-04-26T11:14:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.216 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110145 5.9 5:9b275f16:::benchmark_data_smithi029_44842_object110144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.974579977000001, 2024-04-26T11:14:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032844496000000001, 2024-04-26T11:14:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110145 2024-04-26T11:14:41.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:41.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148297+0000", 2024-04-26T11:14:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148325+0000", 2024-04-26T11:14:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7511000000000001e-05 2024-04-26T11:14:41.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148338+0000", 2024-04-26T11:14:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2808e-05 2024-04-26T11:14:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148345+0000", 2024-04-26T11:14:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7200000000000006e-06 2024-04-26T11:14:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149888+0000", 2024-04-26T11:14:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001542666 2024-04-26T11:14:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149977+0000", 2024-04-26T11:14:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9247999999999997e-05 2024-04-26T11:14:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181006+0000", 2024-04-26T11:14:41.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031028535999999999 2024-04-26T11:14:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181051+0000", 2024-04-26T11:14:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5393999999999999e-05 2024-04-26T11:14:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181143+0000", 2024-04-26T11:14:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1458000000000004e-05 2024-04-26T11:14:41.222 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110155 5.9 5:9ebc6158:::benchmark_data_smithi029_44842_object110154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.969504185000002, 2024-04-26T11:14:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027886826999999999, 2024-04-26T11:14:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:41.223 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110155 2024-04-26T11:14:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:41.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:41.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:41.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153373+0000", 2024-04-26T11:14:41.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:41.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153479+0000", 2024-04-26T11:14:41.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105728 2024-04-26T11:14:41.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:41.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153491+0000", 2024-04-26T11:14:41.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2207e-05 2024-04-26T11:14:41.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153499+0000", 2024-04-26T11:14:41.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7729999999999999e-06 2024-04-26T11:14:41.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153655+0000", 2024-04-26T11:14:41.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015573 2024-04-26T11:14:41.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:41.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153770+0000", 2024-04-26T11:14:41.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011562500000000001 2024-04-26T11:14:41.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:41.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181153+0000", 2024-04-26T11:14:41.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027382113 2024-04-26T11:14:41.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:41.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181195+0000", 2024-04-26T11:14:41.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1921000000000001e-05 2024-04-26T11:14:41.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:41.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181261+0000", 2024-04-26T11:14:41.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6402999999999994e-05 2024-04-26T11:14:41.228 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.228 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:41.228 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.229 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:129903 5.0 5:00b2d390:::benchmark_data_smithi029_44842_object129902:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:41.229 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:31.889868+0000", 2024-04-26T11:14:41.229 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.2330097850000001, 2024-04-26T11:14:41.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026543418999999999, 2024-04-26T11:14:41.229 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:41.229 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:41.229 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:41.229 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:41.229 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.229 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 129903 2024-04-26T11:14:41.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.229 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:41.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:41.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889868+0000", 2024-04-26T11:14:41.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:41.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889868+0000", 2024-04-26T11:14:41.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:41.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889868+0000", 2024-04-26T11:14:41.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:41.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889936+0000", 2024-04-26T11:14:41.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7655000000000002e-05 2024-04-26T11:14:41.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:41.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889943+0000", 2024-04-26T11:14:41.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7319999999999998e-06 2024-04-26T11:14:41.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889948+0000", 2024-04-26T11:14:41.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5909999999999998e-06 2024-04-26T11:14:41.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.893510+0000", 2024-04-26T11:14:41.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035624540000000001 2024-04-26T11:14:41.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:41.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.893637+0000", 2024-04-26T11:14:41.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000126604 2024-04-26T11:14:41.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:41.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.893784+0000", 2024-04-26T11:14:41.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014726299999999999 2024-04-26T11:14:41.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:41.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.903173+0000", 2024-04-26T11:14:41.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0093891370000000005 2024-04-26T11:14:41.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:41.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.916373+0000", 2024-04-26T11:14:41.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013199407999999999 2024-04-26T11:14:41.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:41.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.916395+0000", 2024-04-26T11:14:41.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2447e-05 2024-04-26T11:14:41.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:41.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.916412+0000", 2024-04-26T11:14:41.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6688e-05 2024-04-26T11:14:41.234 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.234 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:41.234 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.234 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:130965 5.0 5:02e1af30:::benchmark_data_smithi029_44842_object130964:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:41.234 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:32.376041+0000", 2024-04-26T11:14:41.235 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.7468375510000005, 2024-04-26T11:14:41.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027463617999999999, 2024-04-26T11:14:41.235 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:41.235 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:41.235 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:41.235 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:41.235 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.235 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 130965 2024-04-26T11:14:41.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.235 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:41.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:41.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376041+0000", 2024-04-26T11:14:41.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:41.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376041+0000", 2024-04-26T11:14:41.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:41.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376040+0000", 2024-04-26T11:14:41.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:41.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376126+0000", 2024-04-26T11:14:41.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6070999999999996e-05 2024-04-26T11:14:41.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:41.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376133+0000", 2024-04-26T11:14:41.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7739999999999999e-06 2024-04-26T11:14:41.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376137+0000", 2024-04-26T11:14:41.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3669999999999999e-06 2024-04-26T11:14:41.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.378033+0000", 2024-04-26T11:14:41.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001895484 2024-04-26T11:14:41.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:41.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.378108+0000", 2024-04-26T11:14:41.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5201e-05 2024-04-26T11:14:41.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:41.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.378200+0000", 2024-04-26T11:14:41.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1712999999999994e-05 2024-04-26T11:14:41.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:41.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.381666+0000", 2024-04-26T11:14:41.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003466701 2024-04-26T11:14:41.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:41.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.403451+0000", 2024-04-26T11:14:41.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021784583 2024-04-26T11:14:41.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:41.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.403484+0000", 2024-04-26T11:14:41.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3265000000000001e-05 2024-04-26T11:14:41.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:41.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.403504+0000", 2024-04-26T11:14:41.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0123999999999999e-05 2024-04-26T11:14:41.240 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.240 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:41.240 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.240 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:143341 5.e 5:726d70d0:::benchmark_data_smithi029_44842_object143340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T11:14:41.240 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:37.815337+0000", 2024-04-26T11:14:41.240 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.307541713, 2024-04-26T11:14:41.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02673615, 2024-04-26T11:14:41.241 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:41.241 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:41.241 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:41.241 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:41.241 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.241 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 143341 2024-04-26T11:14:41.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.241 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:41.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:41.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.815337+0000", 2024-04-26T11:14:41.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:41.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.815337+0000", 2024-04-26T11:14:41.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:41.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:41.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.815336+0000", 2024-04-26T11:14:41.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:41.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.815404+0000", 2024-04-26T11:14:41.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8003999999999995e-05 2024-04-26T11:14:41.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:41.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.815414+0000", 2024-04-26T11:14:41.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0302999999999999e-05 2024-04-26T11:14:41.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.815421+0000", 2024-04-26T11:14:41.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4919999999999998e-06 2024-04-26T11:14:41.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:41.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.821786+0000", 2024-04-26T11:14:41.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.006365094 2024-04-26T11:14:41.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:41.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.821895+0000", 2024-04-26T11:14:41.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108856 2024-04-26T11:14:41.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:41.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.822026+0000", 2024-04-26T11:14:41.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013116500000000001 2024-04-26T11:14:41.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:41.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.827684+0000", 2024-04-26T11:14:41.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0056578619999999996 2024-04-26T11:14:41.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:41.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.842007+0000", 2024-04-26T11:14:41.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014323259 2024-04-26T11:14:41.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:41.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.842049+0000", 2024-04-26T11:14:41.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2345000000000002e-05 2024-04-26T11:14:41.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:41.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:41.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:41.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.842073+0000", 2024-04-26T11:14:41.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3481000000000001e-05 2024-04-26T11:14:41.247 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.247 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:41.247 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.247 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:41.247 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:41.247 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:41.248 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:41.246+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:41.249 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:41.351 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:41.348+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:41.437 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:41.437 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:41.437 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.437 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:150183 5.5 5:aa80f10c:::benchmark_data_smithi029_44842_object5545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T11:14:41.437 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:41.429859+0000", 2024-04-26T11:14:41.437 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0050683539999999997, 2024-04-26T11:14:41.437 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0050890060000000001, 2024-04-26T11:14:41.437 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:41.437 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:41.438 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:41.438 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:41.438 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.438 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 150183 2024-04-26T11:14:41.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.438 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:41.438 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.438 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:41.438 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.429859+0000", 2024-04-26T11:14:41.438 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.439 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.439 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:41.439 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.429859+0000", 2024-04-26T11:14:41.439 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.440 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.440 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:41.440 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.429858+0000", 2024-04-26T11:14:41.440 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.440 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.440 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:41.440 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.429862+0000", 2024-04-26T11:14:41.440 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.084e-06 2024-04-26T11:14:41.441 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.441 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.441 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:41.441 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.429867+0000", 2024-04-26T11:14:41.441 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9610000000000002e-06 2024-04-26T11:14:41.441 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.441 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.441 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.442 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.429873+0000", 2024-04-26T11:14:41.442 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4319999999999998e-06 2024-04-26T11:14:41.442 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.442 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.442 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:41.442 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431165+0000", 2024-04-26T11:14:41.442 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001292199 2024-04-26T11:14:41.442 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.442 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.442 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:41.442 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431245+0000", 2024-04-26T11:14:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9548999999999993e-05 2024-04-26T11:14:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:150187 5.c 5:394a3e32:::benchmark_data_smithi029_44842_object5549:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T11:14:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:41.430538+0000", 2024-04-26T11:14:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0043896669999999999, 2024-04-26T11:14:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0044572559999999997, 2024-04-26T11:14:41.443 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 150187 2024-04-26T11:14:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.430538+0000", 2024-04-26T11:14:41.445 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.445 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.445 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:41.445 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.430538+0000", 2024-04-26T11:14:41.445 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.445 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.445 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:41.445 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.430537+0000", 2024-04-26T11:14:41.445 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:41.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.446 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.446 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:41.446 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.430542+0000", 2024-04-26T11:14:41.446 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6619999999999996e-06 2024-04-26T11:14:41.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.446 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.446 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:41.446 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.430552+0000", 2024-04-26T11:14:41.446 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0966e-05 2024-04-26T11:14:41.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.447 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.447 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.447 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.430559+0000", 2024-04-26T11:14:41.447 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9260000000000003e-06 2024-04-26T11:14:41.447 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.447 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.447 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:41.447 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431395+0000", 2024-04-26T11:14:41.447 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00083573800000000004 2024-04-26T11:14:41.447 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.447 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.447 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:41.448 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431517+0000", 2024-04-26T11:14:41.448 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000121391 2024-04-26T11:14:41.448 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.448 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:41.448 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.448 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.448 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.448 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:150185 5.b e43/16 5:d08168bb:::benchmark_data_smithi029_44842_object5547:head v 43'9521, mlcod=43'9518)", 2024-04-26T11:14:41.448 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:41.431138+0000", 2024-04-26T11:14:41.448 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0037895350000000001, 2024-04-26T11:14:41.448 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0038965559999999998, 2024-04-26T11:14:41.449 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:41.449 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:41.449 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:41.449 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.449 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:41.449 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431138+0000", 2024-04-26T11:14:41.449 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.449 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.449 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:41.449 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431138+0000", 2024-04-26T11:14:41.449 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.450 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.450 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:41.450 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431137+0000", 2024-04-26T11:14:41.450 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.450 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.450 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:41.450 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431143+0000", 2024-04-26T11:14:41.450 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3300000000000004e-06 2024-04-26T11:14:41.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.450 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.450 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:41.450 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431158+0000", 2024-04-26T11:14:41.451 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4127999999999999e-05 2024-04-26T11:14:41.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.451 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.451 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.451 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431164+0000", 2024-04-26T11:14:41.451 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7320000000000001e-06 2024-04-26T11:14:41.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.451 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.451 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:41.451 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431197+0000", 2024-04-26T11:14:41.451 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.29e-05 2024-04-26T11:14:41.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.451 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.451 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:41.452 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431224+0000", 2024-04-26T11:14:41.452 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6471000000000001e-05 2024-04-26T11:14:41.452 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.452 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:41.452 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.452 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.452 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:150186 5.4 e43/16 5:29ab6072:::benchmark_data_smithi029_44842_object5548:head v 43'9290, mlcod=43'9286)", 2024-04-26T11:14:41.452 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:41.431174+0000", 2024-04-26T11:14:41.452 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0037534759999999999, 2024-04-26T11:14:41.452 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0038969149999999999, 2024-04-26T11:14:41.452 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:41.452 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:41.452 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:41.452 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.453 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:41.453 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431174+0000", 2024-04-26T11:14:41.453 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.453 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.453 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.453 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:41.453 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431174+0000", 2024-04-26T11:14:41.453 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.453 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.453 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.453 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:41.453 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431173+0000", 2024-04-26T11:14:41.453 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.454 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.454 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:41.454 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431178+0000", 2024-04-26T11:14:41.454 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0559999999999998e-06 2024-04-26T11:14:41.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.454 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.454 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:41.454 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431185+0000", 2024-04-26T11:14:41.454 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1949999999999997e-06 2024-04-26T11:14:41.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.454 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.455 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.455 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431189+0000", 2024-04-26T11:14:41.455 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.651e-06 2024-04-26T11:14:41.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.455 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.455 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:41.455 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431372+0000", 2024-04-26T11:14:41.455 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00018310200000000001 2024-04-26T11:14:41.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.455 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.455 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:41.455 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431383+0000", 2024-04-26T11:14:41.455 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0764999999999999e-05 2024-04-26T11:14:41.455 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.456 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:41.456 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.456 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.456 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.456 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:150190 5.2 5:4a4e1710:::benchmark_data_smithi029_44842_object5552:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T11:14:41.456 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:41.431706+0000", 2024-04-26T11:14:41.456 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0032211380000000001, 2024-04-26T11:14:41.456 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0033999949999999998, 2024-04-26T11:14:41.456 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:41.456 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:41.456 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:41.456 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:41.456 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.456 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 150190 2024-04-26T11:14:41.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.457 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:41.457 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.457 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:41.457 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431706+0000", 2024-04-26T11:14:41.457 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.457 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.457 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:41.457 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431706+0000", 2024-04-26T11:14:41.457 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.457 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.457 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:41.457 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431705+0000", 2024-04-26T11:14:41.458 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:41.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.458 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.458 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:41.458 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431710+0000", 2024-04-26T11:14:41.458 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5410000000000002e-06 2024-04-26T11:14:41.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.458 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.458 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:41.458 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431721+0000", 2024-04-26T11:14:41.458 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1029999999999999e-05 2024-04-26T11:14:41.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.458 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.459 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.459 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431728+0000", 2024-04-26T11:14:41.459 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:14:41.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.459 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.459 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:41.459 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431768+0000", 2024-04-26T11:14:41.459 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0655999999999998e-05 2024-04-26T11:14:41.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.459 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.459 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:41.459 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431886+0000", 2024-04-26T11:14:41.460 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000117823 2024-04-26T11:14:41.460 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.460 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:41.460 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.460 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.460 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:150191 5.7 5:ea306892:::benchmark_data_smithi029_44842_object5553:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T11:14:41.460 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:41.431812+0000", 2024-04-26T11:14:41.460 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.003115488, 2024-04-26T11:14:41.460 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0033325160000000002, 2024-04-26T11:14:41.460 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:41.460 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:41.460 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:41.460 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:41.460 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.461 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 150191 2024-04-26T11:14:41.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.461 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:41.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.461 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:41.461 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431812+0000", 2024-04-26T11:14:41.461 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.461 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:41.461 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431812+0000", 2024-04-26T11:14:41.461 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.461 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:41.462 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431811+0000", 2024-04-26T11:14:41.462 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.462 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.462 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:41.462 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431815+0000", 2024-04-26T11:14:41.462 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4309999999999998e-06 2024-04-26T11:14:41.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.462 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.462 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:41.463 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431823+0000", 2024-04-26T11:14:41.463 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6810000000000004e-06 2024-04-26T11:14:41.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.463 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.463 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.463 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431829+0000", 2024-04-26T11:14:41.463 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6579999999999999e-06 2024-04-26T11:14:41.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.463 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.463 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:41.464 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.432579+0000", 2024-04-26T11:14:41.464 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00075010400000000003 2024-04-26T11:14:41.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.464 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.464 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:41.464 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.432691+0000", 2024-04-26T11:14:41.464 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000111708 2024-04-26T11:14:41.464 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.464 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:41.464 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.464 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.464 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:150188 5.a e43/31 5:5b0e8690:::benchmark_data_smithi029_44842_object5550:head v 43'9481, mlcod=43'9479)", 2024-04-26T11:14:41.465 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:41.431914+0000", 2024-04-26T11:14:41.465 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0030131730000000001, 2024-04-26T11:14:41.465 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003266854, 2024-04-26T11:14:41.465 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:41.465 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:41.465 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:41.465 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.465 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:41.465 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431914+0000", 2024-04-26T11:14:41.465 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.466 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.466 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:41.466 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431914+0000", 2024-04-26T11:14:41.466 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.466 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.466 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:41.466 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431914+0000", 2024-04-26T11:14:41.466 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.466 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.467 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:41.467 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431918+0000", 2024-04-26T11:14:41.467 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7029999999999997e-06 2024-04-26T11:14:41.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.467 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:41.467 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431925+0000", 2024-04-26T11:14:41.467 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0419999999999997e-06 2024-04-26T11:14:41.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.468 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.468 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.431930+0000", 2024-04-26T11:14:41.468 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8269999999999997e-06 2024-04-26T11:14:41.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.468 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.468 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:41.468 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.433157+0000", 2024-04-26T11:14:41.468 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0012271490000000001 2024-04-26T11:14:41.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.468 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.468 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:41.468 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.433173+0000", 2024-04-26T11:14:41.469 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5668999999999999e-05 2024-04-26T11:14:41.469 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.469 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:41.469 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.469 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:150193 5.5 5:abd43892:::benchmark_data_smithi029_44842_object5555:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T11:14:41.469 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:41.432500+0000", 2024-04-26T11:14:41.469 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0024273459999999999, 2024-04-26T11:14:41.469 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0027172239999999999, 2024-04-26T11:14:41.469 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:41.470 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:41.470 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:41.470 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:41.470 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.470 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 150193 2024-04-26T11:14:41.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.470 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:41.470 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.470 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:41.470 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.432500+0000", 2024-04-26T11:14:41.471 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.471 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.471 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:41.471 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.432500+0000", 2024-04-26T11:14:41.471 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.471 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.471 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:41.471 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.432499+0000", 2024-04-26T11:14:41.471 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.472 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.472 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:41.472 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.432503+0000", 2024-04-26T11:14:41.472 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9790000000000004e-06 2024-04-26T11:14:41.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.472 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.472 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:41.472 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.432512+0000", 2024-04-26T11:14:41.472 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7020000000000007e-06 2024-04-26T11:14:41.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.473 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.473 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.432518+0000", 2024-04-26T11:14:41.473 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8309999999999997e-06 2024-04-26T11:14:41.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.473 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:41.473 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.434315+0000", 2024-04-26T11:14:41.473 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001796815 2024-04-26T11:14:41.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.473 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:41.474 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.434391+0000", 2024-04-26T11:14:41.474 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6159e-05 2024-04-26T11:14:41.474 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.474 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:41.474 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.474 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:150192 5.b e43/16 5:df65e990:::benchmark_data_smithi029_44842_object5554:head v 43'9522, mlcod=43'9519)", 2024-04-26T11:14:41.474 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:41.432535+0000", 2024-04-26T11:14:41.474 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0023921239999999998, 2024-04-26T11:14:41.474 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0027202089999999999, 2024-04-26T11:14:41.475 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:41.475 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:41.475 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:41.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.475 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:41.475 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.432535+0000", 2024-04-26T11:14:41.475 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.476 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:41.476 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.432535+0000", 2024-04-26T11:14:41.476 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.476 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.476 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:41.476 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.432535+0000", 2024-04-26T11:14:41.476 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.476 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.476 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:41.477 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.432539+0000", 2024-04-26T11:14:41.477 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0289999999999999e-06 2024-04-26T11:14:41.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.477 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.477 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:41.477 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.432553+0000", 2024-04-26T11:14:41.477 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4105e-05 2024-04-26T11:14:41.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.477 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.477 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.477 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.432558+0000", 2024-04-26T11:14:41.478 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6979999999999997e-06 2024-04-26T11:14:41.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.478 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.478 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:41.478 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.433040+0000", 2024-04-26T11:14:41.478 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00048274400000000001 2024-04-26T11:14:41.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.478 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.478 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:41.478 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.433061+0000", 2024-04-26T11:14:41.479 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0409999999999999e-05 2024-04-26T11:14:41.479 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.479 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:41.479 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.479 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.479 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:150194 5.8 e43/16 5:1962d190:::benchmark_data_smithi029_44842_object5556:head v 43'9403, mlcod=43'9401)", 2024-04-26T11:14:41.479 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:41.433017+0000", 2024-04-26T11:14:41.479 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0019099309999999999, 2024-04-26T11:14:41.479 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022726299999999999, 2024-04-26T11:14:41.479 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:41.480 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:41.480 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:41.480 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.480 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:41.480 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.433017+0000", 2024-04-26T11:14:41.480 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.480 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.480 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:41.480 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.433017+0000", 2024-04-26T11:14:41.480 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.481 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.481 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:41.481 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.433017+0000", 2024-04-26T11:14:41.481 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.481 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.481 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:41.481 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.433022+0000", 2024-04-26T11:14:41.481 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6630000000000001e-06 2024-04-26T11:14:41.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.481 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.482 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:41.482 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.433030+0000", 2024-04-26T11:14:41.482 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3610000000000001e-06 2024-04-26T11:14:41.482 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.482 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.482 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.482 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.433035+0000", 2024-04-26T11:14:41.482 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.9840000000000001e-06 2024-04-26T11:14:41.482 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.482 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.482 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:41.482 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.433065+0000", 2024-04-26T11:14:41.483 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0400999999999999e-05 2024-04-26T11:14:41.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.483 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.483 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:41.483 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.433083+0000", 2024-04-26T11:14:41.483 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7918e-05 2024-04-26T11:14:41.483 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.483 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:41.483 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.483 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.483 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:150195 5.0 e43/16 5:0c212e76:::benchmark_data_smithi029_44842_object5557:head v 43'9550, mlcod=43'9548)", 2024-04-26T11:14:41.484 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:41.433159+0000", 2024-04-26T11:14:41.484 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.001768038, 2024-04-26T11:14:41.484 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0021630070000000002, 2024-04-26T11:14:41.484 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:41.484 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:41.484 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:41.484 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.484 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:41.484 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.433159+0000", 2024-04-26T11:14:41.484 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.484 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.484 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:41.485 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.433159+0000", 2024-04-26T11:14:41.485 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.485 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.485 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:41.485 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.433159+0000", 2024-04-26T11:14:41.485 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.485 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.485 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:41.485 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.433163+0000", 2024-04-26T11:14:41.485 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6260000000000003e-06 2024-04-26T11:14:41.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.486 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.486 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:41.486 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.433171+0000", 2024-04-26T11:14:41.486 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4619999999999999e-06 2024-04-26T11:14:41.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.486 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.486 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.486 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.433176+0000", 2024-04-26T11:14:41.486 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5929999999999996e-06 2024-04-26T11:14:41.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.486 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.486 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:41.487 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.433485+0000", 2024-04-26T11:14:41.487 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000309022 2024-04-26T11:14:41.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.487 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.487 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:41.487 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.433508+0000", 2024-04-26T11:14:41.487 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2039999999999999e-05 2024-04-26T11:14:41.487 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.487 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:41.487 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.487 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.488 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:150180 5.5 5:a2255c3a:::benchmark_data_smithi029_44842_object5542:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T11:14:41.488 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:41.429466+0000", 2024-04-26T11:14:41.488 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.005461296, 2024-04-26T11:14:41.488 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0059064579999999998, 2024-04-26T11:14:41.488 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:41.488 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:41.488 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:41.488 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:41.488 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.488 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 150180 2024-04-26T11:14:41.488 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.488 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:41.488 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.489 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:41.489 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.429466+0000", 2024-04-26T11:14:41.489 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.489 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.489 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:41.489 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.429466+0000", 2024-04-26T11:14:41.489 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.489 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.489 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:41.489 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.429465+0000", 2024-04-26T11:14:41.489 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:41.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.490 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.490 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:41.490 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.429470+0000", 2024-04-26T11:14:41.490 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.31e-06 2024-04-26T11:14:41.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.490 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.490 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:41.490 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.429481+0000", 2024-04-26T11:14:41.490 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.065e-05 2024-04-26T11:14:41.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.490 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.490 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.490 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.429489+0000", 2024-04-26T11:14:41.491 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8140000000000001e-06 2024-04-26T11:14:41.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.491 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.491 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:41.491 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.429531+0000", 2024-04-26T11:14:41.491 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1785000000000001e-05 2024-04-26T11:14:41.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.491 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.491 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:41.491 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.429644+0000", 2024-04-26T11:14:41.491 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000113047 2024-04-26T11:14:41.491 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.491 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:41.491 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.492 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.492 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:150182 5.c 5:319d3c3a:::benchmark_data_smithi029_44842_object5544:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T11:14:41.492 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:41.429831+0000", 2024-04-26T11:14:41.492 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0050965359999999996, 2024-04-26T11:14:41.492 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0056055280000000002, 2024-04-26T11:14:41.492 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:41.492 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:41.492 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:41.492 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:41.492 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.492 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 150182 2024-04-26T11:14:41.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.493 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:41.493 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.493 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:41.493 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.429831+0000", 2024-04-26T11:14:41.493 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.493 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.493 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:41.493 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.429831+0000", 2024-04-26T11:14:41.493 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.493 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.494 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:41.494 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.429830+0000", 2024-04-26T11:14:41.494 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.494 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.494 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:41.494 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.429834+0000", 2024-04-26T11:14:41.494 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1459999999999998e-06 2024-04-26T11:14:41.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.494 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.494 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:41.495 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.429842+0000", 2024-04-26T11:14:41.495 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6969999999999993e-06 2024-04-26T11:14:41.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.495 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.495 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.495 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.429847+0000", 2024-04-26T11:14:41.495 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6539999999999998e-06 2024-04-26T11:14:41.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.495 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.495 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:41.495 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.429883+0000", 2024-04-26T11:14:41.496 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6677999999999997e-05 2024-04-26T11:14:41.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.496 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.496 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:41.496 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.429962+0000", 2024-04-26T11:14:41.496 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8738000000000004e-05 2024-04-26T11:14:41.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.496 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.496 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:41.496 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.435353+0000", 2024-04-26T11:14:41.496 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053911660000000002 2024-04-26T11:14:41.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.496 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.497 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:41.497 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:41.435403+0000", 2024-04-26T11:14:41.497 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0247000000000002e-05 2024-04-26T11:14:41.497 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.497 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:41.497 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.497 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.497 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:14:41.497 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 13 2024-04-26T11:14:41.497 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:41.499 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:41.500 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:41.496+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:41.600 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:41.598+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:41.668 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:14:41.701 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:41.699+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:41.719 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:41.719 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:14:41.720 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:14:41.720 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:14:41.720 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:41.735 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:41.802 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:41.801+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:41.906 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:41.902+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:41.962 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:41.962 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:14:41.962 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:14:41.962 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:41.962 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.963 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:41.963 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:41.963 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 48.687439886, 2024-04-26T11:14:41.963 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:14:41.963 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:41.963 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:41.963 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:41.963 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:41.963 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.963 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:14:41.963 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.963 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:41.963 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.963 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:41.964 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:41.964 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.964 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.964 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.964 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:41.964 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:41.964 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.964 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.964 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.964 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:41.964 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:14:41.964 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.964 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.964 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.964 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:41.965 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:14:41.965 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:14:41.965 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.965 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.965 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:41.965 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:14:41.965 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:14:41.965 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.965 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.965 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.965 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:14:41.965 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:14:41.965 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.965 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.965 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:41.965 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:14:41.966 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:14:41.966 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.966 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.966 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:41.966 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:14:41.966 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:14:41.966 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.966 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.966 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:41.966 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:14:41.966 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:14:41.966 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.966 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.966 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:41.967 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:14:41.967 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:14:41.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.967 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.967 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:41.967 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:14:41.967 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:14:41.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.967 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.967 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:41.967 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:14:41.967 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:14:41.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.967 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.967 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:41.968 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:14:41.968 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:14:41.968 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.968 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:41.968 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.968 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.968 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.968 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:41.968 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:41.968 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 48.686628321000001, 2024-04-26T11:14:41.968 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:14:41.968 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:41.968 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:41.968 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:41.969 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:41.969 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.969 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:14:41.969 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.969 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:41.969 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.969 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:41.969 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:41.969 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.969 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.969 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.969 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:41.969 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:41.969 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.969 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.969 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.970 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:41.970 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:41.970 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:41.970 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.970 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.970 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:41.970 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:14:41.970 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:14:41.970 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.970 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.970 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:41.970 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:14:41.970 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:14:41.970 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.971 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.971 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.971 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:14:41.971 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:14:41.971 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.971 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.971 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:41.971 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:14:41.971 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:14:41.971 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.971 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.971 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:41.971 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:14:41.971 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:14:41.971 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.972 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.972 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:41.972 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:14:41.972 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:14:41.972 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.972 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.972 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:41.972 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:14:41.972 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:14:41.972 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.972 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.972 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:41.972 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:14:41.972 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:14:41.972 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.972 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.973 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:41.973 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:14:41.973 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:14:41.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.973 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.973 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:41.973 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:14:41.973 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:14:41.973 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.973 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:41.973 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.973 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.973 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:41.974 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:41.974 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 48.679441484000002, 2024-04-26T11:14:41.974 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:14:41.974 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:41.974 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:41.974 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:41.974 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:41.974 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.974 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:14:41.974 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.974 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:41.974 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.974 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:41.974 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:41.975 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.975 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.975 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:41.975 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:41.975 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.975 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.975 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:41.975 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:14:41.975 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:41.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.975 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.975 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:41.975 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:14:41.976 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:14:41.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.976 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.976 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:41.976 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:14:41.976 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:14:41.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.976 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.976 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.976 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:14:41.976 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:14:41.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.976 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.976 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:41.976 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:14:41.977 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:14:41.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.977 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.977 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:41.977 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:14:41.977 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:14:41.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.977 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.977 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:41.977 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:14:41.977 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:14:41.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.977 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.977 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:41.977 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:14:41.978 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:14:41.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.978 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.978 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:41.978 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:14:41.978 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:14:41.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.978 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.978 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:41.978 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:14:41.978 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:14:41.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.978 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.978 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:41.978 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:14:41.979 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:14:41.979 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.979 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:41.979 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.979 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.979 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:41.979 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:41.979 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 48.678900605000003, 2024-04-26T11:14:41.979 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:14:41.979 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:41.979 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:41.979 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:41.979 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:41.979 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.980 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:14:41.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.980 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:41.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.980 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:41.980 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:41.980 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.980 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:41.980 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:41.980 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.980 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:41.981 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:41.981 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:41.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.981 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.981 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:41.981 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:14:41.981 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:14:41.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.981 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.981 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:41.981 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:14:41.981 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:14:41.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.981 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.982 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.982 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:14:41.982 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:14:41.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.982 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.982 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:41.982 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:14:41.982 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:14:41.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.982 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.982 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:41.982 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:14:41.982 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:14:41.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.983 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:41.983 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:14:41.983 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:14:41.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.983 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:41.983 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:14:41.983 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:14:41.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.983 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:41.983 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:14:41.984 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:14:41.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.984 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:41.984 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:14:41.984 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:14:41.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.984 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:41.984 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:14:41.984 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:14:41.984 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.984 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:41.984 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.985 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.985 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:41.985 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:41.985 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 44.635716158000001, 2024-04-26T11:14:41.985 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:14:41.985 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:41.985 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:41.985 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:41.985 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:41.985 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.985 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:14:41.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.985 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:41.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.986 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:41.986 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:41.986 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.986 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:41.986 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:41.986 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.986 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:41.987 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:14:41.987 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:41.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.987 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:41.987 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:14:41.987 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:14:41.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.987 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:41.987 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:14:41.987 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:14:41.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.987 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.988 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:14:41.988 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:14:41.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.988 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.988 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:41.988 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:14:41.988 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:14:41.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.988 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.988 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:41.988 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:14:41.988 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:14:41.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.989 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.989 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:41.989 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:14:41.989 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:14:41.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.989 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.989 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:41.989 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:14:41.989 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:14:41.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.989 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.989 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:41.989 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:14:41.989 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:14:41.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.990 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.990 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:41.990 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:14:41.990 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:14:41.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.990 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.990 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:41.990 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:14:41.990 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:14:41.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.990 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.990 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:41.990 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:14:41.990 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:14:41.990 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.991 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:41.991 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.991 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:41.991 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:41.991 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 44.633522818000003, 2024-04-26T11:14:41.991 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:14:41.991 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:41.991 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:41.991 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:41.991 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:41.991 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.991 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:14:41.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.992 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:41.992 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.992 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:41.992 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:41.992 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.992 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.992 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:41.992 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:41.992 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.992 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.992 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:41.992 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:14:41.992 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:41.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.993 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.993 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:41.993 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:14:41.993 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:14:41.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.993 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.993 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:41.993 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:14:41.993 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:14:41.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.993 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.993 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:41.993 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:14:41.994 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:14:41.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.994 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.994 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:41.994 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:14:41.994 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:14:41.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.994 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.994 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:41.994 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:14:41.994 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:14:41.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.994 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.994 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:41.994 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:14:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:14:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:14:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:14:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:14:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:14:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:14:41.996 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:14:41.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.996 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.996 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:41.996 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:14:41.996 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:14:41.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.996 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.996 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:41.996 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:14:41.996 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:14:41.996 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.996 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:41.996 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:41.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.997 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:41.997 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:41.997 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 44.628310994000003, 2024-04-26T11:14:41.997 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:14:41.997 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:41.997 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:41.997 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:41.997 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:41.997 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:41.997 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:14:41.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.998 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:41.998 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.998 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:41.998 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:41.998 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.998 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.998 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:41.998 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:41.998 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:41.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.998 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.998 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:41.999 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:14:41.999 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:41.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.999 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.999 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:41.999 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:14:41.999 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:14:41.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.999 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.999 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:41.999 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:14:41.999 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:14:41.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:41.999 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:41.999 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:42.000 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:14:42.000 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:14:42.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.000 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:42.000 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:14:42.000 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:14:42.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.000 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:42.000 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:14:42.000 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:14:42.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.001 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:42.001 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:14:42.001 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:14:42.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.001 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.001 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:42.001 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:14:42.001 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:14:42.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.001 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.001 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:42.001 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:14:42.001 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:14:42.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.002 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.002 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:42.002 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:14:42.002 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:14:42.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.002 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.002 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:42.002 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:14:42.002 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:14:42.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.002 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.002 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:42.002 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:14:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:14:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 44.611862293999998, 2024-04-26T11:14:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:14:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:42.003 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:14:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.004 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.005 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:42.005 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:14:42.005 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:42.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.005 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:42.005 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:14:42.005 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:14:42.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.005 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:42.005 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:14:42.005 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:14:42.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.006 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:42.006 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:14:42.006 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:14:42.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.006 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.006 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:42.006 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:14:42.006 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:14:42.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.006 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.006 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:42.006 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:14:42.006 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:14:42.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.007 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:42.007 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:14:42.007 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:14:42.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.007 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:42.007 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:14:42.007 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:14:42.007 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.007 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:42.007 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.007 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:42.008 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:42.008 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 44.610164789000002, 2024-04-26T11:14:42.008 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:14:42.008 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:42.008 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:42.008 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:42.008 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:42.008 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:42.008 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:14:42.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.008 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:42.008 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.009 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:42.009 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:42.009 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.009 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:42.009 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:42.009 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.009 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:42.009 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:14:42.009 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:42.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.009 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:42.010 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:14:42.010 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:14:42.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.010 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.010 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:42.010 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:14:42.010 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:14:42.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.010 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.010 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:42.010 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:14:42.010 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:14:42.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.010 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.011 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:42.011 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:14:42.011 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:14:42.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.011 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:42.011 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:14:42.011 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:14:42.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.011 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:42.011 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:14:42.011 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:14:42.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.012 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:42.012 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:14:42.012 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:14:42.012 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.012 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:42.012 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.012 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.012 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:42.012 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:42.012 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 44.610100486999997, 2024-04-26T11:14:42.012 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:14:42.012 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:42.012 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:42.012 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:42.013 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:42.013 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:42.013 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:14:42.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.013 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:42.013 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.013 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:42.013 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:42.013 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.013 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.013 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:42.013 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:42.013 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.014 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:42.014 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:42.014 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:42.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.014 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:42.014 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:14:42.014 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:14:42.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.014 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:42.014 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:14:42.014 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:14:42.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.015 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:42.015 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:14:42.015 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:14:42.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.015 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:42.015 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:14:42.015 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:14:42.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.015 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:42.015 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:14:42.015 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:14:42.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.016 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.016 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:42.016 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:14:42.016 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:14:42.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.016 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.016 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:42.016 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:14:42.016 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:14:42.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.016 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.016 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:42.016 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:14:42.016 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:14:42.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.017 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:42.017 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:14:42.017 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:14:42.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.017 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:42.017 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:14:42.017 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:14:42.017 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.017 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:42.017 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.017 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:42.018 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:42.018 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 44.610046263000001, 2024-04-26T11:14:42.018 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:14:42.018 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:42.018 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:42.018 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:42.018 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:42.018 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:42.018 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:14:42.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.018 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:42.018 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.019 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:42.019 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:42.019 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.019 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.019 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:42.019 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:42.019 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.019 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.019 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:42.019 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:42.019 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:42.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.020 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:42.020 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:14:42.020 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:14:42.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.020 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:42.020 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:14:42.020 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:14:42.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.020 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:42.021 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:14:42.021 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:14:42.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.021 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.021 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:42.021 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:14:42.021 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:14:42.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.021 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.021 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:42.021 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:14:42.022 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:14:42.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.022 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:42.022 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:14:42.022 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:14:42.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.022 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:42.022 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:14:42.022 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:14:42.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.022 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:42.022 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:14:42.023 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:14:42.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.023 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.023 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:42.023 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:14:42.023 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:42.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.023 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.023 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:42.023 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:14:42.023 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:14:42.023 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.023 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:42.023 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.024 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.024 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:42.024 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:42.024 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 44.610001750999999, 2024-04-26T11:14:42.024 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:14:42.024 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:42.024 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:42.024 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:42.024 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:42.024 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:42.024 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:14:42.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.024 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:42.024 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.025 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:42.025 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:42.025 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.025 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:42.025 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:42.025 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.025 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:42.025 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:14:42.025 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:42.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.026 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.026 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:42.026 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:14:42.026 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:14:42.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.026 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.026 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:42.026 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:14:42.026 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:14:42.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.026 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.026 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:42.026 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:14:42.026 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:14:42.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.027 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.027 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:42.027 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:14:42.027 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:14:42.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.027 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.027 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:42.027 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:14:42.027 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:14:42.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.027 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.027 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:42.027 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:14:42.027 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:14:42.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.028 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.028 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:42.028 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:14:42.028 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:14:42.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.028 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.028 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:42.028 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:14:42.028 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:14:42.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.028 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.028 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:42.028 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:14:42.029 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:14:42.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.029 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:42.029 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:14:42.029 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:14:42.029 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.029 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:42.029 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.029 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:42.030 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:42.030 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 44.605780748999997, 2024-04-26T11:14:42.030 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:14:42.030 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:42.030 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:42.030 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:42.030 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:42.030 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:42.030 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:14:42.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.030 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:42.030 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.030 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:42.031 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:42.031 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.031 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.031 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:42.031 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:42.031 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.031 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.031 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:42.031 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:14:42.031 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:14:42.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.031 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.031 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:42.032 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:14:42.032 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:14:42.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.032 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.032 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:42.032 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:14:42.032 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:14:42.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.032 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.032 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:42.032 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:14:42.032 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:14:42.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.032 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.032 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:42.033 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:14:42.033 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:14:42.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.033 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.033 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:42.033 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:14:42.033 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:14:42.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.033 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.033 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:42.033 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:14:42.033 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:14:42.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.033 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.033 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:42.034 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:14:42.034 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:14:42.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.034 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.034 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:42.034 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:14:42.034 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:14:42.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.034 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.034 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:42.034 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:14:42.034 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:14:42.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.034 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.034 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:42.035 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:14:42.035 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:14:42.035 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.035 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:42.035 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.035 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.035 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.035 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83360 5.2 5:42f8bfcd:::benchmark_data_smithi029_44842_object83359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:42.035 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:42.035 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 30.918541379000001, 2024-04-26T11:14:42.035 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022279782000000001, 2024-04-26T11:14:42.035 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:42.035 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:42.035 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:42.035 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:42.036 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:42.036 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83360 2024-04-26T11:14:42.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.036 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:42.036 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.036 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:42.036 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:42.036 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.036 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.036 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:42.036 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:42.036 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.036 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.037 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:42.037 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:42.037 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:42.037 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.037 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.037 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:42.037 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039700+0000", 2024-04-26T11:14:42.037 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5541000000000002e-05 2024-04-26T11:14:42.037 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.037 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.037 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:42.037 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039706+0000", 2024-04-26T11:14:42.037 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3680000000000001e-06 2024-04-26T11:14:42.037 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.037 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.037 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:42.038 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039709+0000", 2024-04-26T11:14:42.038 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4659999999999999e-06 2024-04-26T11:14:42.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.038 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.038 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:42.038 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056305+0000", 2024-04-26T11:14:42.038 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016595649000000001 2024-04-26T11:14:42.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.038 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.038 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:42.038 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056487+0000", 2024-04-26T11:14:42.038 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000181886 2024-04-26T11:14:42.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.038 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.038 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:42.039 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061809+0000", 2024-04-26T11:14:42.039 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053223259999999996 2024-04-26T11:14:42.039 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.039 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.039 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:42.039 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061852+0000", 2024-04-26T11:14:42.039 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2738999999999999e-05 2024-04-26T11:14:42.039 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.039 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.039 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:42.039 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061925+0000", 2024-04-26T11:14:42.039 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3180000000000001e-05 2024-04-26T11:14:42.039 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.039 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:42.039 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.040 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.040 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83364 5.2 5:42c5cd8c:::benchmark_data_smithi029_44842_object83363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:42.040 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:42.040 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 30.918125638999999, 2024-04-26T11:14:42.040 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022695336, 2024-04-26T11:14:42.040 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:42.040 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:42.040 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:42.040 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:42.040 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:42.040 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83364 2024-04-26T11:14:42.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.040 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:42.040 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.041 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:42.041 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:42.041 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.041 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.041 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.041 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:42.041 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:42.041 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.041 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.041 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.041 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:42.041 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040060+0000", 2024-04-26T11:14:42.042 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:42.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.042 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.042 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:42.042 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040086+0000", 2024-04-26T11:14:42.042 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5482000000000001e-05 2024-04-26T11:14:42.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.042 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.042 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:42.042 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040093+0000", 2024-04-26T11:14:42.042 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6409999999999996e-06 2024-04-26T11:14:42.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.042 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.042 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:42.043 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040098+0000", 2024-04-26T11:14:42.043 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879999999999996e-06 2024-04-26T11:14:42.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.043 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.043 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:42.043 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058292+0000", 2024-04-26T11:14:42.043 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018193504999999999 2024-04-26T11:14:42.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.043 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.043 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:42.043 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058412+0000", 2024-04-26T11:14:42.043 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011979199999999999 2024-04-26T11:14:42.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.043 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.044 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:42.044 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062642+0000", 2024-04-26T11:14:42.044 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042299449999999997 2024-04-26T11:14:42.044 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.044 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.044 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:42.044 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062688+0000", 2024-04-26T11:14:42.044 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6859e-05 2024-04-26T11:14:42.044 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.044 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.044 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:42.044 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062756+0000", 2024-04-26T11:14:42.044 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7995000000000002e-05 2024-04-26T11:14:42.044 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.045 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:42.045 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.045 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.045 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.045 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:129903 5.0 e40/16 5:00b2d390:::benchmark_data_smithi029_44842_object129902:head v 40'8238, mlcod=40'8234)", 2024-04-26T11:14:42.045 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:42.045 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 10.064376255999999, 2024-04-26T11:14:42.045 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.02228639, 2024-04-26T11:14:42.045 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:42.045 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:42.045 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:42.045 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.045 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:42.045 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:42.045 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.046 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.046 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:42.046 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:42.046 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.046 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.046 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:42.046 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:42.046 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:42.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.046 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.046 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:42.046 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893874+0000", 2024-04-26T11:14:42.046 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3849000000000005e-05 2024-04-26T11:14:42.047 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.047 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.047 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:42.047 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893884+0000", 2024-04-26T11:14:42.047 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0149000000000001e-05 2024-04-26T11:14:42.047 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.047 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.047 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:42.047 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893892+0000", 2024-04-26T11:14:42.047 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0299999999999994e-06 2024-04-26T11:14:42.047 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.047 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.047 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:42.047 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.894003+0000", 2024-04-26T11:14:42.047 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011128099999999999 2024-04-26T11:14:42.048 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.048 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.048 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:42.048 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.894024+0000", 2024-04-26T11:14:42.048 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0979e-05 2024-04-26T11:14:42.048 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.048 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.048 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:42.048 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.916077+0000", 2024-04-26T11:14:42.048 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022053461 2024-04-26T11:14:42.048 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.048 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.048 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:42.048 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.916097+0000", 2024-04-26T11:14:42.048 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9389999999999999e-05 2024-04-26T11:14:42.049 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.049 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:42.049 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.049 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.049 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.049 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:130959 5.7 5:ee32f7f7:::benchmark_data_smithi029_44842_object130958:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:42.049 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:32.375500+0000", 2024-04-26T11:14:42.049 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 9.5826869840000004, 2024-04-26T11:14:42.049 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022235456000000001, 2024-04-26T11:14:42.049 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:42.049 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:42.049 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:42.049 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:42.049 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:42.050 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 130959 2024-04-26T11:14:42.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.050 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:42.050 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.050 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:42.050 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375500+0000", 2024-04-26T11:14:42.050 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.050 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.050 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:42.050 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375500+0000", 2024-04-26T11:14:42.050 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.050 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.050 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:42.051 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375499+0000", 2024-04-26T11:14:42.051 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:42.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.051 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.051 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:42.051 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375530+0000", 2024-04-26T11:14:42.051 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0556999999999999e-05 2024-04-26T11:14:42.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.051 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.051 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:42.051 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375537+0000", 2024-04-26T11:14:42.051 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7849999999999992e-06 2024-04-26T11:14:42.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.051 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.052 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:42.052 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375543+0000", 2024-04-26T11:14:42.052 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6060000000000002e-06 2024-04-26T11:14:42.052 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.052 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.052 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:42.052 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.377410+0000", 2024-04-26T11:14:42.052 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0018671149999999999 2024-04-26T11:14:42.052 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.052 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.052 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:42.052 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.377544+0000", 2024-04-26T11:14:42.052 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013380999999999999 2024-04-26T11:14:42.052 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.052 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.053 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:42.053 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397624+0000", 2024-04-26T11:14:42.053 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020079889 2024-04-26T11:14:42.053 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.053 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.053 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:42.053 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397662+0000", 2024-04-26T11:14:42.053 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8269999999999998e-05 2024-04-26T11:14:42.053 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.053 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.053 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:42.053 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397735+0000", 2024-04-26T11:14:42.053 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3017999999999998e-05 2024-04-26T11:14:42.053 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.053 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:42.054 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.054 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.054 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.054 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:130960 5.0 e40/16 5:042df53c:::benchmark_data_smithi029_44842_object130959:head v 40'8310, mlcod=40'8308)", 2024-04-26T11:14:42.054 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:32.375983+0000", 2024-04-26T11:14:42.054 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 9.5822040739999998, 2024-04-26T11:14:42.054 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.021699000999999999, 2024-04-26T11:14:42.054 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:42.054 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:42.054 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:42.054 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.054 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:42.054 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375983+0000", 2024-04-26T11:14:42.054 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.055 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.055 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:42.055 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375983+0000", 2024-04-26T11:14:42.055 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.055 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.055 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:42.055 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375982+0000", 2024-04-26T11:14:42.055 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:42.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.055 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.055 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:42.055 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376039+0000", 2024-04-26T11:14:42.056 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7240000000000001e-05 2024-04-26T11:14:42.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.056 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.056 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:42.056 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376047+0000", 2024-04-26T11:14:42.056 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6699999999999994e-06 2024-04-26T11:14:42.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.056 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.056 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:42.056 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376053+0000", 2024-04-26T11:14:42.056 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:14:42.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.056 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.056 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:42.056 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376504+0000", 2024-04-26T11:14:42.056 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00045143100000000002 2024-04-26T11:14:42.057 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.057 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.057 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:42.057 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376521+0000", 2024-04-26T11:14:42.057 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6820000000000002e-05 2024-04-26T11:14:42.057 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.057 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.057 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:42.057 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397656+0000", 2024-04-26T11:14:42.057 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.021134824 2024-04-26T11:14:42.057 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.057 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.057 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:42.057 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397682+0000", 2024-04-26T11:14:42.058 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.597e-05 2024-04-26T11:14:42.058 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.058 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:42.058 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.058 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.058 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.058 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:130966 5.3 5:ce21bfb4:::benchmark_data_smithi029_44842_object130965:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:42.058 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:32.376761+0000", 2024-04-26T11:14:42.058 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 9.5814260680000007, 2024-04-26T11:14:42.058 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.023879659000000001, 2024-04-26T11:14:42.058 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:42.058 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:42.058 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:42.058 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:42.059 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:42.059 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 130966 2024-04-26T11:14:42.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.059 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:42.059 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.059 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:42.059 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376761+0000", 2024-04-26T11:14:42.059 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.059 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.059 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:42.059 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376761+0000", 2024-04-26T11:14:42.059 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.059 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.060 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:42.060 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376760+0000", 2024-04-26T11:14:42.060 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:42.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.060 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.060 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:42.060 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376807+0000", 2024-04-26T11:14:42.060 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7089000000000003e-05 2024-04-26T11:14:42.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.060 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.060 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:42.060 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376817+0000", 2024-04-26T11:14:42.060 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.7329999999999998e-06 2024-04-26T11:14:42.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.060 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.061 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:42.061 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376824+0000", 2024-04-26T11:14:42.061 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6240000000000002e-06 2024-04-26T11:14:42.061 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.061 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.061 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:42.061 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378825+0000", 2024-04-26T11:14:42.061 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020004799999999998 2024-04-26T11:14:42.061 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.061 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.061 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:42.061 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378963+0000", 2024-04-26T11:14:42.061 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013860399999999999 2024-04-26T11:14:42.061 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.062 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.062 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:42.062 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.400519+0000", 2024-04-26T11:14:42.062 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.021555405 2024-04-26T11:14:42.062 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.062 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.062 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:42.062 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.400568+0000", 2024-04-26T11:14:42.062 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8989999999999997e-05 2024-04-26T11:14:42.062 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.062 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.062 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:42.062 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.400640+0000", 2024-04-26T11:14:42.062 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2556000000000001e-05 2024-04-26T11:14:42.062 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.063 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:42.063 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.063 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.063 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:130965 5.0 e40/16 5:02e1af30:::benchmark_data_smithi029_44842_object130964:head v 40'8311, mlcod=40'8308)", 2024-04-26T11:14:42.063 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:32.378228+0000", 2024-04-26T11:14:42.063 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 9.5799582470000004, 2024-04-26T11:14:42.063 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.023551810999999999, 2024-04-26T11:14:42.063 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:42.063 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:42.063 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:42.063 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.063 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:42.063 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378228+0000", 2024-04-26T11:14:42.063 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.064 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.064 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.064 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:42.064 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378228+0000", 2024-04-26T11:14:42.064 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:42.064 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.064 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.064 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:42.064 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378228+0000", 2024-04-26T11:14:42.064 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:42.064 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.064 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.064 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:42.064 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378275+0000", 2024-04-26T11:14:42.064 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:14:42.065 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.065 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.065 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:42.065 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378284+0000", 2024-04-26T11:14:42.065 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3740000000000004e-06 2024-04-26T11:14:42.065 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.065 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.065 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:42.065 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378291+0000", 2024-04-26T11:14:42.065 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4359999999999999e-06 2024-04-26T11:14:42.065 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.065 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.065 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:42.065 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378322+0000", 2024-04-26T11:14:42.065 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1260000000000002e-05 2024-04-26T11:14:42.066 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.066 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.066 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:42.066 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378336+0000", 2024-04-26T11:14:42.066 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3937999999999999e-05 2024-04-26T11:14:42.066 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.066 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.066 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:42.066 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.401744+0000", 2024-04-26T11:14:42.066 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.023407715999999999 2024-04-26T11:14:42.066 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:42.066 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:42.066 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:42.066 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.401780+0000", 2024-04-26T11:14:42.067 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6433999999999997e-05 2024-04-26T11:14:42.067 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.067 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:42.067 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.067 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:42.067 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:42.067 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:42.069 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:42.069 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:42.066+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:42.069 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:14:42.169 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:42.167+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:42.222 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:42.239 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:42.239 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:42.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.239 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:152366 5.a 5:50cd4e87:::benchmark_data_smithi029_44842_object7728:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T11:14:42.239 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:42.231325+0000", 2024-04-26T11:14:42.239 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0059066199999999996, 2024-04-26T11:14:42.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059311529999999998, 2024-04-26T11:14:42.240 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:42.240 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:42.240 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:42.240 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:42.240 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:42.240 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 152366 2024-04-26T11:14:42.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.241 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:42.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:42.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.231325+0000", 2024-04-26T11:14:42.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:42.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:42.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.231325+0000", 2024-04-26T11:14:42.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:42.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:42.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.231325+0000", 2024-04-26T11:14:42.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:42.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:42.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.231329+0000", 2024-04-26T11:14:42.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4850000000000003e-06 2024-04-26T11:14:42.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:42.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.231341+0000", 2024-04-26T11:14:42.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1545999999999999e-05 2024-04-26T11:14:42.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:42.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.231349+0000", 2024-04-26T11:14:42.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6829999999999997e-06 2024-04-26T11:14:42.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:42.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.231988+0000", 2024-04-26T11:14:42.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00063905799999999997 2024-04-26T11:14:42.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:42.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.232137+0000", 2024-04-26T11:14:42.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000148956 2024-04-26T11:14:42.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:42.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.232264+0000", 2024-04-26T11:14:42.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012705999999999999 2024-04-26T11:14:42.245 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:42.245 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:42.245 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:42.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.245 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:152369 5.0 5:0f27003e:::benchmark_data_smithi029_44842_object7731:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T11:14:42.245 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:42.231801+0000", 2024-04-26T11:14:42.245 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0054306770000000001, 2024-04-26T11:14:42.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055418139999999999, 2024-04-26T11:14:42.245 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:42.245 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:42.245 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:42.245 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:42.246 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:42.246 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 152369 2024-04-26T11:14:42.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.246 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:42.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:42.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.231801+0000", 2024-04-26T11:14:42.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:42.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:42.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.231801+0000", 2024-04-26T11:14:42.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:42.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:42.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.231800+0000", 2024-04-26T11:14:42.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:42.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:42.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.231805+0000", 2024-04-26T11:14:42.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2799999999999997e-06 2024-04-26T11:14:42.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:42.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.231816+0000", 2024-04-26T11:14:42.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.11e-05 2024-04-26T11:14:42.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:42.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.231824+0000", 2024-04-26T11:14:42.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1960000000000008e-06 2024-04-26T11:14:42.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:42.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.231858+0000", 2024-04-26T11:14:42.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.366e-05 2024-04-26T11:14:42.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:42.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.231974+0000", 2024-04-26T11:14:42.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000116475 2024-04-26T11:14:42.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:42.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.232089+0000", 2024-04-26T11:14:42.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000115121 2024-04-26T11:14:42.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:42.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235744+0000", 2024-04-26T11:14:42.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003655008 2024-04-26T11:14:42.250 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:42.250 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:42.250 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:42.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.250 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:152374 5.f 5:fc774f6a:::benchmark_data_smithi029_44842_object7736:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T11:14:42.250 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:42.234786+0000", 2024-04-26T11:14:42.250 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0024456220000000002, 2024-04-26T11:14:42.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026375560000000001, 2024-04-26T11:14:42.251 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:42.251 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:42.251 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:42.251 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:42.251 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:42.251 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 152374 2024-04-26T11:14:42.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.251 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:42.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:42.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.234786+0000", 2024-04-26T11:14:42.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:42.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:42.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.234786+0000", 2024-04-26T11:14:42.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:42.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:42.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.234786+0000", 2024-04-26T11:14:42.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:42.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:42.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.234790+0000", 2024-04-26T11:14:42.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6500000000000004e-06 2024-04-26T11:14:42.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:42.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.234799+0000", 2024-04-26T11:14:42.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7190000000000007e-06 2024-04-26T11:14:42.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:42.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.234805+0000", 2024-04-26T11:14:42.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:14:42.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:42.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.234849+0000", 2024-04-26T11:14:42.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3747e-05 2024-04-26T11:14:42.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:42.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.234976+0000", 2024-04-26T11:14:42.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012773400000000001 2024-04-26T11:14:42.254 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:42.254 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:42.254 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:42.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.255 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:152376 5.f 5:fa76f74a:::benchmark_data_smithi029_44842_object7738:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T11:14:42.255 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:42.234813+0000", 2024-04-26T11:14:42.255 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0024191909999999998, 2024-04-26T11:14:42.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026768809999999999, 2024-04-26T11:14:42.255 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:42.255 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:42.255 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:42.255 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:42.255 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:42.255 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 152376 2024-04-26T11:14:42.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.256 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:42.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:42.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.234813+0000", 2024-04-26T11:14:42.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:42.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:42.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.234813+0000", 2024-04-26T11:14:42.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:42.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:42.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.234813+0000", 2024-04-26T11:14:42.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:42.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:42.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.234814+0000", 2024-04-26T11:14:42.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6700000000000001e-06 2024-04-26T11:14:42.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:42.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.234819+0000", 2024-04-26T11:14:42.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3560000000000003e-06 2024-04-26T11:14:42.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:42.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.234822+0000", 2024-04-26T11:14:42.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4079999999999998e-06 2024-04-26T11:14:42.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:42.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.236779+0000", 2024-04-26T11:14:42.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0019568770000000001 2024-04-26T11:14:42.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:42.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.236856+0000", 2024-04-26T11:14:42.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7260000000000002e-05 2024-04-26T11:14:42.259 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:42.259 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:42.259 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:42.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.260 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:152377 5.b 5:d4038e19:::benchmark_data_smithi029_44842_object7739:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T11:14:42.260 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:42.235500+0000", 2024-04-26T11:14:42.260 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0017320899999999999, 2024-04-26T11:14:42.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002057321, 2024-04-26T11:14:42.260 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:42.260 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:42.260 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:42.260 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:42.260 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:42.261 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 152377 2024-04-26T11:14:42.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.261 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:42.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:42.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235500+0000", 2024-04-26T11:14:42.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:42.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:42.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235500+0000", 2024-04-26T11:14:42.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:42.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:42.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235499+0000", 2024-04-26T11:14:42.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:42.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:42.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235502+0000", 2024-04-26T11:14:42.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2500000000000001e-06 2024-04-26T11:14:42.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:42.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235507+0000", 2024-04-26T11:14:42.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2429999999999996e-06 2024-04-26T11:14:42.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:42.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235510+0000", 2024-04-26T11:14:42.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.461e-06 2024-04-26T11:14:42.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:42.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235534+0000", 2024-04-26T11:14:42.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3431999999999999e-05 2024-04-26T11:14:42.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:42.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235610+0000", 2024-04-26T11:14:42.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6126999999999998e-05 2024-04-26T11:14:42.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:42.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235678+0000", 2024-04-26T11:14:42.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7665999999999999e-05 2024-04-26T11:14:42.264 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:42.264 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:42.264 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:42.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.264 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:152378 5.8 5:109143d7:::benchmark_data_smithi029_44842_object7740:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T11:14:42.264 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:42.235718+0000", 2024-04-26T11:14:42.264 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0015137970000000001, 2024-04-26T11:14:42.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0019142930000000001, 2024-04-26T11:14:42.265 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:42.265 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:42.265 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:42.265 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:42.265 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:42.265 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 152378 2024-04-26T11:14:42.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.265 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:42.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:42.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235718+0000", 2024-04-26T11:14:42.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:42.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:42.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235718+0000", 2024-04-26T11:14:42.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:42.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:42.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235718+0000", 2024-04-26T11:14:42.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:42.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:42.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235721+0000", 2024-04-26T11:14:42.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.078e-06 2024-04-26T11:14:42.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:42.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235728+0000", 2024-04-26T11:14:42.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4699999999999996e-06 2024-04-26T11:14:42.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:42.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235735+0000", 2024-04-26T11:14:42.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5259999999999999e-06 2024-04-26T11:14:42.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:42.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235767+0000", 2024-04-26T11:14:42.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1865000000000001e-05 2024-04-26T11:14:42.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:42.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235874+0000", 2024-04-26T11:14:42.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107596 2024-04-26T11:14:42.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:42.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235958+0000", 2024-04-26T11:14:42.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3422000000000002e-05 2024-04-26T11:14:42.269 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:42.269 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:42.269 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:42.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.269 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:152379 5.9 5:96e2330a:::benchmark_data_smithi029_44842_object7741:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T11:14:42.269 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:42.235743+0000", 2024-04-26T11:14:42.270 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0014887399999999999, 2024-04-26T11:14:42.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0019613920000000002, 2024-04-26T11:14:42.270 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:42.270 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:42.270 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:42.270 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:42.270 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:42.270 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 152379 2024-04-26T11:14:42.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.270 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:42.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:42.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235743+0000", 2024-04-26T11:14:42.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:42.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:42.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235743+0000", 2024-04-26T11:14:42.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:42.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:42.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235743+0000", 2024-04-26T11:14:42.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:42.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:42.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235745+0000", 2024-04-26T11:14:42.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4420000000000001e-06 2024-04-26T11:14:42.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:42.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235751+0000", 2024-04-26T11:14:42.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0120000000000002e-06 2024-04-26T11:14:42.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:42.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235757+0000", 2024-04-26T11:14:42.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7309999999999998e-06 2024-04-26T11:14:42.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:42.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235790+0000", 2024-04-26T11:14:42.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2635999999999997e-05 2024-04-26T11:14:42.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:42.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235898+0000", 2024-04-26T11:14:42.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108581 2024-04-26T11:14:42.273 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:42.273 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:42.273 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:42.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.274 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:152380 5.d 5:b703f6d7:::benchmark_data_smithi029_44842_object7742:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T11:14:42.274 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:42.235765+0000", 2024-04-26T11:14:42.274 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0014666410000000001, 2024-04-26T11:14:42.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020119999999999999, 2024-04-26T11:14:42.274 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:42.274 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:42.274 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:42.274 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:42.274 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:42.274 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 152380 2024-04-26T11:14:42.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.274 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:42.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:42.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235765+0000", 2024-04-26T11:14:42.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:42.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:42.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235765+0000", 2024-04-26T11:14:42.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:42.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:42.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235765+0000", 2024-04-26T11:14:42.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:42.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:42.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235767+0000", 2024-04-26T11:14:42.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1069999999999999e-06 2024-04-26T11:14:42.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:42.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235774+0000", 2024-04-26T11:14:42.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4219999999999997e-06 2024-04-26T11:14:42.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:42.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235779+0000", 2024-04-26T11:14:42.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9409999999999998e-06 2024-04-26T11:14:42.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:42.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.236316+0000", 2024-04-26T11:14:42.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00053720299999999999 2024-04-26T11:14:42.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:42.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.236432+0000", 2024-04-26T11:14:42.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000116277 2024-04-26T11:14:42.278 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:42.278 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:42.278 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:42.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.278 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:152381 5.9 5:93c18637:::benchmark_data_smithi029_44842_object7743:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T11:14:42.278 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:42.235790+0000", 2024-04-26T11:14:42.278 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0014422910000000001, 2024-04-26T11:14:42.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020593669999999999, 2024-04-26T11:14:42.279 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:42.279 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:42.279 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:42.279 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:42.279 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:42.279 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 152381 2024-04-26T11:14:42.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.279 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:42.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:42.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235790+0000", 2024-04-26T11:14:42.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:42.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:42.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235790+0000", 2024-04-26T11:14:42.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:42.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:42.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235789+0000", 2024-04-26T11:14:42.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:42.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:42.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235792+0000", 2024-04-26T11:14:42.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3309999999999998e-06 2024-04-26T11:14:42.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:42.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235799+0000", 2024-04-26T11:14:42.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0700000000000001e-06 2024-04-26T11:14:42.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:42.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235804+0000", 2024-04-26T11:14:42.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7119999999999999e-06 2024-04-26T11:14:42.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:42.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.237737+0000", 2024-04-26T11:14:42.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0019335050000000001 2024-04-26T11:14:42.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:42.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.237812+0000", 2024-04-26T11:14:42.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4487999999999996e-05 2024-04-26T11:14:42.282 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:42.282 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:42.282 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:42.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.283 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:152382 5.b 5:d0e48de6:::benchmark_data_smithi029_44842_object7744:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T11:14:42.283 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:42.235917+0000", 2024-04-26T11:14:42.283 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0013146340000000001, 2024-04-26T11:14:42.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002013604, 2024-04-26T11:14:42.283 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:42.283 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:42.283 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:42.283 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:42.283 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:42.283 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 152382 2024-04-26T11:14:42.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.283 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:42.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:42.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235917+0000", 2024-04-26T11:14:42.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:42.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:42.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235917+0000", 2024-04-26T11:14:42.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:42.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:42.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235917+0000", 2024-04-26T11:14:42.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:42.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:42.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235921+0000", 2024-04-26T11:14:42.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0069999999999999e-06 2024-04-26T11:14:42.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:42.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235928+0000", 2024-04-26T11:14:42.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7430000000000002e-06 2024-04-26T11:14:42.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:42.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.235935+0000", 2024-04-26T11:14:42.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4019999999999999e-06 2024-04-26T11:14:42.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:42.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.237576+0000", 2024-04-26T11:14:42.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0016412670000000001 2024-04-26T11:14:42.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:42.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.237727+0000", 2024-04-26T11:14:42.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000150822 2024-04-26T11:14:42.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:42.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:42.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:42.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:42.237843+0000", 2024-04-26T11:14:42.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011647200000000001 2024-04-26T11:14:42.286 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:42.286 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:42.287 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:42.287 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:42.287 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:14:42.287 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 10 2024-04-26T11:14:42.287 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:42.288 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:42.289 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:42.289 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:42.290 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:42.286+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:42.290 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:42.290 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:42.291 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:42.291 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:42.389 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:42.387+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:42.490 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:42.488+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:42.502 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:42.502 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:42.516 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:42.591 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:42.589+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:42.660 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:14:42.692 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:42.690+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:42.707 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:42.707 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:42.722 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:42.793 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:42.791+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:42.894 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:42.892+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:42.905 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:42.905 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:42.916 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:42.994 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:42.992+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:43.094 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:43.094 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:43.095 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:43.093+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:43.109 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:43.196 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:43.195+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:43.290 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:43.291 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:43.300 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:43.296+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:43.305 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:43.398 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:43.396+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:43.478 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:43.478 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:43.493 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:43.537 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:43.536+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:43.600 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:43.598+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:43.669 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:43.669 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:43.681 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:43.701 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:43.699+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:43.801 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:43.800+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:43.887 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:43.887 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:43.902 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:43.942 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:43.941+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:44.004 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:44.002+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:44.084 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:44.084 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:44.098 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:44.142 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:44.140+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:44.205 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:44.203+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:44.284 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:44.284 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:44.291 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:14:44.295 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:44.305 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:44.303+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:44.408 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:44.405+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:44.445 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:44.465 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:44.465 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:44.465 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:44.465 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:44.467 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:44.468 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:44.507 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:44.505+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:44.528 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:44.528 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:14:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:14:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 51.249773611000002, 2024-04-26T11:14:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:14:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.529 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:14:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.530 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:14:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:14:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:14:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:14:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:14:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.531 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:14:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:14:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:14:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:14:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:14:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:14:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:14:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:14:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:14:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:14:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:14:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:14:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:14:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:14:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:14:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:14:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:44.534 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 51.248962046000003, 2024-04-26T11:14:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:14:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:14:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:14:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:14:44.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:14:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:14:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:14:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:14:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:14:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:14:44.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:14:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:14:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:14:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:14:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:14:44.538 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:14:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:14:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:14:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:14:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:14:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:14:44.539 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:14:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 51.241775208999996, 2024-04-26T11:14:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:14:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.540 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:14:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.541 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:14:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:14:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:14:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:14:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:14:44.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:14:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:14:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:14:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:14:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:14:44.543 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:14:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:14:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:14:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:14:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:14:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.544 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:14:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:14:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:14:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:14:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:14:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:14:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.545 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 51.241234329999997, 2024-04-26T11:14:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:14:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:14:44.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:44.547 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:14:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:14:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:14:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:14:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:14:44.548 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:14:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:14:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:14:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:14:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:14:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:14:44.549 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:14:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:14:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:14:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:14:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:14:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.550 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:14:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:14:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:14:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:14:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:44.551 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 47.198049883000003, 2024-04-26T11:14:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:14:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:14:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:14:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:14:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:14:44.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:14:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:14:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:14:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:14:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:14:44.554 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:14:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:14:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:14:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:14:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:14:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:44.555 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:14:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:14:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:14:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:14:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:14:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:14:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.556 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:14:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:14:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:14:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:14:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.557 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 47.195856542999998, 2024-04-26T11:14:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:14:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:14:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:44.558 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:14:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:44.559 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:14:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:14:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:14:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:14:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:14:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:14:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.560 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:14:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:14:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:14:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:14:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:14:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:14:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:14:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:14:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:14:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:14:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:14:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:14:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:14:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:14:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:14:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:14:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:44.563 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 47.190644718999998, 2024-04-26T11:14:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:14:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:14:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.564 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:14:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:14:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:14:44.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:14:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:14:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:14:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:14:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:14:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:14:44.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:14:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:14:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:14:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:14:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:14:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:14:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.567 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:14:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:14:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:14:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:14:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:14:44.568 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:14:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:14:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:14:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 47.174196019, 2024-04-26T11:14:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:14:44.569 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:14:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.570 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:14:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:14:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:14:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.571 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:14:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:14:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:14:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:14:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:14:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:14:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.572 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:14:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:14:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:14:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:14:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:14:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:14:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:44.573 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 47.172498513999997, 2024-04-26T11:14:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:14:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:14:44.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:14:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:44.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:14:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:14:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:14:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:14:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:14:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:14:44.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:14:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:14:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:14:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:14:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:14:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:14:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:14:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:14:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 47.172434211999999, 2024-04-26T11:14:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:14:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:44.578 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:14:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:14:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:14:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:14:44.580 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:14:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:14:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:14:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:14:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:14:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:44.581 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:14:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:14:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:14:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:14:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:14:44.582 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:14:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:14:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:14:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:14:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:14:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:14:44.583 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:14:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 47.172379988000003, 2024-04-26T11:14:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:14:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:44.584 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:14:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:14:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:14:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:14:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:14:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.586 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:14:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:14:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:14:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:14:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:14:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:14:44.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:14:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:14:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:14:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:14:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:14:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:14:44.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:14:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:14:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:14:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 47.172335476000001, 2024-04-26T11:14:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:14:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:14:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.590 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:14:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.591 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:14:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:14:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:14:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:14:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:14:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:14:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.592 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:14:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:14:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:14:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:14:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:14:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:14:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.593 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:14:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:14:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:14:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:14:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:14:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:14:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.594 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:14:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:14:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 47.168114473999999, 2024-04-26T11:14:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:14:44.595 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:14:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:44.596 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:14:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:14:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:14:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:14:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.597 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:14:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:14:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:14:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:14:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:14:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:14:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.598 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:14:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:14:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:14:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:14:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:14:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:14:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.599 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:14:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:14:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:14:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:14:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:14:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:14:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.600 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83360 5.2 5:42f8bfcd:::benchmark_data_smithi029_44842_object83359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 33.480875103999999, 2024-04-26T11:14:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022279782000000001, 2024-04-26T11:14:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83360 2024-04-26T11:14:44.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.602 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039700+0000", 2024-04-26T11:14:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5541000000000002e-05 2024-04-26T11:14:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039706+0000", 2024-04-26T11:14:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3680000000000001e-06 2024-04-26T11:14:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.603 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039709+0000", 2024-04-26T11:14:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4659999999999999e-06 2024-04-26T11:14:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056305+0000", 2024-04-26T11:14:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016595649000000001 2024-04-26T11:14:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056487+0000", 2024-04-26T11:14:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000181886 2024-04-26T11:14:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.604 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061809+0000", 2024-04-26T11:14:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053223259999999996 2024-04-26T11:14:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061852+0000", 2024-04-26T11:14:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2738999999999999e-05 2024-04-26T11:14:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061925+0000", 2024-04-26T11:14:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3180000000000001e-05 2024-04-26T11:14:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83364 5.2 5:42c5cd8c:::benchmark_data_smithi029_44842_object83363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 33.480459363999998, 2024-04-26T11:14:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022695336, 2024-04-26T11:14:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83364 2024-04-26T11:14:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:44.606 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040060+0000", 2024-04-26T11:14:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.607 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040086+0000", 2024-04-26T11:14:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5482000000000001e-05 2024-04-26T11:14:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040093+0000", 2024-04-26T11:14:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6409999999999996e-06 2024-04-26T11:14:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040098+0000", 2024-04-26T11:14:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879999999999996e-06 2024-04-26T11:14:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.608 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058292+0000", 2024-04-26T11:14:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018193504999999999 2024-04-26T11:14:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058412+0000", 2024-04-26T11:14:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011979199999999999 2024-04-26T11:14:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062642+0000", 2024-04-26T11:14:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042299449999999997 2024-04-26T11:14:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.609 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062688+0000", 2024-04-26T11:14:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6859e-05 2024-04-26T11:14:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062756+0000", 2024-04-26T11:14:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7995000000000002e-05 2024-04-26T11:14:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:129903 5.0 e40/16 5:00b2d390:::benchmark_data_smithi029_44842_object129902:head v 40'8238, mlcod=40'8234)", 2024-04-26T11:14:44.610 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.626709980999999, 2024-04-26T11:14:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.02228639, 2024-04-26T11:14:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:44.611 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893874+0000", 2024-04-26T11:14:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3849000000000005e-05 2024-04-26T11:14:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893884+0000", 2024-04-26T11:14:44.612 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0149000000000001e-05 2024-04-26T11:14:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893892+0000", 2024-04-26T11:14:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0299999999999994e-06 2024-04-26T11:14:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.894003+0000", 2024-04-26T11:14:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011128099999999999 2024-04-26T11:14:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.894024+0000", 2024-04-26T11:14:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0979e-05 2024-04-26T11:14:44.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.916077+0000", 2024-04-26T11:14:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022053461 2024-04-26T11:14:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.916097+0000", 2024-04-26T11:14:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9389999999999999e-05 2024-04-26T11:14:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.614 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:130959 5.7 5:ee32f7f7:::benchmark_data_smithi029_44842_object130958:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:32.375500+0000", 2024-04-26T11:14:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.145020709000001, 2024-04-26T11:14:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022235456000000001, 2024-04-26T11:14:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 130959 2024-04-26T11:14:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375500+0000", 2024-04-26T11:14:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375500+0000", 2024-04-26T11:14:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375499+0000", 2024-04-26T11:14:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375530+0000", 2024-04-26T11:14:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0556999999999999e-05 2024-04-26T11:14:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.616 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375537+0000", 2024-04-26T11:14:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7849999999999992e-06 2024-04-26T11:14:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375543+0000", 2024-04-26T11:14:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6060000000000002e-06 2024-04-26T11:14:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.377410+0000", 2024-04-26T11:14:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0018671149999999999 2024-04-26T11:14:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.617 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.377544+0000", 2024-04-26T11:14:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013380999999999999 2024-04-26T11:14:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397624+0000", 2024-04-26T11:14:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020079889 2024-04-26T11:14:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397662+0000", 2024-04-26T11:14:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8269999999999998e-05 2024-04-26T11:14:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.618 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397735+0000", 2024-04-26T11:14:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3017999999999998e-05 2024-04-26T11:14:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:130960 5.0 e40/16 5:042df53c:::benchmark_data_smithi029_44842_object130959:head v 40'8310, mlcod=40'8308)", 2024-04-26T11:14:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:32.375983+0000", 2024-04-26T11:14:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.144537799, 2024-04-26T11:14:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.021699000999999999, 2024-04-26T11:14:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:44.619 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375983+0000", 2024-04-26T11:14:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375983+0000", 2024-04-26T11:14:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375982+0000", 2024-04-26T11:14:44.620 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376039+0000", 2024-04-26T11:14:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7240000000000001e-05 2024-04-26T11:14:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376047+0000", 2024-04-26T11:14:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6699999999999994e-06 2024-04-26T11:14:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376053+0000", 2024-04-26T11:14:44.621 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:14:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376504+0000", 2024-04-26T11:14:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00045143100000000002 2024-04-26T11:14:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376521+0000", 2024-04-26T11:14:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6820000000000002e-05 2024-04-26T11:14:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397656+0000", 2024-04-26T11:14:44.622 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.021134824 2024-04-26T11:14:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397682+0000", 2024-04-26T11:14:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.597e-05 2024-04-26T11:14:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:130966 5.3 5:ce21bfb4:::benchmark_data_smithi029_44842_object130965:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:32.376761+0000", 2024-04-26T11:14:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.143759792999999, 2024-04-26T11:14:44.623 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.023879659000000001, 2024-04-26T11:14:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 130966 2024-04-26T11:14:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376761+0000", 2024-04-26T11:14:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.624 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376761+0000", 2024-04-26T11:14:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376760+0000", 2024-04-26T11:14:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376807+0000", 2024-04-26T11:14:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7089000000000003e-05 2024-04-26T11:14:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376817+0000", 2024-04-26T11:14:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.7329999999999998e-06 2024-04-26T11:14:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376824+0000", 2024-04-26T11:14:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6240000000000002e-06 2024-04-26T11:14:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378825+0000", 2024-04-26T11:14:44.626 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020004799999999998 2024-04-26T11:14:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378963+0000", 2024-04-26T11:14:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013860399999999999 2024-04-26T11:14:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.400519+0000", 2024-04-26T11:14:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.021555405 2024-04-26T11:14:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.627 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.400568+0000", 2024-04-26T11:14:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8989999999999997e-05 2024-04-26T11:14:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.400640+0000", 2024-04-26T11:14:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2556000000000001e-05 2024-04-26T11:14:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.628 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:130965 5.0 e40/16 5:02e1af30:::benchmark_data_smithi029_44842_object130964:head v 40'8311, mlcod=40'8308)", 2024-04-26T11:14:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:32.378228+0000", 2024-04-26T11:14:44.629 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.142291972000001, 2024-04-26T11:14:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.023551810999999999, 2024-04-26T11:14:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378228+0000", 2024-04-26T11:14:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378228+0000", 2024-04-26T11:14:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378228+0000", 2024-04-26T11:14:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378275+0000", 2024-04-26T11:14:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:14:44.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378284+0000", 2024-04-26T11:14:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3740000000000004e-06 2024-04-26T11:14:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378291+0000", 2024-04-26T11:14:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4359999999999999e-06 2024-04-26T11:14:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378322+0000", 2024-04-26T11:14:44.632 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1260000000000002e-05 2024-04-26T11:14:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378336+0000", 2024-04-26T11:14:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3937999999999999e-05 2024-04-26T11:14:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.401744+0000", 2024-04-26T11:14:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.023407715999999999 2024-04-26T11:14:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.401780+0000", 2024-04-26T11:14:44.633 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6433999999999997e-05 2024-04-26T11:14:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:44.634 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:44.634 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:44.636 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:44.636 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:44.633+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:44.672 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:14:44.736 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:44.734+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:44.807 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:44.807 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:44.807 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.807 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:159215 5.a 5:5a1f0c88:::benchmark_data_smithi029_44842_object14577:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T11:14:44.807 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:44.800893+0000", 2024-04-26T11:14:44.808 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0048399309999999996, 2024-04-26T11:14:44.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048607290000000003, 2024-04-26T11:14:44.808 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:44.808 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:44.808 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:44.808 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:44.808 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.808 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 159215 2024-04-26T11:14:44.808 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.808 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:44.808 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.808 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:44.808 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.800893+0000", 2024-04-26T11:14:44.808 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:44.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:44.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.800893+0000", 2024-04-26T11:14:44.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:44.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:44.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.800893+0000", 2024-04-26T11:14:44.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:44.809 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.809 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.809 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:44.809 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.800896+0000", 2024-04-26T11:14:44.809 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5720000000000001e-06 2024-04-26T11:14:44.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:44.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.800902+0000", 2024-04-26T11:14:44.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5570000000000001e-06 2024-04-26T11:14:44.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.800908+0000", 2024-04-26T11:14:44.810 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7180000000000001e-06 2024-04-26T11:14:44.810 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.810 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.810 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:44.810 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.802257+0000", 2024-04-26T11:14:44.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001348667 2024-04-26T11:14:44.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:44.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.802370+0000", 2024-04-26T11:14:44.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113119 2024-04-26T11:14:44.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:44.811 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.802475+0000", 2024-04-26T11:14:44.811 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010556900000000001 2024-04-26T11:14:44.811 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.811 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.811 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:44.812 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805146+0000", 2024-04-26T11:14:44.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026712009999999998 2024-04-26T11:14:44.812 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:44.812 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:44.812 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:44.812 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.812 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.812 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:159216 5.9 5:9546f261:::benchmark_data_smithi029_44842_object14578:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T11:14:44.812 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:44.800916+0000", 2024-04-26T11:14:44.812 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0048178730000000003, 2024-04-26T11:14:44.812 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049024480000000002, 2024-04-26T11:14:44.812 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:44.812 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:44.812 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:44.812 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:44.812 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.813 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 159216 2024-04-26T11:14:44.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.813 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:44.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:44.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.800916+0000", 2024-04-26T11:14:44.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:44.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.813 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.813 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:44.813 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.800916+0000", 2024-04-26T11:14:44.813 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:44.813 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:44.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.800915+0000", 2024-04-26T11:14:44.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:44.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:44.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.800918+0000", 2024-04-26T11:14:44.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6520000000000002e-06 2024-04-26T11:14:44.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.814 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.814 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:44.814 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.800925+0000", 2024-04-26T11:14:44.814 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9040000000000003e-06 2024-04-26T11:14:44.814 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.800930+0000", 2024-04-26T11:14:44.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4399999999999996e-06 2024-04-26T11:14:44.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:44.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.802122+0000", 2024-04-26T11:14:44.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011922300000000001 2024-04-26T11:14:44.815 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.815 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.815 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:44.815 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.802198+0000", 2024-04-26T11:14:44.815 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6137999999999995e-05 2024-04-26T11:14:44.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:44.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805758+0000", 2024-04-26T11:14:44.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035596450000000002 2024-04-26T11:14:44.816 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.816 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.816 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:44.816 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805803+0000", 2024-04-26T11:14:44.816 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4412000000000001e-05 2024-04-26T11:14:44.816 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:44.816 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:44.817 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:44.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.817 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.817 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:159220 5.b 5:d344ad27:::benchmark_data_smithi029_44842_object14582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T11:14:44.817 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:44.802924+0000", 2024-04-26T11:14:44.817 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0028091549999999998, 2024-04-26T11:14:44.817 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0029610370000000001, 2024-04-26T11:14:44.817 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:44.817 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:44.817 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:44.817 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:44.817 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.817 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 159220 2024-04-26T11:14:44.817 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.817 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:44.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:44.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.802924+0000", 2024-04-26T11:14:44.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:44.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:44.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.802924+0000", 2024-04-26T11:14:44.818 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:44.818 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.818 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.818 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:44.818 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.802923+0000", 2024-04-26T11:14:44.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:44.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:44.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.802933+0000", 2024-04-26T11:14:44.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3170000000000008e-06 2024-04-26T11:14:44.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:44.819 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.802943+0000", 2024-04-26T11:14:44.819 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0543000000000001e-05 2024-04-26T11:14:44.819 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.819 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.819 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.802951+0000", 2024-04-26T11:14:44.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.447e-06 2024-04-26T11:14:44.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:44.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.802986+0000", 2024-04-26T11:14:44.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5499e-05 2024-04-26T11:14:44.820 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.820 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.820 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:44.820 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.803119+0000", 2024-04-26T11:14:44.820 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013332099999999999 2024-04-26T11:14:44.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:44.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.803233+0000", 2024-04-26T11:14:44.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113498 2024-04-26T11:14:44.821 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.821 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.821 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:44.821 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805396+0000", 2024-04-26T11:14:44.821 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002163571 2024-04-26T11:14:44.821 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:44.821 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:44.821 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:44.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.822 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.822 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:159223 5.a 5:50077d5d:::benchmark_data_smithi029_44842_object14585:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T11:14:44.822 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:44.803117+0000", 2024-04-26T11:14:44.822 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.002616227, 2024-04-26T11:14:44.822 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0028577810000000002, 2024-04-26T11:14:44.822 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:44.822 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:44.822 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:44.822 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:44.822 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.822 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 159223 2024-04-26T11:14:44.822 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.822 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:44.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:44.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.803117+0000", 2024-04-26T11:14:44.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:44.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:44.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.803117+0000", 2024-04-26T11:14:44.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:44.823 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.823 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.823 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:44.823 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.803117+0000", 2024-04-26T11:14:44.823 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:44.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:44.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.803120+0000", 2024-04-26T11:14:44.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7290000000000002e-06 2024-04-26T11:14:44.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:44.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.803131+0000", 2024-04-26T11:14:44.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1198e-05 2024-04-26T11:14:44.824 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.824 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.824 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.824 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.803137+0000", 2024-04-26T11:14:44.824 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0220000000000001e-06 2024-04-26T11:14:44.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:44.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.803889+0000", 2024-04-26T11:14:44.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00075204000000000004 2024-04-26T11:14:44.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:44.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.803985+0000", 2024-04-26T11:14:44.825 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5563999999999995e-05 2024-04-26T11:14:44.825 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.825 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.825 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:44.825 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.804074+0000", 2024-04-26T11:14:44.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8589000000000002e-05 2024-04-26T11:14:44.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.826 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:44.826 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805661+0000", 2024-04-26T11:14:44.826 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0015868939999999999 2024-04-26T11:14:44.826 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:44.826 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:44.826 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:44.826 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.826 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.826 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:159227 5.9 5:9bd01ca0:::benchmark_data_smithi029_44842_object14589:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T11:14:44.827 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:44.803760+0000", 2024-04-26T11:14:44.827 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0019736630000000001, 2024-04-26T11:14:44.827 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022940370000000001, 2024-04-26T11:14:44.827 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:44.827 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:44.827 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:44.827 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:44.827 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.827 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 159227 2024-04-26T11:14:44.827 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.827 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:44.827 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.827 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:44.827 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.803760+0000", 2024-04-26T11:14:44.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:44.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:44.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.803760+0000", 2024-04-26T11:14:44.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:44.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:44.828 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.803759+0000", 2024-04-26T11:14:44.828 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:44.828 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.828 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.828 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:44.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.803764+0000", 2024-04-26T11:14:44.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1089999999999997e-06 2024-04-26T11:14:44.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:44.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.803776+0000", 2024-04-26T11:14:44.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2228999999999999e-05 2024-04-26T11:14:44.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.829 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.829 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.829 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.803784+0000", 2024-04-26T11:14:44.829 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:14:44.829 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:44.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.803826+0000", 2024-04-26T11:14:44.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1866999999999997e-05 2024-04-26T11:14:44.830 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.830 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.830 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:44.830 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.803913+0000", 2024-04-26T11:14:44.830 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7021000000000006e-05 2024-04-26T11:14:44.830 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:44.830 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:44.831 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:44.831 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.831 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.831 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:159230 5.f 5:fe7e1331:::benchmark_data_smithi029_44842_object14592:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T11:14:44.831 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:44.805286+0000", 2024-04-26T11:14:44.831 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00044717999999999998, 2024-04-26T11:14:44.831 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081358000000000005, 2024-04-26T11:14:44.831 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:44.831 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:44.831 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:44.831 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:44.831 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.832 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 159230 2024-04-26T11:14:44.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.832 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:44.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:44.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805286+0000", 2024-04-26T11:14:44.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:44.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.832 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:44.832 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805286+0000", 2024-04-26T11:14:44.832 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:44.832 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.832 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:44.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805285+0000", 2024-04-26T11:14:44.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:44.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:44.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805290+0000", 2024-04-26T11:14:44.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8500000000000002e-06 2024-04-26T11:14:44.833 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.833 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.833 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:44.833 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805303+0000", 2024-04-26T11:14:44.833 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2325e-05 2024-04-26T11:14:44.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805310+0000", 2024-04-26T11:14:44.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5460000000000003e-06 2024-04-26T11:14:44.834 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.834 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.834 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:44.834 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805350+0000", 2024-04-26T11:14:44.834 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0367000000000002e-05 2024-04-26T11:14:44.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.835 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:44.835 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805463+0000", 2024-04-26T11:14:44.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112304 2024-04-26T11:14:44.835 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:44.835 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:44.835 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:44.835 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.835 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.835 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:159231 5.d 5:b00d1d52:::benchmark_data_smithi029_44842_object14593:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T11:14:44.835 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:44.805345+0000", 2024-04-26T11:14:44.835 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.000388744, 2024-04-26T11:14:44.835 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081074200000000004, 2024-04-26T11:14:44.836 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:44.836 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:44.836 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:44.836 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:44.836 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.836 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 159231 2024-04-26T11:14:44.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.836 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:44.836 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.836 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:44.836 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805345+0000", 2024-04-26T11:14:44.836 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:44.836 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:44.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805345+0000", 2024-04-26T11:14:44.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:44.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:44.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805344+0000", 2024-04-26T11:14:44.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:44.837 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.837 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.837 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:44.837 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805348+0000", 2024-04-26T11:14:44.837 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3189999999999996e-06 2024-04-26T11:14:44.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:44.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805358+0000", 2024-04-26T11:14:44.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2750000000000001e-06 2024-04-26T11:14:44.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805364+0000", 2024-04-26T11:14:44.838 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3620000000000002e-06 2024-04-26T11:14:44.838 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.838 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.838 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:44.838 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805470+0000", 2024-04-26T11:14:44.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010618199999999999 2024-04-26T11:14:44.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.839 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:44.839 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805559+0000", 2024-04-26T11:14:44.839 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8987999999999996e-05 2024-04-26T11:14:44.839 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:44.839 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:44.839 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:44.839 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.839 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.839 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:159232 5.0 5:01479445:::benchmark_data_smithi029_44842_object14594:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T11:14:44.839 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:44.805520+0000", 2024-04-26T11:14:44.839 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00021292800000000001, 2024-04-26T11:14:44.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00068595500000000003, 2024-04-26T11:14:44.840 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:44.840 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:44.840 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:44.840 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:44.840 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:44.840 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 159232 2024-04-26T11:14:44.840 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.840 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:44.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:44.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805520+0000", 2024-04-26T11:14:44.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:44.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:44.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805520+0000", 2024-04-26T11:14:44.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:44.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:44.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805520+0000", 2024-04-26T11:14:44.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:44.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:44.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805524+0000", 2024-04-26T11:14:44.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5249999999999999e-06 2024-04-26T11:14:44.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:44.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805534+0000", 2024-04-26T11:14:44.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9000000000000001e-06 2024-04-26T11:14:44.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805541+0000", 2024-04-26T11:14:44.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.126e-06 2024-04-26T11:14:44.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:44.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805580+0000", 2024-04-26T11:14:44.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8640000000000003e-05 2024-04-26T11:14:44.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:44.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805696+0000", 2024-04-26T11:14:44.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011615700000000001 2024-04-26T11:14:44.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:44.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805799+0000", 2024-04-26T11:14:44.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102633 2024-04-26T11:14:44.844 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:44.844 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:44.844 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:44.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.844 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(client.4534.0:159215 5.a e44/31)", 2024-04-26T11:14:44.844 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:44.805981+0000", 2024-04-26T11:14:44.845 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9997525, 2024-04-26T11:14:44.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00026790100000000002, 2024-04-26T11:14:44.845 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:44.845 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:44.845 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:44.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:44.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805981+0000", 2024-04-26T11:14:44.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:44.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:44.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805981+0000", 2024-04-26T11:14:44.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:44.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:44.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805980+0000", 2024-04-26T11:14:44.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:44.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:44.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805984+0000", 2024-04-26T11:14:44.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.535e-06 2024-04-26T11:14:44.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:44.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805991+0000", 2024-04-26T11:14:44.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0879999999999997e-06 2024-04-26T11:14:44.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:44.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:44.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:44.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:44.805997+0000", 2024-04-26T11:14:44.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8499999999999999e-06 2024-04-26T11:14:44.847 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:44.847 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:44.847 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:44.847 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:44.847 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:14:44.847 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 9 2024-04-26T11:14:44.847 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:44.849 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:44.847+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:44.849 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:44.950 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:44.948+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:45.019 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:45.020 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:14:45.020 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:14:45.020 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:14:45.020 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:45.033 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:45.050 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:45.048+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:45.151 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:45.149+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:45.211 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:45.211 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:14:45.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:14:45.211 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:45.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.211 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:45.211 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:45.211 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.928795440999998, 2024-04-26T11:14:45.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:14:45.212 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:45.212 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:45.212 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:45.212 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:45.212 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.212 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:14:45.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.212 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:45.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:45.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:45.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:45.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:45.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.213 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:45.213 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:45.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:45.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:45.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:14:45.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:14:45.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:45.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:14:45.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:14:45.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:14:45.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:14:45.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:14:45.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:14:45.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:45.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:14:45.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:14:45.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:45.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:14:45.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:14:45.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:45.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:14:45.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:14:45.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:45.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:14:45.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:14:45.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:45.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:14:45.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:14:45.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.217 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:45.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:14:45.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:14:45.217 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.217 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:45.217 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.217 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:45.218 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:45.218 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.928145739000001, 2024-04-26T11:14:45.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:14:45.218 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:45.218 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:45.218 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:45.218 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:45.218 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.218 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:14:45.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.218 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:45.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:45.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:45.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:45.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:45.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:45.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:14:45.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:45.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:45.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:14:45.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:14:45.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:45.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:14:45.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:14:45.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:14:45.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:14:45.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:14:45.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:14:45.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:45.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:14:45.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:14:45.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:45.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:14:45.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:14:45.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:45.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:14:45.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:14:45.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:45.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:14:45.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:14:45.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:45.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:14:45.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:14:45.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:45.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:14:45.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:14:45.223 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.223 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:45.223 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.223 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:45.223 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:45.223 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.8615037, 2024-04-26T11:14:45.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:14:45.223 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:45.224 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:45.224 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:45.224 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:45.224 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.224 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:14:45.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.224 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:45.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:45.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:45.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:45.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:45.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:45.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:14:45.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:45.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:45.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:14:45.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:14:45.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:45.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:14:45.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:14:45.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:14:45.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:14:45.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:14:45.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:14:45.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:45.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:14:45.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:14:45.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:14:45.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:14:45.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:45.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:14:45.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:14:45.227 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.227 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:45.228 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.228 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:45.228 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:45.228 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.861408054000002, 2024-04-26T11:14:45.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:14:45.228 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:45.228 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:45.228 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:45.228 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:45.228 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.228 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:14:45.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.228 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:45.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:45.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:45.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:45.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:45.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:45.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:14:45.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:45.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:45.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:14:45.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:14:45.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:45.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:14:45.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:14:45.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:14:45.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:14:45.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:14:45.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:14:45.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:45.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:14:45.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:14:45.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:14:45.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:14:45.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:45.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:14:45.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:14:45.232 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.232 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:45.232 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.233 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:45.233 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:45.233 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.861276375000003, 2024-04-26T11:14:45.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:14:45.233 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:45.233 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:45.233 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:45.233 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:45.233 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.233 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:14:45.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.233 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:45.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:45.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:45.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:45.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:45.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:45.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:45.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:45.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:45.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:14:45.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:14:45.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:45.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:14:45.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:14:45.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:14:45.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:14:45.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:14:45.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:14:45.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:45.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:14:45.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:14:45.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:14:45.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:14:45.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:45.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:14:45.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:14:45.237 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.237 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:45.237 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.237 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:45.237 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:45.237 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.861167919000003, 2024-04-26T11:14:45.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:14:45.237 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:45.237 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:45.238 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:45.238 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:45.238 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.238 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:14:45.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.238 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:45.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:45.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:45.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:45.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:45.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:45.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:14:45.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:45.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:45.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:14:45.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:14:45.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:45.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:14:45.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:14:45.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:14:45.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:14:45.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:14:45.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:14:45.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:45.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:14:45.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:14:45.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:14:45.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:14:45.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:45.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:14:45.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:14:45.241 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.241 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:45.242 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.242 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:45.242 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:45.242 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.861066651000002, 2024-04-26T11:14:45.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:14:45.242 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:45.242 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:45.242 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:45.242 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:45.242 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.242 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:14:45.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.243 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:45.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:45.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:45.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:45.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:45.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:45.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:45.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:45.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:45.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:14:45.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:14:45.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:45.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:14:45.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:14:45.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:14:45.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:14:45.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:14:45.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:14:45.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:45.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:14:45.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:14:45.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:14:45.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:14:45.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:45.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:14:45.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:14:45.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:45.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:14:45.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:14:45.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:45.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:14:45.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:14:45.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:45.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:14:45.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:14:45.248 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.248 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:45.248 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.249 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:45.249 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:45.249 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.860997709999999, 2024-04-26T11:14:45.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:14:45.249 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:45.249 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:45.249 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:45.249 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:45.249 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.249 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:14:45.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.249 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:45.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:45.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:45.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:45.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:45.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:45.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:14:45.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:45.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:45.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:14:45.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:14:45.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:45.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:14:45.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:14:45.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:14:45.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:14:45.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:14:45.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:14:45.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:45.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:14:45.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:14:45.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:14:45.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:14:45.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:45.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:14:45.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:14:45.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:45.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:14:45.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:14:45.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:45.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:14:45.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:14:45.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:45.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:14:45.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:14:45.254 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.254 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:45.254 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.254 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:45.254 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:45.254 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.855002128999999, 2024-04-26T11:14:45.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:14:45.254 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:45.254 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:45.254 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:45.254 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:45.254 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.255 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:14:45.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.255 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:45.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:45.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:45.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:45.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:45.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:45.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:14:45.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:45.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:45.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:14:45.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:14:45.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:45.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:14:45.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:14:45.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:14:45.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:14:45.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:14:45.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:14:45.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:45.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:14:45.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:14:45.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:14:45.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:14:45.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:45.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:14:45.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:14:45.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:45.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:14:45.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:14:45.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:45.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:14:45.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:14:45.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:45.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:14:45.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:14:45.259 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.259 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:45.259 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.259 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:81256 5.8 5:1c0f3fd8:::benchmark_data_smithi029_44842_object81255:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:45.259 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:45.259 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 35.091542580000002, 2024-04-26T11:14:45.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026193673000000001, 2024-04-26T11:14:45.259 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:45.259 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:45.259 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:45.260 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:45.260 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.260 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 81256 2024-04-26T11:14:45.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.260 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:45.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:45.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:45.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:45.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:45.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:45.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:45.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:45.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:45.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116073+0000", 2024-04-26T11:14:45.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0114e-05 2024-04-26T11:14:45.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:45.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116079+0000", 2024-04-26T11:14:45.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8939999999999998e-06 2024-04-26T11:14:45.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116082+0000", 2024-04-26T11:14:45.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:14:45.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127501+0000", 2024-04-26T11:14:45.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011418281000000001 2024-04-26T11:14:45.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:45.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127639+0000", 2024-04-26T11:14:45.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013828899999999999 2024-04-26T11:14:45.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:45.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127782+0000", 2024-04-26T11:14:45.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014328299999999999 2024-04-26T11:14:45.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:45.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.134767+0000", 2024-04-26T11:14:45.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0069844140000000004 2024-04-26T11:14:45.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:45.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142160+0000", 2024-04-26T11:14:45.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007392839 2024-04-26T11:14:45.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:45.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142202+0000", 2024-04-26T11:14:45.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2797999999999999e-05 2024-04-26T11:14:45.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:45.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142237+0000", 2024-04-26T11:14:45.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4464000000000001e-05 2024-04-26T11:14:45.264 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.264 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:45.264 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.265 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101754 5.e 5:7ca15a5c:::benchmark_data_smithi029_44842_object101753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:45.265 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:45.265 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.089054387000001, 2024-04-26T11:14:45.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039171048999999999, 2024-04-26T11:14:45.265 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:45.265 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:45.265 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:45.265 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:45.265 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.265 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101754 2024-04-26T11:14:45.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.265 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:45.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:45.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:45.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:45.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:45.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:45.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:45.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:45.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:45.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118604+0000", 2024-04-26T11:14:45.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3399000000000007e-05 2024-04-26T11:14:45.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:45.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118613+0000", 2024-04-26T11:14:45.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6989999999999992e-06 2024-04-26T11:14:45.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118618+0000", 2024-04-26T11:14:45.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3850000000000001e-06 2024-04-26T11:14:45.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118646+0000", 2024-04-26T11:14:45.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7878e-05 2024-04-26T11:14:45.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:45.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118720+0000", 2024-04-26T11:14:45.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3461999999999996e-05 2024-04-26T11:14:45.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:45.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118807+0000", 2024-04-26T11:14:45.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7269999999999996e-05 2024-04-26T11:14:45.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:45.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142317+0000", 2024-04-26T11:14:45.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023510105999999999 2024-04-26T11:14:45.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:45.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.143287+0000", 2024-04-26T11:14:45.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096983599999999996 2024-04-26T11:14:45.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:45.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157662+0000", 2024-04-26T11:14:45.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014375393 2024-04-26T11:14:45.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:45.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157702+0000", 2024-04-26T11:14:45.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0295e-05 2024-04-26T11:14:45.270 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.270 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:45.270 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.271 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101755 5.f 5:fa973a83:::benchmark_data_smithi029_44842_object101754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:45.271 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:45.271 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.088888691000001, 2024-04-26T11:14:45.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039139064000000001, 2024-04-26T11:14:45.271 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:45.271 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:45.271 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:45.271 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:45.271 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.271 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101755 2024-04-26T11:14:45.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.271 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:45.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:45.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:45.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:45.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:45.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:45.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118696+0000", 2024-04-26T11:14:45.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:45.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:45.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118766+0000", 2024-04-26T11:14:45.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9423000000000003e-05 2024-04-26T11:14:45.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:45.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118774+0000", 2024-04-26T11:14:45.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9710000000000004e-06 2024-04-26T11:14:45.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118779+0000", 2024-04-26T11:14:45.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5629999999999999e-06 2024-04-26T11:14:45.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118817+0000", 2024-04-26T11:14:45.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7771000000000001e-05 2024-04-26T11:14:45.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:45.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118929+0000", 2024-04-26T11:14:45.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011222699999999999 2024-04-26T11:14:45.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:45.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157661+0000", 2024-04-26T11:14:45.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038731120000000001 2024-04-26T11:14:45.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:45.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157757+0000", 2024-04-26T11:14:45.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6910000000000006e-05 2024-04-26T11:14:45.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:45.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157836+0000", 2024-04-26T11:14:45.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8727999999999996e-05 2024-04-26T11:14:45.275 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.275 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:45.275 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.276 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101758 5.4 5:2525a4eb:::benchmark_data_smithi029_44842_object101757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:45.276 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:45.276 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.08670584, 2024-04-26T11:14:45.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.03686739, 2024-04-26T11:14:45.276 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:45.276 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:45.276 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:45.276 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:45.276 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.276 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101758 2024-04-26T11:14:45.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.276 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:45.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:45.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:45.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:45.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:45.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:45.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120879+0000", 2024-04-26T11:14:45.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:45.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:45.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120971+0000", 2024-04-26T11:14:45.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2133999999999996e-05 2024-04-26T11:14:45.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:45.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120977+0000", 2024-04-26T11:14:45.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5509999999999999e-06 2024-04-26T11:14:45.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120981+0000", 2024-04-26T11:14:45.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.245e-06 2024-04-26T11:14:45.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121010+0000", 2024-04-26T11:14:45.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9084000000000001e-05 2024-04-26T11:14:45.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:45.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121083+0000", 2024-04-26T11:14:45.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2942999999999996e-05 2024-04-26T11:14:45.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:45.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121163+0000", 2024-04-26T11:14:45.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0197000000000005e-05 2024-04-26T11:14:45.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:45.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142822+0000", 2024-04-26T11:14:45.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021658535999999999 2024-04-26T11:14:45.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:45.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157674+0000", 2024-04-26T11:14:45.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014851573999999999 2024-04-26T11:14:45.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:45.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157714+0000", 2024-04-26T11:14:45.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0473999999999999e-05 2024-04-26T11:14:45.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:45.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157747+0000", 2024-04-26T11:14:45.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3278999999999998e-05 2024-04-26T11:14:45.284 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.284 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:45.284 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.284 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101760 5.4 5:2510211a:::benchmark_data_smithi029_44842_object101759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:45.284 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:45.284 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.086273495, 2024-04-26T11:14:45.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039182383000000001, 2024-04-26T11:14:45.284 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:45.284 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:45.284 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:45.284 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:45.285 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.285 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101760 2024-04-26T11:14:45.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.285 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:45.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:45.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:45.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:45.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:45.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:45.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:45.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:45.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:45.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121389+0000", 2024-04-26T11:14:45.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6667000000000003e-05 2024-04-26T11:14:45.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:45.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121394+0000", 2024-04-26T11:14:45.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0839999999999999e-06 2024-04-26T11:14:45.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121397+0000", 2024-04-26T11:14:45.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4489999999999999e-06 2024-04-26T11:14:45.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122921+0000", 2024-04-26T11:14:45.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001524067 2024-04-26T11:14:45.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:45.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.123010+0000", 2024-04-26T11:14:45.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8449000000000006e-05 2024-04-26T11:14:45.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:45.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140838+0000", 2024-04-26T11:14:45.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017828796000000001 2024-04-26T11:14:45.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:45.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157665+0000", 2024-04-26T11:14:45.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016826574 2024-04-26T11:14:45.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:45.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160407+0000", 2024-04-26T11:14:45.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027423970000000002 2024-04-26T11:14:45.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:45.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160456+0000", 2024-04-26T11:14:45.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8678999999999999e-05 2024-04-26T11:14:45.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:45.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160495+0000", 2024-04-26T11:14:45.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8658000000000002e-05 2024-04-26T11:14:45.290 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.290 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:45.290 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.291 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101761 5.e 5:70294421:::benchmark_data_smithi029_44842_object101760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:45.291 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:45.291 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.084849122000001, 2024-04-26T11:14:45.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035270448000000003, 2024-04-26T11:14:45.291 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:45.291 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:45.291 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:45.291 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:45.291 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.291 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101761 2024-04-26T11:14:45.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.291 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:45.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:45.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:45.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:45.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:45.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:45.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122736+0000", 2024-04-26T11:14:45.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:45.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:45.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122805+0000", 2024-04-26T11:14:45.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9076000000000001e-05 2024-04-26T11:14:45.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:45.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122811+0000", 2024-04-26T11:14:45.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:14:45.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122815+0000", 2024-04-26T11:14:45.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2860000000000001e-06 2024-04-26T11:14:45.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122842+0000", 2024-04-26T11:14:45.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6429000000000001e-05 2024-04-26T11:14:45.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:45.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122916+0000", 2024-04-26T11:14:45.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4122999999999995e-05 2024-04-26T11:14:45.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:45.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122997+0000", 2024-04-26T11:14:45.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1428999999999996e-05 2024-04-26T11:14:45.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:45.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142344+0000", 2024-04-26T11:14:45.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019346452 2024-04-26T11:14:45.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:45.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157934+0000", 2024-04-26T11:14:45.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015589911999999999 2024-04-26T11:14:45.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:45.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157975+0000", 2024-04-26T11:14:45.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1604999999999999e-05 2024-04-26T11:14:45.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:45.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.158007+0000", 2024-04-26T11:14:45.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1921000000000002e-05 2024-04-26T11:14:45.296 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.296 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:45.296 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.296 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110145 5.9 5:9b275f16:::benchmark_data_smithi029_44842_object110144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:45.296 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:45.297 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.059287483999999, 2024-04-26T11:14:45.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032844496000000001, 2024-04-26T11:14:45.297 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:45.297 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:45.297 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:45.297 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:45.297 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.297 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110145 2024-04-26T11:14:45.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.297 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:45.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:45.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:45.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:45.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:45.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:45.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148297+0000", 2024-04-26T11:14:45.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:45.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:45.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148325+0000", 2024-04-26T11:14:45.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7511000000000001e-05 2024-04-26T11:14:45.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:45.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148338+0000", 2024-04-26T11:14:45.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2808e-05 2024-04-26T11:14:45.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148345+0000", 2024-04-26T11:14:45.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7200000000000006e-06 2024-04-26T11:14:45.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149888+0000", 2024-04-26T11:14:45.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001542666 2024-04-26T11:14:45.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:45.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149977+0000", 2024-04-26T11:14:45.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9247999999999997e-05 2024-04-26T11:14:45.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:45.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181006+0000", 2024-04-26T11:14:45.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031028535999999999 2024-04-26T11:14:45.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:45.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181051+0000", 2024-04-26T11:14:45.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5393999999999999e-05 2024-04-26T11:14:45.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:45.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181143+0000", 2024-04-26T11:14:45.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1458000000000004e-05 2024-04-26T11:14:45.302 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.302 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:45.302 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.303 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110155 5.9 5:9ebc6158:::benchmark_data_smithi029_44842_object110154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:45.303 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:45.303 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 22.054211691999999, 2024-04-26T11:14:45.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027886826999999999, 2024-04-26T11:14:45.303 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:45.303 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:45.303 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:45.303 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:45.303 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.304 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110155 2024-04-26T11:14:45.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.304 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:45.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:45.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:45.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:45.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:45.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:45.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153373+0000", 2024-04-26T11:14:45.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:45.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:45.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153479+0000", 2024-04-26T11:14:45.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105728 2024-04-26T11:14:45.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:45.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153491+0000", 2024-04-26T11:14:45.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2207e-05 2024-04-26T11:14:45.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153499+0000", 2024-04-26T11:14:45.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7729999999999999e-06 2024-04-26T11:14:45.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153655+0000", 2024-04-26T11:14:45.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015573 2024-04-26T11:14:45.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:45.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153770+0000", 2024-04-26T11:14:45.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011562500000000001 2024-04-26T11:14:45.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:45.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181153+0000", 2024-04-26T11:14:45.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027382113 2024-04-26T11:14:45.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:45.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181195+0000", 2024-04-26T11:14:45.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1921000000000001e-05 2024-04-26T11:14:45.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:45.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181261+0000", 2024-04-26T11:14:45.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6402999999999994e-05 2024-04-26T11:14:45.308 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.308 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:45.308 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.309 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:129903 5.0 5:00b2d390:::benchmark_data_smithi029_44842_object129902:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:45.309 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:31.889868+0000", 2024-04-26T11:14:45.309 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 13.317717291999999, 2024-04-26T11:14:45.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026543418999999999, 2024-04-26T11:14:45.309 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:45.309 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:45.309 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:45.309 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:45.309 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.309 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 129903 2024-04-26T11:14:45.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.310 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:45.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:45.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889868+0000", 2024-04-26T11:14:45.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:45.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889868+0000", 2024-04-26T11:14:45.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:45.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889868+0000", 2024-04-26T11:14:45.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:45.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:45.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889936+0000", 2024-04-26T11:14:45.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7655000000000002e-05 2024-04-26T11:14:45.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:45.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889943+0000", 2024-04-26T11:14:45.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7319999999999998e-06 2024-04-26T11:14:45.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889948+0000", 2024-04-26T11:14:45.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5909999999999998e-06 2024-04-26T11:14:45.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.893510+0000", 2024-04-26T11:14:45.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035624540000000001 2024-04-26T11:14:45.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:45.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.893637+0000", 2024-04-26T11:14:45.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000126604 2024-04-26T11:14:45.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:45.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.893784+0000", 2024-04-26T11:14:45.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014726299999999999 2024-04-26T11:14:45.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:45.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.903173+0000", 2024-04-26T11:14:45.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0093891370000000005 2024-04-26T11:14:45.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:45.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.916373+0000", 2024-04-26T11:14:45.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013199407999999999 2024-04-26T11:14:45.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:45.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.916395+0000", 2024-04-26T11:14:45.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2447e-05 2024-04-26T11:14:45.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:45.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.916412+0000", 2024-04-26T11:14:45.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6688e-05 2024-04-26T11:14:45.315 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.315 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:45.315 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.315 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:130965 5.0 5:02e1af30:::benchmark_data_smithi029_44842_object130964:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:45.315 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:32.376041+0000", 2024-04-26T11:14:45.315 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.831545058, 2024-04-26T11:14:45.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027463617999999999, 2024-04-26T11:14:45.315 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:45.315 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:45.315 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:45.315 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:45.316 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.316 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 130965 2024-04-26T11:14:45.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.316 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:45.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:45.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376041+0000", 2024-04-26T11:14:45.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:45.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376041+0000", 2024-04-26T11:14:45.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:45.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376040+0000", 2024-04-26T11:14:45.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:45.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:45.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376126+0000", 2024-04-26T11:14:45.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6070999999999996e-05 2024-04-26T11:14:45.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:45.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376133+0000", 2024-04-26T11:14:45.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7739999999999999e-06 2024-04-26T11:14:45.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376137+0000", 2024-04-26T11:14:45.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3669999999999999e-06 2024-04-26T11:14:45.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.378033+0000", 2024-04-26T11:14:45.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001895484 2024-04-26T11:14:45.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:45.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.378108+0000", 2024-04-26T11:14:45.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5201e-05 2024-04-26T11:14:45.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:45.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.378200+0000", 2024-04-26T11:14:45.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1712999999999994e-05 2024-04-26T11:14:45.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:45.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.381666+0000", 2024-04-26T11:14:45.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003466701 2024-04-26T11:14:45.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:45.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.403451+0000", 2024-04-26T11:14:45.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021784583 2024-04-26T11:14:45.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:45.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.403484+0000", 2024-04-26T11:14:45.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3265000000000001e-05 2024-04-26T11:14:45.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:45.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.403504+0000", 2024-04-26T11:14:45.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0123999999999999e-05 2024-04-26T11:14:45.321 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.321 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:45.321 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.321 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:143341 5.e 5:726d70d0:::benchmark_data_smithi029_44842_object143340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T11:14:45.321 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:37.815337+0000", 2024-04-26T11:14:45.321 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.3922492200000001, 2024-04-26T11:14:45.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02673615, 2024-04-26T11:14:45.321 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:45.321 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:45.321 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:45.321 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:45.321 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.322 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 143341 2024-04-26T11:14:45.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.322 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:45.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:45.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.815337+0000", 2024-04-26T11:14:45.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:45.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.815337+0000", 2024-04-26T11:14:45.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:45.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:45.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.815336+0000", 2024-04-26T11:14:45.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:45.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:45.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.815404+0000", 2024-04-26T11:14:45.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8003999999999995e-05 2024-04-26T11:14:45.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:45.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.815414+0000", 2024-04-26T11:14:45.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0302999999999999e-05 2024-04-26T11:14:45.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.815421+0000", 2024-04-26T11:14:45.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4919999999999998e-06 2024-04-26T11:14:45.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:45.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.821786+0000", 2024-04-26T11:14:45.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.006365094 2024-04-26T11:14:45.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:45.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.821895+0000", 2024-04-26T11:14:45.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108856 2024-04-26T11:14:45.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:45.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.822026+0000", 2024-04-26T11:14:45.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013116500000000001 2024-04-26T11:14:45.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:45.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.827684+0000", 2024-04-26T11:14:45.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0056578619999999996 2024-04-26T11:14:45.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:45.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.842007+0000", 2024-04-26T11:14:45.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014323259 2024-04-26T11:14:45.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:45.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.842049+0000", 2024-04-26T11:14:45.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2345000000000002e-05 2024-04-26T11:14:45.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:45.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:45.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:45.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.842073+0000", 2024-04-26T11:14:45.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3481000000000001e-05 2024-04-26T11:14:45.326 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.326 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:45.327 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.327 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:45.327 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:45.327 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:45.329 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:45.326+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:45.329 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:45.428 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:45.426+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:45.509 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:45.509 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:45.509 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.509 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:161164 5.a e44/31 5:5fba23d7:::benchmark_data_smithi029_44842_object16526:head v 44'10214, mlcod=44'10211)", 2024-04-26T11:14:45.509 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:45.505438+0000", 2024-04-26T11:14:45.509 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00180934, 2024-04-26T11:14:45.510 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0018317299999999999, 2024-04-26T11:14:45.510 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:45.510 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:45.510 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:45.510 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.510 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:45.510 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.505438+0000", 2024-04-26T11:14:45.510 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:45.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.510 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.510 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.505438+0000", 2024-04-26T11:14:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.505437+0000", 2024-04-26T11:14:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.505445+0000", 2024-04-26T11:14:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2010000000000002e-06 2024-04-26T11:14:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.505455+0000", 2024-04-26T11:14:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0222e-05 2024-04-26T11:14:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.505460+0000", 2024-04-26T11:14:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1569999999999999e-06 2024-04-26T11:14:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.512 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.505486+0000", 2024-04-26T11:14:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6288e-05 2024-04-26T11:14:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.505499+0000", 2024-04-26T11:14:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2383e-05 2024-04-26T11:14:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:45.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.514 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.514 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:161166 5.0 e44/16 5:0126650e:::benchmark_data_smithi029_44842_object16528:head v 44'10233, mlcod=44'10230)", 2024-04-26T11:14:45.514 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:45.505907+0000", 2024-04-26T11:14:45.514 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.001340803, 2024-04-26T11:14:45.514 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001427549, 2024-04-26T11:14:45.514 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:45.514 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:45.514 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:45.514 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.514 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:45.514 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.505907+0000", 2024-04-26T11:14:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.505907+0000", 2024-04-26T11:14:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.505906+0000", 2024-04-26T11:14:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.515 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.505910+0000", 2024-04-26T11:14:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6509999999999999e-06 2024-04-26T11:14:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.505918+0000", 2024-04-26T11:14:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7340000000000008e-06 2024-04-26T11:14:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.516 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.505923+0000", 2024-04-26T11:14:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7339999999999996e-06 2024-04-26T11:14:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.505956+0000", 2024-04-26T11:14:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2731000000000002e-05 2024-04-26T11:14:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.505975+0000", 2024-04-26T11:14:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9003000000000001e-05 2024-04-26T11:14:45.517 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:161169 5.6 5:6224857c:::benchmark_data_smithi029_44842_object16531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T11:14:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:45.506107+0000", 2024-04-26T11:14:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0011401709999999999, 2024-04-26T11:14:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0012886600000000001, 2024-04-26T11:14:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:45.518 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 161169 2024-04-26T11:14:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506107+0000", 2024-04-26T11:14:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:45.519 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506107+0000", 2024-04-26T11:14:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506106+0000", 2024-04-26T11:14:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506111+0000", 2024-04-26T11:14:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1330000000000001e-06 2024-04-26T11:14:45.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506117+0000", 2024-04-26T11:14:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8959999999999997e-06 2024-04-26T11:14:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506122+0000", 2024-04-26T11:14:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6929999999999998e-06 2024-04-26T11:14:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:45.521 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506155+0000", 2024-04-26T11:14:45.522 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2944000000000002e-05 2024-04-26T11:14:45.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.522 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.522 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:45.522 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506270+0000", 2024-04-26T11:14:45.522 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011499 2024-04-26T11:14:45.522 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:45.522 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:45.522 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:45.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.522 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.522 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:161170 5.c 5:332b0548:::benchmark_data_smithi029_44842_object16532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T11:14:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:45.506138+0000", 2024-04-26T11:14:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.001109126, 2024-04-26T11:14:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001332944, 2024-04-26T11:14:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 161170 2024-04-26T11:14:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.523 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:45.524 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506138+0000", 2024-04-26T11:14:45.524 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:45.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.524 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.524 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:45.524 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506138+0000", 2024-04-26T11:14:45.524 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:45.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.524 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.524 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:45.524 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506138+0000", 2024-04-26T11:14:45.524 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:45.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.525 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.525 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:45.525 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506140+0000", 2024-04-26T11:14:45.525 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0669999999999999e-06 2024-04-26T11:14:45.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.525 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.525 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:45.525 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506144+0000", 2024-04-26T11:14:45.525 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5430000000000004e-06 2024-04-26T11:14:45.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.525 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.525 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.526 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506148+0000", 2024-04-26T11:14:45.526 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1870000000000001e-06 2024-04-26T11:14:45.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.526 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.526 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:45.526 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506182+0000", 2024-04-26T11:14:45.526 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3887999999999998e-05 2024-04-26T11:14:45.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.526 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.526 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:45.526 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506269+0000", 2024-04-26T11:14:45.526 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7626000000000004e-05 2024-04-26T11:14:45.527 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:45.527 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:45.527 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:45.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.527 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.527 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:161171 5.5 5:a207be30:::benchmark_data_smithi029_44842_object16533:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T11:14:45.527 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:45.506156+0000", 2024-04-26T11:14:45.527 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.001091449, 2024-04-26T11:14:45.527 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0014556829999999999, 2024-04-26T11:14:45.527 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:45.527 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:45.527 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:45.527 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:45.528 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.528 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 161171 2024-04-26T11:14:45.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.528 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:45.528 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.528 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:45.528 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506156+0000", 2024-04-26T11:14:45.528 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:45.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.528 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.528 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:45.528 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506156+0000", 2024-04-26T11:14:45.528 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:45.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.529 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.529 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:45.529 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506156+0000", 2024-04-26T11:14:45.529 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:45.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.529 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.529 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:45.529 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506158+0000", 2024-04-26T11:14:45.529 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3159999999999999e-06 2024-04-26T11:14:45.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.529 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.529 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:45.530 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506170+0000", 2024-04-26T11:14:45.530 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2123000000000001e-05 2024-04-26T11:14:45.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.530 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.530 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.530 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506175+0000", 2024-04-26T11:14:45.530 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4269999999999999e-06 2024-04-26T11:14:45.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.530 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.530 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:45.530 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506227+0000", 2024-04-26T11:14:45.530 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2111999999999998e-05 2024-04-26T11:14:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506358+0000", 2024-04-26T11:14:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013011300000000001 2024-04-26T11:14:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:161173 5.7 5:efc481e7:::benchmark_data_smithi029_44842_object16535:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T11:14:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:45.506823+0000", 2024-04-26T11:14:45.531 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00042426200000000001, 2024-04-26T11:14:45.532 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00086740199999999997, 2024-04-26T11:14:45.532 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:45.532 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:45.532 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:45.532 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:45.532 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.532 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 161173 2024-04-26T11:14:45.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.532 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:45.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.532 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:45.532 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506823+0000", 2024-04-26T11:14:45.532 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:45.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:45.533 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506823+0000", 2024-04-26T11:14:45.533 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:45.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:45.533 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506822+0000", 2024-04-26T11:14:45.533 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:45.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.534 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:45.534 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506827+0000", 2024-04-26T11:14:45.534 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.3109999999999999e-06 2024-04-26T11:14:45.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.534 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:45.534 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506837+0000", 2024-04-26T11:14:45.534 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0528e-05 2024-04-26T11:14:45.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.534 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.534 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506844+0000", 2024-04-26T11:14:45.534 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8809999999999998e-06 2024-04-26T11:14:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.506885+0000", 2024-04-26T11:14:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0538999999999999e-05 2024-04-26T11:14:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.507006+0000", 2024-04-26T11:14:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000121462 2024-04-26T11:14:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:45.535 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:161172 5.e e44/16 5:74fe7dd2:::benchmark_data_smithi029_44842_object16534:head v 44'10021, mlcod=44'10019)", 2024-04-26T11:14:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:45.507512+0000", 2024-04-26T11:14:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9997354, 2024-04-26T11:14:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00025065899999999997, 2024-04-26T11:14:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.507512+0000", 2024-04-26T11:14:45.536 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.507512+0000", 2024-04-26T11:14:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.507511+0000", 2024-04-26T11:14:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.537 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:45.538 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.507520+0000", 2024-04-26T11:14:45.538 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7139999999999999e-06 2024-04-26T11:14:45.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.538 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:45.538 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.507528+0000", 2024-04-26T11:14:45.538 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.1049999999999995e-06 2024-04-26T11:14:45.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.538 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.538 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.507534+0000", 2024-04-26T11:14:45.538 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9449999999999998e-06 2024-04-26T11:14:45.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.539 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:45.539 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.507563+0000", 2024-04-26T11:14:45.539 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9094e-05 2024-04-26T11:14:45.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.539 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:45.539 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.507580+0000", 2024-04-26T11:14:45.539 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7070000000000001e-05 2024-04-26T11:14:45.539 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:45.539 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:45.539 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:45.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.540 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:161176 5.c 5.d2eea84c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T11:14:45.540 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:45.507792+0000", 2024-04-26T11:14:45.540 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9994555, 2024-04-26T11:14:45.540 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6591999999999998e-05, 2024-04-26T11:14:45.540 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:45.540 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:45.540 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:45.540 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:45.540 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:45.540 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 161176 2024-04-26T11:14:45.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.541 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:45.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.541 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:45.541 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.507792+0000", 2024-04-26T11:14:45.541 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:45.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.541 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:45.541 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.507792+0000", 2024-04-26T11:14:45.541 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:45.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.542 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:45.542 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.507791+0000", 2024-04-26T11:14:45.542 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:45.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.542 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.542 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:45.542 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.507797+0000", 2024-04-26T11:14:45.542 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.648e-06 2024-04-26T11:14:45.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.542 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.542 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:45.542 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.507808+0000", 2024-04-26T11:14:45.543 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1049999999999999e-05 2024-04-26T11:14:45.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:45.543 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:45.543 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:45.543 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:45.507817+0000", 2024-04-26T11:14:45.543 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1069999999999994e-06 2024-04-26T11:14:45.543 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:45.543 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:45.543 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:45.543 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:45.543 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:14:45.543 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 8 2024-04-26T11:14:45.543 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:45.545 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:45.546 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:45.543+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:45.646 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:45.644+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:45.665 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:14:45.746 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~47s 2024-04-26T11:14:45.746 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:45.745+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:45.768 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:14:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:14:45.768 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:14:45.768 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:45.783 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:45.847 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:45.846+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:45.950 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:45.948+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:46.011 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:46.011 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:14:46.011 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:14:46.011 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:46.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.012 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:46.012 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:46.012 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 52.737355757000003, 2024-04-26T11:14:46.012 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:14:46.012 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:46.012 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:46.012 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:46.012 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:46.012 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.012 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:14:46.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.012 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:46.012 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.012 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:46.013 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:46.013 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.013 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.013 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:46.013 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:46.013 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.013 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.013 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:46.013 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:14:46.013 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:46.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.013 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.014 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:46.014 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:14:46.014 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:14:46.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.014 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:46.014 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:14:46.014 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:14:46.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.014 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.014 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:14:46.014 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:14:46.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.015 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.015 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:14:46.015 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:14:46.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.015 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:46.015 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:14:46.015 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:14:46.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.015 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:46.015 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:14:46.015 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:14:46.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.016 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.016 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:46.016 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:14:46.016 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:14:46.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.016 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.016 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:46.016 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:14:46.016 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:14:46.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.016 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.016 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:46.016 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:14:46.016 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:14:46.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.017 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:46.017 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:14:46.017 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:14:46.017 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.017 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:46.017 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.017 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:46.017 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:46.017 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 52.736544191999997, 2024-04-26T11:14:46.017 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:14:46.017 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:46.018 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:46.018 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:46.018 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:46.018 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.018 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:14:46.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.018 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:46.018 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.018 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:46.018 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:46.018 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.018 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.019 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:46.019 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:46.019 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.019 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.019 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:46.019 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:46.019 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:46.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.019 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.019 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:46.019 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:14:46.019 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:14:46.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.019 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.020 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:46.020 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:14:46.020 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:14:46.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.020 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.020 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:14:46.020 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:14:46.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.020 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.020 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:14:46.020 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:14:46.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.021 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:46.021 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:14:46.021 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:14:46.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.021 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.021 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:46.021 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:14:46.021 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:14:46.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.021 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.021 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:46.021 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:14:46.021 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:14:46.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.022 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:46.022 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:14:46.022 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:14:46.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.022 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:46.022 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:14:46.022 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:14:46.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.022 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:46.022 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:14:46.022 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:14:46.023 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.023 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:46.023 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.023 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.023 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:46.023 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:46.023 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 52.729357354999998, 2024-04-26T11:14:46.023 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:14:46.023 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:46.023 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:46.023 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:46.023 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:46.023 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.024 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:14:46.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.024 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:46.024 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.024 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:46.024 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:46.024 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.024 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.024 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:46.024 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:46.024 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.025 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:46.025 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:14:46.025 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:46.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.025 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:46.025 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:14:46.025 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:14:46.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.026 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:46.026 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:14:46.026 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:14:46.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.026 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.026 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.026 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:14:46.026 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:14:46.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.026 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.026 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.026 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:14:46.026 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:14:46.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.027 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.027 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:46.027 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:14:46.027 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:14:46.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.027 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.027 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:46.027 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:14:46.027 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:14:46.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.027 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.027 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:46.027 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:14:46.027 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:14:46.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.028 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.028 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:46.028 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:14:46.028 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:14:46.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.028 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.028 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:46.028 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:14:46.028 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:14:46.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.028 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.028 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:46.028 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:14:46.029 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:14:46.029 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.029 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:46.029 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.029 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:46.029 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:46.029 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 52.728816475999999, 2024-04-26T11:14:46.029 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:14:46.029 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:46.029 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:46.029 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:46.029 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:46.030 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.030 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:14:46.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.030 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:46.030 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.030 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:46.030 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:46.030 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.030 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.030 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:46.030 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:46.030 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.031 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.031 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:46.031 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:46.031 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:46.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.031 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.031 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:46.031 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:14:46.031 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:14:46.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.031 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.031 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:46.031 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:14:46.032 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:14:46.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.032 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.032 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.032 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:14:46.032 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:14:46.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.032 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.032 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.032 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:14:46.032 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:14:46.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.032 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.032 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:46.033 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:14:46.033 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:14:46.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.033 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.033 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:46.033 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:14:46.033 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:14:46.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.033 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.033 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:46.033 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:14:46.033 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:14:46.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.033 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.034 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:46.034 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:14:46.034 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:14:46.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.034 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.034 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:46.034 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:14:46.034 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:14:46.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.034 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.034 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:46.034 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:14:46.034 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:14:46.034 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.034 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:46.035 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.035 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.035 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.035 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:46.035 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:46.035 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 48.685632028999997, 2024-04-26T11:14:46.035 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:14:46.035 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:46.035 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:46.035 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:46.035 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:46.035 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.035 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:14:46.035 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.036 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:46.036 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.036 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:46.036 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:46.036 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.036 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.036 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:46.036 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:46.036 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.036 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.036 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:46.036 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:14:46.036 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:46.037 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.037 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.037 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:46.037 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:14:46.037 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:14:46.037 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.037 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.037 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:46.037 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:14:46.037 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:14:46.037 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.037 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.037 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.037 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:14:46.037 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:14:46.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.038 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.038 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.038 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:14:46.038 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:14:46.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.038 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.038 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:46.038 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:14:46.038 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:14:46.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.038 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.038 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:46.038 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:14:46.039 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:14:46.039 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.039 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.039 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:46.039 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:14:46.039 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:14:46.039 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.039 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.039 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.039 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:14:46.039 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:14:46.039 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.039 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.039 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:46.039 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:14:46.040 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:14:46.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.040 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.040 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.040 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:14:46.040 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:14:46.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.040 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.040 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:46.040 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:14:46.040 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:14:46.040 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.040 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:46.040 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.041 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.041 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:46.041 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:46.041 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 48.683438688999999, 2024-04-26T11:14:46.041 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:14:46.041 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:46.041 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:46.041 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:46.041 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:46.041 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.041 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:14:46.041 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.041 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:46.041 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.041 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:46.042 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:46.042 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.042 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.042 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:46.042 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:46.042 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.042 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.042 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:46.042 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:14:46.042 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:46.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.042 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.043 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:46.043 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:14:46.043 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:14:46.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.043 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.043 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:46.043 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:14:46.043 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:14:46.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.043 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.043 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.043 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:14:46.043 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:14:46.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.043 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.044 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.044 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:14:46.044 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:14:46.044 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.044 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.044 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:46.044 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:14:46.044 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:14:46.044 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.044 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.044 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:46.044 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:14:46.044 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:14:46.044 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.044 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.045 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:46.045 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:14:46.045 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:14:46.045 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.045 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.045 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.045 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:14:46.045 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:14:46.045 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.045 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.045 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:46.045 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:14:46.045 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:14:46.045 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.046 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.046 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.046 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:14:46.046 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:14:46.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.046 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.046 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:46.046 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:14:46.046 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:14:46.046 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.046 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:46.046 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.046 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.046 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:46.047 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:46.047 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 48.678226864999999, 2024-04-26T11:14:46.047 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:14:46.047 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:46.047 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:46.047 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:46.047 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:46.047 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.047 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:14:46.047 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.047 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:46.047 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.047 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:46.047 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:46.047 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.048 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.048 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.048 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:46.048 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:46.048 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.048 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.048 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.048 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:46.048 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:14:46.048 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:46.048 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.048 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.048 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:46.048 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:14:46.048 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:14:46.049 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.049 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.049 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:46.049 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:14:46.049 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:14:46.049 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.049 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.049 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.049 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:14:46.049 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:14:46.049 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.049 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.049 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.049 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:14:46.049 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:14:46.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.050 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.050 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:46.050 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:14:46.050 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:14:46.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.050 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.050 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:46.050 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:14:46.050 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:14:46.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.050 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.050 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:46.050 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:14:46.050 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:14:46.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.051 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.051 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.051 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:14:46.051 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:14:46.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.051 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.051 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:46.051 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:14:46.051 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:14:46.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.051 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.051 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.052 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:14:46.052 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:14:46.052 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.052 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.052 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:46.052 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:14:46.052 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:14:46.052 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.052 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:46.052 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.052 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.052 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.052 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:46.052 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:46.053 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 48.661778165000001, 2024-04-26T11:14:46.053 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:14:46.053 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:46.053 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:46.053 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:46.053 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:46.053 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.053 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:14:46.053 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.053 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:46.053 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.053 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:46.053 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:46.054 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.054 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.054 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.054 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:46.054 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:46.054 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.054 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.054 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.054 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:46.054 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:14:46.054 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:46.054 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.054 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.054 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:46.054 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:14:46.055 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:14:46.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.055 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.055 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:46.055 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:14:46.055 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:14:46.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.055 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.055 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.055 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:14:46.055 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:14:46.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.055 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.055 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.056 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:14:46.056 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:14:46.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.056 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.056 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:46.056 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:14:46.056 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:14:46.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.056 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.056 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.056 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:14:46.056 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:14:46.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.056 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.057 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:46.057 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:14:46.057 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:14:46.057 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.057 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:46.057 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.057 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.057 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.057 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:46.057 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:46.057 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 48.660080659999998, 2024-04-26T11:14:46.057 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:14:46.057 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:46.057 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:46.058 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:46.058 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:46.058 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.058 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:14:46.058 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.058 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:46.058 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.058 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:46.058 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:46.058 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.058 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.058 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.058 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:46.058 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:46.058 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.059 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.059 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:46.059 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:14:46.059 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:46.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.059 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.059 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:46.059 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:14:46.059 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:14:46.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.059 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.059 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:46.059 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:14:46.059 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:14:46.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.060 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.060 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.060 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:14:46.060 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:14:46.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.060 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.060 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.060 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:14:46.060 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:14:46.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.060 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.060 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:46.060 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:14:46.060 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:14:46.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.061 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.061 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.061 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:14:46.061 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:14:46.061 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.061 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.061 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:46.061 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:14:46.061 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:14:46.061 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.061 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:46.061 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.061 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.061 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.061 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:46.062 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:46.062 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 48.660016358, 2024-04-26T11:14:46.062 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:14:46.062 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:46.062 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:46.062 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:46.062 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:46.062 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.062 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:14:46.062 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.062 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:46.062 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.062 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:46.062 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:46.062 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.063 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.063 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:46.063 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:46.063 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.063 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.063 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:46.063 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:46.063 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:46.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.063 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.063 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:46.063 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:14:46.063 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:14:46.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.064 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.064 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:46.064 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:14:46.064 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:14:46.064 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.064 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.064 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.064 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:14:46.064 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:14:46.064 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.064 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.064 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.064 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:14:46.064 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:14:46.065 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.065 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.065 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:46.065 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:14:46.065 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:14:46.065 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.065 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.065 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.065 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:14:46.065 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:14:46.065 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.065 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.065 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:46.066 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:14:46.066 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:14:46.066 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.066 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.066 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:46.066 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:14:46.066 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:14:46.066 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.066 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.066 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:46.066 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:14:46.066 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:14:46.066 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.066 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.067 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:46.067 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:14:46.067 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:14:46.067 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.067 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:46.067 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.067 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.067 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.067 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:46.067 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:46.067 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 48.659962133999997, 2024-04-26T11:14:46.067 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:14:46.067 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:46.067 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:46.068 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:46.068 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:46.068 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.068 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:14:46.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.068 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:46.068 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.068 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:46.068 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:46.068 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.068 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.068 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:46.068 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:46.068 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.069 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.069 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.069 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:46.069 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:46.069 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:46.069 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.069 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.069 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:46.069 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:14:46.069 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:14:46.069 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.069 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.069 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:46.069 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:14:46.069 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:14:46.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.070 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.070 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.070 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:14:46.070 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:14:46.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.070 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.070 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.070 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:14:46.070 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:14:46.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.070 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.070 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:46.070 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:14:46.071 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:14:46.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.071 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.071 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.071 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:14:46.071 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:14:46.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.071 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.071 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:46.071 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:14:46.071 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:14:46.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.071 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.071 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:46.071 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:14:46.072 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:14:46.072 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.072 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.072 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:46.072 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:14:46.072 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:46.072 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.072 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.072 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:46.072 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:14:46.072 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:14:46.072 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.072 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:46.072 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.072 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.073 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.073 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:46.073 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:46.073 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 48.659917622000002, 2024-04-26T11:14:46.073 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:14:46.073 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:46.073 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:46.073 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:46.073 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:46.073 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.073 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:14:46.073 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.073 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:46.073 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.074 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:46.074 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:46.074 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.074 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.074 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.074 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:46.074 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:46.074 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.074 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.074 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.074 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:46.074 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:14:46.074 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:46.074 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.074 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.075 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:46.075 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:14:46.075 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:14:46.075 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.075 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.075 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:46.075 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:14:46.075 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:14:46.075 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.075 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.075 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.075 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:14:46.075 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:14:46.075 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.075 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.076 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.076 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:14:46.076 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:14:46.076 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.076 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.076 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:46.076 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:14:46.076 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:14:46.076 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.076 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.076 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.076 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:14:46.076 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:14:46.076 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.076 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.076 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:46.077 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:14:46.077 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:14:46.077 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.077 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.077 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:46.077 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:14:46.077 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:14:46.077 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.077 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.077 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:46.077 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:14:46.077 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:14:46.077 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.077 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.078 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:46.078 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:14:46.078 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:14:46.078 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.078 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:46.078 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.078 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.078 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.078 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:46.078 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:46.078 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 48.655696620000001, 2024-04-26T11:14:46.078 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:14:46.078 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:46.079 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:46.079 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:46.079 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:46.079 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.079 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:14:46.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.079 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:46.079 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.079 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:46.079 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:46.079 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.079 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.080 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:46.080 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:46.080 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.080 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.080 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.080 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:46.080 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:14:46.080 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:14:46.080 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.080 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.080 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:46.080 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:14:46.080 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:14:46.080 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.080 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.081 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:46.081 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:14:46.081 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:14:46.081 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.081 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.081 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.081 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:14:46.081 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:14:46.081 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.081 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.081 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.081 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:14:46.081 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:14:46.081 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.081 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.082 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:46.082 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:14:46.082 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:14:46.082 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.082 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.082 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.082 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:14:46.082 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:14:46.082 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.082 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.082 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:46.082 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:14:46.082 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:14:46.082 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.082 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.083 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:46.083 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:14:46.083 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:14:46.083 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.083 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.083 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:46.083 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:14:46.083 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:14:46.083 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.083 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.083 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:46.083 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:14:46.083 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:14:46.083 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.083 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:46.084 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.084 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.084 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83360 5.2 5:42f8bfcd:::benchmark_data_smithi029_44842_object83359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:46.084 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:46.084 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 34.96845725, 2024-04-26T11:14:46.084 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022279782000000001, 2024-04-26T11:14:46.084 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:46.084 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:46.084 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:46.084 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:46.084 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.084 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83360 2024-04-26T11:14:46.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.084 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:46.085 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.085 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:46.085 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:46.085 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.085 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.085 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:46.085 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:46.085 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.085 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.085 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:46.085 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:46.085 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:46.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.085 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.086 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:46.086 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039700+0000", 2024-04-26T11:14:46.086 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5541000000000002e-05 2024-04-26T11:14:46.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.086 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.086 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:46.086 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039706+0000", 2024-04-26T11:14:46.086 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3680000000000001e-06 2024-04-26T11:14:46.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.086 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.086 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.086 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039709+0000", 2024-04-26T11:14:46.087 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4659999999999999e-06 2024-04-26T11:14:46.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.087 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.087 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.087 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056305+0000", 2024-04-26T11:14:46.087 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016595649000000001 2024-04-26T11:14:46.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.087 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.087 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:46.087 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056487+0000", 2024-04-26T11:14:46.087 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000181886 2024-04-26T11:14:46.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.087 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.087 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:46.087 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061809+0000", 2024-04-26T11:14:46.088 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053223259999999996 2024-04-26T11:14:46.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.088 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.088 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:46.088 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061852+0000", 2024-04-26T11:14:46.088 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2738999999999999e-05 2024-04-26T11:14:46.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.088 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.088 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:46.088 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061925+0000", 2024-04-26T11:14:46.088 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3180000000000001e-05 2024-04-26T11:14:46.088 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.088 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:46.088 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.089 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.089 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83364 5.2 5:42c5cd8c:::benchmark_data_smithi029_44842_object83363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:46.089 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:46.089 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 34.968041509999999, 2024-04-26T11:14:46.089 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022695336, 2024-04-26T11:14:46.089 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:46.089 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:46.089 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:46.089 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:46.089 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.089 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83364 2024-04-26T11:14:46.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.089 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:46.089 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.089 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:46.090 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:46.090 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.090 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.090 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:46.090 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:46.090 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.090 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.090 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:46.090 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040060+0000", 2024-04-26T11:14:46.090 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:46.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.090 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.091 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:46.091 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040086+0000", 2024-04-26T11:14:46.091 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5482000000000001e-05 2024-04-26T11:14:46.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.091 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.091 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:46.091 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040093+0000", 2024-04-26T11:14:46.091 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6409999999999996e-06 2024-04-26T11:14:46.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.091 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.091 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.091 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040098+0000", 2024-04-26T11:14:46.091 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879999999999996e-06 2024-04-26T11:14:46.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.091 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.092 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.092 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058292+0000", 2024-04-26T11:14:46.092 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018193504999999999 2024-04-26T11:14:46.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.092 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.092 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:46.092 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058412+0000", 2024-04-26T11:14:46.092 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011979199999999999 2024-04-26T11:14:46.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.092 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.092 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:46.092 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062642+0000", 2024-04-26T11:14:46.092 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042299449999999997 2024-04-26T11:14:46.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.092 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.093 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:46.093 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062688+0000", 2024-04-26T11:14:46.093 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6859e-05 2024-04-26T11:14:46.093 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.093 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.093 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:46.093 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062756+0000", 2024-04-26T11:14:46.093 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7995000000000002e-05 2024-04-26T11:14:46.093 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.093 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:46.093 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.093 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.093 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.094 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:129903 5.0 e40/16 5:00b2d390:::benchmark_data_smithi029_44842_object129902:head v 40'8238, mlcod=40'8234)", 2024-04-26T11:14:46.094 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:46.094 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 14.114292127000001, 2024-04-26T11:14:46.094 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.02228639, 2024-04-26T11:14:46.094 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:46.094 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:46.094 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:46.094 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.094 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:46.094 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:46.094 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.094 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.095 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:46.095 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:46.095 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.095 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.095 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:46.095 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:46.095 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:46.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.095 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.095 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:46.095 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893874+0000", 2024-04-26T11:14:46.095 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3849000000000005e-05 2024-04-26T11:14:46.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.096 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.096 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:46.096 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893884+0000", 2024-04-26T11:14:46.096 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0149000000000001e-05 2024-04-26T11:14:46.097 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.097 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.097 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.097 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893892+0000", 2024-04-26T11:14:46.097 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0299999999999994e-06 2024-04-26T11:14:46.097 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.097 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.098 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.098 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.894003+0000", 2024-04-26T11:14:46.098 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011128099999999999 2024-04-26T11:14:46.098 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.098 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.098 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:46.098 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.894024+0000", 2024-04-26T11:14:46.098 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0979e-05 2024-04-26T11:14:46.098 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.098 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.098 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:46.098 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.916077+0000", 2024-04-26T11:14:46.098 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022053461 2024-04-26T11:14:46.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.099 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.099 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:46.099 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.916097+0000", 2024-04-26T11:14:46.099 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9389999999999999e-05 2024-04-26T11:14:46.099 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.099 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:46.099 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.099 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.099 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:130959 5.7 5:ee32f7f7:::benchmark_data_smithi029_44842_object130958:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:46.099 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:32.375500+0000", 2024-04-26T11:14:46.099 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 13.632602855, 2024-04-26T11:14:46.099 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022235456000000001, 2024-04-26T11:14:46.100 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:46.100 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:46.100 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:46.100 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:46.100 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.100 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 130959 2024-04-26T11:14:46.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.100 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:46.100 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.100 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:46.100 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375500+0000", 2024-04-26T11:14:46.100 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.100 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.100 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:46.101 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375500+0000", 2024-04-26T11:14:46.101 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.101 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.101 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.101 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:46.101 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375499+0000", 2024-04-26T11:14:46.101 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:46.101 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.101 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.101 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:46.101 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375530+0000", 2024-04-26T11:14:46.101 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0556999999999999e-05 2024-04-26T11:14:46.101 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.101 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.101 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:46.102 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375537+0000", 2024-04-26T11:14:46.102 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7849999999999992e-06 2024-04-26T11:14:46.102 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.102 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.102 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.102 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375543+0000", 2024-04-26T11:14:46.102 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6060000000000002e-06 2024-04-26T11:14:46.102 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.102 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.102 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.102 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.377410+0000", 2024-04-26T11:14:46.102 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0018671149999999999 2024-04-26T11:14:46.102 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.102 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.103 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:46.103 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.377544+0000", 2024-04-26T11:14:46.103 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013380999999999999 2024-04-26T11:14:46.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.103 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.103 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:46.103 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397624+0000", 2024-04-26T11:14:46.103 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020079889 2024-04-26T11:14:46.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.103 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.103 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:46.103 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397662+0000", 2024-04-26T11:14:46.103 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8269999999999998e-05 2024-04-26T11:14:46.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.103 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.104 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:46.104 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397735+0000", 2024-04-26T11:14:46.104 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3017999999999998e-05 2024-04-26T11:14:46.104 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.104 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:46.104 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.104 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.104 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:130960 5.0 e40/16 5:042df53c:::benchmark_data_smithi029_44842_object130959:head v 40'8310, mlcod=40'8308)", 2024-04-26T11:14:46.104 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:32.375983+0000", 2024-04-26T11:14:46.104 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 13.632119944999999, 2024-04-26T11:14:46.104 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.021699000999999999, 2024-04-26T11:14:46.104 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:46.104 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:46.105 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:46.105 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.105 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:46.105 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375983+0000", 2024-04-26T11:14:46.105 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.105 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.105 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:46.105 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375983+0000", 2024-04-26T11:14:46.105 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.105 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.105 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:46.105 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375982+0000", 2024-04-26T11:14:46.105 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:46.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.106 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:46.106 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376039+0000", 2024-04-26T11:14:46.106 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7240000000000001e-05 2024-04-26T11:14:46.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.106 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:46.106 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376047+0000", 2024-04-26T11:14:46.106 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6699999999999994e-06 2024-04-26T11:14:46.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.106 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.106 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376053+0000", 2024-04-26T11:14:46.107 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:14:46.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.107 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.107 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.107 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376504+0000", 2024-04-26T11:14:46.107 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00045143100000000002 2024-04-26T11:14:46.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.107 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.107 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:46.107 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376521+0000", 2024-04-26T11:14:46.107 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6820000000000002e-05 2024-04-26T11:14:46.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.107 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.107 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:46.107 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397656+0000", 2024-04-26T11:14:46.108 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.021134824 2024-04-26T11:14:46.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.108 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.108 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:46.108 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397682+0000", 2024-04-26T11:14:46.108 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.597e-05 2024-04-26T11:14:46.108 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.108 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:46.108 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.108 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.108 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:130966 5.3 5:ce21bfb4:::benchmark_data_smithi029_44842_object130965:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:46.108 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:32.376761+0000", 2024-04-26T11:14:46.108 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 13.631341939, 2024-04-26T11:14:46.108 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.023879659000000001, 2024-04-26T11:14:46.109 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:46.109 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:46.109 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:46.109 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:46.109 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.109 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 130966 2024-04-26T11:14:46.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.109 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:46.109 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.109 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:46.109 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376761+0000", 2024-04-26T11:14:46.109 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.109 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.109 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:46.110 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376761+0000", 2024-04-26T11:14:46.110 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.110 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.110 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:46.110 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376760+0000", 2024-04-26T11:14:46.110 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:46.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.110 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.110 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:46.110 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376807+0000", 2024-04-26T11:14:46.110 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7089000000000003e-05 2024-04-26T11:14:46.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.110 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.111 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:46.111 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376817+0000", 2024-04-26T11:14:46.111 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.7329999999999998e-06 2024-04-26T11:14:46.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.111 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.111 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.111 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376824+0000", 2024-04-26T11:14:46.111 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6240000000000002e-06 2024-04-26T11:14:46.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.111 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.111 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.111 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378825+0000", 2024-04-26T11:14:46.111 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020004799999999998 2024-04-26T11:14:46.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.111 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.111 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:46.112 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378963+0000", 2024-04-26T11:14:46.112 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013860399999999999 2024-04-26T11:14:46.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.112 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.112 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:46.112 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.400519+0000", 2024-04-26T11:14:46.112 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.021555405 2024-04-26T11:14:46.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.112 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.112 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:46.112 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.400568+0000", 2024-04-26T11:14:46.112 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8989999999999997e-05 2024-04-26T11:14:46.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.112 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.112 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:46.113 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.400640+0000", 2024-04-26T11:14:46.113 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2556000000000001e-05 2024-04-26T11:14:46.113 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.113 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:46.113 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.113 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.113 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.113 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:130965 5.0 e40/16 5:02e1af30:::benchmark_data_smithi029_44842_object130964:head v 40'8311, mlcod=40'8308)", 2024-04-26T11:14:46.113 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:32.378228+0000", 2024-04-26T11:14:46.113 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 13.629874118, 2024-04-26T11:14:46.113 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.023551810999999999, 2024-04-26T11:14:46.113 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:46.113 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:46.113 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:46.114 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.114 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:46.114 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378228+0000", 2024-04-26T11:14:46.114 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.114 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.114 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:46.114 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378228+0000", 2024-04-26T11:14:46.114 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:46.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.114 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.114 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:46.114 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378228+0000", 2024-04-26T11:14:46.114 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:46.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.115 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:46.115 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378275+0000", 2024-04-26T11:14:46.115 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:14:46.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.115 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:46.115 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378284+0000", 2024-04-26T11:14:46.115 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3740000000000004e-06 2024-04-26T11:14:46.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.115 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.115 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378291+0000", 2024-04-26T11:14:46.115 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4359999999999999e-06 2024-04-26T11:14:46.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.116 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.116 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:46.116 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378322+0000", 2024-04-26T11:14:46.116 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1260000000000002e-05 2024-04-26T11:14:46.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.116 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.116 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:46.116 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378336+0000", 2024-04-26T11:14:46.116 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3937999999999999e-05 2024-04-26T11:14:46.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.116 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.116 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:46.116 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.401744+0000", 2024-04-26T11:14:46.116 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.023407715999999999 2024-04-26T11:14:46.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:46.117 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:46.117 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:46.117 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.401780+0000", 2024-04-26T11:14:46.117 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6433999999999997e-05 2024-04-26T11:14:46.117 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.117 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:46.117 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.117 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:46.117 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:46.117 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:46.119 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:46.119 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:46.116+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:46.219 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:46.217+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:46.285 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:46.285 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:46.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.285 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:163258 5.a 5:583dcfcc:::benchmark_data_smithi029_44842_object18620:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T11:14:46.285 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:46.279099+0000", 2024-04-26T11:14:46.285 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0040682009999999996, 2024-04-26T11:14:46.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040944179999999998, 2024-04-26T11:14:46.285 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:46.285 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:46.285 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:46.285 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:46.285 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.286 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 163258 2024-04-26T11:14:46.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.286 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:46.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:46.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279099+0000", 2024-04-26T11:14:46.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:46.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:46.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279099+0000", 2024-04-26T11:14:46.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:46.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:46.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279098+0000", 2024-04-26T11:14:46.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:46.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:46.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279101+0000", 2024-04-26T11:14:46.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8459999999999999e-06 2024-04-26T11:14:46.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:46.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279108+0000", 2024-04-26T11:14:46.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1760000000000004e-06 2024-04-26T11:14:46.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279112+0000", 2024-04-26T11:14:46.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0500000000000002e-06 2024-04-26T11:14:46.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:46.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.281025+0000", 2024-04-26T11:14:46.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0019122500000000001 2024-04-26T11:14:46.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:46.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.281147+0000", 2024-04-26T11:14:46.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012178 2024-04-26T11:14:46.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:46.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.281263+0000", 2024-04-26T11:14:46.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011681 2024-04-26T11:14:46.289 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.289 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:46.289 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.289 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:163260 5.0 5:03f29d4e:::benchmark_data_smithi029_44842_object18622:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T11:14:46.289 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:46.279752+0000", 2024-04-26T11:14:46.289 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0034156210000000002, 2024-04-26T11:14:46.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035468940000000001, 2024-04-26T11:14:46.289 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:46.289 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:46.290 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:46.290 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:46.290 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.290 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 163260 2024-04-26T11:14:46.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.290 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:46.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:46.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279752+0000", 2024-04-26T11:14:46.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:46.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:46.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279752+0000", 2024-04-26T11:14:46.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:46.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:46.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279751+0000", 2024-04-26T11:14:46.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:46.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:46.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279753+0000", 2024-04-26T11:14:46.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0439999999999998e-06 2024-04-26T11:14:46.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:46.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279759+0000", 2024-04-26T11:14:46.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5770000000000001e-06 2024-04-26T11:14:46.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279764+0000", 2024-04-26T11:14:46.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6709999999999998e-06 2024-04-26T11:14:46.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:46.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279804+0000", 2024-04-26T11:14:46.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0519000000000003e-05 2024-04-26T11:14:46.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:46.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279928+0000", 2024-04-26T11:14:46.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012437900000000001 2024-04-26T11:14:46.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:46.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.280041+0000", 2024-04-26T11:14:46.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011296800000000001 2024-04-26T11:14:46.293 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.293 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:46.293 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.293 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:163264 5.b 5:d5e6b33d:::benchmark_data_smithi029_44842_object18626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T11:14:46.294 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:46.279770+0000", 2024-04-26T11:14:46.294 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0033971600000000002, 2024-04-26T11:14:46.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036171559999999998, 2024-04-26T11:14:46.294 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:46.294 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:46.294 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:46.294 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:46.294 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.294 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 163264 2024-04-26T11:14:46.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.294 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:46.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:46.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279770+0000", 2024-04-26T11:14:46.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:46.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:46.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279770+0000", 2024-04-26T11:14:46.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:46.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:46.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279770+0000", 2024-04-26T11:14:46.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:46.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:46.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279772+0000", 2024-04-26T11:14:46.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0849999999999999e-06 2024-04-26T11:14:46.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:46.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279778+0000", 2024-04-26T11:14:46.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7699999999999998e-06 2024-04-26T11:14:46.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279782+0000", 2024-04-26T11:14:46.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3460000000000004e-06 2024-04-26T11:14:46.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:46.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279815+0000", 2024-04-26T11:14:46.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3398000000000001e-05 2024-04-26T11:14:46.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:46.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279932+0000", 2024-04-26T11:14:46.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011671900000000001 2024-04-26T11:14:46.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:46.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.280041+0000", 2024-04-26T11:14:46.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000109339 2024-04-26T11:14:46.297 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.297 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:46.298 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.298 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:163265 5.e 5:77fe1ae6:::benchmark_data_smithi029_44842_object18627:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T11:14:46.298 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:46.279789+0000", 2024-04-26T11:14:46.298 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0033778839999999998, 2024-04-26T11:14:46.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036859269999999999, 2024-04-26T11:14:46.298 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:46.298 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:46.298 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:46.298 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:46.298 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.299 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 163265 2024-04-26T11:14:46.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.299 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:46.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:46.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279789+0000", 2024-04-26T11:14:46.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:46.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:46.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279789+0000", 2024-04-26T11:14:46.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:46.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:46.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279789+0000", 2024-04-26T11:14:46.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:46.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:46.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279791+0000", 2024-04-26T11:14:46.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2029999999999999e-06 2024-04-26T11:14:46.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:46.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279797+0000", 2024-04-26T11:14:46.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9209999999999997e-06 2024-04-26T11:14:46.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279802+0000", 2024-04-26T11:14:46.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8219999999999997e-06 2024-04-26T11:14:46.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:46.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279840+0000", 2024-04-26T11:14:46.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8130000000000003e-05 2024-04-26T11:14:46.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:46.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279915+0000", 2024-04-26T11:14:46.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5179999999999995e-05 2024-04-26T11:14:46.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:46.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.280009+0000", 2024-04-26T11:14:46.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4133000000000002e-05 2024-04-26T11:14:46.303 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.303 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:46.303 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.304 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:163267 5.b 5:d71602d2:::benchmark_data_smithi029_44842_object18629:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T11:14:46.304 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:46.279918+0000", 2024-04-26T11:14:46.304 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0032489229999999999, 2024-04-26T11:14:46.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036026909999999999, 2024-04-26T11:14:46.304 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:46.304 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:46.304 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:46.304 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:46.304 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.304 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 163267 2024-04-26T11:14:46.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.304 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:46.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:46.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279918+0000", 2024-04-26T11:14:46.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:46.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:46.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279918+0000", 2024-04-26T11:14:46.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:46.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:46.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279918+0000", 2024-04-26T11:14:46.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:46.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:46.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279922+0000", 2024-04-26T11:14:46.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7319999999999998e-06 2024-04-26T11:14:46.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:46.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279931+0000", 2024-04-26T11:14:46.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5169999999999999e-06 2024-04-26T11:14:46.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279938+0000", 2024-04-26T11:14:46.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6969999999999996e-06 2024-04-26T11:14:46.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:46.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.281891+0000", 2024-04-26T11:14:46.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0019534700000000001 2024-04-26T11:14:46.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:46.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.281991+0000", 2024-04-26T11:14:46.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100117 2024-04-26T11:14:46.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:46.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.282228+0000", 2024-04-26T11:14:46.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000237345 2024-04-26T11:14:46.309 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.309 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:46.309 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.309 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:163268 5.8 5:1e2c6b42:::benchmark_data_smithi029_44842_object18630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T11:14:46.309 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:46.279947+0000", 2024-04-26T11:14:46.309 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0032204299999999998, 2024-04-26T11:14:46.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036155250000000001, 2024-04-26T11:14:46.309 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:46.309 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:46.309 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:46.309 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:46.310 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.310 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 163268 2024-04-26T11:14:46.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.310 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:46.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:46.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279947+0000", 2024-04-26T11:14:46.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:46.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:46.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279947+0000", 2024-04-26T11:14:46.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:46.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:46.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279946+0000", 2024-04-26T11:14:46.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:46.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:46.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279949+0000", 2024-04-26T11:14:46.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6589999999999999e-06 2024-04-26T11:14:46.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:46.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279955+0000", 2024-04-26T11:14:46.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.246e-06 2024-04-26T11:14:46.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.279960+0000", 2024-04-26T11:14:46.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1189999999999996e-06 2024-04-26T11:14:46.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:46.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.280152+0000", 2024-04-26T11:14:46.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00019208199999999999 2024-04-26T11:14:46.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:46.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.280284+0000", 2024-04-26T11:14:46.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013126199999999999 2024-04-26T11:14:46.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:46.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.280410+0000", 2024-04-26T11:14:46.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012650899999999999 2024-04-26T11:14:46.313 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.313 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:46.313 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.313 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(client.4534.0:163253 5.b e45/16)", 2024-04-26T11:14:46.313 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:46.280788+0000", 2024-04-26T11:14:46.313 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0023795740000000002, 2024-04-26T11:14:46.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0028133199999999998, 2024-04-26T11:14:46.313 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:46.314 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:46.314 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:46.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:46.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.280788+0000", 2024-04-26T11:14:46.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:46.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:46.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.280788+0000", 2024-04-26T11:14:46.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:46.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:46.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.280787+0000", 2024-04-26T11:14:46.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:46.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:46.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.280793+0000", 2024-04-26T11:14:46.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2559999999999999e-06 2024-04-26T11:14:46.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:46.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.280801+0000", 2024-04-26T11:14:46.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6879999999999999e-06 2024-04-26T11:14:46.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.280807+0000", 2024-04-26T11:14:46.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5400000000000001e-06 2024-04-26T11:14:46.316 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.316 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:46.316 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.316 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:163269 5.4 5:2b8d7503:::benchmark_data_smithi029_44842_object18631:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T11:14:46.316 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:46.282818+0000", 2024-04-26T11:14:46.316 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00034914499999999998, 2024-04-26T11:14:46.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00081304200000000004, 2024-04-26T11:14:46.316 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:46.317 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:46.317 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:46.317 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:46.317 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.317 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 163269 2024-04-26T11:14:46.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.317 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:46.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:46.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.282818+0000", 2024-04-26T11:14:46.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:46.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:46.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.282818+0000", 2024-04-26T11:14:46.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:46.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:46.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.282817+0000", 2024-04-26T11:14:46.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:46.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:46.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.282826+0000", 2024-04-26T11:14:46.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:14:46.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:46.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.282836+0000", 2024-04-26T11:14:46.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7880000000000001e-06 2024-04-26T11:14:46.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.282844+0000", 2024-04-26T11:14:46.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8529999999999992e-06 2024-04-26T11:14:46.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:46.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.282876+0000", 2024-04-26T11:14:46.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2048999999999998e-05 2024-04-26T11:14:46.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:46.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.282975+0000", 2024-04-26T11:14:46.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8981999999999995e-05 2024-04-26T11:14:46.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:46.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.283043+0000", 2024-04-26T11:14:46.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8361000000000005e-05 2024-04-26T11:14:46.320 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.320 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:46.320 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.321 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:163270 5.e 5:73219ab0:::benchmark_data_smithi029_44842_object18632:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T11:14:46.321 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:46.283063+0000", 2024-04-26T11:14:46.321 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.000103971, 2024-04-26T11:14:46.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00060803500000000004, 2024-04-26T11:14:46.321 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:46.321 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:46.321 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:46.321 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:46.321 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.321 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 163270 2024-04-26T11:14:46.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.321 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:46.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:46.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.283063+0000", 2024-04-26T11:14:46.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:46.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:46.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.283063+0000", 2024-04-26T11:14:46.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:46.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:46.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.283062+0000", 2024-04-26T11:14:46.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:46.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:46.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.283067+0000", 2024-04-26T11:14:46.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1239999999999998e-06 2024-04-26T11:14:46.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:46.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.283075+0000", 2024-04-26T11:14:46.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5599999999999994e-06 2024-04-26T11:14:46.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.283082+0000", 2024-04-26T11:14:46.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9709999999999998e-06 2024-04-26T11:14:46.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:46.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.283132+0000", 2024-04-26T11:14:46.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9895999999999998e-05 2024-04-26T11:14:46.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:46.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.283260+0000", 2024-04-26T11:14:46.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012768100000000001 2024-04-26T11:14:46.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:46.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.283381+0000", 2024-04-26T11:14:46.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000121291 2024-04-26T11:14:46.325 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.325 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:46.325 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.325 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:163271 5.9 5:911e1c59:::benchmark_data_smithi029_44842_object18633:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T11:14:46.325 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:46.283107+0000", 2024-04-26T11:14:46.325 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.9855000000000002e-05, 2024-04-26T11:14:46.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00060398899999999998, 2024-04-26T11:14:46.325 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:46.325 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:46.325 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:46.325 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:46.325 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.326 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 163271 2024-04-26T11:14:46.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.326 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:46.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:46.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.283107+0000", 2024-04-26T11:14:46.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:46.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:46.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.283107+0000", 2024-04-26T11:14:46.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:46.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:46.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.283107+0000", 2024-04-26T11:14:46.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:46.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:46.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.283111+0000", 2024-04-26T11:14:46.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9650000000000002e-06 2024-04-26T11:14:46.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:46.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.283119+0000", 2024-04-26T11:14:46.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7549999999999994e-06 2024-04-26T11:14:46.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.283125+0000", 2024-04-26T11:14:46.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0270000000000001e-06 2024-04-26T11:14:46.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:46.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.283233+0000", 2024-04-26T11:14:46.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010887600000000001 2024-04-26T11:14:46.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:46.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.283359+0000", 2024-04-26T11:14:46.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012570999999999999 2024-04-26T11:14:46.329 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.329 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:46.329 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.329 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:163272 5.8 5.54a183d8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T11:14:46.329 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:46.283134+0000", 2024-04-26T11:14:46.329 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.2975000000000002e-05, 2024-04-26T11:14:46.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000612508, 2024-04-26T11:14:46.330 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:46.330 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:46.330 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:46.330 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:46.330 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.330 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 163272 2024-04-26T11:14:46.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.330 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:46.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:46.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.283134+0000", 2024-04-26T11:14:46.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:46.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:46.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.283134+0000", 2024-04-26T11:14:46.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:46.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:46.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.283134+0000", 2024-04-26T11:14:46.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:46.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:46.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.283137+0000", 2024-04-26T11:14:46.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.881e-06 2024-04-26T11:14:46.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:46.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.283143+0000", 2024-04-26T11:14:46.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0650000000000004e-06 2024-04-26T11:14:46.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.283148+0000", 2024-04-26T11:14:46.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2800000000000003e-06 2024-04-26T11:14:46.332 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.332 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:46.332 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.333 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:163253 5.b 5:dfa474b2:::benchmark_data_smithi029_44842_object18615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T11:14:46.333 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:46.276385+0000", 2024-04-26T11:14:46.333 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0067821729999999998, 2024-04-26T11:14:46.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007393218, 2024-04-26T11:14:46.333 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:46.333 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:46.333 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:46.333 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:46.333 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:46.333 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 163253 2024-04-26T11:14:46.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.333 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:46.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:46.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.276385+0000", 2024-04-26T11:14:46.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:46.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:46.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.276385+0000", 2024-04-26T11:14:46.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:46.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:46.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.276385+0000", 2024-04-26T11:14:46.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:46.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:46.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.276388+0000", 2024-04-26T11:14:46.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0089999999999999e-06 2024-04-26T11:14:46.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:46.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.276393+0000", 2024-04-26T11:14:46.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6550000000000001e-06 2024-04-26T11:14:46.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:46.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.276397+0000", 2024-04-26T11:14:46.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.216e-06 2024-04-26T11:14:46.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:46.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.276428+0000", 2024-04-26T11:14:46.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0454999999999999e-05 2024-04-26T11:14:46.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:46.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.276530+0000", 2024-04-26T11:14:46.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010262100000000001 2024-04-26T11:14:46.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:46.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.276604+0000", 2024-04-26T11:14:46.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3175000000000003e-05 2024-04-26T11:14:46.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:46.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:46.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:46.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:46.278522+0000", 2024-04-26T11:14:46.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0019179310000000001 2024-04-26T11:14:46.337 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.337 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:46.337 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.337 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:46.337 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:14:46.338 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 12 2024-04-26T11:14:46.338 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:46.339 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:46.340 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:46.337+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:46.439 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:46.437+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:46.469 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:14:46.541 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:46.539+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:46.549 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:46.549 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:14:46.549 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:14:46.549 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:14:46.549 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:46.564 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:46.621 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:46.642 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:46.640+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:46.643 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:46.643 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:46.643 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:46.643 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:46.645 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:46.646 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:46.742 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:46.741+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:46.773 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:46.773 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:46.787 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:46.846 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:46.842+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:46.945 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:46.943+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:46.969 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:46.969 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:46.982 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:47.045 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:47.044+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:47.146 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:47.144+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:47.207 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:47.207 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:47.223 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:47.264 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:47.262+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:47.348 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:47.347+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:47.447 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:47.447 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:47.449 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:47.447+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:47.463 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:47.550 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:47.548+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:47.632 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:47.632 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:47.645 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:47.677 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:14:47.687 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:47.685+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:47.751 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:47.750+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:47.852 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:47.850+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:47.856 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:47.856 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:47.870 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:47.953 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:47.951+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:48.055 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:48.052+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:48.086 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:48.086 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:48.101 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:48.155 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:48.154+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:48.256 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:48.255+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:48.284 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:48.284 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:48.298 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:48.359 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:48.355+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:48.458 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:48.456+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:48.480 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:48.481 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:48.495 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:48.559 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:48.557+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:48.647 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:14:48.660 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:48.658+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:48.671 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:14:48.719 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:48.720 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:48.735 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:48.760 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:48.758+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:48.802 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:48.826 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:48.827 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:48.827 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:48.827 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:48.829 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:48.829 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:48.861 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:48.859+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:48.916 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:48.916 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:48.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.916 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:170343 5.4 5:2dbefcdf:::benchmark_data_smithi029_44842_object25705:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:48.916 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:48.909230+0000", 2024-04-26T11:14:48.916 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0048155940000000003, 2024-04-26T11:14:48.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048413650000000003, 2024-04-26T11:14:48.916 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:48.916 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:48.916 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:48.916 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:48.917 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:48.917 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 170343 2024-04-26T11:14:48.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.917 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:48.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:48.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.909230+0000", 2024-04-26T11:14:48.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:48.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:48.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.909230+0000", 2024-04-26T11:14:48.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:48.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:48.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.909230+0000", 2024-04-26T11:14:48.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:48.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:48.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.909233+0000", 2024-04-26T11:14:48.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9529999999999999e-06 2024-04-26T11:14:48.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:48.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.909239+0000", 2024-04-26T11:14:48.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1149999999999999e-06 2024-04-26T11:14:48.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:48.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.909244+0000", 2024-04-26T11:14:48.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3990000000000003e-06 2024-04-26T11:14:48.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:48.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.909382+0000", 2024-04-26T11:14:48.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013772400000000001 2024-04-26T11:14:48.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:48.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.909509+0000", 2024-04-26T11:14:48.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012696300000000001 2024-04-26T11:14:48.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:48.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.909629+0000", 2024-04-26T11:14:48.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011977900000000001 2024-04-26T11:14:48.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:48.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913243+0000", 2024-04-26T11:14:48.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003614183 2024-04-26T11:14:48.920 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:48.920 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:48.920 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:48.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.921 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:170347 5.8 5:15434755:::benchmark_data_smithi029_44842_object25709:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:48.921 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:48.910087+0000", 2024-04-26T11:14:48.921 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0039587570000000002, 2024-04-26T11:14:48.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004080223, 2024-04-26T11:14:48.921 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:48.921 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:48.921 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:48.921 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:48.921 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:48.921 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 170347 2024-04-26T11:14:48.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.921 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:48.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:48.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.910087+0000", 2024-04-26T11:14:48.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:48.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:48.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.910087+0000", 2024-04-26T11:14:48.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:48.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:48.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.910086+0000", 2024-04-26T11:14:48.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:48.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:48.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.910090+0000", 2024-04-26T11:14:48.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2189999999999998e-06 2024-04-26T11:14:48.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:48.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.910101+0000", 2024-04-26T11:14:48.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0152999999999999e-05 2024-04-26T11:14:48.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:48.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.910107+0000", 2024-04-26T11:14:48.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5529999999999998e-06 2024-04-26T11:14:48.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:48.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.910142+0000", 2024-04-26T11:14:48.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4765999999999999e-05 2024-04-26T11:14:48.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:48.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.910256+0000", 2024-04-26T11:14:48.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113773 2024-04-26T11:14:48.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:48.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.910363+0000", 2024-04-26T11:14:48.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010764600000000001 2024-04-26T11:14:48.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:48.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913010+0000", 2024-04-26T11:14:48.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026471289999999998 2024-04-26T11:14:48.925 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:48.925 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:48.925 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:48.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.926 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:170350 5.e 5:758cf19f:::benchmark_data_smithi029_44842_object25712:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:48.926 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:48.911536+0000", 2024-04-26T11:14:48.926 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0025092299999999999, 2024-04-26T11:14:48.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027150049999999999, 2024-04-26T11:14:48.926 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:48.926 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:48.926 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:48.926 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:48.926 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:48.926 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 170350 2024-04-26T11:14:48.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.926 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:48.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:48.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.911536+0000", 2024-04-26T11:14:48.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:48.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:48.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.911536+0000", 2024-04-26T11:14:48.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:48.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:48.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.911536+0000", 2024-04-26T11:14:48.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:48.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:48.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.911540+0000", 2024-04-26T11:14:48.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5800000000000002e-06 2024-04-26T11:14:48.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:48.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.911548+0000", 2024-04-26T11:14:48.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0350000000000001e-06 2024-04-26T11:14:48.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:48.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.911554+0000", 2024-04-26T11:14:48.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1150000000000002e-06 2024-04-26T11:14:48.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:48.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.911585+0000", 2024-04-26T11:14:48.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0985999999999998e-05 2024-04-26T11:14:48.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:48.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.911675+0000", 2024-04-26T11:14:48.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.0483999999999996e-05 2024-04-26T11:14:48.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:48.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.911742+0000", 2024-04-26T11:14:48.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7082000000000006e-05 2024-04-26T11:14:48.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:48.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913476+0000", 2024-04-26T11:14:48.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001734155 2024-04-26T11:14:48.930 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:48.930 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:48.930 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:48.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.930 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:170354 5.9 5:94842979:::benchmark_data_smithi029_44842_object25716:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:48.930 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:48.913298+0000", 2024-04-26T11:14:48.930 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00074779700000000002, 2024-04-26T11:14:48.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010433110000000001, 2024-04-26T11:14:48.931 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:48.931 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:48.931 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:48.931 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:48.931 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:48.931 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 170354 2024-04-26T11:14:48.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.931 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:48.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:48.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913298+0000", 2024-04-26T11:14:48.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:48.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:48.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913298+0000", 2024-04-26T11:14:48.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:48.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:48.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913297+0000", 2024-04-26T11:14:48.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:48.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:48.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913302+0000", 2024-04-26T11:14:48.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6029999999999998e-06 2024-04-26T11:14:48.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:48.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913311+0000", 2024-04-26T11:14:48.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7469999999999994e-06 2024-04-26T11:14:48.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:48.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913316+0000", 2024-04-26T11:14:48.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8710000000000002e-06 2024-04-26T11:14:48.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:48.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913354+0000", 2024-04-26T11:14:48.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7908999999999999e-05 2024-04-26T11:14:48.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:48.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913432+0000", 2024-04-26T11:14:48.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7434000000000004e-05 2024-04-26T11:14:48.934 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:48.934 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:48.934 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:48.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.934 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:170355 5.8 5:1a06fa52:::benchmark_data_smithi029_44842_object25717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:48.934 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:48.913331+0000", 2024-04-26T11:14:48.934 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00071437599999999997, 2024-04-26T11:14:48.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010797300000000001, 2024-04-26T11:14:48.934 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:48.934 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:48.935 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:48.935 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:48.935 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:48.935 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 170355 2024-04-26T11:14:48.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.935 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:48.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:48.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913331+0000", 2024-04-26T11:14:48.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:48.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:48.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913331+0000", 2024-04-26T11:14:48.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:48.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:48.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913331+0000", 2024-04-26T11:14:48.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:48.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:48.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913334+0000", 2024-04-26T11:14:48.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7630000000000001e-06 2024-04-26T11:14:48.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:48.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913340+0000", 2024-04-26T11:14:48.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4060000000000002e-06 2024-04-26T11:14:48.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:48.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913346+0000", 2024-04-26T11:14:48.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1979999999999998e-06 2024-04-26T11:14:48.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:48.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913372+0000", 2024-04-26T11:14:48.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5550000000000001e-05 2024-04-26T11:14:48.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:48.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913450+0000", 2024-04-26T11:14:48.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8135999999999999e-05 2024-04-26T11:14:48.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:48.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913518+0000", 2024-04-26T11:14:48.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8343000000000006e-05 2024-04-26T11:14:48.938 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:48.938 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:48.938 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:48.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.938 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:170356 5.4 5:2365b835:::benchmark_data_smithi029_44842_object25718:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:48.938 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:48.913964+0000", 2024-04-26T11:14:48.938 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 8.1335999999999995e-05, 2024-04-26T11:14:48.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00051893299999999996, 2024-04-26T11:14:48.939 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:48.939 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:48.939 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:48.939 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:48.939 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:48.939 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 170356 2024-04-26T11:14:48.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.939 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:48.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:48.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913964+0000", 2024-04-26T11:14:48.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:48.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:48.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913964+0000", 2024-04-26T11:14:48.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:48.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:48.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913964+0000", 2024-04-26T11:14:48.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:48.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:48.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913969+0000", 2024-04-26T11:14:48.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9609999999999996e-06 2024-04-26T11:14:48.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:48.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913979+0000", 2024-04-26T11:14:48.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0859999999999999e-05 2024-04-26T11:14:48.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:48.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.913985+0000", 2024-04-26T11:14:48.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1e-06 2024-04-26T11:14:48.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:48.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.914028+0000", 2024-04-26T11:14:48.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3010000000000003e-05 2024-04-26T11:14:48.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:48.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.914154+0000", 2024-04-26T11:14:48.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012530199999999999 2024-04-26T11:14:48.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:48.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.914271+0000", 2024-04-26T11:14:48.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117342 2024-04-26T11:14:48.943 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:48.943 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:48.943 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:48.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.943 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:170336 5.a 5:533c6fbc:::benchmark_data_smithi029_44842_object25698:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:48.943 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:48.907239+0000", 2024-04-26T11:14:48.943 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0068066619999999998, 2024-04-26T11:14:48.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0073192329999999996, 2024-04-26T11:14:48.943 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:48.943 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:48.943 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:48.943 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:48.944 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:48.944 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 170336 2024-04-26T11:14:48.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.944 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:48.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:48.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907239+0000", 2024-04-26T11:14:48.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:48.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:48.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907239+0000", 2024-04-26T11:14:48.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:48.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:48.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907239+0000", 2024-04-26T11:14:48.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967296 2024-04-26T11:14:48.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:48.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907240+0000", 2024-04-26T11:14:48.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5340000000000001e-06 2024-04-26T11:14:48.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:48.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907244+0000", 2024-04-26T11:14:48.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2200000000000001e-06 2024-04-26T11:14:48.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:48.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907246+0000", 2024-04-26T11:14:48.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7590000000000002e-06 2024-04-26T11:14:48.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:48.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907281+0000", 2024-04-26T11:14:48.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5125e-05 2024-04-26T11:14:48.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:48.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907370+0000", 2024-04-26T11:14:48.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8901999999999997e-05 2024-04-26T11:14:48.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:48.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907437+0000", 2024-04-26T11:14:48.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6495000000000006e-05 2024-04-26T11:14:48.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:48.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.909352+0000", 2024-04-26T11:14:48.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0019156189999999999 2024-04-26T11:14:48.947 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:48.948 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:48.948 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:48.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.948 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:170339 5.0 5:0212ff0b:::benchmark_data_smithi029_44842_object25701:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:48.948 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:48.907251+0000", 2024-04-26T11:14:48.948 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.006794469, 2024-04-26T11:14:48.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0073847679999999999, 2024-04-26T11:14:48.948 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:48.948 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:48.948 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:48.948 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:48.948 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:48.948 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 170339 2024-04-26T11:14:48.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.949 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:48.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:48.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907251+0000", 2024-04-26T11:14:48.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:48.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:48.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907251+0000", 2024-04-26T11:14:48.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:48.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:48.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907251+0000", 2024-04-26T11:14:48.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:48.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:48.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907253+0000", 2024-04-26T11:14:48.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0959999999999999e-06 2024-04-26T11:14:48.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:48.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907259+0000", 2024-04-26T11:14:48.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.229e-06 2024-04-26T11:14:48.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:48.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907265+0000", 2024-04-26T11:14:48.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4079999999999997e-06 2024-04-26T11:14:48.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:48.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907303+0000", 2024-04-26T11:14:48.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8720999999999997e-05 2024-04-26T11:14:48.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:48.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907418+0000", 2024-04-26T11:14:48.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011443 2024-04-26T11:14:48.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:48.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907525+0000", 2024-04-26T11:14:48.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107043 2024-04-26T11:14:48.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:48.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.909369+0000", 2024-04-26T11:14:48.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018441340000000001 2024-04-26T11:14:48.955 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:48.955 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:48.955 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:48.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.955 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:170340 5.4 5:2c745ff6:::benchmark_data_smithi029_44842_object25702:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:48.955 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:48.907271+0000", 2024-04-26T11:14:48.955 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0067744140000000003, 2024-04-26T11:14:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0074432860000000003, 2024-04-26T11:14:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 170340 2024-04-26T11:14:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907271+0000", 2024-04-26T11:14:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907271+0000", 2024-04-26T11:14:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907271+0000", 2024-04-26T11:14:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907273+0000", 2024-04-26T11:14:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4499999999999998e-06 2024-04-26T11:14:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907282+0000", 2024-04-26T11:14:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8240000000000006e-06 2024-04-26T11:14:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907287+0000", 2024-04-26T11:14:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0540000000000002e-06 2024-04-26T11:14:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907335+0000", 2024-04-26T11:14:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7481999999999997e-05 2024-04-26T11:14:48.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907468+0000", 2024-04-26T11:14:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013329800000000001 2024-04-26T11:14:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.907587+0000", 2024-04-26T11:14:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000118515 2024-04-26T11:14:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:48.911460+0000", 2024-04-26T11:14:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003873118 2024-04-26T11:14:48.959 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:48.960 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:48.960 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:48.960 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:48.960 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:14:48.960 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 9 2024-04-26T11:14:48.960 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:48.961 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:48.963 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:48.960+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:49.063 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:49.061+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:49.138 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:14:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:14:49.138 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:14:49.138 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:49.151 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:49.169 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:49.164+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:49.267 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:49.264+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:49.327 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:49.327 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:14:49.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:14:49.327 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:49.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.327 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:49.327 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:49.327 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.044100380000003, 2024-04-26T11:14:49.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:14:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:14:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:49.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:49.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:14:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:14:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:14:49.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:14:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:14:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:14:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:14:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:14:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:14:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:14:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:14:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:14:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:14:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:14:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:14:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:14:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:49.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:14:49.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:14:49.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:49.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:14:49.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:14:49.334 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.334 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:49.334 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.335 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:49.335 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:49.336 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.043450677999999, 2024-04-26T11:14:49.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:14:49.336 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:49.336 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:49.336 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:49.337 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:49.337 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.337 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:14:49.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.337 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:49.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:49.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:49.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:49.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:49.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:49.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:14:49.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:49.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:49.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:14:49.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:14:49.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:49.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:14:49.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:14:49.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:14:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:14:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:14:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:14:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:14:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:14:49.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:14:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:14:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:14:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:14:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:14:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:14:49.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:14:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:14:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:14:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:14:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.344 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.976808638999998, 2024-04-26T11:14:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:14:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:14:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:49.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:14:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:14:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:14:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:14:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:14:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:14:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:14:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:14:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:14:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:14:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:14:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:14:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:14:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:14:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:14:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.976712993, 2024-04-26T11:14:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:14:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:14:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:14:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:14:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:14:49.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:14:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:14:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:14:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:14:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:14:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:14:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:14:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:14:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:14:49.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:14:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:14:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:14:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.976581314000001, 2024-04-26T11:14:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:14:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:14:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:14:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:14:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:14:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:14:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:14:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:14:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:14:49.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:14:49.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:49.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:14:49.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:14:49.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:14:49.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:14:49.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:49.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:14:49.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:14:49.363 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.363 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:49.363 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.364 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:49.364 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:49.364 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.976472858000001, 2024-04-26T11:14:49.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:14:49.364 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:49.364 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:49.365 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:49.365 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:49.365 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.365 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:14:49.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.365 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:49.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:49.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:49.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:49.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:49.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:14:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:14:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:14:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:49.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:14:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:14:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:14:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:14:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:14:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:14:49.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:14:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:14:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:14:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:14:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:49.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:14:49.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:14:49.370 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.370 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:49.370 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.370 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:49.370 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:49.370 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.976371589999999, 2024-04-26T11:14:49.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:14:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:14:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:49.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:14:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:14:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:14:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:14:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:14:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:14:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:14:49.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:14:49.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:49.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:14:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:14:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:14:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:14:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:14:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:14:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:14:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:14:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:14:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:14:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:14:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:14:49.376 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.976302648999997, 2024-04-26T11:14:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:14:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:14:49.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:49.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:14:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:14:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:14:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:14:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:14:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:14:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:14:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:14:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:14:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:14:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:14:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:14:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:14:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:14:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:14:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:14:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:14:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:49.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:14:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:14:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:14:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:14:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:49.382 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.970307067999997, 2024-04-26T11:14:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:14:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:14:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:14:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:49.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:14:49.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:14:49.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:49.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:14:49.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:14:49.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:14:49.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:14:49.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:14:49.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:14:49.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:49.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:14:49.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:14:49.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:14:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:14:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:14:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:14:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:14:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:14:49.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:14:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:14:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:14:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:14:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:49.389 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.390 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:81256 5.8 5:1c0f3fd8:::benchmark_data_smithi029_44842_object81255:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:49.390 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:49.390 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 39.206847519, 2024-04-26T11:14:49.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026193673000000001, 2024-04-26T11:14:49.390 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:49.390 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:49.390 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:49.390 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:49.390 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 81256 2024-04-26T11:14:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:49.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116043+0000", 2024-04-26T11:14:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116073+0000", 2024-04-26T11:14:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0114e-05 2024-04-26T11:14:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116079+0000", 2024-04-26T11:14:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8939999999999998e-06 2024-04-26T11:14:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.116082+0000", 2024-04-26T11:14:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7759999999999999e-06 2024-04-26T11:14:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127501+0000", 2024-04-26T11:14:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.011418281000000001 2024-04-26T11:14:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127639+0000", 2024-04-26T11:14:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013828899999999999 2024-04-26T11:14:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.127782+0000", 2024-04-26T11:14:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014328299999999999 2024-04-26T11:14:49.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.134767+0000", 2024-04-26T11:14:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0069844140000000004 2024-04-26T11:14:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142160+0000", 2024-04-26T11:14:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.007392839 2024-04-26T11:14:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:49.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142202+0000", 2024-04-26T11:14:49.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2797999999999999e-05 2024-04-26T11:14:49.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:49.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:10.142237+0000", 2024-04-26T11:14:49.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4464000000000001e-05 2024-04-26T11:14:49.396 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.396 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101754 5.e 5:7ca15a5c:::benchmark_data_smithi029_44842_object101753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.204359325999999, 2024-04-26T11:14:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039171048999999999, 2024-04-26T11:14:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:49.397 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.398 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101754 2024-04-26T11:14:49.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.398 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:49.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:49.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:49.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:49.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:49.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:49.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:49.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:49.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118604+0000", 2024-04-26T11:14:49.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3399000000000007e-05 2024-04-26T11:14:49.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:49.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118613+0000", 2024-04-26T11:14:49.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6989999999999992e-06 2024-04-26T11:14:49.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.402 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118618+0000", 2024-04-26T11:14:49.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3850000000000001e-06 2024-04-26T11:14:49.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.402 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118646+0000", 2024-04-26T11:14:49.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7878e-05 2024-04-26T11:14:49.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:49.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118720+0000", 2024-04-26T11:14:49.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3461999999999996e-05 2024-04-26T11:14:49.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:49.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118807+0000", 2024-04-26T11:14:49.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7269999999999996e-05 2024-04-26T11:14:49.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:49.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142317+0000", 2024-04-26T11:14:49.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023510105999999999 2024-04-26T11:14:49.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:49.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.143287+0000", 2024-04-26T11:14:49.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096983599999999996 2024-04-26T11:14:49.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:49.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157662+0000", 2024-04-26T11:14:49.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014375393 2024-04-26T11:14:49.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:49.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157702+0000", 2024-04-26T11:14:49.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0295e-05 2024-04-26T11:14:49.405 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.405 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:49.405 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.405 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101755 5.f 5:fa973a83:::benchmark_data_smithi029_44842_object101754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:49.405 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:49.405 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.204193629999999, 2024-04-26T11:14:49.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039139064000000001, 2024-04-26T11:14:49.405 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:49.406 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:49.406 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:49.406 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:49.406 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.406 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101755 2024-04-26T11:14:49.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.406 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:49.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.406 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:49.406 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:49.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.407 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:49.407 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:49.407 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.407 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:49.407 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118696+0000", 2024-04-26T11:14:49.407 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.407 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:49.407 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118766+0000", 2024-04-26T11:14:49.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9423000000000003e-05 2024-04-26T11:14:49.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:49.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118774+0000", 2024-04-26T11:14:49.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9710000000000004e-06 2024-04-26T11:14:49.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118779+0000", 2024-04-26T11:14:49.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5629999999999999e-06 2024-04-26T11:14:49.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118817+0000", 2024-04-26T11:14:49.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7771000000000001e-05 2024-04-26T11:14:49.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:49.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118929+0000", 2024-04-26T11:14:49.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011222699999999999 2024-04-26T11:14:49.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:49.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157661+0000", 2024-04-26T11:14:49.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038731120000000001 2024-04-26T11:14:49.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:49.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157757+0000", 2024-04-26T11:14:49.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6910000000000006e-05 2024-04-26T11:14:49.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:49.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157836+0000", 2024-04-26T11:14:49.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8727999999999996e-05 2024-04-26T11:14:49.410 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.410 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:49.410 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.410 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101758 5.4 5:2525a4eb:::benchmark_data_smithi029_44842_object101757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:49.411 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:49.411 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.202010778999998, 2024-04-26T11:14:49.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.03686739, 2024-04-26T11:14:49.411 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:49.411 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:49.411 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:49.411 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:49.411 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.411 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101758 2024-04-26T11:14:49.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.411 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:49.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.412 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:49.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:49.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.412 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:49.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:49.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:49.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120879+0000", 2024-04-26T11:14:49.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:49.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120971+0000", 2024-04-26T11:14:49.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2133999999999996e-05 2024-04-26T11:14:49.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120977+0000", 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5509999999999999e-06 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120981+0000", 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.245e-06 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121010+0000", 2024-04-26T11:14:49.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9084000000000001e-05 2024-04-26T11:14:49.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:49.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121083+0000", 2024-04-26T11:14:49.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2942999999999996e-05 2024-04-26T11:14:49.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:49.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121163+0000", 2024-04-26T11:14:49.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0197000000000005e-05 2024-04-26T11:14:49.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:49.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142822+0000", 2024-04-26T11:14:49.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021658535999999999 2024-04-26T11:14:49.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:49.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157674+0000", 2024-04-26T11:14:49.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014851573999999999 2024-04-26T11:14:49.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:49.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157714+0000", 2024-04-26T11:14:49.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0473999999999999e-05 2024-04-26T11:14:49.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:49.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157747+0000", 2024-04-26T11:14:49.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3278999999999998e-05 2024-04-26T11:14:49.418 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.418 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:49.418 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.418 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101760 5.4 5:2510211a:::benchmark_data_smithi029_44842_object101759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:49.418 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:49.418 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.201578434000002, 2024-04-26T11:14:49.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039182383000000001, 2024-04-26T11:14:49.419 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:49.419 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:49.419 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:49.419 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:49.419 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.419 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101760 2024-04-26T11:14:49.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.419 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:49.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:49.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:49.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:49.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:49.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:49.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:49.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:49.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121389+0000", 2024-04-26T11:14:49.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6667000000000003e-05 2024-04-26T11:14:49.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:49.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121394+0000", 2024-04-26T11:14:49.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0839999999999999e-06 2024-04-26T11:14:49.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121397+0000", 2024-04-26T11:14:49.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4489999999999999e-06 2024-04-26T11:14:49.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122921+0000", 2024-04-26T11:14:49.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001524067 2024-04-26T11:14:49.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:49.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.123010+0000", 2024-04-26T11:14:49.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8449000000000006e-05 2024-04-26T11:14:49.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:49.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140838+0000", 2024-04-26T11:14:49.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017828796000000001 2024-04-26T11:14:49.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:49.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157665+0000", 2024-04-26T11:14:49.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016826574 2024-04-26T11:14:49.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:49.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160407+0000", 2024-04-26T11:14:49.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027423970000000002 2024-04-26T11:14:49.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:49.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160456+0000", 2024-04-26T11:14:49.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8678999999999999e-05 2024-04-26T11:14:49.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:49.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160495+0000", 2024-04-26T11:14:49.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8658000000000002e-05 2024-04-26T11:14:49.424 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.424 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:49.424 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.424 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101761 5.e 5:70294421:::benchmark_data_smithi029_44842_object101760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:49.424 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:49.424 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.200154060999999, 2024-04-26T11:14:49.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035270448000000003, 2024-04-26T11:14:49.425 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:49.425 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:49.425 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:49.425 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:49.425 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.425 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101761 2024-04-26T11:14:49.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.425 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:49.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:49.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:49.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:49.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:49.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:49.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122736+0000", 2024-04-26T11:14:49.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:49.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122805+0000", 2024-04-26T11:14:49.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9076000000000001e-05 2024-04-26T11:14:49.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:49.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122811+0000", 2024-04-26T11:14:49.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:14:49.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122815+0000", 2024-04-26T11:14:49.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2860000000000001e-06 2024-04-26T11:14:49.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122842+0000", 2024-04-26T11:14:49.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6429000000000001e-05 2024-04-26T11:14:49.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:49.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122916+0000", 2024-04-26T11:14:49.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4122999999999995e-05 2024-04-26T11:14:49.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:49.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122997+0000", 2024-04-26T11:14:49.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1428999999999996e-05 2024-04-26T11:14:49.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:49.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142344+0000", 2024-04-26T11:14:49.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019346452 2024-04-26T11:14:49.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:49.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157934+0000", 2024-04-26T11:14:49.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015589911999999999 2024-04-26T11:14:49.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:49.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157975+0000", 2024-04-26T11:14:49.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1604999999999999e-05 2024-04-26T11:14:49.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:49.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.158007+0000", 2024-04-26T11:14:49.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1921000000000002e-05 2024-04-26T11:14:49.431 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.431 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:49.431 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.431 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110145 5.9 5:9b275f16:::benchmark_data_smithi029_44842_object110144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:49.431 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:49.431 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.174592423, 2024-04-26T11:14:49.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032844496000000001, 2024-04-26T11:14:49.431 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:49.431 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:49.431 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:49.432 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:49.432 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.432 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110145 2024-04-26T11:14:49.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.432 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:49.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:49.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:49.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:49.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:49.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:49.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148297+0000", 2024-04-26T11:14:49.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:49.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:49.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148325+0000", 2024-04-26T11:14:49.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7511000000000001e-05 2024-04-26T11:14:49.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:49.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148338+0000", 2024-04-26T11:14:49.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2808e-05 2024-04-26T11:14:49.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148345+0000", 2024-04-26T11:14:49.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7200000000000006e-06 2024-04-26T11:14:49.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149888+0000", 2024-04-26T11:14:49.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001542666 2024-04-26T11:14:49.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:49.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149977+0000", 2024-04-26T11:14:49.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9247999999999997e-05 2024-04-26T11:14:49.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:49.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181006+0000", 2024-04-26T11:14:49.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031028535999999999 2024-04-26T11:14:49.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:49.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181051+0000", 2024-04-26T11:14:49.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5393999999999999e-05 2024-04-26T11:14:49.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:49.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181143+0000", 2024-04-26T11:14:49.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1458000000000004e-05 2024-04-26T11:14:49.436 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.436 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:49.436 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.437 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110155 5.9 5:9ebc6158:::benchmark_data_smithi029_44842_object110154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:49.437 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:49.437 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.169516631, 2024-04-26T11:14:49.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027886826999999999, 2024-04-26T11:14:49.437 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:49.437 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:49.437 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:49.437 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:49.437 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.437 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110155 2024-04-26T11:14:49.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.437 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:49.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:49.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:49.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:49.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:49.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:49.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153373+0000", 2024-04-26T11:14:49.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:49.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153479+0000", 2024-04-26T11:14:49.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105728 2024-04-26T11:14:49.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:49.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153491+0000", 2024-04-26T11:14:49.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2207e-05 2024-04-26T11:14:49.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153499+0000", 2024-04-26T11:14:49.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7729999999999999e-06 2024-04-26T11:14:49.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153655+0000", 2024-04-26T11:14:49.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015573 2024-04-26T11:14:49.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:49.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153770+0000", 2024-04-26T11:14:49.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011562500000000001 2024-04-26T11:14:49.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:49.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181153+0000", 2024-04-26T11:14:49.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027382113 2024-04-26T11:14:49.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:49.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181195+0000", 2024-04-26T11:14:49.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1921000000000001e-05 2024-04-26T11:14:49.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:49.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181261+0000", 2024-04-26T11:14:49.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6402999999999994e-05 2024-04-26T11:14:49.441 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.441 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:49.441 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.441 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:129903 5.0 5:00b2d390:::benchmark_data_smithi029_44842_object129902:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:49.442 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:31.889868+0000", 2024-04-26T11:14:49.442 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.433022230999999, 2024-04-26T11:14:49.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.026543418999999999, 2024-04-26T11:14:49.442 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:49.442 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:49.442 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:49.442 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:49.442 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.442 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 129903 2024-04-26T11:14:49.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.442 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:49.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:49.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889868+0000", 2024-04-26T11:14:49.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:49.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889868+0000", 2024-04-26T11:14:49.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:49.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889868+0000", 2024-04-26T11:14:49.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:49.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889936+0000", 2024-04-26T11:14:49.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7655000000000002e-05 2024-04-26T11:14:49.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:49.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889943+0000", 2024-04-26T11:14:49.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7319999999999998e-06 2024-04-26T11:14:49.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.889948+0000", 2024-04-26T11:14:49.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5909999999999998e-06 2024-04-26T11:14:49.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.893510+0000", 2024-04-26T11:14:49.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035624540000000001 2024-04-26T11:14:49.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:49.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.893637+0000", 2024-04-26T11:14:49.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000126604 2024-04-26T11:14:49.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:49.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.893784+0000", 2024-04-26T11:14:49.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014726299999999999 2024-04-26T11:14:49.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:49.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.903173+0000", 2024-04-26T11:14:49.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0093891370000000005 2024-04-26T11:14:49.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:49.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.916373+0000", 2024-04-26T11:14:49.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.013199407999999999 2024-04-26T11:14:49.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:49.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.916395+0000", 2024-04-26T11:14:49.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2447e-05 2024-04-26T11:14:49.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:49.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:31.916412+0000", 2024-04-26T11:14:49.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6688e-05 2024-04-26T11:14:49.447 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.447 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:49.447 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.447 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:130965 5.0 5:02e1af30:::benchmark_data_smithi029_44842_object130964:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:49.447 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:32.376041+0000", 2024-04-26T11:14:49.447 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.946849997000001, 2024-04-26T11:14:49.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027463617999999999, 2024-04-26T11:14:49.447 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:49.447 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:49.447 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:49.447 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:49.448 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.448 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 130965 2024-04-26T11:14:49.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.448 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:49.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:49.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376041+0000", 2024-04-26T11:14:49.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:49.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376041+0000", 2024-04-26T11:14:49.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:49.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376040+0000", 2024-04-26T11:14:49.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:49.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376126+0000", 2024-04-26T11:14:49.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6070999999999996e-05 2024-04-26T11:14:49.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:49.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376133+0000", 2024-04-26T11:14:49.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7739999999999999e-06 2024-04-26T11:14:49.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.376137+0000", 2024-04-26T11:14:49.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3669999999999999e-06 2024-04-26T11:14:49.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.378033+0000", 2024-04-26T11:14:49.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001895484 2024-04-26T11:14:49.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:49.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.378108+0000", 2024-04-26T11:14:49.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5201e-05 2024-04-26T11:14:49.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:49.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.378200+0000", 2024-04-26T11:14:49.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1712999999999994e-05 2024-04-26T11:14:49.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:49.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.381666+0000", 2024-04-26T11:14:49.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003466701 2024-04-26T11:14:49.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:49.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.403451+0000", 2024-04-26T11:14:49.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021784583 2024-04-26T11:14:49.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:49.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.403484+0000", 2024-04-26T11:14:49.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3265000000000001e-05 2024-04-26T11:14:49.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:49.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:32.403504+0000", 2024-04-26T11:14:49.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0123999999999999e-05 2024-04-26T11:14:49.453 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.453 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:49.453 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.453 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:143341 5.e 5:726d70d0:::benchmark_data_smithi029_44842_object143340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T11:14:49.454 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:37.815337+0000", 2024-04-26T11:14:49.454 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 11.507554159, 2024-04-26T11:14:49.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.02673615, 2024-04-26T11:14:49.454 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:49.454 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:49.454 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:49.454 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:49.454 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.454 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 143341 2024-04-26T11:14:49.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.454 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:49.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:49.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.815337+0000", 2024-04-26T11:14:49.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:49.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.815337+0000", 2024-04-26T11:14:49.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:49.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:49.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.815336+0000", 2024-04-26T11:14:49.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:49.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.815404+0000", 2024-04-26T11:14:49.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8003999999999995e-05 2024-04-26T11:14:49.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:49.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.815414+0000", 2024-04-26T11:14:49.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0302999999999999e-05 2024-04-26T11:14:49.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.815421+0000", 2024-04-26T11:14:49.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4919999999999998e-06 2024-04-26T11:14:49.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:49.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.821786+0000", 2024-04-26T11:14:49.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.006365094 2024-04-26T11:14:49.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:49.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.821895+0000", 2024-04-26T11:14:49.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108856 2024-04-26T11:14:49.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:49.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.822026+0000", 2024-04-26T11:14:49.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013116500000000001 2024-04-26T11:14:49.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:49.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.827684+0000", 2024-04-26T11:14:49.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0056578619999999996 2024-04-26T11:14:49.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:49.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.842007+0000", 2024-04-26T11:14:49.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014323259 2024-04-26T11:14:49.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:49.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.842049+0000", 2024-04-26T11:14:49.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2345000000000002e-05 2024-04-26T11:14:49.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:49.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:49.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:49.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:37.842073+0000", 2024-04-26T11:14:49.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3481000000000001e-05 2024-04-26T11:14:49.460 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.460 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:49.460 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.460 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:49.460 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:49.460 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:49.462 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:49.459+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:49.462 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:49.562 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:49.560+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:49.655 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:49.656 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:49.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.656 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:172417 5.4 e46/16 5:2e0a8c65:::benchmark_data_smithi029_44842_object27779:head v 46'10687, mlcod=46'10685)", 2024-04-26T11:14:49.656 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:49.651567+0000", 2024-04-26T11:14:49.656 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.002381162, 2024-04-26T11:14:49.656 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0024009909999999999, 2024-04-26T11:14:49.656 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:49.656 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:49.656 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:49.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.656 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:49.656 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651567+0000", 2024-04-26T11:14:49.657 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.657 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:49.657 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651567+0000", 2024-04-26T11:14:49.657 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.657 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:49.657 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651567+0000", 2024-04-26T11:14:49.657 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.657 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:49.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651572+0000", 2024-04-26T11:14:49.658 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2979999999999999e-06 2024-04-26T11:14:49.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.658 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:49.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651580+0000", 2024-04-26T11:14:49.658 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8439999999999998e-06 2024-04-26T11:14:49.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.658 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651586+0000", 2024-04-26T11:14:49.658 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6969999999999998e-06 2024-04-26T11:14:49.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.658 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:49.659 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.652936+0000", 2024-04-26T11:14:49.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001350022 2024-04-26T11:14:49.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.659 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:49.659 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.652955+0000", 2024-04-26T11:14:49.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9434999999999999e-05 2024-04-26T11:14:49.659 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.659 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:49.659 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.659 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:172420 5.b e46/16 5:df3ccfc8:::benchmark_data_smithi029_44842_object27782:head v 46'10971, mlcod=46'10969)", 2024-04-26T11:14:49.659 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:49.651595+0000", 2024-04-26T11:14:49.660 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0023538669999999999, 2024-04-26T11:14:49.660 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0024135950000000002, 2024-04-26T11:14:49.660 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:49.660 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:49.660 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:49.660 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.660 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:49.660 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651595+0000", 2024-04-26T11:14:49.660 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.660 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.660 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:49.660 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651595+0000", 2024-04-26T11:14:49.660 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.661 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.661 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:49.661 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651594+0000", 2024-04-26T11:14:49.661 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.661 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.661 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:49.661 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651597+0000", 2024-04-26T11:14:49.661 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1410000000000001e-06 2024-04-26T11:14:49.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.661 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.661 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:49.661 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651603+0000", 2024-04-26T11:14:49.661 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4539999999999998e-06 2024-04-26T11:14:49.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.662 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.662 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651607+0000", 2024-04-26T11:14:49.662 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9650000000000002e-06 2024-04-26T11:14:49.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.662 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:49.662 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.652693+0000", 2024-04-26T11:14:49.662 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001086364 2024-04-26T11:14:49.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.662 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:49.662 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.652712+0000", 2024-04-26T11:14:49.662 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.84e-05 2024-04-26T11:14:49.662 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.663 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:49.663 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.663 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:172424 5.8 e46/16 5:1a0b3ae3:::benchmark_data_smithi029_44842_object27786:head v 46'10794, mlcod=46'10792)", 2024-04-26T11:14:49.663 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:49.652891+0000", 2024-04-26T11:14:49.663 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0010576909999999999, 2024-04-26T11:14:49.663 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0011537609999999999, 2024-04-26T11:14:49.663 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:49.663 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:49.663 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:49.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.663 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:49.663 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.652891+0000", 2024-04-26T11:14:49.663 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.664 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:49.664 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.652891+0000", 2024-04-26T11:14:49.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.664 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:49.664 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.652890+0000", 2024-04-26T11:14:49.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.664 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:49.664 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.652896+0000", 2024-04-26T11:14:49.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0499999999999997e-06 2024-04-26T11:14:49.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.665 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:49.665 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.652909+0000", 2024-04-26T11:14:49.665 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3044000000000001e-05 2024-04-26T11:14:49.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.665 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.665 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.652921+0000", 2024-04-26T11:14:49.665 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1976e-05 2024-04-26T11:14:49.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.665 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:49.665 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.652961+0000", 2024-04-26T11:14:49.666 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9932999999999999e-05 2024-04-26T11:14:49.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.666 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.666 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:49.666 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.652974+0000", 2024-04-26T11:14:49.666 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3361e-05 2024-04-26T11:14:49.666 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.666 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:49.666 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.666 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.666 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:172421 5.b e46/16)", 2024-04-26T11:14:49.666 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:49.653094+0000", 2024-04-26T11:14:49.666 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00085402199999999996, 2024-04-26T11:14:49.666 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00098090299999999998, 2024-04-26T11:14:49.667 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:49.667 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:49.667 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:49.667 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.667 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:49.667 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653094+0000", 2024-04-26T11:14:49.667 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.667 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.667 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:49.667 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653094+0000", 2024-04-26T11:14:49.667 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.667 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.668 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:49.668 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653094+0000", 2024-04-26T11:14:49.668 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.668 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:49.668 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653099+0000", 2024-04-26T11:14:49.668 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1630000000000004e-06 2024-04-26T11:14:49.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.668 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:49.668 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653107+0000", 2024-04-26T11:14:49.668 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7640000000000005e-06 2024-04-26T11:14:49.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653112+0000", 2024-04-26T11:14:49.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4949999999999999e-06 2024-04-26T11:14:49.669 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.669 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:49.669 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.669 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:172425 5.7 5:e26d77d1:::benchmark_data_smithi029_44842_object27787:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:49.669 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:49.653351+0000", 2024-04-26T11:14:49.670 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00059751699999999999, 2024-04-26T11:14:49.670 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00075439799999999998, 2024-04-26T11:14:49.670 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:49.670 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:49.670 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:49.670 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:49.670 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.670 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 172425 2024-04-26T11:14:49.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.670 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:49.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.671 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:49.671 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653351+0000", 2024-04-26T11:14:49.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.671 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:49.671 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653351+0000", 2024-04-26T11:14:49.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.671 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:49.671 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653350+0000", 2024-04-26T11:14:49.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:49.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:49.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653356+0000", 2024-04-26T11:14:49.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7339999999999996e-06 2024-04-26T11:14:49.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:49.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653366+0000", 2024-04-26T11:14:49.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0643e-05 2024-04-26T11:14:49.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653374+0000", 2024-04-26T11:14:49.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9789999999999993e-06 2024-04-26T11:14:49.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:49.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653413+0000", 2024-04-26T11:14:49.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.879e-05 2024-04-26T11:14:49.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.674 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:49.674 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653542+0000", 2024-04-26T11:14:49.674 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012933000000000001 2024-04-26T11:14:49.674 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.674 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:49.674 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.674 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:172426 5.1 5:84f9575f:::benchmark_data_smithi029_44842_object27788:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:49.674 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:49.653386+0000", 2024-04-26T11:14:49.674 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00056275599999999998, 2024-04-26T11:14:49.674 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00075982299999999997, 2024-04-26T11:14:49.675 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:49.675 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:49.675 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:49.675 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:49.675 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.675 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 172426 2024-04-26T11:14:49.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.675 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:49.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.675 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:49.675 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653386+0000", 2024-04-26T11:14:49.675 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.676 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:49.676 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653386+0000", 2024-04-26T11:14:49.676 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.676 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:49.676 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653385+0000", 2024-04-26T11:14:49.676 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.677 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:49.677 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653388+0000", 2024-04-26T11:14:49.677 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9500000000000001e-06 2024-04-26T11:14:49.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.677 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:49.677 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653395+0000", 2024-04-26T11:14:49.677 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3309999999999998e-06 2024-04-26T11:14:49.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.677 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653401+0000", 2024-04-26T11:14:49.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9150000000000001e-06 2024-04-26T11:14:49.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.678 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:49.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653435+0000", 2024-04-26T11:14:49.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3312000000000002e-05 2024-04-26T11:14:49.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.678 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:49.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653550+0000", 2024-04-26T11:14:49.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011545200000000001 2024-04-26T11:14:49.679 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.679 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:49.679 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.679 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:172428 5.7 5.5ef96e57 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:49.679 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:49.653533+0000", 2024-04-26T11:14:49.679 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00041537399999999998, 2024-04-26T11:14:49.679 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00064789399999999999, 2024-04-26T11:14:49.679 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:49.679 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:49.680 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:49.680 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:49.680 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.680 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 172428 2024-04-26T11:14:49.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.680 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:49.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.680 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:49.680 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653533+0000", 2024-04-26T11:14:49.680 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.680 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:49.681 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653533+0000", 2024-04-26T11:14:49.681 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.681 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.681 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:49.681 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653532+0000", 2024-04-26T11:14:49.681 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:49.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.681 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.681 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:49.681 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653537+0000", 2024-04-26T11:14:49.681 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5109999999999997e-06 2024-04-26T11:14:49.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.682 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:49.682 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653546+0000", 2024-04-26T11:14:49.682 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3670000000000003e-06 2024-04-26T11:14:49.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.682 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.682 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653553+0000", 2024-04-26T11:14:49.682 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6510000000000004e-06 2024-04-26T11:14:49.682 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.682 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:49.682 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.683 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:172429 5.3 5.6251b0d3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:49.683 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:49.653589+0000", 2024-04-26T11:14:49.683 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.000359551, 2024-04-26T11:14:49.683 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00062143799999999998, 2024-04-26T11:14:49.683 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:49.683 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:49.683 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:49.683 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:49.683 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.683 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 172429 2024-04-26T11:14:49.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.683 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:49.683 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.684 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:49.684 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653589+0000", 2024-04-26T11:14:49.684 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.684 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:49.684 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653589+0000", 2024-04-26T11:14:49.684 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.684 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:49.684 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653588+0000", 2024-04-26T11:14:49.685 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.685 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.685 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:49.685 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653592+0000", 2024-04-26T11:14:49.685 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4149999999999999e-06 2024-04-26T11:14:49.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.685 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.685 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:49.685 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653600+0000", 2024-04-26T11:14:49.685 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0120000000000005e-06 2024-04-26T11:14:49.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.686 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.686 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.686 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.653606+0000", 2024-04-26T11:14:49.686 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7209999999999997e-06 2024-04-26T11:14:49.686 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.686 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:49.686 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.686 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.686 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:172413 5.a e46/31 5:547886c1:::benchmark_data_smithi029_44842_object27775:head v 46'10931, mlcod=46'10928)", 2024-04-26T11:14:49.686 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:49.649423+0000", 2024-04-26T11:14:49.686 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0045253749999999999, 2024-04-26T11:14:49.686 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0048209150000000003, 2024-04-26T11:14:49.686 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:49.687 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:49.687 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:49.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.687 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:49.687 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.649423+0000", 2024-04-26T11:14:49.687 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.687 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:49.687 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.649423+0000", 2024-04-26T11:14:49.687 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.688 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:49.688 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.649422+0000", 2024-04-26T11:14:49.688 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.688 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:49.688 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.649428+0000", 2024-04-26T11:14:49.688 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8730000000000004e-06 2024-04-26T11:14:49.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.688 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:49.688 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.649437+0000", 2024-04-26T11:14:49.688 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6540000000000005e-06 2024-04-26T11:14:49.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.689 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.689 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.649443+0000", 2024-04-26T11:14:49.689 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8660000000000002e-06 2024-04-26T11:14:49.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.689 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:49.689 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.649481+0000", 2024-04-26T11:14:49.689 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7858999999999998e-05 2024-04-26T11:14:49.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.689 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:49.689 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.649497+0000", 2024-04-26T11:14:49.689 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6827999999999999e-05 2024-04-26T11:14:49.689 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.689 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:49.690 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.690 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.690 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:172415 5.6 5:6490a517:::benchmark_data_smithi029_44842_object27777:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:49.690 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:49.650460+0000", 2024-04-26T11:14:49.690 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0034881320000000001, 2024-04-26T11:14:49.690 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0038170270000000002, 2024-04-26T11:14:49.690 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:49.690 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:49.690 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:49.690 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:49.690 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.690 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 172415 2024-04-26T11:14:49.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.691 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:49.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.691 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:49.691 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.650460+0000", 2024-04-26T11:14:49.691 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.691 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:49.691 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.650460+0000", 2024-04-26T11:14:49.691 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.691 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:49.691 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.650459+0000", 2024-04-26T11:14:49.692 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:49.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.692 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:49.692 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.650465+0000", 2024-04-26T11:14:49.692 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7169999999999996e-06 2024-04-26T11:14:49.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.692 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:49.692 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.650477+0000", 2024-04-26T11:14:49.692 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2384e-05 2024-04-26T11:14:49.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.692 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.692 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.650485+0000", 2024-04-26T11:14:49.693 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5639999999999999e-06 2024-04-26T11:14:49.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.693 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:49.693 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651093+0000", 2024-04-26T11:14:49.693 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00060800000000000003 2024-04-26T11:14:49.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.693 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:49.693 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651215+0000", 2024-04-26T11:14:49.693 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012248200000000001 2024-04-26T11:14:49.693 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.693 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:49.693 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.694 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:172416 5.3 5:c62cb743:::benchmark_data_smithi029_44842_object27778:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:49.694 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:49.650754+0000", 2024-04-26T11:14:49.694 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0031943319999999998, 2024-04-26T11:14:49.694 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0035600580000000001, 2024-04-26T11:14:49.694 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:49.694 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:49.694 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:49.694 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:49.694 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.694 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 172416 2024-04-26T11:14:49.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.694 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:49.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.695 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:49.695 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.650754+0000", 2024-04-26T11:14:49.695 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.695 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:49.695 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.650754+0000", 2024-04-26T11:14:49.695 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.695 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:49.695 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.650753+0000", 2024-04-26T11:14:49.695 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.696 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:49.696 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.650758+0000", 2024-04-26T11:14:49.696 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.3159999999999998e-06 2024-04-26T11:14:49.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.696 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:49.696 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.650766+0000", 2024-04-26T11:14:49.696 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6489999999999997e-06 2024-04-26T11:14:49.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.696 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.696 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.650773+0000", 2024-04-26T11:14:49.696 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6449999999999999e-06 2024-04-26T11:14:49.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.697 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:49.697 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.650950+0000", 2024-04-26T11:14:49.697 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000176775 2024-04-26T11:14:49.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.697 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:49.697 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651054+0000", 2024-04-26T11:14:49.697 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010463000000000001 2024-04-26T11:14:49.697 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.697 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:49.697 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.698 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:172418 5.7 5:e0c2512c:::benchmark_data_smithi029_44842_object27780:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:49.698 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:49.651030+0000", 2024-04-26T11:14:49.698 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0029184559999999998, 2024-04-26T11:14:49.698 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0033205180000000002, 2024-04-26T11:14:49.698 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:49.698 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:49.698 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:49.698 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:49.698 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.698 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 172418 2024-04-26T11:14:49.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.698 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:49.698 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.698 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:49.699 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651030+0000", 2024-04-26T11:14:49.699 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.699 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:49.699 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651030+0000", 2024-04-26T11:14:49.699 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.699 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:49.699 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651029+0000", 2024-04-26T11:14:49.699 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:49.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.700 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:49.700 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651034+0000", 2024-04-26T11:14:49.700 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6460000000000001e-06 2024-04-26T11:14:49.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.700 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:49.700 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651043+0000", 2024-04-26T11:14:49.700 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4339999999999998e-06 2024-04-26T11:14:49.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.700 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.700 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651050+0000", 2024-04-26T11:14:49.700 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2080000000000003e-06 2024-04-26T11:14:49.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.701 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:49.701 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651089+0000", 2024-04-26T11:14:49.701 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8751999999999998e-05 2024-04-26T11:14:49.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.701 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:49.701 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651225+0000", 2024-04-26T11:14:49.701 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013546200000000001 2024-04-26T11:14:49.701 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.701 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:49.701 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.701 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:172419 5.1 5:8191a850:::benchmark_data_smithi029_44842_object27781:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:49.702 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:49.651063+0000", 2024-04-26T11:14:49.702 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0028855349999999998, 2024-04-26T11:14:49.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0033238679999999998, 2024-04-26T11:14:49.702 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:49.702 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:49.702 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:49.702 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:49.702 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.702 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 172419 2024-04-26T11:14:49.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.702 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:49.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:49.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651063+0000", 2024-04-26T11:14:49.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:49.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651063+0000", 2024-04-26T11:14:49.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:49.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651062+0000", 2024-04-26T11:14:49.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:49.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:49.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651065+0000", 2024-04-26T11:14:49.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9210000000000001e-06 2024-04-26T11:14:49.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:49.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651072+0000", 2024-04-26T11:14:49.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6150000000000002e-06 2024-04-26T11:14:49.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651078+0000", 2024-04-26T11:14:49.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9410000000000004e-06 2024-04-26T11:14:49.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:49.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651135+0000", 2024-04-26T11:14:49.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7003999999999998e-05 2024-04-26T11:14:49.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:49.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651249+0000", 2024-04-26T11:14:49.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011366699999999999 2024-04-26T11:14:49.706 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.706 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:49.706 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.706 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:172423 5.2 5:492856bb:::benchmark_data_smithi029_44842_object27785:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:49.706 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:49.651231+0000", 2024-04-26T11:14:49.706 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.002717021, 2024-04-26T11:14:49.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0031920009999999999, 2024-04-26T11:14:49.706 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:49.706 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:49.706 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:49.707 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:49.707 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:49.707 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 172423 2024-04-26T11:14:49.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.707 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:49.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:49.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651231+0000", 2024-04-26T11:14:49.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:49.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651231+0000", 2024-04-26T11:14:49.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:49.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:49.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651230+0000", 2024-04-26T11:14:49.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:49.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:49.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651236+0000", 2024-04-26T11:14:49.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3900000000000001e-06 2024-04-26T11:14:49.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:49.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651247+0000", 2024-04-26T11:14:49.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1487e-05 2024-04-26T11:14:49.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:49.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651255+0000", 2024-04-26T11:14:49.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9850000000000006e-06 2024-04-26T11:14:49.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:49.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651301+0000", 2024-04-26T11:14:49.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5238000000000003e-05 2024-04-26T11:14:49.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:49.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:49.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:49.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:49.651426+0000", 2024-04-26T11:14:49.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000125232 2024-04-26T11:14:49.710 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.710 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:49.710 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.710 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:49.710 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:14:49.711 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 14 2024-04-26T11:14:49.711 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:49.712 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:49.710+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:49.713 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:49.814 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:49.812+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:49.903 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:49.903 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:14:49.903 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:14:49.903 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:14:49.903 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:49.914 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:49.913+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:49.916 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:50.016 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:50.014+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:50.117 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:50.115+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:50.145 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:50.145 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:14:50.145 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:14:50.146 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:50.146 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.146 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:50.146 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:50.146 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 56.871053709000002, 2024-04-26T11:14:50.146 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:14:50.146 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:50.146 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.146 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:50.146 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:50.146 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.147 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:14:50.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.147 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:50.147 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.147 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:50.147 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:50.147 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.147 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.147 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:50.148 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:50.148 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.148 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.148 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:50.148 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:14:50.148 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.148 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.148 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:50.148 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:14:50.148 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:14:50.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.149 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.149 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:50.149 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:14:50.149 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:14:50.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.149 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.149 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.149 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:14:50.149 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:14:50.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.150 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.150 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.150 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:14:50.150 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:14:50.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.150 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.150 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:50.150 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:14:50.150 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:14:50.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.150 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.150 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:50.151 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:14:50.151 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:14:50.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.151 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.151 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:50.151 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:14:50.151 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:14:50.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.151 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.151 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:50.151 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:14:50.152 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:14:50.152 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.152 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.152 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:50.152 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:14:50.152 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:14:50.152 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.152 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.152 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:50.152 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:14:50.152 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:14:50.153 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.153 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:50.153 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.153 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.153 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.153 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:50.153 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:50.153 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 56.870242144000002, 2024-04-26T11:14:50.153 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:14:50.153 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:50.154 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.154 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:50.154 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:50.154 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.154 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:14:50.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.154 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:50.154 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.154 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:50.154 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:50.154 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.155 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.155 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:50.155 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:50.155 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.155 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.155 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:50.155 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:50.155 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:50.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.155 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.155 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:50.156 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:14:50.156 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:14:50.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.156 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.156 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:50.156 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:14:50.156 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:14:50.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.156 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.156 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.156 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:14:50.156 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:14:50.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.156 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.157 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.157 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:14:50.157 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:14:50.157 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.157 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.157 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:50.157 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:14:50.157 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:14:50.157 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.157 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.157 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:50.157 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:14:50.157 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:14:50.157 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.158 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.158 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:50.158 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:14:50.158 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:14:50.158 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.158 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.158 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:50.158 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:14:50.158 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:14:50.158 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.158 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.158 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:50.158 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:14:50.158 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:14:50.158 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.159 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.159 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:50.159 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:14:50.159 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:14:50.159 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.159 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:50.159 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.159 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.159 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.159 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:50.159 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:50.159 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 56.863055307000003, 2024-04-26T11:14:50.159 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:14:50.159 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:50.160 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.160 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:50.160 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:50.160 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.160 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:14:50.160 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.160 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:50.160 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.160 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:50.160 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:50.160 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.160 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.160 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.160 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:50.161 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:50.161 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.161 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.161 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:50.161 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:14:50.161 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:50.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.161 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.161 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:50.161 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:14:50.161 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:14:50.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.161 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.162 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:50.162 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:14:50.162 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:14:50.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.162 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.162 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.162 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:14:50.162 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:14:50.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.162 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.162 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.162 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:14:50.162 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:14:50.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.163 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.163 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:50.163 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:14:50.163 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:14:50.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.163 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.163 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:50.163 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:14:50.163 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:14:50.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.163 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.163 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:50.163 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:14:50.163 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:14:50.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.164 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.164 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:50.164 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:14:50.164 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:14:50.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.164 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.164 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:50.164 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:14:50.164 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:14:50.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.164 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.164 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:50.164 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:14:50.164 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:14:50.164 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.165 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:50.165 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.165 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.165 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:50.165 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:50.165 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 56.862514427999997, 2024-04-26T11:14:50.165 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:14:50.165 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:50.165 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.165 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:50.165 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:50.165 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.165 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:14:50.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.166 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:50.166 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.166 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:50.166 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:50.166 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.166 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.166 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.166 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:50.166 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:50.166 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.166 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.166 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.167 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:50.167 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:50.167 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.167 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.167 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.167 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:50.167 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:14:50.167 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:14:50.168 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.168 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.168 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:50.168 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:14:50.168 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:14:50.168 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.168 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.168 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.168 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:14:50.168 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:14:50.168 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.168 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.168 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.168 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:14:50.169 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:14:50.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.169 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.169 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:50.169 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:14:50.169 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:14:50.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.169 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.169 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:50.169 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:14:50.169 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:14:50.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.169 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.170 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:50.170 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:14:50.170 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:14:50.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.170 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.170 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:50.170 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:14:50.170 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:14:50.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.170 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.170 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:50.170 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:14:50.171 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:14:50.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.171 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.171 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:50.171 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:14:50.171 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:14:50.171 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.171 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:50.171 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.172 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.172 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.172 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:50.172 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:50.172 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 52.819329981000003, 2024-04-26T11:14:50.172 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:14:50.172 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:50.172 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:50.173 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:50.173 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:50.173 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.173 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:14:50.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.173 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:50.173 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.173 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:50.173 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:50.173 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.173 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.174 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:50.174 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:50.174 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.174 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.174 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.174 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:50.174 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:14:50.174 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:50.174 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.174 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.174 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:50.174 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:14:50.174 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:14:50.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.175 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.175 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:50.175 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:14:50.175 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:14:50.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.175 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.175 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.175 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:14:50.175 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:14:50.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.175 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.176 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.176 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:14:50.176 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:14:50.176 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.177 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.177 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:50.177 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:14:50.177 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:14:50.178 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.178 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.178 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:50.178 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:14:50.178 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:14:50.178 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.178 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.178 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:50.178 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:14:50.179 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:14:50.179 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.179 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.179 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.179 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:14:50.179 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:14:50.179 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.179 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.179 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:50.179 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:14:50.179 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:14:50.179 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.180 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.180 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.180 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:14:50.180 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:14:50.180 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.180 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.180 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:50.180 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:14:50.180 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:14:50.180 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.180 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:50.180 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.181 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.181 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.181 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:50.181 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:50.181 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 52.817136640999998, 2024-04-26T11:14:50.181 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:14:50.181 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:50.181 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:50.181 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:50.181 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:50.181 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.182 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:14:50.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.182 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:50.182 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.182 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:50.182 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:50.182 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.182 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.182 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:50.182 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:50.182 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.183 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.183 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:50.183 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:14:50.183 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:50.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.183 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.183 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:50.183 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:14:50.183 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:14:50.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.183 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.184 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:50.184 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:14:50.184 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:14:50.184 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.184 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.184 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.184 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:14:50.184 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:14:50.184 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.184 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.184 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.184 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:14:50.185 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:14:50.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.185 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.185 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:50.185 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:14:50.185 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:14:50.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.185 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.185 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:50.185 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:14:50.185 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:14:50.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.185 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.186 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:50.186 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:14:50.186 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:14:50.186 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.186 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.186 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.186 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:14:50.186 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:14:50.186 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.186 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.186 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:50.187 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:14:50.187 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:14:50.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.187 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.187 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.187 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:14:50.187 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:14:50.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.187 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.187 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:50.187 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:14:50.187 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:14:50.188 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.188 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:50.188 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.188 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.188 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:50.188 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:50.188 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 52.811924816999998, 2024-04-26T11:14:50.188 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:14:50.188 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:50.188 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:50.188 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:50.188 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:50.188 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.188 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:14:50.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.189 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:50.189 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.189 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:50.189 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:50.189 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.189 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.189 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:50.189 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:50.189 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.189 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.189 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:50.189 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:14:50.190 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:50.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.190 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.190 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:50.190 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:14:50.190 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:14:50.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.190 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.190 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:50.190 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:14:50.190 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:14:50.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.190 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.190 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.191 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:14:50.191 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:14:50.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.191 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.191 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.191 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:14:50.191 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:14:50.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.191 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.191 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:50.191 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:14:50.191 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:14:50.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.191 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.191 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:50.192 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:14:50.192 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:14:50.192 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.192 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.192 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:50.192 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:14:50.192 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:14:50.192 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.192 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.192 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.192 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:14:50.192 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:14:50.192 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.192 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.192 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:50.193 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:14:50.193 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:14:50.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.193 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.193 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.193 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:14:50.193 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:14:50.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.193 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.193 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:50.193 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:14:50.193 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:14:50.193 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.193 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:50.193 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.194 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.194 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:50.194 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:50.194 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 52.795476117, 2024-04-26T11:14:50.194 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:14:50.194 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:50.194 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:50.194 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:50.194 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:50.194 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.194 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:14:50.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.195 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:50.195 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.195 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:50.195 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:50.195 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.195 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.195 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:50.195 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:50.195 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.195 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.195 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:50.195 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:14:50.196 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:50.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.196 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.196 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:50.196 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:14:50.196 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:14:50.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.196 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.196 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:50.196 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:14:50.196 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:14:50.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.196 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.196 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.196 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:14:50.197 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:14:50.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.197 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.197 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.197 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:14:50.197 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:14:50.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.197 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.197 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:50.197 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:14:50.197 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:14:50.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.197 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.197 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.198 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:14:50.198 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:14:50.198 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.198 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.198 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:50.198 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:14:50.198 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:14:50.198 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.198 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:50.198 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.198 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.198 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.198 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:50.198 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:50.198 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 52.793778611999997, 2024-04-26T11:14:50.199 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:14:50.199 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:50.199 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:50.199 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:50.199 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:50.199 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.199 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:14:50.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.199 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:50.199 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.199 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:50.199 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:50.199 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.200 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.200 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:50.200 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:50.200 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.200 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.200 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.200 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:50.200 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:14:50.200 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:50.200 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.200 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.200 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:50.200 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:14:50.200 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:14:50.200 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.201 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.201 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:50.201 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:14:50.201 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:14:50.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.201 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.201 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.201 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:14:50.201 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:14:50.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.201 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.201 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.201 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:14:50.201 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:14:50.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.202 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.202 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:50.202 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:14:50.202 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:14:50.202 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.202 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.202 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.202 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:14:50.202 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:14:50.202 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.202 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.202 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:50.202 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:14:50.203 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:14:50.203 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.203 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:50.203 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.203 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.203 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:50.203 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:50.203 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 52.793714309999999, 2024-04-26T11:14:50.203 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:14:50.203 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:50.203 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.203 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:50.204 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:50.204 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.204 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:14:50.204 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.204 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:50.204 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.204 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:50.204 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:50.204 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.204 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.204 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.204 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:50.204 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:50.204 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.205 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.205 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.205 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:50.205 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:50.205 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.205 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.205 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.205 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:50.205 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:14:50.205 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:14:50.205 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.205 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.205 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:50.205 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:14:50.206 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:14:50.206 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.206 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.206 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.206 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:14:50.206 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:14:50.206 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.206 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.206 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.206 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:14:50.206 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:14:50.206 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.206 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.206 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:50.207 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:14:50.207 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:14:50.207 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.207 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.207 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.207 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:14:50.207 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:14:50.207 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.207 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.207 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:50.207 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:14:50.207 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:14:50.207 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.207 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.208 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:50.208 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:14:50.208 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:14:50.208 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.208 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.208 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:50.208 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:14:50.208 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:14:50.208 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.208 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.208 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:50.208 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:14:50.208 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:14:50.208 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.208 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:50.209 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.209 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.209 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.209 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:50.209 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:50.209 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 52.793660086000003, 2024-04-26T11:14:50.209 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:14:50.209 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:50.209 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.209 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:50.209 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:50.209 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.209 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:14:50.209 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.210 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:50.210 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.210 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:50.210 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:50.210 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.210 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.210 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.210 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:50.210 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:50.210 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.210 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.210 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.210 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:50.211 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:50.211 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.211 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.211 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.211 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:50.211 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:14:50.211 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:14:50.211 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.211 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.211 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:50.211 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:14:50.211 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:14:50.211 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.212 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.212 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.212 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:14:50.212 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:14:50.212 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.212 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.212 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.212 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:14:50.212 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:14:50.212 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.212 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.212 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:50.213 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:14:50.213 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:14:50.213 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.213 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.213 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.213 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:14:50.213 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:14:50.213 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.213 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.213 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:50.213 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:14:50.213 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:14:50.213 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.214 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.214 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:50.214 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:14:50.214 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:14:50.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.214 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.214 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:50.214 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:14:50.214 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:50.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.214 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.214 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:50.215 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:14:50.215 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:14:50.215 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.215 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:50.215 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.215 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.215 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.215 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:50.215 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:50.215 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 52.793615574, 2024-04-26T11:14:50.215 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:14:50.215 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:50.216 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.216 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:50.216 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:50.216 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.216 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:14:50.216 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.216 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:50.216 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.216 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:50.216 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:50.216 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.216 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.217 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.217 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:50.217 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:50.217 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.217 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.217 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.217 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:50.217 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:14:50.217 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.217 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.217 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.217 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:50.218 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:14:50.218 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:14:50.218 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.218 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.218 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:50.218 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:14:50.218 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:14:50.218 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.218 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.218 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.218 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:14:50.218 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:14:50.219 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.219 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.219 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.219 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:14:50.219 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:14:50.219 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.219 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.219 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:50.219 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:14:50.219 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:14:50.219 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.219 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.219 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.220 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:14:50.220 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:14:50.220 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.220 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.220 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:50.220 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:14:50.220 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:14:50.220 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.220 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.220 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:50.220 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:14:50.220 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:14:50.221 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.221 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.221 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:50.221 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:14:50.221 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:14:50.221 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.221 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.221 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:50.221 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:14:50.221 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:14:50.221 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.221 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:50.222 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.222 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.222 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.222 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:50.222 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:50.222 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 52.789394571999999, 2024-04-26T11:14:50.222 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:14:50.222 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:50.222 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.222 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:50.222 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:50.223 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.223 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:14:50.223 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.223 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:50.223 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.223 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:50.223 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:50.223 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.223 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.223 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.223 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:50.224 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:50.224 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.224 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.224 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.224 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:50.224 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:14:50.224 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:14:50.224 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.224 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.224 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:50.224 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:14:50.224 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:14:50.224 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.225 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.225 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:50.225 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:14:50.225 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:14:50.225 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.225 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.225 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.225 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:14:50.225 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:14:50.225 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.225 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.226 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.226 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:14:50.226 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:14:50.226 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.226 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.226 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:50.226 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:14:50.226 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:14:50.226 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.226 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.226 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.226 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:14:50.226 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:14:50.226 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.227 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.227 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:50.227 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:14:50.227 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:14:50.227 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.227 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.227 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:50.227 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:14:50.227 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:14:50.227 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.227 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.227 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:50.227 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:14:50.227 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:14:50.227 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.228 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.228 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:50.228 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:14:50.228 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:14:50.228 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.228 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:50.228 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.228 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.228 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.228 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83360 5.2 5:42f8bfcd:::benchmark_data_smithi029_44842_object83359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:50.228 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:50.228 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 39.102155201999999, 2024-04-26T11:14:50.228 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022279782000000001, 2024-04-26T11:14:50.228 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:50.228 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.228 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:50.229 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:50.229 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.229 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83360 2024-04-26T11:14:50.229 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.229 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:50.229 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.229 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:50.229 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:50.229 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.229 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.229 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.229 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:50.229 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:50.229 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.230 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.230 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.230 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:50.230 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039645+0000", 2024-04-26T11:14:50.230 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.230 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.230 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.230 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:50.230 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039700+0000", 2024-04-26T11:14:50.230 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5541000000000002e-05 2024-04-26T11:14:50.230 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.230 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.230 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:50.230 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039706+0000", 2024-04-26T11:14:50.230 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3680000000000001e-06 2024-04-26T11:14:50.231 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.231 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.231 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.231 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.039709+0000", 2024-04-26T11:14:50.231 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4659999999999999e-06 2024-04-26T11:14:50.231 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.231 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.231 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.231 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056305+0000", 2024-04-26T11:14:50.231 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.016595649000000001 2024-04-26T11:14:50.231 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.231 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.231 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:50.231 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.056487+0000", 2024-04-26T11:14:50.231 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000181886 2024-04-26T11:14:50.232 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.232 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.232 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:50.232 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061809+0000", 2024-04-26T11:14:50.232 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053223259999999996 2024-04-26T11:14:50.232 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.232 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.232 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:50.232 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061852+0000", 2024-04-26T11:14:50.232 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2738999999999999e-05 2024-04-26T11:14:50.232 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.232 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.232 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:50.232 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.061925+0000", 2024-04-26T11:14:50.232 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3180000000000001e-05 2024-04-26T11:14:50.233 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.233 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:50.233 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.233 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.233 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.233 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:83364 5.2 5:42c5cd8c:::benchmark_data_smithi029_44842_object83363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T11:14:50.233 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:50.233 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 39.101739461999998, 2024-04-26T11:14:50.233 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022695336, 2024-04-26T11:14:50.233 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:50.233 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.233 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:50.233 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:50.233 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.233 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 83364 2024-04-26T11:14:50.234 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.234 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:50.234 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.234 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:50.234 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:50.234 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.234 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.234 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.234 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:50.234 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040061+0000", 2024-04-26T11:14:50.234 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.234 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.234 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.234 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:50.235 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040060+0000", 2024-04-26T11:14:50.235 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.235 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.235 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:50.235 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040086+0000", 2024-04-26T11:14:50.235 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5482000000000001e-05 2024-04-26T11:14:50.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.235 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.235 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:50.235 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040093+0000", 2024-04-26T11:14:50.235 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6409999999999996e-06 2024-04-26T11:14:50.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.235 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.236 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.236 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.040098+0000", 2024-04-26T11:14:50.236 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879999999999996e-06 2024-04-26T11:14:50.236 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.236 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.236 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.236 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058292+0000", 2024-04-26T11:14:50.236 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.018193504999999999 2024-04-26T11:14:50.236 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.236 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.236 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:50.236 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.058412+0000", 2024-04-26T11:14:50.236 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011979199999999999 2024-04-26T11:14:50.236 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.236 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.237 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:50.237 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062642+0000", 2024-04-26T11:14:50.237 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042299449999999997 2024-04-26T11:14:50.237 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.237 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.237 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:50.237 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062688+0000", 2024-04-26T11:14:50.237 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6859e-05 2024-04-26T11:14:50.237 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.237 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.237 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:50.237 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:11.062756+0000", 2024-04-26T11:14:50.237 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7995000000000002e-05 2024-04-26T11:14:50.237 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.237 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:50.238 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.238 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.238 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.238 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:129903 5.0 e40/16 5:00b2d390:::benchmark_data_smithi029_44842_object129902:head v 40'8238, mlcod=40'8234)", 2024-04-26T11:14:50.238 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:50.238 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 18.247990079000001, 2024-04-26T11:14:50.238 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.02228639, 2024-04-26T11:14:50.238 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:50.238 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.238 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:50.238 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.238 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:50.238 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:50.238 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.238 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.239 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.239 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:50.239 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:50.239 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.239 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.239 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:50.239 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893810+0000", 2024-04-26T11:14:50.239 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:50.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.239 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.239 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:50.239 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893874+0000", 2024-04-26T11:14:50.240 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3849000000000005e-05 2024-04-26T11:14:50.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.240 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.240 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:50.240 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893884+0000", 2024-04-26T11:14:50.240 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0149000000000001e-05 2024-04-26T11:14:50.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.240 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.240 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.240 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.893892+0000", 2024-04-26T11:14:50.240 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0299999999999994e-06 2024-04-26T11:14:50.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.241 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.241 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.241 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.894003+0000", 2024-04-26T11:14:50.241 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011128099999999999 2024-04-26T11:14:50.241 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.241 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.241 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:50.241 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.894024+0000", 2024-04-26T11:14:50.241 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0979e-05 2024-04-26T11:14:50.241 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.241 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.241 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:50.241 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.916077+0000", 2024-04-26T11:14:50.242 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022053461 2024-04-26T11:14:50.242 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.242 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.242 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:50.242 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:31.916097+0000", 2024-04-26T11:14:50.242 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9389999999999999e-05 2024-04-26T11:14:50.242 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.242 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:50.242 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.242 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.242 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.242 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:130959 5.7 5:ee32f7f7:::benchmark_data_smithi029_44842_object130958:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:50.243 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:32.375500+0000", 2024-04-26T11:14:50.243 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 17.766300807, 2024-04-26T11:14:50.243 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.022235456000000001, 2024-04-26T11:14:50.243 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:50.243 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.243 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:50.243 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:50.243 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.243 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 130959 2024-04-26T11:14:50.243 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.243 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:50.244 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.244 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:50.244 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375500+0000", 2024-04-26T11:14:50.244 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.244 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.244 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.244 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:50.244 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375500+0000", 2024-04-26T11:14:50.244 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.244 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.244 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.244 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:50.244 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375499+0000", 2024-04-26T11:14:50.245 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.245 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.245 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.245 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:50.245 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375530+0000", 2024-04-26T11:14:50.245 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0556999999999999e-05 2024-04-26T11:14:50.245 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.245 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.245 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:50.245 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375537+0000", 2024-04-26T11:14:50.245 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7849999999999992e-06 2024-04-26T11:14:50.245 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.246 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.246 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.246 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375543+0000", 2024-04-26T11:14:50.246 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6060000000000002e-06 2024-04-26T11:14:50.246 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.246 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.246 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.246 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.377410+0000", 2024-04-26T11:14:50.246 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0018671149999999999 2024-04-26T11:14:50.246 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.246 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.247 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:50.247 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.377544+0000", 2024-04-26T11:14:50.247 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013380999999999999 2024-04-26T11:14:50.247 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.247 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.247 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:50.247 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397624+0000", 2024-04-26T11:14:50.247 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020079889 2024-04-26T11:14:50.247 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.247 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.247 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:50.247 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397662+0000", 2024-04-26T11:14:50.248 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8269999999999998e-05 2024-04-26T11:14:50.248 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.248 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.248 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:50.248 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397735+0000", 2024-04-26T11:14:50.248 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3017999999999998e-05 2024-04-26T11:14:50.248 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.248 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:50.248 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.248 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.248 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.248 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:130960 5.0 e40/16 5:042df53c:::benchmark_data_smithi029_44842_object130959:head v 40'8310, mlcod=40'8308)", 2024-04-26T11:14:50.249 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:32.375983+0000", 2024-04-26T11:14:50.249 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 17.765817897000002, 2024-04-26T11:14:50.249 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.021699000999999999, 2024-04-26T11:14:50.249 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:50.249 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.249 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:50.249 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.249 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:50.249 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375983+0000", 2024-04-26T11:14:50.249 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.249 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.249 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.250 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:50.250 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375983+0000", 2024-04-26T11:14:50.250 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.250 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.250 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.250 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:50.250 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.375982+0000", 2024-04-26T11:14:50.250 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:50.250 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.250 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.250 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:50.251 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376039+0000", 2024-04-26T11:14:50.251 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7240000000000001e-05 2024-04-26T11:14:50.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.251 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.251 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:50.251 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376047+0000", 2024-04-26T11:14:50.251 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6699999999999994e-06 2024-04-26T11:14:50.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.251 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.251 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.251 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376053+0000", 2024-04-26T11:14:50.251 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:14:50.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.252 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.252 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.252 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376504+0000", 2024-04-26T11:14:50.252 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00045143100000000002 2024-04-26T11:14:50.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.252 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.252 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:50.252 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376521+0000", 2024-04-26T11:14:50.252 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6820000000000002e-05 2024-04-26T11:14:50.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.252 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.253 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:50.253 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397656+0000", 2024-04-26T11:14:50.253 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.021134824 2024-04-26T11:14:50.253 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.253 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.253 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:50.253 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.397682+0000", 2024-04-26T11:14:50.253 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.597e-05 2024-04-26T11:14:50.253 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.253 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:50.253 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.254 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.254 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.254 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:130966 5.3 5:ce21bfb4:::benchmark_data_smithi029_44842_object130965:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T11:14:50.254 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:32.376761+0000", 2024-04-26T11:14:50.254 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 17.765039891000001, 2024-04-26T11:14:50.254 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.023879659000000001, 2024-04-26T11:14:50.254 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:50.254 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.254 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:50.254 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:50.254 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.255 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 130966 2024-04-26T11:14:50.255 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.255 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:50.255 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.255 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:50.255 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376761+0000", 2024-04-26T11:14:50.255 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.255 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.255 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.255 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:50.255 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376761+0000", 2024-04-26T11:14:50.256 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.256 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.256 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:50.256 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376760+0000", 2024-04-26T11:14:50.256 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:50.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.256 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.256 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:50.256 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376807+0000", 2024-04-26T11:14:50.256 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7089000000000003e-05 2024-04-26T11:14:50.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.256 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.257 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:50.257 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376817+0000", 2024-04-26T11:14:50.257 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.7329999999999998e-06 2024-04-26T11:14:50.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.257 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.257 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.257 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.376824+0000", 2024-04-26T11:14:50.257 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6240000000000002e-06 2024-04-26T11:14:50.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.257 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.257 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.257 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378825+0000", 2024-04-26T11:14:50.258 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020004799999999998 2024-04-26T11:14:50.258 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.258 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.258 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:50.258 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378963+0000", 2024-04-26T11:14:50.258 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013860399999999999 2024-04-26T11:14:50.258 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.258 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.258 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:50.258 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.400519+0000", 2024-04-26T11:14:50.258 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.021555405 2024-04-26T11:14:50.258 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.258 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.258 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:50.259 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.400568+0000", 2024-04-26T11:14:50.259 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8989999999999997e-05 2024-04-26T11:14:50.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.259 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.259 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:50.259 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.400640+0000", 2024-04-26T11:14:50.259 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2556000000000001e-05 2024-04-26T11:14:50.259 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.259 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:50.259 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.259 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.259 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:130965 5.0 e40/16 5:02e1af30:::benchmark_data_smithi029_44842_object130964:head v 40'8311, mlcod=40'8308)", 2024-04-26T11:14:50.259 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:32.378228+0000", 2024-04-26T11:14:50.259 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 17.763572069999999, 2024-04-26T11:14:50.260 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.023551810999999999, 2024-04-26T11:14:50.260 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:50.260 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.260 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:50.260 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.260 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:50.260 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378228+0000", 2024-04-26T11:14:50.260 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.260 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.260 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:50.260 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378228+0000", 2024-04-26T11:14:50.260 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:50.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.261 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.261 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:50.261 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378228+0000", 2024-04-26T11:14:50.261 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:50.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.261 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.261 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:50.261 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378275+0000", 2024-04-26T11:14:50.261 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:14:50.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.261 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.261 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:50.261 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378284+0000", 2024-04-26T11:14:50.261 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3740000000000004e-06 2024-04-26T11:14:50.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.261 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.262 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.262 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378291+0000", 2024-04-26T11:14:50.262 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4359999999999999e-06 2024-04-26T11:14:50.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.262 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.262 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:50.262 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378322+0000", 2024-04-26T11:14:50.262 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1260000000000002e-05 2024-04-26T11:14:50.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.262 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.262 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:50.262 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.378336+0000", 2024-04-26T11:14:50.262 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3937999999999999e-05 2024-04-26T11:14:50.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.263 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.263 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:50.263 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.401744+0000", 2024-04-26T11:14:50.263 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.023407715999999999 2024-04-26T11:14:50.263 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:50.263 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:50.263 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:50.263 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:32.401780+0000", 2024-04-26T11:14:50.263 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6433999999999997e-05 2024-04-26T11:14:50.263 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.263 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:50.263 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.263 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:50.263 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:50.263 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:50.265 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:50.265 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:50.262+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:50.410 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:50.364+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:50.416 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:50.416 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174404 5.4 5:2801f1e1:::benchmark_data_smithi029_44842_object29766:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:14:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.058467348000000002, 2024-04-26T11:14:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.058487258, 2024-04-26T11:14:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174404 2024-04-26T11:14:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:14:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:14:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356488+0000", 2024-04-26T11:14:50.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356492+0000", 2024-04-26T11:14:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1169999999999997e-06 2024-04-26T11:14:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356502+0000", 2024-04-26T11:14:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0263e-05 2024-04-26T11:14:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356508+0000", 2024-04-26T11:14:50.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5890000000000002e-06 2024-04-26T11:14:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356545+0000", 2024-04-26T11:14:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7382999999999998e-05 2024-04-26T11:14:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356671+0000", 2024-04-26T11:14:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012535500000000001 2024-04-26T11:14:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:50.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356789+0000", 2024-04-26T11:14:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000118099 2024-04-26T11:14:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.359200+0000", 2024-04-26T11:14:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024110059999999998 2024-04-26T11:14:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174406 5.8 5:1694f31f:::benchmark_data_smithi029_44842_object29768:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.410592+0000", 2024-04-26T11:14:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0043644249999999999, 2024-04-26T11:14:50.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044372769999999999, 2024-04-26T11:14:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174406 2024-04-26T11:14:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.410592+0000", 2024-04-26T11:14:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.410592+0000", 2024-04-26T11:14:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.410590+0000", 2024-04-26T11:14:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999981 2024-04-26T11:14:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.410599+0000", 2024-04-26T11:14:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.969e-06 2024-04-26T11:14:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.410617+0000", 2024-04-26T11:14:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8739000000000001e-05 2024-04-26T11:14:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.410628+0000", 2024-04-26T11:14:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1086e-05 2024-04-26T11:14:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.410691+0000", 2024-04-26T11:14:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2433000000000003e-05 2024-04-26T11:14:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.410866+0000", 2024-04-26T11:14:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000174706 2024-04-26T11:14:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.411004+0000", 2024-04-26T11:14:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013792399999999999 2024-04-26T11:14:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174407 5.b 5:d956be86:::benchmark_data_smithi029_44842_object29769:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:50.425 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.410640+0000", 2024-04-26T11:14:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0043162139999999996, 2024-04-26T11:14:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044323019999999999, 2024-04-26T11:14:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174407 2024-04-26T11:14:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.410640+0000", 2024-04-26T11:14:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.410640+0000", 2024-04-26T11:14:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.410639+0000", 2024-04-26T11:14:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.410642+0000", 2024-04-26T11:14:50.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5799999999999999e-06 2024-04-26T11:14:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.410646+0000", 2024-04-26T11:14:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.506e-06 2024-04-26T11:14:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.410648+0000", 2024-04-26T11:14:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7999999999999999e-06 2024-04-26T11:14:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.410697+0000", 2024-04-26T11:14:50.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8442000000000001e-05 2024-04-26T11:14:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.410870+0000", 2024-04-26T11:14:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000173165 2024-04-26T11:14:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.411004+0000", 2024-04-26T11:14:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013362199999999999 2024-04-26T11:14:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174409 5.8 5:18e0e59d:::benchmark_data_smithi029_44842_object29771:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.411142+0000", 2024-04-26T11:14:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0038135280000000001, 2024-04-26T11:14:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039931680000000001, 2024-04-26T11:14:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174409 2024-04-26T11:14:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.411142+0000", 2024-04-26T11:14:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.411142+0000", 2024-04-26T11:14:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.411142+0000", 2024-04-26T11:14:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.411146+0000", 2024-04-26T11:14:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.946e-06 2024-04-26T11:14:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.411155+0000", 2024-04-26T11:14:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9020000000000005e-06 2024-04-26T11:14:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.411161+0000", 2024-04-26T11:14:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3500000000000002e-06 2024-04-26T11:14:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.413133+0000", 2024-04-26T11:14:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001972377 2024-04-26T11:14:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.413244+0000", 2024-04-26T11:14:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011112000000000001 2024-04-26T11:14:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.413356+0000", 2024-04-26T11:14:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111457 2024-04-26T11:14:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.433 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174410 5.8 5:19d0a09f:::benchmark_data_smithi029_44842_object29772:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.412300+0000", 2024-04-26T11:14:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0026562999999999999, 2024-04-26T11:14:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0029328100000000001, 2024-04-26T11:14:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174410 2024-04-26T11:14:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.434 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412300+0000", 2024-04-26T11:14:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412300+0000", 2024-04-26T11:14:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412299+0000", 2024-04-26T11:14:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412303+0000", 2024-04-26T11:14:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.817e-06 2024-04-26T11:14:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412312+0000", 2024-04-26T11:14:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5929999999999995e-06 2024-04-26T11:14:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412319+0000", 2024-04-26T11:14:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0750000000000003e-06 2024-04-26T11:14:50.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.415137+0000", 2024-04-26T11:14:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0028187780000000001 2024-04-26T11:14:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174414 5.4 5:27c8a6fb:::benchmark_data_smithi029_44842_object29776:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.412355+0000", 2024-04-26T11:14:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0026010360000000001, 2024-04-26T11:14:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002947889, 2024-04-26T11:14:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.437 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174414 2024-04-26T11:14:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412355+0000", 2024-04-26T11:14:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412355+0000", 2024-04-26T11:14:50.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412354+0000", 2024-04-26T11:14:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412357+0000", 2024-04-26T11:14:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6139999999999999e-06 2024-04-26T11:14:50.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412365+0000", 2024-04-26T11:14:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6229999999999997e-06 2024-04-26T11:14:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412370+0000", 2024-04-26T11:14:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6269999999999997e-06 2024-04-26T11:14:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412437+0000", 2024-04-26T11:14:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6836999999999997e-05 2024-04-26T11:14:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412533+0000", 2024-04-26T11:14:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5806999999999999e-05 2024-04-26T11:14:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412654+0000", 2024-04-26T11:14:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012087300000000001 2024-04-26T11:14:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.441 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174415 5.e 5:79141ada:::benchmark_data_smithi029_44842_object29777:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.412473+0000", 2024-04-26T11:14:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0024826219999999999, 2024-04-26T11:14:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0029271179999999998, 2024-04-26T11:14:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174415 2024-04-26T11:14:50.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.443 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412473+0000", 2024-04-26T11:14:50.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412473+0000", 2024-04-26T11:14:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412473+0000", 2024-04-26T11:14:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412476+0000", 2024-04-26T11:14:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3359999999999999e-06 2024-04-26T11:14:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412484+0000", 2024-04-26T11:14:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8380000000000002e-06 2024-04-26T11:14:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412489+0000", 2024-04-26T11:14:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1200000000000001e-06 2024-04-26T11:14:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412529+0000", 2024-04-26T11:14:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0154000000000002e-05 2024-04-26T11:14:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:50.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412649+0000", 2024-04-26T11:14:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000119752 2024-04-26T11:14:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412753+0000", 2024-04-26T11:14:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010384599999999999 2024-04-26T11:14:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174416 5.f 5:ffb54abb:::benchmark_data_smithi029_44842_object29778:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.412960+0000", 2024-04-26T11:14:50.446 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0019954650000000001, 2024-04-26T11:14:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025268529999999999, 2024-04-26T11:14:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174416 2024-04-26T11:14:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412960+0000", 2024-04-26T11:14:50.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412960+0000", 2024-04-26T11:14:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412960+0000", 2024-04-26T11:14:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412963+0000", 2024-04-26T11:14:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8519999999999997e-06 2024-04-26T11:14:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412980+0000", 2024-04-26T11:14:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6118999999999999e-05 2024-04-26T11:14:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412988+0000", 2024-04-26T11:14:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8340000000000005e-06 2024-04-26T11:14:50.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.413023+0000", 2024-04-26T11:14:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4283999999999999e-05 2024-04-26T11:14:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.413127+0000", 2024-04-26T11:14:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104115 2024-04-26T11:14:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(client.4534.0:174406 5.8 e46/16)", 2024-04-26T11:14:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.415158+0000", 2024-04-26T11:14:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9997983, 2024-04-26T11:14:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00041354400000000001, 2024-04-26T11:14:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.415158+0000", 2024-04-26T11:14:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.415158+0000", 2024-04-26T11:14:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.415158+0000", 2024-04-26T11:14:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.415160+0000", 2024-04-26T11:14:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0619999999999999e-06 2024-04-26T11:14:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.415164+0000", 2024-04-26T11:14:50.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4229999999999998e-06 2024-04-26T11:14:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.415167+0000", 2024-04-26T11:14:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0740000000000001e-06 2024-04-26T11:14:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174422 5.8 5.598d7b18 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.415465+0000", 2024-04-26T11:14:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9994907, 2024-04-26T11:14:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015746799999999999, 2024-04-26T11:14:50.453 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174422 2024-04-26T11:14:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.415465+0000", 2024-04-26T11:14:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.415465+0000", 2024-04-26T11:14:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.415465+0000", 2024-04-26T11:14:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.415468+0000", 2024-04-26T11:14:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6049999999999998e-06 2024-04-26T11:14:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.415475+0000", 2024-04-26T11:14:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8360000000000003e-06 2024-04-26T11:14:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.415479+0000", 2024-04-26T11:14:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1999999999999996e-06 2024-04-26T11:14:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:14:50.456 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 10 2024-04-26T11:14:50.456 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:50.457 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:50.501 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:50.500+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:50.568 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:50.566+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:50.639 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:50.640 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:14:50.640 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:14:50.640 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:14:50.640 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:50.650 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:50.684 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:14:50.693 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:50.691+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:50.769 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:50.767+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:50.830 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:14:50.870 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:50.868+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:50.872 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:50.872 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:14:50.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:14:50.872 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:50.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.872 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:50.872 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:50.872 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 57.589597255999998, 2024-04-26T11:14:50.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:14:50.872 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.873 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.873 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.873 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.873 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.873 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:14:50.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.873 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:50.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:50.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:50.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:14:50.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:14:50.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:14:50.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:14:50.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:14:50.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:14:50.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:14:50.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:14:50.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:50.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:14:50.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:14:50.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:50.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:14:50.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:14:50.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:50.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:14:50.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:14:50.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:50.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:14:50.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:14:50.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:50.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:14:50.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:14:50.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:50.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:14:50.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:14:50.878 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.878 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.878 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.878 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:50.878 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:50.878 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 57.588947554000001, 2024-04-26T11:14:50.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:14:50.879 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.879 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.879 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.879 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.879 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.879 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:14:50.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.879 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:50.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:50.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:14:50.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:50.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:14:50.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:14:50.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:14:50.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:14:50.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:14:50.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:14:50.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:14:50.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:14:50.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:50.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:14:50.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:14:50.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:50.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:14:50.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:14:50.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:50.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:14:50.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:14:50.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:50.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:14:50.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:14:50.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:50.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:14:50.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:14:50.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:50.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:14:50.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:14:50.884 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.884 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.884 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.884 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:50.884 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:50.884 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 53.522305514999999, 2024-04-26T11:14:50.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:14:50.884 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.884 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:50.884 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.884 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.885 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.885 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:14:50.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.885 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:50.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:50.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:14:50.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:50.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:14:50.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:14:50.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:14:50.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:14:50.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:14:50.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:14:50.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:14:50.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:14:50.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:50.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:14:50.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:14:50.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:14:50.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:14:50.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:50.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:14:50.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:14:50.889 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.889 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.889 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.889 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:50.889 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:50.889 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 53.522209869000001, 2024-04-26T11:14:50.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:14:50.889 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.889 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:50.889 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.889 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.890 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.890 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:14:50.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.890 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:50.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:50.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:14:50.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:14:50.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:14:50.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:14:50.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:14:50.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:14:50.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:14:50.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:14:50.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:14:50.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:50.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:14:50.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:14:50.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:14:50.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:14:50.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:50.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:14:50.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:14:50.894 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.894 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.894 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.894 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:50.894 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:50.894 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 53.522078190000002, 2024-04-26T11:14:50.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:14:50.894 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.894 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:50.895 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.895 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.895 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.895 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:14:50.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.895 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:50.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:50.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:50.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:14:50.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:14:50.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:14:50.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:14:50.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:14:50.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:14:50.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:14:50.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:14:50.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:50.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:14:50.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:14:50.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:14:50.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:14:50.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:50.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:14:50.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:14:50.898 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.898 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.899 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.899 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:50.899 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:50.899 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 53.521969734000002, 2024-04-26T11:14:50.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:14:50.899 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.899 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:50.899 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.899 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.899 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.899 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:14:50.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.900 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:50.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:50.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:14:50.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:50.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:14:50.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:14:50.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:14:50.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:14:50.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:14:50.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:14:50.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:14:50.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:14:50.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:50.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:14:50.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:14:50.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:14:50.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:14:50.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:50.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:14:50.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:14:50.903 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.903 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.903 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.904 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:50.904 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:50.904 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 53.521868466000001, 2024-04-26T11:14:50.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:14:50.904 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.904 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.904 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.904 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.904 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.904 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:14:50.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.904 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:50.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:50.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:50.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:14:50.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:14:50.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:14:50.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:14:50.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:14:50.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:14:50.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:14:50.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:14:50.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:50.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:14:50.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:14:50.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:14:50.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:14:50.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:50.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:14:50.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:14:50.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:50.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:14:50.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:14:50.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:50.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:14:50.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:14:50.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:50.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:14:50.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:14:50.909 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.909 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.909 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.909 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:50.910 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:50.910 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 53.521799524999999, 2024-04-26T11:14:50.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:14:50.910 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.910 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.910 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.910 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.910 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.910 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:14:50.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.910 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:50.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:50.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:14:50.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:14:50.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:14:50.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:14:50.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:14:50.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:14:50.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:14:50.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:14:50.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:14:50.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:50.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:14:50.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:14:50.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:14:50.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:14:50.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:50.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:14:50.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:14:50.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:50.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:14:50.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:14:50.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:50.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:14:50.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:14:50.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:50.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:14:50.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:14:50.915 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.915 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.915 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.915 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:50.915 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:50.916 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 53.515803943999998, 2024-04-26T11:14:50.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:14:50.916 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.916 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.916 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.916 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.916 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.916 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:14:50.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.916 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:50.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:50.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:14:50.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:14:50.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:14:50.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:14:50.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:14:50.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:14:50.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:14:50.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:14:50.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:14:50.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:50.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:14:50.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:14:50.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:14:50.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:14:50.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:50.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:14:50.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:14:50.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:50.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:14:50.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:14:50.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:50.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:14:50.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:14:50.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:50.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:14:50.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:14:50.922 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.922 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.922 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.923 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101754 5.e 5:7ca15a5c:::benchmark_data_smithi029_44842_object101753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:50.923 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:50.923 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 31.749856202, 2024-04-26T11:14:50.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039171048999999999, 2024-04-26T11:14:50.923 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.923 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.923 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.923 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.923 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.923 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101754 2024-04-26T11:14:50.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.923 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:50.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:50.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:50.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118604+0000", 2024-04-26T11:14:50.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3399000000000007e-05 2024-04-26T11:14:50.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118613+0000", 2024-04-26T11:14:50.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6989999999999992e-06 2024-04-26T11:14:50.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118618+0000", 2024-04-26T11:14:50.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3850000000000001e-06 2024-04-26T11:14:50.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118646+0000", 2024-04-26T11:14:50.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7878e-05 2024-04-26T11:14:50.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:50.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118720+0000", 2024-04-26T11:14:50.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3461999999999996e-05 2024-04-26T11:14:50.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:50.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118807+0000", 2024-04-26T11:14:50.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7269999999999996e-05 2024-04-26T11:14:50.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:50.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142317+0000", 2024-04-26T11:14:50.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023510105999999999 2024-04-26T11:14:50.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:50.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.143287+0000", 2024-04-26T11:14:50.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096983599999999996 2024-04-26T11:14:50.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:50.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157662+0000", 2024-04-26T11:14:50.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014375393 2024-04-26T11:14:50.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:50.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157702+0000", 2024-04-26T11:14:50.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0295e-05 2024-04-26T11:14:50.928 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.928 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.928 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.928 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101755 5.f 5:fa973a83:::benchmark_data_smithi029_44842_object101754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:50.928 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:50.928 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 31.749690506, 2024-04-26T11:14:50.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039139064000000001, 2024-04-26T11:14:50.928 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.928 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.929 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.929 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.929 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.929 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101755 2024-04-26T11:14:50.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.929 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:50.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:50.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118696+0000", 2024-04-26T11:14:50.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118766+0000", 2024-04-26T11:14:50.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9423000000000003e-05 2024-04-26T11:14:50.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118774+0000", 2024-04-26T11:14:50.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9710000000000004e-06 2024-04-26T11:14:50.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118779+0000", 2024-04-26T11:14:50.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5629999999999999e-06 2024-04-26T11:14:50.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118817+0000", 2024-04-26T11:14:50.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7771000000000001e-05 2024-04-26T11:14:50.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:50.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118929+0000", 2024-04-26T11:14:50.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011222699999999999 2024-04-26T11:14:50.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:50.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157661+0000", 2024-04-26T11:14:50.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038731120000000001 2024-04-26T11:14:50.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:50.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157757+0000", 2024-04-26T11:14:50.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6910000000000006e-05 2024-04-26T11:14:50.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:50.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157836+0000", 2024-04-26T11:14:50.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8727999999999996e-05 2024-04-26T11:14:50.933 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.933 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.933 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.933 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101758 5.4 5:2525a4eb:::benchmark_data_smithi029_44842_object101757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:50.933 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:50.933 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 31.747507655, 2024-04-26T11:14:50.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.03686739, 2024-04-26T11:14:50.933 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.934 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.934 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.934 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.934 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.934 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101758 2024-04-26T11:14:50.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.934 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:50.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:50.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120879+0000", 2024-04-26T11:14:50.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120971+0000", 2024-04-26T11:14:50.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2133999999999996e-05 2024-04-26T11:14:50.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120977+0000", 2024-04-26T11:14:50.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5509999999999999e-06 2024-04-26T11:14:50.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120981+0000", 2024-04-26T11:14:50.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.245e-06 2024-04-26T11:14:50.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121010+0000", 2024-04-26T11:14:50.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9084000000000001e-05 2024-04-26T11:14:50.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:50.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121083+0000", 2024-04-26T11:14:50.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2942999999999996e-05 2024-04-26T11:14:50.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:50.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121163+0000", 2024-04-26T11:14:50.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0197000000000005e-05 2024-04-26T11:14:50.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:50.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142822+0000", 2024-04-26T11:14:50.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021658535999999999 2024-04-26T11:14:50.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:50.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157674+0000", 2024-04-26T11:14:50.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014851573999999999 2024-04-26T11:14:50.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:50.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157714+0000", 2024-04-26T11:14:50.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0473999999999999e-05 2024-04-26T11:14:50.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:50.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157747+0000", 2024-04-26T11:14:50.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3278999999999998e-05 2024-04-26T11:14:50.938 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.939 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.939 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.939 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101760 5.4 5:2510211a:::benchmark_data_smithi029_44842_object101759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:50.939 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:50.939 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 31.74707531, 2024-04-26T11:14:50.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039182383000000001, 2024-04-26T11:14:50.939 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.939 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.939 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.939 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.939 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.939 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101760 2024-04-26T11:14:50.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.940 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:50.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:50.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:50.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121389+0000", 2024-04-26T11:14:50.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6667000000000003e-05 2024-04-26T11:14:50.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121394+0000", 2024-04-26T11:14:50.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0839999999999999e-06 2024-04-26T11:14:50.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121397+0000", 2024-04-26T11:14:50.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4489999999999999e-06 2024-04-26T11:14:50.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122921+0000", 2024-04-26T11:14:50.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001524067 2024-04-26T11:14:50.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:50.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.123010+0000", 2024-04-26T11:14:50.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8449000000000006e-05 2024-04-26T11:14:50.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:50.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140838+0000", 2024-04-26T11:14:50.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017828796000000001 2024-04-26T11:14:50.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:50.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157665+0000", 2024-04-26T11:14:50.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016826574 2024-04-26T11:14:50.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:50.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160407+0000", 2024-04-26T11:14:50.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027423970000000002 2024-04-26T11:14:50.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:50.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160456+0000", 2024-04-26T11:14:50.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8678999999999999e-05 2024-04-26T11:14:50.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:50.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160495+0000", 2024-04-26T11:14:50.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8658000000000002e-05 2024-04-26T11:14:50.944 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.944 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.944 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.945 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101761 5.e 5:70294421:::benchmark_data_smithi029_44842_object101760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:50.945 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:50.945 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 31.745650937000001, 2024-04-26T11:14:50.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035270448000000003, 2024-04-26T11:14:50.945 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.945 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.945 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.945 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.945 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.945 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101761 2024-04-26T11:14:50.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.945 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:50.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:50.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122736+0000", 2024-04-26T11:14:50.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122805+0000", 2024-04-26T11:14:50.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9076000000000001e-05 2024-04-26T11:14:50.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122811+0000", 2024-04-26T11:14:50.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:14:50.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122815+0000", 2024-04-26T11:14:50.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2860000000000001e-06 2024-04-26T11:14:50.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122842+0000", 2024-04-26T11:14:50.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6429000000000001e-05 2024-04-26T11:14:50.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:50.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122916+0000", 2024-04-26T11:14:50.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4122999999999995e-05 2024-04-26T11:14:50.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:50.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122997+0000", 2024-04-26T11:14:50.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1428999999999996e-05 2024-04-26T11:14:50.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:50.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142344+0000", 2024-04-26T11:14:50.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019346452 2024-04-26T11:14:50.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:50.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157934+0000", 2024-04-26T11:14:50.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015589911999999999 2024-04-26T11:14:50.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:50.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157975+0000", 2024-04-26T11:14:50.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1604999999999999e-05 2024-04-26T11:14:50.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:50.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.158007+0000", 2024-04-26T11:14:50.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1921000000000002e-05 2024-04-26T11:14:50.950 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.950 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.950 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.950 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110145 5.9 5:9b275f16:::benchmark_data_smithi029_44842_object110144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:50.950 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:50.950 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.720089299000001, 2024-04-26T11:14:50.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032844496000000001, 2024-04-26T11:14:50.951 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.951 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.951 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.951 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.951 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.951 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110145 2024-04-26T11:14:50.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.951 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:50.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:50.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148297+0000", 2024-04-26T11:14:50.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:50.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148325+0000", 2024-04-26T11:14:50.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7511000000000001e-05 2024-04-26T11:14:50.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148338+0000", 2024-04-26T11:14:50.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2808e-05 2024-04-26T11:14:50.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148345+0000", 2024-04-26T11:14:50.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7200000000000006e-06 2024-04-26T11:14:50.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149888+0000", 2024-04-26T11:14:50.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001542666 2024-04-26T11:14:50.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:50.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149977+0000", 2024-04-26T11:14:50.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9247999999999997e-05 2024-04-26T11:14:50.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:50.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181006+0000", 2024-04-26T11:14:50.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031028535999999999 2024-04-26T11:14:50.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:50.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181051+0000", 2024-04-26T11:14:50.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5393999999999999e-05 2024-04-26T11:14:50.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:50.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181143+0000", 2024-04-26T11:14:50.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1458000000000004e-05 2024-04-26T11:14:50.955 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.955 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.955 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.956 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110155 5.9 5:9ebc6158:::benchmark_data_smithi029_44842_object110154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:50.956 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:50.956 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 27.715013506999998, 2024-04-26T11:14:50.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027886826999999999, 2024-04-26T11:14:50.956 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.956 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.956 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.956 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.956 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.956 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110155 2024-04-26T11:14:50.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.956 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:50.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:50.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153373+0000", 2024-04-26T11:14:50.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153479+0000", 2024-04-26T11:14:50.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105728 2024-04-26T11:14:50.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153491+0000", 2024-04-26T11:14:50.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2207e-05 2024-04-26T11:14:50.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153499+0000", 2024-04-26T11:14:50.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7729999999999999e-06 2024-04-26T11:14:50.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153655+0000", 2024-04-26T11:14:50.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015573 2024-04-26T11:14:50.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:50.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153770+0000", 2024-04-26T11:14:50.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011562500000000001 2024-04-26T11:14:50.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:50.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181153+0000", 2024-04-26T11:14:50.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027382113 2024-04-26T11:14:50.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:50.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181195+0000", 2024-04-26T11:14:50.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1921000000000001e-05 2024-04-26T11:14:50.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:50.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181261+0000", 2024-04-26T11:14:50.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6402999999999994e-05 2024-04-26T11:14:50.960 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.960 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.960 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.961 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174398 5.4 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:50.961 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:14:50.961 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.51849729499999997, 2024-04-26T11:14:50.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.064773789999999998, 2024-04-26T11:14:50.961 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.961 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.961 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.961 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.961 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.961 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174398 2024-04-26T11:14:50.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.961 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:14:50.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:14:50.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349889+0000", 2024-04-26T11:14:50.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:50.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349895+0000", 2024-04-26T11:14:50.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4519999999999996e-06 2024-04-26T11:14:50.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349909+0000", 2024-04-26T11:14:50.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3791000000000001e-05 2024-04-26T11:14:50.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349919+0000", 2024-04-26T11:14:50.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0135999999999999e-05 2024-04-26T11:14:50.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349956+0000", 2024-04-26T11:14:50.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7642000000000003e-05 2024-04-26T11:14:50.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:50.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350080+0000", 2024-04-26T11:14:50.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123285 2024-04-26T11:14:50.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:50.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350192+0000", 2024-04-26T11:14:50.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112509 2024-04-26T11:14:50.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:50.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356232+0000", 2024-04-26T11:14:50.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060403339999999996 2024-04-26T11:14:50.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:50.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414616+0000", 2024-04-26T11:14:50.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.058383156999999998 2024-04-26T11:14:50.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:50.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414643+0000", 2024-04-26T11:14:50.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7317e-05 2024-04-26T11:14:50.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414664+0000", 2024-04-26T11:14:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1135999999999999e-05 2024-04-26T11:14:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174402 5.b 5:d8ad746d:::benchmark_data_smithi029_44842_object29764:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:14:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.51454310599999997, 2024-04-26T11:14:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059017657000000001, 2024-04-26T11:14:50.966 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174402 2024-04-26T11:14:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:14:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:14:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:14:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353848+0000", 2024-04-26T11:14:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5040000000000004e-06 2024-04-26T11:14:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353858+0000", 2024-04-26T11:14:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7410000000000004e-06 2024-04-26T11:14:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353864+0000", 2024-04-26T11:14:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7899999999999996e-06 2024-04-26T11:14:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353902+0000", 2024-04-26T11:14:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8325000000000003e-05 2024-04-26T11:14:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353980+0000", 2024-04-26T11:14:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8077000000000005e-05 2024-04-26T11:14:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354046+0000", 2024-04-26T11:14:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6249999999999998e-05 2024-04-26T11:14:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356532+0000", 2024-04-26T11:14:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024850969999999999 2024-04-26T11:14:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412796+0000", 2024-04-26T11:14:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056264616000000003 2024-04-26T11:14:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412835+0000", 2024-04-26T11:14:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8863999999999999e-05 2024-04-26T11:14:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412862+0000", 2024-04-26T11:14:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7124e-05 2024-04-26T11:14:50.971 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174403 5.4 5:2d30cd6a:::benchmark_data_smithi029_44842_object29765:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:14:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.51451590300000005, 2024-04-26T11:14:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.060873365999999998, 2024-04-26T11:14:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.972 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174403 2024-04-26T11:14:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:14:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:14:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353871+0000", 2024-04-26T11:14:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353874+0000", 2024-04-26T11:14:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869999999999999e-06 2024-04-26T11:14:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353881+0000", 2024-04-26T11:14:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2239999999999998e-06 2024-04-26T11:14:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353886+0000", 2024-04-26T11:14:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.259e-06 2024-04-26T11:14:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353912+0000", 2024-04-26T11:14:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6404999999999999e-05 2024-04-26T11:14:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353991+0000", 2024-04-26T11:14:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8104999999999998e-05 2024-04-26T11:14:50.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354055+0000", 2024-04-26T11:14:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4875999999999993e-05 2024-04-26T11:14:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.358000+0000", 2024-04-26T11:14:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039442629999999999 2024-04-26T11:14:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414690+0000", 2024-04-26T11:14:50.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056689940000000001 2024-04-26T11:14:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414714+0000", 2024-04-26T11:14:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4527000000000001e-05 2024-04-26T11:14:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414745+0000", 2024-04-26T11:14:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0874999999999998e-05 2024-04-26T11:14:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174404 5.4 5:2801f1e1:::benchmark_data_smithi029_44842_object29766:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:14:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.51189897900000003, 2024-04-26T11:14:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059745741999999998, 2024-04-26T11:14:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174404 2024-04-26T11:14:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:50.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:14:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:14:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356488+0000", 2024-04-26T11:14:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:50.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356492+0000", 2024-04-26T11:14:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1169999999999997e-06 2024-04-26T11:14:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356502+0000", 2024-04-26T11:14:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0263e-05 2024-04-26T11:14:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356508+0000", 2024-04-26T11:14:50.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5890000000000002e-06 2024-04-26T11:14:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356545+0000", 2024-04-26T11:14:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7382999999999998e-05 2024-04-26T11:14:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356671+0000", 2024-04-26T11:14:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012535500000000001 2024-04-26T11:14:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356789+0000", 2024-04-26T11:14:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000118099 2024-04-26T11:14:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.359200+0000", 2024-04-26T11:14:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024110059999999998 2024-04-26T11:14:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416180+0000", 2024-04-26T11:14:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056980335999999999 2024-04-26T11:14:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416204+0000", 2024-04-26T11:14:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4301e-05 2024-04-26T11:14:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416234+0000", 2024-04-26T11:14:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9903000000000002e-05 2024-04-26T11:14:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:50.983 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:50.983 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:50.985 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:50.986 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:50.984+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:50.986 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:51.007 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:51.007 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:51.007 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:51.008 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:51.010 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:51.010 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:51.085 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:51.084+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:51.179 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:51.179 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:51.186 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:51.184+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:51.194 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:51.287 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:51.286+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:51.388 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:51.386+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:51.425 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:51.425 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:51.442 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:51.529 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:51.525+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:51.590 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~53s 2024-04-26T11:14:51.590 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:51.589+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:51.666 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:51.667 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:51.674 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is set 2024-04-26T11:14:51.682 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:51.728 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:51.727+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:51.792 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:51.790+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:51.858 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:51.858 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:51.874 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:51.894 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:51.891+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:51.994 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:51.993+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:52.088 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:52.088 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:52.095 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:52.093+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:52.102 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:52.199 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:52.197+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:52.296 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:52.295+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:52.316 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:52.316 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:52.329 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:52.398 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:52.397+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:52.498 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:52.497+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:52.526 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:52.526 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:52.540 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:52.599 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:52.597+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:52.700 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:52.699+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:52.775 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:52.775 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:52.790 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:52.800 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:52.799+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:52.902 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:52.900+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:53.004 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:53.003+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:53.011 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:14:53.022 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:53.022 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:53.037 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:53.103 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:53.102+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:53.167 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:53.189 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:53.189 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:53.189 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:53.189 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:53.191 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:53.192 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:53.204 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:53.203+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:53.220 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:182313 5.8 5:132ae2ee:::benchmark_data_smithi029_44842_object37675:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T11:14:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:53.212836+0000", 2024-04-26T11:14:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0055482090000000001, 2024-04-26T11:14:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0055692509999999999, 2024-04-26T11:14:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.220 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 182313 2024-04-26T11:14:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.212836+0000", 2024-04-26T11:14:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.212836+0000", 2024-04-26T11:14:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.212835+0000", 2024-04-26T11:14:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.212839+0000", 2024-04-26T11:14:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1069999999999998e-06 2024-04-26T11:14:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.212849+0000", 2024-04-26T11:14:53.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.3349999999999996e-06 2024-04-26T11:14:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.212855+0000", 2024-04-26T11:14:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4269999999999996e-06 2024-04-26T11:14:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.212894+0000", 2024-04-26T11:14:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8546e-05 2024-04-26T11:14:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.213009+0000", 2024-04-26T11:14:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000115214 2024-04-26T11:14:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.213108+0000", 2024-04-26T11:14:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9272999999999996e-05 2024-04-26T11:14:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.217801+0000", 2024-04-26T11:14:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0046928810000000003 2024-04-26T11:14:53.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.218338+0000", 2024-04-26T11:14:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00053748000000000001 2024-04-26T11:14:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.218380+0000", 2024-04-26T11:14:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1900000000000002e-05 2024-04-26T11:14:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.218415+0000", 2024-04-26T11:14:53.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4421000000000001e-05 2024-04-26T11:14:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:182316 5.e 5:79251b38:::benchmark_data_smithi029_44842_object37678:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T11:14:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:53.214342+0000", 2024-04-26T11:14:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0040422000000000001, 2024-04-26T11:14:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0041330799999999999, 2024-04-26T11:14:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.226 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 182316 2024-04-26T11:14:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.214342+0000", 2024-04-26T11:14:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.214342+0000", 2024-04-26T11:14:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.214342+0000", 2024-04-26T11:14:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.214345+0000", 2024-04-26T11:14:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1310000000000002e-06 2024-04-26T11:14:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.214353+0000", 2024-04-26T11:14:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9889999999999992e-06 2024-04-26T11:14:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.214359+0000", 2024-04-26T11:14:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0179999999999998e-06 2024-04-26T11:14:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.214392+0000", 2024-04-26T11:14:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3206e-05 2024-04-26T11:14:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.214511+0000", 2024-04-26T11:14:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011937799999999999 2024-04-26T11:14:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.214626+0000", 2024-04-26T11:14:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000115173 2024-04-26T11:14:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.217489+0000", 2024-04-26T11:14:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0028630159999999999 2024-04-26T11:14:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.230 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:182317 5.f 5:f628e3e5:::benchmark_data_smithi029_44842_object37679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T11:14:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:53.215191+0000", 2024-04-26T11:14:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0031932229999999998, 2024-04-26T11:14:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0033325360000000001, 2024-04-26T11:14:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 182317 2024-04-26T11:14:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.231 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215191+0000", 2024-04-26T11:14:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215191+0000", 2024-04-26T11:14:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215190+0000", 2024-04-26T11:14:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:53.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215195+0000", 2024-04-26T11:14:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6530000000000002e-06 2024-04-26T11:14:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215207+0000", 2024-04-26T11:14:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1537e-05 2024-04-26T11:14:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215214+0000", 2024-04-26T11:14:53.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5959999999999998e-06 2024-04-26T11:14:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215251+0000", 2024-04-26T11:14:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6807999999999997e-05 2024-04-26T11:14:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215385+0000", 2024-04-26T11:14:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013381100000000001 2024-04-26T11:14:53.234 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:182318 5.9 5:980bf894:::benchmark_data_smithi029_44842_object37680:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T11:14:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:53.215344+0000", 2024-04-26T11:14:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0030398830000000002, 2024-04-26T11:14:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003217714, 2024-04-26T11:14:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.235 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 182318 2024-04-26T11:14:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215344+0000", 2024-04-26T11:14:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215344+0000", 2024-04-26T11:14:53.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215344+0000", 2024-04-26T11:14:53.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:53.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215348+0000", 2024-04-26T11:14:53.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6720000000000003e-06 2024-04-26T11:14:53.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215357+0000", 2024-04-26T11:14:53.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1360000000000003e-06 2024-04-26T11:14:53.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215365+0000", 2024-04-26T11:14:53.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2520000000000002e-06 2024-04-26T11:14:53.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215407+0000", 2024-04-26T11:14:53.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1986000000000001e-05 2024-04-26T11:14:53.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215505+0000", 2024-04-26T11:14:53.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8573999999999995e-05 2024-04-26T11:14:53.242 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.242 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.242 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.243 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:182319 5.8 5:11984701:::benchmark_data_smithi029_44842_object37681:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T11:14:53.243 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:53.215418+0000", 2024-04-26T11:14:53.243 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0029658789999999998, 2024-04-26T11:14:53.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0031808689999999998, 2024-04-26T11:14:53.243 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.244 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:53.244 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.244 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.244 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.244 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 182319 2024-04-26T11:14:53.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.245 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215418+0000", 2024-04-26T11:14:53.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215418+0000", 2024-04-26T11:14:53.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215418+0000", 2024-04-26T11:14:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215421+0000", 2024-04-26T11:14:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.252e-06 2024-04-26T11:14:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215428+0000", 2024-04-26T11:14:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6640000000000001e-06 2024-04-26T11:14:53.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215435+0000", 2024-04-26T11:14:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1300000000000003e-06 2024-04-26T11:14:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215525+0000", 2024-04-26T11:14:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9587999999999997e-05 2024-04-26T11:14:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215637+0000", 2024-04-26T11:14:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011257200000000001 2024-04-26T11:14:53.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215745+0000", 2024-04-26T11:14:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010785000000000001 2024-04-26T11:14:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:182322 5.a 5:5459d00d:::benchmark_data_smithi029_44842_object37684:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T11:14:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:53.215602+0000", 2024-04-26T11:14:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.002782601, 2024-04-26T11:14:53.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0030381290000000001, 2024-04-26T11:14:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 182322 2024-04-26T11:14:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215602+0000", 2024-04-26T11:14:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215602+0000", 2024-04-26T11:14:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215601+0000", 2024-04-26T11:14:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215605+0000", 2024-04-26T11:14:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.07e-06 2024-04-26T11:14:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215614+0000", 2024-04-26T11:14:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3699999999999995e-06 2024-04-26T11:14:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215620+0000", 2024-04-26T11:14:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.5889999999999999e-06 2024-04-26T11:14:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215655+0000", 2024-04-26T11:14:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5160000000000002e-05 2024-04-26T11:14:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215763+0000", 2024-04-26T11:14:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107404 2024-04-26T11:14:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.215915+0000", 2024-04-26T11:14:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015224600000000001 2024-04-26T11:14:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.256 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:182327 5.e 5:700f3ce4:::benchmark_data_smithi029_44842_object37689:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T11:14:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:53.217989+0000", 2024-04-26T11:14:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00039494999999999998, 2024-04-26T11:14:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00069296400000000001, 2024-04-26T11:14:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 182327 2024-04-26T11:14:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.217989+0000", 2024-04-26T11:14:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.217989+0000", 2024-04-26T11:14:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.217988+0000", 2024-04-26T11:14:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.217992+0000", 2024-04-26T11:14:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5130000000000001e-06 2024-04-26T11:14:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.217999+0000", 2024-04-26T11:14:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1790000000000002e-06 2024-04-26T11:14:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.218004+0000", 2024-04-26T11:14:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.544e-06 2024-04-26T11:14:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.218027+0000", 2024-04-26T11:14:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3683e-05 2024-04-26T11:14:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.218140+0000", 2024-04-26T11:14:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112378 2024-04-26T11:14:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.218210+0000", 2024-04-26T11:14:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0068999999999996e-05 2024-04-26T11:14:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.260 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:182328 5.0 5:0c7f6209:::benchmark_data_smithi029_44842_object37690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T11:14:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:53.218014+0000", 2024-04-26T11:14:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00037000800000000001, 2024-04-26T11:14:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00070859700000000005, 2024-04-26T11:14:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.261 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 182328 2024-04-26T11:14:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.218014+0000", 2024-04-26T11:14:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.218014+0000", 2024-04-26T11:14:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.218014+0000", 2024-04-26T11:14:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.218016+0000", 2024-04-26T11:14:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5100000000000001e-06 2024-04-26T11:14:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.218022+0000", 2024-04-26T11:14:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7899999999999996e-06 2024-04-26T11:14:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.218028+0000", 2024-04-26T11:14:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.378e-06 2024-04-26T11:14:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.218065+0000", 2024-04-26T11:14:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7092000000000003e-05 2024-04-26T11:14:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.218165+0000", 2024-04-26T11:14:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010045899999999999 2024-04-26T11:14:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.218280+0000", 2024-04-26T11:14:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000114957 2024-04-26T11:14:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:182329 5.9 5:930001a9:::benchmark_data_smithi029_44842_object37691:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T11:14:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:53.218037+0000", 2024-04-26T11:14:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00034728599999999998, 2024-04-26T11:14:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00072590199999999995, 2024-04-26T11:14:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:53.265 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 182329 2024-04-26T11:14:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.218037+0000", 2024-04-26T11:14:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.218037+0000", 2024-04-26T11:14:53.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.218037+0000", 2024-04-26T11:14:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.218039+0000", 2024-04-26T11:14:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4200000000000001e-06 2024-04-26T11:14:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.218045+0000", 2024-04-26T11:14:53.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.891e-06 2024-04-26T11:14:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.218051+0000", 2024-04-26T11:14:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0700000000000003e-06 2024-04-26T11:14:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.218085+0000", 2024-04-26T11:14:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3566999999999999e-05 2024-04-26T11:14:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.218214+0000", 2024-04-26T11:14:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012967 2024-04-26T11:14:53.268 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.269 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.269 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.269 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:182305 5.b 5:d74ede7a:::benchmark_data_smithi029_44842_object37667:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T11:14:53.269 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:53.210331+0000", 2024-04-26T11:14:53.269 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0080534219999999993, 2024-04-26T11:14:53.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0084690379999999999, 2024-04-26T11:14:53.269 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.269 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:53.269 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.269 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.269 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.269 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 182305 2024-04-26T11:14:53.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.270 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.210331+0000", 2024-04-26T11:14:53.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.210331+0000", 2024-04-26T11:14:53.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.210331+0000", 2024-04-26T11:14:53.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:53.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.210333+0000", 2024-04-26T11:14:53.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3039999999999999e-06 2024-04-26T11:14:53.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.210338+0000", 2024-04-26T11:14:53.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3759999999999999e-06 2024-04-26T11:14:53.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.210343+0000", 2024-04-26T11:14:53.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5569999999999997e-06 2024-04-26T11:14:53.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.213924+0000", 2024-04-26T11:14:53.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035812130000000002 2024-04-26T11:14:53.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.214060+0000", 2024-04-26T11:14:53.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013645000000000001 2024-04-26T11:14:53.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:53.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.214193+0000", 2024-04-26T11:14:53.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000133013 2024-04-26T11:14:53.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:53.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:53.217358+0000", 2024-04-26T11:14:53.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0031644170000000001 2024-04-26T11:14:53.273 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.273 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.273 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.273 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.273 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:14:53.273 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 10 2024-04-26T11:14:53.273 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:53.275 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:53.305 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:53.304+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:53.406 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:53.405+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:53.490 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:53.490 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:14:53.490 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:14:53.490 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:14:53.490 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:53.502 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:53.507 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:53.506+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:53.608 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:53.607+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:53.675 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:53.675 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:14:53.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:14:53.675 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:53.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.675 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:53.675 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:53.676 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.392438468000002, 2024-04-26T11:14:53.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:14:53.676 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.676 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:53.676 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.676 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.676 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.676 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:14:53.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.676 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.676 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.676 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:53.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:53.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:53.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:53.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:14:53.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:14:53.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:14:53.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:14:53.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:14:53.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:14:53.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:14:53.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:14:53.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:14:53.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:14:53.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:53.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:14:53.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:14:53.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:53.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:14:53.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:14:53.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:53.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:14:53.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:14:53.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:53.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:14:53.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:14:53.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.681 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:53.681 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:14:53.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:14:53.681 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.681 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.681 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.681 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:53.681 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:53.681 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.391788765999998, 2024-04-26T11:14:53.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:14:53.682 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.682 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:53.682 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.682 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.682 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.682 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:14:53.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.682 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:53.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:53.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:14:53.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:53.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:14:53.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:14:53.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:14:53.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:14:53.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:14:53.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:14:53.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:14:53.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:14:53.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:14:53.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:14:53.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:53.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:14:53.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:14:53.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:53.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:14:53.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:14:53.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:53.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:14:53.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:14:53.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:53.686 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:14:53.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:14:53.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.686 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:53.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:14:53.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:14:53.687 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.687 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.687 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.687 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:53.687 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:53.687 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.325146727000003, 2024-04-26T11:14:53.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:14:53.687 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.687 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:53.687 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.688 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.688 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.688 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:14:53.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.688 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:53.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:53.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:14:53.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:53.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:14:53.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:14:53.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:14:53.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:14:53.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:14:53.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:14:53.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:14:53.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:14:53.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:53.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:14:53.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:14:53.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:14:53.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:14:53.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:53.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:14:53.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:14:53.691 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.692 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.692 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.692 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:53.692 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:53.692 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.325051080999998, 2024-04-26T11:14:53.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:14:53.692 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.692 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:53.692 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.692 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.692 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.692 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:14:53.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.693 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:53.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:53.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:14:53.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:53.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:14:53.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:14:53.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:14:53.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:14:53.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:14:53.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:14:53.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:14:53.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:14:53.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:53.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:14:53.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:14:53.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:14:53.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:14:53.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:53.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:14:53.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:14:53.696 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.696 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.696 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.697 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:53.697 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:53.697 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.324919401999999, 2024-04-26T11:14:53.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:14:53.697 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.697 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:53.697 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.697 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.697 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.697 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:14:53.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.697 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:53.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:53.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:53.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:53.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:14:53.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:14:53.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:14:53.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:14:53.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:14:53.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:14:53.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:14:53.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:14:53.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:53.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:14:53.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:14:53.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:14:53.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:14:53.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:53.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:14:53.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:14:53.701 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.701 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.701 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.701 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:53.701 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:53.702 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.324810945999999, 2024-04-26T11:14:53.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:14:53.702 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.702 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:53.702 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.702 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.702 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.702 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:14:53.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.702 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:53.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:53.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:14:53.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:53.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:14:53.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:14:53.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:14:53.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:14:53.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:14:53.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:14:53.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:14:53.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:14:53.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:53.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:14:53.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:14:53.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:14:53.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:14:53.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:53.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:14:53.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:14:53.706 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.706 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.706 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.706 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:53.706 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:53.706 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.324709677999998, 2024-04-26T11:14:53.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:14:53.707 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.707 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:53.707 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.707 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.707 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.707 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:14:53.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.707 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:53.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:53.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:53.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:53.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:14:53.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:14:53.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:14:53.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:14:53.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:14:53.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:14:53.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:14:53.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:14:53.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:53.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:14:53.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:14:53.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:14:53.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:14:53.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:14:53.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:14:53.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:53.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:14:53.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:14:53.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:53.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:14:53.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:14:53.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:53.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:14:53.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:14:53.711 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.711 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.712 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.712 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:53.712 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:53.712 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.324640737000003, 2024-04-26T11:14:53.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:14:53.712 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.712 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:53.712 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.712 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.712 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.712 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:14:53.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.712 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:53.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:53.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:14:53.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:53.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:14:53.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:14:53.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:14:53.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:14:53.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:14:53.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:14:53.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:14:53.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:14:53.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:53.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:14:53.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:14:53.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:14:53.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:14:53.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:14:53.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:14:53.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:53.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:14:53.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:14:53.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:53.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:14:53.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:14:53.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:53.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:14:53.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:14:53.717 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.717 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.717 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.718 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:53.718 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:53.718 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 56.318645156000002, 2024-04-26T11:14:53.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:14:53.718 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.718 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:53.718 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.718 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.718 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.718 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:14:53.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.718 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:53.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:53.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:14:53.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:53.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:14:53.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:14:53.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:14:53.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:14:53.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:14:53.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:14:53.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:14:53.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:14:53.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:53.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:14:53.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:14:53.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:14:53.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:14:53.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:14:53.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:14:53.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:53.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:14:53.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:14:53.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:53.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:14:53.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:14:53.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:53.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:14:53.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:14:53.723 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.723 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.723 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.723 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101754 5.e 5:7ca15a5c:::benchmark_data_smithi029_44842_object101753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:53.723 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:53.723 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.552697414000001, 2024-04-26T11:14:53.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039171048999999999, 2024-04-26T11:14:53.724 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.724 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:53.724 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.724 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.724 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.724 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101754 2024-04-26T11:14:53.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.724 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.724 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.724 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:53.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:53.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:53.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:53.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118604+0000", 2024-04-26T11:14:53.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3399000000000007e-05 2024-04-26T11:14:53.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118613+0000", 2024-04-26T11:14:53.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6989999999999992e-06 2024-04-26T11:14:53.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118618+0000", 2024-04-26T11:14:53.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3850000000000001e-06 2024-04-26T11:14:53.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118646+0000", 2024-04-26T11:14:53.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7878e-05 2024-04-26T11:14:53.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118720+0000", 2024-04-26T11:14:53.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3461999999999996e-05 2024-04-26T11:14:53.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:53.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118807+0000", 2024-04-26T11:14:53.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7269999999999996e-05 2024-04-26T11:14:53.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:53.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142317+0000", 2024-04-26T11:14:53.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023510105999999999 2024-04-26T11:14:53.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:53.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.143287+0000", 2024-04-26T11:14:53.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096983599999999996 2024-04-26T11:14:53.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:53.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157662+0000", 2024-04-26T11:14:53.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014375393 2024-04-26T11:14:53.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:53.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157702+0000", 2024-04-26T11:14:53.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0295e-05 2024-04-26T11:14:53.729 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.729 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.729 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.729 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101755 5.f 5:fa973a83:::benchmark_data_smithi029_44842_object101754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:53.729 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:53.729 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.552531717999997, 2024-04-26T11:14:53.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039139064000000001, 2024-04-26T11:14:53.729 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.729 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:53.730 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.730 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.730 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.730 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101755 2024-04-26T11:14:53.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.730 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:53.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:53.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118696+0000", 2024-04-26T11:14:53.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:53.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118766+0000", 2024-04-26T11:14:53.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9423000000000003e-05 2024-04-26T11:14:53.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118774+0000", 2024-04-26T11:14:53.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9710000000000004e-06 2024-04-26T11:14:53.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118779+0000", 2024-04-26T11:14:53.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5629999999999999e-06 2024-04-26T11:14:53.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118817+0000", 2024-04-26T11:14:53.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7771000000000001e-05 2024-04-26T11:14:53.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118929+0000", 2024-04-26T11:14:53.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011222699999999999 2024-04-26T11:14:53.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:53.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157661+0000", 2024-04-26T11:14:53.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038731120000000001 2024-04-26T11:14:53.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:53.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157757+0000", 2024-04-26T11:14:53.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6910000000000006e-05 2024-04-26T11:14:53.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:53.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157836+0000", 2024-04-26T11:14:53.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8727999999999996e-05 2024-04-26T11:14:53.734 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.734 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.734 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.734 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101758 5.4 5:2525a4eb:::benchmark_data_smithi029_44842_object101757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:53.734 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:53.734 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.550348866999997, 2024-04-26T11:14:53.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.03686739, 2024-04-26T11:14:53.734 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.735 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:53.735 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.735 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.735 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.735 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101758 2024-04-26T11:14:53.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.735 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:53.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:53.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120879+0000", 2024-04-26T11:14:53.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:53.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120971+0000", 2024-04-26T11:14:53.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2133999999999996e-05 2024-04-26T11:14:53.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120977+0000", 2024-04-26T11:14:53.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5509999999999999e-06 2024-04-26T11:14:53.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120981+0000", 2024-04-26T11:14:53.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.245e-06 2024-04-26T11:14:53.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121010+0000", 2024-04-26T11:14:53.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9084000000000001e-05 2024-04-26T11:14:53.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121083+0000", 2024-04-26T11:14:53.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2942999999999996e-05 2024-04-26T11:14:53.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:53.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121163+0000", 2024-04-26T11:14:53.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0197000000000005e-05 2024-04-26T11:14:53.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:53.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142822+0000", 2024-04-26T11:14:53.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021658535999999999 2024-04-26T11:14:53.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:53.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157674+0000", 2024-04-26T11:14:53.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014851573999999999 2024-04-26T11:14:53.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:53.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157714+0000", 2024-04-26T11:14:53.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0473999999999999e-05 2024-04-26T11:14:53.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:53.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157747+0000", 2024-04-26T11:14:53.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3278999999999998e-05 2024-04-26T11:14:53.739 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.739 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.739 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.740 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101760 5.4 5:2510211a:::benchmark_data_smithi029_44842_object101759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:53.740 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:53.740 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.549916521999997, 2024-04-26T11:14:53.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039182383000000001, 2024-04-26T11:14:53.740 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.740 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:53.740 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.740 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.740 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.740 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101760 2024-04-26T11:14:53.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.740 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:53.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:53.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:53.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:53.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121389+0000", 2024-04-26T11:14:53.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6667000000000003e-05 2024-04-26T11:14:53.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121394+0000", 2024-04-26T11:14:53.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0839999999999999e-06 2024-04-26T11:14:53.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121397+0000", 2024-04-26T11:14:53.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4489999999999999e-06 2024-04-26T11:14:53.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122921+0000", 2024-04-26T11:14:53.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001524067 2024-04-26T11:14:53.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.123010+0000", 2024-04-26T11:14:53.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8449000000000006e-05 2024-04-26T11:14:53.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.743 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:53.743 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140838+0000", 2024-04-26T11:14:53.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017828796000000001 2024-04-26T11:14:53.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:53.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157665+0000", 2024-04-26T11:14:53.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016826574 2024-04-26T11:14:53.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:53.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160407+0000", 2024-04-26T11:14:53.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027423970000000002 2024-04-26T11:14:53.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:53.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160456+0000", 2024-04-26T11:14:53.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8678999999999999e-05 2024-04-26T11:14:53.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:53.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160495+0000", 2024-04-26T11:14:53.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8658000000000002e-05 2024-04-26T11:14:53.745 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.745 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.745 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.745 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101761 5.e 5:70294421:::benchmark_data_smithi029_44842_object101760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:53.745 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:53.745 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.548492148999998, 2024-04-26T11:14:53.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035270448000000003, 2024-04-26T11:14:53.746 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.746 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:53.746 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.746 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.746 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.746 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101761 2024-04-26T11:14:53.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.746 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:53.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:53.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122736+0000", 2024-04-26T11:14:53.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:53.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122805+0000", 2024-04-26T11:14:53.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9076000000000001e-05 2024-04-26T11:14:53.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122811+0000", 2024-04-26T11:14:53.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:14:53.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122815+0000", 2024-04-26T11:14:53.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2860000000000001e-06 2024-04-26T11:14:53.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122842+0000", 2024-04-26T11:14:53.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6429000000000001e-05 2024-04-26T11:14:53.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122916+0000", 2024-04-26T11:14:53.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4122999999999995e-05 2024-04-26T11:14:53.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:53.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122997+0000", 2024-04-26T11:14:53.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1428999999999996e-05 2024-04-26T11:14:53.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.749 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:53.749 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142344+0000", 2024-04-26T11:14:53.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019346452 2024-04-26T11:14:53.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:53.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157934+0000", 2024-04-26T11:14:53.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015589911999999999 2024-04-26T11:14:53.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:53.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157975+0000", 2024-04-26T11:14:53.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1604999999999999e-05 2024-04-26T11:14:53.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:53.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.158007+0000", 2024-04-26T11:14:53.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1921000000000002e-05 2024-04-26T11:14:53.751 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.751 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.751 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.751 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110145 5.9 5:9b275f16:::benchmark_data_smithi029_44842_object110144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:53.751 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:53.751 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.522930510999998, 2024-04-26T11:14:53.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032844496000000001, 2024-04-26T11:14:53.751 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.751 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:53.751 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.751 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.752 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.752 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110145 2024-04-26T11:14:53.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.752 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:53.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:53.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148297+0000", 2024-04-26T11:14:53.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:53.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148325+0000", 2024-04-26T11:14:53.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7511000000000001e-05 2024-04-26T11:14:53.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148338+0000", 2024-04-26T11:14:53.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2808e-05 2024-04-26T11:14:53.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148345+0000", 2024-04-26T11:14:53.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7200000000000006e-06 2024-04-26T11:14:53.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149888+0000", 2024-04-26T11:14:53.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001542666 2024-04-26T11:14:53.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.754 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.754 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149977+0000", 2024-04-26T11:14:53.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9247999999999997e-05 2024-04-26T11:14:53.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:53.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181006+0000", 2024-04-26T11:14:53.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031028535999999999 2024-04-26T11:14:53.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:53.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181051+0000", 2024-04-26T11:14:53.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5393999999999999e-05 2024-04-26T11:14:53.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:53.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181143+0000", 2024-04-26T11:14:53.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1458000000000004e-05 2024-04-26T11:14:53.756 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.756 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.756 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.756 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110155 5.9 5:9ebc6158:::benchmark_data_smithi029_44842_object110154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:53.756 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:53.756 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.517854718999999, 2024-04-26T11:14:53.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027886826999999999, 2024-04-26T11:14:53.756 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.756 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:53.756 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.756 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.757 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.757 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110155 2024-04-26T11:14:53.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.757 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:53.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:53.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153373+0000", 2024-04-26T11:14:53.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:53.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153479+0000", 2024-04-26T11:14:53.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105728 2024-04-26T11:14:53.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153491+0000", 2024-04-26T11:14:53.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2207e-05 2024-04-26T11:14:53.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153499+0000", 2024-04-26T11:14:53.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7729999999999999e-06 2024-04-26T11:14:53.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153655+0000", 2024-04-26T11:14:53.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015573 2024-04-26T11:14:53.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153770+0000", 2024-04-26T11:14:53.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011562500000000001 2024-04-26T11:14:53.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:53.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181153+0000", 2024-04-26T11:14:53.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027382113 2024-04-26T11:14:53.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:53.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181195+0000", 2024-04-26T11:14:53.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1921000000000001e-05 2024-04-26T11:14:53.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.760 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:53.760 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181261+0000", 2024-04-26T11:14:53.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6402999999999994e-05 2024-04-26T11:14:53.761 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.761 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.761 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.761 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174398 5.4 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:53.761 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:14:53.761 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.3213385070000001, 2024-04-26T11:14:53.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.064773789999999998, 2024-04-26T11:14:53.761 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.761 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:53.761 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.761 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.761 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.761 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174398 2024-04-26T11:14:53.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.762 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:14:53.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:14:53.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349889+0000", 2024-04-26T11:14:53.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:53.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349895+0000", 2024-04-26T11:14:53.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4519999999999996e-06 2024-04-26T11:14:53.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349909+0000", 2024-04-26T11:14:53.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3791000000000001e-05 2024-04-26T11:14:53.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349919+0000", 2024-04-26T11:14:53.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0135999999999999e-05 2024-04-26T11:14:53.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349956+0000", 2024-04-26T11:14:53.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7642000000000003e-05 2024-04-26T11:14:53.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350080+0000", 2024-04-26T11:14:53.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123285 2024-04-26T11:14:53.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:53.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350192+0000", 2024-04-26T11:14:53.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112509 2024-04-26T11:14:53.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:53.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356232+0000", 2024-04-26T11:14:53.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060403339999999996 2024-04-26T11:14:53.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:53.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414616+0000", 2024-04-26T11:14:53.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.058383156999999998 2024-04-26T11:14:53.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:53.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414643+0000", 2024-04-26T11:14:53.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7317e-05 2024-04-26T11:14:53.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:53.766 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414664+0000", 2024-04-26T11:14:53.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1135999999999999e-05 2024-04-26T11:14:53.766 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.766 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.766 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.766 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174402 5.b 5:d8ad746d:::benchmark_data_smithi029_44842_object29764:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:53.766 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:14:53.767 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.3173843180000002, 2024-04-26T11:14:53.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059017657000000001, 2024-04-26T11:14:53.767 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.767 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:53.767 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.767 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.767 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.767 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174402 2024-04-26T11:14:53.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.767 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:14:53.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:14:53.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:14:53.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:53.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353848+0000", 2024-04-26T11:14:53.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5040000000000004e-06 2024-04-26T11:14:53.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353858+0000", 2024-04-26T11:14:53.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7410000000000004e-06 2024-04-26T11:14:53.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353864+0000", 2024-04-26T11:14:53.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7899999999999996e-06 2024-04-26T11:14:53.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353902+0000", 2024-04-26T11:14:53.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8325000000000003e-05 2024-04-26T11:14:53.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353980+0000", 2024-04-26T11:14:53.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8077000000000005e-05 2024-04-26T11:14:53.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:53.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354046+0000", 2024-04-26T11:14:53.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6249999999999998e-05 2024-04-26T11:14:53.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:53.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356532+0000", 2024-04-26T11:14:53.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024850969999999999 2024-04-26T11:14:53.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:53.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412796+0000", 2024-04-26T11:14:53.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056264616000000003 2024-04-26T11:14:53.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:53.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412835+0000", 2024-04-26T11:14:53.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8863999999999999e-05 2024-04-26T11:14:53.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.772 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:53.772 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412862+0000", 2024-04-26T11:14:53.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7124e-05 2024-04-26T11:14:53.772 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.772 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.772 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.772 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.772 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.772 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174403 5.4 5:2d30cd6a:::benchmark_data_smithi029_44842_object29765:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:53.772 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:14:53.772 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.3173571150000001, 2024-04-26T11:14:53.772 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.060873365999999998, 2024-04-26T11:14:53.773 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.773 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:53.773 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.773 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.773 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.773 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174403 2024-04-26T11:14:53.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.773 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.773 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:14:53.773 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.773 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.773 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.773 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:14:53.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353871+0000", 2024-04-26T11:14:53.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:53.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353874+0000", 2024-04-26T11:14:53.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869999999999999e-06 2024-04-26T11:14:53.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353881+0000", 2024-04-26T11:14:53.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2239999999999998e-06 2024-04-26T11:14:53.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353886+0000", 2024-04-26T11:14:53.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.259e-06 2024-04-26T11:14:53.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353912+0000", 2024-04-26T11:14:53.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6404999999999999e-05 2024-04-26T11:14:53.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353991+0000", 2024-04-26T11:14:53.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8104999999999998e-05 2024-04-26T11:14:53.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:53.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354055+0000", 2024-04-26T11:14:53.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4875999999999993e-05 2024-04-26T11:14:53.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:53.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.358000+0000", 2024-04-26T11:14:53.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039442629999999999 2024-04-26T11:14:53.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:53.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414690+0000", 2024-04-26T11:14:53.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056689940000000001 2024-04-26T11:14:53.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:53.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414714+0000", 2024-04-26T11:14:53.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4527000000000001e-05 2024-04-26T11:14:53.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:53.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414745+0000", 2024-04-26T11:14:53.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0874999999999998e-05 2024-04-26T11:14:53.778 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.778 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.778 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.778 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174404 5.4 5:2801f1e1:::benchmark_data_smithi029_44842_object29766:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:53.778 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:14:53.778 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.3147401909999998, 2024-04-26T11:14:53.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059745741999999998, 2024-04-26T11:14:53.778 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:53.778 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:53.778 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:53.778 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:53.778 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.779 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174404 2024-04-26T11:14:53.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.779 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:53.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:53.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:14:53.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:53.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:14:53.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:53.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:53.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356488+0000", 2024-04-26T11:14:53.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:53.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:53.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356492+0000", 2024-04-26T11:14:53.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1169999999999997e-06 2024-04-26T11:14:53.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:53.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356502+0000", 2024-04-26T11:14:53.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0263e-05 2024-04-26T11:14:53.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356508+0000", 2024-04-26T11:14:53.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5890000000000002e-06 2024-04-26T11:14:53.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:53.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356545+0000", 2024-04-26T11:14:53.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7382999999999998e-05 2024-04-26T11:14:53.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:53.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356671+0000", 2024-04-26T11:14:53.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012535500000000001 2024-04-26T11:14:53.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:53.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356789+0000", 2024-04-26T11:14:53.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000118099 2024-04-26T11:14:53.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:53.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.359200+0000", 2024-04-26T11:14:53.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024110059999999998 2024-04-26T11:14:53.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:53.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416180+0000", 2024-04-26T11:14:53.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056980335999999999 2024-04-26T11:14:53.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:53.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416204+0000", 2024-04-26T11:14:53.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4301e-05 2024-04-26T11:14:53.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:53.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:53.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:53.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416234+0000", 2024-04-26T11:14:53.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9903000000000002e-05 2024-04-26T11:14:53.783 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.783 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.783 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.783 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:53.783 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:53.783 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:53.783 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:14:53.785 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:53.783+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:53.785 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:53.886 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:53.884+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:53.981 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:53.981 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:53.981 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.981 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:184410 5.8 e47/16 5:1c2722df:::benchmark_data_smithi029_44842_object39772:head v 47'11573, mlcod=47'11571)", 2024-04-26T11:14:53.981 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:53.970476+0000", 2024-04-26T11:14:53.982 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0047555719999999996, 2024-04-26T11:14:53.982 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0047874939999999998, 2024-04-26T11:14:53.982 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:53.982 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:53.982 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:53.982 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.982 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:53.982 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970476+0000", 2024-04-26T11:14:53.982 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:53.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.982 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.982 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:53.982 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970476+0000", 2024-04-26T11:14:53.982 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:53.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.983 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:53.983 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970476+0000", 2024-04-26T11:14:53.983 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:53.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.983 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:53.983 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970479+0000", 2024-04-26T11:14:53.983 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6559999999999998e-06 2024-04-26T11:14:53.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.983 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:53.983 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970486+0000", 2024-04-26T11:14:53.983 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8349999999999998e-06 2024-04-26T11:14:53.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.984 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.984 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970491+0000", 2024-04-26T11:14:53.984 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.831e-06 2024-04-26T11:14:53.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.984 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:53.984 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970574+0000", 2024-04-26T11:14:53.984 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2585999999999998e-05 2024-04-26T11:14:53.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.984 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:53.984 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970594+0000", 2024-04-26T11:14:53.985 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.054e-05 2024-04-26T11:14:53.985 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:53.985 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:53.985 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:53.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.985 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.985 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:184412 5.0 e47/16 5:0a00ad68:::benchmark_data_smithi029_44842_object39774:head v 47'11669, mlcod=47'11667)", 2024-04-26T11:14:53.985 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:53.970501+0000", 2024-04-26T11:14:53.985 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0047308669999999997, 2024-04-26T11:14:53.985 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.004833469, 2024-04-26T11:14:53.985 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:53.985 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:53.985 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:53.985 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.985 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:53.986 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970501+0000", 2024-04-26T11:14:53.986 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:53.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.986 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:53.986 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970501+0000", 2024-04-26T11:14:53.986 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:53.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.986 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:53.986 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970501+0000", 2024-04-26T11:14:53.986 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:53.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.987 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:53.987 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970507+0000", 2024-04-26T11:14:53.987 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.878e-06 2024-04-26T11:14:53.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.987 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:53.987 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970514+0000", 2024-04-26T11:14:53.987 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9020000000000002e-06 2024-04-26T11:14:53.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.987 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.987 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970519+0000", 2024-04-26T11:14:53.987 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5900000000000001e-06 2024-04-26T11:14:53.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.988 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:53.988 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970610+0000", 2024-04-26T11:14:53.988 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1508000000000005e-05 2024-04-26T11:14:53.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.988 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.988 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:53.988 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970627+0000", 2024-04-26T11:14:53.988 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6708e-05 2024-04-26T11:14:53.988 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:53.988 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:53.988 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:53.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.988 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.988 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:184417 5.2 5:4eb1677f:::benchmark_data_smithi029_44842_object39779:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T11:14:53.988 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:53.970865+0000", 2024-04-26T11:14:53.989 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0043669520000000003, 2024-04-26T11:14:53.989 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0045353349999999997, 2024-04-26T11:14:53.989 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:53.989 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:53.989 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:53.989 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:53.989 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.989 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 184417 2024-04-26T11:14:53.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.989 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:53.989 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.989 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:53.989 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970865+0000", 2024-04-26T11:14:53.989 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:53.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.990 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.990 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:53.990 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970865+0000", 2024-04-26T11:14:53.990 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:53.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.990 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.990 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:53.990 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970864+0000", 2024-04-26T11:14:53.990 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:53.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.990 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.990 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:53.990 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970869+0000", 2024-04-26T11:14:53.990 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.356e-06 2024-04-26T11:14:53.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.991 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:53.991 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970880+0000", 2024-04-26T11:14:53.991 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0324e-05 2024-04-26T11:14:53.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.991 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.991 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970896+0000", 2024-04-26T11:14:53.991 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6790999999999999e-05 2024-04-26T11:14:53.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.991 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:53.991 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970961+0000", 2024-04-26T11:14:53.991 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4788000000000004e-05 2024-04-26T11:14:53.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.992 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.992 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:53.992 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.972610+0000", 2024-04-26T11:14:53.992 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016486980000000001 2024-04-26T11:14:53.992 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:53.992 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:53.992 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:53.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.992 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.992 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:184418 5.2 5:4ab5b447:::benchmark_data_smithi029_44842_object39780:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T11:14:53.992 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:53.970908+0000", 2024-04-26T11:14:53.992 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0043231850000000002, 2024-04-26T11:14:53.992 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0045355350000000003, 2024-04-26T11:14:53.992 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:53.993 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:53.993 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:53.993 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:53.993 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.993 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 184418 2024-04-26T11:14:53.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.993 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:53.993 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.993 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:53.993 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970908+0000", 2024-04-26T11:14:53.993 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:53.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.993 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.993 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:53.993 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970908+0000", 2024-04-26T11:14:53.994 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:53.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.994 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.994 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:53.994 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970908+0000", 2024-04-26T11:14:53.994 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:53.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.994 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.994 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:53.994 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970911+0000", 2024-04-26T11:14:53.994 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2509999999999999e-06 2024-04-26T11:14:53.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.994 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.994 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:53.994 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970919+0000", 2024-04-26T11:14:53.995 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3470000000000001e-06 2024-04-26T11:14:53.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.995 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.995 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970924+0000", 2024-04-26T11:14:53.995 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7749999999999998e-06 2024-04-26T11:14:53.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.995 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:53.995 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.974140+0000", 2024-04-26T11:14:53.995 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0032156469999999999 2024-04-26T11:14:53.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.995 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:53.995 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.974258+0000", 2024-04-26T11:14:53.996 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011809 2024-04-26T11:14:53.996 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:53.996 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:53.996 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:53.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.996 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.996 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:184420 5.2 5.58796602 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T11:14:53.996 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:53.971424+0000", 2024-04-26T11:14:53.996 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0038073349999999998, 2024-04-26T11:14:53.996 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0040731639999999998, 2024-04-26T11:14:53.996 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:53.996 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:53.996 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:53.996 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:53.997 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:53.997 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 184420 2024-04-26T11:14:53.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.997 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:53.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.997 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:53.997 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.971424+0000", 2024-04-26T11:14:53.997 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:53.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.997 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:53.997 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.971424+0000", 2024-04-26T11:14:53.997 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:53.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.998 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:53.998 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.971424+0000", 2024-04-26T11:14:53.998 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:53.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.998 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.998 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:53.998 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.971428+0000", 2024-04-26T11:14:53.998 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6920000000000001e-06 2024-04-26T11:14:53.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.998 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.998 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:53.998 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.971438+0000", 2024-04-26T11:14:53.998 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3349999999999996e-06 2024-04-26T11:14:53.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.998 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.999 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:53.999 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.971445+0000", 2024-04-26T11:14:53.999 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9929999999999998e-06 2024-04-26T11:14:53.999 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:53.999 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:53.999 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:53.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:53.999 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:53.999 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:184423 5.7 5:e9dd7895:::benchmark_data_smithi029_44842_object39785:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T11:14:53.999 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:53.971899+0000", 2024-04-26T11:14:53.999 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.003333099, 2024-04-26T11:14:53.999 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0036323359999999999, 2024-04-26T11:14:53.999 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:53.999 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:53.999 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:54.000 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:54.000 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.000 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 184423 2024-04-26T11:14:54.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.000 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.000 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.000 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.971899+0000", 2024-04-26T11:14:54.000 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.000 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.000 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.971899+0000", 2024-04-26T11:14:54.000 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.001 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.001 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.001 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.971898+0000", 2024-04-26T11:14:54.001 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:54.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.001 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.001 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.001 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.971901+0000", 2024-04-26T11:14:54.001 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1810000000000001e-06 2024-04-26T11:14:54.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.001 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.001 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.001 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.971908+0000", 2024-04-26T11:14:54.001 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4919999999999998e-06 2024-04-26T11:14:54.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.002 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.002 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.002 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.971914+0000", 2024-04-26T11:14:54.002 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8479999999999997e-06 2024-04-26T11:14:54.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.002 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.002 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.002 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.972189+0000", 2024-04-26T11:14:54.002 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00027568900000000002 2024-04-26T11:14:54.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.002 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.002 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.002 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.972326+0000", 2024-04-26T11:14:54.002 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136916 2024-04-26T11:14:54.003 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.003 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.003 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.003 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.003 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:184424 5.7 5:e9d24348:::benchmark_data_smithi029_44842_object39786:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T11:14:54.003 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:53.972148+0000", 2024-04-26T11:14:54.003 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0030833829999999999, 2024-04-26T11:14:54.003 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0034404679999999999, 2024-04-26T11:14:54.003 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.003 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:54.003 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:54.003 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:54.003 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.003 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 184424 2024-04-26T11:14:54.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.004 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.004 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.004 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.004 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.972148+0000", 2024-04-26T11:14:54.004 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.004 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.004 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.004 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.972148+0000", 2024-04-26T11:14:54.004 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.004 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.004 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.004 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.972148+0000", 2024-04-26T11:14:54.005 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:54.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.005 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.005 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.972151+0000", 2024-04-26T11:14:54.005 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.32e-06 2024-04-26T11:14:54.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.005 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.005 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.972163+0000", 2024-04-26T11:14:54.005 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1732999999999999e-05 2024-04-26T11:14:54.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.005 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.005 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.972169+0000", 2024-04-26T11:14:54.006 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0279999999999997e-06 2024-04-26T11:14:54.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.006 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.006 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.006 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.975562+0000", 2024-04-26T11:14:54.006 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0033933600000000002 2024-04-26T11:14:54.006 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.006 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.006 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.006 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.006 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:184419 5.b e47/16 5:d0e638f6:::benchmark_data_smithi029_44842_object39781:head v 47'11742, mlcod=47'11739)", 2024-04-26T11:14:54.006 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:53.972550+0000", 2024-04-26T11:14:54.006 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0026820350000000001, 2024-04-26T11:14:54.007 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0031053069999999999, 2024-04-26T11:14:54.007 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.007 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:54.007 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.007 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.007 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.972550+0000", 2024-04-26T11:14:54.007 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.007 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.007 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.972550+0000", 2024-04-26T11:14:54.007 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.007 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.008 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.972549+0000", 2024-04-26T11:14:54.008 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:54.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.008 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.008 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.008 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.972554+0000", 2024-04-26T11:14:54.008 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1950000000000002e-06 2024-04-26T11:14:54.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.008 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.008 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.008 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.972563+0000", 2024-04-26T11:14:54.008 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2329999999999995e-06 2024-04-26T11:14:54.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.008 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.009 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.009 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.972570+0000", 2024-04-26T11:14:54.009 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2389999999999999e-06 2024-04-26T11:14:54.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.009 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.009 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973651+0000", 2024-04-26T11:14:54.009 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0010808580000000001 2024-04-26T11:14:54.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.009 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.009 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973668+0000", 2024-04-26T11:14:54.009 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7881e-05 2024-04-26T11:14:54.009 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.009 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.010 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.010 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.010 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:184421 5.4 e47/16 5:25dd81f7:::benchmark_data_smithi029_44842_object39783:head v 47'11410, mlcod=47'11408)", 2024-04-26T11:14:54.010 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:53.973627+0000", 2024-04-26T11:14:54.010 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.001604615, 2024-04-26T11:14:54.010 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020982840000000002, 2024-04-26T11:14:54.010 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.010 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:54.010 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.010 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.010 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.010 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973627+0000", 2024-04-26T11:14:54.010 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.011 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.011 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973627+0000", 2024-04-26T11:14:54.011 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.011 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.011 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973627+0000", 2024-04-26T11:14:54.011 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:54.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.011 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.011 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973631+0000", 2024-04-26T11:14:54.011 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.792e-06 2024-04-26T11:14:54.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.012 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.012 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.012 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973641+0000", 2024-04-26T11:14:54.012 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3680000000000008e-06 2024-04-26T11:14:54.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.012 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.012 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.012 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973647+0000", 2024-04-26T11:14:54.012 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3369999999999996e-06 2024-04-26T11:14:54.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.012 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.012 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.012 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973681+0000", 2024-04-26T11:14:54.012 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3495999999999999e-05 2024-04-26T11:14:54.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.013 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.013 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.013 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973704+0000", 2024-04-26T11:14:54.013 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3289999999999999e-05 2024-04-26T11:14:54.013 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.013 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.013 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.013 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.013 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:184422 5.8 e47/16 5:15c81414:::benchmark_data_smithi029_44842_object39784:head v 47'11574, mlcod=47'11571)", 2024-04-26T11:14:54.013 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:53.973657+0000", 2024-04-26T11:14:54.013 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.001575061, 2024-04-26T11:14:54.013 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0021489479999999999, 2024-04-26T11:14:54.013 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.014 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:54.014 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.014 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.014 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973657+0000", 2024-04-26T11:14:54.014 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.014 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.014 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973657+0000", 2024-04-26T11:14:54.014 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.014 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.015 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973656+0000", 2024-04-26T11:14:54.015 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:54.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.015 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.015 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973665+0000", 2024-04-26T11:14:54.015 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3170000000000002e-06 2024-04-26T11:14:54.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.015 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.015 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973672+0000", 2024-04-26T11:14:54.015 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1439999999999997e-06 2024-04-26T11:14:54.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.015 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.016 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973677+0000", 2024-04-26T11:14:54.016 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2989999999999996e-06 2024-04-26T11:14:54.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.016 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.016 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.016 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973725+0000", 2024-04-26T11:14:54.016 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7615999999999999e-05 2024-04-26T11:14:54.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.016 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.016 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.016 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973743+0000", 2024-04-26T11:14:54.016 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8822e-05 2024-04-26T11:14:54.016 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.016 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.016 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.017 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:184425 5.3 5:c54f04f9:::benchmark_data_smithi029_44842_object39787:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T11:14:54.017 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:53.973658+0000", 2024-04-26T11:14:54.017 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0015733139999999999, 2024-04-26T11:14:54.017 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0021964160000000001, 2024-04-26T11:14:54.017 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.017 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:54.017 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:54.017 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:54.017 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.017 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 184425 2024-04-26T11:14:54.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.017 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.018 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.018 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973658+0000", 2024-04-26T11:14:54.018 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.018 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.018 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.018 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973658+0000", 2024-04-26T11:14:54.018 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.018 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.018 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.018 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973658+0000", 2024-04-26T11:14:54.018 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:54.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.018 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.019 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.019 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973671+0000", 2024-04-26T11:14:54.019 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3740000000000001e-05 2024-04-26T11:14:54.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.019 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.019 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.019 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973681+0000", 2024-04-26T11:14:54.019 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.7899999999999994e-06 2024-04-26T11:14:54.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.019 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.019 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.019 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973689+0000", 2024-04-26T11:14:54.019 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5979999999999999e-06 2024-04-26T11:14:54.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.019 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.020 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.020 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973807+0000", 2024-04-26T11:14:54.020 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000117792 2024-04-26T11:14:54.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.020 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.020 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.973953+0000", 2024-04-26T11:14:54.020 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014673900000000001 2024-04-26T11:14:54.020 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.020 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.020 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.020 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:184426 5.b e47/16 5:dd631cfc:::benchmark_data_smithi029_44842_object39788:head v 47'11743, mlcod=47'11739)", 2024-04-26T11:14:54.020 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:53.975378+0000", 2024-04-26T11:14:54.021 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9998541, 2024-04-26T11:14:54.021 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00052648699999999996, 2024-04-26T11:14:54.021 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.021 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:54.021 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.021 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.021 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.021 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.975378+0000", 2024-04-26T11:14:54.021 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.021 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.021 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.021 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.975378+0000", 2024-04-26T11:14:54.021 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.022 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.022 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.975377+0000", 2024-04-26T11:14:54.022 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:54.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.022 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.022 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.975383+0000", 2024-04-26T11:14:54.022 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9699999999999996e-06 2024-04-26T11:14:54.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.022 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.022 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.975392+0000", 2024-04-26T11:14:54.022 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.704e-06 2024-04-26T11:14:54.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.023 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.023 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.023 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.975398+0000", 2024-04-26T11:14:54.023 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2160000000000003e-06 2024-04-26T11:14:54.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.023 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.023 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.023 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.975479+0000", 2024-04-26T11:14:54.023 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.1291000000000005e-05 2024-04-26T11:14:54.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.023 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.023 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.023 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.975504+0000", 2024-04-26T11:14:54.023 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.544e-05 2024-04-26T11:14:54.024 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.024 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.024 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.024 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.024 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:184428 5.7 5.8a0f98f7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T11:14:54.024 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:53.975791+0000", 2024-04-26T11:14:54.024 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9994411, 2024-04-26T11:14:54.024 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000153151, 2024-04-26T11:14:54.024 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.024 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:54.024 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:54.024 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:54.024 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.024 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 184428 2024-04-26T11:14:54.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.025 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.025 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.025 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.975791+0000", 2024-04-26T11:14:54.025 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.025 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.025 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.975791+0000", 2024-04-26T11:14:54.025 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.025 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.025 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.975790+0000", 2024-04-26T11:14:54.026 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:54.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.026 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.026 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.026 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.975795+0000", 2024-04-26T11:14:54.026 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2190000000000003e-06 2024-04-26T11:14:54.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.026 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.026 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.026 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.975805+0000", 2024-04-26T11:14:54.026 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0331e-05 2024-04-26T11:14:54.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.026 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.026 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.026 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.975813+0000", 2024-04-26T11:14:54.027 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.464e-06 2024-04-26T11:14:54.027 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.027 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.027 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.027 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.027 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:184409 5.b e47/16 5:d6588be2:::benchmark_data_smithi029_44842_object39771:head v 47'11741, mlcod=47'11738)", 2024-04-26T11:14:54.027 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:53.970441+0000", 2024-04-26T11:14:54.027 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0047910180000000002, 2024-04-26T11:14:54.027 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0055370619999999997, 2024-04-26T11:14:54.027 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.027 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:54.027 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.027 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.027 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.028 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970441+0000", 2024-04-26T11:14:54.028 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.028 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.028 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.028 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970441+0000", 2024-04-26T11:14:54.028 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.028 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.028 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.028 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970440+0000", 2024-04-26T11:14:54.028 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:54.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.028 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.028 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.029 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970445+0000", 2024-04-26T11:14:54.029 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2190000000000003e-06 2024-04-26T11:14:54.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.029 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.029 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970461+0000", 2024-04-26T11:14:54.029 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5369000000000001e-05 2024-04-26T11:14:54.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.029 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.029 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970467+0000", 2024-04-26T11:14:54.029 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7789999999999998e-06 2024-04-26T11:14:54.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.029 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.030 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970499+0000", 2024-04-26T11:14:54.030 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1760000000000001e-05 2024-04-26T11:14:54.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.030 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.030 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.030 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:53.970519+0000", 2024-04-26T11:14:54.030 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0152e-05 2024-04-26T11:14:54.030 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.030 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.030 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.030 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.030 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:14:54.030 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 14 2024-04-26T11:14:54.030 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:54.032 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:54.032 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:54.031+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:54.132 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:54.131+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:54.233 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:54.232+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:54.257 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:54.257 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:14:54.257 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:14:54.257 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:14:54.257 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:54.271 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:54.356 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:54.355+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:54.434 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:54.433+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:54.500 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:54.500 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:14:54.500 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:14:54.500 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:54.500 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.500 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:54.500 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:54.500 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 61.226000401999997, 2024-04-26T11:14:54.500 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:14:54.500 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.500 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:54.500 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:54.501 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:54.501 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.501 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:14:54.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.501 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.501 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.501 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.501 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:54.501 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.501 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.501 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.501 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:54.501 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.502 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.502 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.502 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:14:54.502 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:54.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.502 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.502 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.502 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:14:54.502 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:14:54.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.502 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.502 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.502 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:14:54.503 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:14:54.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.503 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.503 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.503 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:14:54.503 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:14:54.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.503 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.503 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.503 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:14:54.503 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:14:54.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.503 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.503 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.504 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:14:54.504 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:14:54.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.504 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.504 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:54.504 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:14:54.504 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:14:54.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.504 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.504 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:54.504 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:14:54.504 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:14:54.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.505 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.505 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:54.505 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:14:54.505 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:14:54.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.505 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.505 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:54.505 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:14:54.505 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:14:54.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.505 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.505 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:54.505 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:14:54.505 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:14:54.505 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.506 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.506 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.506 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.506 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:54.506 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:54.506 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 61.225188836999997, 2024-04-26T11:14:54.506 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:14:54.506 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.506 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:54.507 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:54.507 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:54.507 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.507 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:14:54.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.507 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.507 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.507 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.507 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:54.507 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.507 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.507 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.507 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:54.507 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.508 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.508 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.508 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:54.508 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:54.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.508 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.508 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.508 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:14:54.508 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:14:54.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.508 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.508 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.508 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:14:54.508 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:14:54.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.509 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.509 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.509 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:14:54.509 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:14:54.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.509 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.509 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.509 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:14:54.509 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:14:54.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.509 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.509 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.509 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:14:54.510 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:14:54.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.510 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.510 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:54.510 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:14:54.510 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:14:54.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.510 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.510 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:54.510 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:14:54.510 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:14:54.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.510 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.510 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:54.510 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:14:54.511 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:14:54.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.511 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.511 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:54.511 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:14:54.511 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:14:54.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.511 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.511 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:54.511 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:14:54.511 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:14:54.511 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.511 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.511 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.511 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.512 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:54.512 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:54.512 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 61.218001999999998, 2024-04-26T11:14:54.512 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:14:54.512 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.512 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:54.512 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:54.512 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:54.512 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.512 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:14:54.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.512 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.512 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.513 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.513 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:54.513 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.513 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.513 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.513 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:54.513 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.513 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.513 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.513 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:14:54.513 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:54.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.513 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.513 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.514 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:14:54.514 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:14:54.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.514 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.514 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.514 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:14:54.514 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:14:54.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.514 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.514 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.514 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:14:54.514 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:14:54.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.515 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.515 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.515 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:14:54.515 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:14:54.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.515 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.515 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.515 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:14:54.515 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:14:54.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.515 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.515 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:54.515 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:14:54.515 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:14:54.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.516 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.516 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:54.516 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:14:54.516 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:14:54.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.516 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.516 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:54.516 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:14:54.516 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:14:54.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.516 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.516 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:54.516 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:14:54.516 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:14:54.517 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.517 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.517 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:54.517 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:14:54.517 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:14:54.517 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.517 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.517 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.517 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.517 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.517 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:54.517 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:54.517 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 61.217461120999999, 2024-04-26T11:14:54.517 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:14:54.517 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.517 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:54.518 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:54.518 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:54.518 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.518 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:14:54.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.518 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.518 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.518 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.518 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:54.518 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.518 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.518 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.518 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:54.519 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.519 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.519 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.519 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:54.519 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:54.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.519 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.519 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.519 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:14:54.519 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:14:54.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.519 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.519 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.519 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:14:54.520 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:14:54.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.520 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.520 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.520 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:14:54.520 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:14:54.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.520 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.520 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.520 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:14:54.520 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:14:54.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.520 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.520 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.520 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:14:54.521 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:14:54.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.521 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.521 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:54.521 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:14:54.521 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:14:54.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.521 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.521 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:54.521 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:14:54.521 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:14:54.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.521 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.521 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:54.522 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:14:54.522 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:14:54.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.522 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.522 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:54.522 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:14:54.522 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:14:54.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.522 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.522 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:54.522 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:14:54.522 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:14:54.522 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.522 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.522 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.523 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.523 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:54.523 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:54.523 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 57.174276673999998, 2024-04-26T11:14:54.523 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:14:54.523 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.523 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:54.523 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:54.523 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:54.523 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.523 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:14:54.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.523 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.523 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.524 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.524 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:54.524 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.524 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.524 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.524 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:54.524 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.524 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.524 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.524 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:14:54.524 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:54.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.524 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.525 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.525 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:14:54.525 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:14:54.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.525 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.525 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.525 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:14:54.525 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:14:54.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.525 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.525 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.525 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:14:54.525 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:14:54.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.525 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.525 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.526 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:14:54.526 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:14:54.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.526 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.526 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.526 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:14:54.526 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:14:54.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.526 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.526 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:54.526 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:14:54.526 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:14:54.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.527 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.527 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:54.527 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:14:54.527 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:14:54.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.527 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.527 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.527 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:14:54.527 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:14:54.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.527 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.527 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:54.527 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:14:54.527 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:14:54.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.528 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.528 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.528 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:14:54.528 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:14:54.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.528 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.528 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:54.528 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:14:54.528 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:14:54.528 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.528 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.528 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.528 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.529 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:54.529 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:54.529 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 57.172083334, 2024-04-26T11:14:54.529 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:14:54.529 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.529 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:54.529 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:54.529 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:54.529 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.529 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:14:54.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.529 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.529 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.529 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.530 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:54.530 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.530 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.530 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.530 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:54.530 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.530 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.530 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.530 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:14:54.530 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:54.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.530 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.531 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.531 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:14:54.531 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:14:54.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.531 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.531 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.531 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:14:54.531 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:14:54.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.531 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.531 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.531 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:14:54.531 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:14:54.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.531 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.532 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.532 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:14:54.532 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:14:54.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.532 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.532 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:14:54.532 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:14:54.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.532 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:54.532 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:14:54.532 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:14:54.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:54.533 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:14:54.533 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:14:54.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.533 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:14:54.533 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:14:54.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:54.533 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:14:54.533 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:14:54.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.534 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:14:54.534 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:14:54.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.534 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:54.534 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:14:54.534 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:14:54.534 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.534 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.534 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.534 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:54.534 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:54.535 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 57.16687151, 2024-04-26T11:14:54.535 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:14:54.535 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.535 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:54.535 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:54.535 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:54.535 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.535 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:14:54.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.535 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.535 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.535 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.535 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:54.535 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.536 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.536 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.536 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:54.536 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.536 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.536 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.536 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:14:54.536 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:54.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.536 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.536 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.536 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:14:54.536 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:14:54.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.537 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.537 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:14:54.537 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:14:54.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.537 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.537 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:14:54.537 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:14:54.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.537 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.537 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:14:54.537 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:14:54.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.538 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.538 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:14:54.538 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:14:54.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.538 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:54.538 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:14:54.538 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:14:54.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.538 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:54.538 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:14:54.538 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:14:54.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.539 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.539 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:14:54.539 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:14:54.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.539 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:54.539 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:14:54.539 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:14:54.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.539 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.539 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:14:54.540 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:14:54.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.540 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:54.540 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:14:54.540 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:14:54.540 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.540 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.540 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.540 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:54.540 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:54.540 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 57.150422810000002, 2024-04-26T11:14:54.540 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:14:54.541 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.541 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:54.541 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:54.541 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:54.541 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.541 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:14:54.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.541 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.541 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.541 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:54.541 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.542 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.542 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:54.542 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.542 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.542 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.542 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:14:54.542 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:54.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.542 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.542 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.542 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:14:54.542 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:14:54.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.543 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.543 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.543 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:14:54.543 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:14:54.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.543 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.543 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.543 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:14:54.543 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:14:54.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.543 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.543 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.543 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:14:54.543 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:14:54.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.543 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.544 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:54.544 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:14:54.544 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:14:54.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.544 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.544 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.544 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:14:54.544 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:14:54.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.544 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.544 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:54.544 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:14:54.544 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:14:54.544 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.545 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.545 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.545 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.545 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:54.545 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:54.545 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 57.148725304999999, 2024-04-26T11:14:54.545 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:14:54.545 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.545 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:54.545 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:54.545 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:54.545 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.545 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:14:54.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.546 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.546 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.546 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.546 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:54.546 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.546 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.546 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.546 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:54.546 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.546 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.546 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.546 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:14:54.547 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:54.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.547 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.547 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:14:54.547 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:14:54.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.547 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.547 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:14:54.547 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:14:54.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.547 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.547 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:14:54.548 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:14:54.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.548 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.548 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.548 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:14:54.548 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:14:54.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.548 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.548 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:54.548 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:14:54.548 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:14:54.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.549 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.549 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.549 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:14:54.549 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:14:54.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.549 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.549 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:54.549 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:14:54.549 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:14:54.549 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.549 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.549 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.549 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.549 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:54.549 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:54.550 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 57.148661003000001, 2024-04-26T11:14:54.550 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:14:54.550 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.550 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:54.550 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:54.550 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:54.550 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.550 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:14:54.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.550 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.550 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.550 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.550 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:54.550 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.551 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.551 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.551 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:54.551 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.551 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.551 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.551 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:54.551 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:54.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.551 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.551 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.551 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:14:54.551 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:14:54.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.552 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.552 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.552 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:14:54.552 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:14:54.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.552 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.552 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.552 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:14:54.552 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:14:54.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.552 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.552 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.552 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:14:54.552 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:14:54.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.553 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.553 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:54.553 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:14:54.553 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:14:54.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.553 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.553 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.553 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:14:54.553 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:14:54.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.553 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.554 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.554 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:14:54.554 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:14:54.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.554 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.554 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:54.554 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:14:54.554 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:14:54.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.554 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.554 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:54.554 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:14:54.554 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:14:54.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.555 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.555 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:54.555 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:14:54.555 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:14:54.555 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.555 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.555 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.555 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.555 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.555 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:54.555 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:54.555 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 57.148606778999998, 2024-04-26T11:14:54.555 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:14:54.555 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.555 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:54.556 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:54.556 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:54.556 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.556 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:14:54.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.556 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.556 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.556 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.556 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:54.556 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.556 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.556 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.556 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:54.556 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.557 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.557 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.557 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:54.557 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:54.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.557 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.557 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.557 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:14:54.557 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:14:54.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.557 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.557 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.557 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:14:54.557 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:14:54.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.558 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.558 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.558 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:14:54.558 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:14:54.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.558 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.558 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.558 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:14:54.558 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:14:54.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.558 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.558 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:54.558 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:14:54.558 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:14:54.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.559 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.559 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.559 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:14:54.559 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:14:54.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.559 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.559 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.559 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:14:54.559 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:14:54.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.559 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.559 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:54.559 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:14:54.559 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:14:54.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.560 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.560 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:54.560 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:14:54.560 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:54.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.560 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.560 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:54.560 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:14:54.560 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:14:54.560 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.560 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.560 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.560 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.561 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:54.561 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:54.561 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 57.148562267000003, 2024-04-26T11:14:54.561 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:14:54.561 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.561 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:54.561 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:54.561 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:54.561 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.561 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:14:54.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.561 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.561 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.561 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.561 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:54.562 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.562 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.562 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.562 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:54.562 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.562 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.562 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.562 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:14:54.562 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:54.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.562 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.562 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.562 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:14:54.563 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:14:54.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.563 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.563 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.563 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:14:54.563 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:14:54.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.563 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.563 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.563 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:14:54.563 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:14:54.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.563 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.563 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.563 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:14:54.564 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:14:54.564 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.564 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.564 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:54.564 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:14:54.564 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:14:54.564 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.564 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.564 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.564 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:14:54.564 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:14:54.564 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.564 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.564 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.564 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:14:54.565 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:14:54.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.565 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.565 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:54.565 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:14:54.565 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:14:54.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.565 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.565 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:54.565 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:14:54.565 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:14:54.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.565 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.565 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:54.566 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:14:54.566 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:14:54.566 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.566 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.566 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.566 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.566 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:54.566 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:54.566 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 57.144341265000001, 2024-04-26T11:14:54.566 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:14:54.566 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.566 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:54.566 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:54.567 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:54.567 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.567 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:14:54.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.567 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.567 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.567 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.567 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:54.567 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.567 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.567 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.567 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:54.567 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.568 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.568 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.568 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:14:54.568 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:14:54.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.568 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.568 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.568 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:14:54.568 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:14:54.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.568 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.568 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.568 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:14:54.568 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:14:54.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.569 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.569 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.569 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:14:54.569 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:14:54.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.569 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.569 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.569 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:14:54.569 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:14:54.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.569 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.569 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:54.569 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:14:54.570 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:14:54.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.570 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.570 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.570 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:14:54.570 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:14:54.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.570 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.570 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.570 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:14:54.570 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:14:54.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.570 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.570 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:54.570 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:14:54.571 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:14:54.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.571 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.571 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:54.571 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:14:54.571 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:14:54.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.571 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.571 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:54.571 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:14:54.571 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:14:54.571 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.571 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.571 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.572 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.572 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174388 5.c 5:312e5163:::benchmark_data_smithi029_44842_object29750:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:54.572 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:14:54.572 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.1485156099999996, 2024-04-26T11:14:54.572 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.064002009999999998, 2024-04-26T11:14:54.572 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.572 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:54.572 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:54.572 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:54.572 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.572 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174388 2024-04-26T11:14:54.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.572 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.572 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.573 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.573 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:14:54.573 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.573 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.573 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.573 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.573 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:14:54.573 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.573 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.573 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.573 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.573 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348231+0000", 2024-04-26T11:14:54.573 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:54.573 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.573 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.574 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.574 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348233+0000", 2024-04-26T11:14:54.574 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2249999999999999e-06 2024-04-26T11:14:54.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.574 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.574 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.574 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348238+0000", 2024-04-26T11:14:54.574 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1899999999999997e-06 2024-04-26T11:14:54.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.574 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.574 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.574 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348241+0000", 2024-04-26T11:14:54.574 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.965e-06 2024-04-26T11:14:54.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.574 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.575 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.575 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348264+0000", 2024-04-26T11:14:54.575 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3014e-05 2024-04-26T11:14:54.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.575 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.575 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.575 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348371+0000", 2024-04-26T11:14:54.575 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000106889 2024-04-26T11:14:54.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.575 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.575 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:54.575 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412126+0000", 2024-04-26T11:14:54.575 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063755495999999995 2024-04-26T11:14:54.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.575 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.576 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:54.576 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412165+0000", 2024-04-26T11:14:54.576 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9269e-05 2024-04-26T11:14:54.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.576 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.576 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:54.576 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412234+0000", 2024-04-26T11:14:54.576 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8337000000000007e-05 2024-04-26T11:14:54.576 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.576 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.576 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.576 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.576 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174390 5.1 5:81c54fd7:::benchmark_data_smithi029_44842_object29752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:54.576 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:14:54.577 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.1484004560000001, 2024-04-26T11:14:54.577 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063635918, 2024-04-26T11:14:54.577 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.577 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:54.577 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:54.577 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:54.577 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.577 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174390 2024-04-26T11:14:54.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.577 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.577 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.577 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.577 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:14:54.577 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.578 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.578 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.578 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:14:54.578 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.578 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.578 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.578 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348346+0000", 2024-04-26T11:14:54.578 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:54.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.578 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.578 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.578 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348351+0000", 2024-04-26T11:14:54.578 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.442e-06 2024-04-26T11:14:54.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.579 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.579 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.579 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348357+0000", 2024-04-26T11:14:54.579 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9530000000000002e-06 2024-04-26T11:14:54.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.579 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.579 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.579 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348363+0000", 2024-04-26T11:14:54.579 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2129999999999999e-06 2024-04-26T11:14:54.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.579 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.579 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.579 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348396+0000", 2024-04-26T11:14:54.579 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3161999999999999e-05 2024-04-26T11:14:54.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.580 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.580 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.580 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348511+0000", 2024-04-26T11:14:54.580 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000115253 2024-04-26T11:14:54.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.580 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.580 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:54.580 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411857+0000", 2024-04-26T11:14:54.580 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063345431999999993 2024-04-26T11:14:54.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.580 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.580 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:54.580 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411904+0000", 2024-04-26T11:14:54.580 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7389000000000003e-05 2024-04-26T11:14:54.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.581 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.581 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:54.581 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411983+0000", 2024-04-26T11:14:54.581 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8750000000000003e-05 2024-04-26T11:14:54.581 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.581 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.581 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.581 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.581 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174394 5.3 5:c91ce5cb:::benchmark_data_smithi029_44842_object29756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:54.581 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:14:54.581 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.1482975120000001, 2024-04-26T11:14:54.581 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062247626, 2024-04-26T11:14:54.581 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.582 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:54.582 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:54.582 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:54.582 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.582 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174394 2024-04-26T11:14:54.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.582 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.582 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.582 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.582 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:14:54.582 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.582 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.582 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.583 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:14:54.583 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.583 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.583 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.583 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348449+0000", 2024-04-26T11:14:54.583 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:54.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.583 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.583 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.583 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348457+0000", 2024-04-26T11:14:54.583 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9619999999999993e-06 2024-04-26T11:14:54.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.583 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.583 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.584 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348462+0000", 2024-04-26T11:14:54.584 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6569999999999996e-06 2024-04-26T11:14:54.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.584 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.584 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.584 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348465+0000", 2024-04-26T11:14:54.584 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2990000000000001e-06 2024-04-26T11:14:54.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.584 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.584 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.584 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408427+0000", 2024-04-26T11:14:54.584 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.059961423 2024-04-26T11:14:54.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.584 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.584 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.585 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408554+0000", 2024-04-26T11:14:54.585 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012779600000000001 2024-04-26T11:14:54.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.585 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:54.585 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410570+0000", 2024-04-26T11:14:54.585 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020152719999999998 2024-04-26T11:14:54.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.585 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:54.585 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410624+0000", 2024-04-26T11:14:54.585 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4211e-05 2024-04-26T11:14:54.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.586 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:54.586 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410697+0000", 2024-04-26T11:14:54.586 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3447000000000003e-05 2024-04-26T11:14:54.586 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.586 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.586 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.586 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.586 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174395 5.1 5:8ee7f1d3:::benchmark_data_smithi029_44842_object29757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:54.586 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:14:54.586 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.1472674210000005, 2024-04-26T11:14:54.586 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062622744999999994, 2024-04-26T11:14:54.586 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.586 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:54.587 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:54.587 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:54.587 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.587 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174395 2024-04-26T11:14:54.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.587 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.587 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.587 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.587 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:14:54.587 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.587 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.587 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.587 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:14:54.587 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.588 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.588 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349479+0000", 2024-04-26T11:14:54.588 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:54.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.588 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.588 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349483+0000", 2024-04-26T11:14:54.588 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.54e-06 2024-04-26T11:14:54.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.588 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.588 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349488+0000", 2024-04-26T11:14:54.588 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5119999999999999e-06 2024-04-26T11:14:54.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.589 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.589 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349492+0000", 2024-04-26T11:14:54.589 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7170000000000002e-06 2024-04-26T11:14:54.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.589 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.589 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350187+0000", 2024-04-26T11:14:54.589 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00069535899999999999 2024-04-26T11:14:54.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.589 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.589 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350292+0000", 2024-04-26T11:14:54.589 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0001047 2024-04-26T11:14:54.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.590 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.590 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:54.590 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411992+0000", 2024-04-26T11:14:54.590 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061699647000000003 2024-04-26T11:14:54.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.590 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.590 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:54.590 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412030+0000", 2024-04-26T11:14:54.590 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8124999999999998e-05 2024-04-26T11:14:54.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.590 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.590 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:54.590 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412103+0000", 2024-04-26T11:14:54.591 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2733999999999999e-05 2024-04-26T11:14:54.591 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.591 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.591 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.591 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174396 5.7 5:e0fad05d:::benchmark_data_smithi029_44842_object29758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:54.591 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:14:54.591 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.1471837819999999, 2024-04-26T11:14:54.591 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062445026000000001, 2024-04-26T11:14:54.591 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.591 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:54.591 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:54.591 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:54.591 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.592 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174396 2024-04-26T11:14:54.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.592 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.592 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.592 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:14:54.592 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.592 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.592 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:14:54.592 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.592 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.593 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:14:54.593 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:54.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.593 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.593 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.593 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349566+0000", 2024-04-26T11:14:54.593 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2490000000000001e-06 2024-04-26T11:14:54.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.593 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.593 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.593 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349573+0000", 2024-04-26T11:14:54.593 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.776e-06 2024-04-26T11:14:54.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.593 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.594 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.594 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349576+0000", 2024-04-26T11:14:54.594 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3629999999999998e-06 2024-04-26T11:14:54.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.594 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.594 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.594 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350396+0000", 2024-04-26T11:14:54.594 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00081992199999999995 2024-04-26T11:14:54.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.594 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.594 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.594 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350516+0000", 2024-04-26T11:14:54.594 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012006900000000001 2024-04-26T11:14:54.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.595 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.595 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:54.595 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411924+0000", 2024-04-26T11:14:54.595 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061407960999999997 2024-04-26T11:14:54.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.595 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.595 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:54.595 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411947+0000", 2024-04-26T11:14:54.595 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2943999999999999e-05 2024-04-26T11:14:54.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.595 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.595 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:54.595 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412008+0000", 2024-04-26T11:14:54.595 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1237999999999999e-05 2024-04-26T11:14:54.596 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.596 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.596 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.596 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.596 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174397 5.7 5:e25daf9a:::benchmark_data_smithi029_44842_object29759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:54.596 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:14:54.596 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.1470756529999999, 2024-04-26T11:14:54.596 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063878565999999998, 2024-04-26T11:14:54.596 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.596 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:54.596 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:54.596 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:54.596 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.596 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174397 2024-04-26T11:14:54.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.597 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.597 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.597 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.597 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:14:54.597 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.597 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.597 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.597 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:14:54.597 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.597 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.597 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.597 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349671+0000", 2024-04-26T11:14:54.598 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:54.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.598 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.598 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.598 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349674+0000", 2024-04-26T11:14:54.598 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3360000000000002e-06 2024-04-26T11:14:54.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.598 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.598 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.598 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349678+0000", 2024-04-26T11:14:54.598 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0709999999999996e-06 2024-04-26T11:14:54.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.598 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.598 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.599 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349681+0000", 2024-04-26T11:14:54.599 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3139999999999999e-06 2024-04-26T11:14:54.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.599 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.599 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.599 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410371+0000", 2024-04-26T11:14:54.599 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.060690202999999998 2024-04-26T11:14:54.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.599 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.599 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.599 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410463+0000", 2024-04-26T11:14:54.599 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2095000000000005e-05 2024-04-26T11:14:54.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.599 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.600 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:54.600 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413471+0000", 2024-04-26T11:14:54.600 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0030073909999999999 2024-04-26T11:14:54.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.600 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.600 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:54.600 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413499+0000", 2024-04-26T11:14:54.600 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8725e-05 2024-04-26T11:14:54.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.600 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.600 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:54.600 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413550+0000", 2024-04-26T11:14:54.600 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0810000000000003e-05 2024-04-26T11:14:54.600 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.601 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.601 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.601 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.601 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:174398 5.4 e46/16 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head v 46'10798, mlcod=46'10796)", 2024-04-26T11:14:54.601 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:14:54.601 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4.1465474420000001, 2024-04-26T11:14:54.601 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062067047, 2024-04-26T11:14:54.601 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:54.601 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:54.601 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:54.601 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.601 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:54.601 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:14:54.601 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.602 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.602 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:54.602 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:14:54.602 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:54.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.602 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.602 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:54.602 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350199+0000", 2024-04-26T11:14:54.602 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:54.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.602 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.602 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:54.602 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350205+0000", 2024-04-26T11:14:54.602 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6749999999999999e-06 2024-04-26T11:14:54.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.603 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:54.603 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350212+0000", 2024-04-26T11:14:54.603 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7000000000000002e-06 2024-04-26T11:14:54.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.603 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.603 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350216+0000", 2024-04-26T11:14:54.603 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5120000000000002e-06 2024-04-26T11:14:54.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.603 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:54.603 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350246+0000", 2024-04-26T11:14:54.603 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9978999999999999e-05 2024-04-26T11:14:54.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.604 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:54.604 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350263+0000", 2024-04-26T11:14:54.604 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.702e-05 2024-04-26T11:14:54.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.604 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:54.604 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412238+0000", 2024-04-26T11:14:54.604 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061974603000000003 2024-04-26T11:14:54.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:54.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:54.604 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:54.604 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412267+0000", 2024-04-26T11:14:54.605 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9116e-05 2024-04-26T11:14:54.605 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.605 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.605 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.605 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:54.605 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:54.605 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:54.607 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:54.607 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:54.605+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:54.684 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:14:54.707 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:54.705+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:54.778 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:54.778 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:54.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.778 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:186575 5.4 5:245ed961:::benchmark_data_smithi029_44842_object41937:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T11:14:54.778 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:54.770340+0000", 2024-04-26T11:14:54.778 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.006676609, 2024-04-26T11:14:54.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067010689999999996, 2024-04-26T11:14:54.779 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:54.779 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:54.779 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:54.779 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:54.779 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.779 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 186575 2024-04-26T11:14:54.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.779 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:54.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:54.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.770340+0000", 2024-04-26T11:14:54.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:54.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:54.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.770340+0000", 2024-04-26T11:14:54.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:54.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:54.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.770339+0000", 2024-04-26T11:14:54.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:54.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:54.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.770344+0000", 2024-04-26T11:14:54.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0830000000000003e-06 2024-04-26T11:14:54.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:54.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.770356+0000", 2024-04-26T11:14:54.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1836e-05 2024-04-26T11:14:54.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.770365+0000", 2024-04-26T11:14:54.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4889999999999995e-06 2024-04-26T11:14:54.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:54.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.770403+0000", 2024-04-26T11:14:54.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8928999999999999e-05 2024-04-26T11:14:54.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:54.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.770534+0000", 2024-04-26T11:14:54.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013098999999999999 2024-04-26T11:14:54.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:54.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.770644+0000", 2024-04-26T11:14:54.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000109653 2024-04-26T11:14:54.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:54.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.774043+0000", 2024-04-26T11:14:54.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003398833 2024-04-26T11:14:54.783 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:54.783 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:54.783 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:54.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.783 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:186577 5.4 5:202e2264:::benchmark_data_smithi029_44842_object41939:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T11:14:54.783 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:54.770400+0000", 2024-04-26T11:14:54.783 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0066171399999999997, 2024-04-26T11:14:54.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067340150000000003, 2024-04-26T11:14:54.783 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:54.783 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:54.783 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:54.783 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:54.783 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.784 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 186577 2024-04-26T11:14:54.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.784 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:54.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:54.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.770400+0000", 2024-04-26T11:14:54.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:54.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:54.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.770400+0000", 2024-04-26T11:14:54.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:54.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:54.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.770399+0000", 2024-04-26T11:14:54.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:54.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:54.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.770402+0000", 2024-04-26T11:14:54.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2879999999999999e-06 2024-04-26T11:14:54.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:54.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.770408+0000", 2024-04-26T11:14:54.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4779999999999996e-06 2024-04-26T11:14:54.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.770429+0000", 2024-04-26T11:14:54.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0747e-05 2024-04-26T11:14:54.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:54.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.772071+0000", 2024-04-26T11:14:54.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0016426570000000001 2024-04-26T11:14:54.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:54.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.772198+0000", 2024-04-26T11:14:54.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012614599999999999 2024-04-26T11:14:54.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:54.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.772322+0000", 2024-04-26T11:14:54.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012429100000000001 2024-04-26T11:14:54.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:54.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.776683+0000", 2024-04-26T11:14:54.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043607089999999999 2024-04-26T11:14:54.787 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:54.787 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:54.787 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:54.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.787 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:186587 5.4 5:2ee8377f:::benchmark_data_smithi029_44842_object41949:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T11:14:54.788 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:54.772805+0000", 2024-04-26T11:14:54.788 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.004211673, 2024-04-26T11:14:54.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044083769999999998, 2024-04-26T11:14:54.788 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:54.788 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:54.788 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:54.788 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:54.788 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.788 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 186587 2024-04-26T11:14:54.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.788 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:54.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:54.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.772805+0000", 2024-04-26T11:14:54.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:54.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.772805+0000", 2024-04-26T11:14:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.772805+0000", 2024-04-26T11:14:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.772807+0000", 2024-04-26T11:14:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8559999999999998e-06 2024-04-26T11:14:54.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.772814+0000", 2024-04-26T11:14:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8229999999999997e-06 2024-04-26T11:14:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.772819+0000", 2024-04-26T11:14:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1819999999999997e-06 2024-04-26T11:14:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.774060+0000", 2024-04-26T11:14:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001240297 2024-04-26T11:14:54.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.774145+0000", 2024-04-26T11:14:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4907000000000005e-05 2024-04-26T11:14:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.774207+0000", 2024-04-26T11:14:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2359000000000004e-05 2024-04-26T11:14:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.776686+0000", 2024-04-26T11:14:54.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024787070000000001 2024-04-26T11:14:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:186590 5.4 5:27e8d1ff:::benchmark_data_smithi029_44842_object41952:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T11:14:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:54.774078+0000", 2024-04-26T11:14:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.002938768, 2024-04-26T11:14:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0032202950000000002, 2024-04-26T11:14:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.792 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 186590 2024-04-26T11:14:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.774078+0000", 2024-04-26T11:14:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.774078+0000", 2024-04-26T11:14:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:54.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.774077+0000", 2024-04-26T11:14:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.774082+0000", 2024-04-26T11:14:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9060000000000001e-06 2024-04-26T11:14:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.774090+0000", 2024-04-26T11:14:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:14:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.774097+0000", 2024-04-26T11:14:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0650000000000001e-06 2024-04-26T11:14:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.775318+0000", 2024-04-26T11:14:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001220945 2024-04-26T11:14:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.775426+0000", 2024-04-26T11:14:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108008 2024-04-26T11:14:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.795 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.775527+0000", 2024-04-26T11:14:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000101042 2024-04-26T11:14:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:186593 5.d 5:bbce8407:::benchmark_data_smithi029_44842_object41955:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T11:14:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:54.774804+0000", 2024-04-26T11:14:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0022123630000000002, 2024-04-26T11:14:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002567934, 2024-04-26T11:14:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:14:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:54.796 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 186593 2024-04-26T11:14:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.774804+0000", 2024-04-26T11:14:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.774804+0000", 2024-04-26T11:14:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:54.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.774804+0000", 2024-04-26T11:14:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.774808+0000", 2024-04-26T11:14:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2969999999999997e-06 2024-04-26T11:14:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.774819+0000", 2024-04-26T11:14:54.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1090999999999999e-05 2024-04-26T11:14:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.774826+0000", 2024-04-26T11:14:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0990000000000001e-06 2024-04-26T11:14:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.774854+0000", 2024-04-26T11:14:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7449000000000001e-05 2024-04-26T11:14:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.774926+0000", 2024-04-26T11:14:54.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2377000000000002e-05 2024-04-26T11:14:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:186598 5.b 5:d9b4b8e2:::benchmark_data_smithi029_44842_object41960:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T11:14:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:54.776508+0000", 2024-04-26T11:14:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00050840900000000003, 2024-04-26T11:14:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00092987099999999997, 2024-04-26T11:14:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:54.800 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 186598 2024-04-26T11:14:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.776508+0000", 2024-04-26T11:14:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.776508+0000", 2024-04-26T11:14:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.776508+0000", 2024-04-26T11:14:54.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.776512+0000", 2024-04-26T11:14:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6269999999999999e-06 2024-04-26T11:14:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.776526+0000", 2024-04-26T11:14:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3295999999999999e-05 2024-04-26T11:14:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.776534+0000", 2024-04-26T11:14:54.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:14:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.776561+0000", 2024-04-26T11:14:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7373e-05 2024-04-26T11:14:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.776655+0000", 2024-04-26T11:14:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4227000000000004e-05 2024-04-26T11:14:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:54.776718+0000", 2024-04-26T11:14:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2926e-05 2024-04-26T11:14:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:54.803 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:54.804 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:54.804 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:14:54.804 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 6 2024-04-26T11:14:54.804 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:54.805 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:54.847 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:54.845+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:54.909 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:54.907+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:55.010 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:55.009+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:55.013 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:55.013 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:14:55.013 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:14:55.013 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:14:55.013 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:55.026 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:55.110 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:55.109+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:55.193 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:14:55.211 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:55.210+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:55.234 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:55.234 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:14:55.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:14:55.234 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:55.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.234 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:55.234 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:55.234 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 61.95177271, 2024-04-26T11:14:55.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:14:55.235 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:55.235 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:55.235 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:55.235 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:55.235 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:55.235 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:14:55.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.235 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:55.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:55.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:55.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:55.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:55.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:55.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:55.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:55.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:55.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:14:55.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:14:55.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:55.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:14:55.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:14:55.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:55.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:14:55.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:14:55.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:14:55.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:14:55.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:14:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:14:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:14:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:14:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:14:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:14:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:14:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:14:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:14:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:14:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:14:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:14:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.240 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 61.951123008000003, 2024-04-26T11:14:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:14:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:14:55.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:55.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:14:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:14:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:14:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:14:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:14:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:55.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:14:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:14:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:14:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:14:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:14:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:14:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:14:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:14:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:14:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:14:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:14:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:14:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:14:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:14:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:14:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:14:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.246 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:55.247 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:55.247 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 57.884480969000002, 2024-04-26T11:14:55.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:14:55.247 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:55.247 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:55.247 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:55.247 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:55.247 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:55.247 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:14:55.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.247 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:55.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:55.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:55.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:55.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:55.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:55.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:14:55.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:55.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:55.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:14:55.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:14:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:14:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:14:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:14:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:14:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:14:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:14:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:14:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:14:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:14:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:14:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:55.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:14:55.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:14:55.251 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.251 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:55.251 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.251 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:55.251 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:55.251 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 57.884385322999997, 2024-04-26T11:14:55.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:14:55.251 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:55.251 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:55.251 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:55.251 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:14:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:14:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:14:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:14:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:14:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:14:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:14:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:14:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:14:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:14:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:14:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:14:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:14:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:14:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:14:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:14:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.255 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 57.884253643999998, 2024-04-26T11:14:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:14:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:14:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:55.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:14:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:14:55.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:14:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:14:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:14:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:14:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:14:55.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:14:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:14:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:14:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:14:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:14:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:14:55.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:14:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 57.884145187999998, 2024-04-26T11:14:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:14:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:14:55.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:14:55.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:14:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:14:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:14:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:14:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:55.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:14:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:14:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:14:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:14:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:14:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:14:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:14:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:14:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:14:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:14:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:55.264 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 57.884043920000003, 2024-04-26T11:14:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:14:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:14:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:14:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:14:55.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:14:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:14:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:14:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:14:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:14:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:14:55.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:14:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:14:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:14:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:14:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:14:55.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:14:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:14:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:14:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:14:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:14:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:14:55.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:14:55.270 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.270 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:55.270 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.270 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:55.270 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:55.270 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 57.883974979000001, 2024-04-26T11:14:55.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:14:55.270 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:55.270 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:55.270 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:55.270 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:55.270 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:55.271 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:14:55.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.271 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:55.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:55.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:55.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:55.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:55.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:55.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:14:55.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:55.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:55.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:14:55.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:14:55.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:55.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:14:55.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:14:55.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:55.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:14:55.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:14:55.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:14:55.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:14:55.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:55.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:14:55.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:14:55.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:14:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:14:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:14:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:14:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:14:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:14:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:55.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:14:55.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:14:55.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:55.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:14:55.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:14:55.275 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.275 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:55.275 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.275 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:55.275 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:55.276 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 57.877979398000001, 2024-04-26T11:14:55.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:14:55.276 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:55.276 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:55.276 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:55.276 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:55.276 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:55.276 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:14:55.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.276 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:55.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:55.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:55.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:14:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:14:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:14:55.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:14:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:14:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:14:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:14:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:14:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:14:55.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:14:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:14:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:14:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:14:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:14:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:14:55.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:14:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:14:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:14:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:14:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:14:55.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:14:55.281 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.281 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:55.281 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.281 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101754 5.e 5:7ca15a5c:::benchmark_data_smithi029_44842_object101753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:55.281 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:55.281 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.112031655999999, 2024-04-26T11:14:55.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039171048999999999, 2024-04-26T11:14:55.281 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:55.281 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:55.281 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:55.281 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:55.281 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:55.281 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101754 2024-04-26T11:14:55.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.282 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:55.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:55.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:55.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:55.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:55.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:55.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:55.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:55.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:55.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118604+0000", 2024-04-26T11:14:55.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3399000000000007e-05 2024-04-26T11:14:55.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:55.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118613+0000", 2024-04-26T11:14:55.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6989999999999992e-06 2024-04-26T11:14:55.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:55.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118618+0000", 2024-04-26T11:14:55.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3850000000000001e-06 2024-04-26T11:14:55.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118646+0000", 2024-04-26T11:14:55.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7878e-05 2024-04-26T11:14:55.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:55.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118720+0000", 2024-04-26T11:14:55.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3461999999999996e-05 2024-04-26T11:14:55.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:55.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118807+0000", 2024-04-26T11:14:55.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7269999999999996e-05 2024-04-26T11:14:55.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:55.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142317+0000", 2024-04-26T11:14:55.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023510105999999999 2024-04-26T11:14:55.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:55.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.143287+0000", 2024-04-26T11:14:55.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096983599999999996 2024-04-26T11:14:55.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:55.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157662+0000", 2024-04-26T11:14:55.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014375393 2024-04-26T11:14:55.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:55.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157702+0000", 2024-04-26T11:14:55.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0295e-05 2024-04-26T11:14:55.286 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.286 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:55.286 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.286 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101755 5.f 5:fa973a83:::benchmark_data_smithi029_44842_object101754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:55.286 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:55.287 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.111865960000003, 2024-04-26T11:14:55.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039139064000000001, 2024-04-26T11:14:55.287 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:55.287 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:55.287 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:55.287 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:55.287 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:55.287 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101755 2024-04-26T11:14:55.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.287 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:55.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:55.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:55.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:55.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:55.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:55.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118696+0000", 2024-04-26T11:14:55.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:55.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:55.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118766+0000", 2024-04-26T11:14:55.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9423000000000003e-05 2024-04-26T11:14:55.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:55.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118774+0000", 2024-04-26T11:14:55.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9710000000000004e-06 2024-04-26T11:14:55.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:55.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118779+0000", 2024-04-26T11:14:55.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5629999999999999e-06 2024-04-26T11:14:55.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118817+0000", 2024-04-26T11:14:55.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7771000000000001e-05 2024-04-26T11:14:55.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118929+0000", 2024-04-26T11:14:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011222699999999999 2024-04-26T11:14:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157661+0000", 2024-04-26T11:14:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038731120000000001 2024-04-26T11:14:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157757+0000", 2024-04-26T11:14:55.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6910000000000006e-05 2024-04-26T11:14:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157836+0000", 2024-04-26T11:14:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8727999999999996e-05 2024-04-26T11:14:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101758 5.4 5:2525a4eb:::benchmark_data_smithi029_44842_object101757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.109683109000002, 2024-04-26T11:14:55.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.03686739, 2024-04-26T11:14:55.293 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:55.293 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:55.293 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:55.293 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:55.293 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:55.293 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101758 2024-04-26T11:14:55.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.293 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:55.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:55.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120879+0000", 2024-04-26T11:14:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:55.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120971+0000", 2024-04-26T11:14:55.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2133999999999996e-05 2024-04-26T11:14:55.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:55.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120977+0000", 2024-04-26T11:14:55.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5509999999999999e-06 2024-04-26T11:14:55.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:55.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120981+0000", 2024-04-26T11:14:55.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.245e-06 2024-04-26T11:14:55.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121010+0000", 2024-04-26T11:14:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9084000000000001e-05 2024-04-26T11:14:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121083+0000", 2024-04-26T11:14:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2942999999999996e-05 2024-04-26T11:14:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121163+0000", 2024-04-26T11:14:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0197000000000005e-05 2024-04-26T11:14:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:55.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142822+0000", 2024-04-26T11:14:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021658535999999999 2024-04-26T11:14:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157674+0000", 2024-04-26T11:14:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014851573999999999 2024-04-26T11:14:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157714+0000", 2024-04-26T11:14:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0473999999999999e-05 2024-04-26T11:14:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:55.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157747+0000", 2024-04-26T11:14:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3278999999999998e-05 2024-04-26T11:14:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101760 5.4 5:2510211a:::benchmark_data_smithi029_44842_object101759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.109250764000002, 2024-04-26T11:14:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039182383000000001, 2024-04-26T11:14:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:55.298 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101760 2024-04-26T11:14:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:55.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121389+0000", 2024-04-26T11:14:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6667000000000003e-05 2024-04-26T11:14:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121394+0000", 2024-04-26T11:14:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0839999999999999e-06 2024-04-26T11:14:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:55.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121397+0000", 2024-04-26T11:14:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4489999999999999e-06 2024-04-26T11:14:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122921+0000", 2024-04-26T11:14:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001524067 2024-04-26T11:14:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.123010+0000", 2024-04-26T11:14:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8449000000000006e-05 2024-04-26T11:14:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:55.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140838+0000", 2024-04-26T11:14:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017828796000000001 2024-04-26T11:14:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157665+0000", 2024-04-26T11:14:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016826574 2024-04-26T11:14:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160407+0000", 2024-04-26T11:14:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027423970000000002 2024-04-26T11:14:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160456+0000", 2024-04-26T11:14:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8678999999999999e-05 2024-04-26T11:14:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160495+0000", 2024-04-26T11:14:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8658000000000002e-05 2024-04-26T11:14:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101761 5.e 5:70294421:::benchmark_data_smithi029_44842_object101760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:55.303 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.107826391000003, 2024-04-26T11:14:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035270448000000003, 2024-04-26T11:14:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101761 2024-04-26T11:14:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122736+0000", 2024-04-26T11:14:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122805+0000", 2024-04-26T11:14:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9076000000000001e-05 2024-04-26T11:14:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122811+0000", 2024-04-26T11:14:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:14:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122815+0000", 2024-04-26T11:14:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2860000000000001e-06 2024-04-26T11:14:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122842+0000", 2024-04-26T11:14:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6429000000000001e-05 2024-04-26T11:14:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122916+0000", 2024-04-26T11:14:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4122999999999995e-05 2024-04-26T11:14:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122997+0000", 2024-04-26T11:14:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1428999999999996e-05 2024-04-26T11:14:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142344+0000", 2024-04-26T11:14:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019346452 2024-04-26T11:14:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157934+0000", 2024-04-26T11:14:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015589911999999999 2024-04-26T11:14:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157975+0000", 2024-04-26T11:14:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1604999999999999e-05 2024-04-26T11:14:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.158007+0000", 2024-04-26T11:14:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1921000000000002e-05 2024-04-26T11:14:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:55.308 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110145 5.9 5:9b275f16:::benchmark_data_smithi029_44842_object110144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 32.082264752999997, 2024-04-26T11:14:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032844496000000001, 2024-04-26T11:14:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110145 2024-04-26T11:14:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:55.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148297+0000", 2024-04-26T11:14:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:55.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148325+0000", 2024-04-26T11:14:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7511000000000001e-05 2024-04-26T11:14:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148338+0000", 2024-04-26T11:14:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2808e-05 2024-04-26T11:14:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148345+0000", 2024-04-26T11:14:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7200000000000006e-06 2024-04-26T11:14:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149888+0000", 2024-04-26T11:14:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001542666 2024-04-26T11:14:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149977+0000", 2024-04-26T11:14:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9247999999999997e-05 2024-04-26T11:14:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181006+0000", 2024-04-26T11:14:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031028535999999999 2024-04-26T11:14:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181051+0000", 2024-04-26T11:14:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5393999999999999e-05 2024-04-26T11:14:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181143+0000", 2024-04-26T11:14:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1458000000000004e-05 2024-04-26T11:14:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110155 5.9 5:9ebc6158:::benchmark_data_smithi029_44842_object110154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:55.313 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 32.077188960999997, 2024-04-26T11:14:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027886826999999999, 2024-04-26T11:14:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110155 2024-04-26T11:14:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:55.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153373+0000", 2024-04-26T11:14:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153479+0000", 2024-04-26T11:14:55.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105728 2024-04-26T11:14:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153491+0000", 2024-04-26T11:14:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2207e-05 2024-04-26T11:14:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153499+0000", 2024-04-26T11:14:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7729999999999999e-06 2024-04-26T11:14:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153655+0000", 2024-04-26T11:14:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015573 2024-04-26T11:14:55.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153770+0000", 2024-04-26T11:14:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011562500000000001 2024-04-26T11:14:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181153+0000", 2024-04-26T11:14:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027382113 2024-04-26T11:14:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181195+0000", 2024-04-26T11:14:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1921000000000001e-05 2024-04-26T11:14:55.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181261+0000", 2024-04-26T11:14:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6402999999999994e-05 2024-04-26T11:14:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174398 5.4 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:14:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.8806727490000004, 2024-04-26T11:14:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.064773789999999998, 2024-04-26T11:14:55.318 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174398 2024-04-26T11:14:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:14:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:55.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:14:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349889+0000", 2024-04-26T11:14:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349895+0000", 2024-04-26T11:14:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4519999999999996e-06 2024-04-26T11:14:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349909+0000", 2024-04-26T11:14:55.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3791000000000001e-05 2024-04-26T11:14:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349919+0000", 2024-04-26T11:14:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0135999999999999e-05 2024-04-26T11:14:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349956+0000", 2024-04-26T11:14:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7642000000000003e-05 2024-04-26T11:14:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:55.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350080+0000", 2024-04-26T11:14:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123285 2024-04-26T11:14:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350192+0000", 2024-04-26T11:14:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112509 2024-04-26T11:14:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356232+0000", 2024-04-26T11:14:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060403339999999996 2024-04-26T11:14:55.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414616+0000", 2024-04-26T11:14:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.058383156999999998 2024-04-26T11:14:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414643+0000", 2024-04-26T11:14:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7317e-05 2024-04-26T11:14:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414664+0000", 2024-04-26T11:14:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1135999999999999e-05 2024-04-26T11:14:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.323 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174402 5.b 5:d8ad746d:::benchmark_data_smithi029_44842_object29764:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:14:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.8767185600000005, 2024-04-26T11:14:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059017657000000001, 2024-04-26T11:14:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174402 2024-04-26T11:14:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.324 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:14:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:14:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:14:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:55.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353848+0000", 2024-04-26T11:14:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5040000000000004e-06 2024-04-26T11:14:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353858+0000", 2024-04-26T11:14:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7410000000000004e-06 2024-04-26T11:14:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353864+0000", 2024-04-26T11:14:55.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7899999999999996e-06 2024-04-26T11:14:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353902+0000", 2024-04-26T11:14:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8325000000000003e-05 2024-04-26T11:14:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353980+0000", 2024-04-26T11:14:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8077000000000005e-05 2024-04-26T11:14:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:55.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354046+0000", 2024-04-26T11:14:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6249999999999998e-05 2024-04-26T11:14:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356532+0000", 2024-04-26T11:14:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024850969999999999 2024-04-26T11:14:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412796+0000", 2024-04-26T11:14:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056264616000000003 2024-04-26T11:14:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412835+0000", 2024-04-26T11:14:55.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8863999999999999e-05 2024-04-26T11:14:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412862+0000", 2024-04-26T11:14:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7124e-05 2024-04-26T11:14:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174403 5.4 5:2d30cd6a:::benchmark_data_smithi029_44842_object29765:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:14:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.8766913570000003, 2024-04-26T11:14:55.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.060873365999999998, 2024-04-26T11:14:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174403 2024-04-26T11:14:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:14:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:14:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353871+0000", 2024-04-26T11:14:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353874+0000", 2024-04-26T11:14:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869999999999999e-06 2024-04-26T11:14:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353881+0000", 2024-04-26T11:14:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2239999999999998e-06 2024-04-26T11:14:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353886+0000", 2024-04-26T11:14:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.259e-06 2024-04-26T11:14:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353912+0000", 2024-04-26T11:14:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6404999999999999e-05 2024-04-26T11:14:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353991+0000", 2024-04-26T11:14:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8104999999999998e-05 2024-04-26T11:14:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354055+0000", 2024-04-26T11:14:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4875999999999993e-05 2024-04-26T11:14:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.358000+0000", 2024-04-26T11:14:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039442629999999999 2024-04-26T11:14:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414690+0000", 2024-04-26T11:14:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056689940000000001 2024-04-26T11:14:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414714+0000", 2024-04-26T11:14:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4527000000000001e-05 2024-04-26T11:14:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414745+0000", 2024-04-26T11:14:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0874999999999998e-05 2024-04-26T11:14:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:55.334 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174404 5.4 5:2801f1e1:::benchmark_data_smithi029_44842_object29766:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:14:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.8740744329999997, 2024-04-26T11:14:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059745741999999998, 2024-04-26T11:14:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174404 2024-04-26T11:14:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:14:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:14:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356488+0000", 2024-04-26T11:14:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356492+0000", 2024-04-26T11:14:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1169999999999997e-06 2024-04-26T11:14:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356502+0000", 2024-04-26T11:14:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0263e-05 2024-04-26T11:14:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356508+0000", 2024-04-26T11:14:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5890000000000002e-06 2024-04-26T11:14:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356545+0000", 2024-04-26T11:14:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7382999999999998e-05 2024-04-26T11:14:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356671+0000", 2024-04-26T11:14:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012535500000000001 2024-04-26T11:14:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356789+0000", 2024-04-26T11:14:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000118099 2024-04-26T11:14:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.359200+0000", 2024-04-26T11:14:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024110059999999998 2024-04-26T11:14:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416180+0000", 2024-04-26T11:14:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056980335999999999 2024-04-26T11:14:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416204+0000", 2024-04-26T11:14:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4301e-05 2024-04-26T11:14:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:55.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:55.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416234+0000", 2024-04-26T11:14:55.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9903000000000002e-05 2024-04-26T11:14:55.340 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.340 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:55.340 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.340 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:55.340 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:55.340 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:55.341 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:55.339+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:55.342 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:55.344 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:55.365 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:55.366 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:55.366 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:55.366 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:55.368 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:55.368 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:55.442 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:55.440+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:55.531 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:55.532 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:55.543 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:55.542+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:55.545 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:55.643 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:55.642+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:55.744 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:55.742+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:55.774 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:55.774 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:55.790 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:55.845 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:55.843+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:55.946 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:55.944+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:55.976 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:55.976 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:55.992 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:56.047 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:56.045+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:56.147 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:56.146+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:56.162 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:56.162 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:56.176 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:56.261 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:56.259+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:56.349 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:56.348+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:56.396 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:56.397 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:56.402 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:56.450 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:56.449+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:56.551 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:56.549+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:56.614 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:56.614 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:56.629 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:56.679 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:56.673+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:56.697 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:14:56.753 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:56.751+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:56.824 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:56.824 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:56.836 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:56.853 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:56.851+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:56.954 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:56.952+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:57.055 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:57.053+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:57.064 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:57.064 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:57.080 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:57.156 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:57.155+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:57.257 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:57.255+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:57.268 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:57.268 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:57.282 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:57.357 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:57.357+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:57.369 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:14:57.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~59s 2024-04-26T11:14:57.458 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:57.457+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:57.460 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:57.460 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:57.474 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:57.518 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:57.541 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:57.541 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:57.541 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:57.541 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:57.543 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:57.544 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:57.560 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:57.558+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:57.653 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:57.654 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:14:57.654 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:14:57.654 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:14:57.654 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:57.660 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:57.658+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:57.663 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:57.686 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:14:57.763 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:57.762+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:57.864 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:57.862+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:57.877 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:57.877 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:14:57.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:14:57.877 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:57.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.877 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:57.878 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:57.878 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.594953438999994, 2024-04-26T11:14:57.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:14:57.878 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:57.878 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:57.878 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:57.878 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:57.878 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:57.878 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:14:57.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.878 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:57.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:57.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:57.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:57.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:57.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:57.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:57.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:57.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:57.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:14:57.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:14:57.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:57.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:14:57.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:14:57.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:57.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:14:57.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:14:57.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:14:57.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:14:57.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:57.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:14:57.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:14:57.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:57.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:14:57.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:14:57.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:57.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:14:57.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:14:57.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:57.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:14:57.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:14:57.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:57.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:14:57.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:14:57.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:57.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:14:57.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:14:57.883 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.883 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:57.883 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.883 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:57.883 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:57.884 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 64.594303737000004, 2024-04-26T11:14:57.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:14:57.884 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:57.884 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:57.884 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:57.884 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:57.884 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:57.884 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:14:57.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.884 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:57.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:57.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:57.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:57.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:57.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:57.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:14:57.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:57.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:57.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:14:57.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:14:57.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:57.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:14:57.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:14:57.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:57.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:14:57.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:14:57.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:14:57.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:14:57.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:57.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:14:57.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:14:57.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:57.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:14:57.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:14:57.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:57.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:14:57.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:14:57.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:57.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:14:57.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:14:57.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:57.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:14:57.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:14:57.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:57.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:14:57.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:14:57.889 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.889 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:57.889 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.889 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:57.889 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:57.889 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.527661698000003, 2024-04-26T11:14:57.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:14:57.889 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:57.889 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:57.889 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:57.889 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:57.889 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:57.890 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:14:57.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.890 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:57.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:57.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:57.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:57.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:57.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:57.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:14:57.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:57.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:57.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:14:57.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:14:57.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:57.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:14:57.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:14:57.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:57.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:14:57.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:14:57.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:14:57.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:14:57.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:57.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:14:57.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:14:57.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:14:57.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:14:57.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:57.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:14:57.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:14:57.893 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.893 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:57.893 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.893 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:57.894 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:57.894 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.527566051999997, 2024-04-26T11:14:57.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:14:57.894 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:57.894 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:57.894 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:57.894 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:57.894 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:57.894 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:14:57.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.894 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:57.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:57.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:57.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:57.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:57.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:57.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:14:57.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:57.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:57.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:14:57.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:14:57.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:57.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:14:57.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:14:57.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:57.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:14:57.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:14:57.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:14:57.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:14:57.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:57.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:14:57.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:14:57.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:14:57.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:14:57.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:57.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:14:57.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:14:57.898 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.898 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:57.898 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.898 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:57.898 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:57.898 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.527434372999998, 2024-04-26T11:14:57.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:14:57.898 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:57.898 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:57.899 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:57.899 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:57.899 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:57.899 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:14:57.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.899 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:57.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:57.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:57.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:57.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:57.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:57.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:57.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:57.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:57.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:14:57.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:14:57.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:57.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:14:57.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:14:57.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:57.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:14:57.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:14:57.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:14:57.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:14:57.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:57.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:14:57.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:14:57.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:14:57.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:14:57.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:57.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:14:57.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:14:57.902 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.902 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:57.902 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.902 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:57.903 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:57.903 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.527325916999999, 2024-04-26T11:14:57.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:14:57.903 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:57.903 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:57.903 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:57.903 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:57.903 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:57.903 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:14:57.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.903 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:57.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:57.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:57.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:57.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:57.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:57.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:14:57.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:57.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:57.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:14:57.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:14:57.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:57.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:14:57.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:14:57.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:57.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:14:57.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:14:57.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:14:57.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:14:57.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:57.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:14:57.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:14:57.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:14:57.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:14:57.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:57.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:14:57.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:14:57.907 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.907 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:57.907 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.907 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:57.907 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:57.907 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.527224648999997, 2024-04-26T11:14:57.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:14:57.907 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:57.907 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:57.907 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:57.907 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:57.908 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:57.908 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:14:57.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.908 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:57.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:57.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:57.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:57.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:57.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:57.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:57.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:57.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:57.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:14:57.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:14:57.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:57.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:14:57.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:14:57.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:57.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:14:57.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:14:57.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:14:57.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:14:57.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:57.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:14:57.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:14:57.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:14:57.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:14:57.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:57.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:14:57.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:14:57.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:57.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:14:57.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:14:57.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:57.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:14:57.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:14:57.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:57.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:14:57.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:14:57.912 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.912 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:57.912 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.912 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:57.912 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:57.913 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.527155708000002, 2024-04-26T11:14:57.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:14:57.913 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:57.913 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:57.913 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:57.913 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:57.913 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:57.913 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:14:57.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.913 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:57.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:57.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:57.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:57.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:57.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:57.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:14:57.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:57.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:57.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:14:57.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:14:57.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:57.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:14:57.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:14:57.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:57.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:14:57.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:14:57.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:14:57.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:14:57.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:57.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:14:57.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:14:57.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:14:57.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:14:57.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:57.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:14:57.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:14:57.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:57.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:14:57.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:14:57.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:57.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:14:57.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:14:57.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:57.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:14:57.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:14:57.918 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.918 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:57.918 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.918 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:57.918 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:57.918 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 60.521160127000002, 2024-04-26T11:14:57.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:14:57.918 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:57.918 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:57.918 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:57.918 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:57.919 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:57.919 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:14:57.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.919 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:57.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:57.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:57.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:57.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:57.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:57.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:14:57.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:57.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:57.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:14:57.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:14:57.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:57.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:14:57.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:14:57.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:57.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:14:57.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:14:57.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:14:57.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:14:57.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:57.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:14:57.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:14:57.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:14:57.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:14:57.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:57.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:14:57.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:14:57.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:57.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:14:57.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:14:57.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:57.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:14:57.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:14:57.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:57.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:14:57.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:14:57.923 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.923 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:57.924 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.924 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101754 5.e 5:7ca15a5c:::benchmark_data_smithi029_44842_object101753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:57.924 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:57.924 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.755212385, 2024-04-26T11:14:57.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039171048999999999, 2024-04-26T11:14:57.924 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:57.924 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:57.924 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:57.924 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:57.924 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:57.924 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101754 2024-04-26T11:14:57.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.925 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:57.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:57.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:57.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:57.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:57.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:57.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:57.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:57.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:57.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118604+0000", 2024-04-26T11:14:57.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3399000000000007e-05 2024-04-26T11:14:57.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:57.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118613+0000", 2024-04-26T11:14:57.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6989999999999992e-06 2024-04-26T11:14:57.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:57.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118618+0000", 2024-04-26T11:14:57.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3850000000000001e-06 2024-04-26T11:14:57.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118646+0000", 2024-04-26T11:14:57.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7878e-05 2024-04-26T11:14:57.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:57.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118720+0000", 2024-04-26T11:14:57.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3461999999999996e-05 2024-04-26T11:14:57.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:57.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118807+0000", 2024-04-26T11:14:57.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7269999999999996e-05 2024-04-26T11:14:57.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:57.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142317+0000", 2024-04-26T11:14:57.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023510105999999999 2024-04-26T11:14:57.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:57.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.143287+0000", 2024-04-26T11:14:57.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096983599999999996 2024-04-26T11:14:57.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:57.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157662+0000", 2024-04-26T11:14:57.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014375393 2024-04-26T11:14:57.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:57.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157702+0000", 2024-04-26T11:14:57.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0295e-05 2024-04-26T11:14:57.929 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.929 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:57.929 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.929 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101755 5.f 5:fa973a83:::benchmark_data_smithi029_44842_object101754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:57.929 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:57.929 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.755046688999997, 2024-04-26T11:14:57.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039139064000000001, 2024-04-26T11:14:57.929 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:57.930 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:57.930 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:57.930 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:57.930 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:57.930 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101755 2024-04-26T11:14:57.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.930 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:57.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:57.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:57.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118696+0000", 2024-04-26T11:14:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118766+0000", 2024-04-26T11:14:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9423000000000003e-05 2024-04-26T11:14:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118774+0000", 2024-04-26T11:14:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9710000000000004e-06 2024-04-26T11:14:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118779+0000", 2024-04-26T11:14:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5629999999999999e-06 2024-04-26T11:14:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118817+0000", 2024-04-26T11:14:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7771000000000001e-05 2024-04-26T11:14:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118929+0000", 2024-04-26T11:14:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011222699999999999 2024-04-26T11:14:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157661+0000", 2024-04-26T11:14:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038731120000000001 2024-04-26T11:14:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157757+0000", 2024-04-26T11:14:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6910000000000006e-05 2024-04-26T11:14:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157836+0000", 2024-04-26T11:14:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8727999999999996e-05 2024-04-26T11:14:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101758 5.4 5:2525a4eb:::benchmark_data_smithi029_44842_object101757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.752863838000003, 2024-04-26T11:14:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.03686739, 2024-04-26T11:14:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:57.934 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101758 2024-04-26T11:14:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:57.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120879+0000", 2024-04-26T11:14:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120971+0000", 2024-04-26T11:14:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2133999999999996e-05 2024-04-26T11:14:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120977+0000", 2024-04-26T11:14:57.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5509999999999999e-06 2024-04-26T11:14:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120981+0000", 2024-04-26T11:14:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.245e-06 2024-04-26T11:14:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121010+0000", 2024-04-26T11:14:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9084000000000001e-05 2024-04-26T11:14:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121083+0000", 2024-04-26T11:14:57.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2942999999999996e-05 2024-04-26T11:14:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121163+0000", 2024-04-26T11:14:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0197000000000005e-05 2024-04-26T11:14:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142822+0000", 2024-04-26T11:14:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021658535999999999 2024-04-26T11:14:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:57.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157674+0000", 2024-04-26T11:14:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014851573999999999 2024-04-26T11:14:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157714+0000", 2024-04-26T11:14:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0473999999999999e-05 2024-04-26T11:14:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157747+0000", 2024-04-26T11:14:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3278999999999998e-05 2024-04-26T11:14:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101760 5.4 5:2510211a:::benchmark_data_smithi029_44842_object101759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.752431493000003, 2024-04-26T11:14:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039182383000000001, 2024-04-26T11:14:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101760 2024-04-26T11:14:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121389+0000", 2024-04-26T11:14:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6667000000000003e-05 2024-04-26T11:14:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121394+0000", 2024-04-26T11:14:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0839999999999999e-06 2024-04-26T11:14:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121397+0000", 2024-04-26T11:14:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4489999999999999e-06 2024-04-26T11:14:57.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122921+0000", 2024-04-26T11:14:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001524067 2024-04-26T11:14:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.123010+0000", 2024-04-26T11:14:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8449000000000006e-05 2024-04-26T11:14:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140838+0000", 2024-04-26T11:14:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017828796000000001 2024-04-26T11:14:57.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157665+0000", 2024-04-26T11:14:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016826574 2024-04-26T11:14:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160407+0000", 2024-04-26T11:14:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027423970000000002 2024-04-26T11:14:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160456+0000", 2024-04-26T11:14:57.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8678999999999999e-05 2024-04-26T11:14:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160495+0000", 2024-04-26T11:14:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8658000000000002e-05 2024-04-26T11:14:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101761 5.e 5:70294421:::benchmark_data_smithi029_44842_object101760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.751007119999997, 2024-04-26T11:14:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035270448000000003, 2024-04-26T11:14:57.945 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101761 2024-04-26T11:14:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:57.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122736+0000", 2024-04-26T11:14:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122805+0000", 2024-04-26T11:14:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9076000000000001e-05 2024-04-26T11:14:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:57.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122811+0000", 2024-04-26T11:14:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:14:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122815+0000", 2024-04-26T11:14:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2860000000000001e-06 2024-04-26T11:14:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122842+0000", 2024-04-26T11:14:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6429000000000001e-05 2024-04-26T11:14:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:57.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122916+0000", 2024-04-26T11:14:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4122999999999995e-05 2024-04-26T11:14:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122997+0000", 2024-04-26T11:14:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1428999999999996e-05 2024-04-26T11:14:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142344+0000", 2024-04-26T11:14:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019346452 2024-04-26T11:14:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157934+0000", 2024-04-26T11:14:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015589911999999999 2024-04-26T11:14:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157975+0000", 2024-04-26T11:14:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1604999999999999e-05 2024-04-26T11:14:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.158007+0000", 2024-04-26T11:14:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1921000000000002e-05 2024-04-26T11:14:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.950 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110145 5.9 5:9b275f16:::benchmark_data_smithi029_44842_object110144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.725445481999998, 2024-04-26T11:14:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032844496000000001, 2024-04-26T11:14:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110145 2024-04-26T11:14:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.951 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148297+0000", 2024-04-26T11:14:57.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148325+0000", 2024-04-26T11:14:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7511000000000001e-05 2024-04-26T11:14:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148338+0000", 2024-04-26T11:14:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2808e-05 2024-04-26T11:14:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148345+0000", 2024-04-26T11:14:57.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7200000000000006e-06 2024-04-26T11:14:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149888+0000", 2024-04-26T11:14:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001542666 2024-04-26T11:14:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149977+0000", 2024-04-26T11:14:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9247999999999997e-05 2024-04-26T11:14:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181006+0000", 2024-04-26T11:14:57.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031028535999999999 2024-04-26T11:14:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181051+0000", 2024-04-26T11:14:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5393999999999999e-05 2024-04-26T11:14:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181143+0000", 2024-04-26T11:14:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1458000000000004e-05 2024-04-26T11:14:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110155 5.9 5:9ebc6158:::benchmark_data_smithi029_44842_object110154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.720369689999998, 2024-04-26T11:14:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027886826999999999, 2024-04-26T11:14:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110155 2024-04-26T11:14:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:57.956 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153373+0000", 2024-04-26T11:14:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:57.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153479+0000", 2024-04-26T11:14:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105728 2024-04-26T11:14:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153491+0000", 2024-04-26T11:14:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2207e-05 2024-04-26T11:14:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153499+0000", 2024-04-26T11:14:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7729999999999999e-06 2024-04-26T11:14:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153655+0000", 2024-04-26T11:14:57.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015573 2024-04-26T11:14:57.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:57.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153770+0000", 2024-04-26T11:14:57.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011562500000000001 2024-04-26T11:14:57.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181153+0000", 2024-04-26T11:14:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027382113 2024-04-26T11:14:57.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181195+0000", 2024-04-26T11:14:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1921000000000001e-05 2024-04-26T11:14:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181261+0000", 2024-04-26T11:14:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6402999999999994e-05 2024-04-26T11:14:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174398 5.4 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:14:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.5238534780000004, 2024-04-26T11:14:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.064773789999999998, 2024-04-26T11:14:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174398 2024-04-26T11:14:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:57.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:14:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:14:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349889+0000", 2024-04-26T11:14:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:57.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349895+0000", 2024-04-26T11:14:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4519999999999996e-06 2024-04-26T11:14:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349909+0000", 2024-04-26T11:14:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3791000000000001e-05 2024-04-26T11:14:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349919+0000", 2024-04-26T11:14:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0135999999999999e-05 2024-04-26T11:14:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349956+0000", 2024-04-26T11:14:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7642000000000003e-05 2024-04-26T11:14:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350080+0000", 2024-04-26T11:14:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123285 2024-04-26T11:14:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350192+0000", 2024-04-26T11:14:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112509 2024-04-26T11:14:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:57.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356232+0000", 2024-04-26T11:14:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060403339999999996 2024-04-26T11:14:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414616+0000", 2024-04-26T11:14:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.058383156999999998 2024-04-26T11:14:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414643+0000", 2024-04-26T11:14:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7317e-05 2024-04-26T11:14:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:57.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414664+0000", 2024-04-26T11:14:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1135999999999999e-05 2024-04-26T11:14:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174402 5.b 5:d8ad746d:::benchmark_data_smithi029_44842_object29764:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:14:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.5198992889999996, 2024-04-26T11:14:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059017657000000001, 2024-04-26T11:14:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:57.968 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174402 2024-04-26T11:14:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:14:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:14:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:14:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353848+0000", 2024-04-26T11:14:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5040000000000004e-06 2024-04-26T11:14:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353858+0000", 2024-04-26T11:14:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7410000000000004e-06 2024-04-26T11:14:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353864+0000", 2024-04-26T11:14:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7899999999999996e-06 2024-04-26T11:14:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353902+0000", 2024-04-26T11:14:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8325000000000003e-05 2024-04-26T11:14:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353980+0000", 2024-04-26T11:14:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8077000000000005e-05 2024-04-26T11:14:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354046+0000", 2024-04-26T11:14:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6249999999999998e-05 2024-04-26T11:14:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356532+0000", 2024-04-26T11:14:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024850969999999999 2024-04-26T11:14:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412796+0000", 2024-04-26T11:14:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056264616000000003 2024-04-26T11:14:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412835+0000", 2024-04-26T11:14:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8863999999999999e-05 2024-04-26T11:14:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412862+0000", 2024-04-26T11:14:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7124e-05 2024-04-26T11:14:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174403 5.4 5:2d30cd6a:::benchmark_data_smithi029_44842_object29765:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:14:57.973 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.5198720860000003, 2024-04-26T11:14:57.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.060873365999999998, 2024-04-26T11:14:57.974 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:57.974 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:57.974 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:57.974 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:57.974 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:57.974 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174403 2024-04-26T11:14:57.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.974 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:57.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:57.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:14:57.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:57.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:14:57.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:57.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353871+0000", 2024-04-26T11:14:57.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:57.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:57.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353874+0000", 2024-04-26T11:14:57.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869999999999999e-06 2024-04-26T11:14:57.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:57.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353881+0000", 2024-04-26T11:14:57.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2239999999999998e-06 2024-04-26T11:14:57.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:57.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353886+0000", 2024-04-26T11:14:57.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.259e-06 2024-04-26T11:14:57.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353912+0000", 2024-04-26T11:14:57.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6404999999999999e-05 2024-04-26T11:14:57.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:57.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353991+0000", 2024-04-26T11:14:57.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8104999999999998e-05 2024-04-26T11:14:57.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:57.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354055+0000", 2024-04-26T11:14:57.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4875999999999993e-05 2024-04-26T11:14:57.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:57.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.358000+0000", 2024-04-26T11:14:57.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039442629999999999 2024-04-26T11:14:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414690+0000", 2024-04-26T11:14:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056689940000000001 2024-04-26T11:14:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414714+0000", 2024-04-26T11:14:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4527000000000001e-05 2024-04-26T11:14:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414745+0000", 2024-04-26T11:14:57.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0874999999999998e-05 2024-04-26T11:14:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174404 5.4 5:2801f1e1:::benchmark_data_smithi029_44842_object29766:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:14:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 7.5172551619999997, 2024-04-26T11:14:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059745741999999998, 2024-04-26T11:14:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:57.979 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174404 2024-04-26T11:14:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:14:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:14:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:57.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356488+0000", 2024-04-26T11:14:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356492+0000", 2024-04-26T11:14:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1169999999999997e-06 2024-04-26T11:14:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356502+0000", 2024-04-26T11:14:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0263e-05 2024-04-26T11:14:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:57.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356508+0000", 2024-04-26T11:14:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5890000000000002e-06 2024-04-26T11:14:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356545+0000", 2024-04-26T11:14:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7382999999999998e-05 2024-04-26T11:14:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356671+0000", 2024-04-26T11:14:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012535500000000001 2024-04-26T11:14:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356789+0000", 2024-04-26T11:14:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000118099 2024-04-26T11:14:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.359200+0000", 2024-04-26T11:14:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024110059999999998 2024-04-26T11:14:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416180+0000", 2024-04-26T11:14:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056980335999999999 2024-04-26T11:14:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416204+0000", 2024-04-26T11:14:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4301e-05 2024-04-26T11:14:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416234+0000", 2024-04-26T11:14:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9903000000000002e-05 2024-04-26T11:14:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:57.984 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:57.984 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:57.986 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:57.984+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:57.986 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:58.086 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:58.085+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:58.170 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:58.170 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:58.171 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.171 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:195781 5.5 5:a14b9ab2:::benchmark_data_smithi029_44842_object51143:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T11:14:58.171 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:58.164055+0000", 2024-04-26T11:14:58.171 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.003740569, 2024-04-26T11:14:58.171 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003773626, 2024-04-26T11:14:58.171 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.171 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:58.171 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:58.171 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:58.171 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.172 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 195781 2024-04-26T11:14:58.172 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.172 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.172 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.172 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.172 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.164055+0000", 2024-04-26T11:14:58.172 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.172 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.172 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.172 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.172 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.164055+0000", 2024-04-26T11:14:58.172 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.173 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.173 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.173 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.164054+0000", 2024-04-26T11:14:58.173 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.173 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.173 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.173 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.164058+0000", 2024-04-26T11:14:58.173 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.455e-06 2024-04-26T11:14:58.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.174 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.174 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.174 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.164066+0000", 2024-04-26T11:14:58.174 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.1100000000000003e-06 2024-04-26T11:14:58.174 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.174 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.174 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.174 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.164072+0000", 2024-04-26T11:14:58.174 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0270000000000001e-06 2024-04-26T11:14:58.174 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.174 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.175 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.175 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.164107+0000", 2024-04-26T11:14:58.175 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4788e-05 2024-04-26T11:14:58.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.175 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.175 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.175 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.164227+0000", 2024-04-26T11:14:58.175 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000120513 2024-04-26T11:14:58.175 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.175 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.175 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.176 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.176 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:195779 5.4 e49/16 5:292b8cc3:::benchmark_data_smithi029_44842_object51141:head v 49'12142, mlcod=49'12140)", 2024-04-26T11:14:58.176 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:58.164272+0000", 2024-04-26T11:14:58.176 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0035238629999999999, 2024-04-26T11:14:58.176 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0036371670000000002, 2024-04-26T11:14:58.176 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.176 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:58.176 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.176 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.176 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.176 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.164272+0000", 2024-04-26T11:14:58.176 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.177 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.177 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.177 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.177 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.164272+0000", 2024-04-26T11:14:58.177 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.177 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.177 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.177 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.177 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.164271+0000", 2024-04-26T11:14:58.177 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.177 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.177 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.178 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.178 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.164277+0000", 2024-04-26T11:14:58.178 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1480000000000003e-06 2024-04-26T11:14:58.178 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.178 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.178 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.178 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.164286+0000", 2024-04-26T11:14:58.178 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6160000000000002e-06 2024-04-26T11:14:58.178 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.178 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.178 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.178 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.164293+0000", 2024-04-26T11:14:58.179 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.798e-06 2024-04-26T11:14:58.179 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.179 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.180 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.180 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.164446+0000", 2024-04-26T11:14:58.180 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015317400000000001 2024-04-26T11:14:58.180 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.180 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.180 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.180 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.164468+0000", 2024-04-26T11:14:58.180 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1922000000000001e-05 2024-04-26T11:14:58.180 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.180 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.180 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.180 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.180 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.180 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:195782 5.4 e49/16 5:2e0105ba:::benchmark_data_smithi029_44842_object51144:head v 49'12143, mlcod=49'12140)", 2024-04-26T11:14:58.181 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:58.165759+0000", 2024-04-26T11:14:58.181 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0020364160000000001, 2024-04-26T11:14:58.181 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002229848, 2024-04-26T11:14:58.181 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.181 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:58.181 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.181 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.181 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.181 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.165759+0000", 2024-04-26T11:14:58.181 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.181 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.181 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.181 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.181 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.165759+0000", 2024-04-26T11:14:58.182 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.182 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.182 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.182 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.165759+0000", 2024-04-26T11:14:58.182 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.182 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.182 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.182 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.165764+0000", 2024-04-26T11:14:58.182 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6609999999999997e-06 2024-04-26T11:14:58.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.182 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.182 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.183 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.165774+0000", 2024-04-26T11:14:58.183 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6870000000000006e-06 2024-04-26T11:14:58.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.183 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.183 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.183 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.165780+0000", 2024-04-26T11:14:58.183 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4030000000000004e-06 2024-04-26T11:14:58.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.183 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.183 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.183 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166258+0000", 2024-04-26T11:14:58.183 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000477861 2024-04-26T11:14:58.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.183 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.183 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.184 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166279+0000", 2024-04-26T11:14:58.184 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0673999999999999e-05 2024-04-26T11:14:58.184 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.184 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.184 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.184 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.184 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.184 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:195789 5.6 5:6391eae3:::benchmark_data_smithi029_44842_object51151:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T11:14:58.184 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:58.166180+0000", 2024-04-26T11:14:58.184 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.001615687, 2024-04-26T11:14:58.184 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001845679, 2024-04-26T11:14:58.184 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.184 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:58.184 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:58.184 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:58.185 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.185 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 195789 2024-04-26T11:14:58.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.185 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.185 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.185 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.185 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166180+0000", 2024-04-26T11:14:58.185 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.185 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.185 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.185 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166180+0000", 2024-04-26T11:14:58.185 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.186 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.186 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.186 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166179+0000", 2024-04-26T11:14:58.186 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:58.186 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.186 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.186 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.186 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166184+0000", 2024-04-26T11:14:58.186 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3199999999999999e-06 2024-04-26T11:14:58.186 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.186 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.186 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.186 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166196+0000", 2024-04-26T11:14:58.186 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1751e-05 2024-04-26T11:14:58.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.187 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.187 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.187 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166205+0000", 2024-04-26T11:14:58.187 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2469999999999997e-06 2024-04-26T11:14:58.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.187 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.187 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.187 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166236+0000", 2024-04-26T11:14:58.187 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1137999999999999e-05 2024-04-26T11:14:58.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.187 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.187 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.187 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166340+0000", 2024-04-26T11:14:58.188 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000103768 2024-04-26T11:14:58.188 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.188 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.188 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.188 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.188 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:195785 5.0 e49/16 5:0238ca4e:::benchmark_data_smithi029_44842_object51147:head v 49'12411, mlcod=49'12409)", 2024-04-26T11:14:58.188 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:58.166293+0000", 2024-04-26T11:14:58.188 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0015020470000000001, 2024-04-26T11:14:58.188 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0017831850000000001, 2024-04-26T11:14:58.188 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.188 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:58.188 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.188 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.188 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.189 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166293+0000", 2024-04-26T11:14:58.189 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.189 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.189 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.189 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166293+0000", 2024-04-26T11:14:58.189 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.189 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.189 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.189 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166293+0000", 2024-04-26T11:14:58.189 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.189 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.189 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.190 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166298+0000", 2024-04-26T11:14:58.190 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5829999999999997e-06 2024-04-26T11:14:58.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.190 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.190 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.190 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166311+0000", 2024-04-26T11:14:58.190 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2655e-05 2024-04-26T11:14:58.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.190 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.190 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.190 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166318+0000", 2024-04-26T11:14:58.190 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4679999999999997e-06 2024-04-26T11:14:58.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.190 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.191 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.191 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166364+0000", 2024-04-26T11:14:58.191 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6621e-05 2024-04-26T11:14:58.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.191 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.191 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.191 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166426+0000", 2024-04-26T11:14:58.191 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1753000000000003e-05 2024-04-26T11:14:58.191 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.191 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.191 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.191 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.191 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:195786 5.a e49/31 5:5e8df28e:::benchmark_data_smithi029_44842_object51148:head v 49'12441, mlcod=49'12438)", 2024-04-26T11:14:58.192 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:58.166338+0000", 2024-04-26T11:14:58.192 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0014573190000000001, 2024-04-26T11:14:58.192 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0017738000000000001, 2024-04-26T11:14:58.192 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.192 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:58.192 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.192 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.192 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.192 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166338+0000", 2024-04-26T11:14:58.192 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.192 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.192 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.192 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.192 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166338+0000", 2024-04-26T11:14:58.192 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.193 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.193 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.193 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166338+0000", 2024-04-26T11:14:58.193 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.193 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.193 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.193 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166342+0000", 2024-04-26T11:14:58.193 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9149999999999998e-06 2024-04-26T11:14:58.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.193 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.193 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.193 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166348+0000", 2024-04-26T11:14:58.193 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3589999999999996e-06 2024-04-26T11:14:58.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.194 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.194 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.194 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166353+0000", 2024-04-26T11:14:58.194 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0030000000000002e-06 2024-04-26T11:14:58.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.194 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.194 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.194 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166383+0000", 2024-04-26T11:14:58.194 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9638999999999999e-05 2024-04-26T11:14:58.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.194 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.194 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.194 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166394+0000", 2024-04-26T11:14:58.195 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1301000000000001e-05 2024-04-26T11:14:58.195 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.195 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.195 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.195 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.195 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:195787 5.e e49/16 5:70762b99:::benchmark_data_smithi029_44842_object51149:head v 49'12171, mlcod=49'12168)", 2024-04-26T11:14:58.195 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:58.166361+0000", 2024-04-26T11:14:58.195 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.001434846, 2024-04-26T11:14:58.195 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0017899389999999999, 2024-04-26T11:14:58.195 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.195 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:58.195 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.195 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.195 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.196 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166361+0000", 2024-04-26T11:14:58.196 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.196 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.196 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.196 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166361+0000", 2024-04-26T11:14:58.196 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.196 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.196 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.196 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166360+0000", 2024-04-26T11:14:58.196 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967296 2024-04-26T11:14:58.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.196 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.196 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.197 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166367+0000", 2024-04-26T11:14:58.197 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0190000000000001e-06 2024-04-26T11:14:58.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.197 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.197 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.197 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166373+0000", 2024-04-26T11:14:58.197 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8080000000000001e-06 2024-04-26T11:14:58.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.197 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.197 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.197 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166378+0000", 2024-04-26T11:14:58.197 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4710000000000001e-06 2024-04-26T11:14:58.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.197 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.197 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.198 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166433+0000", 2024-04-26T11:14:58.198 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4996e-05 2024-04-26T11:14:58.198 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.198 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.198 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.198 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.166454+0000", 2024-04-26T11:14:58.198 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1246e-05 2024-04-26T11:14:58.198 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.198 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.198 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.198 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.198 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.198 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:195790 5.7 5:e712b74d:::benchmark_data_smithi029_44842_object51152:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T11:14:58.198 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:58.167585+0000", 2024-04-26T11:14:58.198 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.000210433, 2024-04-26T11:14:58.199 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00063146800000000005, 2024-04-26T11:14:58.199 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.199 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:58.199 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:58.199 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:58.199 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.199 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 195790 2024-04-26T11:14:58.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.199 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.199 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.199 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.199 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.167585+0000", 2024-04-26T11:14:58.199 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.199 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.200 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.200 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.167585+0000", 2024-04-26T11:14:58.200 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.200 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.200 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.200 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.200 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.167584+0000", 2024-04-26T11:14:58.200 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:58.200 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.200 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.200 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.200 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.167590+0000", 2024-04-26T11:14:58.200 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3909999999999997e-06 2024-04-26T11:14:58.200 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.201 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.201 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.201 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.167601+0000", 2024-04-26T11:14:58.201 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.167e-05 2024-04-26T11:14:58.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.201 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.201 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.201 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.167608+0000", 2024-04-26T11:14:58.201 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1470000000000004e-06 2024-04-26T11:14:58.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.201 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.201 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.201 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.167652+0000", 2024-04-26T11:14:58.201 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4054000000000002e-05 2024-04-26T11:14:58.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.202 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.202 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.202 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.167784+0000", 2024-04-26T11:14:58.202 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013175799999999999 2024-04-26T11:14:58.202 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.202 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.202 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.202 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.202 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.202 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:195791 5.3 5:ced6c951:::benchmark_data_smithi029_44842_object51153:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T11:14:58.202 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:58.167896+0000", 2024-04-26T11:14:58.202 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9998994, 2024-04-26T11:14:58.202 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00039995900000000002, 2024-04-26T11:14:58.202 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.202 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:14:58.203 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:58.203 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:58.203 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.203 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 195791 2024-04-26T11:14:58.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.203 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.203 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.203 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.203 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.167896+0000", 2024-04-26T11:14:58.203 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.203 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.203 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.203 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.167896+0000", 2024-04-26T11:14:58.204 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.204 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.204 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.204 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.204 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.167896+0000", 2024-04-26T11:14:58.204 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.204 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.204 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.204 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.204 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.167900+0000", 2024-04-26T11:14:58.204 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6739999999999996e-06 2024-04-26T11:14:58.204 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.204 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.204 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.204 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.167909+0000", 2024-04-26T11:14:58.205 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6659999999999997e-06 2024-04-26T11:14:58.205 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.205 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.205 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.205 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.167918+0000", 2024-04-26T11:14:58.205 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5550000000000003e-06 2024-04-26T11:14:58.205 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.205 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.205 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.205 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.168078+0000", 2024-04-26T11:14:58.205 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000160018 2024-04-26T11:14:58.205 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.205 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.205 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.205 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.168204+0000", 2024-04-26T11:14:58.206 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012666899999999999 2024-04-26T11:14:58.206 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.206 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.206 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.206 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.206 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.206 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:195792 5.3 5.9a553c73 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T11:14:58.206 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:58.168022+0000", 2024-04-26T11:14:58.206 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9997735, 2024-04-26T11:14:58.206 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000335643, 2024-04-26T11:14:58.206 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.206 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:14:58.206 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:58.206 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:58.206 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.207 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 195792 2024-04-26T11:14:58.207 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.207 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.207 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.207 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.207 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.168022+0000", 2024-04-26T11:14:58.207 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.207 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.207 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.207 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.207 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.168022+0000", 2024-04-26T11:14:58.207 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.207 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.207 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.207 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.208 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.168021+0000", 2024-04-26T11:14:58.208 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.208 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.208 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.208 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.208 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.168025+0000", 2024-04-26T11:14:58.208 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.681e-06 2024-04-26T11:14:58.208 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.208 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.208 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.208 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.168033+0000", 2024-04-26T11:14:58.208 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.644e-06 2024-04-26T11:14:58.208 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.208 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.208 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.209 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:58.168039+0000", 2024-04-26T11:14:58.209 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0650000000000004e-06 2024-04-26T11:14:58.209 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.209 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.209 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.209 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.209 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:14:58.209 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 10 2024-04-26T11:14:58.209 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:58.212 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:58.212 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:58.209+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:58.314 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:58.311+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:58.412 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:58.411+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:58.431 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:58.432 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:14:58.432 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:14:58.432 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:14:58.432 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:58.445 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:14:58.529 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:58.528+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:58.614 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:58.614+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:58.671 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:14:58.671 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:14:58.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:14:58.671 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:14:58.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.671 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:58.672 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:58.672 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 65.396433036999994, 2024-04-26T11:14:58.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:14:58.672 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.672 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:58.672 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:58.672 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:58.672 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.672 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:14:58.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.672 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:58.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:14:58.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:14:58.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:14:58.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:14:58.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.674 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.674 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:14:58.674 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:14:58.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.674 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.674 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:14:58.674 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:14:58.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.674 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.674 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:14:58.674 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:14:58.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.675 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.675 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:14:58.675 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:14:58.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.675 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:58.675 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:14:58.676 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:14:58.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.676 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:58.676 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:14:58.676 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:14:58.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.676 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:58.676 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:14:58.676 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:14:58.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.677 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:58.677 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:14:58.677 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:14:58.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.677 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:58.677 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:14:58.677 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:14:58.677 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.677 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.677 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.678 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:58.678 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:58.678 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 65.395621472000002, 2024-04-26T11:14:58.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:14:58.678 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.678 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:58.678 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:58.678 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:58.678 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.678 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:14:58.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.678 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.678 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.679 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:58.679 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.679 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.679 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:58.679 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.679 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.679 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:14:58.679 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:58.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.679 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.680 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:14:58.680 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:14:58.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.680 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.680 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:14:58.680 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:14:58.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.680 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.680 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:14:58.680 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:14:58.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.680 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.680 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:14:58.681 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:14:58.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.681 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.681 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.681 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:14:58.681 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:14:58.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.681 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.681 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:58.681 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:14:58.681 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:14:58.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.681 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.681 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:58.681 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:14:58.682 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:14:58.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.682 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:58.682 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:14:58.682 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:14:58.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.683 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:58.683 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:14:58.683 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:14:58.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.683 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.683 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:58.683 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:14:58.683 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:14:58.683 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.683 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.683 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.683 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.683 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:58.683 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:58.684 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 65.388434634999996, 2024-04-26T11:14:58.684 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:14:58.684 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.684 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:58.684 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:58.684 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:58.684 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.684 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:14:58.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.684 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.684 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.684 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:58.684 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.685 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.685 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.685 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:14:58.685 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.685 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.685 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.686 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:14:58.686 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:58.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.686 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.686 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.686 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:14:58.686 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:14:58.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.686 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.686 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.686 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:14:58.686 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:14:58.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.686 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.687 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.687 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:14:58.687 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:14:58.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.687 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.687 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:14:58.687 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:14:58.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.687 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.687 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:14:58.687 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:14:58.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.688 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:58.688 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:14:58.688 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:14:58.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.688 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:58.688 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:14:58.688 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:14:58.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.688 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:58.688 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:14:58.688 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:14:58.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.689 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:58.689 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:14:58.689 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:14:58.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.689 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:58.689 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:14:58.689 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:14:58.689 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.689 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.689 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.689 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:58.690 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:58.690 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 65.387893755999997, 2024-04-26T11:14:58.690 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:14:58.690 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.690 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:58.690 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:58.690 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:58.690 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.690 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:14:58.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.690 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.690 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.690 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.690 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:58.691 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.691 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.691 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:58.691 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.691 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.691 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:14:58.691 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.691 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.691 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:14:58.692 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:14:58.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.692 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.692 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:14:58.692 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:14:58.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.692 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.692 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:14:58.693 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:14:58.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.693 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.693 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:14:58.693 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:14:58.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.693 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.693 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:14:58.693 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:14:58.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.693 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:58.694 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:14:58.694 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:14:58.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.694 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:58.694 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:14:58.694 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:14:58.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.694 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:58.694 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:14:58.694 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:14:58.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.695 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:58.695 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:14:58.695 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:14:58.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.695 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:58.695 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:14:58.695 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:14:58.695 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.695 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.695 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.695 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:58.695 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:58.696 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 61.344709309000002, 2024-04-26T11:14:58.696 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:14:58.696 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.696 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:58.696 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:58.696 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:58.696 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.696 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:14:58.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.696 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.696 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.696 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:58.696 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.697 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.697 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:14:58.697 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.697 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.697 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:14:58.697 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:58.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.697 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.697 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:14:58.697 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:14:58.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.698 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.698 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.698 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:14:58.698 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:14:58.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.698 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.698 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.698 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:14:58.698 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:14:58.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.698 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.698 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.698 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:14:58.698 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:14:58.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.699 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.699 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:14:58.699 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:14:58.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.699 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:58.699 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:14:58.699 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:14:58.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.699 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:58.699 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:14:58.699 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:14:58.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.700 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.700 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:14:58.700 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:14:58.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.700 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:58.700 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:14:58.700 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:14:58.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.701 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.701 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:14:58.701 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:14:58.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.701 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:58.701 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:14:58.701 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:14:58.701 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.701 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.701 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.702 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:58.702 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:58.702 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 61.342515968999997, 2024-04-26T11:14:58.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:14:58.702 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.702 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:58.702 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:58.702 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:58.702 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.702 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:14:58.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.702 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:58.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:14:58.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:14:58.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:58.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:14:58.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:14:58.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:14:58.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:14:58.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:14:58.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:14:58.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:14:58.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:14:58.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:14:58.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:14:58.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:58.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:14:58.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:14:58.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:58.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:14:58.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:14:58.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:14:58.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:14:58.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:58.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:14:58.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:14:58.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:14:58.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:14:58.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:58.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:14:58.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:14:58.707 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.707 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.707 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.707 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:14:58.708 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:58.708 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 61.337304144999997, 2024-04-26T11:14:58.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:14:58.708 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.708 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:58.708 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:58.708 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:58.708 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.708 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:14:58.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.708 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:58.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:14:58.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:14:58.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:58.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:14:58.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:14:58.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:14:58.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:14:58.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.711 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.711 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:14:58.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:14:58.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.711 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.711 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:14:58.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:14:58.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.711 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.711 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:14:58.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:14:58.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:58.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:14:58.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:14:58.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:58.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:14:58.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:14:58.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:14:58.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:14:58.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:58.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:14:58.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:14:58.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:14:58.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:14:58.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:58.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:14:58.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:14:58.714 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.714 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.714 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.714 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:58.714 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:58.714 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 61.320855444999999, 2024-04-26T11:14:58.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:14:58.714 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.715 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:58.715 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:58.715 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:58.715 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.715 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:14:58.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.715 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:58.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:14:58.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.716 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:14:58.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:58.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.716 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:14:58.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:14:58.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:14:58.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:14:58.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:14:58.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:14:58.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:14:58.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:14:58.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:58.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:14:58.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:14:58.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:14:58.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:14:58.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:58.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:14:58.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:14:58.719 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.719 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.719 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.719 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:58.719 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:58.719 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 61.319157939999997, 2024-04-26T11:14:58.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:14:58.719 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.719 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:14:58.719 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:58.719 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:58.719 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.720 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:14:58.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.720 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:58.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:14:58.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:14:58.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:14:58.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:14:58.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:14:58.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:14:58.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:14:58.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:14:58.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:14:58.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:14:58.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:14:58.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:58.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:14:58.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:14:58.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:14:58.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:14:58.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:58.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:14:58.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:14:58.723 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.723 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.723 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.723 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:58.724 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:58.724 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 61.319093637999998, 2024-04-26T11:14:58.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:14:58.724 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.724 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:58.724 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:58.724 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:58.724 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.724 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:14:58.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.724 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:58.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:58.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:14:58.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:14:58.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:14:58.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.726 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:14:58.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:14:58.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.726 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:14:58.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:14:58.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:14:58.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:14:58.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:58.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:14:58.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:14:58.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:14:58.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:14:58.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:14:58.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:14:58.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:58.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:14:58.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:14:58.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:58.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:14:58.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:14:58.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:58.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:14:58.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:14:58.729 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.729 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.729 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.729 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:58.729 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:58.729 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 61.319039414000002, 2024-04-26T11:14:58.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:14:58.729 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.730 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:58.730 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:58.730 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:58.730 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.730 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:14:58.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.730 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:58.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:58.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:14:58.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:14:58.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:14:58.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:14:58.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:14:58.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:14:58.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:14:58.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:14:58.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:14:58.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:58.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:14:58.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:14:58.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:14:58.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:14:58.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:14:58.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:14:58.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:58.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:14:58.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:14:58.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:58.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:14:58.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:14:58.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:58.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:14:58.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:14:58.734 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.735 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.735 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.735 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:58.735 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:58.735 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 61.318994902, 2024-04-26T11:14:58.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:14:58.735 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.735 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:58.735 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:58.735 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:58.735 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.735 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:14:58.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.736 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:58.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:14:58.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:14:58.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:14:58.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:14:58.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:14:58.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:14:58.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:14:58.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:14:58.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:14:58.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:14:58.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:58.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:14:58.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:14:58.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:14:58.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:14:58.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:14:58.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:14:58.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:58.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:14:58.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:14:58.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:58.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:14:58.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:14:58.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:58.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:14:58.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:14:58.740 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.740 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.740 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.740 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:58.741 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:58.741 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 61.314773899999999, 2024-04-26T11:14:58.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:14:58.741 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.741 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:58.741 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:58.741 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:58.741 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.741 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:14:58.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.741 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:58.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:14:58.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:14:58.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:14:58.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:14:58.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:14:58.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:14:58.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:14:58.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:14:58.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:14:58.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:14:58.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:14:58.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:14:58.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:14:58.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:14:58.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:14:58.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:14:58.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:14:58.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:14:58.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:58.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:14:58.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:14:58.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:58.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:14:58.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:14:58.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:58.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:14:58.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:14:58.746 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.746 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.746 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.746 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174388 5.c 5:312e5163:::benchmark_data_smithi029_44842_object29750:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:58.746 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:14:58.746 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.3189482449999996, 2024-04-26T11:14:58.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.064002009999999998, 2024-04-26T11:14:58.746 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.746 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:58.747 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:58.747 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:58.747 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.747 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174388 2024-04-26T11:14:58.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.747 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.747 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.747 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:14:58.747 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.747 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.747 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:14:58.747 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348231+0000", 2024-04-26T11:14:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348233+0000", 2024-04-26T11:14:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2249999999999999e-06 2024-04-26T11:14:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348238+0000", 2024-04-26T11:14:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1899999999999997e-06 2024-04-26T11:14:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348241+0000", 2024-04-26T11:14:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.965e-06 2024-04-26T11:14:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348264+0000", 2024-04-26T11:14:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3014e-05 2024-04-26T11:14:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348371+0000", 2024-04-26T11:14:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000106889 2024-04-26T11:14:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412126+0000", 2024-04-26T11:14:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063755495999999995 2024-04-26T11:14:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412165+0000", 2024-04-26T11:14:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9269e-05 2024-04-26T11:14:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412234+0000", 2024-04-26T11:14:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8337000000000007e-05 2024-04-26T11:14:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174390 5.1 5:81c54fd7:::benchmark_data_smithi029_44842_object29752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:14:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.3188330910000001, 2024-04-26T11:14:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063635918, 2024-04-26T11:14:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:58.751 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174390 2024-04-26T11:14:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:14:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:14:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348346+0000", 2024-04-26T11:14:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348351+0000", 2024-04-26T11:14:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.442e-06 2024-04-26T11:14:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348357+0000", 2024-04-26T11:14:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9530000000000002e-06 2024-04-26T11:14:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348363+0000", 2024-04-26T11:14:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2129999999999999e-06 2024-04-26T11:14:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348396+0000", 2024-04-26T11:14:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3161999999999999e-05 2024-04-26T11:14:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348511+0000", 2024-04-26T11:14:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000115253 2024-04-26T11:14:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411857+0000", 2024-04-26T11:14:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063345431999999993 2024-04-26T11:14:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411904+0000", 2024-04-26T11:14:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7389000000000003e-05 2024-04-26T11:14:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:58.756 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411983+0000", 2024-04-26T11:14:58.756 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8750000000000003e-05 2024-04-26T11:14:58.756 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.756 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.756 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.756 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174394 5.3 5:c91ce5cb:::benchmark_data_smithi029_44842_object29756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:58.756 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:14:58.756 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.3187301470000001, 2024-04-26T11:14:58.756 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062247626, 2024-04-26T11:14:58.756 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.756 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:58.756 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174394 2024-04-26T11:14:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:14:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:14:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348449+0000", 2024-04-26T11:14:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348457+0000", 2024-04-26T11:14:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9619999999999993e-06 2024-04-26T11:14:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.758 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348462+0000", 2024-04-26T11:14:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6569999999999996e-06 2024-04-26T11:14:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348465+0000", 2024-04-26T11:14:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2990000000000001e-06 2024-04-26T11:14:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408427+0000", 2024-04-26T11:14:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.059961423 2024-04-26T11:14:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408554+0000", 2024-04-26T11:14:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012779600000000001 2024-04-26T11:14:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410570+0000", 2024-04-26T11:14:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020152719999999998 2024-04-26T11:14:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410624+0000", 2024-04-26T11:14:58.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4211e-05 2024-04-26T11:14:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410697+0000", 2024-04-26T11:14:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3447000000000003e-05 2024-04-26T11:14:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174395 5.1 5:8ee7f1d3:::benchmark_data_smithi029_44842_object29757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:14:58.761 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.3177000559999996, 2024-04-26T11:14:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062622744999999994, 2024-04-26T11:14:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174395 2024-04-26T11:14:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:14:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:14:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349479+0000", 2024-04-26T11:14:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349483+0000", 2024-04-26T11:14:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.54e-06 2024-04-26T11:14:58.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.764 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.764 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349488+0000", 2024-04-26T11:14:58.764 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5119999999999999e-06 2024-04-26T11:14:58.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.764 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.764 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349492+0000", 2024-04-26T11:14:58.764 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7170000000000002e-06 2024-04-26T11:14:58.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350187+0000", 2024-04-26T11:14:58.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00069535899999999999 2024-04-26T11:14:58.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350292+0000", 2024-04-26T11:14:58.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0001047 2024-04-26T11:14:58.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:58.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411992+0000", 2024-04-26T11:14:58.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061699647000000003 2024-04-26T11:14:58.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.766 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.766 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:58.766 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412030+0000", 2024-04-26T11:14:58.766 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8124999999999998e-05 2024-04-26T11:14:58.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.766 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.766 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:58.766 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412103+0000", 2024-04-26T11:14:58.766 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2733999999999999e-05 2024-04-26T11:14:58.766 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.766 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.766 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.766 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.767 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174396 5.7 5:e0fad05d:::benchmark_data_smithi029_44842_object29758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:58.767 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:14:58.767 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.317616417, 2024-04-26T11:14:58.767 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062445026000000001, 2024-04-26T11:14:58.767 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.767 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:58.767 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:58.767 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:58.767 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.767 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174396 2024-04-26T11:14:58.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.767 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.767 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:14:58.768 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.768 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:14:58.768 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.768 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:14:58.768 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.769 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.769 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349566+0000", 2024-04-26T11:14:58.769 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2490000000000001e-06 2024-04-26T11:14:58.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.769 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.769 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349573+0000", 2024-04-26T11:14:58.769 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.776e-06 2024-04-26T11:14:58.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.769 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.769 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349576+0000", 2024-04-26T11:14:58.769 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3629999999999998e-06 2024-04-26T11:14:58.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.770 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.770 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.770 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350396+0000", 2024-04-26T11:14:58.770 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00081992199999999995 2024-04-26T11:14:58.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.770 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.770 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.770 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350516+0000", 2024-04-26T11:14:58.770 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012006900000000001 2024-04-26T11:14:58.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.770 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.770 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:58.770 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411924+0000", 2024-04-26T11:14:58.770 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061407960999999997 2024-04-26T11:14:58.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.771 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.771 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:58.771 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411947+0000", 2024-04-26T11:14:58.771 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2943999999999999e-05 2024-04-26T11:14:58.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.771 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.771 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:58.771 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412008+0000", 2024-04-26T11:14:58.771 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1237999999999999e-05 2024-04-26T11:14:58.771 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.771 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.771 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.772 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.772 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174397 5.7 5:e25daf9a:::benchmark_data_smithi029_44842_object29759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:58.772 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:14:58.772 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.3175082880000009, 2024-04-26T11:14:58.772 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063878565999999998, 2024-04-26T11:14:58.772 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.772 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:58.772 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:14:58.772 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:14:58.772 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.772 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174397 2024-04-26T11:14:58.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.772 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.772 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.773 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.773 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:14:58.773 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.773 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.773 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.773 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:14:58.773 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.773 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.773 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.773 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349671+0000", 2024-04-26T11:14:58.773 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.774 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.774 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.774 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349674+0000", 2024-04-26T11:14:58.774 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3360000000000002e-06 2024-04-26T11:14:58.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.774 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.774 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.774 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349678+0000", 2024-04-26T11:14:58.774 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0709999999999996e-06 2024-04-26T11:14:58.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.774 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.774 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.774 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349681+0000", 2024-04-26T11:14:58.775 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3139999999999999e-06 2024-04-26T11:14:58.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.775 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.775 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.775 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410371+0000", 2024-04-26T11:14:58.775 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.060690202999999998 2024-04-26T11:14:58.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.775 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.775 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.775 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410463+0000", 2024-04-26T11:14:58.775 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2095000000000005e-05 2024-04-26T11:14:58.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.775 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.775 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:14:58.776 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413471+0000", 2024-04-26T11:14:58.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0030073909999999999 2024-04-26T11:14:58.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.776 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:58.776 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413499+0000", 2024-04-26T11:14:58.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8725e-05 2024-04-26T11:14:58.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.776 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:58.776 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413550+0000", 2024-04-26T11:14:58.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0810000000000003e-05 2024-04-26T11:14:58.776 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.776 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.777 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.777 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:174398 5.4 e46/16 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head v 46'10798, mlcod=46'10796)", 2024-04-26T11:14:58.777 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:14:58.777 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.3169800770000002, 2024-04-26T11:14:58.777 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062067047, 2024-04-26T11:14:58.777 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:14:58.777 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:58.777 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:14:58.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.777 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:14:58.777 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:14:58.777 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.778 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.778 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:14:58.778 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:14:58.778 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:14:58.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.778 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.778 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:14:58.778 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350199+0000", 2024-04-26T11:14:58.778 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.778 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.778 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:14:58.778 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350205+0000", 2024-04-26T11:14:58.778 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6749999999999999e-06 2024-04-26T11:14:58.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.779 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:14:58.779 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350212+0000", 2024-04-26T11:14:58.779 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7000000000000002e-06 2024-04-26T11:14:58.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.779 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.779 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350216+0000", 2024-04-26T11:14:58.779 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5120000000000002e-06 2024-04-26T11:14:58.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.779 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:14:58.779 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350246+0000", 2024-04-26T11:14:58.779 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9978999999999999e-05 2024-04-26T11:14:58.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.780 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:14:58.780 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350263+0000", 2024-04-26T11:14:58.780 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.702e-05 2024-04-26T11:14:58.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.780 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:14:58.780 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412238+0000", 2024-04-26T11:14:58.780 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061974603000000003 2024-04-26T11:14:58.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:14:58.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:14:58.780 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:14:58.780 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412267+0000", 2024-04-26T11:14:58.781 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9116e-05 2024-04-26T11:14:58.781 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.781 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.781 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.781 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:14:58.781 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:14:58.781 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:14:58.782 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:58.781+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:58.783 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:14:58.883 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:58.883+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:58.958 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:58.958 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:58.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.958 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:197864 5.b 5:dc62bfa6:::benchmark_data_smithi029_44842_object53226:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T11:14:58.958 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:58.948610+0000", 2024-04-26T11:14:58.958 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0051322010000000003, 2024-04-26T11:14:58.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00514972, 2024-04-26T11:14:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 197864 2024-04-26T11:14:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.948610+0000", 2024-04-26T11:14:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:58.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:58.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.948610+0000", 2024-04-26T11:14:58.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:58.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:58.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.948609+0000", 2024-04-26T11:14:58.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:58.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:58.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.948615+0000", 2024-04-26T11:14:58.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8139999999999997e-06 2024-04-26T11:14:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.948625+0000", 2024-04-26T11:14:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0146000000000001e-05 2024-04-26T11:14:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.948633+0000", 2024-04-26T11:14:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1950000000000003e-06 2024-04-26T11:14:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:58.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.948676+0000", 2024-04-26T11:14:58.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2564000000000001e-05 2024-04-26T11:14:58.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:58.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.948751+0000", 2024-04-26T11:14:58.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5567000000000003e-05 2024-04-26T11:14:58.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:58.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.948818+0000", 2024-04-26T11:14:58.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6576999999999996e-05 2024-04-26T11:14:58.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.950984+0000", 2024-04-26T11:14:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021663149999999998 2024-04-26T11:14:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:197865 5.a 5:52901a9a:::benchmark_data_smithi029_44842_object53227:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T11:14:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:58.948951+0000", 2024-04-26T11:14:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0047906989999999998, 2024-04-26T11:14:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048604479999999999, 2024-04-26T11:14:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:58.963 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 197865 2024-04-26T11:14:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.948951+0000", 2024-04-26T11:14:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.948951+0000", 2024-04-26T11:14:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.948951+0000", 2024-04-26T11:14:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.948954+0000", 2024-04-26T11:14:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7689999999999998e-06 2024-04-26T11:14:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.948962+0000", 2024-04-26T11:14:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8010000000000004e-06 2024-04-26T11:14:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.948969+0000", 2024-04-26T11:14:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0110000000000003e-06 2024-04-26T11:14:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.949069+0000", 2024-04-26T11:14:58.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100173 2024-04-26T11:14:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.949165+0000", 2024-04-26T11:14:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5193999999999997e-05 2024-04-26T11:14:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.949263+0000", 2024-04-26T11:14:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8363999999999995e-05 2024-04-26T11:14:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.952209+0000", 2024-04-26T11:14:58.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0029464019999999999 2024-04-26T11:14:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:197866 5.8 5:18519636:::benchmark_data_smithi029_44842_object53228:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T11:14:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:58.948999+0000", 2024-04-26T11:14:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0047425699999999998, 2024-04-26T11:14:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048592080000000003, 2024-04-26T11:14:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:58.968 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 197866 2024-04-26T11:14:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.948999+0000", 2024-04-26T11:14:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.948999+0000", 2024-04-26T11:14:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.948999+0000", 2024-04-26T11:14:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.949002+0000", 2024-04-26T11:14:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4510000000000001e-06 2024-04-26T11:14:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.949016+0000", 2024-04-26T11:14:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3856000000000001e-05 2024-04-26T11:14:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.949025+0000", 2024-04-26T11:14:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2499999999999995e-06 2024-04-26T11:14:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.949058+0000", 2024-04-26T11:14:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2274999999999998e-05 2024-04-26T11:14:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.949168+0000", 2024-04-26T11:14:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000110048 2024-04-26T11:14:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.949281+0000", 2024-04-26T11:14:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113441 2024-04-26T11:14:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.951854+0000", 2024-04-26T11:14:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025731450000000002 2024-04-26T11:14:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:197870 5.a 5:51df3b6f:::benchmark_data_smithi029_44842_object53232:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T11:14:58.972 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:58.949163+0000", 2024-04-26T11:14:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0045790190000000001, 2024-04-26T11:14:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047404379999999996, 2024-04-26T11:14:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 197870 2024-04-26T11:14:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.949163+0000", 2024-04-26T11:14:58.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.949163+0000", 2024-04-26T11:14:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.949162+0000", 2024-04-26T11:14:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:58.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.949167+0000", 2024-04-26T11:14:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4710000000000001e-06 2024-04-26T11:14:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.949179+0000", 2024-04-26T11:14:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2666999999999999e-05 2024-04-26T11:14:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.949186+0000", 2024-04-26T11:14:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8809999999999998e-06 2024-04-26T11:14:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:58.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.950475+0000", 2024-04-26T11:14:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001288984 2024-04-26T11:14:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.950621+0000", 2024-04-26T11:14:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00014540199999999999 2024-04-26T11:14:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.950741+0000", 2024-04-26T11:14:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120143 2024-04-26T11:14:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:58.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.952415+0000", 2024-04-26T11:14:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00167395 2024-04-26T11:14:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:197872 5.8 5:12ac3256:::benchmark_data_smithi029_44842_object53234:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T11:14:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:58.949200+0000", 2024-04-26T11:14:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0045422839999999997, 2024-04-26T11:14:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0047469809999999999, 2024-04-26T11:14:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:58.977 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 197872 2024-04-26T11:14:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.949200+0000", 2024-04-26T11:14:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.949200+0000", 2024-04-26T11:14:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:58.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.949199+0000", 2024-04-26T11:14:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.949202+0000", 2024-04-26T11:14:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.05e-06 2024-04-26T11:14:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.949211+0000", 2024-04-26T11:14:58.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2580000000000001e-06 2024-04-26T11:14:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.949217+0000", 2024-04-26T11:14:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2290000000000002e-06 2024-04-26T11:14:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.950843+0000", 2024-04-26T11:14:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0016259709999999999 2024-04-26T11:14:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.950916+0000", 2024-04-26T11:14:58.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3230000000000002e-05 2024-04-26T11:14:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.950980+0000", 2024-04-26T11:14:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4455999999999994e-05 2024-04-26T11:14:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.952078+0000", 2024-04-26T11:14:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010979690000000001 2024-04-26T11:14:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:58.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:197855 5.4 5:2630c026:::benchmark_data_smithi029_44842_object53217:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T11:14:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:58.944330+0000", 2024-04-26T11:14:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0094118689999999998, 2024-04-26T11:14:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0096604159999999998, 2024-04-26T11:14:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 197855 2024-04-26T11:14:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:58.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.944330+0000", 2024-04-26T11:14:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.944330+0000", 2024-04-26T11:14:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.944329+0000", 2024-04-26T11:14:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:58.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:58.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.944334+0000", 2024-04-26T11:14:58.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9690000000000002e-06 2024-04-26T11:14:58.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:58.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.944345+0000", 2024-04-26T11:14:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0477e-05 2024-04-26T11:14:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.944352+0000", 2024-04-26T11:14:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3699999999999997e-06 2024-04-26T11:14:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.944393+0000", 2024-04-26T11:14:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1439000000000001e-05 2024-04-26T11:14:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.944519+0000", 2024-04-26T11:14:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000125728 2024-04-26T11:14:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.944629+0000", 2024-04-26T11:14:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000109826 2024-04-26T11:14:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.948612+0000", 2024-04-26T11:14:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039832019999999999 2024-04-26T11:14:58.987 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:197856 5.8 5:18e59ff9:::benchmark_data_smithi029_44842_object53218:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T11:14:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:58.944794+0000", 2024-04-26T11:14:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0089482380000000007, 2024-04-26T11:14:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092421799999999991, 2024-04-26T11:14:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:58.988 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 197856 2024-04-26T11:14:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.944794+0000", 2024-04-26T11:14:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.944794+0000", 2024-04-26T11:14:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:58.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.944793+0000", 2024-04-26T11:14:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.944797+0000", 2024-04-26T11:14:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7740000000000002e-06 2024-04-26T11:14:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.944805+0000", 2024-04-26T11:14:58.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8509999999999999e-06 2024-04-26T11:14:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.944810+0000", 2024-04-26T11:14:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2050000000000001e-06 2024-04-26T11:14:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.944849+0000", 2024-04-26T11:14:58.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8654e-05 2024-04-26T11:14:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.944970+0000", 2024-04-26T11:14:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000121785 2024-04-26T11:14:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.945075+0000", 2024-04-26T11:14:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010473500000000001 2024-04-26T11:14:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:58.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.948725+0000", 2024-04-26T11:14:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036498849999999998 2024-04-26T11:14:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:197857 5.8 5:14efd1e0:::benchmark_data_smithi029_44842_object53219:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T11:14:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:58.945020+0000", 2024-04-26T11:14:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0087215929999999997, 2024-04-26T11:14:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0090652300000000005, 2024-04-26T11:14:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:58.993 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 197857 2024-04-26T11:14:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.945020+0000", 2024-04-26T11:14:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.945020+0000", 2024-04-26T11:14:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:58.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.945020+0000", 2024-04-26T11:14:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.945022+0000", 2024-04-26T11:14:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.565e-06 2024-04-26T11:14:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.945027+0000", 2024-04-26T11:14:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7090000000000001e-06 2024-04-26T11:14:58.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.945031+0000", 2024-04-26T11:14:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5609999999999999e-06 2024-04-26T11:14:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.946760+0000", 2024-04-26T11:14:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0017292049999999999 2024-04-26T11:14:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.946880+0000", 2024-04-26T11:14:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000119751 2024-04-26T11:14:58.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.946990+0000", 2024-04-26T11:14:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011027 2024-04-26T11:14:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.950820+0000", 2024-04-26T11:14:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0038296620000000002 2024-04-26T11:14:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:197859 5.a 5:5dc4614f:::benchmark_data_smithi029_44842_object53221:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T11:14:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:58.946314+0000", 2024-04-26T11:14:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0074283689999999998, 2024-04-26T11:14:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0078533400000000003, 2024-04-26T11:14:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 197859 2024-04-26T11:14:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:58.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.946314+0000", 2024-04-26T11:14:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.946314+0000", 2024-04-26T11:14:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.946313+0000", 2024-04-26T11:14:58.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.946317+0000", 2024-04-26T11:14:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9659999999999998e-06 2024-04-26T11:14:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.946323+0000", 2024-04-26T11:14:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4620000000000001e-06 2024-04-26T11:14:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:59.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.946328+0000", 2024-04-26T11:14:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5940000000000004e-06 2024-04-26T11:14:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.946421+0000", 2024-04-26T11:14:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2947000000000003e-05 2024-04-26T11:14:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.946512+0000", 2024-04-26T11:14:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1287999999999997e-05 2024-04-26T11:14:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.946620+0000", 2024-04-26T11:14:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000107977 2024-04-26T11:14:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.948172+0000", 2024-04-26T11:14:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0015517689999999999 2024-04-26T11:14:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.954152+0000", 2024-04-26T11:14:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059795650000000001 2024-04-26T11:14:59.002 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:197860 5.4 5:22be3cc9:::benchmark_data_smithi029_44842_object53222:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T11:14:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:58.946334+0000", 2024-04-26T11:14:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0074078039999999996, 2024-04-26T11:14:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00792496, 2024-04-26T11:14:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:14:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:59.003 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 197860 2024-04-26T11:14:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.946334+0000", 2024-04-26T11:14:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.946334+0000", 2024-04-26T11:14:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:59.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.946334+0000", 2024-04-26T11:14:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.946336+0000", 2024-04-26T11:14:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3709999999999998e-06 2024-04-26T11:14:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.946343+0000", 2024-04-26T11:14:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9840000000000004e-06 2024-04-26T11:14:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.946347+0000", 2024-04-26T11:14:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.092e-06 2024-04-26T11:14:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.946554+0000", 2024-04-26T11:14:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020658800000000001 2024-04-26T11:14:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.946682+0000", 2024-04-26T11:14:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012825900000000001 2024-04-26T11:14:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.946800+0000", 2024-04-26T11:14:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011837600000000001 2024-04-26T11:14:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.949083+0000", 2024-04-26T11:14:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022825940000000002 2024-04-26T11:14:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:58.954247+0000", 2024-04-26T11:14:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051638930000000001 2024-04-26T11:14:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.007 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:59.008 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.008 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.008 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:14:59.008 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 10 2024-04-26T11:14:59.008 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:59.009 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:59.008+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:59.010 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:14:59.110 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:59.109+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:59.211 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:59.210+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:59.218 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:59.218 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:14:59.219 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:14:59.219 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:14:59.219 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:59.234 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:14:59.311 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:59.311+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:59.408 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:14:59.408 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:14:59.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:14:59.408 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:14:59.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.409 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:59.409 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:59.409 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 66.125881256, 2024-04-26T11:14:59.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:14:59.409 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:59.409 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:59.409 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:59.409 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:59.409 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:59.409 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:14:59.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.409 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:59.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:59.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:59.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:59.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:59.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:59.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:14:59.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:59.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:59.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:14:59.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:14:59.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:59.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:14:59.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:14:59.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:59.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:14:59.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:14:59.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.412 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:14:59.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:14:59.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.412 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:59.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:14:59.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:14:59.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.412 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:59.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:14:59.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:14:59.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:59.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:14:59.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:14:59.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:59.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:14:59.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:14:59.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:59.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:14:59.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:14:59.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:59.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:14:59.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:14:59.414 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.414 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:59.414 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.415 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:14:59.415 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:59.415 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 66.125231553999996, 2024-04-26T11:14:59.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:14:59.415 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:59.415 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:59.415 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:59.415 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:59.415 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:59.415 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:14:59.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.415 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:59.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:59.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:59.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:59.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:14:59.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:59.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:14:59.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:59.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:59.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:14:59.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:14:59.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:59.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:14:59.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:14:59.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:59.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:14:59.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:14:59.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:14:59.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:14:59.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:59.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:14:59.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:14:59.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:14:59.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:14:59.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:14:59.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:59.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:14:59.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:14:59.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:59.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:14:59.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:14:59.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:59.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:14:59.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:14:59.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:59.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:14:59.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:14:59.420 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.420 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:59.420 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.421 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:59.421 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:59.421 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 62.058589515000001, 2024-04-26T11:14:59.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:14:59.421 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:59.421 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:59.421 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:59.421 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:59.421 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:59.421 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:14:59.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.421 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:59.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:59.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:59.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:59.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:14:59.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:59.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:14:59.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:59.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:59.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:14:59.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:14:59.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:59.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:14:59.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:14:59.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:59.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:14:59.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:14:59.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:14:59.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:14:59.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:59.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:14:59.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:14:59.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:14:59.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:14:59.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:59.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:14:59.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:14:59.426 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.426 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:59.426 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.427 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:59.427 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:59.427 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 62.058493869000003, 2024-04-26T11:14:59.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:14:59.427 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:59.427 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:59.427 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:59.427 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:59.427 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:59.427 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:14:59.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.428 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:59.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:59.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:59.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:59.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:14:59.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:59.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:14:59.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:59.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:59.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:14:59.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:14:59.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:59.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:14:59.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:14:59.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:59.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:14:59.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:14:59.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:14:59.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:14:59.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:59.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:14:59.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:14:59.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:14:59.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:14:59.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:59.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:14:59.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:14:59.432 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.432 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:59.432 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.432 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:59.432 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:59.432 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 62.058362189999997, 2024-04-26T11:14:59.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:14:59.433 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:59.433 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:59.433 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:59.433 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:59.433 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:59.433 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:14:59.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.433 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:59.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:59.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:59.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:59.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:59.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:59.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:14:59.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:59.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:59.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:14:59.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:14:59.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:59.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:14:59.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:14:59.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:59.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:14:59.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:14:59.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:14:59.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:14:59.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:59.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:14:59.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:14:59.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:14:59.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:14:59.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:59.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:14:59.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:14:59.437 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.437 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:59.437 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.437 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:59.437 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:59.437 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 62.058253733999997, 2024-04-26T11:14:59.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:14:59.438 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:59.438 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:14:59.438 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:59.438 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:59.438 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:59.438 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:14:59.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.438 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:59.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:59.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:59.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:59.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:14:59.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:59.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:14:59.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:59.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:59.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:14:59.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:14:59.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:59.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:14:59.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:14:59.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:59.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:14:59.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:14:59.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:14:59.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:14:59.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:59.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:14:59.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:14:59.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:14:59.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:14:59.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:59.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:14:59.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:14:59.442 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.442 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:59.442 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.442 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:59.442 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:59.442 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 62.058152466000003, 2024-04-26T11:14:59.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:14:59.442 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:59.442 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:59.442 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:59.443 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:59.443 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:59.443 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:14:59.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.443 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:59.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:59.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:59.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:59.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:59.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:59.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:14:59.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:59.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:59.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:14:59.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:14:59.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:59.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:14:59.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:14:59.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:59.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:14:59.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:14:59.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:14:59.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:14:59.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:59.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:14:59.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:14:59.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:14:59.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:14:59.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:59.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:14:59.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:14:59.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:59.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:14:59.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:14:59.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:59.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:14:59.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:14:59.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:59.448 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:14:59.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:14:59.448 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.448 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:59.448 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.448 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:59.448 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:59.448 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 62.058083525000001, 2024-04-26T11:14:59.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:14:59.449 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:59.449 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:59.449 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:59.449 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:59.449 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:59.449 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:14:59.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.449 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:59.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:59.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:59.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:59.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:14:59.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:59.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:14:59.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:59.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:59.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:14:59.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:14:59.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:59.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:14:59.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:14:59.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:59.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:14:59.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:14:59.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:14:59.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:14:59.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:59.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:14:59.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:14:59.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:14:59.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:14:59.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:59.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:14:59.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:14:59.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:59.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:14:59.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:14:59.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:59.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:14:59.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:14:59.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:59.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:14:59.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:14:59.454 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.454 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:59.454 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.454 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:14:59.454 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:59.454 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 62.052087944, 2024-04-26T11:14:59.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:14:59.454 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:59.454 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:59.454 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:59.454 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:59.454 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:59.455 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:14:59.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.455 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:59.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:59.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:59.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:59.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:14:59.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:59.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:14:59.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:59.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:59.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:14:59.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:14:59.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:59.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:14:59.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:14:59.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:59.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:14:59.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:14:59.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:14:59.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:14:59.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:14:59.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:14:59.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:14:59.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:14:59.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:14:59.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:59.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:14:59.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:14:59.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:59.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:14:59.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:14:59.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:59.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:14:59.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:14:59.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:59.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:14:59.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:14:59.460 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.460 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:59.460 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.460 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101754 5.e 5:7ca15a5c:::benchmark_data_smithi029_44842_object101753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:59.461 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:59.461 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 40.286140201999999, 2024-04-26T11:14:59.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039171048999999999, 2024-04-26T11:14:59.461 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:59.461 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:59.461 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:59.461 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:59.461 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:59.461 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101754 2024-04-26T11:14:59.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.462 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:59.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:59.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:59.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:59.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:59.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:59.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:14:59.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:59.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:59.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118604+0000", 2024-04-26T11:14:59.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3399000000000007e-05 2024-04-26T11:14:59.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:59.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118613+0000", 2024-04-26T11:14:59.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6989999999999992e-06 2024-04-26T11:14:59.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:59.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118618+0000", 2024-04-26T11:14:59.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3850000000000001e-06 2024-04-26T11:14:59.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118646+0000", 2024-04-26T11:14:59.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7878e-05 2024-04-26T11:14:59.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:59.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118720+0000", 2024-04-26T11:14:59.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3461999999999996e-05 2024-04-26T11:14:59.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:59.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118807+0000", 2024-04-26T11:14:59.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7269999999999996e-05 2024-04-26T11:14:59.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:59.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142317+0000", 2024-04-26T11:14:59.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023510105999999999 2024-04-26T11:14:59.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:59.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.143287+0000", 2024-04-26T11:14:59.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096983599999999996 2024-04-26T11:14:59.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:59.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157662+0000", 2024-04-26T11:14:59.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014375393 2024-04-26T11:14:59.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:59.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157702+0000", 2024-04-26T11:14:59.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0295e-05 2024-04-26T11:14:59.466 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.466 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:59.466 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.467 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101755 5.f 5:fa973a83:::benchmark_data_smithi029_44842_object101754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:59.467 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:59.467 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 40.285974506000002, 2024-04-26T11:14:59.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039139064000000001, 2024-04-26T11:14:59.467 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:59.467 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:59.467 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:59.468 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:59.468 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:59.468 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101755 2024-04-26T11:14:59.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.468 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:59.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:59.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:59.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:59.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:14:59.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:59.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118696+0000", 2024-04-26T11:14:59.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:59.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:59.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118766+0000", 2024-04-26T11:14:59.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9423000000000003e-05 2024-04-26T11:14:59.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:59.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118774+0000", 2024-04-26T11:14:59.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9710000000000004e-06 2024-04-26T11:14:59.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:59.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118779+0000", 2024-04-26T11:14:59.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5629999999999999e-06 2024-04-26T11:14:59.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118817+0000", 2024-04-26T11:14:59.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7771000000000001e-05 2024-04-26T11:14:59.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:59.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118929+0000", 2024-04-26T11:14:59.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011222699999999999 2024-04-26T11:14:59.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:59.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157661+0000", 2024-04-26T11:14:59.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038731120000000001 2024-04-26T11:14:59.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:59.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157757+0000", 2024-04-26T11:14:59.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6910000000000006e-05 2024-04-26T11:14:59.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:59.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157836+0000", 2024-04-26T11:14:59.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8727999999999996e-05 2024-04-26T11:14:59.472 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.472 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:59.472 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.472 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101758 5.4 5:2525a4eb:::benchmark_data_smithi029_44842_object101757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:59.472 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:59.472 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 40.283791655000002, 2024-04-26T11:14:59.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.03686739, 2024-04-26T11:14:59.472 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:59.472 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:59.472 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:59.473 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:59.473 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:59.473 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101758 2024-04-26T11:14:59.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.473 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:59.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:59.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:59.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:59.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:14:59.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:59.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120879+0000", 2024-04-26T11:14:59.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:59.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:59.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120971+0000", 2024-04-26T11:14:59.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2133999999999996e-05 2024-04-26T11:14:59.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:59.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120977+0000", 2024-04-26T11:14:59.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5509999999999999e-06 2024-04-26T11:14:59.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:59.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120981+0000", 2024-04-26T11:14:59.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.245e-06 2024-04-26T11:14:59.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121010+0000", 2024-04-26T11:14:59.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9084000000000001e-05 2024-04-26T11:14:59.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:59.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121083+0000", 2024-04-26T11:14:59.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2942999999999996e-05 2024-04-26T11:14:59.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:59.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121163+0000", 2024-04-26T11:14:59.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0197000000000005e-05 2024-04-26T11:14:59.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:59.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142822+0000", 2024-04-26T11:14:59.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021658535999999999 2024-04-26T11:14:59.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:59.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157674+0000", 2024-04-26T11:14:59.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014851573999999999 2024-04-26T11:14:59.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:59.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157714+0000", 2024-04-26T11:14:59.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0473999999999999e-05 2024-04-26T11:14:59.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:59.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157747+0000", 2024-04-26T11:14:59.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3278999999999998e-05 2024-04-26T11:14:59.477 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.477 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:59.477 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.479 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101760 5.4 5:2510211a:::benchmark_data_smithi029_44842_object101759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:59.479 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:59.479 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 40.283359310000002, 2024-04-26T11:14:59.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039182383000000001, 2024-04-26T11:14:59.479 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:59.480 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:59.480 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:59.480 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:59.480 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:59.480 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101760 2024-04-26T11:14:59.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.480 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:59.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:59.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:59.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:59.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:59.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:59.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:14:59.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:59.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:59.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121389+0000", 2024-04-26T11:14:59.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6667000000000003e-05 2024-04-26T11:14:59.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:59.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121394+0000", 2024-04-26T11:14:59.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0839999999999999e-06 2024-04-26T11:14:59.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:59.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121397+0000", 2024-04-26T11:14:59.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4489999999999999e-06 2024-04-26T11:14:59.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122921+0000", 2024-04-26T11:14:59.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001524067 2024-04-26T11:14:59.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:59.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.123010+0000", 2024-04-26T11:14:59.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8449000000000006e-05 2024-04-26T11:14:59.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:59.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140838+0000", 2024-04-26T11:14:59.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017828796000000001 2024-04-26T11:14:59.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:59.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157665+0000", 2024-04-26T11:14:59.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016826574 2024-04-26T11:14:59.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:59.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160407+0000", 2024-04-26T11:14:59.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027423970000000002 2024-04-26T11:14:59.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:59.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160456+0000", 2024-04-26T11:14:59.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8678999999999999e-05 2024-04-26T11:14:59.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:59.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160495+0000", 2024-04-26T11:14:59.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8658000000000002e-05 2024-04-26T11:14:59.485 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.485 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:59.485 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.485 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101761 5.e 5:70294421:::benchmark_data_smithi029_44842_object101760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:14:59.485 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:59.485 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 40.281934937000003, 2024-04-26T11:14:59.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035270448000000003, 2024-04-26T11:14:59.485 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:59.485 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:59.485 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:59.486 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:59.486 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:59.486 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101761 2024-04-26T11:14:59.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.486 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:59.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:59.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:59.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:59.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:14:59.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:59.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122736+0000", 2024-04-26T11:14:59.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:59.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:59.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122805+0000", 2024-04-26T11:14:59.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9076000000000001e-05 2024-04-26T11:14:59.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:59.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122811+0000", 2024-04-26T11:14:59.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:14:59.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:59.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122815+0000", 2024-04-26T11:14:59.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2860000000000001e-06 2024-04-26T11:14:59.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122842+0000", 2024-04-26T11:14:59.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6429000000000001e-05 2024-04-26T11:14:59.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:59.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122916+0000", 2024-04-26T11:14:59.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4122999999999995e-05 2024-04-26T11:14:59.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:59.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122997+0000", 2024-04-26T11:14:59.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1428999999999996e-05 2024-04-26T11:14:59.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:59.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142344+0000", 2024-04-26T11:14:59.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019346452 2024-04-26T11:14:59.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:59.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157934+0000", 2024-04-26T11:14:59.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015589911999999999 2024-04-26T11:14:59.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:59.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157975+0000", 2024-04-26T11:14:59.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1604999999999999e-05 2024-04-26T11:14:59.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:59.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.158007+0000", 2024-04-26T11:14:59.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1921000000000002e-05 2024-04-26T11:14:59.490 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.490 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:59.490 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.490 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110145 5.9 5:9b275f16:::benchmark_data_smithi029_44842_object110144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:59.491 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:59.491 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.256373299000003, 2024-04-26T11:14:59.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032844496000000001, 2024-04-26T11:14:59.491 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:59.491 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:59.491 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:59.491 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:59.491 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:59.491 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110145 2024-04-26T11:14:59.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.491 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:59.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:59.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:59.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:59.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:14:59.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:59.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148297+0000", 2024-04-26T11:14:59.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:59.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:59.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148325+0000", 2024-04-26T11:14:59.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7511000000000001e-05 2024-04-26T11:14:59.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:59.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148338+0000", 2024-04-26T11:14:59.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2808e-05 2024-04-26T11:14:59.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:59.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148345+0000", 2024-04-26T11:14:59.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7200000000000006e-06 2024-04-26T11:14:59.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149888+0000", 2024-04-26T11:14:59.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001542666 2024-04-26T11:14:59.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:59.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149977+0000", 2024-04-26T11:14:59.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9247999999999997e-05 2024-04-26T11:14:59.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:59.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181006+0000", 2024-04-26T11:14:59.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031028535999999999 2024-04-26T11:14:59.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:59.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181051+0000", 2024-04-26T11:14:59.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5393999999999999e-05 2024-04-26T11:14:59.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:59.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181143+0000", 2024-04-26T11:14:59.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1458000000000004e-05 2024-04-26T11:14:59.495 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.495 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:59.495 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.495 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110155 5.9 5:9ebc6158:::benchmark_data_smithi029_44842_object110154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:14:59.495 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:59.495 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 36.251297506999997, 2024-04-26T11:14:59.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027886826999999999, 2024-04-26T11:14:59.496 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:59.496 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:59.496 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:59.496 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:59.496 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:59.496 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110155 2024-04-26T11:14:59.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.496 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:59.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:59.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:59.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:59.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:14:59.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:59.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153373+0000", 2024-04-26T11:14:59.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:59.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:59.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153479+0000", 2024-04-26T11:14:59.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105728 2024-04-26T11:14:59.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:59.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153491+0000", 2024-04-26T11:14:59.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2207e-05 2024-04-26T11:14:59.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:59.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153499+0000", 2024-04-26T11:14:59.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7729999999999999e-06 2024-04-26T11:14:59.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153655+0000", 2024-04-26T11:14:59.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015573 2024-04-26T11:14:59.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:59.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153770+0000", 2024-04-26T11:14:59.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011562500000000001 2024-04-26T11:14:59.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:59.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181153+0000", 2024-04-26T11:14:59.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027382113 2024-04-26T11:14:59.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:59.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181195+0000", 2024-04-26T11:14:59.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1921000000000001e-05 2024-04-26T11:14:59.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:59.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181261+0000", 2024-04-26T11:14:59.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6402999999999994e-05 2024-04-26T11:14:59.500 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.500 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:59.500 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.500 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174398 5.4 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:59.500 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:14:59.500 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.0547812949999997, 2024-04-26T11:14:59.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.064773789999999998, 2024-04-26T11:14:59.500 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:59.500 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:59.501 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:59.501 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:59.501 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:59.501 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174398 2024-04-26T11:14:59.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.501 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:59.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:59.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:14:59.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:59.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:14:59.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:59.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349889+0000", 2024-04-26T11:14:59.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:59.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:59.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349895+0000", 2024-04-26T11:14:59.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4519999999999996e-06 2024-04-26T11:14:59.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:59.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349909+0000", 2024-04-26T11:14:59.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3791000000000001e-05 2024-04-26T11:14:59.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:59.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349919+0000", 2024-04-26T11:14:59.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0135999999999999e-05 2024-04-26T11:14:59.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349956+0000", 2024-04-26T11:14:59.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7642000000000003e-05 2024-04-26T11:14:59.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:59.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350080+0000", 2024-04-26T11:14:59.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123285 2024-04-26T11:14:59.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:59.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350192+0000", 2024-04-26T11:14:59.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112509 2024-04-26T11:14:59.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:59.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356232+0000", 2024-04-26T11:14:59.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060403339999999996 2024-04-26T11:14:59.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:59.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414616+0000", 2024-04-26T11:14:59.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.058383156999999998 2024-04-26T11:14:59.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:59.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414643+0000", 2024-04-26T11:14:59.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7317e-05 2024-04-26T11:14:59.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:59.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414664+0000", 2024-04-26T11:14:59.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1135999999999999e-05 2024-04-26T11:14:59.505 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.505 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:59.505 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.506 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174402 5.b 5:d8ad746d:::benchmark_data_smithi029_44842_object29764:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:59.506 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:14:59.506 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.0508271059999998, 2024-04-26T11:14:59.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059017657000000001, 2024-04-26T11:14:59.506 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:59.506 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:59.506 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:59.506 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:59.506 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:59.506 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174402 2024-04-26T11:14:59.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.506 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:59.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:59.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:14:59.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:59.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:14:59.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:59.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:14:59.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:14:59.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:59.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353848+0000", 2024-04-26T11:14:59.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5040000000000004e-06 2024-04-26T11:14:59.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:59.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353858+0000", 2024-04-26T11:14:59.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7410000000000004e-06 2024-04-26T11:14:59.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:59.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353864+0000", 2024-04-26T11:14:59.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7899999999999996e-06 2024-04-26T11:14:59.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353902+0000", 2024-04-26T11:14:59.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8325000000000003e-05 2024-04-26T11:14:59.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:59.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353980+0000", 2024-04-26T11:14:59.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8077000000000005e-05 2024-04-26T11:14:59.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:59.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354046+0000", 2024-04-26T11:14:59.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6249999999999998e-05 2024-04-26T11:14:59.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:59.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356532+0000", 2024-04-26T11:14:59.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024850969999999999 2024-04-26T11:14:59.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:59.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412796+0000", 2024-04-26T11:14:59.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056264616000000003 2024-04-26T11:14:59.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:59.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412835+0000", 2024-04-26T11:14:59.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8863999999999999e-05 2024-04-26T11:14:59.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:59.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412862+0000", 2024-04-26T11:14:59.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7124e-05 2024-04-26T11:14:59.511 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.511 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:59.511 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.511 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174403 5.4 5:2d30cd6a:::benchmark_data_smithi029_44842_object29765:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:59.511 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:14:59.511 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.0507999029999997, 2024-04-26T11:14:59.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.060873365999999998, 2024-04-26T11:14:59.511 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:59.511 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:59.511 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:59.512 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:59.512 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:59.512 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174403 2024-04-26T11:14:59.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.512 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:59.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:59.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:14:59.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:59.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:14:59.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:59.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353871+0000", 2024-04-26T11:14:59.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:59.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:59.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353874+0000", 2024-04-26T11:14:59.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869999999999999e-06 2024-04-26T11:14:59.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:59.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353881+0000", 2024-04-26T11:14:59.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2239999999999998e-06 2024-04-26T11:14:59.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:59.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353886+0000", 2024-04-26T11:14:59.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.259e-06 2024-04-26T11:14:59.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353912+0000", 2024-04-26T11:14:59.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6404999999999999e-05 2024-04-26T11:14:59.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:59.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353991+0000", 2024-04-26T11:14:59.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8104999999999998e-05 2024-04-26T11:14:59.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:59.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354055+0000", 2024-04-26T11:14:59.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4875999999999993e-05 2024-04-26T11:14:59.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:59.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.358000+0000", 2024-04-26T11:14:59.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039442629999999999 2024-04-26T11:14:59.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:59.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414690+0000", 2024-04-26T11:14:59.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056689940000000001 2024-04-26T11:14:59.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:59.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414714+0000", 2024-04-26T11:14:59.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4527000000000001e-05 2024-04-26T11:14:59.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:59.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414745+0000", 2024-04-26T11:14:59.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0874999999999998e-05 2024-04-26T11:14:59.516 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.516 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:59.516 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.517 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174404 5.4 5:2801f1e1:::benchmark_data_smithi029_44842_object29766:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:14:59.517 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:14:59.517 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.0481829789999999, 2024-04-26T11:14:59.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059745741999999998, 2024-04-26T11:14:59.517 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:14:59.517 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:14:59.517 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:14:59.517 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:14:59.517 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:14:59.517 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174404 2024-04-26T11:14:59.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.517 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:14:59.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:14:59.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:14:59.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:14:59.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:14:59.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:14:59.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:14:59.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356488+0000", 2024-04-26T11:14:59.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:14:59.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:14:59.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356492+0000", 2024-04-26T11:14:59.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1169999999999997e-06 2024-04-26T11:14:59.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:14:59.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356502+0000", 2024-04-26T11:14:59.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0263e-05 2024-04-26T11:14:59.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:14:59.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356508+0000", 2024-04-26T11:14:59.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5890000000000002e-06 2024-04-26T11:14:59.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:14:59.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356545+0000", 2024-04-26T11:14:59.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7382999999999998e-05 2024-04-26T11:14:59.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:14:59.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356671+0000", 2024-04-26T11:14:59.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012535500000000001 2024-04-26T11:14:59.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:14:59.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356789+0000", 2024-04-26T11:14:59.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000118099 2024-04-26T11:14:59.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:14:59.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.359200+0000", 2024-04-26T11:14:59.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024110059999999998 2024-04-26T11:14:59.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:14:59.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416180+0000", 2024-04-26T11:14:59.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056980335999999999 2024-04-26T11:14:59.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:14:59.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416204+0000", 2024-04-26T11:14:59.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4301e-05 2024-04-26T11:14:59.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:14:59.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:14:59.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:14:59.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416234+0000", 2024-04-26T11:14:59.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9903000000000002e-05 2024-04-26T11:14:59.522 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.522 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:59.522 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.522 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:14:59.522 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:14:59.522 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:14:59.523 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:59.522+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:59.524 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:14:59.545 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:14:59.624 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:59.623+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:59.699 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:14:59.700 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:14:59.704 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:59.705 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:59.720 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:14:59.720 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:14:59.720 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:14:59.720 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:14:59.721 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:14:59.722 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:14:59.723 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:14:59.725 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:59.724+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:59.829 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:14:59.827+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:14:59.912 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:14:59.912 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:14:59.926 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:14:59.925+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:14:59.927 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:00.029 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:00.028+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:00.128 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:00.127+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:00.155 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:00.156 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:00.171 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:00.229 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:00.228+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:00.329 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:00.328+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:00.345 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:00.345 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:00.359 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:00.430 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:00.429+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:00.530 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:00.530 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:00.531 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:00.530+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:00.544 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:00.633 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:00.632+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:00.690 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:15:00.718 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:00.718 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:00.732 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:00.736 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:00.734+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:00.835 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:00.834+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:00.923 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:00.923 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:00.933 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:00.937 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:00.936+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:01.037 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:01.036+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:01.109 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:01.109 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:01.122 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:01.137 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:01.137+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:01.238 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:01.237+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:01.300 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:01.300 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:01.315 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:01.339 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:01.338+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:01.443 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:01.439+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:01.487 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:01.488 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:01.502 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:01.541 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:01.540+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:01.643 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:01.642+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:01.683 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:01.683 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:01.697 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:01.724 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:15:01.744 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:01.743+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:01.848 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:01.846+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:01.869 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:01.870 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:01.872 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:15:01.881 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:01.893 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:15:01.893 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:15:01.893 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:15:01.893 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:15:01.895 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:15:01.896 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:15:01.946 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:01.945+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:02.051 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:02.049+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:02.080 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:02.081 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:15:02.081 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.081 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:206268 5.7 5:e91963bf:::benchmark_data_smithi029_44842_object61630:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:15:02.081 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:02.072881+0000", 2024-04-26T11:15:02.081 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0054762379999999996, 2024-04-26T11:15:02.081 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0055076020000000003, 2024-04-26T11:15:02.081 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.081 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:02.081 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.081 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 206268 2024-04-26T11:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.072881+0000", 2024-04-26T11:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.072881+0000", 2024-04-26T11:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.072880+0000", 2024-04-26T11:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.072886+0000", 2024-04-26T11:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4469999999999997e-06 2024-04-26T11:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.072898+0000", 2024-04-26T11:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2061e-05 2024-04-26T11:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.072907+0000", 2024-04-26T11:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1139999999999995e-06 2024-04-26T11:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.072948+0000", 2024-04-26T11:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1634000000000002e-05 2024-04-26T11:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.073060+0000", 2024-04-26T11:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011189200000000001 2024-04-26T11:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:206266 5.b e50/16 5:d3aac1ac:::benchmark_data_smithi029_44842_object61628:head v 50'13121, mlcod=50'13117)", 2024-04-26T11:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:02.073594+0000", 2024-04-26T11:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0047628599999999998, 2024-04-26T11:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0048503610000000001, 2024-04-26T11:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.073594+0000", 2024-04-26T11:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.073594+0000", 2024-04-26T11:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.073594+0000", 2024-04-26T11:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.073599+0000", 2024-04-26T11:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6570000000000002e-06 2024-04-26T11:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.073608+0000", 2024-04-26T11:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3899999999999993e-06 2024-04-26T11:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.073614+0000", 2024-04-26T11:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6999999999999996e-06 2024-04-26T11:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.074320+0000", 2024-04-26T11:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00070601300000000002 2024-04-26T11:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.074336+0000", 2024-04-26T11:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6608000000000001e-05 2024-04-26T11:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:206265 5.8 e50/16 5:11c7d75c:::benchmark_data_smithi029_44842_object61627:head v 50'12946, mlcod=50'12942)", 2024-04-26T11:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:02.073622+0000", 2024-04-26T11:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0047349360000000004, 2024-04-26T11:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0048716699999999998, 2024-04-26T11:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.073622+0000", 2024-04-26T11:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.073622+0000", 2024-04-26T11:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.073622+0000", 2024-04-26T11:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.073625+0000", 2024-04-26T11:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2399999999999999e-06 2024-04-26T11:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.073631+0000", 2024-04-26T11:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2339999999999999e-06 2024-04-26T11:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.073635+0000", 2024-04-26T11:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6509999999999999e-06 2024-04-26T11:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.073665+0000", 2024-04-26T11:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0334000000000001e-05 2024-04-26T11:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.073683+0000", 2024-04-26T11:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7861000000000001e-05 2024-04-26T11:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:206271 5.4 e50/16 5:28a877d5:::benchmark_data_smithi029_44842_object61633:head v 50'12775, mlcod=50'12773)", 2024-04-26T11:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:02.073700+0000", 2024-04-26T11:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0046572410000000003, 2024-04-26T11:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0048410010000000002, 2024-04-26T11:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.073700+0000", 2024-04-26T11:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.073700+0000", 2024-04-26T11:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.073699+0000", 2024-04-26T11:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.073704+0000", 2024-04-26T11:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2200000000000003e-06 2024-04-26T11:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.073710+0000", 2024-04-26T11:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7950000000000002e-06 2024-04-26T11:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.073715+0000", 2024-04-26T11:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7829999999999998e-06 2024-04-26T11:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.074438+0000", 2024-04-26T11:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00072229800000000002 2024-04-26T11:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.074457+0000", 2024-04-26T11:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8994000000000001e-05 2024-04-26T11:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:206272 5.7 5:e14c5f74:::benchmark_data_smithi029_44842_object61634:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:02.074708+0000", 2024-04-26T11:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.003649495, 2024-04-26T11:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0038790859999999999, 2024-04-26T11:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 206272 2024-04-26T11:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.074708+0000", 2024-04-26T11:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.074708+0000", 2024-04-26T11:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.074707+0000", 2024-04-26T11:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.074712+0000", 2024-04-26T11:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3859999999999998e-06 2024-04-26T11:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.074730+0000", 2024-04-26T11:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7909000000000001e-05 2024-04-26T11:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.074739+0000", 2024-04-26T11:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1290000000000002e-06 2024-04-26T11:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.075207+0000", 2024-04-26T11:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00046824200000000001 2024-04-26T11:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.075319+0000", 2024-04-26T11:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000112094 2024-04-26T11:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:206275 5.c 5:371fe0a8:::benchmark_data_smithi029_44842_object61637:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:02.074756+0000", 2024-04-26T11:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0036012259999999999, 2024-04-26T11:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0038687830000000002, 2024-04-26T11:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 206275 2024-04-26T11:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.074756+0000", 2024-04-26T11:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.074756+0000", 2024-04-26T11:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.074755+0000", 2024-04-26T11:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.074759+0000", 2024-04-26T11:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5669999999999999e-06 2024-04-26T11:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.074767+0000", 2024-04-26T11:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2519999999999999e-06 2024-04-26T11:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.074773+0000", 2024-04-26T11:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.075489+0000", 2024-04-26T11:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000715893 2024-04-26T11:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.075607+0000", 2024-04-26T11:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011852400000000001 2024-04-26T11:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:206269 5.b e50/16 5:d0fca213:::benchmark_data_smithi029_44842_object61631:head v 50'13122, mlcod=50'13118)", 2024-04-26T11:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:02.074919+0000", 2024-04-26T11:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0034379340000000001, 2024-04-26T11:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0037431220000000002, 2024-04-26T11:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.074919+0000", 2024-04-26T11:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.074919+0000", 2024-04-26T11:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.074919+0000", 2024-04-26T11:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.074925+0000", 2024-04-26T11:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.84e-06 2024-04-26T11:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.074935+0000", 2024-04-26T11:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0149999999999999e-05 2024-04-26T11:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.074942+0000", 2024-04-26T11:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6920000000000002e-06 2024-04-26T11:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.076078+0000", 2024-04-26T11:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001135968 2024-04-26T11:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.076097+0000", 2024-04-26T11:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8610999999999999e-05 2024-04-26T11:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:206277 5.2 5:49f3ace2:::benchmark_data_smithi029_44842_object61639:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:02.075438+0000", 2024-04-26T11:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0029193449999999998, 2024-04-26T11:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0032579250000000001, 2024-04-26T11:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 206277 2024-04-26T11:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.075438+0000", 2024-04-26T11:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.075438+0000", 2024-04-26T11:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.075437+0000", 2024-04-26T11:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.111 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.111 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.111 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.075441+0000", 2024-04-26T11:15:02.111 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2860000000000001e-06 2024-04-26T11:15:02.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.111 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.111 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.111 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.075448+0000", 2024-04-26T11:15:02.111 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.314e-06 2024-04-26T11:15:02.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.111 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.111 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.112 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.075459+0000", 2024-04-26T11:15:02.112 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1345999999999999e-05 2024-04-26T11:15:02.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.112 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.112 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.112 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.075488+0000", 2024-04-26T11:15:02.112 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8629e-05 2024-04-26T11:15:02.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.112 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.112 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.112 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.075591+0000", 2024-04-26T11:15:02.112 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000103359 2024-04-26T11:15:02.112 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.113 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.113 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.113 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.113 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.113 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:206279 5.1 5:8b60efe9:::benchmark_data_smithi029_44842_object61641:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:15:02.113 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:02.075547+0000", 2024-04-26T11:15:02.113 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00281029, 2024-04-26T11:15:02.113 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0031875879999999999, 2024-04-26T11:15:02.113 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.113 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:02.113 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.113 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.113 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.113 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 206279 2024-04-26T11:15:02.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.114 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.114 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.114 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.114 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.075547+0000", 2024-04-26T11:15:02.114 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.114 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.114 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.114 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.075547+0000", 2024-04-26T11:15:02.114 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.114 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.115 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.115 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.075546+0000", 2024-04-26T11:15:02.115 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:02.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.115 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.115 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.075550+0000", 2024-04-26T11:15:02.115 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0679999999999998e-06 2024-04-26T11:15:02.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.115 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.115 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.075559+0000", 2024-04-26T11:15:02.115 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7369999999999995e-06 2024-04-26T11:15:02.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.116 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.116 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.116 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.075566+0000", 2024-04-26T11:15:02.116 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5299999999999999e-06 2024-04-26T11:15:02.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.116 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.116 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.116 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.076486+0000", 2024-04-26T11:15:02.116 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00091967600000000002 2024-04-26T11:15:02.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.116 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.116 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.116 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.076601+0000", 2024-04-26T11:15:02.117 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011489000000000001 2024-04-26T11:15:02.117 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.117 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.117 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.117 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.117 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:206280 5.2 5:4d83591b:::benchmark_data_smithi029_44842_object61642:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:15:02.117 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:02.077306+0000", 2024-04-26T11:15:02.117 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0010514770000000001, 2024-04-26T11:15:02.117 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0014652409999999999, 2024-04-26T11:15:02.117 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.117 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:02.117 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.117 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.118 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.118 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 206280 2024-04-26T11:15:02.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.118 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.118 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.118 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.118 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077306+0000", 2024-04-26T11:15:02.118 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.118 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.118 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.118 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077306+0000", 2024-04-26T11:15:02.118 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.119 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.119 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.119 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077305+0000", 2024-04-26T11:15:02.119 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.119 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.119 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.119 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.119 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077309+0000", 2024-04-26T11:15:02.119 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4710000000000001e-06 2024-04-26T11:15:02.119 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.119 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.119 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.120 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077317+0000", 2024-04-26T11:15:02.120 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9189999999999999e-06 2024-04-26T11:15:02.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.120 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.120 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.120 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077324+0000", 2024-04-26T11:15:02.120 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3640000000000004e-06 2024-04-26T11:15:02.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.120 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.120 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.120 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077668+0000", 2024-04-26T11:15:02.120 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00034436100000000001 2024-04-26T11:15:02.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.120 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.121 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.121 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077784+0000", 2024-04-26T11:15:02.121 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000115919 2024-04-26T11:15:02.121 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.121 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.121 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.121 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.121 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:206273 5.4 e50/16 5:251d1258:::benchmark_data_smithi029_44842_object61635:head v 50'12776, mlcod=50'12773)", 2024-04-26T11:15:02.121 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:02.077605+0000", 2024-04-26T11:15:02.121 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00075263999999999995, 2024-04-26T11:15:02.121 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0012019960000000001, 2024-04-26T11:15:02.121 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.121 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:02.121 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.122 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.122 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.122 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077605+0000", 2024-04-26T11:15:02.122 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.122 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.122 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.122 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077605+0000", 2024-04-26T11:15:02.122 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.122 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.122 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.122 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077604+0000", 2024-04-26T11:15:02.123 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.123 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.123 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.123 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077609+0000", 2024-04-26T11:15:02.123 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5740000000000003e-06 2024-04-26T11:15:02.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.123 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.123 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.123 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077640+0000", 2024-04-26T11:15:02.123 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0784999999999997e-05 2024-04-26T11:15:02.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.123 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.124 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.124 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077649+0000", 2024-04-26T11:15:02.124 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4740000000000005e-06 2024-04-26T11:15:02.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.124 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.124 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.124 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077749+0000", 2024-04-26T11:15:02.124 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100151 2024-04-26T11:15:02.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.124 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.124 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.124 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077766+0000", 2024-04-26T11:15:02.124 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7138000000000001e-05 2024-04-26T11:15:02.124 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.125 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.125 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.125 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.125 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:206276 5.e e50/16 5:76502d3c:::benchmark_data_smithi029_44842_object61638:head v 50'12837, mlcod=50'12835)", 2024-04-26T11:15:02.125 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:02.077660+0000", 2024-04-26T11:15:02.125 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.000697618, 2024-04-26T11:15:02.125 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0011792949999999999, 2024-04-26T11:15:02.125 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.125 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:02.125 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.125 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.125 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.125 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077660+0000", 2024-04-26T11:15:02.126 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.126 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.126 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077660+0000", 2024-04-26T11:15:02.126 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.126 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.126 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077659+0000", 2024-04-26T11:15:02.126 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.127 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.127 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077664+0000", 2024-04-26T11:15:02.127 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2750000000000003e-06 2024-04-26T11:15:02.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.127 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.127 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077672+0000", 2024-04-26T11:15:02.127 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7400000000000004e-06 2024-04-26T11:15:02.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.127 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.127 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077677+0000", 2024-04-26T11:15:02.127 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5850000000000001e-06 2024-04-26T11:15:02.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.128 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.128 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077710+0000", 2024-04-26T11:15:02.128 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3278999999999998e-05 2024-04-26T11:15:02.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.128 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.128 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077727+0000", 2024-04-26T11:15:02.128 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7484000000000001e-05 2024-04-26T11:15:02.128 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.128 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.128 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.128 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:206278 5.0 e50/16 5:0ab636ee:::benchmark_data_smithi029_44842_object61640:head v 50'13083, mlcod=50'13081)", 2024-04-26T11:15:02.129 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:02.077684+0000", 2024-04-26T11:15:02.129 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00067366400000000003, 2024-04-26T11:15:02.129 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0011876, 2024-04-26T11:15:02.129 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.129 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:02.129 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.129 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.129 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.129 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077684+0000", 2024-04-26T11:15:02.129 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.129 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.129 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.129 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.130 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077684+0000", 2024-04-26T11:15:02.130 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.130 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.130 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.130 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077683+0000", 2024-04-26T11:15:02.130 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967296 2024-04-26T11:15:02.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.130 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.130 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.130 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077690+0000", 2024-04-26T11:15:02.130 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1239999999999999e-06 2024-04-26T11:15:02.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.130 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.131 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.131 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077696+0000", 2024-04-26T11:15:02.131 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2839999999999997e-06 2024-04-26T11:15:02.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.131 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.131 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.131 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077700+0000", 2024-04-26T11:15:02.131 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.907e-06 2024-04-26T11:15:02.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.131 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.131 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.131 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077747+0000", 2024-04-26T11:15:02.131 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7753000000000002e-05 2024-04-26T11:15:02.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.132 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.132 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.132 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077763+0000", 2024-04-26T11:15:02.132 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5361000000000001e-05 2024-04-26T11:15:02.132 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.132 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.132 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.132 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.132 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.132 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:206281 5.1 5.c637fda1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:15:02.132 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:02.077994+0000", 2024-04-26T11:15:02.132 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00036345700000000003, 2024-04-26T11:15:02.132 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00091074999999999999, 2024-04-26T11:15:02.133 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.133 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:15:02.133 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.133 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.133 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.133 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 206281 2024-04-26T11:15:02.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.133 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.133 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.133 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.133 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077994+0000", 2024-04-26T11:15:02.133 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.133 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.134 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.134 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077994+0000", 2024-04-26T11:15:02.134 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.134 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.134 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.134 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077993+0000", 2024-04-26T11:15:02.134 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.134 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.134 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.134 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.077998+0000", 2024-04-26T11:15:02.134 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6859999999999997e-06 2024-04-26T11:15:02.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.135 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.135 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.135 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.078014+0000", 2024-04-26T11:15:02.135 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6518999999999999e-05 2024-04-26T11:15:02.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.135 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.135 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.135 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.078022+0000", 2024-04-26T11:15:02.135 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2989999999999999e-06 2024-04-26T11:15:02.135 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.135 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.135 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.136 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.136 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:206283 5.6 5:6b36ff9f:::benchmark_data_smithi029_44842_object61645:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:15:02.136 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:02.078181+0000", 2024-04-26T11:15:02.136 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00017644700000000001, 2024-04-26T11:15:02.136 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00075432199999999998, 2024-04-26T11:15:02.136 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.136 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:02.136 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.136 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.136 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.136 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 206283 2024-04-26T11:15:02.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.136 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.136 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.137 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.137 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.078181+0000", 2024-04-26T11:15:02.137 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.137 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.137 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.137 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.078181+0000", 2024-04-26T11:15:02.137 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.137 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.137 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.137 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.078180+0000", 2024-04-26T11:15:02.137 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.138 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.138 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.138 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.078184+0000", 2024-04-26T11:15:02.138 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4519999999999999e-06 2024-04-26T11:15:02.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.138 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.138 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.138 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.078197+0000", 2024-04-26T11:15:02.138 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2840000000000001e-05 2024-04-26T11:15:02.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.138 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.138 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.139 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.078204+0000", 2024-04-26T11:15:02.139 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2480000000000001e-06 2024-04-26T11:15:02.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.139 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.139 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.139 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.078238+0000", 2024-04-26T11:15:02.139 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4848999999999998e-05 2024-04-26T11:15:02.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.139 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.139 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.139 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.078358+0000", 2024-04-26T11:15:02.139 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000119993 2024-04-26T11:15:02.139 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.139 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.140 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.140 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.140 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:206282 5.4 e50/16)", 2024-04-26T11:15:02.140 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:02.078274+0000", 2024-04-26T11:15:02.140 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 8.2795999999999998e-05, 2024-04-26T11:15:02.140 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00069866899999999996, 2024-04-26T11:15:02.140 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.140 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:15:02.140 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.140 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.140 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.140 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.078274+0000", 2024-04-26T11:15:02.140 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.141 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.141 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.141 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.078274+0000", 2024-04-26T11:15:02.141 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.141 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.141 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.141 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.078274+0000", 2024-04-26T11:15:02.141 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.141 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.141 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.141 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.078280+0000", 2024-04-26T11:15:02.141 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0499999999999997e-06 2024-04-26T11:15:02.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.142 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.142 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.142 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.078289+0000", 2024-04-26T11:15:02.142 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2930000000000006e-06 2024-04-26T11:15:02.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.142 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.142 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.142 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:02.078298+0000", 2024-04-26T11:15:02.142 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7239999999999998e-06 2024-04-26T11:15:02.142 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.142 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.142 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.142 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.142 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:15:02.143 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 16 2024-04-26T11:15:02.143 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:02.144 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:02.151 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:02.150+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:02.256 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:02.254+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:02.356 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:02.355+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:02.366 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:02.367 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:15:02.367 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:15:02.367 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:15:02.367 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:02.381 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:02.462 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:02.459+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:02.560 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:02.559+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:02.572 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:02.572 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:15:02.572 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:15:02.572 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:15:02.572 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.572 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:02.572 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:02.572 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 69.297700057, 2024-04-26T11:15:02.572 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:15:02.573 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.573 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:02.573 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.573 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.573 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.573 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:15:02.573 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.573 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.573 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.573 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.574 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:02.574 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.574 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.574 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.574 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:02.574 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.574 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.574 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.574 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:15:02.574 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.574 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.575 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.575 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:15:02.575 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:15:02.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.575 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.575 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.575 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:15:02.575 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:15:02.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.575 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.575 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.575 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:15:02.575 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:15:02.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.576 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.576 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.576 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:15:02.576 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:15:02.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.576 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.576 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.576 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:15:02.576 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:15:02.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.576 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.576 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:02.576 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:15:02.576 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:15:02.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.577 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.577 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:02.577 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:15:02.577 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:15:02.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.577 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.577 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:02.577 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:15:02.577 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:15:02.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.577 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.577 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:02.577 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:15:02.577 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:15:02.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.578 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.578 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:02.578 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:15:02.578 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:15:02.578 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.578 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.578 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.578 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.578 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:02.578 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:02.578 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 69.296888491999994, 2024-04-26T11:15:02.578 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:15:02.578 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.579 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:02.579 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.579 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.579 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.579 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:15:02.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.579 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.579 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.579 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.579 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:02.579 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.579 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.579 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.579 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:02.580 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.580 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.580 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.580 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:02.580 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:02.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.580 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.580 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.580 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:15:02.580 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:15:02.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.580 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.581 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.581 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:15:02.581 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:15:02.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.581 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.581 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.581 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:15:02.581 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:15:02.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.581 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.581 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.581 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:15:02.581 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:15:02.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.581 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.582 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.582 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:15:02.582 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:15:02.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.582 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.582 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:02.582 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:15:02.582 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:15:02.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.582 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.582 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:02.582 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:15:02.582 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:15:02.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.582 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.583 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:02.583 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:15:02.583 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:15:02.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.583 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.583 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:02.583 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:15:02.583 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:15:02.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.583 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.583 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:02.583 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:15:02.583 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:15:02.584 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.584 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.584 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.584 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.584 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:02.584 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:02.584 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 69.289701655000002, 2024-04-26T11:15:02.585 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:15:02.585 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.585 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:02.585 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.585 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.585 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.585 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:15:02.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.585 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.586 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.586 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:02.586 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.586 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.586 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.586 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:02.586 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.586 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.587 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.587 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:15:02.587 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:02.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.587 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.587 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.587 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:15:02.587 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:15:02.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.588 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.588 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:15:02.588 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:15:02.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.588 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.588 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:15:02.588 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:15:02.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.588 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.589 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:15:02.589 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:15:02.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.589 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.589 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:15:02.589 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:15:02.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.589 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:02.589 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:15:02.589 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:15:02.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.590 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:02.590 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:15:02.590 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:15:02.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.590 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.590 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:02.590 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:15:02.590 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:15:02.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.590 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.590 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:02.590 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:15:02.590 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:15:02.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.591 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:02.591 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:15:02.591 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:15:02.591 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.591 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.591 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.591 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:02.591 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:02.591 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 69.289160776000003, 2024-04-26T11:15:02.591 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:15:02.591 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.591 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:02.592 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.592 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.592 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.592 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:15:02.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.592 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.592 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.592 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:02.592 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.592 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.592 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:02.593 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.593 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.593 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.593 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:02.593 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.593 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.593 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.593 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:15:02.593 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:15:02.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.593 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.593 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.593 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:15:02.594 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:15:02.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.594 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.594 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.594 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:15:02.594 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:15:02.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.594 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.594 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.594 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:15:02.594 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:15:02.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.594 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.594 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.595 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:15:02.595 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:15:02.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.595 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.595 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:02.595 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:15:02.595 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:15:02.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.595 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.595 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:02.595 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:15:02.595 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:15:02.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.595 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.596 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:02.596 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:15:02.596 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:15:02.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.596 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.596 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:02.596 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:15:02.596 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:15:02.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.596 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.596 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:02.596 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:15:02.596 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:15:02.596 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.597 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.597 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.597 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.597 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:02.597 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:02.597 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 65.245976329000001, 2024-04-26T11:15:02.597 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:15:02.597 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.597 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:02.597 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.597 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.597 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.597 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:15:02.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.598 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.598 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.598 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.598 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:02.598 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.598 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.598 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.598 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:02.598 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.598 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.598 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.598 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:15:02.599 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:02.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.599 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.599 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.599 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:15:02.599 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:15:02.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.599 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.599 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.599 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:15:02.599 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:15:02.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.599 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.599 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.599 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:15:02.600 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:15:02.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.600 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.600 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.600 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:15:02.600 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:15:02.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.600 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.600 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.600 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:15:02.600 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:15:02.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.600 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.600 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:02.601 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:15:02.601 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:15:02.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.601 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.601 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:02.601 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:15:02.601 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:15:02.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.601 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.601 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.601 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:15:02.601 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:15:02.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.602 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.602 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:02.602 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:15:02.602 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:15:02.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.602 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.602 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.602 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:15:02.602 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:15:02.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.602 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.602 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:02.603 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:15:02.603 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:15:02.603 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.603 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.603 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.603 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:02.603 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:02.603 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 65.243782988999996, 2024-04-26T11:15:02.603 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:15:02.603 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.603 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:02.603 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.603 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.604 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.604 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:15:02.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.604 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.604 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.604 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:02.604 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.604 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.604 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:02.604 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.605 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.605 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:15:02.605 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:02.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.605 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.605 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.605 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:15:02.605 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:15:02.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.605 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.605 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.605 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:15:02.605 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:15:02.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.606 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.606 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.606 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:15:02.606 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:15:02.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.606 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.606 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.606 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:15:02.606 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:15:02.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.606 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.606 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.606 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:15:02.606 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:15:02.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:15:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:15:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:15:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:15:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:15:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:15:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:15:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:15:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:15:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:15:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:15:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:15:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.609 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.609 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.609 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.609 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:02.609 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:02.609 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 65.238571164999996, 2024-04-26T11:15:02.609 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:15:02.609 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.609 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:02.609 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.609 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.609 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.609 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:15:02.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.610 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.610 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.610 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.610 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:02.610 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.610 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.610 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.610 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:02.610 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.610 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.610 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.610 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:15:02.610 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:02.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.611 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.611 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.611 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:15:02.611 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:15:02.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.611 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.611 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.611 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:15:02.611 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:15:02.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.611 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.611 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.611 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:15:02.611 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:15:02.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.612 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.612 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.612 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:15:02.612 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:15:02.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.612 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.612 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.612 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:15:02.612 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:15:02.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.612 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.612 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:02.612 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:15:02.612 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:15:02.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.613 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.613 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:02.613 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:15:02.613 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:15:02.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.613 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.613 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.613 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:15:02.613 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:15:02.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.613 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.613 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:02.613 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:15:02.614 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:15:02.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.614 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.614 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.614 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:15:02.614 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:15:02.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.614 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.614 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:02.614 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:15:02.614 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:15:02.614 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.614 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.614 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.615 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.615 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:02.615 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:02.615 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 65.222122464999998, 2024-04-26T11:15:02.615 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:15:02.615 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.615 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:02.615 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.615 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.615 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.615 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:15:02.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.615 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.615 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.615 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.616 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:02.616 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.616 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.616 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.616 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:02.616 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.616 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.616 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.616 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:15:02.616 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:02.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.616 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.616 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.617 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:15:02.617 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:15:02.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.617 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.617 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.617 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:15:02.617 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:15:02.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.617 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.617 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.617 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:15:02.617 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:15:02.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.617 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.617 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.618 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:15:02.618 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:15:02.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.618 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.618 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:02.618 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:15:02.618 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:15:02.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.618 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.618 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.618 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:15:02.618 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:15:02.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.618 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.619 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:02.619 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:15:02.619 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:15:02.619 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.619 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.619 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.619 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.619 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:02.619 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:02.619 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 65.220424960000003, 2024-04-26T11:15:02.619 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:15:02.619 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.619 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:02.619 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.620 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.620 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.620 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:15:02.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.620 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.620 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.620 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.620 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:02.620 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.620 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.620 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.620 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:02.620 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.621 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.621 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.621 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:15:02.621 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:02.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.621 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.621 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.621 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:15:02.621 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:15:02.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.621 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.621 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.621 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:15:02.621 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:15:02.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.622 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.622 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.622 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:15:02.622 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:15:02.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.622 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.622 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.622 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:15:02.622 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:15:02.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.622 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.622 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:02.623 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:15:02.623 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:15:02.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.623 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.623 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.623 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:15:02.623 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:15:02.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.623 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.623 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:02.623 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:15:02.623 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:15:02.623 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.623 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.623 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.624 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.624 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:02.624 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:02.624 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 65.220360658000004, 2024-04-26T11:15:02.624 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:15:02.624 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.624 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:02.624 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.624 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.624 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.624 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:15:02.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.624 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.624 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.624 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.625 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:02.625 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.625 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.625 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.625 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:02.625 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.625 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.625 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.625 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:02.625 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.625 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.626 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.626 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:15:02.626 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:15:02.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.626 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.626 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.626 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:15:02.626 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:15:02.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.626 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.626 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.626 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:15:02.626 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:15:02.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.627 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.627 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.627 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:15:02.627 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:15:02.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.627 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.627 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:02.627 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:15:02.627 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:15:02.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.627 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.627 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.627 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:15:02.627 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:15:02.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.628 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.628 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:15:02.628 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:15:02.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.628 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:02.628 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:15:02.628 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:15:02.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.628 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:02.628 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:15:02.628 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:15:02.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.629 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.629 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:02.629 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:15:02.629 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:15:02.629 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.629 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.629 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.629 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.629 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:02.629 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:02.629 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 65.220306433999994, 2024-04-26T11:15:02.629 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:15:02.630 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.630 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:02.630 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.630 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.630 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.630 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:15:02.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.630 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.630 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.630 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:02.630 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.631 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:02.631 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.631 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:02.631 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.631 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:15:02.631 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:15:02.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.632 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.632 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:15:02.632 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:15:02.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.632 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.632 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.632 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:15:02.632 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:15:02.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.632 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.632 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.632 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:15:02.632 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:15:02.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.632 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.633 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:02.633 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:15:02.633 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:15:02.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.633 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.633 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:15:02.633 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:15:02.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.633 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.633 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:15:02.633 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:15:02.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.634 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:02.634 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:15:02.634 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:15:02.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.634 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:02.634 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:15:02.634 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:15:02.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.634 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:02.634 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:15:02.634 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:15:02.634 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.635 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.635 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.635 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.635 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:02.635 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:02.635 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 65.220261922000006, 2024-04-26T11:15:02.635 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:15:02.635 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.635 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:02.635 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.635 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.635 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.635 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:15:02.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.636 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.636 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.636 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:02.636 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.636 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.636 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:02.636 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.636 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.636 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:15:02.636 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.637 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.637 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:15:02.637 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:15:02.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.637 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.637 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:15:02.637 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:15:02.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.637 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.637 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:15:02.637 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:15:02.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.638 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.638 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.638 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:15:02.638 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:15:02.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.638 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.638 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:02.638 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:15:02.638 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:15:02.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.638 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.638 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.638 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:15:02.638 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:15:02.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.639 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.639 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:15:02.639 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:15:02.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.639 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:02.639 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:15:02.639 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:15:02.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.639 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:02.639 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:15:02.639 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:15:02.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.640 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.640 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:02.640 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:15:02.640 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:15:02.640 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.640 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.640 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.640 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.640 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:02.640 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:02.640 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 65.216040919999998, 2024-04-26T11:15:02.640 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:15:02.641 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.641 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:02.641 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.641 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.641 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.641 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:15:02.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.641 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.641 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.641 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.641 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:02.641 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.642 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.642 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.642 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:02.642 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.642 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.642 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.642 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.642 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:15:02.642 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:15:02.642 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.642 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.642 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.642 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:15:02.642 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:15:02.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.643 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.643 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.643 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:15:02.643 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:15:02.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.643 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.643 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.643 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:15:02.643 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:15:02.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.643 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.643 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.643 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:15:02.643 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:15:02.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.644 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.644 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:02.644 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:15:02.644 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:15:02.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.644 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.644 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.644 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:15:02.644 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:15:02.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.644 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.644 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.644 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:15:02.644 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:15:02.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.645 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:02.645 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:15:02.645 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:15:02.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.645 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:02.645 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:15:02.645 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:15:02.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.645 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:02.645 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:15:02.645 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:15:02.646 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.646 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.646 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.646 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.646 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174388 5.c 5:312e5163:::benchmark_data_smithi029_44842_object29750:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:02.646 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:02.646 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.220215265, 2024-04-26T11:15:02.646 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.064002009999999998, 2024-04-26T11:15:02.646 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.646 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:02.646 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.646 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.646 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.646 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174388 2024-04-26T11:15:02.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.647 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.647 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.647 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.647 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:02.647 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.647 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.647 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.647 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:02.647 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.647 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.647 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.647 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348231+0000", 2024-04-26T11:15:02.648 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.648 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.648 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.648 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348233+0000", 2024-04-26T11:15:02.648 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2249999999999999e-06 2024-04-26T11:15:02.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.648 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.648 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.648 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348238+0000", 2024-04-26T11:15:02.648 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1899999999999997e-06 2024-04-26T11:15:02.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.648 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.648 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.649 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348241+0000", 2024-04-26T11:15:02.649 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.965e-06 2024-04-26T11:15:02.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.649 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.649 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348264+0000", 2024-04-26T11:15:02.649 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3014e-05 2024-04-26T11:15:02.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.649 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.649 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348371+0000", 2024-04-26T11:15:02.649 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000106889 2024-04-26T11:15:02.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.650 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:02.650 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412126+0000", 2024-04-26T11:15:02.650 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063755495999999995 2024-04-26T11:15:02.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.650 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.650 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:02.650 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412165+0000", 2024-04-26T11:15:02.650 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9269e-05 2024-04-26T11:15:02.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.650 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.650 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:02.650 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412234+0000", 2024-04-26T11:15:02.650 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8337000000000007e-05 2024-04-26T11:15:02.650 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.650 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.651 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.651 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.651 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174390 5.1 5:81c54fd7:::benchmark_data_smithi029_44842_object29752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:02.651 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:02.651 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.220100111000001, 2024-04-26T11:15:02.651 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063635918, 2024-04-26T11:15:02.651 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.651 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:02.651 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.651 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.651 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.651 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174390 2024-04-26T11:15:02.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.652 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.652 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:02.652 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.652 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:02.652 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.652 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348346+0000", 2024-04-26T11:15:02.652 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.653 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.653 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348351+0000", 2024-04-26T11:15:02.653 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.442e-06 2024-04-26T11:15:02.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.653 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.653 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348357+0000", 2024-04-26T11:15:02.653 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9530000000000002e-06 2024-04-26T11:15:02.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.653 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.653 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348363+0000", 2024-04-26T11:15:02.653 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2129999999999999e-06 2024-04-26T11:15:02.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.654 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.654 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.654 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348396+0000", 2024-04-26T11:15:02.654 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3161999999999999e-05 2024-04-26T11:15:02.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.654 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.654 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.654 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348511+0000", 2024-04-26T11:15:02.654 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000115253 2024-04-26T11:15:02.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.654 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.654 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:02.654 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411857+0000", 2024-04-26T11:15:02.655 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063345431999999993 2024-04-26T11:15:02.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.655 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.655 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:02.655 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411904+0000", 2024-04-26T11:15:02.655 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7389000000000003e-05 2024-04-26T11:15:02.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.655 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.655 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:02.655 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411983+0000", 2024-04-26T11:15:02.655 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8750000000000003e-05 2024-04-26T11:15:02.655 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.655 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.655 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.656 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174394 5.3 5:c91ce5cb:::benchmark_data_smithi029_44842_object29756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:02.656 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:02.656 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.219997167000001, 2024-04-26T11:15:02.656 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062247626, 2024-04-26T11:15:02.656 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.656 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:02.656 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.656 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.656 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.656 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174394 2024-04-26T11:15:02.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.656 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.656 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.657 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:02.657 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.657 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.657 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:02.657 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.657 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.657 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348449+0000", 2024-04-26T11:15:02.657 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.657 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348457+0000", 2024-04-26T11:15:02.658 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9619999999999993e-06 2024-04-26T11:15:02.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.658 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348462+0000", 2024-04-26T11:15:02.658 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6569999999999996e-06 2024-04-26T11:15:02.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.658 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348465+0000", 2024-04-26T11:15:02.658 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2990000000000001e-06 2024-04-26T11:15:02.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.659 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.659 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408427+0000", 2024-04-26T11:15:02.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.059961423 2024-04-26T11:15:02.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.659 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.659 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408554+0000", 2024-04-26T11:15:02.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012779600000000001 2024-04-26T11:15:02.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.659 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:02.659 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410570+0000", 2024-04-26T11:15:02.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020152719999999998 2024-04-26T11:15:02.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.660 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.660 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:02.660 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410624+0000", 2024-04-26T11:15:02.660 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4211e-05 2024-04-26T11:15:02.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.660 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.660 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:02.660 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410697+0000", 2024-04-26T11:15:02.660 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3447000000000003e-05 2024-04-26T11:15:02.660 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.660 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.660 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.661 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.661 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174395 5.1 5:8ee7f1d3:::benchmark_data_smithi029_44842_object29757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:02.661 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:02.661 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.218967076, 2024-04-26T11:15:02.661 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062622744999999994, 2024-04-26T11:15:02.661 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.661 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:02.661 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.661 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.661 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.661 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174395 2024-04-26T11:15:02.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.662 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.662 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.662 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:02.662 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.662 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.662 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:02.662 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.662 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.663 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349479+0000", 2024-04-26T11:15:02.663 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.663 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.663 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349483+0000", 2024-04-26T11:15:02.663 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.54e-06 2024-04-26T11:15:02.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.663 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.663 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349488+0000", 2024-04-26T11:15:02.663 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5119999999999999e-06 2024-04-26T11:15:02.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.664 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.664 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349492+0000", 2024-04-26T11:15:02.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7170000000000002e-06 2024-04-26T11:15:02.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.664 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.664 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350187+0000", 2024-04-26T11:15:02.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00069535899999999999 2024-04-26T11:15:02.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.664 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.664 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350292+0000", 2024-04-26T11:15:02.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0001047 2024-04-26T11:15:02.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.665 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:02.665 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411992+0000", 2024-04-26T11:15:02.665 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061699647000000003 2024-04-26T11:15:02.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.665 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:02.665 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412030+0000", 2024-04-26T11:15:02.665 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8124999999999998e-05 2024-04-26T11:15:02.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.666 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:02.666 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412103+0000", 2024-04-26T11:15:02.666 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2733999999999999e-05 2024-04-26T11:15:02.666 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.666 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.666 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.666 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.666 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174396 5.7 5:e0fad05d:::benchmark_data_smithi029_44842_object29758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:02.666 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:02.666 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.218883437000001, 2024-04-26T11:15:02.666 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062445026000000001, 2024-04-26T11:15:02.666 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.666 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:02.667 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.667 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.667 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.667 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174396 2024-04-26T11:15:02.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.667 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.667 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.667 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.667 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:02.667 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.667 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.667 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.667 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:02.667 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.668 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.668 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:02.668 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.668 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.668 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349566+0000", 2024-04-26T11:15:02.668 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2490000000000001e-06 2024-04-26T11:15:02.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.668 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.668 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349573+0000", 2024-04-26T11:15:02.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.776e-06 2024-04-26T11:15:02.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349576+0000", 2024-04-26T11:15:02.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3629999999999998e-06 2024-04-26T11:15:02.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350396+0000", 2024-04-26T11:15:02.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00081992199999999995 2024-04-26T11:15:02.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350516+0000", 2024-04-26T11:15:02.670 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012006900000000001 2024-04-26T11:15:02.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.670 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:02.670 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411924+0000", 2024-04-26T11:15:02.670 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061407960999999997 2024-04-26T11:15:02.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.670 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:02.670 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411947+0000", 2024-04-26T11:15:02.670 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2943999999999999e-05 2024-04-26T11:15:02.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.670 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:02.671 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412008+0000", 2024-04-26T11:15:02.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1237999999999999e-05 2024-04-26T11:15:02.671 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.671 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.671 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.671 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174397 5.7 5:e25daf9a:::benchmark_data_smithi029_44842_object29759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:02.671 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:02.671 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.218775308, 2024-04-26T11:15:02.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063878565999999998, 2024-04-26T11:15:02.671 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.671 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:02.671 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:02.671 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:02.672 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.672 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174397 2024-04-26T11:15:02.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.672 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:02.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:02.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349671+0000", 2024-04-26T11:15:02.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349674+0000", 2024-04-26T11:15:02.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3360000000000002e-06 2024-04-26T11:15:02.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349678+0000", 2024-04-26T11:15:02.674 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0709999999999996e-06 2024-04-26T11:15:02.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.674 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.674 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349681+0000", 2024-04-26T11:15:02.674 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3139999999999999e-06 2024-04-26T11:15:02.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.674 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.674 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410371+0000", 2024-04-26T11:15:02.674 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.060690202999999998 2024-04-26T11:15:02.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.674 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.675 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410463+0000", 2024-04-26T11:15:02.675 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2095000000000005e-05 2024-04-26T11:15:02.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.675 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:02.675 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413471+0000", 2024-04-26T11:15:02.675 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0030073909999999999 2024-04-26T11:15:02.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.675 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:02.675 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413499+0000", 2024-04-26T11:15:02.675 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8725e-05 2024-04-26T11:15:02.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.675 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:02.676 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413550+0000", 2024-04-26T11:15:02.676 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0810000000000003e-05 2024-04-26T11:15:02.676 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.676 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.676 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.676 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:174398 5.4 e46/16 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head v 46'10798, mlcod=46'10796)", 2024-04-26T11:15:02.676 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:02.676 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 12.218247097000001, 2024-04-26T11:15:02.676 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062067047, 2024-04-26T11:15:02.676 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:02.677 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:02.677 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:02.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.677 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:02.677 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:02.677 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.677 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:02.677 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:02.677 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:02.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.677 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:02.677 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350199+0000", 2024-04-26T11:15:02.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.678 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:02.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350205+0000", 2024-04-26T11:15:02.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6749999999999999e-06 2024-04-26T11:15:02.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.678 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:02.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350212+0000", 2024-04-26T11:15:02.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7000000000000002e-06 2024-04-26T11:15:02.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.678 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.679 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350216+0000", 2024-04-26T11:15:02.679 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5120000000000002e-06 2024-04-26T11:15:02.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.679 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:02.679 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350246+0000", 2024-04-26T11:15:02.679 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9978999999999999e-05 2024-04-26T11:15:02.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.679 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:02.679 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350263+0000", 2024-04-26T11:15:02.679 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.702e-05 2024-04-26T11:15:02.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.679 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:02.680 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412238+0000", 2024-04-26T11:15:02.680 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061974603000000003 2024-04-26T11:15:02.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:02.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:02.680 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:02.680 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412267+0000", 2024-04-26T11:15:02.680 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9116e-05 2024-04-26T11:15:02.680 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.680 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.680 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.680 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:02.680 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:02.680 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:02.682 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:02.682 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:02.680+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:02.703 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:15:02.782 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:02.781+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:02.859 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:02.859 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:15:02.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.860 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:208361 5.f 5:fbe83ea3:::benchmark_data_smithi029_44842_object63723:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:15:02.860 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:02.853072+0000", 2024-04-26T11:15:02.860 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0048126389999999996, 2024-04-26T11:15:02.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048342460000000004, 2024-04-26T11:15:02.860 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:02.860 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:02.860 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:02.860 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:02.860 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.860 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 208361 2024-04-26T11:15:02.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.860 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:02.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:02.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853072+0000", 2024-04-26T11:15:02.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:02.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:02.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853072+0000", 2024-04-26T11:15:02.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:02.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.861 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:02.861 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853072+0000", 2024-04-26T11:15:02.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:02.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:02.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853077+0000", 2024-04-26T11:15:02.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3959999999999997e-06 2024-04-26T11:15:02.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:02.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853087+0000", 2024-04-26T11:15:02.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0244000000000001e-05 2024-04-26T11:15:02.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853095+0000", 2024-04-26T11:15:02.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1440000000000003e-06 2024-04-26T11:15:02.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:02.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.855310+0000", 2024-04-26T11:15:02.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022149940000000001 2024-04-26T11:15:02.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:02.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.855444+0000", 2024-04-26T11:15:02.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013377899999999999 2024-04-26T11:15:02.863 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:02.863 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:02.863 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:02.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.864 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:208362 5.d 5:b984d630:::benchmark_data_smithi029_44842_object63724:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:15:02.864 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:02.853460+0000", 2024-04-26T11:15:02.864 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0044249670000000001, 2024-04-26T11:15:02.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044929210000000004, 2024-04-26T11:15:02.864 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:02.864 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:02.864 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:02.864 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:02.864 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.864 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 208362 2024-04-26T11:15:02.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.865 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:02.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:02.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853460+0000", 2024-04-26T11:15:02.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:02.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:02.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853460+0000", 2024-04-26T11:15:02.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:02.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:02.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853459+0000", 2024-04-26T11:15:02.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:02.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853463+0000", 2024-04-26T11:15:02.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4130000000000002e-06 2024-04-26T11:15:02.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:02.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853471+0000", 2024-04-26T11:15:02.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3100000000000001e-06 2024-04-26T11:15:02.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853477+0000", 2024-04-26T11:15:02.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3280000000000002e-06 2024-04-26T11:15:02.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:02.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853512+0000", 2024-04-26T11:15:02.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4589999999999999e-05 2024-04-26T11:15:02.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:02.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853612+0000", 2024-04-26T11:15:02.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9728999999999993e-05 2024-04-26T11:15:02.867 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:02.867 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:02.868 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:02.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.868 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:208363 5.0 5:00e1be55:::benchmark_data_smithi029_44842_object63725:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:15:02.868 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:02.853490+0000", 2024-04-26T11:15:02.868 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0043946009999999997, 2024-04-26T11:15:02.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045018870000000004, 2024-04-26T11:15:02.868 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:02.868 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:02.868 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:02.868 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:02.868 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.868 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 208363 2024-04-26T11:15:02.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.868 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:02.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:02.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853490+0000", 2024-04-26T11:15:02.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:02.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:02.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853490+0000", 2024-04-26T11:15:02.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:02.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:02.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853490+0000", 2024-04-26T11:15:02.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:02.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853493+0000", 2024-04-26T11:15:02.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9529999999999999e-06 2024-04-26T11:15:02.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:02.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853500+0000", 2024-04-26T11:15:02.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8560000000000001e-06 2024-04-26T11:15:02.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853505+0000", 2024-04-26T11:15:02.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2989999999999996e-06 2024-04-26T11:15:02.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:02.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853559+0000", 2024-04-26T11:15:02.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4067999999999998e-05 2024-04-26T11:15:02.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:02.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853681+0000", 2024-04-26T11:15:02.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000121741 2024-04-26T11:15:02.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:02.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853793+0000", 2024-04-26T11:15:02.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112345 2024-04-26T11:15:02.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:02.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.857857+0000", 2024-04-26T11:15:02.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040641560000000002 2024-04-26T11:15:02.872 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:02.872 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:02.872 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:02.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.872 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:208365 5.0 5:067d68b6:::benchmark_data_smithi029_44842_object63727:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:15:02.872 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:02.853608+0000", 2024-04-26T11:15:02.872 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0042765349999999997, 2024-04-26T11:15:02.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044364879999999997, 2024-04-26T11:15:02.872 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:02.873 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:02.873 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:02.873 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:02.873 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.873 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 208365 2024-04-26T11:15:02.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.873 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:02.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:02.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853608+0000", 2024-04-26T11:15:02.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:02.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:02.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853608+0000", 2024-04-26T11:15:02.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:02.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:02.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853608+0000", 2024-04-26T11:15:02.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:02.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853610+0000", 2024-04-26T11:15:02.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3709999999999998e-06 2024-04-26T11:15:02.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:02.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853618+0000", 2024-04-26T11:15:02.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3640000000000001e-06 2024-04-26T11:15:02.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.853623+0000", 2024-04-26T11:15:02.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3040000000000004e-06 2024-04-26T11:15:02.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:02.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.855898+0000", 2024-04-26T11:15:02.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022753019999999999 2024-04-26T11:15:02.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:02.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.856013+0000", 2024-04-26T11:15:02.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011430900000000001 2024-04-26T11:15:02.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:02.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.856111+0000", 2024-04-26T11:15:02.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8527e-05 2024-04-26T11:15:02.876 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:02.876 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:02.876 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:02.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.876 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:208366 5.d 5:bba52501:::benchmark_data_smithi029_44842_object63728:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:15:02.877 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:02.854707+0000", 2024-04-26T11:15:02.877 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0031774559999999999, 2024-04-26T11:15:02.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0033797319999999999, 2024-04-26T11:15:02.877 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:02.877 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:02.877 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:02.877 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:02.877 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.877 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 208366 2024-04-26T11:15:02.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.877 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:02.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:02.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.854707+0000", 2024-04-26T11:15:02.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:02.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:02.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.854707+0000", 2024-04-26T11:15:02.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:02.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:02.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.854707+0000", 2024-04-26T11:15:02.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:02.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.854710+0000", 2024-04-26T11:15:02.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4259999999999999e-06 2024-04-26T11:15:02.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:02.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.854720+0000", 2024-04-26T11:15:02.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6290000000000005e-06 2024-04-26T11:15:02.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.854727+0000", 2024-04-26T11:15:02.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7220000000000002e-06 2024-04-26T11:15:02.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:02.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.856309+0000", 2024-04-26T11:15:02.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0015826219999999999 2024-04-26T11:15:02.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:02.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.856445+0000", 2024-04-26T11:15:02.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013536000000000001 2024-04-26T11:15:02.880 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:02.880 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:02.880 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:02.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.880 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:208368 5.4 5:21f1bb53:::benchmark_data_smithi029_44842_object63730:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:15:02.881 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:02.854832+0000", 2024-04-26T11:15:02.881 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0030525090000000001, 2024-04-26T11:15:02.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003294253, 2024-04-26T11:15:02.881 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:02.881 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:02.881 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:02.881 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:02.881 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.881 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 208368 2024-04-26T11:15:02.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.881 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:02.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:02.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.854832+0000", 2024-04-26T11:15:02.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:02.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:02.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.854832+0000", 2024-04-26T11:15:02.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:02.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:02.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.854832+0000", 2024-04-26T11:15:02.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:02.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.854835+0000", 2024-04-26T11:15:02.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0000000000000001e-06 2024-04-26T11:15:02.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:02.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.854841+0000", 2024-04-26T11:15:02.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7420000000000003e-06 2024-04-26T11:15:02.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.854846+0000", 2024-04-26T11:15:02.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7459999999999997e-06 2024-04-26T11:15:02.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:02.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.854885+0000", 2024-04-26T11:15:02.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8352000000000001e-05 2024-04-26T11:15:02.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:02.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.855007+0000", 2024-04-26T11:15:02.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000121894 2024-04-26T11:15:02.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:02.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.855116+0000", 2024-04-26T11:15:02.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010915 2024-04-26T11:15:02.885 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:02.885 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:02.885 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:02.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.885 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:208370 5.9 5:9ed2ab69:::benchmark_data_smithi029_44842_object63732:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:15:02.885 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:02.855857+0000", 2024-04-26T11:15:02.885 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.002028223, 2024-04-26T11:15:02.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023113949999999999, 2024-04-26T11:15:02.885 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:02.885 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:02.885 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:02.885 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:02.886 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.886 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 208370 2024-04-26T11:15:02.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.886 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:02.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:02.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.855857+0000", 2024-04-26T11:15:02.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:02.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:02.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.855857+0000", 2024-04-26T11:15:02.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:02.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:02.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.855856+0000", 2024-04-26T11:15:02.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:02.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:02.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.855860+0000", 2024-04-26T11:15:02.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.109e-06 2024-04-26T11:15:02.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:02.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.855869+0000", 2024-04-26T11:15:02.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5220000000000007e-06 2024-04-26T11:15:02.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.855875+0000", 2024-04-26T11:15:02.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8000000000000001e-06 2024-04-26T11:15:02.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:02.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.855918+0000", 2024-04-26T11:15:02.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2209000000000002e-05 2024-04-26T11:15:02.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:02.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.856051+0000", 2024-04-26T11:15:02.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013300700000000001 2024-04-26T11:15:02.888 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:02.889 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:02.889 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:02.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.889 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:208371 5.4 5:235def78:::benchmark_data_smithi029_44842_object63733:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:15:02.889 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:02.857292+0000", 2024-04-26T11:15:02.889 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00059253599999999995, 2024-04-26T11:15:02.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00091598099999999996, 2024-04-26T11:15:02.889 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:02.889 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:02.889 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:02.889 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:02.889 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.889 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 208371 2024-04-26T11:15:02.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.890 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:02.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:02.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.857292+0000", 2024-04-26T11:15:02.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:02.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:02.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.857292+0000", 2024-04-26T11:15:02.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:02.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:02.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.857292+0000", 2024-04-26T11:15:02.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:02.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:02.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.857296+0000", 2024-04-26T11:15:02.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8790000000000002e-06 2024-04-26T11:15:02.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:02.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.857306+0000", 2024-04-26T11:15:02.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7389999999999994e-06 2024-04-26T11:15:02.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.857313+0000", 2024-04-26T11:15:02.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0369999999999997e-06 2024-04-26T11:15:02.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:02.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.857392+0000", 2024-04-26T11:15:02.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9263000000000003e-05 2024-04-26T11:15:02.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:02.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.857508+0000", 2024-04-26T11:15:02.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011520599999999999 2024-04-26T11:15:02.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:02.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.857611+0000", 2024-04-26T11:15:02.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103113 2024-04-26T11:15:02.893 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:02.893 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:02.893 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:02.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.893 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:208372 5.b 5:d0ef1714:::benchmark_data_smithi029_44842_object63734:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:15:02.893 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:02.857329+0000", 2024-04-26T11:15:02.893 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00055549099999999997, 2024-04-26T11:15:02.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00092347600000000001, 2024-04-26T11:15:02.893 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:02.893 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:02.893 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:02.893 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:02.894 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.894 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 208372 2024-04-26T11:15:02.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.894 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:02.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:02.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.857329+0000", 2024-04-26T11:15:02.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:02.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:02.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.857329+0000", 2024-04-26T11:15:02.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:02.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:02.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.857329+0000", 2024-04-26T11:15:02.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:02.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.857332+0000", 2024-04-26T11:15:02.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.875e-06 2024-04-26T11:15:02.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:02.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.857338+0000", 2024-04-26T11:15:02.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.083e-06 2024-04-26T11:15:02.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.857343+0000", 2024-04-26T11:15:02.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8520000000000003e-06 2024-04-26T11:15:02.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:02.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.857396+0000", 2024-04-26T11:15:02.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3149999999999998e-05 2024-04-26T11:15:02.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:02.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.857503+0000", 2024-04-26T11:15:02.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106705 2024-04-26T11:15:02.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:02.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.857603+0000", 2024-04-26T11:15:02.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100293 2024-04-26T11:15:02.897 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:02.897 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:02.897 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:02.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.897 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:208347 5.d 5:bea97e82:::benchmark_data_smithi029_44842_object63709:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:15:02.897 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:02.849039+0000", 2024-04-26T11:15:02.897 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0088455080000000002, 2024-04-26T11:15:02.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0092639269999999999, 2024-04-26T11:15:02.897 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:02.897 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:02.898 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:02.898 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:02.898 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:02.898 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 208347 2024-04-26T11:15:02.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.898 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:02.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:02.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.849039+0000", 2024-04-26T11:15:02.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:02.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:02.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.849039+0000", 2024-04-26T11:15:02.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:02.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:02.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.849039+0000", 2024-04-26T11:15:02.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:02.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:02.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.849041+0000", 2024-04-26T11:15:02.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.407e-06 2024-04-26T11:15:02.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:02.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.849048+0000", 2024-04-26T11:15:02.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4609999999999996e-06 2024-04-26T11:15:02.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:02.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.849053+0000", 2024-04-26T11:15:02.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2979999999999999e-06 2024-04-26T11:15:02.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:02.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.849094+0000", 2024-04-26T11:15:02.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0504999999999999e-05 2024-04-26T11:15:02.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:02.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.849233+0000", 2024-04-26T11:15:02.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013900800000000001 2024-04-26T11:15:02.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:02.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.858232+0000", 2024-04-26T11:15:02.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0089994069999999992 2024-04-26T11:15:02.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:02.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.858258+0000", 2024-04-26T11:15:02.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6194e-05 2024-04-26T11:15:02.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:02.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:02.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:02.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:02.858304+0000", 2024-04-26T11:15:02.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6006e-05 2024-04-26T11:15:02.902 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:02.902 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:02.902 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:02.902 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:02.902 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:15:02.902 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 10 2024-04-26T11:15:02.902 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:02.904 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:02.904 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:02.902+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:03.004 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:03.003+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:03.105 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:03.104+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:03.108 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:03.108 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:15:03.108 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:15:03.109 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:15:03.109 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:03.122 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:03.206 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:03.205+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:03.306 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~65s 2024-04-26T11:15:03.307 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:03.306+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:03.337 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:03.337 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:15:03.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:15:03.337 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:15:03.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.337 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:03.337 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:03.337 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 70.055508062000001, 2024-04-26T11:15:03.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:15:03.337 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:03.337 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:03.337 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:03.338 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:03.338 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:03.338 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:15:03.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.338 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:03.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:03.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:03.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:03.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:03.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:03.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:03.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:03.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:03.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:15:03.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:15:03.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:03.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:15:03.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:15:03.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:15:03.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:15:03.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:15:03.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:15:03.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:03.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:15:03.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:15:03.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:03.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:15:03.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:15:03.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:03.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:15:03.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:15:03.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:03.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:15:03.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:15:03.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:03.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:15:03.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:15:03.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:03.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:15:03.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:15:03.343 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.343 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:03.343 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.343 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:03.343 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:03.343 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 70.054858359999997, 2024-04-26T11:15:03.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:15:03.343 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:03.343 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:03.343 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:03.343 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:03.343 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:03.344 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:15:03.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.344 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:03.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:03.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:03.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:03.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:03.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:03.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:15:03.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:03.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:03.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:15:03.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:15:03.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:03.345 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:15:03.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:15:03.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.345 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:15:03.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:15:03.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:15:03.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:15:03.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:03.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:15:03.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:15:03.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:03.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:15:03.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:15:03.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:03.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:15:03.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:15:03.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:03.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:15:03.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:15:03.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:03.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:15:03.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:15:03.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:03.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:15:03.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:15:03.348 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.348 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:03.348 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.349 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:03.349 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:03.349 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.988216320999996, 2024-04-26T11:15:03.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:15:03.349 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:03.349 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:03.349 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:03.349 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:03.349 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:03.349 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:15:03.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.349 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:03.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:03.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:03.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:03.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:03.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.350 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:03.350 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:15:03.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:03.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:03.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:15:03.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:15:03.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:03.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:15:03.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:15:03.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:15:03.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:15:03.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:15:03.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:15:03.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:03.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:15:03.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:15:03.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:15:03.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:15:03.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:03.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:15:03.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:15:03.353 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.353 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:03.353 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.353 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:03.353 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:03.353 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.988120675000005, 2024-04-26T11:15:03.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:15:03.354 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:03.354 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:03.354 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:03.354 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:03.354 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:03.354 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:15:03.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.354 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:03.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:03.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:03.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:03.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:03.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:03.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:15:03.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:03.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:03.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:15:03.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:15:03.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:03.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:15:03.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:15:03.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:15:03.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:15:03.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:15:03.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:15:03.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:03.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:15:03.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:15:03.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:15:03.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:15:03.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:03.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:15:03.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:15:03.357 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.358 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:03.358 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.358 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:03.358 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:03.358 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.987988995999999, 2024-04-26T11:15:03.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:15:03.358 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:03.358 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:03.358 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:03.358 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:03.358 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:03.359 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:15:03.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.359 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:03.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:03.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:03.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:03.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:03.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:03.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:03.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:03.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:03.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:15:03.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:15:03.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:03.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:15:03.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:15:03.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.360 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:15:03.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:15:03.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:15:03.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:15:03.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:03.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:15:03.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:15:03.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:15:03.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:15:03.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:03.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:15:03.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:15:03.362 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.362 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:03.362 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.362 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:03.363 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:03.363 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.987880540000006, 2024-04-26T11:15:03.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:15:03.363 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:03.363 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:03.363 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:03.363 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:03.363 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:03.363 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:15:03.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.363 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:03.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:03.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:03.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:03.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:03.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:03.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:15:03.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:03.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:03.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:15:03.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:15:03.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:03.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:15:03.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:15:03.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:15:03.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:15:03.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:15:03.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:15:03.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:03.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:15:03.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:15:03.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:15:03.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:15:03.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:03.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:15:03.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:15:03.367 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.367 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:03.367 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.367 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:03.367 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:03.368 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.987779271999997, 2024-04-26T11:15:03.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:15:03.368 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:03.368 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:03.368 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:03.368 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:03.368 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:03.368 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:15:03.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.368 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:03.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:03.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:03.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:03.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:03.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:03.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:03.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:03.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:03.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:15:03.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:15:03.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:03.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:15:03.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:15:03.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:15:03.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:15:03.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:15:03.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:15:03.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:03.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:15:03.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:15:03.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:15:03.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:15:03.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:03.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:15:03.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:15:03.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:03.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:15:03.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:15:03.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:03.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:15:03.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:15:03.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:03.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:15:03.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:15:03.373 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.373 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:03.373 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.373 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:03.373 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:03.373 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.987710331000002, 2024-04-26T11:15:03.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:15:03.373 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:03.373 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:03.373 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:03.374 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:03.374 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:03.374 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:15:03.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.374 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:03.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:03.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:03.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:03.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:03.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:03.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:15:03.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:03.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:03.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:15:03.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:15:03.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:03.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:15:03.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:15:03.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:15:03.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:15:03.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:15:03.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:15:03.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:03.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:15:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:15:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:15:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:15:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:15:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:15:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:15:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:15:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:15:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:15:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:15:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:15:03.378 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.981714749999995, 2024-04-26T11:15:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:15:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:15:03.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:15:03.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:15:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:15:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:15:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:15:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:15:03.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:15:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:15:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:15:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:15:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:15:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:15:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:15:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:15:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:15:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:15:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:15:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:15:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:15:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:15:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:15:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101754 5.e 5:7ca15a5c:::benchmark_data_smithi029_44842_object101753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:03.384 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 44.215767008, 2024-04-26T11:15:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039171048999999999, 2024-04-26T11:15:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101754 2024-04-26T11:15:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118604+0000", 2024-04-26T11:15:03.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3399000000000007e-05 2024-04-26T11:15:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118613+0000", 2024-04-26T11:15:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6989999999999992e-06 2024-04-26T11:15:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118618+0000", 2024-04-26T11:15:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3850000000000001e-06 2024-04-26T11:15:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118646+0000", 2024-04-26T11:15:03.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7878e-05 2024-04-26T11:15:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118720+0000", 2024-04-26T11:15:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3461999999999996e-05 2024-04-26T11:15:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118807+0000", 2024-04-26T11:15:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7269999999999996e-05 2024-04-26T11:15:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142317+0000", 2024-04-26T11:15:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023510105999999999 2024-04-26T11:15:03.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.143287+0000", 2024-04-26T11:15:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096983599999999996 2024-04-26T11:15:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157662+0000", 2024-04-26T11:15:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014375393 2024-04-26T11:15:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:03.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157702+0000", 2024-04-26T11:15:03.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0295e-05 2024-04-26T11:15:03.390 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.390 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:03.390 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.390 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101755 5.f 5:fa973a83:::benchmark_data_smithi029_44842_object101754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:03.390 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:15:03.390 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 44.215601311999997, 2024-04-26T11:15:03.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039139064000000001, 2024-04-26T11:15:03.391 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:03.391 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:03.391 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:03.391 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:03.391 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:03.391 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101755 2024-04-26T11:15:03.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.391 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:03.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:03.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:15:03.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:03.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:15:03.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:03.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118696+0000", 2024-04-26T11:15:03.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:03.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:03.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118766+0000", 2024-04-26T11:15:03.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9423000000000003e-05 2024-04-26T11:15:03.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:03.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118774+0000", 2024-04-26T11:15:03.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9710000000000004e-06 2024-04-26T11:15:03.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118779+0000", 2024-04-26T11:15:03.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5629999999999999e-06 2024-04-26T11:15:03.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118817+0000", 2024-04-26T11:15:03.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7771000000000001e-05 2024-04-26T11:15:03.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:03.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118929+0000", 2024-04-26T11:15:03.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011222699999999999 2024-04-26T11:15:03.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:03.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157661+0000", 2024-04-26T11:15:03.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038731120000000001 2024-04-26T11:15:03.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:03.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157757+0000", 2024-04-26T11:15:03.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6910000000000006e-05 2024-04-26T11:15:03.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:03.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157836+0000", 2024-04-26T11:15:03.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8727999999999996e-05 2024-04-26T11:15:03.395 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.395 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:03.395 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.395 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101758 5.4 5:2525a4eb:::benchmark_data_smithi029_44842_object101757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:03.395 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:15:03.396 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 44.213418461000003, 2024-04-26T11:15:03.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.03686739, 2024-04-26T11:15:03.396 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:03.396 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:03.396 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:03.396 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:03.396 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:03.396 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101758 2024-04-26T11:15:03.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.396 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:03.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:03.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:15:03.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:03.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:15:03.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:03.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120879+0000", 2024-04-26T11:15:03.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:03.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:03.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120971+0000", 2024-04-26T11:15:03.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2133999999999996e-05 2024-04-26T11:15:03.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:03.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120977+0000", 2024-04-26T11:15:03.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5509999999999999e-06 2024-04-26T11:15:03.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120981+0000", 2024-04-26T11:15:03.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.245e-06 2024-04-26T11:15:03.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121010+0000", 2024-04-26T11:15:03.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9084000000000001e-05 2024-04-26T11:15:03.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:03.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121083+0000", 2024-04-26T11:15:03.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2942999999999996e-05 2024-04-26T11:15:03.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:03.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121163+0000", 2024-04-26T11:15:03.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0197000000000005e-05 2024-04-26T11:15:03.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:03.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142822+0000", 2024-04-26T11:15:03.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021658535999999999 2024-04-26T11:15:03.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:03.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157674+0000", 2024-04-26T11:15:03.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014851573999999999 2024-04-26T11:15:03.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:03.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157714+0000", 2024-04-26T11:15:03.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0473999999999999e-05 2024-04-26T11:15:03.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:03.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157747+0000", 2024-04-26T11:15:03.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3278999999999998e-05 2024-04-26T11:15:03.400 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.400 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:03.401 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.401 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101760 5.4 5:2510211a:::benchmark_data_smithi029_44842_object101759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:03.401 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:03.401 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 44.212986116000003, 2024-04-26T11:15:03.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039182383000000001, 2024-04-26T11:15:03.401 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:03.401 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:03.401 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:03.401 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:03.402 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:03.402 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101760 2024-04-26T11:15:03.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.402 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:03.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.402 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:03.402 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:03.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.402 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:03.402 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:03.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:03.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:03.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:03.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:03.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121389+0000", 2024-04-26T11:15:03.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6667000000000003e-05 2024-04-26T11:15:03.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:03.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121394+0000", 2024-04-26T11:15:03.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0839999999999999e-06 2024-04-26T11:15:03.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121397+0000", 2024-04-26T11:15:03.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4489999999999999e-06 2024-04-26T11:15:03.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122921+0000", 2024-04-26T11:15:03.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001524067 2024-04-26T11:15:03.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:03.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.123010+0000", 2024-04-26T11:15:03.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8449000000000006e-05 2024-04-26T11:15:03.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:03.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140838+0000", 2024-04-26T11:15:03.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017828796000000001 2024-04-26T11:15:03.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:03.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157665+0000", 2024-04-26T11:15:03.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016826574 2024-04-26T11:15:03.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.406 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:03.406 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160407+0000", 2024-04-26T11:15:03.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027423970000000002 2024-04-26T11:15:03.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.406 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:03.406 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160456+0000", 2024-04-26T11:15:03.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8678999999999999e-05 2024-04-26T11:15:03.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.406 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:03.406 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160495+0000", 2024-04-26T11:15:03.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8658000000000002e-05 2024-04-26T11:15:03.407 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.407 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:03.407 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.407 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101761 5.e 5:70294421:::benchmark_data_smithi029_44842_object101760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:03.407 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:15:03.407 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 44.211561742999997, 2024-04-26T11:15:03.407 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035270448000000003, 2024-04-26T11:15:03.407 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:03.407 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:03.407 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:03.407 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:03.407 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:03.407 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101761 2024-04-26T11:15:03.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.408 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:03.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:03.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:15:03.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:03.408 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:15:03.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.408 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:03.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122736+0000", 2024-04-26T11:15:03.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:03.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:03.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122805+0000", 2024-04-26T11:15:03.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9076000000000001e-05 2024-04-26T11:15:03.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:03.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122811+0000", 2024-04-26T11:15:03.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:15:03.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122815+0000", 2024-04-26T11:15:03.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2860000000000001e-06 2024-04-26T11:15:03.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122842+0000", 2024-04-26T11:15:03.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6429000000000001e-05 2024-04-26T11:15:03.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:03.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122916+0000", 2024-04-26T11:15:03.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4122999999999995e-05 2024-04-26T11:15:03.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:03.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122997+0000", 2024-04-26T11:15:03.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1428999999999996e-05 2024-04-26T11:15:03.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:03.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142344+0000", 2024-04-26T11:15:03.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019346452 2024-04-26T11:15:03.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:03.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157934+0000", 2024-04-26T11:15:03.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015589911999999999 2024-04-26T11:15:03.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:03.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157975+0000", 2024-04-26T11:15:03.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1604999999999999e-05 2024-04-26T11:15:03.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.412 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:03.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.158007+0000", 2024-04-26T11:15:03.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1921000000000002e-05 2024-04-26T11:15:03.412 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.412 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:03.412 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.412 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110145 5.9 5:9b275f16:::benchmark_data_smithi029_44842_object110144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:15:03.412 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:15:03.412 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 40.186000104999998, 2024-04-26T11:15:03.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032844496000000001, 2024-04-26T11:15:03.413 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:03.413 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:03.413 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:03.413 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:03.413 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:03.413 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110145 2024-04-26T11:15:03.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.413 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:03.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.413 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:03.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:15:03.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:03.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:15:03.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:03.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148297+0000", 2024-04-26T11:15:03.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:03.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:03.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148325+0000", 2024-04-26T11:15:03.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7511000000000001e-05 2024-04-26T11:15:03.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:03.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148338+0000", 2024-04-26T11:15:03.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2808e-05 2024-04-26T11:15:03.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148345+0000", 2024-04-26T11:15:03.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7200000000000006e-06 2024-04-26T11:15:03.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149888+0000", 2024-04-26T11:15:03.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001542666 2024-04-26T11:15:03.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:03.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149977+0000", 2024-04-26T11:15:03.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9247999999999997e-05 2024-04-26T11:15:03.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:03.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181006+0000", 2024-04-26T11:15:03.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031028535999999999 2024-04-26T11:15:03.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:03.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181051+0000", 2024-04-26T11:15:03.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5393999999999999e-05 2024-04-26T11:15:03.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:03.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181143+0000", 2024-04-26T11:15:03.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1458000000000004e-05 2024-04-26T11:15:03.417 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.417 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:03.417 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.417 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110155 5.9 5:9ebc6158:::benchmark_data_smithi029_44842_object110154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:15:03.417 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:15:03.417 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 40.180924312999998, 2024-04-26T11:15:03.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027886826999999999, 2024-04-26T11:15:03.417 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:03.417 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:03.418 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:03.418 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:03.418 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:03.418 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110155 2024-04-26T11:15:03.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.418 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:03.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:03.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:15:03.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:03.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:15:03.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:03.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153373+0000", 2024-04-26T11:15:03.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:03.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:03.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153479+0000", 2024-04-26T11:15:03.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105728 2024-04-26T11:15:03.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.419 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:03.419 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153491+0000", 2024-04-26T11:15:03.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2207e-05 2024-04-26T11:15:03.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153499+0000", 2024-04-26T11:15:03.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7729999999999999e-06 2024-04-26T11:15:03.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153655+0000", 2024-04-26T11:15:03.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015573 2024-04-26T11:15:03.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:03.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153770+0000", 2024-04-26T11:15:03.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011562500000000001 2024-04-26T11:15:03.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:03.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181153+0000", 2024-04-26T11:15:03.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027382113 2024-04-26T11:15:03.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:03.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181195+0000", 2024-04-26T11:15:03.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1921000000000001e-05 2024-04-26T11:15:03.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:03.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181261+0000", 2024-04-26T11:15:03.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6402999999999994e-05 2024-04-26T11:15:03.422 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.422 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:03.422 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.422 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174398 5.4 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:03.422 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:03.423 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.984408101, 2024-04-26T11:15:03.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.064773789999999998, 2024-04-26T11:15:03.423 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:03.423 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:03.423 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:03.423 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:03.423 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:03.423 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174398 2024-04-26T11:15:03.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.423 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:03.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:03.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:03.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:03.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:03.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:03.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349889+0000", 2024-04-26T11:15:03.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:03.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:03.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349895+0000", 2024-04-26T11:15:03.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4519999999999996e-06 2024-04-26T11:15:03.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:03.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349909+0000", 2024-04-26T11:15:03.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3791000000000001e-05 2024-04-26T11:15:03.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349919+0000", 2024-04-26T11:15:03.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0135999999999999e-05 2024-04-26T11:15:03.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349956+0000", 2024-04-26T11:15:03.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7642000000000003e-05 2024-04-26T11:15:03.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:03.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350080+0000", 2024-04-26T11:15:03.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123285 2024-04-26T11:15:03.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:03.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350192+0000", 2024-04-26T11:15:03.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112509 2024-04-26T11:15:03.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:03.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356232+0000", 2024-04-26T11:15:03.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060403339999999996 2024-04-26T11:15:03.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:03.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414616+0000", 2024-04-26T11:15:03.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.058383156999999998 2024-04-26T11:15:03.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:03.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414643+0000", 2024-04-26T11:15:03.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7317e-05 2024-04-26T11:15:03.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:03.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414664+0000", 2024-04-26T11:15:03.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1135999999999999e-05 2024-04-26T11:15:03.428 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.428 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:03.428 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.428 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174402 5.b 5:d8ad746d:::benchmark_data_smithi029_44842_object29764:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:03.429 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:03.429 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.980453912, 2024-04-26T11:15:03.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059017657000000001, 2024-04-26T11:15:03.429 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:03.429 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:03.429 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:03.429 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:03.429 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:03.429 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174402 2024-04-26T11:15:03.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.430 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:03.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:03.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:03.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:03.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:03.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:03.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:03.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:03.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:03.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353848+0000", 2024-04-26T11:15:03.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5040000000000004e-06 2024-04-26T11:15:03.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:03.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353858+0000", 2024-04-26T11:15:03.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7410000000000004e-06 2024-04-26T11:15:03.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353864+0000", 2024-04-26T11:15:03.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7899999999999996e-06 2024-04-26T11:15:03.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353902+0000", 2024-04-26T11:15:03.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8325000000000003e-05 2024-04-26T11:15:03.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:03.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353980+0000", 2024-04-26T11:15:03.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8077000000000005e-05 2024-04-26T11:15:03.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:03.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354046+0000", 2024-04-26T11:15:03.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6249999999999998e-05 2024-04-26T11:15:03.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:03.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356532+0000", 2024-04-26T11:15:03.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024850969999999999 2024-04-26T11:15:03.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412796+0000", 2024-04-26T11:15:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056264616000000003 2024-04-26T11:15:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412835+0000", 2024-04-26T11:15:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8863999999999999e-05 2024-04-26T11:15:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412862+0000", 2024-04-26T11:15:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7124e-05 2024-04-26T11:15:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.434 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174403 5.4 5:2d30cd6a:::benchmark_data_smithi029_44842_object29765:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:15:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.980426709, 2024-04-26T11:15:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.060873365999999998, 2024-04-26T11:15:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174403 2024-04-26T11:15:03.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:15:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:15:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:03.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353871+0000", 2024-04-26T11:15:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353874+0000", 2024-04-26T11:15:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869999999999999e-06 2024-04-26T11:15:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353881+0000", 2024-04-26T11:15:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2239999999999998e-06 2024-04-26T11:15:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353886+0000", 2024-04-26T11:15:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.259e-06 2024-04-26T11:15:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353912+0000", 2024-04-26T11:15:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6404999999999999e-05 2024-04-26T11:15:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353991+0000", 2024-04-26T11:15:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8104999999999998e-05 2024-04-26T11:15:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354055+0000", 2024-04-26T11:15:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4875999999999993e-05 2024-04-26T11:15:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.358000+0000", 2024-04-26T11:15:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039442629999999999 2024-04-26T11:15:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414690+0000", 2024-04-26T11:15:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056689940000000001 2024-04-26T11:15:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:03.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414714+0000", 2024-04-26T11:15:03.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4527000000000001e-05 2024-04-26T11:15:03.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:03.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414745+0000", 2024-04-26T11:15:03.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0874999999999998e-05 2024-04-26T11:15:03.440 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.440 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:03.440 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.440 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174404 5.4 5:2801f1e1:::benchmark_data_smithi029_44842_object29766:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:03.440 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:15:03.440 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 12.977809785, 2024-04-26T11:15:03.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059745741999999998, 2024-04-26T11:15:03.441 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:03.441 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:03.441 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:03.441 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:03.441 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:03.441 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174404 2024-04-26T11:15:03.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.441 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:03.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:03.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:15:03.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:03.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:15:03.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:03.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:03.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356488+0000", 2024-04-26T11:15:03.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:03.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:03.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356492+0000", 2024-04-26T11:15:03.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1169999999999997e-06 2024-04-26T11:15:03.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:03.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356502+0000", 2024-04-26T11:15:03.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0263e-05 2024-04-26T11:15:03.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356508+0000", 2024-04-26T11:15:03.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5890000000000002e-06 2024-04-26T11:15:03.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:03.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356545+0000", 2024-04-26T11:15:03.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7382999999999998e-05 2024-04-26T11:15:03.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:03.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356671+0000", 2024-04-26T11:15:03.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012535500000000001 2024-04-26T11:15:03.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:03.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356789+0000", 2024-04-26T11:15:03.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000118099 2024-04-26T11:15:03.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:03.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.359200+0000", 2024-04-26T11:15:03.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024110059999999998 2024-04-26T11:15:03.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:03.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416180+0000", 2024-04-26T11:15:03.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056980335999999999 2024-04-26T11:15:03.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:03.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416204+0000", 2024-04-26T11:15:03.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4301e-05 2024-04-26T11:15:03.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:03.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:03.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:03.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416234+0000", 2024-04-26T11:15:03.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9903000000000002e-05 2024-04-26T11:15:03.446 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.446 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:03.446 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.446 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:03.446 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:03.446 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:03.447 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:03.446+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:03.448 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:03.548 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:03.547+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:03.629 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:03.630 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:15:03.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.630 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:210440 5.e e50/16 5:7a43ae16:::benchmark_data_smithi029_44842_object65802:head v 50'13086, mlcod=50'13084)", 2024-04-26T11:15:03.630 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:03.624072+0000", 2024-04-26T11:15:03.630 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0037654810000000002, 2024-04-26T11:15:03.630 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0037901190000000002, 2024-04-26T11:15:03.630 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:03.630 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:03.630 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:03.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624072+0000", 2024-04-26T11:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624072+0000", 2024-04-26T11:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:03.632 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624071+0000", 2024-04-26T11:15:03.632 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:03.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.632 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.632 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:03.632 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624076+0000", 2024-04-26T11:15:03.632 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0699999999999997e-06 2024-04-26T11:15:03.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.632 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.632 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:03.632 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624084+0000", 2024-04-26T11:15:03.632 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0800000000000006e-06 2024-04-26T11:15:03.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.633 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.633 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624089+0000", 2024-04-26T11:15:03.633 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1729999999999997e-06 2024-04-26T11:15:03.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.633 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:03.633 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624153+0000", 2024-04-26T11:15:03.633 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4089000000000003e-05 2024-04-26T11:15:03.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.633 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:03.634 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624172+0000", 2024-04-26T11:15:03.634 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9196999999999999e-05 2024-04-26T11:15:03.634 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:03.634 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:03.634 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:03.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.634 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:210443 5.8 e50/16 5:10034819:::benchmark_data_smithi029_44842_object65805:head v 50'13221, mlcod=50'13219)", 2024-04-26T11:15:03.634 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:03.624096+0000", 2024-04-26T11:15:03.634 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0037418220000000001, 2024-04-26T11:15:03.634 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0038316840000000001, 2024-04-26T11:15:03.634 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:03.635 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:03.635 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:03.635 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.635 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:03.635 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624096+0000", 2024-04-26T11:15:03.635 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:03.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.635 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.635 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:03.635 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624096+0000", 2024-04-26T11:15:03.635 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:03.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.635 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.636 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:03.636 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624096+0000", 2024-04-26T11:15:03.636 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967296 2024-04-26T11:15:03.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.636 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:03.636 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624098+0000", 2024-04-26T11:15:03.636 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3499999999999999e-06 2024-04-26T11:15:03.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.636 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:03.636 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624102+0000", 2024-04-26T11:15:03.636 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1080000000000003e-06 2024-04-26T11:15:03.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.637 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.637 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624105+0000", 2024-04-26T11:15:03.637 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5380000000000001e-06 2024-04-26T11:15:03.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.637 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:03.637 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624142+0000", 2024-04-26T11:15:03.637 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7293999999999999e-05 2024-04-26T11:15:03.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.637 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:03.637 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624162+0000", 2024-04-26T11:15:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9745000000000002e-05 2024-04-26T11:15:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:210442 5.0 e50/16 5:05060db9:::benchmark_data_smithi029_44842_object65804:head v 50'13363, mlcod=50'13361)", 2024-04-26T11:15:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:03.624109+0000", 2024-04-26T11:15:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0037283009999999998, 2024-04-26T11:15:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0038779790000000001, 2024-04-26T11:15:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:03.638 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624109+0000", 2024-04-26T11:15:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624109+0000", 2024-04-26T11:15:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624109+0000", 2024-04-26T11:15:03.639 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967296 2024-04-26T11:15:03.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.640 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.640 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:03.640 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624113+0000", 2024-04-26T11:15:03.640 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1919999999999998e-06 2024-04-26T11:15:03.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.640 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.640 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:03.640 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624118+0000", 2024-04-26T11:15:03.640 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2549999999999999e-06 2024-04-26T11:15:03.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.640 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.640 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.641 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624120+0000", 2024-04-26T11:15:03.641 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3659999999999999e-06 2024-04-26T11:15:03.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.641 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.641 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:03.641 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624160+0000", 2024-04-26T11:15:03.641 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0161999999999999e-05 2024-04-26T11:15:03.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.641 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.641 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:03.641 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624175+0000", 2024-04-26T11:15:03.641 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5285e-05 2024-04-26T11:15:03.642 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:03.642 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:03.642 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:03.642 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.642 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.642 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:210450 5.2 5:4d6c7062:::benchmark_data_smithi029_44842_object65812:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:15:03.642 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:03.624511+0000", 2024-04-26T11:15:03.642 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0033267119999999999, 2024-04-26T11:15:03.642 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0035363590000000002, 2024-04-26T11:15:03.642 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:03.642 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:03.642 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:03.642 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:03.643 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:03.643 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 210450 2024-04-26T11:15:03.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.643 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:03.643 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.643 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:03.643 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624511+0000", 2024-04-26T11:15:03.643 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:03.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.643 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.643 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:03.643 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624511+0000", 2024-04-26T11:15:03.643 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:03.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.644 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.644 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:03.644 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624510+0000", 2024-04-26T11:15:03.644 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:03.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.644 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.644 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:03.644 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624515+0000", 2024-04-26T11:15:03.644 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2440000000000001e-06 2024-04-26T11:15:03.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.644 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.644 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:03.644 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624529+0000", 2024-04-26T11:15:03.645 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.36e-05 2024-04-26T11:15:03.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.645 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.645 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624536+0000", 2024-04-26T11:15:03.645 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7039999999999994e-06 2024-04-26T11:15:03.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.645 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:03.645 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.625556+0000", 2024-04-26T11:15:03.645 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001019991 2024-04-26T11:15:03.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.646 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:03.646 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.625676+0000", 2024-04-26T11:15:03.646 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000119688 2024-04-26T11:15:03.646 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:03.646 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:03.646 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:03.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.646 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.646 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:210447 5.0 e50/16 5:01e6c1f2:::benchmark_data_smithi029_44842_object65809:head v 50'13364, mlcod=50'13361)", 2024-04-26T11:15:03.646 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:03.624513+0000", 2024-04-26T11:15:03.646 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0033244619999999998, 2024-04-26T11:15:03.646 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0036021790000000001, 2024-04-26T11:15:03.646 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:03.647 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:03.647 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:03.647 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.647 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:03.647 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624513+0000", 2024-04-26T11:15:03.647 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:03.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.647 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.647 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:03.647 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624513+0000", 2024-04-26T11:15:03.647 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:03.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.647 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.648 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:03.648 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624512+0000", 2024-04-26T11:15:03.648 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:03.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.648 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.648 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:03.648 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624518+0000", 2024-04-26T11:15:03.648 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3709999999999999e-06 2024-04-26T11:15:03.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.648 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.648 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:03.648 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624531+0000", 2024-04-26T11:15:03.648 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3198e-05 2024-04-26T11:15:03.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.649 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.649 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.624537+0000", 2024-04-26T11:15:03.649 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8050000000000003e-06 2024-04-26T11:15:03.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.649 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:03.649 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.625610+0000", 2024-04-26T11:15:03.649 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001073224 2024-04-26T11:15:03.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.649 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:03.649 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.625634+0000", 2024-04-26T11:15:03.649 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3476999999999999e-05 2024-04-26T11:15:03.650 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:03.650 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:03.650 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:03.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.650 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.650 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:210448 5.0 e50/16 5:01254480:::benchmark_data_smithi029_44842_object65810:head v 50'13365, mlcod=50'13361)", 2024-04-26T11:15:03.650 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:03.625980+0000", 2024-04-26T11:15:03.650 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0018578869999999999, 2024-04-26T11:15:03.650 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0021929929999999999, 2024-04-26T11:15:03.650 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:03.650 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:03.650 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:03.650 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.651 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:03.651 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.625980+0000", 2024-04-26T11:15:03.651 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:03.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.651 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.651 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:03.651 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.625980+0000", 2024-04-26T11:15:03.651 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:03.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.651 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.651 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:03.651 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.625979+0000", 2024-04-26T11:15:03.651 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:03.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.651 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:03.652 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.625995+0000", 2024-04-26T11:15:03.652 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6413999999999999e-05 2024-04-26T11:15:03.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:03.652 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.626006+0000", 2024-04-26T11:15:03.652 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0383999999999999e-05 2024-04-26T11:15:03.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.652 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.626012+0000", 2024-04-26T11:15:03.652 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0689999999999998e-06 2024-04-26T11:15:03.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.653 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:03.653 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.627356+0000", 2024-04-26T11:15:03.653 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001343976 2024-04-26T11:15:03.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.653 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:03.653 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.627374+0000", 2024-04-26T11:15:03.653 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8323000000000001e-05 2024-04-26T11:15:03.653 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:03.653 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:03.653 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:03.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.654 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.654 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:210449 5.8 e50/16 5:1a85bacb:::benchmark_data_smithi029_44842_object65811:head v 50'13222, mlcod=50'13219)", 2024-04-26T11:15:03.654 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:03.626019+0000", 2024-04-26T11:15:03.654 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0018183959999999999, 2024-04-26T11:15:03.654 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022116620000000001, 2024-04-26T11:15:03.654 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:03.654 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:03.654 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:03.654 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.654 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:03.654 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.626019+0000", 2024-04-26T11:15:03.654 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:03.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.654 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.655 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:03.655 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.626019+0000", 2024-04-26T11:15:03.655 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:03.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.655 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.655 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:03.655 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.626019+0000", 2024-04-26T11:15:03.655 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:03.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.655 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.655 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:03.655 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.626023+0000", 2024-04-26T11:15:03.655 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7189999999999999e-06 2024-04-26T11:15:03.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.626029+0000", 2024-04-26T11:15:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1240000000000002e-06 2024-04-26T11:15:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.626033+0000", 2024-04-26T11:15:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9160000000000003e-06 2024-04-26T11:15:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.627040+0000", 2024-04-26T11:15:03.656 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001007335 2024-04-26T11:15:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.627062+0000", 2024-04-26T11:15:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2323999999999998e-05 2024-04-26T11:15:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:210453 5.3 5:ce7409ae:::benchmark_data_smithi029_44842_object65815:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:15:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:03.626773+0000", 2024-04-26T11:15:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0010649889999999999, 2024-04-26T11:15:03.657 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0015177039999999999, 2024-04-26T11:15:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 210453 2024-04-26T11:15:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.626773+0000", 2024-04-26T11:15:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.626773+0000", 2024-04-26T11:15:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.626770+0000", 2024-04-26T11:15:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999981 2024-04-26T11:15:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.626777+0000", 2024-04-26T11:15:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.472e-06 2024-04-26T11:15:03.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.626792+0000", 2024-04-26T11:15:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4918e-05 2024-04-26T11:15:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.626801+0000", 2024-04-26T11:15:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3989999999999993e-06 2024-04-26T11:15:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:03.660 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.626851+0000", 2024-04-26T11:15:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.9903e-05 2024-04-26T11:15:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.627032+0000", 2024-04-26T11:15:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00018055299999999999 2024-04-26T11:15:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:210454 5.6 5:6425b7e9:::benchmark_data_smithi029_44842_object65816:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T11:15:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:03.626814+0000", 2024-04-26T11:15:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.001023609, 2024-04-26T11:15:03.661 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0015446730000000001, 2024-04-26T11:15:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 210454 2024-04-26T11:15:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.626814+0000", 2024-04-26T11:15:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.626814+0000", 2024-04-26T11:15:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.626814+0000", 2024-04-26T11:15:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.626816+0000", 2024-04-26T11:15:03.663 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3690000000000001e-06 2024-04-26T11:15:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.626824+0000", 2024-04-26T11:15:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5629999999999992e-06 2024-04-26T11:15:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.626832+0000", 2024-04-26T11:15:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1899999999999998e-06 2024-04-26T11:15:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:03.664 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.626881+0000", 2024-04-26T11:15:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.9119999999999997e-05 2024-04-26T11:15:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:03.627055+0000", 2024-04-26T11:15:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017409399999999999 2024-04-26T11:15:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:15:03.665 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 9 2024-04-26T11:15:03.665 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:03.667 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:03.667 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:03.665+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:03.700 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is set 2024-04-26T11:15:03.767 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:03.766+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:03.868 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:03.867+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:03.894 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:03.894 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:15:03.894 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:15:03.894 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:15:03.894 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:03.897 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:15:03.909 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:03.993 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:03.992+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:04.047 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:15:04.066 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:15:04.067 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:15:04.067 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:15:04.067 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:15:04.069 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:15:04.069 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:15:04.070 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:04.070+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:04.129 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:04.129 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:04.141 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:04.528 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:04.527+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:04.628 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:04.627+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:04.695 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:04.695 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:04.710 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:04.754 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:04.753+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:04.830 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:04.829+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:04.875 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:04.875 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:04.889 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:04.931 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:04.930+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:05.032 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:05.031+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:05.089 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:05.089 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:05.104 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:05.145 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:05.144+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:05.234 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:05.233+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:05.290 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:05.290 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:05.303 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:05.337 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:05.336+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:05.437 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:05.436+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:05.529 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:05.529 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:05.537 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:05.536+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:05.544 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:05.638 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:05.638+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:05.712 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:15:05.742 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:05.741+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:05.779 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:05.779 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:05.791 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:05.840 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:05.839+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:05.940 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:05.940+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:05.965 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:05.966 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:05.980 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:06.041 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:06.040+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:06.070 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:15:06.141 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:06.141+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:06.194 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:06.194 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:06.208 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:06.225 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:15:06.242 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:06.241+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:06.247 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:15:06.247 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:15:06.247 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:15:06.247 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:15:06.249 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:15:06.250 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:15:06.343 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:06.342+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:06.426 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:06.427 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:15:06.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:15:06.427 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:15:06.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.427 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:06.427 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:06.427 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.144107400999999, 2024-04-26T11:15:06.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:15:06.427 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:06.427 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:06.427 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:06.427 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:06.427 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.428 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:15:06.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.428 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:06.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:06.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:06.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:06.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:06.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:06.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:06.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:06.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:06.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:15:06.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:15:06.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:06.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:15:06.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:15:06.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:15:06.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:15:06.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:15:06.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:15:06.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:06.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:15:06.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:15:06.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:06.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:15:06.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:15:06.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:06.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:15:06.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:15:06.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:06.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:15:06.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:15:06.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:06.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:15:06.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:15:06.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:06.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:15:06.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:15:06.432 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.432 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:06.432 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.433 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:06.433 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:06.433 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.143457698999995, 2024-04-26T11:15:06.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:15:06.433 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:06.433 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:06.433 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:06.433 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:06.433 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.433 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:15:06.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.433 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:06.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:06.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:06.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:06.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:06.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:06.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:15:06.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:06.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:06.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:15:06.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:15:06.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:06.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:15:06.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:15:06.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:15:06.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:15:06.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:15:06.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:15:06.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:06.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:15:06.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:15:06.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:06.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:15:06.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:15:06.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:06.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:15:06.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:15:06.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:06.437 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:15:06.437 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:15:06.437 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.437 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.437 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:06.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:15:06.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:15:06.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.438 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:06.438 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:15:06.438 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:15:06.438 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.438 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:06.438 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.438 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.438 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.438 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:06.438 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:06.439 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.076815659999994, 2024-04-26T11:15:06.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:15:06.439 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:06.439 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:06.439 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:06.439 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:06.439 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.439 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:15:06.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.439 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:06.439 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.439 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:06.439 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:06.439 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.439 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:06.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:06.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:06.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:15:06.440 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:06.440 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.440 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.440 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:06.440 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:15:06.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:15:06.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:06.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:15:06.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:15:06.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.441 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:15:06.441 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:15:06.441 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.441 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.441 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:15:06.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:15:06.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:06.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:15:06.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:15:06.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.442 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.442 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:15:06.442 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:15:06.442 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.442 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.443 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:06.443 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:15:06.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:15:06.443 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.443 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:06.443 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.443 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.443 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.443 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:06.443 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:06.443 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.076720014000003, 2024-04-26T11:15:06.443 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:15:06.443 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:06.443 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:06.444 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:06.444 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:06.444 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.444 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:15:06.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.444 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:06.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:06.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:06.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.444 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.444 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.444 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:06.444 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:06.444 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:06.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:15:06.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:06.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:06.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:15:06.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:15:06.445 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.445 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.445 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:06.445 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:15:06.445 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:15:06.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:15:06.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:15:06.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:15:06.446 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:15:06.446 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.446 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.446 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:06.446 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:15:06.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:15:06.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:15:06.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:15:06.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.447 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.447 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:06.447 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:15:06.447 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:15:06.447 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.447 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:06.447 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.447 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.448 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:06.448 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:06.448 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.076588334999997, 2024-04-26T11:15:06.448 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:15:06.448 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:06.448 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:06.448 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:06.448 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:06.448 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.448 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:15:06.448 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.448 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:06.448 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.448 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:06.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:06.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:06.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:06.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:06.449 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:06.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:06.449 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.449 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:06.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:15:06.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:15:06.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:06.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:15:06.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:15:06.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:15:06.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:15:06.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:15:06.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:15:06.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:06.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:15:06.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:15:06.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:15:06.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:15:06.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:06.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:15:06.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:15:06.452 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.452 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:06.452 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.452 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:06.452 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:06.452 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.076479879000004, 2024-04-26T11:15:06.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:15:06.453 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:06.453 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:06.453 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:06.453 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:06.453 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.453 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:15:06.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.453 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:06.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:06.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:06.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:06.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:06.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:06.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:15:06.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:06.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:06.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:15:06.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:15:06.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:06.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:15:06.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:15:06.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:15:06.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:15:06.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:15:06.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:15:06.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:06.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:15:06.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:15:06.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:15:06.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:15:06.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:06.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:15:06.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:15:06.457 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.457 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:06.457 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.457 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:06.457 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:06.457 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.076378610999996, 2024-04-26T11:15:06.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:15:06.458 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:06.458 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:06.458 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:06.458 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:06.458 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.458 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:15:06.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.458 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:06.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:06.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:06.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:06.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:06.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:06.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:06.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:06.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:06.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:15:06.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:15:06.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:06.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:15:06.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:15:06.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:15:06.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:15:06.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:15:06.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:15:06.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:06.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:15:06.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:15:06.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:15:06.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:15:06.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:06.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:15:06.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:15:06.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:06.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:15:06.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:15:06.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:06.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:15:06.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:15:06.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:06.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:15:06.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:15:06.462 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.463 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:06.463 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.463 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:06.463 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:06.463 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.076309670000001, 2024-04-26T11:15:06.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:15:06.463 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:06.463 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:06.463 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:06.463 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:06.463 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.463 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:15:06.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.464 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:06.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:06.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:06.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:06.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:06.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:06.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:15:06.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:06.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:06.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:15:06.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:15:06.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:06.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:15:06.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:15:06.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.465 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:15:06.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:15:06.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:15:06.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:15:06.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:06.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:15:06.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:15:06.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:15:06.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:15:06.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:06.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:15:06.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:15:06.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:06.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:15:06.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:15:06.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:06.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:15:06.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:15:06.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:06.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:15:06.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:15:06.468 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.468 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:06.468 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.468 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:06.468 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:06.468 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 69.070314088999993, 2024-04-26T11:15:06.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:15:06.469 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:06.469 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:06.469 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:06.469 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:06.469 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.469 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:15:06.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.469 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:06.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:06.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:06.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:06.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:06.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:06.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:15:06.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:06.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:06.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:15:06.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:15:06.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:06.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:15:06.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:15:06.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:15:06.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:15:06.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:15:06.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:15:06.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:06.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:15:06.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:15:06.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:15:06.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:15:06.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:06.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:15:06.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:15:06.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:06.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:15:06.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:15:06.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:06.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:15:06.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:15:06.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:06.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:15:06.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:15:06.473 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.473 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:06.474 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.474 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101754 5.e 5:7ca15a5c:::benchmark_data_smithi029_44842_object101753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:06.474 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:06.474 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.304366346999998, 2024-04-26T11:15:06.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039171048999999999, 2024-04-26T11:15:06.474 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:06.474 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:06.474 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:06.474 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:06.474 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.474 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101754 2024-04-26T11:15:06.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.474 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:06.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:06.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:06.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:06.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:06.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:06.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:06.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:06.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:06.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118604+0000", 2024-04-26T11:15:06.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3399000000000007e-05 2024-04-26T11:15:06.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:06.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118613+0000", 2024-04-26T11:15:06.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6989999999999992e-06 2024-04-26T11:15:06.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118618+0000", 2024-04-26T11:15:06.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3850000000000001e-06 2024-04-26T11:15:06.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118646+0000", 2024-04-26T11:15:06.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7878e-05 2024-04-26T11:15:06.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:06.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118720+0000", 2024-04-26T11:15:06.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3461999999999996e-05 2024-04-26T11:15:06.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:06.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118807+0000", 2024-04-26T11:15:06.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7269999999999996e-05 2024-04-26T11:15:06.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:06.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142317+0000", 2024-04-26T11:15:06.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023510105999999999 2024-04-26T11:15:06.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:06.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.143287+0000", 2024-04-26T11:15:06.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096983599999999996 2024-04-26T11:15:06.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.478 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:06.478 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157662+0000", 2024-04-26T11:15:06.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014375393 2024-04-26T11:15:06.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:06.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157702+0000", 2024-04-26T11:15:06.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0295e-05 2024-04-26T11:15:06.479 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.479 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:06.479 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.479 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101755 5.f 5:fa973a83:::benchmark_data_smithi029_44842_object101754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:06.479 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:15:06.479 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.304200651000002, 2024-04-26T11:15:06.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039139064000000001, 2024-04-26T11:15:06.479 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:06.480 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:06.480 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:06.480 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:06.480 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.480 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101755 2024-04-26T11:15:06.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.480 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:06.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:06.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:15:06.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:06.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:15:06.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:06.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118696+0000", 2024-04-26T11:15:06.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:06.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:06.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118766+0000", 2024-04-26T11:15:06.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9423000000000003e-05 2024-04-26T11:15:06.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:06.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118774+0000", 2024-04-26T11:15:06.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9710000000000004e-06 2024-04-26T11:15:06.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118779+0000", 2024-04-26T11:15:06.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5629999999999999e-06 2024-04-26T11:15:06.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118817+0000", 2024-04-26T11:15:06.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7771000000000001e-05 2024-04-26T11:15:06.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:06.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118929+0000", 2024-04-26T11:15:06.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011222699999999999 2024-04-26T11:15:06.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:06.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157661+0000", 2024-04-26T11:15:06.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038731120000000001 2024-04-26T11:15:06.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:06.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157757+0000", 2024-04-26T11:15:06.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6910000000000006e-05 2024-04-26T11:15:06.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:06.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157836+0000", 2024-04-26T11:15:06.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8727999999999996e-05 2024-04-26T11:15:06.484 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.484 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:06.484 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.484 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101758 5.4 5:2525a4eb:::benchmark_data_smithi029_44842_object101757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:06.485 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:15:06.485 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.302017800000002, 2024-04-26T11:15:06.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.03686739, 2024-04-26T11:15:06.485 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:06.485 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:06.485 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:06.485 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:06.485 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.485 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101758 2024-04-26T11:15:06.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.485 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:06.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:06.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:15:06.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:06.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:15:06.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:06.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120879+0000", 2024-04-26T11:15:06.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:06.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:06.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120971+0000", 2024-04-26T11:15:06.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2133999999999996e-05 2024-04-26T11:15:06.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:06.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120977+0000", 2024-04-26T11:15:06.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5509999999999999e-06 2024-04-26T11:15:06.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120981+0000", 2024-04-26T11:15:06.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.245e-06 2024-04-26T11:15:06.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121010+0000", 2024-04-26T11:15:06.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9084000000000001e-05 2024-04-26T11:15:06.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:06.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121083+0000", 2024-04-26T11:15:06.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2942999999999996e-05 2024-04-26T11:15:06.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:06.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121163+0000", 2024-04-26T11:15:06.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0197000000000005e-05 2024-04-26T11:15:06.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:06.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142822+0000", 2024-04-26T11:15:06.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021658535999999999 2024-04-26T11:15:06.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:06.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157674+0000", 2024-04-26T11:15:06.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014851573999999999 2024-04-26T11:15:06.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:06.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157714+0000", 2024-04-26T11:15:06.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0473999999999999e-05 2024-04-26T11:15:06.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:06.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157747+0000", 2024-04-26T11:15:06.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3278999999999998e-05 2024-04-26T11:15:06.490 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.490 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:06.490 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.490 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101760 5.4 5:2510211a:::benchmark_data_smithi029_44842_object101759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:06.490 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:06.490 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.301585455000001, 2024-04-26T11:15:06.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039182383000000001, 2024-04-26T11:15:06.490 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:06.490 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:06.490 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:06.490 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:06.491 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.491 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101760 2024-04-26T11:15:06.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.491 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:06.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:06.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:06.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:06.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:06.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:06.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:06.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:06.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:06.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121389+0000", 2024-04-26T11:15:06.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6667000000000003e-05 2024-04-26T11:15:06.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:06.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121394+0000", 2024-04-26T11:15:06.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0839999999999999e-06 2024-04-26T11:15:06.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121397+0000", 2024-04-26T11:15:06.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4489999999999999e-06 2024-04-26T11:15:06.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122921+0000", 2024-04-26T11:15:06.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001524067 2024-04-26T11:15:06.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:06.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.123010+0000", 2024-04-26T11:15:06.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8449000000000006e-05 2024-04-26T11:15:06.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:06.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140838+0000", 2024-04-26T11:15:06.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017828796000000001 2024-04-26T11:15:06.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:06.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157665+0000", 2024-04-26T11:15:06.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016826574 2024-04-26T11:15:06.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:06.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160407+0000", 2024-04-26T11:15:06.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027423970000000002 2024-04-26T11:15:06.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:06.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160456+0000", 2024-04-26T11:15:06.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8678999999999999e-05 2024-04-26T11:15:06.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.495 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:06.495 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160495+0000", 2024-04-26T11:15:06.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8658000000000002e-05 2024-04-26T11:15:06.495 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.495 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:06.495 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.496 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101761 5.e 5:70294421:::benchmark_data_smithi029_44842_object101760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:06.496 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:15:06.496 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.300161082000002, 2024-04-26T11:15:06.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035270448000000003, 2024-04-26T11:15:06.496 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:06.496 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:06.496 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:06.496 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:06.496 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.496 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101761 2024-04-26T11:15:06.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.496 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:06.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:06.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:15:06.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:06.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:15:06.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:06.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122736+0000", 2024-04-26T11:15:06.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:06.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:06.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122805+0000", 2024-04-26T11:15:06.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9076000000000001e-05 2024-04-26T11:15:06.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:06.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122811+0000", 2024-04-26T11:15:06.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:15:06.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122815+0000", 2024-04-26T11:15:06.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2860000000000001e-06 2024-04-26T11:15:06.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122842+0000", 2024-04-26T11:15:06.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6429000000000001e-05 2024-04-26T11:15:06.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:06.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122916+0000", 2024-04-26T11:15:06.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4122999999999995e-05 2024-04-26T11:15:06.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:06.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122997+0000", 2024-04-26T11:15:06.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1428999999999996e-05 2024-04-26T11:15:06.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:06.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142344+0000", 2024-04-26T11:15:06.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019346452 2024-04-26T11:15:06.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:06.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157934+0000", 2024-04-26T11:15:06.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015589911999999999 2024-04-26T11:15:06.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:06.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157975+0000", 2024-04-26T11:15:06.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1604999999999999e-05 2024-04-26T11:15:06.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:06.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.158007+0000", 2024-04-26T11:15:06.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1921000000000002e-05 2024-04-26T11:15:06.501 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.501 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:06.501 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.501 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110145 5.9 5:9b275f16:::benchmark_data_smithi029_44842_object110144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:15:06.501 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:15:06.501 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 43.274599444000003, 2024-04-26T11:15:06.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032844496000000001, 2024-04-26T11:15:06.501 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:06.501 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:06.501 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:06.502 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:06.502 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.502 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110145 2024-04-26T11:15:06.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.502 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:06.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:06.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:15:06.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:06.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:15:06.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:06.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148297+0000", 2024-04-26T11:15:06.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:06.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:06.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148325+0000", 2024-04-26T11:15:06.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7511000000000001e-05 2024-04-26T11:15:06.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:06.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148338+0000", 2024-04-26T11:15:06.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2808e-05 2024-04-26T11:15:06.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148345+0000", 2024-04-26T11:15:06.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7200000000000006e-06 2024-04-26T11:15:06.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149888+0000", 2024-04-26T11:15:06.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001542666 2024-04-26T11:15:06.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:06.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149977+0000", 2024-04-26T11:15:06.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9247999999999997e-05 2024-04-26T11:15:06.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:06.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181006+0000", 2024-04-26T11:15:06.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031028535999999999 2024-04-26T11:15:06.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:06.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181051+0000", 2024-04-26T11:15:06.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5393999999999999e-05 2024-04-26T11:15:06.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:06.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181143+0000", 2024-04-26T11:15:06.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1458000000000004e-05 2024-04-26T11:15:06.506 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.506 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:06.506 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.506 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110155 5.9 5:9ebc6158:::benchmark_data_smithi029_44842_object110154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:15:06.506 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:15:06.506 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 43.269523651999997, 2024-04-26T11:15:06.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027886826999999999, 2024-04-26T11:15:06.506 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:06.506 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:06.506 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:06.507 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:06.507 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.507 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110155 2024-04-26T11:15:06.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.507 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:06.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:06.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:15:06.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:06.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:15:06.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:06.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153373+0000", 2024-04-26T11:15:06.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:06.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:06.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153479+0000", 2024-04-26T11:15:06.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105728 2024-04-26T11:15:06.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:06.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153491+0000", 2024-04-26T11:15:06.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2207e-05 2024-04-26T11:15:06.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153499+0000", 2024-04-26T11:15:06.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7729999999999999e-06 2024-04-26T11:15:06.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153655+0000", 2024-04-26T11:15:06.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015573 2024-04-26T11:15:06.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:06.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153770+0000", 2024-04-26T11:15:06.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011562500000000001 2024-04-26T11:15:06.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:06.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181153+0000", 2024-04-26T11:15:06.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027382113 2024-04-26T11:15:06.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:06.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181195+0000", 2024-04-26T11:15:06.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1921000000000001e-05 2024-04-26T11:15:06.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:06.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181261+0000", 2024-04-26T11:15:06.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6402999999999994e-05 2024-04-26T11:15:06.511 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.511 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:06.511 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.511 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174398 5.4 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:06.511 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:06.511 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.073007440000001, 2024-04-26T11:15:06.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.064773789999999998, 2024-04-26T11:15:06.511 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:06.511 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:06.511 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:06.511 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:06.511 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.512 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174398 2024-04-26T11:15:06.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.512 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:06.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:06.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:06.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:06.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:06.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:06.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349889+0000", 2024-04-26T11:15:06.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:06.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:06.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349895+0000", 2024-04-26T11:15:06.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4519999999999996e-06 2024-04-26T11:15:06.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:06.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349909+0000", 2024-04-26T11:15:06.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3791000000000001e-05 2024-04-26T11:15:06.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349919+0000", 2024-04-26T11:15:06.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0135999999999999e-05 2024-04-26T11:15:06.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349956+0000", 2024-04-26T11:15:06.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7642000000000003e-05 2024-04-26T11:15:06.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:06.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350080+0000", 2024-04-26T11:15:06.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123285 2024-04-26T11:15:06.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:06.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350192+0000", 2024-04-26T11:15:06.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112509 2024-04-26T11:15:06.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:06.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356232+0000", 2024-04-26T11:15:06.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060403339999999996 2024-04-26T11:15:06.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:06.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414616+0000", 2024-04-26T11:15:06.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.058383156999999998 2024-04-26T11:15:06.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:06.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414643+0000", 2024-04-26T11:15:06.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7317e-05 2024-04-26T11:15:06.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:06.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414664+0000", 2024-04-26T11:15:06.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1135999999999999e-05 2024-04-26T11:15:06.516 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.516 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:06.516 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.516 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174402 5.b 5:d8ad746d:::benchmark_data_smithi029_44842_object29764:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:06.516 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:06.516 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.069053251, 2024-04-26T11:15:06.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059017657000000001, 2024-04-26T11:15:06.517 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:06.517 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:06.517 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:06.517 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:06.517 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.517 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174402 2024-04-26T11:15:06.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.517 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:06.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:06.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:06.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:06.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:06.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:06.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:06.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:06.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:06.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353848+0000", 2024-04-26T11:15:06.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5040000000000004e-06 2024-04-26T11:15:06.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:06.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353858+0000", 2024-04-26T11:15:06.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7410000000000004e-06 2024-04-26T11:15:06.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353864+0000", 2024-04-26T11:15:06.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7899999999999996e-06 2024-04-26T11:15:06.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353902+0000", 2024-04-26T11:15:06.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8325000000000003e-05 2024-04-26T11:15:06.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:06.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353980+0000", 2024-04-26T11:15:06.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8077000000000005e-05 2024-04-26T11:15:06.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:06.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354046+0000", 2024-04-26T11:15:06.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6249999999999998e-05 2024-04-26T11:15:06.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:06.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356532+0000", 2024-04-26T11:15:06.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024850969999999999 2024-04-26T11:15:06.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:06.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412796+0000", 2024-04-26T11:15:06.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056264616000000003 2024-04-26T11:15:06.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:06.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412835+0000", 2024-04-26T11:15:06.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8863999999999999e-05 2024-04-26T11:15:06.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:06.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412862+0000", 2024-04-26T11:15:06.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7124e-05 2024-04-26T11:15:06.521 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.521 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:06.521 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.522 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174403 5.4 5:2d30cd6a:::benchmark_data_smithi029_44842_object29765:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:06.522 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:15:06.522 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.069026048000001, 2024-04-26T11:15:06.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.060873365999999998, 2024-04-26T11:15:06.522 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:06.522 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:06.522 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:06.522 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:06.522 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.522 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174403 2024-04-26T11:15:06.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.522 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:06.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:06.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:15:06.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:06.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:15:06.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:06.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353871+0000", 2024-04-26T11:15:06.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:06.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:06.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353874+0000", 2024-04-26T11:15:06.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869999999999999e-06 2024-04-26T11:15:06.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:06.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353881+0000", 2024-04-26T11:15:06.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2239999999999998e-06 2024-04-26T11:15:06.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353886+0000", 2024-04-26T11:15:06.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.259e-06 2024-04-26T11:15:06.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353912+0000", 2024-04-26T11:15:06.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6404999999999999e-05 2024-04-26T11:15:06.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:06.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353991+0000", 2024-04-26T11:15:06.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8104999999999998e-05 2024-04-26T11:15:06.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:06.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354055+0000", 2024-04-26T11:15:06.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4875999999999993e-05 2024-04-26T11:15:06.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:06.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.358000+0000", 2024-04-26T11:15:06.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039442629999999999 2024-04-26T11:15:06.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:06.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414690+0000", 2024-04-26T11:15:06.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056689940000000001 2024-04-26T11:15:06.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:06.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414714+0000", 2024-04-26T11:15:06.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4527000000000001e-05 2024-04-26T11:15:06.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:06.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414745+0000", 2024-04-26T11:15:06.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0874999999999998e-05 2024-04-26T11:15:06.527 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.527 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:06.527 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.527 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174404 5.4 5:2801f1e1:::benchmark_data_smithi029_44842_object29766:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:06.527 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:15:06.527 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 16.066409124, 2024-04-26T11:15:06.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059745741999999998, 2024-04-26T11:15:06.527 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:06.528 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:06.528 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:06.528 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:06.528 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.528 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174404 2024-04-26T11:15:06.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.528 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:06.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:06.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:15:06.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.528 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:06.528 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:15:06.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:06.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:06.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356488+0000", 2024-04-26T11:15:06.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:06.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:06.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356492+0000", 2024-04-26T11:15:06.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1169999999999997e-06 2024-04-26T11:15:06.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:06.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356502+0000", 2024-04-26T11:15:06.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0263e-05 2024-04-26T11:15:06.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356508+0000", 2024-04-26T11:15:06.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5890000000000002e-06 2024-04-26T11:15:06.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:06.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356545+0000", 2024-04-26T11:15:06.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7382999999999998e-05 2024-04-26T11:15:06.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:06.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356671+0000", 2024-04-26T11:15:06.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012535500000000001 2024-04-26T11:15:06.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:06.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356789+0000", 2024-04-26T11:15:06.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000118099 2024-04-26T11:15:06.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:06.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.359200+0000", 2024-04-26T11:15:06.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024110059999999998 2024-04-26T11:15:06.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:06.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416180+0000", 2024-04-26T11:15:06.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056980335999999999 2024-04-26T11:15:06.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:06.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416204+0000", 2024-04-26T11:15:06.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4301e-05 2024-04-26T11:15:06.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:06.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:06.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:06.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416234+0000", 2024-04-26T11:15:06.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9903000000000002e-05 2024-04-26T11:15:06.532 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.532 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:06.532 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.532 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:06.533 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:06.533 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:06.534 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:06.533+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:06.534 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:06.635 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:06.634+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:06.710 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:15:06.725 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:06.725 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:15:06.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.725 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:218900 5.3 5:c2b7eaaf:::benchmark_data_smithi029_44842_object74262:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:06.725 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:06.717067+0000", 2024-04-26T11:15:06.725 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00064364000000000001, 2024-04-26T11:15:06.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00067411000000000001, 2024-04-26T11:15:06.726 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:06.726 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:06.726 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:06.726 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:06.726 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.726 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 218900 2024-04-26T11:15:06.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.726 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:06.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:06.726 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717067+0000", 2024-04-26T11:15:06.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:06.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717067+0000", 2024-04-26T11:15:06.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:06.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717066+0000", 2024-04-26T11:15:06.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:06.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:06.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717069+0000", 2024-04-26T11:15:06.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2969999999999999e-06 2024-04-26T11:15:06.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:06.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717080+0000", 2024-04-26T11:15:06.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0974e-05 2024-04-26T11:15:06.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717086+0000", 2024-04-26T11:15:06.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9920000000000004e-06 2024-04-26T11:15:06.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:06.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717119+0000", 2024-04-26T11:15:06.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2988000000000003e-05 2024-04-26T11:15:06.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:06.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717242+0000", 2024-04-26T11:15:06.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012300399999999999 2024-04-26T11:15:06.729 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.729 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:06.729 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.729 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:218898 5.0 e52/16 5:0a3be92b:::benchmark_data_smithi029_44842_object74260:head v 52'13876, mlcod=51'13872)", 2024-04-26T11:15:06.729 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:06.717378+0000", 2024-04-26T11:15:06.729 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00033169200000000002, 2024-04-26T11:15:06.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00044692400000000002, 2024-04-26T11:15:06.729 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:06.729 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:06.729 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:06.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:06.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717378+0000", 2024-04-26T11:15:06.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:06.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717378+0000", 2024-04-26T11:15:06.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:06.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717378+0000", 2024-04-26T11:15:06.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:06.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:06.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717384+0000", 2024-04-26T11:15:06.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.665e-06 2024-04-26T11:15:06.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:06.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717393+0000", 2024-04-26T11:15:06.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.414e-06 2024-04-26T11:15:06.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717399+0000", 2024-04-26T11:15:06.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3330000000000002e-06 2024-04-26T11:15:06.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:06.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717430+0000", 2024-04-26T11:15:06.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0964999999999999e-05 2024-04-26T11:15:06.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:06.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717449+0000", 2024-04-26T11:15:06.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8175000000000001e-05 2024-04-26T11:15:06.732 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.732 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:06.732 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.733 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:218902 5.6 5:6bc1c7c4:::benchmark_data_smithi029_44842_object74264:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:06.733 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:06.717482+0000", 2024-04-26T11:15:06.733 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00022818599999999999, 2024-04-26T11:15:06.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00040532399999999998, 2024-04-26T11:15:06.733 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:06.733 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:06.733 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:06.733 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:06.733 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.733 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 218902 2024-04-26T11:15:06.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.733 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:06.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:06.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717482+0000", 2024-04-26T11:15:06.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:06.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717482+0000", 2024-04-26T11:15:06.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:06.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717481+0000", 2024-04-26T11:15:06.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:06.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:06.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717485+0000", 2024-04-26T11:15:06.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0629999999999999e-06 2024-04-26T11:15:06.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:06.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717495+0000", 2024-04-26T11:15:06.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3549999999999994e-06 2024-04-26T11:15:06.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717501+0000", 2024-04-26T11:15:06.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4019999999999999e-06 2024-04-26T11:15:06.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:06.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717547+0000", 2024-04-26T11:15:06.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6263000000000001e-05 2024-04-26T11:15:06.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:06.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717667+0000", 2024-04-26T11:15:06.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011937199999999999 2024-04-26T11:15:06.736 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.736 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:06.736 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.736 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:218901 5.a e52/31)", 2024-04-26T11:15:06.736 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:06.717522+0000", 2024-04-26T11:15:06.736 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00018853300000000001, 2024-04-26T11:15:06.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00042863899999999997, 2024-04-26T11:15:06.737 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:06.737 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:15:06.737 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:06.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:06.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717522+0000", 2024-04-26T11:15:06.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:06.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717522+0000", 2024-04-26T11:15:06.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:06.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717521+0000", 2024-04-26T11:15:06.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:06.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:06.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717526+0000", 2024-04-26T11:15:06.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1989999999999999e-06 2024-04-26T11:15:06.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:06.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717533+0000", 2024-04-26T11:15:06.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6590000000000007e-06 2024-04-26T11:15:06.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717538+0000", 2024-04-26T11:15:06.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2179999999999998e-06 2024-04-26T11:15:06.739 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.739 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:06.739 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.739 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:218887 5.c 5:3728c5d5:::benchmark_data_smithi029_44842_object74249:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T11:15:06.739 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:06.713197+0000", 2024-04-26T11:15:06.739 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.004513319, 2024-04-26T11:15:06.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.004807174, 2024-04-26T11:15:06.739 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:06.739 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:06.740 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:06.740 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:06.740 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.740 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 218887 2024-04-26T11:15:06.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.740 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:06.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:06.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.713197+0000", 2024-04-26T11:15:06.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:06.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.713197+0000", 2024-04-26T11:15:06.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:06.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.713196+0000", 2024-04-26T11:15:06.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:06.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:06.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.713201+0000", 2024-04-26T11:15:06.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1320000000000002e-06 2024-04-26T11:15:06.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:06.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.713212+0000", 2024-04-26T11:15:06.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1137e-05 2024-04-26T11:15:06.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.713220+0000", 2024-04-26T11:15:06.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4730000000000003e-06 2024-04-26T11:15:06.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:06.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714700+0000", 2024-04-26T11:15:06.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001479915 2024-04-26T11:15:06.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:06.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714785+0000", 2024-04-26T11:15:06.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5174999999999997e-05 2024-04-26T11:15:06.743 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.743 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:06.743 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.743 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:218889 5.c 5:3108dbe0:::benchmark_data_smithi029_44842_object74251:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:06.743 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:06.713227+0000", 2024-04-26T11:15:06.743 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0044829520000000001, 2024-04-26T11:15:06.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0048443540000000004, 2024-04-26T11:15:06.743 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:06.743 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:06.743 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:06.743 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:06.743 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.744 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 218889 2024-04-26T11:15:06.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.744 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:06.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:06.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.713227+0000", 2024-04-26T11:15:06.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:06.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.713227+0000", 2024-04-26T11:15:06.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:06.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.713227+0000", 2024-04-26T11:15:06.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:06.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:06.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.713229+0000", 2024-04-26T11:15:06.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4439999999999998e-06 2024-04-26T11:15:06.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:06.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.713236+0000", 2024-04-26T11:15:06.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5010000000000001e-06 2024-04-26T11:15:06.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.713241+0000", 2024-04-26T11:15:06.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.356e-06 2024-04-26T11:15:06.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:06.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.716350+0000", 2024-04-26T11:15:06.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0031088819999999999 2024-04-26T11:15:06.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:06.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.716473+0000", 2024-04-26T11:15:06.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000123411 2024-04-26T11:15:06.746 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.746 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:06.747 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.747 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:218891 5.c 5:3fb46a4d:::benchmark_data_smithi029_44842_object74253:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:06.747 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:06.713246+0000", 2024-04-26T11:15:06.747 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0044645120000000003, 2024-04-26T11:15:06.747 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0048960729999999999, 2024-04-26T11:15:06.747 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:06.747 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:06.747 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:06.747 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:06.747 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.747 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 218891 2024-04-26T11:15:06.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.747 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:06.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:06.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.713246+0000", 2024-04-26T11:15:06.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:06.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.713246+0000", 2024-04-26T11:15:06.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:06.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.713245+0000", 2024-04-26T11:15:06.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:06.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:06.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.713248+0000", 2024-04-26T11:15:06.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2419999999999999e-06 2024-04-26T11:15:06.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:06.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.713254+0000", 2024-04-26T11:15:06.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6529999999999997e-06 2024-04-26T11:15:06.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.713259+0000", 2024-04-26T11:15:06.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6349999999999997e-06 2024-04-26T11:15:06.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:06.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717982+0000", 2024-04-26T11:15:06.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0047233550000000003 2024-04-26T11:15:06.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:06.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.718108+0000", 2024-04-26T11:15:06.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012595299999999999 2024-04-26T11:15:06.750 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.750 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:06.750 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.751 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:218892 5.c 5.37f7cb1c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:06.751 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:06.713263+0000", 2024-04-26T11:15:06.751 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.004446818, 2024-04-26T11:15:06.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0049440500000000002, 2024-04-26T11:15:06.751 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:06.751 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:15:06.751 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:06.751 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:06.751 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.751 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 218892 2024-04-26T11:15:06.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.751 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:06.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:06.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.713263+0000", 2024-04-26T11:15:06.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:06.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.713263+0000", 2024-04-26T11:15:06.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:06.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.713263+0000", 2024-04-26T11:15:06.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:06.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:06.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.713266+0000", 2024-04-26T11:15:06.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4569999999999999e-06 2024-04-26T11:15:06.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:06.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.713272+0000", 2024-04-26T11:15:06.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9800000000000001e-06 2024-04-26T11:15:06.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.713278+0000", 2024-04-26T11:15:06.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4790000000000004e-06 2024-04-26T11:15:06.753 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.753 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:06.754 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.754 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:218894 5.c 5.deb839cc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:06.754 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:06.714122+0000", 2024-04-26T11:15:06.754 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0035884490000000001, 2024-04-26T11:15:06.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0041435990000000004, 2024-04-26T11:15:06.754 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:06.754 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:15:06.754 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:06.754 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:06.754 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.754 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 218894 2024-04-26T11:15:06.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.755 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:06.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.758 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:06.758 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714122+0000", 2024-04-26T11:15:06.758 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.758 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:06.758 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714122+0000", 2024-04-26T11:15:06.758 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.758 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:06.758 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714121+0000", 2024-04-26T11:15:06.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:06.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.759 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:06.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714126+0000", 2024-04-26T11:15:06.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4670000000000003e-06 2024-04-26T11:15:06.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.759 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:06.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714137+0000", 2024-04-26T11:15:06.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0135e-05 2024-04-26T11:15:06.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.759 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714144+0000", 2024-04-26T11:15:06.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6639999999999998e-06 2024-04-26T11:15:06.760 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.760 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:06.760 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.760 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:218893 5.0 e52/16 5:035eddd5:::benchmark_data_smithi029_44842_object74255:head v 52'13875, mlcod=51'13872)", 2024-04-26T11:15:06.760 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:06.714163+0000", 2024-04-26T11:15:06.760 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0035473129999999999, 2024-04-26T11:15:06.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0041603819999999998, 2024-04-26T11:15:06.760 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:06.760 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:06.760 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:06.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.761 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:06.761 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714163+0000", 2024-04-26T11:15:06.761 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.761 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:06.761 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714163+0000", 2024-04-26T11:15:06.761 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.761 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:06.761 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714162+0000", 2024-04-26T11:15:06.761 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:06.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.762 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:06.762 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714170+0000", 2024-04-26T11:15:06.762 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7109999999999995e-06 2024-04-26T11:15:06.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.762 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:06.762 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714178+0000", 2024-04-26T11:15:06.762 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8779999999999998e-06 2024-04-26T11:15:06.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.762 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.762 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714186+0000", 2024-04-26T11:15:06.762 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9829999999999996e-06 2024-04-26T11:15:06.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.763 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:06.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.715465+0000", 2024-04-26T11:15:06.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001279044 2024-04-26T11:15:06.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.763 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:06.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.715487+0000", 2024-04-26T11:15:06.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1628e-05 2024-04-26T11:15:06.763 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.763 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:06.763 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.763 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:218897 5.2 5:49a14105:::benchmark_data_smithi029_44842_object74259:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:06.764 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:06.714638+0000", 2024-04-26T11:15:06.764 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.003072254, 2024-04-26T11:15:06.764 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0037453959999999998, 2024-04-26T11:15:06.764 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:06.764 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:06.764 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:06.764 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:06.764 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.764 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 218897 2024-04-26T11:15:06.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.764 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:06.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.764 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:06.764 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714638+0000", 2024-04-26T11:15:06.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:06.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714638+0000", 2024-04-26T11:15:06.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:06.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714637+0000", 2024-04-26T11:15:06.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:06.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:06.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714643+0000", 2024-04-26T11:15:06.766 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5620000000000003e-06 2024-04-26T11:15:06.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.766 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.766 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:06.766 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714653+0000", 2024-04-26T11:15:06.766 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0147e-05 2024-04-26T11:15:06.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.766 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.766 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.766 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714660+0000", 2024-04-26T11:15:06.766 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5050000000000001e-06 2024-04-26T11:15:06.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.766 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.766 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:06.766 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714838+0000", 2024-04-26T11:15:06.767 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000177226 2024-04-26T11:15:06.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.767 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:06.767 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714928+0000", 2024-04-26T11:15:06.767 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.0814000000000002e-05 2024-04-26T11:15:06.767 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.767 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:06.767 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.767 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:218896 5.a e52/31 5:5d433cbb:::benchmark_data_smithi029_44842_object74258:head v 52'13895, mlcod=51'13891)", 2024-04-26T11:15:06.767 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:06.714975+0000", 2024-04-26T11:15:06.767 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.002735632, 2024-04-26T11:15:06.767 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0034725789999999999, 2024-04-26T11:15:06.768 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:06.768 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:06.768 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:06.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.768 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:06.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714975+0000", 2024-04-26T11:15:06.768 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.768 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:06.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714975+0000", 2024-04-26T11:15:06.768 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.769 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:06.769 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714974+0000", 2024-04-26T11:15:06.769 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:06.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.769 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:06.769 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714980+0000", 2024-04-26T11:15:06.769 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0920000000000003e-06 2024-04-26T11:15:06.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.769 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:06.769 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714989+0000", 2024-04-26T11:15:06.769 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1090000000000004e-06 2024-04-26T11:15:06.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.770 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.770 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.714995+0000", 2024-04-26T11:15:06.770 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1659999999999999e-06 2024-04-26T11:15:06.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.770 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.770 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:06.770 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.715025+0000", 2024-04-26T11:15:06.770 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9479e-05 2024-04-26T11:15:06.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.770 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.770 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:06.770 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.715042+0000", 2024-04-26T11:15:06.770 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7136e-05 2024-04-26T11:15:06.770 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.770 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:06.771 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.771 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.771 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:218899 5.2 5:4933bf43:::benchmark_data_smithi029_44842_object74261:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:06.771 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:06.717026+0000", 2024-04-26T11:15:06.771 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00068451000000000004, 2024-04-26T11:15:06.771 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001492937, 2024-04-26T11:15:06.771 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:06.771 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:06.771 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:06.771 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:06.771 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:06.771 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 218899 2024-04-26T11:15:06.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.772 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:06.772 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.772 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:06.772 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717026+0000", 2024-04-26T11:15:06.772 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.772 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.772 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:06.772 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717026+0000", 2024-04-26T11:15:06.772 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:06.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.772 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.772 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:06.772 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717025+0000", 2024-04-26T11:15:06.772 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:06.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.773 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.773 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:06.773 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717029+0000", 2024-04-26T11:15:06.773 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4920000000000004e-06 2024-04-26T11:15:06.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.773 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.773 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:06.773 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717037+0000", 2024-04-26T11:15:06.773 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4710000000000001e-06 2024-04-26T11:15:06.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.773 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.773 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:06.773 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717042+0000", 2024-04-26T11:15:06.773 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4330000000000003e-06 2024-04-26T11:15:06.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.774 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.774 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:06.774 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717079+0000", 2024-04-26T11:15:06.774 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.684e-05 2024-04-26T11:15:06.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:06.774 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:06.774 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:06.774 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:06.717197+0000", 2024-04-26T11:15:06.774 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000117657 2024-04-26T11:15:06.774 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.774 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:06.774 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.774 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:06.775 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:15:06.775 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 13 2024-04-26T11:15:06.775 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:06.776 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:06.777 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:06.775+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:06.877 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:06.876+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:06.980 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:06.977+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:07.003 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:07.003 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:15:07.004 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:15:07.004 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:15:07.004 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:07.019 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:07.078 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:07.077+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:07.179 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:07.178+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:07.248 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:07.248 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:15:07.249 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:15:07.249 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:15:07.249 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.249 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:07.249 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:07.249 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 73.973847305000007, 2024-04-26T11:15:07.249 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:15:07.249 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:07.249 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:07.249 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:07.249 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:07.249 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.249 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:15:07.249 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.249 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:07.250 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.250 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:07.250 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:07.250 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.250 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.250 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.250 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:07.250 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:07.250 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.250 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.250 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.250 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:07.250 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:15:07.250 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:07.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.251 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.251 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:07.251 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:15:07.251 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:15:07.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.251 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.251 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:07.251 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:15:07.251 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:15:07.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.251 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.251 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.251 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:15:07.251 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:15:07.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.252 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.252 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.252 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:15:07.252 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:15:07.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.252 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.252 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:07.252 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:15:07.252 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:15:07.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.252 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.252 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:07.252 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:15:07.253 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:15:07.253 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.253 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.253 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:07.253 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:15:07.253 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:15:07.253 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.253 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.253 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:07.253 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:15:07.253 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:15:07.253 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.253 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.253 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:07.253 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:15:07.254 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:15:07.254 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.254 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.254 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:07.254 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:15:07.254 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:15:07.254 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.254 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:07.254 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.254 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.254 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.254 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:07.254 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:07.254 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 73.97303574, 2024-04-26T11:15:07.255 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:15:07.255 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:07.255 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:07.255 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:07.255 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:07.255 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.255 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:15:07.255 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.255 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:07.255 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.255 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:07.255 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:07.255 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.256 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.256 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:07.256 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:07.256 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.257 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.257 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:07.257 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:07.257 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:07.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.257 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.257 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:07.257 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:15:07.257 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:15:07.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.257 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.257 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:07.257 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:15:07.258 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:15:07.258 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.258 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.258 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.258 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:15:07.258 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:15:07.258 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.258 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.258 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.258 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:15:07.258 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:15:07.258 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.258 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.259 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:07.259 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:15:07.259 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:15:07.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.259 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.259 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:07.259 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:15:07.259 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:15:07.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.259 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.259 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:07.259 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:15:07.259 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:15:07.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.260 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.260 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:07.260 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:15:07.260 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:15:07.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.260 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.260 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:07.260 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:15:07.260 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:15:07.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.260 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.260 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:07.260 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:15:07.260 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:15:07.261 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.261 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:07.261 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.261 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.261 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:07.261 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:07.261 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 73.965848902999994, 2024-04-26T11:15:07.261 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:15:07.261 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:07.261 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:07.261 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:07.261 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:07.261 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.261 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:15:07.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.262 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:07.262 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.262 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:07.262 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:07.262 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.262 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.262 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:07.262 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:07.262 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.262 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.263 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:07.263 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:15:07.263 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:07.263 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.263 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.263 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:07.263 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:15:07.263 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:15:07.263 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.263 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.263 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:07.263 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:15:07.263 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:15:07.264 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.264 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.264 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.264 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:15:07.264 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:15:07.264 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.264 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.264 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.264 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:15:07.264 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:15:07.264 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.264 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.264 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:07.264 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:15:07.264 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:15:07.265 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.265 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.265 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:07.265 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:15:07.265 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:15:07.265 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.265 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.265 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:07.265 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:15:07.265 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:15:07.265 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.265 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.265 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:07.265 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:15:07.266 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:15:07.266 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.266 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.266 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:07.266 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:15:07.266 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:15:07.266 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.266 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.266 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:07.266 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:15:07.266 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:15:07.266 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.266 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:07.267 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.267 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.267 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.267 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:07.267 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:07.267 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 73.965308023999995, 2024-04-26T11:15:07.267 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:15:07.267 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:07.267 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:07.267 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:07.267 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:07.267 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.267 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:15:07.267 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.268 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:07.268 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.268 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:07.268 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:07.268 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.268 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.268 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.268 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:07.268 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:07.268 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.268 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.268 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.268 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:07.269 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:07.269 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:07.269 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.269 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.269 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:07.269 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:15:07.269 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:15:07.269 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.269 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.269 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:07.269 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:15:07.269 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:15:07.269 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.269 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.270 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.270 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:15:07.270 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:15:07.270 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.270 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.270 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.270 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:15:07.270 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:15:07.270 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.270 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.270 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:07.270 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:15:07.270 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:15:07.270 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.271 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.271 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:07.271 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:15:07.271 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:15:07.271 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.271 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.271 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:07.271 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:15:07.271 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:15:07.271 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.271 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.271 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:07.271 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:15:07.271 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:15:07.272 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.272 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.272 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:07.272 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:15:07.272 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:15:07.272 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.272 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.272 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:07.272 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:15:07.272 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:15:07.272 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.272 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:07.272 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.272 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.273 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.273 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:07.273 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:07.273 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 69.922123576999994, 2024-04-26T11:15:07.273 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:15:07.273 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:07.273 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:07.273 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:07.273 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:07.273 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.273 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:15:07.273 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.273 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:07.273 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.274 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:07.274 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:07.274 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.274 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.274 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.274 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:07.274 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:07.274 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.274 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.274 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.274 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:07.274 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:15:07.274 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:07.274 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.275 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.275 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:07.275 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:15:07.275 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:15:07.275 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.275 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.275 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:07.275 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:15:07.275 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:15:07.275 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.275 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.275 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.275 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:15:07.275 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:15:07.275 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.276 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.276 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.276 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:15:07.276 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:15:07.276 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.276 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.276 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:07.276 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:15:07.276 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:15:07.276 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.276 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.276 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:07.276 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:15:07.277 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:15:07.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.277 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.277 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:07.277 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:15:07.277 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:15:07.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.277 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.277 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.277 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:15:07.277 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:15:07.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.277 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.277 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:07.278 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:15:07.278 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:15:07.278 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.278 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.278 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.278 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:15:07.278 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:15:07.278 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.278 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.278 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:07.278 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:15:07.278 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:15:07.278 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.278 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:07.279 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.279 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.279 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.279 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:07.279 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:07.279 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 69.919930237000003, 2024-04-26T11:15:07.279 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:15:07.279 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:07.279 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:07.279 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:07.279 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:07.279 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.279 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:15:07.279 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.280 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:07.280 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.280 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:07.280 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:07.280 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.280 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.280 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:07.280 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:07.280 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.280 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.281 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:07.281 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:15:07.281 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:07.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.281 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.281 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:07.281 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:15:07.281 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:15:07.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.281 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.281 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:07.281 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:15:07.281 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:15:07.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.281 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.282 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.282 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:15:07.282 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:15:07.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.282 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.282 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.282 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:15:07.282 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:15:07.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.282 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.282 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:07.282 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:15:07.282 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:15:07.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.283 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.283 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:07.283 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:15:07.283 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:15:07.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.283 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.283 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:07.283 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:15:07.283 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:15:07.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.283 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.283 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.284 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:15:07.284 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:15:07.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.284 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.284 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:07.284 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:15:07.284 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:15:07.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.284 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.284 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.284 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:15:07.284 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:15:07.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.284 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.285 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:07.285 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:15:07.285 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:15:07.285 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.285 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:07.285 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.285 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.285 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:07.285 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:07.285 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 69.914718413000003, 2024-04-26T11:15:07.285 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:15:07.285 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:07.285 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:07.285 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:07.286 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:07.286 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.286 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:15:07.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.286 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:07.286 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.286 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:07.286 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:07.286 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.286 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.286 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:07.286 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:07.286 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.287 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.287 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:07.287 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:15:07.287 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:07.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.287 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.287 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:07.287 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:15:07.287 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:15:07.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.287 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.287 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:07.287 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:15:07.287 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:15:07.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.288 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.288 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.288 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:15:07.288 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:15:07.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.288 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.288 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.288 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:15:07.288 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:15:07.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.288 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.288 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:07.288 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:15:07.288 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:15:07.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.289 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.289 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:07.289 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:15:07.289 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:15:07.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.289 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.289 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:07.289 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:15:07.289 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:15:07.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.289 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.289 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.289 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:15:07.290 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:15:07.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.290 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:07.290 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:15:07.290 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:15:07.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.290 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.290 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:15:07.290 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:15:07.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.290 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:07.291 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:15:07.291 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:15:07.291 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.291 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:07.291 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.291 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.291 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:07.291 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:07.291 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 69.898269713000005, 2024-04-26T11:15:07.291 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:15:07.291 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:07.291 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:07.291 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:07.291 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:07.292 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.292 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:15:07.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.292 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:07.292 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.292 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:07.292 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:07.292 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.292 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.292 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:07.292 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:07.292 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.293 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.293 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:07.293 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:15:07.293 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:07.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.293 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.293 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:07.293 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:15:07.293 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:15:07.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.293 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.293 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:07.293 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:15:07.293 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:15:07.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.294 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.294 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.294 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:15:07.294 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:15:07.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.294 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.294 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.294 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:15:07.294 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:15:07.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.294 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.294 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:07.294 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:15:07.294 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:15:07.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.295 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.295 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.295 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:15:07.295 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:15:07.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.295 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.295 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:07.295 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:15:07.295 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:15:07.295 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.295 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:07.295 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.295 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.296 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:07.296 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:07.296 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 69.896572207999995, 2024-04-26T11:15:07.296 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:15:07.296 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:07.296 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:07.296 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:07.296 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:07.296 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.296 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:15:07.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.296 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:07.296 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.296 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:07.297 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:07.297 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.297 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.297 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:07.297 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:07.297 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.297 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.297 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:07.297 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:15:07.297 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:07.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.297 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.297 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:07.298 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:15:07.298 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:15:07.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.298 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.298 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:07.298 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:15:07.298 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:15:07.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.298 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.298 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.298 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:15:07.298 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:15:07.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.298 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.299 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.299 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:15:07.299 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:15:07.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.299 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.299 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:07.299 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:15:07.299 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:15:07.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.299 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.299 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.299 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:15:07.299 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:15:07.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.300 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.300 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:07.300 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:15:07.300 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:15:07.300 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.300 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:07.300 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.300 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.300 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:07.300 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:07.300 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 69.896507905999997, 2024-04-26T11:15:07.300 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:15:07.300 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:07.300 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:07.301 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:07.301 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:07.301 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.301 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:15:07.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.301 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:07.301 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.301 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:07.301 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:07.301 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.301 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.301 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:07.301 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:07.302 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.302 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.302 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:07.302 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:07.302 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:07.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.302 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.302 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:07.302 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:15:07.302 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:15:07.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.302 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.302 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:07.303 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:15:07.303 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:15:07.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.303 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.303 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.303 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:15:07.303 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:15:07.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.303 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.303 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.303 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:15:07.303 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:15:07.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.303 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.304 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:07.304 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:15:07.304 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:15:07.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.304 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.304 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.304 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:15:07.304 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:15:07.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.304 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.304 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:07.304 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:15:07.304 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:15:07.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.305 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:07.305 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:15:07.305 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:15:07.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.305 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:07.305 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:15:07.305 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:15:07.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.305 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:07.305 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:15:07.305 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:15:07.306 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.306 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:07.306 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.306 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.306 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:07.306 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:07.306 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 69.896453682000001, 2024-04-26T11:15:07.306 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:15:07.306 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:07.306 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:07.306 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:07.306 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:07.306 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.307 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:15:07.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.307 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:07.307 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.307 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:07.307 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:07.307 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.307 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.307 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:07.307 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:07.307 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.307 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.308 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:07.308 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:07.308 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:07.308 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.308 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.308 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:07.308 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:15:07.308 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:15:07.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.309 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.309 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:07.309 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:15:07.309 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:15:07.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.309 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.309 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.309 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:15:07.309 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:15:07.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.310 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.310 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.310 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:15:07.310 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:15:07.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.310 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.310 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:07.310 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:15:07.310 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:15:07.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.310 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.310 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.310 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:15:07.310 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:15:07.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.311 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.311 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:07.311 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:15:07.311 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:15:07.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.311 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.311 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:07.311 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:15:07.311 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:15:07.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.311 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.311 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:07.311 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:15:07.312 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:15:07.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.312 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.312 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:07.312 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:15:07.312 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:15:07.312 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.312 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:07.312 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.312 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.312 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:07.312 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:07.312 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 69.896409169999998, 2024-04-26T11:15:07.312 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:15:07.313 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:07.313 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:07.313 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:07.313 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:07.313 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.313 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:15:07.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.313 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:07.313 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.313 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:07.313 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:07.313 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.313 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.313 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:07.314 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:07.314 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.314 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.314 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:07.314 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:15:07.314 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:07.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.314 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.314 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:07.314 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:15:07.314 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:15:07.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.314 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.315 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:07.315 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:15:07.315 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:15:07.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.315 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.315 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.315 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:15:07.315 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:15:07.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.315 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.315 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.315 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:15:07.315 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:15:07.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.315 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.316 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:07.316 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:15:07.316 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:15:07.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.316 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.316 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.316 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:15:07.316 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:15:07.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.316 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.316 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:07.316 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:15:07.316 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:15:07.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.317 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.317 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:07.317 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:15:07.317 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:15:07.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.317 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.317 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:07.317 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:15:07.317 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:15:07.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.317 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.317 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:07.317 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:15:07.317 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:15:07.318 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.318 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:07.318 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.318 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.318 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:07.318 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:07.318 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 69.892188168000004, 2024-04-26T11:15:07.318 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:15:07.318 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:07.318 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:07.318 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:07.318 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:07.319 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.319 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:15:07.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.319 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:07.319 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.319 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:07.319 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:07.319 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.319 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.319 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:07.319 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:07.319 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.320 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:07.320 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:15:07.320 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:15:07.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.320 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:07.320 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:15:07.320 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:15:07.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.320 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:07.320 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:15:07.320 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:15:07.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.321 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.321 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.321 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:15:07.321 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:15:07.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.321 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.321 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.321 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:15:07.321 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:15:07.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.321 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.321 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:07.321 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:15:07.321 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:15:07.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.322 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.322 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.322 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:15:07.322 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:15:07.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.322 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.322 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:07.322 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:15:07.322 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:15:07.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.322 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.322 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:07.322 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:15:07.323 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:15:07.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.323 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.323 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:07.323 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:15:07.323 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:15:07.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.323 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.323 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:07.323 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:15:07.323 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:15:07.323 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.323 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:07.324 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.324 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.324 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174388 5.c 5:312e5163:::benchmark_data_smithi029_44842_object29750:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:07.324 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:07.324 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 16.896362513, 2024-04-26T11:15:07.324 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.064002009999999998, 2024-04-26T11:15:07.324 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:07.324 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:07.324 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:07.324 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:07.325 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.325 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174388 2024-04-26T11:15:07.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.325 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:07.325 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.325 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:07.325 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:07.325 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.325 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.325 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:07.325 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:07.325 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.325 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.326 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:07.326 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348231+0000", 2024-04-26T11:15:07.326 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:07.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.326 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.326 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:07.326 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348233+0000", 2024-04-26T11:15:07.326 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2249999999999999e-06 2024-04-26T11:15:07.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.326 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.326 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:07.326 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348238+0000", 2024-04-26T11:15:07.326 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1899999999999997e-06 2024-04-26T11:15:07.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.327 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.327 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.327 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348241+0000", 2024-04-26T11:15:07.327 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.965e-06 2024-04-26T11:15:07.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.327 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.327 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.327 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348264+0000", 2024-04-26T11:15:07.327 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3014e-05 2024-04-26T11:15:07.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.327 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.327 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:07.327 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348371+0000", 2024-04-26T11:15:07.328 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000106889 2024-04-26T11:15:07.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.328 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.328 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:07.328 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412126+0000", 2024-04-26T11:15:07.328 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063755495999999995 2024-04-26T11:15:07.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.328 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.328 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:07.328 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412165+0000", 2024-04-26T11:15:07.328 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9269e-05 2024-04-26T11:15:07.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.328 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.328 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:07.328 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412234+0000", 2024-04-26T11:15:07.329 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8337000000000007e-05 2024-04-26T11:15:07.329 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.329 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:07.329 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.329 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.329 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174390 5.1 5:81c54fd7:::benchmark_data_smithi029_44842_object29752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:07.329 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:07.329 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 16.896247359, 2024-04-26T11:15:07.329 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063635918, 2024-04-26T11:15:07.329 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:07.329 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:07.329 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:07.329 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:07.329 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.330 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174390 2024-04-26T11:15:07.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.330 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:07.330 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.330 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:07.330 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:07.330 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.330 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.330 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:07.330 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:07.330 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.331 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.331 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:07.331 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348346+0000", 2024-04-26T11:15:07.331 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:07.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.331 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.331 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:07.331 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348351+0000", 2024-04-26T11:15:07.331 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.442e-06 2024-04-26T11:15:07.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.331 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.331 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:07.331 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348357+0000", 2024-04-26T11:15:07.331 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9530000000000002e-06 2024-04-26T11:15:07.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.332 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.332 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.332 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348363+0000", 2024-04-26T11:15:07.332 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2129999999999999e-06 2024-04-26T11:15:07.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.332 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.332 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.332 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348396+0000", 2024-04-26T11:15:07.332 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3161999999999999e-05 2024-04-26T11:15:07.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.332 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.332 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:07.332 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348511+0000", 2024-04-26T11:15:07.333 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000115253 2024-04-26T11:15:07.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.333 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.333 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:07.333 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411857+0000", 2024-04-26T11:15:07.333 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063345431999999993 2024-04-26T11:15:07.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.333 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.333 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:07.333 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411904+0000", 2024-04-26T11:15:07.333 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7389000000000003e-05 2024-04-26T11:15:07.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.333 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.333 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:07.334 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411983+0000", 2024-04-26T11:15:07.334 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8750000000000003e-05 2024-04-26T11:15:07.334 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.334 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:07.334 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.334 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.334 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174394 5.3 5:c91ce5cb:::benchmark_data_smithi029_44842_object29756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:07.334 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:07.334 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 16.896144414999998, 2024-04-26T11:15:07.334 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062247626, 2024-04-26T11:15:07.334 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:07.334 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:07.334 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:07.335 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:07.335 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.335 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174394 2024-04-26T11:15:07.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.335 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:07.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.335 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:07.335 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:07.335 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.335 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:07.335 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:07.335 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.336 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:07.336 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348449+0000", 2024-04-26T11:15:07.336 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:07.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.336 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:07.336 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348457+0000", 2024-04-26T11:15:07.336 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9619999999999993e-06 2024-04-26T11:15:07.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.336 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:07.336 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348462+0000", 2024-04-26T11:15:07.336 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6569999999999996e-06 2024-04-26T11:15:07.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.337 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.337 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.337 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348465+0000", 2024-04-26T11:15:07.337 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2990000000000001e-06 2024-04-26T11:15:07.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.337 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.337 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.337 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408427+0000", 2024-04-26T11:15:07.337 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.059961423 2024-04-26T11:15:07.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.337 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.337 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:07.337 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408554+0000", 2024-04-26T11:15:07.338 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012779600000000001 2024-04-26T11:15:07.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.338 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:07.338 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410570+0000", 2024-04-26T11:15:07.338 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020152719999999998 2024-04-26T11:15:07.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.338 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:07.338 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410624+0000", 2024-04-26T11:15:07.338 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4211e-05 2024-04-26T11:15:07.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.338 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:07.339 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410697+0000", 2024-04-26T11:15:07.339 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3447000000000003e-05 2024-04-26T11:15:07.339 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.339 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:07.339 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.339 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174395 5.1 5:8ee7f1d3:::benchmark_data_smithi029_44842_object29757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:07.339 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:07.339 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 16.895114324000001, 2024-04-26T11:15:07.339 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062622744999999994, 2024-04-26T11:15:07.339 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:07.339 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:07.339 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:07.339 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:07.340 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.340 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174395 2024-04-26T11:15:07.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.340 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:07.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.340 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:07.340 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:07.340 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.340 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:07.340 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:07.340 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.341 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:07.341 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349479+0000", 2024-04-26T11:15:07.341 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:07.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.341 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:07.341 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349483+0000", 2024-04-26T11:15:07.341 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.54e-06 2024-04-26T11:15:07.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.341 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:07.341 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349488+0000", 2024-04-26T11:15:07.341 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5119999999999999e-06 2024-04-26T11:15:07.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.342 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.342 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349492+0000", 2024-04-26T11:15:07.342 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7170000000000002e-06 2024-04-26T11:15:07.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.342 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.342 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350187+0000", 2024-04-26T11:15:07.342 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00069535899999999999 2024-04-26T11:15:07.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.342 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:07.342 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350292+0000", 2024-04-26T11:15:07.343 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0001047 2024-04-26T11:15:07.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.343 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:07.343 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411992+0000", 2024-04-26T11:15:07.343 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061699647000000003 2024-04-26T11:15:07.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.343 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:07.343 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412030+0000", 2024-04-26T11:15:07.343 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8124999999999998e-05 2024-04-26T11:15:07.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.343 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:07.344 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412103+0000", 2024-04-26T11:15:07.344 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2733999999999999e-05 2024-04-26T11:15:07.344 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.344 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:07.344 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.344 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174396 5.7 5:e0fad05d:::benchmark_data_smithi029_44842_object29758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:07.344 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:07.344 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 16.895030685000002, 2024-04-26T11:15:07.344 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062445026000000001, 2024-04-26T11:15:07.344 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:07.344 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:07.344 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:07.345 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:07.345 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.345 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174396 2024-04-26T11:15:07.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.345 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:07.345 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.345 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:07.345 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:07.345 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.345 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.345 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:07.345 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:07.345 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.346 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:07.346 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:07.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:07.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.347 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:07.347 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349566+0000", 2024-04-26T11:15:07.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2490000000000001e-06 2024-04-26T11:15:07.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.347 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:07.347 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349573+0000", 2024-04-26T11:15:07.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.776e-06 2024-04-26T11:15:07.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.347 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.348 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349576+0000", 2024-04-26T11:15:07.348 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3629999999999998e-06 2024-04-26T11:15:07.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.348 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.348 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350396+0000", 2024-04-26T11:15:07.348 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00081992199999999995 2024-04-26T11:15:07.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.348 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:07.348 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350516+0000", 2024-04-26T11:15:07.348 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012006900000000001 2024-04-26T11:15:07.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.349 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:07.349 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411924+0000", 2024-04-26T11:15:07.349 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061407960999999997 2024-04-26T11:15:07.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.349 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:07.349 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411947+0000", 2024-04-26T11:15:07.349 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2943999999999999e-05 2024-04-26T11:15:07.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.349 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:07.349 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412008+0000", 2024-04-26T11:15:07.349 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1237999999999999e-05 2024-04-26T11:15:07.349 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.350 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:07.350 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.350 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.350 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174397 5.7 5:e25daf9a:::benchmark_data_smithi029_44842_object29759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:07.350 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:07.350 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 16.894922556000001, 2024-04-26T11:15:07.350 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063878565999999998, 2024-04-26T11:15:07.350 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:07.350 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:07.350 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:07.350 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:07.350 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.350 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174397 2024-04-26T11:15:07.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.351 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:07.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.351 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:07.351 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:07.351 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.351 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:07.351 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:07.351 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.351 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:07.352 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349671+0000", 2024-04-26T11:15:07.352 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:07.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.352 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.352 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:07.352 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349674+0000", 2024-04-26T11:15:07.352 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3360000000000002e-06 2024-04-26T11:15:07.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.352 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.352 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:07.352 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349678+0000", 2024-04-26T11:15:07.352 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0709999999999996e-06 2024-04-26T11:15:07.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.353 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.353 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349681+0000", 2024-04-26T11:15:07.353 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3139999999999999e-06 2024-04-26T11:15:07.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.353 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.353 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410371+0000", 2024-04-26T11:15:07.353 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.060690202999999998 2024-04-26T11:15:07.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.353 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:07.353 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410463+0000", 2024-04-26T11:15:07.353 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2095000000000005e-05 2024-04-26T11:15:07.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.354 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:07.354 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413471+0000", 2024-04-26T11:15:07.354 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0030073909999999999 2024-04-26T11:15:07.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.354 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:07.354 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413499+0000", 2024-04-26T11:15:07.354 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8725e-05 2024-04-26T11:15:07.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.355 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.355 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:07.355 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413550+0000", 2024-04-26T11:15:07.355 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0810000000000003e-05 2024-04-26T11:15:07.355 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.355 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:07.355 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.355 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.355 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:174398 5.4 e46/16 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head v 46'10798, mlcod=46'10796)", 2024-04-26T11:15:07.355 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:07.355 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 16.894394344999998, 2024-04-26T11:15:07.355 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062067047, 2024-04-26T11:15:07.355 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:07.356 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:07.356 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:07.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.356 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:07.356 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:07.356 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.356 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:07.356 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:07.356 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:07.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.357 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:07.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350199+0000", 2024-04-26T11:15:07.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:07.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.357 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:07.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350205+0000", 2024-04-26T11:15:07.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6749999999999999e-06 2024-04-26T11:15:07.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.357 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:07.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350212+0000", 2024-04-26T11:15:07.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7000000000000002e-06 2024-04-26T11:15:07.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.358 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.358 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350216+0000", 2024-04-26T11:15:07.358 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5120000000000002e-06 2024-04-26T11:15:07.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.358 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:07.358 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350246+0000", 2024-04-26T11:15:07.358 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9978999999999999e-05 2024-04-26T11:15:07.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.358 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:07.358 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350263+0000", 2024-04-26T11:15:07.358 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.702e-05 2024-04-26T11:15:07.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:07.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412238+0000", 2024-04-26T11:15:07.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061974603000000003 2024-04-26T11:15:07.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:07.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:07.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:07.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412267+0000", 2024-04-26T11:15:07.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9116e-05 2024-04-26T11:15:07.359 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.359 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:07.359 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.360 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:07.360 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:07.360 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:07.361 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:07.362 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:07.360+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:07.462 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:07.461+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:07.533 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:07.533 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:15:07.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.533 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:221020 5.9 5:93fc985c:::benchmark_data_smithi029_44842_object76382:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:07.533 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:07.527642+0000", 2024-04-26T11:15:07.533 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0033614920000000002, 2024-04-26T11:15:07.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003383708, 2024-04-26T11:15:07.533 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:07.533 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:07.533 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:07.533 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 221020 2024-04-26T11:15:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.527642+0000", 2024-04-26T11:15:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:07.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.527642+0000", 2024-04-26T11:15:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.527642+0000", 2024-04-26T11:15:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.527645+0000", 2024-04-26T11:15:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7589999999999999e-06 2024-04-26T11:15:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.527657+0000", 2024-04-26T11:15:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.205e-05 2024-04-26T11:15:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.527664+0000", 2024-04-26T11:15:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2840000000000003e-06 2024-04-26T11:15:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.528834+0000", 2024-04-26T11:15:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00117056 2024-04-26T11:15:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.528969+0000", 2024-04-26T11:15:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000134871 2024-04-26T11:15:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:221021 5.0 5:0141ac32:::benchmark_data_smithi029_44842_object76383:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:07.528949+0000", 2024-04-26T11:15:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00205492, 2024-04-26T11:15:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021267730000000002, 2024-04-26T11:15:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:07.537 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 221021 2024-04-26T11:15:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.528949+0000", 2024-04-26T11:15:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:07.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.528949+0000", 2024-04-26T11:15:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.528948+0000", 2024-04-26T11:15:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.528952+0000", 2024-04-26T11:15:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4989999999999996e-06 2024-04-26T11:15:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:07.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.528961+0000", 2024-04-26T11:15:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8580000000000006e-06 2024-04-26T11:15:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.528969+0000", 2024-04-26T11:15:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5190000000000003e-06 2024-04-26T11:15:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.529016+0000", 2024-04-26T11:15:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7249000000000001e-05 2024-04-26T11:15:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.529130+0000", 2024-04-26T11:15:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011432199999999999 2024-04-26T11:15:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.529239+0000", 2024-04-26T11:15:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108859 2024-04-26T11:15:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:221023 5.4 5:24eebb92:::benchmark_data_smithi029_44842_object76385:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:07.528984+0000", 2024-04-26T11:15:07.541 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0020196010000000002, 2024-04-26T11:15:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021675829999999998, 2024-04-26T11:15:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 221023 2024-04-26T11:15:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.528984+0000", 2024-04-26T11:15:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.528984+0000", 2024-04-26T11:15:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.528984+0000", 2024-04-26T11:15:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.528987+0000", 2024-04-26T11:15:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2600000000000001e-06 2024-04-26T11:15:07.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.528994+0000", 2024-04-26T11:15:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9149999999999999e-06 2024-04-26T11:15:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.528999+0000", 2024-04-26T11:15:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6559999999999997e-06 2024-04-26T11:15:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.529041+0000", 2024-04-26T11:15:07.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2008000000000002e-05 2024-04-26T11:15:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.529169+0000", 2024-04-26T11:15:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012721299999999999 2024-04-26T11:15:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.529289+0000", 2024-04-26T11:15:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120028 2024-04-26T11:15:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:221024 5.e 5:7e1920bf:::benchmark_data_smithi029_44842_object76386:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:07.529008+0000", 2024-04-26T11:15:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0019953839999999998, 2024-04-26T11:15:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0022172009999999998, 2024-04-26T11:15:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 221024 2024-04-26T11:15:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.529008+0000", 2024-04-26T11:15:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.529008+0000", 2024-04-26T11:15:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.529008+0000", 2024-04-26T11:15:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.529010+0000", 2024-04-26T11:15:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3489999999999999e-06 2024-04-26T11:15:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.529016+0000", 2024-04-26T11:15:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1940000000000003e-06 2024-04-26T11:15:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.529023+0000", 2024-04-26T11:15:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.815e-06 2024-04-26T11:15:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.529065+0000", 2024-04-26T11:15:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1545999999999998e-05 2024-04-26T11:15:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.529169+0000", 2024-04-26T11:15:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104737 2024-04-26T11:15:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.529233+0000", 2024-04-26T11:15:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3460999999999994e-05 2024-04-26T11:15:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.549 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:07.550 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.550 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:221025 5.f 5:fe316905:::benchmark_data_smithi029_44842_object76387:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:07.550 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:07.529112+0000", 2024-04-26T11:15:07.550 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0018918349999999999, 2024-04-26T11:15:07.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021744490000000002, 2024-04-26T11:15:07.550 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:07.550 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:07.550 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:07.550 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:07.550 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.550 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 221025 2024-04-26T11:15:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.529112+0000", 2024-04-26T11:15:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.529112+0000", 2024-04-26T11:15:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:07.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.529111+0000", 2024-04-26T11:15:07.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:07.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:07.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.529115+0000", 2024-04-26T11:15:07.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7390000000000001e-06 2024-04-26T11:15:07.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:07.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.529122+0000", 2024-04-26T11:15:07.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2919999999999998e-06 2024-04-26T11:15:07.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.529128+0000", 2024-04-26T11:15:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0859999999999998e-06 2024-04-26T11:15:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.529662+0000", 2024-04-26T11:15:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00053414999999999995 2024-04-26T11:15:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.529787+0000", 2024-04-26T11:15:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012408499999999999 2024-04-26T11:15:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:07.553 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:221011 5.a 5:5e30c8d0:::benchmark_data_smithi029_44842_object76373:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:07.525349+0000", 2024-04-26T11:15:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0056551079999999998, 2024-04-26T11:15:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059829419999999998, 2024-04-26T11:15:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 221011 2024-04-26T11:15:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.554 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.525349+0000", 2024-04-26T11:15:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.525349+0000", 2024-04-26T11:15:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.525348+0000", 2024-04-26T11:15:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:07.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.525352+0000", 2024-04-26T11:15:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6e-06 2024-04-26T11:15:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.525362+0000", 2024-04-26T11:15:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2830000000000007e-06 2024-04-26T11:15:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.525367+0000", 2024-04-26T11:15:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6860000000000003e-06 2024-04-26T11:15:07.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.525398+0000", 2024-04-26T11:15:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0556999999999999e-05 2024-04-26T11:15:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.525470+0000", 2024-04-26T11:15:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2410000000000006e-05 2024-04-26T11:15:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.525533+0000", 2024-04-26T11:15:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2720999999999998e-05 2024-04-26T11:15:07.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.527155+0000", 2024-04-26T11:15:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001622374 2024-04-26T11:15:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:221015 5.e 5:72c1daa3:::benchmark_data_smithi029_44842_object76377:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:07.526547+0000", 2024-04-26T11:15:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0044563329999999998, 2024-04-26T11:15:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048672330000000003, 2024-04-26T11:15:07.558 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 221015 2024-04-26T11:15:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.526547+0000", 2024-04-26T11:15:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:07.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.526547+0000", 2024-04-26T11:15:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.526547+0000", 2024-04-26T11:15:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.526549+0000", 2024-04-26T11:15:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9879999999999999e-06 2024-04-26T11:15:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:07.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.526555+0000", 2024-04-26T11:15:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.631e-06 2024-04-26T11:15:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.526559+0000", 2024-04-26T11:15:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6920000000000001e-06 2024-04-26T11:15:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.526598+0000", 2024-04-26T11:15:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8858e-05 2024-04-26T11:15:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.526709+0000", 2024-04-26T11:15:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000110802 2024-04-26T11:15:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.526813+0000", 2024-04-26T11:15:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103659 2024-04-26T11:15:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.530793+0000", 2024-04-26T11:15:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039800319999999997 2024-04-26T11:15:07.562 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:221017 5.4 5:2854146c:::benchmark_data_smithi029_44842_object76379:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:07.526568+0000", 2024-04-26T11:15:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0044355139999999998, 2024-04-26T11:15:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049463479999999997, 2024-04-26T11:15:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.563 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 221017 2024-04-26T11:15:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.526568+0000", 2024-04-26T11:15:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.526568+0000", 2024-04-26T11:15:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:07.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.526568+0000", 2024-04-26T11:15:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.526570+0000", 2024-04-26T11:15:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.8250000000000001e-06 2024-04-26T11:15:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.526573+0000", 2024-04-26T11:15:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6349999999999999e-06 2024-04-26T11:15:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.526576+0000", 2024-04-26T11:15:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8420000000000001e-06 2024-04-26T11:15:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.526610+0000", 2024-04-26T11:15:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3606000000000003e-05 2024-04-26T11:15:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.526728+0000", 2024-04-26T11:15:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000118486 2024-04-26T11:15:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.526832+0000", 2024-04-26T11:15:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000103396 2024-04-26T11:15:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:07.528650+0000", 2024-04-26T11:15:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018182350000000001 2024-04-26T11:15:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:15:07.567 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 8 2024-04-26T11:15:07.567 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:07.569 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:07.567+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:07.569 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:07.669 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:07.668+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:07.770 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:07.769+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:07.772 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:07.772 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:15:07.772 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:15:07.772 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:15:07.772 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:07.785 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:07.872 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:07.871+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:07.956 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:07.956 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:15:07.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:15:07.956 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:15:07.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.956 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:07.956 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:07.956 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 74.674484605000004, 2024-04-26T11:15:07.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:15:07.957 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:07.957 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:07.957 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:07.957 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:07.957 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.957 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:15:07.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.957 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:07.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:07.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:07.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:07.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:07.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:07.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:07.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:07.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:07.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:15:07.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:15:07.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:07.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:15:07.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:15:07.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:15:07.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:15:07.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:07.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:15:07.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:15:07.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:07.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:15:07.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:15:07.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:07.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:15:07.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:15:07.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:07.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:15:07.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:15:07.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:07.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:15:07.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:15:07.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:07.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:15:07.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:15:07.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:07.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:15:07.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:15:07.962 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.962 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:07.962 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.962 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:07.962 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:07.962 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 74.673834902999999, 2024-04-26T11:15:07.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:15:07.962 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:07.963 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:07.963 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:07.963 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:07.963 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.963 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:15:07.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.963 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:07.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:07.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:07.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:07.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:07.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:07.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:15:07.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:07.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:07.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:15:07.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:15:07.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:07.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:15:07.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:15:07.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:15:07.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:15:07.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:07.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:15:07.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:15:07.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.965 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:07.965 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:15:07.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:15:07.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:07.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:15:07.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:15:07.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:07.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:15:07.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:15:07.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:07.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:15:07.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:15:07.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:07.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:15:07.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:15:07.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:07.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:15:07.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:15:07.967 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.967 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:07.967 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.968 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:07.968 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:07.968 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 70.607192863999998, 2024-04-26T11:15:07.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:15:07.968 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:07.968 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:07.968 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:07.968 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:07.968 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.968 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:15:07.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.968 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:07.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:07.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:07.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:07.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:07.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:07.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:15:07.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:07.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:07.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:15:07.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:15:07.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:07.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:15:07.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:15:07.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:15:07.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:15:07.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:07.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:15:07.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:15:07.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:07.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:15:07.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:15:07.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:07.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:15:07.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:15:07.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:07.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:15:07.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:15:07.972 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.972 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:07.972 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.972 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:07.972 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:07.973 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 70.607097218000007, 2024-04-26T11:15:07.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:15:07.973 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:07.973 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:07.973 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:07.973 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:07.973 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.973 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:15:07.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.973 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:07.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:07.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:07.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:07.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:07.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:07.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:15:07.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:07.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:07.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:15:07.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:15:07.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:07.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:15:07.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:15:07.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:15:07.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:15:07.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:07.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:15:07.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:15:07.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:07.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:15:07.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:15:07.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:07.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:15:07.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:15:07.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:07.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:15:07.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:15:07.977 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.978 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:07.978 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.978 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:07.978 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:07.978 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 70.606965539000001, 2024-04-26T11:15:07.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:15:07.978 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:07.978 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:07.978 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:07.978 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:07.978 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.979 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:15:07.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.979 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:07.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:07.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:07.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:07.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:07.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:07.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:07.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:07.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:07.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:15:07.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:15:07.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:07.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:15:07.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:15:07.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:15:07.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:15:07.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:07.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:15:07.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:15:07.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.982 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:07.982 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:15:07.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:15:07.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:07.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:15:07.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:15:07.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:07.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:15:07.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:15:07.987 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.987 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:07.987 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.987 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:07.987 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:07.987 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 70.606857082999994, 2024-04-26T11:15:07.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:15:07.987 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:07.988 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:07.988 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:07.988 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:07.988 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.988 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:15:07.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.988 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:07.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:07.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:07.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:07.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:07.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:07.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:15:07.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:07.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:07.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:15:07.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:15:07.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:07.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:15:07.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:15:07.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:15:07.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:15:07.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:07.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:15:07.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:15:07.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:07.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:15:07.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:15:07.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:07.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:15:07.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:15:07.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:07.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:15:07.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:15:07.992 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.992 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:07.992 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.992 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:07.992 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:07.992 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 70.606755815, 2024-04-26T11:15:07.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:15:07.992 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:07.993 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:07.993 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:07.993 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:07.993 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.993 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:15:07.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.993 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:07.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:07.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:07.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:07.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:07.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:07.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:07.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:07.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:07.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:15:07.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:15:07.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:07.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:15:07.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:15:07.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:07.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:15:07.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:15:07.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:07.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:15:07.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:15:07.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:07.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:15:07.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:15:07.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:07.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:15:07.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:15:07.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:07.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:15:07.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:15:07.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:07.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:15:07.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:15:07.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:07.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:15:07.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:15:07.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:07.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:15:07.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:15:07.998 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.998 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:07.998 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:07.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.998 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:07.998 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:07.998 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 70.606686874000005, 2024-04-26T11:15:07.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:15:07.999 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:07.999 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:07.999 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:07.999 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:07.999 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:07.999 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:15:07.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.999 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:07.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:07.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:07.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:07.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:07.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:07.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:08.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:08.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:08.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:15:08.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:08.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:08.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:15:08.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:15:08.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:08.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:15:08.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:15:08.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:15:08.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:15:08.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:08.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:15:08.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:15:08.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:08.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:15:08.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:15:08.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:08.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:15:08.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:15:08.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:08.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:15:08.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:15:08.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:08.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:15:08.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:15:08.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:08.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:15:08.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:15:08.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:08.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:15:08.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:15:08.004 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.004 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:08.004 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.004 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:08.004 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:08.004 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 70.600691292999997, 2024-04-26T11:15:08.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:15:08.004 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:08.004 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:08.004 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:08.005 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:08.005 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.005 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:15:08.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.005 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:08.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:08.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:08.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:08.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:08.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:08.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:15:08.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:08.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:08.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:15:08.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:15:08.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:08.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:15:08.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:15:08.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:15:08.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:15:08.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:08.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:15:08.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:15:08.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:08.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:15:08.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:15:08.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:08.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:15:08.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:15:08.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:08.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:15:08.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:15:08.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:08.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:15:08.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:15:08.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:08.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:15:08.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:15:08.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:08.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:15:08.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:15:08.009 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.009 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:08.009 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.010 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101754 5.e 5:7ca15a5c:::benchmark_data_smithi029_44842_object101753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:08.010 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:08.010 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 48.834743551000003, 2024-04-26T11:15:08.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039171048999999999, 2024-04-26T11:15:08.010 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:08.010 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:08.010 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:08.010 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:08.010 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.010 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101754 2024-04-26T11:15:08.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.010 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:08.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:08.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:08.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:08.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:08.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:08.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:08.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:08.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:08.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118604+0000", 2024-04-26T11:15:08.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3399000000000007e-05 2024-04-26T11:15:08.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:08.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118613+0000", 2024-04-26T11:15:08.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6989999999999992e-06 2024-04-26T11:15:08.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118618+0000", 2024-04-26T11:15:08.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3850000000000001e-06 2024-04-26T11:15:08.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:08.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118646+0000", 2024-04-26T11:15:08.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7878e-05 2024-04-26T11:15:08.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:08.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118720+0000", 2024-04-26T11:15:08.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3461999999999996e-05 2024-04-26T11:15:08.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:08.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118807+0000", 2024-04-26T11:15:08.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7269999999999996e-05 2024-04-26T11:15:08.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:08.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142317+0000", 2024-04-26T11:15:08.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023510105999999999 2024-04-26T11:15:08.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:08.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.143287+0000", 2024-04-26T11:15:08.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096983599999999996 2024-04-26T11:15:08.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:08.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157662+0000", 2024-04-26T11:15:08.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014375393 2024-04-26T11:15:08.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:08.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157702+0000", 2024-04-26T11:15:08.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0295e-05 2024-04-26T11:15:08.015 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.015 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:08.015 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.015 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101755 5.f 5:fa973a83:::benchmark_data_smithi029_44842_object101754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:08.015 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:15:08.015 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 48.834577854999999, 2024-04-26T11:15:08.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039139064000000001, 2024-04-26T11:15:08.016 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:08.016 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:08.016 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:08.016 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:08.016 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.016 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101755 2024-04-26T11:15:08.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.016 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:08.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:08.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:15:08.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:08.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:15:08.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:08.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118696+0000", 2024-04-26T11:15:08.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:08.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:08.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118766+0000", 2024-04-26T11:15:08.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9423000000000003e-05 2024-04-26T11:15:08.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:08.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118774+0000", 2024-04-26T11:15:08.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9710000000000004e-06 2024-04-26T11:15:08.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118779+0000", 2024-04-26T11:15:08.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5629999999999999e-06 2024-04-26T11:15:08.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:08.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118817+0000", 2024-04-26T11:15:08.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7771000000000001e-05 2024-04-26T11:15:08.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:08.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118929+0000", 2024-04-26T11:15:08.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011222699999999999 2024-04-26T11:15:08.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:08.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157661+0000", 2024-04-26T11:15:08.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038731120000000001 2024-04-26T11:15:08.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:08.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157757+0000", 2024-04-26T11:15:08.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6910000000000006e-05 2024-04-26T11:15:08.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:08.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157836+0000", 2024-04-26T11:15:08.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8727999999999996e-05 2024-04-26T11:15:08.020 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.020 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:08.020 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.020 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101758 5.4 5:2525a4eb:::benchmark_data_smithi029_44842_object101757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:08.020 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:15:08.020 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 48.832395003999999, 2024-04-26T11:15:08.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.03686739, 2024-04-26T11:15:08.020 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:08.021 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:08.021 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:08.021 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:08.021 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.021 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101758 2024-04-26T11:15:08.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.021 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:08.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:08.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:15:08.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:08.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:15:08.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:08.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120879+0000", 2024-04-26T11:15:08.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:08.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:08.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120971+0000", 2024-04-26T11:15:08.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2133999999999996e-05 2024-04-26T11:15:08.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:08.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120977+0000", 2024-04-26T11:15:08.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5509999999999999e-06 2024-04-26T11:15:08.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120981+0000", 2024-04-26T11:15:08.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.245e-06 2024-04-26T11:15:08.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:08.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121010+0000", 2024-04-26T11:15:08.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9084000000000001e-05 2024-04-26T11:15:08.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:08.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121083+0000", 2024-04-26T11:15:08.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2942999999999996e-05 2024-04-26T11:15:08.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:08.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121163+0000", 2024-04-26T11:15:08.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0197000000000005e-05 2024-04-26T11:15:08.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:08.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142822+0000", 2024-04-26T11:15:08.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021658535999999999 2024-04-26T11:15:08.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:08.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157674+0000", 2024-04-26T11:15:08.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014851573999999999 2024-04-26T11:15:08.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:08.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157714+0000", 2024-04-26T11:15:08.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0473999999999999e-05 2024-04-26T11:15:08.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:08.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157747+0000", 2024-04-26T11:15:08.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3278999999999998e-05 2024-04-26T11:15:08.025 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.026 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:08.026 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.026 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101760 5.4 5:2510211a:::benchmark_data_smithi029_44842_object101759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:08.026 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:08.026 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 48.831962658999998, 2024-04-26T11:15:08.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039182383000000001, 2024-04-26T11:15:08.026 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:08.026 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:08.026 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:08.026 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:08.026 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.026 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101760 2024-04-26T11:15:08.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.027 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:08.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:08.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:08.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:08.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:08.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:08.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:08.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:08.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:08.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121389+0000", 2024-04-26T11:15:08.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6667000000000003e-05 2024-04-26T11:15:08.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:08.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121394+0000", 2024-04-26T11:15:08.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0839999999999999e-06 2024-04-26T11:15:08.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121397+0000", 2024-04-26T11:15:08.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4489999999999999e-06 2024-04-26T11:15:08.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:08.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122921+0000", 2024-04-26T11:15:08.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001524067 2024-04-26T11:15:08.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:08.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.123010+0000", 2024-04-26T11:15:08.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8449000000000006e-05 2024-04-26T11:15:08.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:08.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140838+0000", 2024-04-26T11:15:08.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017828796000000001 2024-04-26T11:15:08.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:08.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157665+0000", 2024-04-26T11:15:08.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016826574 2024-04-26T11:15:08.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:08.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160407+0000", 2024-04-26T11:15:08.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027423970000000002 2024-04-26T11:15:08.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:08.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160456+0000", 2024-04-26T11:15:08.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8678999999999999e-05 2024-04-26T11:15:08.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:08.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160495+0000", 2024-04-26T11:15:08.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8658000000000002e-05 2024-04-26T11:15:08.031 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.031 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:08.031 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.031 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101761 5.e 5:70294421:::benchmark_data_smithi029_44842_object101760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:08.032 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:15:08.032 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 48.830538285999999, 2024-04-26T11:15:08.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035270448000000003, 2024-04-26T11:15:08.032 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:08.032 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:08.032 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:08.032 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:08.032 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.032 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101761 2024-04-26T11:15:08.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.032 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:08.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:08.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:15:08.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:08.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:15:08.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:08.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122736+0000", 2024-04-26T11:15:08.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:08.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:08.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122805+0000", 2024-04-26T11:15:08.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9076000000000001e-05 2024-04-26T11:15:08.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:08.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122811+0000", 2024-04-26T11:15:08.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:15:08.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122815+0000", 2024-04-26T11:15:08.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2860000000000001e-06 2024-04-26T11:15:08.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:08.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122842+0000", 2024-04-26T11:15:08.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6429000000000001e-05 2024-04-26T11:15:08.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:08.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122916+0000", 2024-04-26T11:15:08.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4122999999999995e-05 2024-04-26T11:15:08.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:08.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122997+0000", 2024-04-26T11:15:08.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1428999999999996e-05 2024-04-26T11:15:08.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:08.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142344+0000", 2024-04-26T11:15:08.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019346452 2024-04-26T11:15:08.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:08.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157934+0000", 2024-04-26T11:15:08.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015589911999999999 2024-04-26T11:15:08.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:08.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157975+0000", 2024-04-26T11:15:08.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1604999999999999e-05 2024-04-26T11:15:08.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:08.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.158007+0000", 2024-04-26T11:15:08.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1921000000000002e-05 2024-04-26T11:15:08.037 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.037 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:08.037 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.037 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110145 5.9 5:9b275f16:::benchmark_data_smithi029_44842_object110144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:15:08.037 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:15:08.037 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 44.804976648, 2024-04-26T11:15:08.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032844496000000001, 2024-04-26T11:15:08.037 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:08.037 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:08.037 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:08.037 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:08.037 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.038 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110145 2024-04-26T11:15:08.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.038 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:08.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:08.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:15:08.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:08.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:15:08.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:08.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148297+0000", 2024-04-26T11:15:08.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:08.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:08.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148325+0000", 2024-04-26T11:15:08.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7511000000000001e-05 2024-04-26T11:15:08.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:08.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148338+0000", 2024-04-26T11:15:08.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2808e-05 2024-04-26T11:15:08.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148345+0000", 2024-04-26T11:15:08.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7200000000000006e-06 2024-04-26T11:15:08.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:08.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149888+0000", 2024-04-26T11:15:08.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001542666 2024-04-26T11:15:08.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:08.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149977+0000", 2024-04-26T11:15:08.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9247999999999997e-05 2024-04-26T11:15:08.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:08.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181006+0000", 2024-04-26T11:15:08.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031028535999999999 2024-04-26T11:15:08.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:08.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181051+0000", 2024-04-26T11:15:08.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5393999999999999e-05 2024-04-26T11:15:08.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:08.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181143+0000", 2024-04-26T11:15:08.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1458000000000004e-05 2024-04-26T11:15:08.041 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.042 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:08.042 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.042 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110155 5.9 5:9ebc6158:::benchmark_data_smithi029_44842_object110154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:15:08.042 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:15:08.042 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 44.799900856000001, 2024-04-26T11:15:08.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027886826999999999, 2024-04-26T11:15:08.042 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:08.042 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:08.042 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:08.042 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:08.042 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.042 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110155 2024-04-26T11:15:08.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.043 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:08.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:08.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:15:08.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:08.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:15:08.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:08.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153373+0000", 2024-04-26T11:15:08.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:08.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:08.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153479+0000", 2024-04-26T11:15:08.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105728 2024-04-26T11:15:08.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:08.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153491+0000", 2024-04-26T11:15:08.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2207e-05 2024-04-26T11:15:08.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153499+0000", 2024-04-26T11:15:08.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7729999999999999e-06 2024-04-26T11:15:08.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:08.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153655+0000", 2024-04-26T11:15:08.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015573 2024-04-26T11:15:08.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:08.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153770+0000", 2024-04-26T11:15:08.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011562500000000001 2024-04-26T11:15:08.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:08.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181153+0000", 2024-04-26T11:15:08.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027382113 2024-04-26T11:15:08.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:08.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181195+0000", 2024-04-26T11:15:08.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1921000000000001e-05 2024-04-26T11:15:08.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.046 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:08.046 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181261+0000", 2024-04-26T11:15:08.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6402999999999994e-05 2024-04-26T11:15:08.046 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.047 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:08.047 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.047 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174398 5.4 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:08.047 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:08.047 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.603384643999998, 2024-04-26T11:15:08.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.064773789999999998, 2024-04-26T11:15:08.047 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:08.047 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:08.047 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:08.047 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:08.047 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.047 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174398 2024-04-26T11:15:08.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.048 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:08.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:08.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:08.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:08.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:08.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:08.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349889+0000", 2024-04-26T11:15:08.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:08.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:08.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349895+0000", 2024-04-26T11:15:08.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4519999999999996e-06 2024-04-26T11:15:08.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:08.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349909+0000", 2024-04-26T11:15:08.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3791000000000001e-05 2024-04-26T11:15:08.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.049 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.049 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349919+0000", 2024-04-26T11:15:08.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0135999999999999e-05 2024-04-26T11:15:08.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:08.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349956+0000", 2024-04-26T11:15:08.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7642000000000003e-05 2024-04-26T11:15:08.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:08.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350080+0000", 2024-04-26T11:15:08.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123285 2024-04-26T11:15:08.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:08.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350192+0000", 2024-04-26T11:15:08.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112509 2024-04-26T11:15:08.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:08.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356232+0000", 2024-04-26T11:15:08.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060403339999999996 2024-04-26T11:15:08.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:08.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414616+0000", 2024-04-26T11:15:08.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.058383156999999998 2024-04-26T11:15:08.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:08.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414643+0000", 2024-04-26T11:15:08.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7317e-05 2024-04-26T11:15:08.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:08.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414664+0000", 2024-04-26T11:15:08.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1135999999999999e-05 2024-04-26T11:15:08.052 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.052 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:08.052 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.052 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174402 5.b 5:d8ad746d:::benchmark_data_smithi029_44842_object29764:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:08.052 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:08.053 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.599430455, 2024-04-26T11:15:08.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059017657000000001, 2024-04-26T11:15:08.053 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:08.053 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:08.053 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:08.053 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:08.053 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.053 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174402 2024-04-26T11:15:08.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.053 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:08.053 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:08.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:08.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.053 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:08.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:08.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:08.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:08.054 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:08.054 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.054 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.054 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:08.054 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353848+0000", 2024-04-26T11:15:08.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5040000000000004e-06 2024-04-26T11:15:08.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:08.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353858+0000", 2024-04-26T11:15:08.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7410000000000004e-06 2024-04-26T11:15:08.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353864+0000", 2024-04-26T11:15:08.055 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7899999999999996e-06 2024-04-26T11:15:08.055 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.055 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.055 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:08.055 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353902+0000", 2024-04-26T11:15:08.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8325000000000003e-05 2024-04-26T11:15:08.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:08.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353980+0000", 2024-04-26T11:15:08.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8077000000000005e-05 2024-04-26T11:15:08.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:08.056 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354046+0000", 2024-04-26T11:15:08.056 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6249999999999998e-05 2024-04-26T11:15:08.056 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.056 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.056 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:08.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356532+0000", 2024-04-26T11:15:08.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024850969999999999 2024-04-26T11:15:08.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:08.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412796+0000", 2024-04-26T11:15:08.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056264616000000003 2024-04-26T11:15:08.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:08.057 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412835+0000", 2024-04-26T11:15:08.057 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8863999999999999e-05 2024-04-26T11:15:08.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.057 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.057 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:08.058 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412862+0000", 2024-04-26T11:15:08.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7124e-05 2024-04-26T11:15:08.058 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.058 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:08.058 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.058 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.058 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174403 5.4 5:2d30cd6a:::benchmark_data_smithi029_44842_object29765:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:08.058 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:15:08.058 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.599403251999998, 2024-04-26T11:15:08.058 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.060873365999999998, 2024-04-26T11:15:08.058 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:08.058 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:08.058 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:08.059 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:08.059 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.059 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174403 2024-04-26T11:15:08.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.059 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:08.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:08.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:15:08.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.059 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.059 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:08.059 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:15:08.059 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:08.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353871+0000", 2024-04-26T11:15:08.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:08.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:08.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353874+0000", 2024-04-26T11:15:08.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869999999999999e-06 2024-04-26T11:15:08.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.060 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.060 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:08.060 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353881+0000", 2024-04-26T11:15:08.060 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2239999999999998e-06 2024-04-26T11:15:08.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353886+0000", 2024-04-26T11:15:08.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.259e-06 2024-04-26T11:15:08.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:08.061 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353912+0000", 2024-04-26T11:15:08.061 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6404999999999999e-05 2024-04-26T11:15:08.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.061 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.061 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:08.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353991+0000", 2024-04-26T11:15:08.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8104999999999998e-05 2024-04-26T11:15:08.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:08.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354055+0000", 2024-04-26T11:15:08.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4875999999999993e-05 2024-04-26T11:15:08.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.062 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:08.062 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.358000+0000", 2024-04-26T11:15:08.062 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039442629999999999 2024-04-26T11:15:08.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.062 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:08.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414690+0000", 2024-04-26T11:15:08.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056689940000000001 2024-04-26T11:15:08.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:08.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414714+0000", 2024-04-26T11:15:08.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4527000000000001e-05 2024-04-26T11:15:08.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.063 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.063 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:08.063 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414745+0000", 2024-04-26T11:15:08.063 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0874999999999998e-05 2024-04-26T11:15:08.063 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.063 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:08.064 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.064 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.064 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174404 5.4 5:2801f1e1:::benchmark_data_smithi029_44842_object29766:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:08.064 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:15:08.064 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 17.596786328, 2024-04-26T11:15:08.064 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059745741999999998, 2024-04-26T11:15:08.064 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:08.064 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:08.064 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:08.064 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:08.064 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.064 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174404 2024-04-26T11:15:08.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.065 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:08.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:08.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:15:08.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:08.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:15:08.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:08.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.065 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.065 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:08.065 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356488+0000", 2024-04-26T11:15:08.065 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:08.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:08.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356492+0000", 2024-04-26T11:15:08.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1169999999999997e-06 2024-04-26T11:15:08.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:08.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356502+0000", 2024-04-26T11:15:08.066 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0263e-05 2024-04-26T11:15:08.066 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.066 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.066 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.066 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356508+0000", 2024-04-26T11:15:08.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5890000000000002e-06 2024-04-26T11:15:08.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:08.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356545+0000", 2024-04-26T11:15:08.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7382999999999998e-05 2024-04-26T11:15:08.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:08.067 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356671+0000", 2024-04-26T11:15:08.067 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012535500000000001 2024-04-26T11:15:08.067 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.067 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.067 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:08.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356789+0000", 2024-04-26T11:15:08.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000118099 2024-04-26T11:15:08.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:08.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.359200+0000", 2024-04-26T11:15:08.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024110059999999998 2024-04-26T11:15:08.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:08.068 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416180+0000", 2024-04-26T11:15:08.068 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056980335999999999 2024-04-26T11:15:08.068 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.068 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.068 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:08.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416204+0000", 2024-04-26T11:15:08.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4301e-05 2024-04-26T11:15:08.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:08.069 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:08.069 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:08.069 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416234+0000", 2024-04-26T11:15:08.069 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9903000000000002e-05 2024-04-26T11:15:08.069 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.069 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:08.069 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.069 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:08.069 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:08.069 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:08.071 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:08.069+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:08.071 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:08.172 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:08.171+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:08.246 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:08.246 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:15:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:222914 5.5 5:a80215f0:::benchmark_data_smithi029_44842_object78276:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:08.232853+0000", 2024-04-26T11:15:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0082476730000000005, 2024-04-26T11:15:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0082670739999999993, 2024-04-26T11:15:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 222914 2024-04-26T11:15:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.232853+0000", 2024-04-26T11:15:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.232853+0000", 2024-04-26T11:15:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.232852+0000", 2024-04-26T11:15:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.232855+0000", 2024-04-26T11:15:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5610000000000001e-06 2024-04-26T11:15:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.232862+0000", 2024-04-26T11:15:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.109e-06 2024-04-26T11:15:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.232868+0000", 2024-04-26T11:15:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7899999999999996e-06 2024-04-26T11:15:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.235939+0000", 2024-04-26T11:15:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0030714610000000002 2024-04-26T11:15:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.236024+0000", 2024-04-26T11:15:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4500999999999996e-05 2024-04-26T11:15:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:222915 5.7 5:ee7d4b38:::benchmark_data_smithi029_44842_object78277:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:08.232874+0000", 2024-04-26T11:15:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0082259959999999993, 2024-04-26T11:15:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0083181420000000006, 2024-04-26T11:15:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 222915 2024-04-26T11:15:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.232874+0000", 2024-04-26T11:15:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.232874+0000", 2024-04-26T11:15:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.232874+0000", 2024-04-26T11:15:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.232877+0000", 2024-04-26T11:15:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8310000000000001e-06 2024-04-26T11:15:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.232883+0000", 2024-04-26T11:15:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5270000000000004e-06 2024-04-26T11:15:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.232889+0000", 2024-04-26T11:15:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.993e-06 2024-04-26T11:15:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.236215+0000", 2024-04-26T11:15:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003325915 2024-04-26T11:15:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.236366+0000", 2024-04-26T11:15:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00015086799999999999 2024-04-26T11:15:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:222916 5.7 5:ebfd63d7:::benchmark_data_smithi029_44842_object78278:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:08.233096+0000", 2024-04-26T11:15:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0080049370000000002, 2024-04-26T11:15:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0081808130000000003, 2024-04-26T11:15:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 222916 2024-04-26T11:15:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.233096+0000", 2024-04-26T11:15:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.233096+0000", 2024-04-26T11:15:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.233095+0000", 2024-04-26T11:15:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.257 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:08.257 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.233099+0000", 2024-04-26T11:15:08.257 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.3250000000000001e-06 2024-04-26T11:15:08.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.257 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.257 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:08.257 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.233110+0000", 2024-04-26T11:15:08.257 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1123e-05 2024-04-26T11:15:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.233117+0000", 2024-04-26T11:15:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9360000000000002e-06 2024-04-26T11:15:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238107+0000", 2024-04-26T11:15:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0049898859999999998 2024-04-26T11:15:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238221+0000", 2024-04-26T11:15:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000113739 2024-04-26T11:15:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:222921 5.7 5:e5d718ec:::benchmark_data_smithi029_44842_object78283:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:08.235364+0000", 2024-04-26T11:15:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0057362400000000001, 2024-04-26T11:15:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0059891479999999997, 2024-04-26T11:15:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 222921 2024-04-26T11:15:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.235364+0000", 2024-04-26T11:15:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.235364+0000", 2024-04-26T11:15:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.235364+0000", 2024-04-26T11:15:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.235368+0000", 2024-04-26T11:15:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6500000000000004e-06 2024-04-26T11:15:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.235378+0000", 2024-04-26T11:15:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4020000000000008e-06 2024-04-26T11:15:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.235383+0000", 2024-04-26T11:15:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0769999999999998e-06 2024-04-26T11:15:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.239811+0000", 2024-04-26T11:15:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0044285430000000001 2024-04-26T11:15:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.239921+0000", 2024-04-26T11:15:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000109831 2024-04-26T11:15:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:222923 5.6 5:6691ccc2:::benchmark_data_smithi029_44842_object78285:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:08.237847+0000", 2024-04-26T11:15:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0032531959999999999, 2024-04-26T11:15:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0035840889999999999, 2024-04-26T11:15:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 222923 2024-04-26T11:15:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.237847+0000", 2024-04-26T11:15:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.237847+0000", 2024-04-26T11:15:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.237846+0000", 2024-04-26T11:15:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.237852+0000", 2024-04-26T11:15:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5559999999999998e-06 2024-04-26T11:15:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.237863+0000", 2024-04-26T11:15:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0715e-05 2024-04-26T11:15:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.237871+0000", 2024-04-26T11:15:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5220000000000007e-06 2024-04-26T11:15:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.237910+0000", 2024-04-26T11:15:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8850000000000002e-05 2024-04-26T11:15:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238043+0000", 2024-04-26T11:15:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013263500000000001 2024-04-26T11:15:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:222925 5.3 5:c9f42596:::benchmark_data_smithi029_44842_object78287:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:08.237963+0000", 2024-04-26T11:15:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0031371070000000001, 2024-04-26T11:15:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0035480490000000002, 2024-04-26T11:15:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 222925 2024-04-26T11:15:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.237963+0000", 2024-04-26T11:15:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.237963+0000", 2024-04-26T11:15:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.237963+0000", 2024-04-26T11:15:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.237967+0000", 2024-04-26T11:15:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4939999999999997e-06 2024-04-26T11:15:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.237979+0000", 2024-04-26T11:15:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1747e-05 2024-04-26T11:15:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.237986+0000", 2024-04-26T11:15:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2010000000000002e-06 2024-04-26T11:15:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238028+0000", 2024-04-26T11:15:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2478999999999998e-05 2024-04-26T11:15:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238165+0000", 2024-04-26T11:15:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136444 2024-04-26T11:15:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:222926 5.5 5:a2cda2d2:::benchmark_data_smithi029_44842_object78288:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:08.237996+0000", 2024-04-26T11:15:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0031046229999999999, 2024-04-26T11:15:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0035886199999999998, 2024-04-26T11:15:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 222926 2024-04-26T11:15:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.237996+0000", 2024-04-26T11:15:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.237996+0000", 2024-04-26T11:15:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.237995+0000", 2024-04-26T11:15:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.237998+0000", 2024-04-26T11:15:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7199999999999998e-06 2024-04-26T11:15:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238007+0000", 2024-04-26T11:15:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.0000000000000002e-06 2024-04-26T11:15:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238013+0000", 2024-04-26T11:15:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3029999999999996e-06 2024-04-26T11:15:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238044+0000", 2024-04-26T11:15:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0803999999999998e-05 2024-04-26T11:15:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238154+0000", 2024-04-26T11:15:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010993999999999999 2024-04-26T11:15:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:222928 5.5 5:a683a299:::benchmark_data_smithi029_44842_object78290:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:08.238023+0000", 2024-04-26T11:15:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0030770060000000002, 2024-04-26T11:15:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003630332, 2024-04-26T11:15:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 222928 2024-04-26T11:15:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238023+0000", 2024-04-26T11:15:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238023+0000", 2024-04-26T11:15:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238023+0000", 2024-04-26T11:15:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238026+0000", 2024-04-26T11:15:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5670000000000002e-06 2024-04-26T11:15:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238033+0000", 2024-04-26T11:15:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1060000000000002e-06 2024-04-26T11:15:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238038+0000", 2024-04-26T11:15:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4659999999999998e-06 2024-04-26T11:15:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.239917+0000", 2024-04-26T11:15:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0018788850000000001 2024-04-26T11:15:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.240064+0000", 2024-04-26T11:15:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014710299999999999 2024-04-26T11:15:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:222929 5.c 5:30dd9f8c:::benchmark_data_smithi029_44842_object78291:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:08.238044+0000", 2024-04-26T11:15:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.003056558, 2024-04-26T11:15:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0036778829999999998, 2024-04-26T11:15:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 222929 2024-04-26T11:15:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238044+0000", 2024-04-26T11:15:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238044+0000", 2024-04-26T11:15:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238043+0000", 2024-04-26T11:15:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238046+0000", 2024-04-26T11:15:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4250000000000001e-06 2024-04-26T11:15:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238052+0000", 2024-04-26T11:15:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1940000000000003e-06 2024-04-26T11:15:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238057+0000", 2024-04-26T11:15:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2020000000000003e-06 2024-04-26T11:15:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238093+0000", 2024-04-26T11:15:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5441999999999997e-05 2024-04-26T11:15:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238207+0000", 2024-04-26T11:15:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000113813 2024-04-26T11:15:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:222930 5.7 5:e6c38900:::benchmark_data_smithi029_44842_object78292:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:08.238123+0000", 2024-04-26T11:15:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.002977707, 2024-04-26T11:15:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0036684719999999999, 2024-04-26T11:15:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 222930 2024-04-26T11:15:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238123+0000", 2024-04-26T11:15:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238123+0000", 2024-04-26T11:15:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238122+0000", 2024-04-26T11:15:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238126+0000", 2024-04-26T11:15:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.16e-06 2024-04-26T11:15:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238136+0000", 2024-04-26T11:15:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.5470000000000002e-06 2024-04-26T11:15:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238142+0000", 2024-04-26T11:15:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8079999999999999e-06 2024-04-26T11:15:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.241175+0000", 2024-04-26T11:15:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003032711 2024-04-26T11:15:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.241310+0000", 2024-04-26T11:15:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013461500000000001 2024-04-26T11:15:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:222931 5.3 5:c5fd84ae:::benchmark_data_smithi029_44842_object78293:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:08.238235+0000", 2024-04-26T11:15:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0028655009999999999, 2024-04-26T11:15:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00362211, 2024-04-26T11:15:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 222931 2024-04-26T11:15:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238235+0000", 2024-04-26T11:15:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238235+0000", 2024-04-26T11:15:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238234+0000", 2024-04-26T11:15:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238239+0000", 2024-04-26T11:15:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4710000000000001e-06 2024-04-26T11:15:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238250+0000", 2024-04-26T11:15:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1379000000000001e-05 2024-04-26T11:15:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.238258+0000", 2024-04-26T11:15:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4329999999999998e-06 2024-04-26T11:15:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.239864+0000", 2024-04-26T11:15:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016067329999999999 2024-04-26T11:15:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.239978+0000", 2024-04-26T11:15:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011397500000000001 2024-04-26T11:15:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:222924 5.b e52/16 5:db12a4cb:::benchmark_data_smithi029_44842_object78286:head v 52'14138, mlcod=52'14136)", 2024-04-26T11:15:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:08.239652+0000", 2024-04-26T11:15:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.001448747, 2024-04-26T11:15:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022713199999999998, 2024-04-26T11:15:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.239652+0000", 2024-04-26T11:15:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.239652+0000", 2024-04-26T11:15:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.239651+0000", 2024-04-26T11:15:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.239658+0000", 2024-04-26T11:15:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7569999999999998e-06 2024-04-26T11:15:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.239666+0000", 2024-04-26T11:15:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6940000000000001e-06 2024-04-26T11:15:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.239672+0000", 2024-04-26T11:15:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0100000000000001e-06 2024-04-26T11:15:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.239855+0000", 2024-04-26T11:15:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00018272699999999999 2024-04-26T11:15:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.239874+0000", 2024-04-26T11:15:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8932000000000001e-05 2024-04-26T11:15:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:222932 5.6 5:680d81a1:::benchmark_data_smithi029_44842_object78294:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:08.240636+0000", 2024-04-26T11:15:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00046490300000000002, 2024-04-26T11:15:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001347158, 2024-04-26T11:15:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 222932 2024-04-26T11:15:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.240636+0000", 2024-04-26T11:15:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.240636+0000", 2024-04-26T11:15:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.240634+0000", 2024-04-26T11:15:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.240640+0000", 2024-04-26T11:15:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:15:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.240652+0000", 2024-04-26T11:15:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1472e-05 2024-04-26T11:15:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.240659+0000", 2024-04-26T11:15:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4710000000000001e-06 2024-04-26T11:15:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.240699+0000", 2024-04-26T11:15:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9694999999999999e-05 2024-04-26T11:15:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.240820+0000", 2024-04-26T11:15:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000121568 2024-04-26T11:15:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:222933 5.a e52/31 5:5bde7902:::benchmark_data_smithi029_44842_object78295:head v 52'14143, mlcod=52'14141)", 2024-04-26T11:15:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:08.241129+0000", 2024-04-26T11:15:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9999719, 2024-04-26T11:15:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00092545699999999997, 2024-04-26T11:15:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.241129+0000", 2024-04-26T11:15:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.241129+0000", 2024-04-26T11:15:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.241128+0000", 2024-04-26T11:15:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.241134+0000", 2024-04-26T11:15:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3300000000000004e-06 2024-04-26T11:15:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.241145+0000", 2024-04-26T11:15:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0973e-05 2024-04-26T11:15:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.241162+0000", 2024-04-26T11:15:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7056000000000001e-05 2024-04-26T11:15:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.241210+0000", 2024-04-26T11:15:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7781000000000002e-05 2024-04-26T11:15:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.241229+0000", 2024-04-26T11:15:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8408000000000001e-05 2024-04-26T11:15:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:222912 5.7 5:e56c5bce:::benchmark_data_smithi029_44842_object78274:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T11:15:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:08.232778+0000", 2024-04-26T11:15:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.008322042, 2024-04-26T11:15:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0093413320000000008, 2024-04-26T11:15:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 222912 2024-04-26T11:15:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.232778+0000", 2024-04-26T11:15:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.232778+0000", 2024-04-26T11:15:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.232778+0000", 2024-04-26T11:15:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.232782+0000", 2024-04-26T11:15:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.844e-06 2024-04-26T11:15:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.232793+0000", 2024-04-26T11:15:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1345000000000001e-05 2024-04-26T11:15:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.232809+0000", 2024-04-26T11:15:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:15:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.232847+0000", 2024-04-26T11:15:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7895000000000002e-05 2024-04-26T11:15:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:08.234309+0000", 2024-04-26T11:15:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001462039 2024-04-26T11:15:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:15:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 15 2024-04-26T11:15:08.307 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:08.308 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:15:08.310 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:08.308+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:08.310 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:08.410 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:08.409+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:08.464 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:15:08.485 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:15:08.485 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:15:08.485 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:15:08.485 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:15:08.487 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:15:08.488 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:15:08.491 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:08.492 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:08.504 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:08.546 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:08.545+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:08.617 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:08.613+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:08.713 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:08.712+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:08.718 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:08.718 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:08.723 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:15:08.732 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:08.814 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:08.813+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:08.907 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:08.907 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:08.915 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:08.914+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:08.922 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:09.016 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:09.015+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:09.117 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~70s 2024-04-26T11:15:09.117 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:09.117+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:09.142 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:09.142 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:09.157 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:09.218 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:09.217+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:09.319 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:09.318+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:09.372 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:09.372 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:09.387 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:09.432 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:09.431+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:09.526 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:09.521+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:09.573 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:09.573 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:09.589 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:09.622 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:09.621+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:09.718 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:15:09.725 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:09.723+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:09.817 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:09.818 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:09.826 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:09.825+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:09.834 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:09.926 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:09.925+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:10.027 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:10.026+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:10.057 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:10.057 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:10.072 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:10.128 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:10.127+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:10.229 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:10.228+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:10.240 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:10.240 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:10.252 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:10.329 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:10.328+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:10.436 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:10.436+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:10.466 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:10.466 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:10.479 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:10.488 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:15:10.531 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:10.530+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:10.633 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:10.632+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:10.643 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:15:10.663 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:15:10.664 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:15:10.664 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:15:10.664 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:15:10.666 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:15:10.666 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:15:10.691 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:10.691 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:15:10.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:15:10.692 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:15:10.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.692 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:10.692 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:10.692 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.409372245, 2024-04-26T11:15:10.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:15:10.692 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:10.692 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:10.692 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:10.692 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:10.693 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:10.693 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:15:10.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.693 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:10.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:10.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:10.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:10.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:10.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:10.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:10.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:10.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:10.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:15:10.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:15:10.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:10.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:15:10.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:15:10.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:10.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:15:10.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:15:10.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:15:10.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:15:10.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:10.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:15:10.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:15:10.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:10.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:15:10.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:15:10.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:10.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:15:10.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:15:10.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:10.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:15:10.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:15:10.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:10.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:15:10.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:15:10.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.698 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:10.698 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:15:10.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:15:10.698 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.698 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:10.698 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.699 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:10.699 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:10.699 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 77.408722542999996, 2024-04-26T11:15:10.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:15:10.699 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:10.699 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:10.699 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:10.699 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:10.699 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:10.699 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:15:10.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.700 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:10.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:10.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:10.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:10.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:10.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:10.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:15:10.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:10.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:10.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:15:10.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:15:10.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:10.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:15:10.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:15:10.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:10.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:15:10.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:15:10.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:15:10.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:15:10.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:10.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:15:10.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:15:10.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:10.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:15:10.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:15:10.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:10.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:15:10.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:15:10.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:10.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:15:10.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:15:10.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:10.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:15:10.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:15:10.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:10.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:15:10.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:15:10.704 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.704 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:10.704 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.705 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:10.705 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:10.705 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.342080503999995, 2024-04-26T11:15:10.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:15:10.705 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:10.705 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:10.705 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:10.705 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:10.705 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:10.705 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:15:10.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.706 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:10.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:10.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:10.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:10.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:10.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:10.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:15:10.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:10.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:10.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:15:10.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:15:10.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:10.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:15:10.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:15:10.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:10.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:15:10.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:15:10.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.708 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.708 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.708 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:15:10.708 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:15:10.708 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:10.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:15:10.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:15:10.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:15:10.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:15:10.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:10.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:15:10.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:15:10.710 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.710 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:10.710 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.710 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:10.710 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:10.710 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.341984858000004, 2024-04-26T11:15:10.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:15:10.710 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:10.710 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:10.710 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:10.710 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:10.710 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:10.711 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:15:10.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.711 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:10.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:10.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:10.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:10.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:10.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.711 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:10.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:15:10.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:10.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:10.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:15:10.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:15:10.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.712 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:10.712 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:15:10.712 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:15:10.712 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.712 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:10.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:15:10.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:15:10.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:15:10.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:15:10.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.713 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.713 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:10.713 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:15:10.713 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:15:10.713 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:15:10.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:15:10.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.714 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:10.714 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:15:10.714 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:15:10.714 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.714 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:10.714 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.714 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.714 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.715 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:10.715 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:10.715 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.341853178999997, 2024-04-26T11:15:10.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:15:10.715 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:10.715 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:10.715 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:10.715 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:10.715 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:10.715 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:15:10.715 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.715 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:10.715 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.715 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:10.715 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:10.715 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:10.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:10.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:10.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:10.716 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:10.716 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.716 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.716 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:10.716 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:15:10.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:15:10.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:10.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:15:10.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:15:10.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:10.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:15:10.717 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:15:10.717 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.717 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.717 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.717 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:15:10.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:15:10.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:10.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:15:10.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:15:10.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.718 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.718 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.718 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:15:10.718 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:15:10.718 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.719 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:10.719 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:15:10.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:15:10.719 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.719 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:10.719 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.719 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.719 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.719 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:10.719 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:10.719 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.341744723000005, 2024-04-26T11:15:10.719 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:15:10.719 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:10.719 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:10.720 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:10.720 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:10.720 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:10.720 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:15:10.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.720 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:10.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:10.720 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:10.720 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.720 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.720 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.720 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:10.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:10.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:10.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:15:10.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:10.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:10.721 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:15:10.721 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:15:10.721 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.721 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.721 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:10.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:15:10.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:15:10.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:10.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:15:10.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:15:10.722 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.722 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.722 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.722 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:15:10.722 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:15:10.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:10.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:15:10.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:15:10.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:15:10.723 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:15:10.723 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.723 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.723 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:10.723 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:15:10.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:15:10.724 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.724 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:10.724 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.724 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.724 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.724 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:10.724 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:10.724 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.341643454999996, 2024-04-26T11:15:10.724 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:15:10.724 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:10.724 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:10.725 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:10.725 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:10.725 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:10.725 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:15:10.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.725 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:10.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:10.725 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:10.725 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.725 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.725 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.725 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:10.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:10.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:10.726 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:10.726 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:10.726 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.726 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.726 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:10.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:15:10.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:15:10.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:10.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:15:10.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:15:10.727 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.727 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.727 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:10.727 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:15:10.727 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:15:10.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:15:10.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:15:10.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.728 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:10.728 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:15:10.728 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:15:10.728 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.728 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:15:10.729 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:15:10.729 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.729 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.729 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:10.729 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:15:10.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:15:10.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:10.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:15:10.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:15:10.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.730 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.730 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:10.730 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:15:10.730 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:15:10.730 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.731 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:10.731 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:15:10.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:15:10.731 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.731 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:10.731 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.731 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.731 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.731 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:10.731 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:10.731 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.341574514000001, 2024-04-26T11:15:10.731 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:15:10.731 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:10.732 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:10.732 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:10.732 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:10.732 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:10.732 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:15:10.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.732 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:10.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:10.732 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:10.732 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.732 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.732 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.732 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:10.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:10.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:10.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:15:10.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:10.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.733 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:10.733 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:15:10.733 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:15:10.733 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.733 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:10.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:15:10.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:15:10.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:10.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:15:10.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:15:10.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.734 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.734 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:15:10.734 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:15:10.734 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.734 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:10.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:15:10.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:15:10.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:15:10.735 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:15:10.735 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.735 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.735 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:10.735 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:15:10.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:15:10.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:10.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:15:10.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:15:10.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.736 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:10.736 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:15:10.736 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:15:10.736 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.736 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.737 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:10.737 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:15:10.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:15:10.737 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.737 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:10.737 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.737 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.737 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.737 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:10.737 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:10.737 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 73.335578932999994, 2024-04-26T11:15:10.737 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:15:10.737 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:10.738 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:10.738 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:10.738 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:10.738 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:10.738 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:15:10.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.738 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:10.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:10.738 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:10.738 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.738 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.738 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.738 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:10.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:10.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:10.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:15:10.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:10.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.739 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.739 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:10.739 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:15:10.739 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:15:10.739 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:10.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:15:10.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:15:10.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:10.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:15:10.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:15:10.740 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.740 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.740 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.740 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:15:10.740 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:15:10.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:10.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:15:10.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:15:10.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:15:10.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:15:10.741 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.741 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.741 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:10.741 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:15:10.741 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:15:10.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:10.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:15:10.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:15:10.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:10.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:15:10.742 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:15:10.742 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.742 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.742 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:10.742 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:15:10.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:15:10.743 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.743 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:10.743 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.743 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.743 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.743 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101754 5.e 5:7ca15a5c:::benchmark_data_smithi029_44842_object101753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:10.743 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:10.743 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.569631190999999, 2024-04-26T11:15:10.743 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039171048999999999, 2024-04-26T11:15:10.743 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:10.743 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:10.743 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:10.743 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:10.744 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:10.744 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101754 2024-04-26T11:15:10.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.744 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:10.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:10.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:10.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.744 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.744 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:10.744 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:10.744 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.744 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:10.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:10.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:10.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:10.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118604+0000", 2024-04-26T11:15:10.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3399000000000007e-05 2024-04-26T11:15:10.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.745 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.745 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:10.745 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118613+0000", 2024-04-26T11:15:10.745 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6989999999999992e-06 2024-04-26T11:15:10.745 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:10.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118618+0000", 2024-04-26T11:15:10.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3850000000000001e-06 2024-04-26T11:15:10.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118646+0000", 2024-04-26T11:15:10.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7878e-05 2024-04-26T11:15:10.746 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.746 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.746 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:10.746 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118720+0000", 2024-04-26T11:15:10.746 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3461999999999996e-05 2024-04-26T11:15:10.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:10.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118807+0000", 2024-04-26T11:15:10.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7269999999999996e-05 2024-04-26T11:15:10.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:10.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142317+0000", 2024-04-26T11:15:10.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023510105999999999 2024-04-26T11:15:10.747 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.747 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.747 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:10.747 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.143287+0000", 2024-04-26T11:15:10.747 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096983599999999996 2024-04-26T11:15:10.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:10.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157662+0000", 2024-04-26T11:15:10.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014375393 2024-04-26T11:15:10.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.748 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.748 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:10.748 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157702+0000", 2024-04-26T11:15:10.748 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0295e-05 2024-04-26T11:15:10.748 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.748 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:10.748 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.748 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.749 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.749 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101755 5.f 5:fa973a83:::benchmark_data_smithi029_44842_object101754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:10.749 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:15:10.749 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.569465495000003, 2024-04-26T11:15:10.749 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039139064000000001, 2024-04-26T11:15:10.749 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:10.749 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:10.749 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:10.749 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:10.749 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:10.749 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101755 2024-04-26T11:15:10.749 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.749 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:10.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:10.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:15:10.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:10.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:15:10.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.750 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.750 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.750 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:10.750 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118696+0000", 2024-04-26T11:15:10.750 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:10.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:10.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118766+0000", 2024-04-26T11:15:10.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9423000000000003e-05 2024-04-26T11:15:10.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:10.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118774+0000", 2024-04-26T11:15:10.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9710000000000004e-06 2024-04-26T11:15:10.751 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.751 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.751 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:10.751 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118779+0000", 2024-04-26T11:15:10.751 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5629999999999999e-06 2024-04-26T11:15:10.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118817+0000", 2024-04-26T11:15:10.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7771000000000001e-05 2024-04-26T11:15:10.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:10.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118929+0000", 2024-04-26T11:15:10.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011222699999999999 2024-04-26T11:15:10.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.752 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.752 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:10.752 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157661+0000", 2024-04-26T11:15:10.752 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038731120000000001 2024-04-26T11:15:10.752 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:10.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157757+0000", 2024-04-26T11:15:10.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6910000000000006e-05 2024-04-26T11:15:10.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.753 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.753 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:10.753 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157836+0000", 2024-04-26T11:15:10.753 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8727999999999996e-05 2024-04-26T11:15:10.753 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.753 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:10.753 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.753 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.754 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101758 5.4 5:2525a4eb:::benchmark_data_smithi029_44842_object101757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:10.754 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:15:10.754 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.567282644000002, 2024-04-26T11:15:10.754 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.03686739, 2024-04-26T11:15:10.754 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:10.754 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:10.754 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:10.754 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:10.754 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:10.754 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101758 2024-04-26T11:15:10.754 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.754 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:10.754 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:10.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:15:10.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.755 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.755 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.755 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:10.755 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:15:10.755 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:10.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120879+0000", 2024-04-26T11:15:10.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:10.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:10.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120971+0000", 2024-04-26T11:15:10.756 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2133999999999996e-05 2024-04-26T11:15:10.756 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.756 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.756 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:10.756 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120977+0000", 2024-04-26T11:15:10.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5509999999999999e-06 2024-04-26T11:15:10.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:10.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120981+0000", 2024-04-26T11:15:10.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.245e-06 2024-04-26T11:15:10.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.757 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121010+0000", 2024-04-26T11:15:10.757 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9084000000000001e-05 2024-04-26T11:15:10.757 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.757 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.757 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:10.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121083+0000", 2024-04-26T11:15:10.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2942999999999996e-05 2024-04-26T11:15:10.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:10.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121163+0000", 2024-04-26T11:15:10.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0197000000000005e-05 2024-04-26T11:15:10.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.758 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:10.758 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142822+0000", 2024-04-26T11:15:10.758 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021658535999999999 2024-04-26T11:15:10.758 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.758 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:10.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157674+0000", 2024-04-26T11:15:10.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014851573999999999 2024-04-26T11:15:10.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:10.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157714+0000", 2024-04-26T11:15:10.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0473999999999999e-05 2024-04-26T11:15:10.759 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.759 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.759 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:10.759 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157747+0000", 2024-04-26T11:15:10.759 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3278999999999998e-05 2024-04-26T11:15:10.759 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.759 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:10.760 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.760 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.760 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101760 5.4 5:2510211a:::benchmark_data_smithi029_44842_object101759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:10.760 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:10.760 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.566850299000002, 2024-04-26T11:15:10.760 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039182383000000001, 2024-04-26T11:15:10.760 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:10.760 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:10.760 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:10.760 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:10.760 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:10.760 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101760 2024-04-26T11:15:10.760 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.761 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:10.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:10.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:10.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:10.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:10.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.761 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.761 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.761 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:10.761 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:10.761 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:10.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:10.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121389+0000", 2024-04-26T11:15:10.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6667000000000003e-05 2024-04-26T11:15:10.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:10.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121394+0000", 2024-04-26T11:15:10.762 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0839999999999999e-06 2024-04-26T11:15:10.762 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.762 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.762 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:10.762 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121397+0000", 2024-04-26T11:15:10.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4489999999999999e-06 2024-04-26T11:15:10.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122921+0000", 2024-04-26T11:15:10.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001524067 2024-04-26T11:15:10.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:10.763 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.123010+0000", 2024-04-26T11:15:10.763 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8449000000000006e-05 2024-04-26T11:15:10.763 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.763 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.763 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:10.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140838+0000", 2024-04-26T11:15:10.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017828796000000001 2024-04-26T11:15:10.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:10.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157665+0000", 2024-04-26T11:15:10.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016826574 2024-04-26T11:15:10.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.764 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:10.764 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160407+0000", 2024-04-26T11:15:10.764 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027423970000000002 2024-04-26T11:15:10.764 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.764 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:10.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160456+0000", 2024-04-26T11:15:10.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8678999999999999e-05 2024-04-26T11:15:10.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.765 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:10.765 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160495+0000", 2024-04-26T11:15:10.765 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8658000000000002e-05 2024-04-26T11:15:10.765 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.765 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:10.765 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.765 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.765 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.765 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101761 5.e 5:70294421:::benchmark_data_smithi029_44842_object101760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:10.766 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:15:10.766 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 51.565425926000003, 2024-04-26T11:15:10.766 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035270448000000003, 2024-04-26T11:15:10.766 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:10.766 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:10.766 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:10.766 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:10.766 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:10.766 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101761 2024-04-26T11:15:10.766 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.766 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:10.766 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.766 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:10.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:15:10.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:10.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:15:10.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.767 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:10.767 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122736+0000", 2024-04-26T11:15:10.767 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:10.767 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.767 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:10.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122805+0000", 2024-04-26T11:15:10.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9076000000000001e-05 2024-04-26T11:15:10.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:10.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122811+0000", 2024-04-26T11:15:10.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:15:10.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.768 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:10.768 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122815+0000", 2024-04-26T11:15:10.768 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2860000000000001e-06 2024-04-26T11:15:10.768 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.768 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122842+0000", 2024-04-26T11:15:10.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6429000000000001e-05 2024-04-26T11:15:10.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:10.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122916+0000", 2024-04-26T11:15:10.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4122999999999995e-05 2024-04-26T11:15:10.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.769 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:10.769 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122997+0000", 2024-04-26T11:15:10.769 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1428999999999996e-05 2024-04-26T11:15:10.769 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.769 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:10.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142344+0000", 2024-04-26T11:15:10.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019346452 2024-04-26T11:15:10.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:10.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157934+0000", 2024-04-26T11:15:10.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015589911999999999 2024-04-26T11:15:10.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.770 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.770 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:10.770 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157975+0000", 2024-04-26T11:15:10.770 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1604999999999999e-05 2024-04-26T11:15:10.770 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.771 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:10.771 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.158007+0000", 2024-04-26T11:15:10.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1921000000000002e-05 2024-04-26T11:15:10.771 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.771 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:10.771 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.771 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.771 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.771 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110145 5.9 5:9b275f16:::benchmark_data_smithi029_44842_object110144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:15:10.771 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:15:10.771 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.539864287999997, 2024-04-26T11:15:10.771 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032844496000000001, 2024-04-26T11:15:10.771 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:10.771 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:10.772 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:10.772 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:10.772 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:10.772 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110145 2024-04-26T11:15:10.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.774 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:10.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:10.774 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:15:10.774 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.774 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.774 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.774 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:10.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:15:10.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:10.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148297+0000", 2024-04-26T11:15:10.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:10.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:10.775 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148325+0000", 2024-04-26T11:15:10.775 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7511000000000001e-05 2024-04-26T11:15:10.775 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.775 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.775 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:10.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148338+0000", 2024-04-26T11:15:10.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2808e-05 2024-04-26T11:15:10.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:10.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148345+0000", 2024-04-26T11:15:10.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7200000000000006e-06 2024-04-26T11:15:10.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.776 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149888+0000", 2024-04-26T11:15:10.776 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001542666 2024-04-26T11:15:10.776 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.776 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.776 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:10.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149977+0000", 2024-04-26T11:15:10.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9247999999999997e-05 2024-04-26T11:15:10.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:10.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181006+0000", 2024-04-26T11:15:10.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031028535999999999 2024-04-26T11:15:10.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.777 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:10.777 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181051+0000", 2024-04-26T11:15:10.777 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5393999999999999e-05 2024-04-26T11:15:10.777 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.777 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.778 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:10.778 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181143+0000", 2024-04-26T11:15:10.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1458000000000004e-05 2024-04-26T11:15:10.778 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.778 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:10.778 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.778 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.778 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.778 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110155 5.9 5:9ebc6158:::benchmark_data_smithi029_44842_object110154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:15:10.778 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:15:10.778 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.534788495999997, 2024-04-26T11:15:10.778 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027886826999999999, 2024-04-26T11:15:10.778 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:10.778 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:10.779 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:10.779 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:10.779 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:10.779 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110155 2024-04-26T11:15:10.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.779 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:10.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:10.779 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:15:10.779 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.779 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.779 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.779 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:10.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:15:10.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:10.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153373+0000", 2024-04-26T11:15:10.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:10.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:10.780 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153479+0000", 2024-04-26T11:15:10.780 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105728 2024-04-26T11:15:10.780 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.780 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.780 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:10.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153491+0000", 2024-04-26T11:15:10.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2207e-05 2024-04-26T11:15:10.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:10.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153499+0000", 2024-04-26T11:15:10.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7729999999999999e-06 2024-04-26T11:15:10.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.781 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.781 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153655+0000", 2024-04-26T11:15:10.781 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015573 2024-04-26T11:15:10.781 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.781 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:10.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153770+0000", 2024-04-26T11:15:10.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011562500000000001 2024-04-26T11:15:10.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:10.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181153+0000", 2024-04-26T11:15:10.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027382113 2024-04-26T11:15:10.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.782 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.782 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:10.782 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181195+0000", 2024-04-26T11:15:10.782 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1921000000000001e-05 2024-04-26T11:15:10.782 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.783 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:10.783 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181261+0000", 2024-04-26T11:15:10.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6402999999999994e-05 2024-04-26T11:15:10.783 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.783 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:10.783 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.783 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.783 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.783 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174398 5.4 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:10.783 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:10.783 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 20.338272283999999, 2024-04-26T11:15:10.783 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.064773789999999998, 2024-04-26T11:15:10.783 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:10.784 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:10.784 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:10.784 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:10.784 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:10.784 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174398 2024-04-26T11:15:10.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.784 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:10.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:10.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:10.784 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.784 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.784 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.784 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:10.784 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:10.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:10.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349889+0000", 2024-04-26T11:15:10.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:10.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:10.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349895+0000", 2024-04-26T11:15:10.785 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4519999999999996e-06 2024-04-26T11:15:10.785 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.785 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.785 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:10.785 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349909+0000", 2024-04-26T11:15:10.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3791000000000001e-05 2024-04-26T11:15:10.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:10.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349919+0000", 2024-04-26T11:15:10.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0135999999999999e-05 2024-04-26T11:15:10.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.786 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349956+0000", 2024-04-26T11:15:10.786 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7642000000000003e-05 2024-04-26T11:15:10.786 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.786 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.786 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:10.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350080+0000", 2024-04-26T11:15:10.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123285 2024-04-26T11:15:10.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:10.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350192+0000", 2024-04-26T11:15:10.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112509 2024-04-26T11:15:10.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:10.787 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356232+0000", 2024-04-26T11:15:10.787 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060403339999999996 2024-04-26T11:15:10.787 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.787 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.787 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:10.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414616+0000", 2024-04-26T11:15:10.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.058383156999999998 2024-04-26T11:15:10.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:10.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414643+0000", 2024-04-26T11:15:10.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7317e-05 2024-04-26T11:15:10.788 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.788 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.788 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:10.788 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414664+0000", 2024-04-26T11:15:10.788 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1135999999999999e-05 2024-04-26T11:15:10.788 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.788 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:10.789 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.789 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.789 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174402 5.b 5:d8ad746d:::benchmark_data_smithi029_44842_object29764:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:10.789 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:10.789 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 20.334318095, 2024-04-26T11:15:10.789 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059017657000000001, 2024-04-26T11:15:10.789 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:10.789 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:10.789 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:10.789 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:10.789 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:10.789 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174402 2024-04-26T11:15:10.789 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.789 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:10.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:10.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:10.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:10.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:10.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.790 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.790 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.790 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:10.790 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:10.790 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:10.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:10.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353848+0000", 2024-04-26T11:15:10.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5040000000000004e-06 2024-04-26T11:15:10.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:10.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353858+0000", 2024-04-26T11:15:10.791 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7410000000000004e-06 2024-04-26T11:15:10.791 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.791 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.791 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:10.791 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353864+0000", 2024-04-26T11:15:10.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7899999999999996e-06 2024-04-26T11:15:10.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353902+0000", 2024-04-26T11:15:10.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8325000000000003e-05 2024-04-26T11:15:10.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:10.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353980+0000", 2024-04-26T11:15:10.792 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8077000000000005e-05 2024-04-26T11:15:10.792 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.792 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.792 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:10.792 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354046+0000", 2024-04-26T11:15:10.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6249999999999998e-05 2024-04-26T11:15:10.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:10.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356532+0000", 2024-04-26T11:15:10.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024850969999999999 2024-04-26T11:15:10.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.793 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:10.793 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412796+0000", 2024-04-26T11:15:10.793 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056264616000000003 2024-04-26T11:15:10.793 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.793 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:10.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412835+0000", 2024-04-26T11:15:10.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8863999999999999e-05 2024-04-26T11:15:10.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.794 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:10.794 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412862+0000", 2024-04-26T11:15:10.794 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7124e-05 2024-04-26T11:15:10.794 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.794 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:10.794 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.794 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.794 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.795 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174403 5.4 5:2d30cd6a:::benchmark_data_smithi029_44842_object29765:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:10.795 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:15:10.795 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 20.334290891999999, 2024-04-26T11:15:10.795 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.060873365999999998, 2024-04-26T11:15:10.795 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:10.795 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:10.795 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:10.795 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:10.795 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:10.795 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174403 2024-04-26T11:15:10.795 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.795 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:10.795 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:10.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:15:10.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:10.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:15:10.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.796 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:10.796 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353871+0000", 2024-04-26T11:15:10.796 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:10.796 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.796 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:10.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353874+0000", 2024-04-26T11:15:10.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869999999999999e-06 2024-04-26T11:15:10.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:10.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353881+0000", 2024-04-26T11:15:10.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2239999999999998e-06 2024-04-26T11:15:10.797 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.797 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.797 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:10.797 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353886+0000", 2024-04-26T11:15:10.797 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.259e-06 2024-04-26T11:15:10.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353912+0000", 2024-04-26T11:15:10.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6404999999999999e-05 2024-04-26T11:15:10.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:10.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353991+0000", 2024-04-26T11:15:10.798 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8104999999999998e-05 2024-04-26T11:15:10.798 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.798 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.798 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:10.798 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354055+0000", 2024-04-26T11:15:10.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4875999999999993e-05 2024-04-26T11:15:10.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:10.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.358000+0000", 2024-04-26T11:15:10.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039442629999999999 2024-04-26T11:15:10.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.799 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:10.799 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414690+0000", 2024-04-26T11:15:10.799 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056689940000000001 2024-04-26T11:15:10.799 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.799 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:10.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414714+0000", 2024-04-26T11:15:10.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4527000000000001e-05 2024-04-26T11:15:10.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.800 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:10.800 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414745+0000", 2024-04-26T11:15:10.800 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0874999999999998e-05 2024-04-26T11:15:10.800 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.800 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:10.800 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.800 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.800 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.801 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174404 5.4 5:2801f1e1:::benchmark_data_smithi029_44842_object29766:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:10.801 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:15:10.801 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 20.331673968, 2024-04-26T11:15:10.801 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059745741999999998, 2024-04-26T11:15:10.801 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:10.801 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:10.801 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:10.801 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:10.801 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:10.801 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174404 2024-04-26T11:15:10.801 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.801 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:10.801 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.801 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:10.801 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:15:10.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:10.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:15:10.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:10.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:10.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356488+0000", 2024-04-26T11:15:10.802 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:10.802 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.802 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.802 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:10.802 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356492+0000", 2024-04-26T11:15:10.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1169999999999997e-06 2024-04-26T11:15:10.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:10.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356502+0000", 2024-04-26T11:15:10.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0263e-05 2024-04-26T11:15:10.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:10.803 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356508+0000", 2024-04-26T11:15:10.803 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5890000000000002e-06 2024-04-26T11:15:10.803 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.803 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.803 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:10.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356545+0000", 2024-04-26T11:15:10.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7382999999999998e-05 2024-04-26T11:15:10.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:10.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356671+0000", 2024-04-26T11:15:10.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012535500000000001 2024-04-26T11:15:10.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.804 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.804 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:10.804 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356789+0000", 2024-04-26T11:15:10.804 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000118099 2024-04-26T11:15:10.804 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:10.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.359200+0000", 2024-04-26T11:15:10.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024110059999999998 2024-04-26T11:15:10.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:10.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416180+0000", 2024-04-26T11:15:10.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056980335999999999 2024-04-26T11:15:10.805 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.805 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.805 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:10.805 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416204+0000", 2024-04-26T11:15:10.805 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4301e-05 2024-04-26T11:15:10.806 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:10.806 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:10.806 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:10.806 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416234+0000", 2024-04-26T11:15:10.806 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9903000000000002e-05 2024-04-26T11:15:10.806 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.806 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:10.806 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.806 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:10.806 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:10.806 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:10.807 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:10.806+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:10.808 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:10.909 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:10.908+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:10.994 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:10.994 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:15:10.994 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:10.994 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:230310 5.a e53/31 5:5047f05c:::benchmark_data_smithi029_44842_object85672:head v 53'14631, mlcod=53'14628)", 2024-04-26T11:15:10.994 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:10.984275+0000", 2024-04-26T11:15:10.995 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0076959619999999998, 2024-04-26T11:15:10.995 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0077159330000000003, 2024-04-26T11:15:10.995 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:10.995 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:10.995 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:10.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:10.995 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:10.995 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.984275+0000", 2024-04-26T11:15:10.995 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:10.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:10.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:10.995 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:10.995 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.984275+0000", 2024-04-26T11:15:10.996 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:10.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:10.996 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:10.996 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:10.996 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.984275+0000", 2024-04-26T11:15:10.996 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:10.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:10.996 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:10.996 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:10.996 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.984280+0000", 2024-04-26T11:15:10.996 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.9930000000000003e-06 2024-04-26T11:15:10.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:10.996 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:10.997 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:10.997 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.984289+0000", 2024-04-26T11:15:10.997 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.0019999999999995e-06 2024-04-26T11:15:10.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:10.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:10.997 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:10.997 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.984295+0000", 2024-04-26T11:15:10.997 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0700000000000003e-06 2024-04-26T11:15:10.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:10.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:10.997 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:10.997 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.984363+0000", 2024-04-26T11:15:10.997 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7774999999999994e-05 2024-04-26T11:15:10.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:10.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:10.998 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:10.998 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.984382+0000", 2024-04-26T11:15:10.998 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9408000000000001e-05 2024-04-26T11:15:10.998 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:10.998 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:10.998 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:10.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:10.998 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:10.998 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:230312 5.2 5:464ade33:::benchmark_data_smithi029_44842_object85674:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T11:15:10.998 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:10.984380+0000", 2024-04-26T11:15:10.998 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0075916350000000002, 2024-04-26T11:15:10.998 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0076540590000000004, 2024-04-26T11:15:10.998 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:10.999 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:10.999 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:10.999 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:10.999 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:10.999 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 230312 2024-04-26T11:15:10.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:10.999 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:10.999 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:10.999 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:10.999 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.984380+0000", 2024-04-26T11:15:10.999 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:10.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:10.999 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:10.999 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:10.999 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.984380+0000", 2024-04-26T11:15:11.000 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.000 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.000 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.984379+0000", 2024-04-26T11:15:11.000 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:11.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.000 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.000 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.984384+0000", 2024-04-26T11:15:11.000 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.656e-06 2024-04-26T11:15:11.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.000 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.000 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.984393+0000", 2024-04-26T11:15:11.001 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2879999999999998e-06 2024-04-26T11:15:11.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.001 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.001 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.001 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.984400+0000", 2024-04-26T11:15:11.001 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8229999999999997e-06 2024-04-26T11:15:11.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.001 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.001 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.001 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.984539+0000", 2024-04-26T11:15:11.001 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139016 2024-04-26T11:15:11.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.001 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.001 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.002 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.984626+0000", 2024-04-26T11:15:11.002 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7769000000000006e-05 2024-04-26T11:15:11.002 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.002 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.002 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.002 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.002 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:230313 5.2 5:4b994d79:::benchmark_data_smithi029_44842_object85675:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T11:15:11.002 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:10.984406+0000", 2024-04-26T11:15:11.002 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.007565123, 2024-04-26T11:15:11.002 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0076728509999999996, 2024-04-26T11:15:11.002 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.002 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:11.003 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:11.003 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:11.003 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.003 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 230313 2024-04-26T11:15:11.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.003 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.003 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.003 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.003 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.984406+0000", 2024-04-26T11:15:11.003 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.003 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.003 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.003 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.984406+0000", 2024-04-26T11:15:11.003 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.004 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.004 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.004 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.984406+0000", 2024-04-26T11:15:11.004 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.004 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.004 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.004 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.984408+0000", 2024-04-26T11:15:11.004 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.1210000000000001e-06 2024-04-26T11:15:11.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.004 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.004 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.004 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.984413+0000", 2024-04-26T11:15:11.004 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3419999999999998e-06 2024-04-26T11:15:11.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.005 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.005 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.984418+0000", 2024-04-26T11:15:11.005 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.498e-06 2024-04-26T11:15:11.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.005 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.005 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.986136+0000", 2024-04-26T11:15:11.005 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001718345 2024-04-26T11:15:11.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.005 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.005 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.986254+0000", 2024-04-26T11:15:11.005 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000117915 2024-04-26T11:15:11.005 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.006 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.006 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.006 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.006 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:230315 5.a e53/31 5:590bcdc4:::benchmark_data_smithi029_44842_object85677:head v 53'14632, mlcod=53'14628)", 2024-04-26T11:15:11.006 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:10.985609+0000", 2024-04-26T11:15:11.006 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0063617559999999997, 2024-04-26T11:15:11.006 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0065157160000000004, 2024-04-26T11:15:11.006 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.006 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:11.006 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.006 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.006 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.007 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.985609+0000", 2024-04-26T11:15:11.007 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.007 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.007 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.985609+0000", 2024-04-26T11:15:11.007 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.007 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.007 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.985609+0000", 2024-04-26T11:15:11.007 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.007 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.008 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.985614+0000", 2024-04-26T11:15:11.008 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3000000000000001e-06 2024-04-26T11:15:11.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.008 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.008 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.008 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.985622+0000", 2024-04-26T11:15:11.008 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8820000000000001e-06 2024-04-26T11:15:11.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.008 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.008 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.008 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.985627+0000", 2024-04-26T11:15:11.008 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4110000000000004e-06 2024-04-26T11:15:11.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.009 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.009 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.986102+0000", 2024-04-26T11:15:11.009 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00047459999999999999 2024-04-26T11:15:11.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.009 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.009 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.986118+0000", 2024-04-26T11:15:11.009 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6336000000000001e-05 2024-04-26T11:15:11.009 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.009 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.009 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.010 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:230320 5.2 5:45952279:::benchmark_data_smithi029_44842_object85682:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T11:15:11.010 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:10.986518+0000", 2024-04-26T11:15:11.010 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.005453528, 2024-04-26T11:15:11.010 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0056838390000000004, 2024-04-26T11:15:11.010 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.010 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:11.010 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:11.010 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:11.010 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.010 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 230320 2024-04-26T11:15:11.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.010 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.010 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.011 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.011 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.986518+0000", 2024-04-26T11:15:11.011 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.011 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.011 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.986518+0000", 2024-04-26T11:15:11.011 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.011 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.011 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.986517+0000", 2024-04-26T11:15:11.011 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.012 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.012 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.986520+0000", 2024-04-26T11:15:11.012 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5399999999999998e-06 2024-04-26T11:15:11.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.012 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.012 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.012 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.986526+0000", 2024-04-26T11:15:11.012 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3509999999999998e-06 2024-04-26T11:15:11.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.012 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.012 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.012 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.986531+0000", 2024-04-26T11:15:11.012 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0869999999999997e-06 2024-04-26T11:15:11.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.013 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.013 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.013 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.987914+0000", 2024-04-26T11:15:11.013 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0013831049999999999 2024-04-26T11:15:11.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.013 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.013 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.013 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.988045+0000", 2024-04-26T11:15:11.013 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013112900000000001 2024-04-26T11:15:11.013 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.013 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.013 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.013 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.014 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:230321 5.2 5:447e95f0:::benchmark_data_smithi029_44842_object85683:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T11:15:11.014 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:10.986551+0000", 2024-04-26T11:15:11.014 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0054203740000000004, 2024-04-26T11:15:11.014 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057209339999999996, 2024-04-26T11:15:11.014 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.014 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:11.014 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:11.014 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:11.014 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.014 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 230321 2024-04-26T11:15:11.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.014 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.015 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.015 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.986551+0000", 2024-04-26T11:15:11.015 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.015 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.016 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.986551+0000", 2024-04-26T11:15:11.016 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.016 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.016 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.016 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.986550+0000", 2024-04-26T11:15:11.016 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.017 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.017 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.986553+0000", 2024-04-26T11:15:11.017 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6539999999999999e-06 2024-04-26T11:15:11.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.017 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.017 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.986559+0000", 2024-04-26T11:15:11.017 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2559999999999999e-06 2024-04-26T11:15:11.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.017 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.017 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.986564+0000", 2024-04-26T11:15:11.017 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.899e-06 2024-04-26T11:15:11.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.018 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.018 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.018 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.989663+0000", 2024-04-26T11:15:11.018 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0030985869999999999 2024-04-26T11:15:11.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.018 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.018 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.018 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.989778+0000", 2024-04-26T11:15:11.018 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000114787 2024-04-26T11:15:11.018 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.019 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.019 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.019 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.019 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:230324 5.a e53/31 5:50ab6f66:::benchmark_data_smithi029_44842_object85686:head v 53'14633, mlcod=53'14628)", 2024-04-26T11:15:11.019 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:10.987107+0000", 2024-04-26T11:15:11.019 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0048645310000000001, 2024-04-26T11:15:11.019 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0052357860000000001, 2024-04-26T11:15:11.019 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.019 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:11.019 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.019 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.019 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.019 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.987107+0000", 2024-04-26T11:15:11.019 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.020 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.020 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.987107+0000", 2024-04-26T11:15:11.020 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.020 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.020 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.987106+0000", 2024-04-26T11:15:11.020 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.021 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.021 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.021 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.987111+0000", 2024-04-26T11:15:11.021 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4619999999999998e-06 2024-04-26T11:15:11.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.022 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.022 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.987120+0000", 2024-04-26T11:15:11.022 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9379999999999998e-06 2024-04-26T11:15:11.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.022 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.022 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.987124+0000", 2024-04-26T11:15:11.022 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999997e-06 2024-04-26T11:15:11.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.022 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.023 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.987598+0000", 2024-04-26T11:15:11.023 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00047382300000000001 2024-04-26T11:15:11.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.023 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.023 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.023 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.987617+0000", 2024-04-26T11:15:11.023 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8697000000000001e-05 2024-04-26T11:15:11.023 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.023 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.023 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.023 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.024 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:230319 5.8 e53/16 5:19edbe05:::benchmark_data_smithi029_44842_object85681:head v 53'14451, mlcod=53'14448)", 2024-04-26T11:15:11.024 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:10.988831+0000", 2024-04-26T11:15:11.024 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0031399879999999998, 2024-04-26T11:15:11.024 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0035901259999999999, 2024-04-26T11:15:11.024 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.024 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:11.024 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.024 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.024 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.024 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.988831+0000", 2024-04-26T11:15:11.024 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.024 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.024 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.025 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.988831+0000", 2024-04-26T11:15:11.025 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.025 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.025 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.988831+0000", 2024-04-26T11:15:11.025 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.025 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.025 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.988839+0000", 2024-04-26T11:15:11.025 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4109999999999996e-06 2024-04-26T11:15:11.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.026 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.026 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.988849+0000", 2024-04-26T11:15:11.026 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.8779999999999993e-06 2024-04-26T11:15:11.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.026 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.026 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.026 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.988854+0000", 2024-04-26T11:15:11.026 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0150000000000003e-06 2024-04-26T11:15:11.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.027 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.027 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.027 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.988887+0000", 2024-04-26T11:15:11.027 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3337000000000003e-05 2024-04-26T11:15:11.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.027 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.028 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.028 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.988904+0000", 2024-04-26T11:15:11.028 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.677e-05 2024-04-26T11:15:11.028 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.028 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.028 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.028 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.028 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:230325 5.e e53/16 5:76de5bfe:::benchmark_data_smithi029_44842_object85687:head v 53'14377, mlcod=53'14374)", 2024-04-26T11:15:11.028 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:10.988862+0000", 2024-04-26T11:15:11.028 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0031093840000000002, 2024-04-26T11:15:11.028 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003631081, 2024-04-26T11:15:11.028 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.028 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:11.029 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.029 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.029 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.988862+0000", 2024-04-26T11:15:11.029 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.029 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.029 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.988862+0000", 2024-04-26T11:15:11.029 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.029 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.029 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.988862+0000", 2024-04-26T11:15:11.029 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967296 2024-04-26T11:15:11.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.030 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.030 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.030 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.988865+0000", 2024-04-26T11:15:11.030 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4709999999999999e-06 2024-04-26T11:15:11.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.030 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.030 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.030 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.988872+0000", 2024-04-26T11:15:11.030 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7569999999999998e-06 2024-04-26T11:15:11.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.030 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.030 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.030 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.988877+0000", 2024-04-26T11:15:11.031 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7180000000000004e-06 2024-04-26T11:15:11.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.031 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.031 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.031 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.988961+0000", 2024-04-26T11:15:11.031 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3944999999999997e-05 2024-04-26T11:15:11.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.031 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.031 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.031 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.988972+0000", 2024-04-26T11:15:11.031 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1909999999999999e-05 2024-04-26T11:15:11.031 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.031 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.031 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.032 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.032 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:230326 5.1 5:8a8b38db:::benchmark_data_smithi029_44842_object85688:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T11:15:11.032 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:10.989524+0000", 2024-04-26T11:15:11.032 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.002447692, 2024-04-26T11:15:11.032 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003030835, 2024-04-26T11:15:11.032 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.032 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:11.033 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:11.033 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:11.033 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.033 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 230326 2024-04-26T11:15:11.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.033 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.033 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.033 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.033 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.989524+0000", 2024-04-26T11:15:11.033 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.033 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.033 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.033 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.989524+0000", 2024-04-26T11:15:11.033 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.034 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.034 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.034 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.989522+0000", 2024-04-26T11:15:11.034 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:11.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.034 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.034 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.034 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.989527+0000", 2024-04-26T11:15:11.034 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0069999999999997e-06 2024-04-26T11:15:11.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.034 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.034 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.035 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.989539+0000", 2024-04-26T11:15:11.035 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1943000000000001e-05 2024-04-26T11:15:11.035 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.035 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.035 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.035 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.989547+0000", 2024-04-26T11:15:11.036 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5299999999999999e-06 2024-04-26T11:15:11.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.036 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.036 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.036 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.989616+0000", 2024-04-26T11:15:11.036 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8628999999999996e-05 2024-04-26T11:15:11.037 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.037 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.037 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.037 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.989747+0000", 2024-04-26T11:15:11.037 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013120499999999999 2024-04-26T11:15:11.037 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.038 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.038 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.038 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.038 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:230327 5.2 5:4a838c64:::benchmark_data_smithi029_44842_object85689:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T11:15:11.038 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:10.989560+0000", 2024-04-26T11:15:11.038 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0024116530000000001, 2024-04-26T11:15:11.038 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003066296, 2024-04-26T11:15:11.038 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.039 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:11.039 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:11.039 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:11.039 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.039 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 230327 2024-04-26T11:15:11.039 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.040 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.040 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.040 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.040 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.989560+0000", 2024-04-26T11:15:11.040 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.040 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.040 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.040 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.989560+0000", 2024-04-26T11:15:11.040 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.040 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.040 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.041 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.989559+0000", 2024-04-26T11:15:11.041 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.041 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.041 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.041 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.041 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.989562+0000", 2024-04-26T11:15:11.041 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.7760000000000002e-06 2024-04-26T11:15:11.041 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.041 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.041 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.042 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.989572+0000", 2024-04-26T11:15:11.042 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044000000000001e-05 2024-04-26T11:15:11.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.042 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.042 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.042 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.989578+0000", 2024-04-26T11:15:11.042 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0610000000000001e-06 2024-04-26T11:15:11.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.042 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.042 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.042 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.991136+0000", 2024-04-26T11:15:11.043 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0015582700000000001 2024-04-26T11:15:11.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.043 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.043 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.043 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.991243+0000", 2024-04-26T11:15:11.043 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000106918 2024-04-26T11:15:11.043 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.043 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.044 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.044 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.044 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.044 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:230322 5.8 e53/16 5:1b1f1ce3:::benchmark_data_smithi029_44842_object85684:head v 53'14452, mlcod=53'14448)", 2024-04-26T11:15:11.044 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:10.990473+0000", 2024-04-26T11:15:11.044 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0014980799999999999, 2024-04-26T11:15:11.044 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022284420000000002, 2024-04-26T11:15:11.044 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.044 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:11.045 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.045 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.045 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.045 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.990473+0000", 2024-04-26T11:15:11.045 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.045 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.045 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.046 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.046 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.990473+0000", 2024-04-26T11:15:11.046 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.046 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.046 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.046 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.990473+0000", 2024-04-26T11:15:11.046 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.046 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.047 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.047 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.990478+0000", 2024-04-26T11:15:11.047 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8710000000000002e-06 2024-04-26T11:15:11.047 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.047 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.047 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.047 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.990488+0000", 2024-04-26T11:15:11.047 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.0929999999999992e-06 2024-04-26T11:15:11.047 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.047 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.047 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.047 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.990493+0000", 2024-04-26T11:15:11.047 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.694e-06 2024-04-26T11:15:11.047 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.048 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.048 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.048 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.990552+0000", 2024-04-26T11:15:11.048 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8495000000000002e-05 2024-04-26T11:15:11.048 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.048 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.048 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.048 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.990570+0000", 2024-04-26T11:15:11.048 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7839e-05 2024-04-26T11:15:11.048 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.048 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.048 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.048 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.048 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.049 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:230328 5.0 e53/16 5:01cd55c9:::benchmark_data_smithi029_44842_object85690:head v 53'14589, mlcod=53'14587)", 2024-04-26T11:15:11.049 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:10.990504+0000", 2024-04-26T11:15:11.049 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.001467589, 2024-04-26T11:15:11.049 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022684580000000001, 2024-04-26T11:15:11.049 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.049 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:11.049 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.049 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.049 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.049 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.990504+0000", 2024-04-26T11:15:11.049 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.049 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.049 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.049 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.050 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.990504+0000", 2024-04-26T11:15:11.050 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.050 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.050 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.050 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.990503+0000", 2024-04-26T11:15:11.050 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.050 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.050 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.050 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.990507+0000", 2024-04-26T11:15:11.050 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6399999999999999e-06 2024-04-26T11:15:11.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.050 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.051 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.051 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.990512+0000", 2024-04-26T11:15:11.051 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2870000000000004e-06 2024-04-26T11:15:11.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.051 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.051 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.051 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.990515+0000", 2024-04-26T11:15:11.051 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9220000000000001e-06 2024-04-26T11:15:11.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.051 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.051 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.051 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.990558+0000", 2024-04-26T11:15:11.051 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2790000000000002e-05 2024-04-26T11:15:11.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.051 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.052 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.052 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.990570+0000", 2024-04-26T11:15:11.052 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2112e-05 2024-04-26T11:15:11.052 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.052 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.052 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.052 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.054 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.054 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:230329 5.b e53/16 5:dd95a39d:::benchmark_data_smithi029_44842_object85691:head v 53'14629, mlcod=53'14627)", 2024-04-26T11:15:11.054 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:10.991364+0000", 2024-04-26T11:15:11.054 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00060716999999999998, 2024-04-26T11:15:11.054 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0014791889999999999, 2024-04-26T11:15:11.054 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.054 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:11.054 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.054 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.054 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.054 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.991364+0000", 2024-04-26T11:15:11.054 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.054 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.055 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.055 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.055 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.991364+0000", 2024-04-26T11:15:11.055 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.055 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.055 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.055 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.991363+0000", 2024-04-26T11:15:11.055 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.055 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.055 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.055 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.991370+0000", 2024-04-26T11:15:11.055 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.173e-06 2024-04-26T11:15:11.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.056 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.056 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.056 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.991380+0000", 2024-04-26T11:15:11.056 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0285999999999999e-05 2024-04-26T11:15:11.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.056 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.056 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.056 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.991387+0000", 2024-04-26T11:15:11.056 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2389999999999996e-06 2024-04-26T11:15:11.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.056 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.056 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.056 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.991434+0000", 2024-04-26T11:15:11.056 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6375999999999998e-05 2024-04-26T11:15:11.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.057 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.057 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.057 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.991446+0000", 2024-04-26T11:15:11.057 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2673e-05 2024-04-26T11:15:11.057 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.057 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.057 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.057 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.057 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.057 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:230330 5.0 e53/16 5:0ce6889c:::benchmark_data_smithi029_44842_object85692:head v 53'14590, mlcod=53'14587)", 2024-04-26T11:15:11.057 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:10.992134+0000", 2024-04-26T11:15:11.057 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9998374, 2024-04-26T11:15:11.057 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00077948000000000004, 2024-04-26T11:15:11.057 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.057 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:11.057 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.058 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.058 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.058 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.992134+0000", 2024-04-26T11:15:11.058 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.058 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.058 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.058 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.058 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.992134+0000", 2024-04-26T11:15:11.058 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.058 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.058 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.058 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.058 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.992133+0000", 2024-04-26T11:15:11.058 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.059 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.059 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.059 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.992140+0000", 2024-04-26T11:15:11.059 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7830000000000001e-06 2024-04-26T11:15:11.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.059 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.059 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.059 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.992149+0000", 2024-04-26T11:15:11.060 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4159999999999993e-06 2024-04-26T11:15:11.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.060 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.060 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.060 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.992156+0000", 2024-04-26T11:15:11.060 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8249999999999999e-06 2024-04-26T11:15:11.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.060 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.060 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.060 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.992334+0000", 2024-04-26T11:15:11.060 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017826300000000001 2024-04-26T11:15:11.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.060 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.060 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.060 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:10.992353+0000", 2024-04-26T11:15:11.061 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8454999999999999e-05 2024-04-26T11:15:11.061 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.061 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.061 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.061 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.061 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:15:11.061 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 15 2024-04-26T11:15:11.061 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:11.066 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:11.066 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:11.061+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:11.166 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:11.164+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:11.265 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:11.263+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:11.293 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:11.293 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:15:11.293 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:15:11.294 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:15:11.294 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:11.309 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:11.395 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:11.394+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:11.467 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:11.466+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:11.537 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:11.537 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:15:11.538 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:15:11.538 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:15:11.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.538 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:11.538 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:11.538 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 78.262964314000001, 2024-04-26T11:15:11.538 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:15:11.538 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.538 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:11.538 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:11.539 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:11.539 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.539 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:15:11.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.539 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.539 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.539 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:11.539 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.539 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.540 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:11.540 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.540 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.540 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:15:11.540 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.540 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.540 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:15:11.540 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:15:11.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.541 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.541 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:15:11.541 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:15:11.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.541 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.541 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:15:11.541 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:15:11.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.542 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.542 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:15:11.542 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:15:11.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.542 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.542 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.542 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:15:11.542 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:15:11.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.542 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.542 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:11.543 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:15:11.543 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:15:11.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.543 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.543 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:11.543 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:15:11.543 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:15:11.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.543 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.544 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:11.544 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:15:11.544 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:15:11.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.544 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.544 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:11.544 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:15:11.544 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:15:11.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.544 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.544 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:11.545 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:15:11.545 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:15:11.545 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.545 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.545 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.545 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.545 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:11.545 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:11.545 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 78.262152748999995, 2024-04-26T11:15:11.545 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:15:11.545 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.546 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:11.546 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:11.546 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:11.546 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.546 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:15:11.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.546 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.546 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.546 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.546 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:11.546 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.547 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.547 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:11.547 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.547 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.547 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:11.547 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:11.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.548 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.548 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:15:11.548 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:15:11.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.548 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.548 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.548 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:15:11.548 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:15:11.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.548 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.548 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.548 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:15:11.549 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:15:11.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.549 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.549 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.549 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:15:11.549 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:15:11.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.549 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.549 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.549 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:15:11.549 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:15:11.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.550 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.550 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:11.550 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:15:11.550 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:15:11.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.550 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.550 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:11.551 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:15:11.551 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:15:11.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.551 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.551 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:11.551 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:15:11.551 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:15:11.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.552 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.552 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:11.552 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:15:11.552 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:15:11.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.552 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.552 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:11.552 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:15:11.553 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:15:11.553 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.553 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.553 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.553 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.553 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:11.553 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:11.553 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 78.254965912000003, 2024-04-26T11:15:11.554 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:15:11.554 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.554 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:11.554 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:11.554 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:11.554 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.554 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:15:11.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.555 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.555 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.555 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.555 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:11.555 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.555 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.555 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.555 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.555 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:11.556 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.556 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.556 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.556 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:15:11.556 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:11.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.556 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.557 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.557 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:15:11.557 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:15:11.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.557 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.557 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.557 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:15:11.557 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:15:11.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.558 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.558 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.558 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:15:11.558 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:15:11.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.558 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.558 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.559 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:15:11.559 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:15:11.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.559 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.559 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.559 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:15:11.559 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:15:11.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.560 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.560 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:11.560 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:15:11.560 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:15:11.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.560 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.560 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:11.560 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:15:11.560 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:15:11.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.561 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.561 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:11.561 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:15:11.561 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:15:11.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.561 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.562 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:11.562 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:15:11.562 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:15:11.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.562 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.562 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:11.562 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:15:11.562 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:15:11.563 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.563 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.563 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.563 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.563 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:11.563 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:11.563 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 78.254425033000004, 2024-04-26T11:15:11.564 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:15:11.564 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.564 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:11.564 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:11.564 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:11.564 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.564 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:15:11.564 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.564 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.564 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.565 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.565 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:11.565 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.565 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.565 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.565 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:11.565 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.566 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.566 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.566 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:11.566 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.567 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.567 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.567 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:15:11.567 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:15:11.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.567 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.567 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.567 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:15:11.568 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:15:11.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.568 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.568 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.568 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:15:11.568 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:15:11.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.569 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.569 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.569 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:15:11.569 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:15:11.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.570 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.570 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.570 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:15:11.570 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:15:11.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.570 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.571 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:11.571 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:15:11.571 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:15:11.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.571 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.571 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:11.571 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:15:11.572 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:15:11.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.572 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.572 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:11.572 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:15:11.572 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:15:11.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.573 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.573 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:11.573 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:15:11.573 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:15:11.573 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.573 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.574 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:11.574 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:15:11.574 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:15:11.574 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.574 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.574 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.575 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.575 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:11.575 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:11.575 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 74.211240586000002, 2024-04-26T11:15:11.575 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:15:11.575 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.576 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:11.576 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:11.576 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:11.576 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.576 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:15:11.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.576 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.577 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.577 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.577 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:11.577 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.578 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.578 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.578 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:11.578 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.579 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.579 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.579 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:15:11.579 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:11.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.580 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.580 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.580 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:15:11.580 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:15:11.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.580 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.580 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.581 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:15:11.581 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:15:11.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.581 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.581 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.582 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:15:11.582 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:15:11.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.582 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.583 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.583 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:15:11.583 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:15:11.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.583 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.583 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.583 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:15:11.583 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:15:11.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.584 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.584 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:11.584 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:15:11.584 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:15:11.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.584 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.584 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:11.584 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:15:11.584 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:15:11.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.584 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.584 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.584 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:15:11.584 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:15:11.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.585 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:11.585 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:15:11.585 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:15:11.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.585 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.585 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:15:11.585 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:15:11.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.585 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:11.585 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:15:11.586 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:15:11.586 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.586 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.586 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.586 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.586 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:11.586 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:11.586 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 74.209047245999997, 2024-04-26T11:15:11.586 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:15:11.586 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.586 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:11.586 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:11.586 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:11.587 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.587 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:15:11.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.587 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.587 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.587 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.587 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:11.587 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.587 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.587 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.587 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:11.587 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.588 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.588 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:15:11.588 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:11.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.588 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.588 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:15:11.588 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:15:11.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.588 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.589 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:15:11.589 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:15:11.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.589 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.589 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:15:11.589 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:15:11.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.589 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.589 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:15:11.589 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:15:11.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.590 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.590 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:15:11.590 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:15:11.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.590 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.590 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:11.590 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:15:11.590 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:15:11.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.590 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.590 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:11.590 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:15:11.590 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:15:11.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.591 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.591 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:15:11.591 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:15:11.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.591 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:11.591 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:15:11.591 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:15:11.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.592 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.592 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:15:11.592 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:15:11.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.592 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:11.592 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:15:11.592 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:15:11.592 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.592 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.592 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.592 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:11.593 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:11.593 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 74.203835421999997, 2024-04-26T11:15:11.593 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:15:11.593 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.593 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:11.593 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:11.593 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:11.593 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.593 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:15:11.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.593 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.593 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.593 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.593 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:11.593 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.594 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.594 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.594 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:11.594 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.594 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.594 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.594 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:15:11.594 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:11.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.594 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.594 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.594 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:15:11.595 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:15:11.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.595 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.595 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.595 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:15:11.595 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:15:11.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.595 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.595 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.595 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:15:11.595 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:15:11.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.595 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.595 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.595 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:15:11.596 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:15:11.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.596 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.596 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.596 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:15:11.596 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:15:11.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.596 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.596 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:11.596 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:15:11.596 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:15:11.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.596 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.596 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:11.596 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:15:11.597 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:15:11.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.597 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.597 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.597 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:15:11.597 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:15:11.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.597 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.597 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:11.597 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:15:11.597 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:15:11.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.598 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.598 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.598 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:15:11.598 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:15:11.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.598 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.598 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:11.598 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:15:11.598 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:15:11.598 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.599 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.599 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.599 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.599 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:11.599 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:11.599 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 74.187386721999999, 2024-04-26T11:15:11.599 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:15:11.599 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.599 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:11.599 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:11.599 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:11.599 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.600 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:15:11.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.600 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.600 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.600 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.600 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:11.600 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.601 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.601 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.601 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:11.601 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.601 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.601 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.601 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:15:11.602 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:11.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.602 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.602 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.602 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:15:11.602 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:15:11.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.602 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.602 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.602 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:15:11.602 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:15:11.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.603 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.603 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:15:11.603 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:15:11.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.603 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.603 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:15:11.603 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:15:11.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.603 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:11.604 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:15:11.604 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:15:11.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.604 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.604 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:15:11.604 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:15:11.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.604 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:11.604 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:15:11.604 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:15:11.605 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.605 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.605 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.605 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.605 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:11.605 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:11.605 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 74.185689217000004, 2024-04-26T11:15:11.605 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:15:11.605 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.605 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:11.606 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:11.606 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:11.606 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.606 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:15:11.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.606 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.606 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.606 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.606 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:11.606 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.607 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.607 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.607 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:11.607 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.607 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.607 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.607 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:15:11.607 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:11.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.607 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.607 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.608 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:15:11.608 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:15:11.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.608 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.608 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.608 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:15:11.608 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:15:11.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.608 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.608 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.608 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:15:11.608 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:15:11.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.609 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.609 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.609 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:15:11.609 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:15:11.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.609 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.609 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:11.609 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:15:11.609 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:15:11.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.609 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.610 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.610 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:15:11.610 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:15:11.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.610 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.610 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:11.610 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:15:11.610 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:15:11.610 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.610 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.610 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.611 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.611 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:11.611 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:11.611 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 74.185624915000005, 2024-04-26T11:15:11.611 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:15:11.612 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.612 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:11.612 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:11.612 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:11.612 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.612 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:15:11.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.613 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.613 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.613 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.613 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:11.614 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.614 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.614 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.614 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:11.614 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.614 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.615 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.615 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:11.615 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.615 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.615 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.615 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:15:11.615 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:15:11.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.615 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.615 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.615 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:15:11.616 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:15:11.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.616 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.616 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.616 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:15:11.616 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:15:11.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.616 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.616 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.616 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:15:11.616 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:15:11.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.617 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.617 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:11.617 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:15:11.617 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:15:11.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.617 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.617 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.617 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:15:11.618 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:15:11.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.618 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.618 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.618 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:15:11.618 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:15:11.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.619 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.619 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:11.619 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:15:11.619 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:15:11.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.619 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.619 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:11.619 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:15:11.619 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:15:11.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.620 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.620 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:11.620 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:15:11.620 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:15:11.620 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.620 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.620 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.620 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.620 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:11.620 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:11.620 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 74.185570690999995, 2024-04-26T11:15:11.620 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:15:11.620 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.621 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:11.621 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:11.621 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:11.621 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.621 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:15:11.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.621 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.621 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.621 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.621 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:11.621 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.621 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.621 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.622 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:11.622 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.622 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.622 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.622 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:11.622 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.623 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.623 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.623 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:15:11.623 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:15:11.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.623 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.623 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.623 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:15:11.623 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:15:11.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.623 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.623 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.623 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:15:11.624 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:15:11.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.624 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.624 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.624 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:15:11.624 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:15:11.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.624 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.624 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:11.624 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:15:11.624 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:15:11.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.625 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.625 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.625 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:15:11.625 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:15:11.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.625 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.625 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.625 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:15:11.625 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:15:11.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.625 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.625 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:11.626 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:15:11.626 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:15:11.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.626 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.626 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:11.626 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:15:11.626 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:15:11.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.626 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.626 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:11.626 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:15:11.626 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:15:11.626 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.627 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.627 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.627 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.627 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:11.627 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:11.627 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 74.185526178999993, 2024-04-26T11:15:11.627 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:15:11.627 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.627 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:11.627 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:11.627 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:11.627 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.627 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:15:11.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.628 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.628 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.628 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:11.628 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.628 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.629 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:11.629 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.629 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.629 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.629 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:15:11.629 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.629 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.629 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.629 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:15:11.629 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:15:11.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.630 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.630 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:15:11.630 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:15:11.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.630 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.630 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:15:11.630 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:15:11.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.631 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:15:11.631 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:15:11.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:11.631 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:15:11.631 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:15:11.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.632 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:15:11.632 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:15:11.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.632 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.632 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.632 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:15:11.632 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:15:11.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.632 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.633 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:11.633 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:15:11.633 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:15:11.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.633 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:11.633 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:15:11.633 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:15:11.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.634 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:11.634 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:15:11.634 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:15:11.634 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.634 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.634 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.634 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:11.634 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:11.634 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 74.181305176999999, 2024-04-26T11:15:11.634 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:15:11.635 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.635 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:11.635 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:11.635 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:11.635 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.635 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:15:11.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.635 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.635 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.635 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.635 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:11.635 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.636 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.636 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:11.636 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.636 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.636 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:15:11.636 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:15:11.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.636 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.636 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:15:11.636 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:15:11.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.637 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.637 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:15:11.637 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:15:11.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.637 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.637 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:15:11.637 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:15:11.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.637 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.637 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:15:11.637 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:15:11.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.638 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.638 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:11.638 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:15:11.638 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:15:11.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.638 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.638 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.638 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:15:11.638 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:15:11.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.639 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.639 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:15:11.639 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:15:11.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.639 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:11.639 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:15:11.639 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:15:11.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.640 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:11.640 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:15:11.640 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:15:11.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.640 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.640 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:11.640 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:15:11.640 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:15:11.640 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.640 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.640 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.641 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.641 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174388 5.c 5:312e5163:::benchmark_data_smithi029_44842_object29750:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:11.641 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:11.641 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 21.185479522000001, 2024-04-26T11:15:11.641 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.064002009999999998, 2024-04-26T11:15:11.641 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.641 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:11.641 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:11.641 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:11.641 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.641 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174388 2024-04-26T11:15:11.642 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.642 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.642 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.642 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.642 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:11.642 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.642 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.642 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.642 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.642 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:11.642 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.643 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.643 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.643 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348231+0000", 2024-04-26T11:15:11.643 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.643 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.643 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.643 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348233+0000", 2024-04-26T11:15:11.643 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2249999999999999e-06 2024-04-26T11:15:11.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.644 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.644 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.644 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348238+0000", 2024-04-26T11:15:11.644 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1899999999999997e-06 2024-04-26T11:15:11.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.644 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.644 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.645 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348241+0000", 2024-04-26T11:15:11.645 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.965e-06 2024-04-26T11:15:11.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.645 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.645 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348264+0000", 2024-04-26T11:15:11.645 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3014e-05 2024-04-26T11:15:11.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.645 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.645 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348371+0000", 2024-04-26T11:15:11.646 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000106889 2024-04-26T11:15:11.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.646 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.646 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:11.646 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412126+0000", 2024-04-26T11:15:11.646 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063755495999999995 2024-04-26T11:15:11.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.646 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.646 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:11.646 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412165+0000", 2024-04-26T11:15:11.647 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9269e-05 2024-04-26T11:15:11.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.647 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.647 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:11.647 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412234+0000", 2024-04-26T11:15:11.647 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8337000000000007e-05 2024-04-26T11:15:11.647 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.647 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.647 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.647 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.648 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174390 5.1 5:81c54fd7:::benchmark_data_smithi029_44842_object29752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:11.648 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:11.648 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 21.185364367999998, 2024-04-26T11:15:11.648 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063635918, 2024-04-26T11:15:11.648 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.648 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:11.648 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:11.648 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:11.648 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.648 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174390 2024-04-26T11:15:11.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.648 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.649 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.649 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:11.649 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.649 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.649 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:11.649 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.649 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.650 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348346+0000", 2024-04-26T11:15:11.650 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.650 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.650 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.650 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348351+0000", 2024-04-26T11:15:11.650 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.442e-06 2024-04-26T11:15:11.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.650 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.650 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.651 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348357+0000", 2024-04-26T11:15:11.651 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9530000000000002e-06 2024-04-26T11:15:11.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.651 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.651 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.651 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348363+0000", 2024-04-26T11:15:11.651 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2129999999999999e-06 2024-04-26T11:15:11.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.651 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.651 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.651 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348396+0000", 2024-04-26T11:15:11.651 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3161999999999999e-05 2024-04-26T11:15:11.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.652 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348511+0000", 2024-04-26T11:15:11.652 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000115253 2024-04-26T11:15:11.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:11.652 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411857+0000", 2024-04-26T11:15:11.652 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063345431999999993 2024-04-26T11:15:11.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:11.652 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411904+0000", 2024-04-26T11:15:11.652 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7389000000000003e-05 2024-04-26T11:15:11.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.653 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:11.653 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411983+0000", 2024-04-26T11:15:11.653 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8750000000000003e-05 2024-04-26T11:15:11.653 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.653 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.653 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.653 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174394 5.3 5:c91ce5cb:::benchmark_data_smithi029_44842_object29756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:11.653 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:11.653 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 21.185261424, 2024-04-26T11:15:11.653 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062247626, 2024-04-26T11:15:11.653 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.653 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:11.654 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:11.654 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:11.654 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.654 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174394 2024-04-26T11:15:11.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.654 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.654 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.654 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.654 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:11.655 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.655 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.655 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.655 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:11.655 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.655 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.655 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.655 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348449+0000", 2024-04-26T11:15:11.655 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.655 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.655 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.656 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348457+0000", 2024-04-26T11:15:11.656 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9619999999999993e-06 2024-04-26T11:15:11.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.656 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.656 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348462+0000", 2024-04-26T11:15:11.656 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6569999999999996e-06 2024-04-26T11:15:11.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.657 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.657 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348465+0000", 2024-04-26T11:15:11.657 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2990000000000001e-06 2024-04-26T11:15:11.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.657 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408427+0000", 2024-04-26T11:15:11.658 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.059961423 2024-04-26T11:15:11.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.658 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408554+0000", 2024-04-26T11:15:11.658 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012779600000000001 2024-04-26T11:15:11.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.658 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:11.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410570+0000", 2024-04-26T11:15:11.658 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020152719999999998 2024-04-26T11:15:11.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.659 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:11.659 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410624+0000", 2024-04-26T11:15:11.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4211e-05 2024-04-26T11:15:11.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.659 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:11.659 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410697+0000", 2024-04-26T11:15:11.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3447000000000003e-05 2024-04-26T11:15:11.659 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.659 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.659 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.660 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174395 5.1 5:8ee7f1d3:::benchmark_data_smithi029_44842_object29757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:11.660 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:11.660 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 21.184231333, 2024-04-26T11:15:11.660 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062622744999999994, 2024-04-26T11:15:11.660 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.660 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:11.660 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:11.660 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:11.660 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.660 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174395 2024-04-26T11:15:11.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.661 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.661 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.661 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.661 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:11.661 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.661 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.661 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.661 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:11.661 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.662 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.662 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349479+0000", 2024-04-26T11:15:11.662 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.663 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.663 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349483+0000", 2024-04-26T11:15:11.663 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.54e-06 2024-04-26T11:15:11.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.664 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.664 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349488+0000", 2024-04-26T11:15:11.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5119999999999999e-06 2024-04-26T11:15:11.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.664 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.665 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349492+0000", 2024-04-26T11:15:11.665 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7170000000000002e-06 2024-04-26T11:15:11.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.665 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.666 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350187+0000", 2024-04-26T11:15:11.666 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00069535899999999999 2024-04-26T11:15:11.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.666 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.666 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.666 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350292+0000", 2024-04-26T11:15:11.666 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0001047 2024-04-26T11:15:11.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.667 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.667 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:11.667 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411992+0000", 2024-04-26T11:15:11.667 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061699647000000003 2024-04-26T11:15:11.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.667 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.667 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:11.667 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412030+0000", 2024-04-26T11:15:11.667 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8124999999999998e-05 2024-04-26T11:15:11.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.667 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.667 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:11.667 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412103+0000", 2024-04-26T11:15:11.667 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2733999999999999e-05 2024-04-26T11:15:11.668 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.668 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.668 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.668 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174396 5.7 5:e0fad05d:::benchmark_data_smithi029_44842_object29758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:11.668 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:11.668 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 21.184147694, 2024-04-26T11:15:11.668 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062445026000000001, 2024-04-26T11:15:11.668 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.668 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:11.669 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:11.669 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:11.669 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.669 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174396 2024-04-26T11:15:11.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.669 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:11.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.670 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.670 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:11.670 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.670 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.670 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:11.670 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.671 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.671 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349566+0000", 2024-04-26T11:15:11.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2490000000000001e-06 2024-04-26T11:15:11.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.671 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.671 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349573+0000", 2024-04-26T11:15:11.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.776e-06 2024-04-26T11:15:11.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349576+0000", 2024-04-26T11:15:11.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3629999999999998e-06 2024-04-26T11:15:11.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350396+0000", 2024-04-26T11:15:11.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00081992199999999995 2024-04-26T11:15:11.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350516+0000", 2024-04-26T11:15:11.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012006900000000001 2024-04-26T11:15:11.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:11.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411924+0000", 2024-04-26T11:15:11.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061407960999999997 2024-04-26T11:15:11.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:11.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411947+0000", 2024-04-26T11:15:11.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2943999999999999e-05 2024-04-26T11:15:11.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.674 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:11.674 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412008+0000", 2024-04-26T11:15:11.674 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1237999999999999e-05 2024-04-26T11:15:11.674 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.674 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.674 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.675 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174397 5.7 5:e25daf9a:::benchmark_data_smithi029_44842_object29759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:11.675 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:11.675 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 21.184039564999999, 2024-04-26T11:15:11.675 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063878565999999998, 2024-04-26T11:15:11.675 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.676 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:11.676 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:11.676 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:11.676 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.676 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174397 2024-04-26T11:15:11.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.676 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.677 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.677 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:11.677 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.677 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.677 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:11.677 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.677 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349671+0000", 2024-04-26T11:15:11.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.678 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349674+0000", 2024-04-26T11:15:11.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3360000000000002e-06 2024-04-26T11:15:11.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.678 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.679 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349678+0000", 2024-04-26T11:15:11.682 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0709999999999996e-06 2024-04-26T11:15:11.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.683 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.683 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349681+0000", 2024-04-26T11:15:11.683 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3139999999999999e-06 2024-04-26T11:15:11.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.683 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.683 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.683 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410371+0000", 2024-04-26T11:15:11.683 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.060690202999999998 2024-04-26T11:15:11.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.684 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.684 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410463+0000", 2024-04-26T11:15:11.684 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2095000000000005e-05 2024-04-26T11:15:11.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.684 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:11.684 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413471+0000", 2024-04-26T11:15:11.684 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0030073909999999999 2024-04-26T11:15:11.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.684 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:11.684 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413499+0000", 2024-04-26T11:15:11.684 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8725e-05 2024-04-26T11:15:11.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.685 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.685 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:11.685 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413550+0000", 2024-04-26T11:15:11.685 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0810000000000003e-05 2024-04-26T11:15:11.685 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.685 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.685 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.685 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.685 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:174398 5.4 e46/16 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head v 46'10798, mlcod=46'10796)", 2024-04-26T11:15:11.685 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:11.685 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 21.183511354, 2024-04-26T11:15:11.685 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062067047, 2024-04-26T11:15:11.686 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:11.686 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:11.686 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:11.686 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.686 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:11.686 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:11.686 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.686 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.686 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:11.687 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:11.687 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:11.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.687 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:11.687 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350199+0000", 2024-04-26T11:15:11.687 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.688 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:11.688 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350205+0000", 2024-04-26T11:15:11.688 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6749999999999999e-06 2024-04-26T11:15:11.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.688 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:11.688 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350212+0000", 2024-04-26T11:15:11.688 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7000000000000002e-06 2024-04-26T11:15:11.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.688 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.688 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350216+0000", 2024-04-26T11:15:11.689 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5120000000000002e-06 2024-04-26T11:15:11.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.689 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:11.689 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350246+0000", 2024-04-26T11:15:11.689 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9978999999999999e-05 2024-04-26T11:15:11.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.689 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:11.689 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350263+0000", 2024-04-26T11:15:11.689 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.702e-05 2024-04-26T11:15:11.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.690 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:11.690 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412238+0000", 2024-04-26T11:15:11.690 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061974603000000003 2024-04-26T11:15:11.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:11.690 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:11.690 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:11.690 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412267+0000", 2024-04-26T11:15:11.690 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9116e-05 2024-04-26T11:15:11.690 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.690 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.690 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.691 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:11.691 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:11.691 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:11.692 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:11.690+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:11.693 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:11.730 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:15:11.793 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:11.792+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:11.867 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:11.867 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:15:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:232708 5.4 5:29db01fc:::benchmark_data_smithi029_44842_object88070:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T11:15:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:11.857919+0000", 2024-04-26T11:15:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0075442260000000002, 2024-04-26T11:15:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0075750670000000004, 2024-04-26T11:15:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:11.868 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.869 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 232708 2024-04-26T11:15:11.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.869 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:11.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:11.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.857919+0000", 2024-04-26T11:15:11.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:11.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:11.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.857919+0000", 2024-04-26T11:15:11.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:11.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.870 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:11.870 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.857918+0000", 2024-04-26T11:15:11.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:11.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:11.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.857923+0000", 2024-04-26T11:15:11.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7439999999999998e-06 2024-04-26T11:15:11.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:11.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.857934+0000", 2024-04-26T11:15:11.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0987e-05 2024-04-26T11:15:11.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.857942+0000", 2024-04-26T11:15:11.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0180000000000001e-06 2024-04-26T11:15:11.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:11.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.858750+0000", 2024-04-26T11:15:11.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00080738499999999998 2024-04-26T11:15:11.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:11.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.858822+0000", 2024-04-26T11:15:11.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2058999999999996e-05 2024-04-26T11:15:11.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:11.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.858884+0000", 2024-04-26T11:15:11.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2429999999999997e-05 2024-04-26T11:15:11.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:11.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.861851+0000", 2024-04-26T11:15:11.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0029665469999999999 2024-04-26T11:15:11.874 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:11.874 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:11.874 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:11.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.875 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:232714 5.4 5:2546c61d:::benchmark_data_smithi029_44842_object88076:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T11:15:11.875 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:11.858299+0000", 2024-04-26T11:15:11.875 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0071642010000000002, 2024-04-26T11:15:11.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0072524310000000002, 2024-04-26T11:15:11.875 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:11.875 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:11.875 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:11.875 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:11.875 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.875 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 232714 2024-04-26T11:15:11.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.876 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:11.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:11.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.858299+0000", 2024-04-26T11:15:11.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:11.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:11.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.858299+0000", 2024-04-26T11:15:11.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:11.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:11.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.858298+0000", 2024-04-26T11:15:11.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:11.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:11.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.858302+0000", 2024-04-26T11:15:11.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7960000000000002e-06 2024-04-26T11:15:11.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:11.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.858311+0000", 2024-04-26T11:15:11.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6109999999999994e-06 2024-04-26T11:15:11.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.858317+0000", 2024-04-26T11:15:11.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2140000000000001e-06 2024-04-26T11:15:11.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:11.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.859742+0000", 2024-04-26T11:15:11.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0014245250000000001 2024-04-26T11:15:11.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:11.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.859830+0000", 2024-04-26T11:15:11.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8722999999999997e-05 2024-04-26T11:15:11.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:11.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.859911+0000", 2024-04-26T11:15:11.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0333000000000005e-05 2024-04-26T11:15:11.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.881 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:11.881 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.861855+0000", 2024-04-26T11:15:11.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001944671 2024-04-26T11:15:11.881 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:11.881 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:11.881 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:11.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.882 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:232717 5.4 5:2ff55da9:::benchmark_data_smithi029_44842_object88079:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T11:15:11.882 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:11.860641+0000", 2024-04-26T11:15:11.882 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0048222300000000003, 2024-04-26T11:15:11.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049565950000000003, 2024-04-26T11:15:11.882 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:11.882 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:11.882 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:11.882 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:11.882 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.883 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 232717 2024-04-26T11:15:11.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.883 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:11.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:11.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.860641+0000", 2024-04-26T11:15:11.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:11.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:11.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.860641+0000", 2024-04-26T11:15:11.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:11.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:11.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.860640+0000", 2024-04-26T11:15:11.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:11.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.860644+0000", 2024-04-26T11:15:11.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9580000000000001e-06 2024-04-26T11:15:11.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:11.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.860650+0000", 2024-04-26T11:15:11.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9549999999999997e-06 2024-04-26T11:15:11.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.860656+0000", 2024-04-26T11:15:11.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6740000000000002e-06 2024-04-26T11:15:11.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:11.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.860781+0000", 2024-04-26T11:15:11.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012467399999999999 2024-04-26T11:15:11.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:11.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.860861+0000", 2024-04-26T11:15:11.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0013999999999997e-05 2024-04-26T11:15:11.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:11.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.860924+0000", 2024-04-26T11:15:11.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3699000000000001e-05 2024-04-26T11:15:11.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:11.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.862856+0000", 2024-04-26T11:15:11.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001931147 2024-04-26T11:15:11.889 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:11.889 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:11.889 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:11.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.890 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:232720 5.4 5:2924b697:::benchmark_data_smithi029_44842_object88082:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T11:15:11.890 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:11.861268+0000", 2024-04-26T11:15:11.890 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0041951059999999997, 2024-04-26T11:15:11.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0043972389999999998, 2024-04-26T11:15:11.890 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:11.890 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:11.890 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:11.890 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:11.890 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.890 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 232720 2024-04-26T11:15:11.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.891 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:11.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:11.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.861268+0000", 2024-04-26T11:15:11.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:11.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:11.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.861268+0000", 2024-04-26T11:15:11.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:11.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:11.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.861268+0000", 2024-04-26T11:15:11.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:11.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.892 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:11.892 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.861272+0000", 2024-04-26T11:15:11.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2289999999999997e-06 2024-04-26T11:15:11.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:11.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.861287+0000", 2024-04-26T11:15:11.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.4856e-05 2024-04-26T11:15:11.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.861295+0000", 2024-04-26T11:15:11.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5760000000000006e-06 2024-04-26T11:15:11.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:11.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.861868+0000", 2024-04-26T11:15:11.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00057264399999999997 2024-04-26T11:15:11.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:11.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.861944+0000", 2024-04-26T11:15:11.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5749999999999998e-05 2024-04-26T11:15:11.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:11.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.862008+0000", 2024-04-26T11:15:11.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4880000000000002e-05 2024-04-26T11:15:11.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:11.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863233+0000", 2024-04-26T11:15:11.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012242220000000001 2024-04-26T11:15:11.895 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:11.895 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:11.895 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:11.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.896 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:232722 5.4 5:2453489e:::benchmark_data_smithi029_44842_object88084:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T11:15:11.896 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:11.863387+0000", 2024-04-26T11:15:11.896 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0020762459999999999, 2024-04-26T11:15:11.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023600919999999998, 2024-04-26T11:15:11.896 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:11.896 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:11.896 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:11.896 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:11.896 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.896 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 232722 2024-04-26T11:15:11.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.896 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:11.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:11.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863387+0000", 2024-04-26T11:15:11.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:11.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:11.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863387+0000", 2024-04-26T11:15:11.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:11.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.897 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:11.897 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863387+0000", 2024-04-26T11:15:11.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:11.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863390+0000", 2024-04-26T11:15:11.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8519999999999997e-06 2024-04-26T11:15:11.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:11.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863399+0000", 2024-04-26T11:15:11.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6500000000000002e-06 2024-04-26T11:15:11.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863404+0000", 2024-04-26T11:15:11.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9779999999999996e-06 2024-04-26T11:15:11.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:11.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863431+0000", 2024-04-26T11:15:11.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6981000000000001e-05 2024-04-26T11:15:11.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:11.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863509+0000", 2024-04-26T11:15:11.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8459000000000002e-05 2024-04-26T11:15:11.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:11.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863577+0000", 2024-04-26T11:15:11.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7331999999999998e-05 2024-04-26T11:15:11.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:11.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.865688+0000", 2024-04-26T11:15:11.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021111519999999998 2024-04-26T11:15:11.900 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:11.900 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:11.900 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:11.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.900 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:232723 5.0 5:01edc0e1:::benchmark_data_smithi029_44842_object88085:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T11:15:11.900 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:11.863411+0000", 2024-04-26T11:15:11.900 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0020528959999999998, 2024-04-26T11:15:11.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002405875, 2024-04-26T11:15:11.901 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:11.901 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:11.901 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:11.901 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:11.901 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.901 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 232723 2024-04-26T11:15:11.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.902 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:11.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:11.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863411+0000", 2024-04-26T11:15:11.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:11.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:11.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863411+0000", 2024-04-26T11:15:11.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:11.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:11.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863410+0000", 2024-04-26T11:15:11.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:11.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863413+0000", 2024-04-26T11:15:11.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3460000000000001e-06 2024-04-26T11:15:11.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:11.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863418+0000", 2024-04-26T11:15:11.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2460000000000003e-06 2024-04-26T11:15:11.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863421+0000", 2024-04-26T11:15:11.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5750000000000001e-06 2024-04-26T11:15:11.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:11.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863457+0000", 2024-04-26T11:15:11.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5769999999999998e-05 2024-04-26T11:15:11.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:11.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863577+0000", 2024-04-26T11:15:11.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120147 2024-04-26T11:15:11.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:11.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863687+0000", 2024-04-26T11:15:11.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000109733 2024-04-26T11:15:11.905 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:11.905 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:11.905 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:11.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.905 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:232724 5.a 5:5bfd8641:::benchmark_data_smithi029_44842_object88086:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T11:15:11.905 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:11.863428+0000", 2024-04-26T11:15:11.905 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0020356469999999998, 2024-04-26T11:15:11.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002431037, 2024-04-26T11:15:11.905 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:11.906 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:11.906 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:11.906 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:11.906 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.906 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 232724 2024-04-26T11:15:11.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.906 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:11.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:11.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863428+0000", 2024-04-26T11:15:11.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:11.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:11.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863428+0000", 2024-04-26T11:15:11.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:11.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:11.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863427+0000", 2024-04-26T11:15:11.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:11.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863430+0000", 2024-04-26T11:15:11.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3199999999999998e-06 2024-04-26T11:15:11.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:11.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863434+0000", 2024-04-26T11:15:11.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2819999999999998e-06 2024-04-26T11:15:11.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863437+0000", 2024-04-26T11:15:11.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8329999999999998e-06 2024-04-26T11:15:11.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:11.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863462+0000", 2024-04-26T11:15:11.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4779000000000001e-05 2024-04-26T11:15:11.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.908 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:11.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863534+0000", 2024-04-26T11:15:11.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2082999999999994e-05 2024-04-26T11:15:11.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:11.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.863595+0000", 2024-04-26T11:15:11.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0970000000000001e-05 2024-04-26T11:15:11.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:11.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.865476+0000", 2024-04-26T11:15:11.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018816460000000001 2024-04-26T11:15:11.909 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:11.909 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:11.909 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:11.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.910 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:232727 5.4 5:216b9ccf:::benchmark_data_smithi029_44842_object88089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T11:15:11.910 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:11.864601+0000", 2024-04-26T11:15:11.910 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00086266900000000004, 2024-04-26T11:15:11.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013014579999999999, 2024-04-26T11:15:11.910 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:11.910 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:11.910 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:11.910 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:11.910 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.910 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 232727 2024-04-26T11:15:11.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.910 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:11.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:11.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.864601+0000", 2024-04-26T11:15:11.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:11.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:11.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.864601+0000", 2024-04-26T11:15:11.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:11.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:11.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.864600+0000", 2024-04-26T11:15:11.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:11.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:11.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.864604+0000", 2024-04-26T11:15:11.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5979999999999999e-06 2024-04-26T11:15:11.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:11.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.864613+0000", 2024-04-26T11:15:11.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9730000000000003e-06 2024-04-26T11:15:11.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.864620+0000", 2024-04-26T11:15:11.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3389999999999998e-06 2024-04-26T11:15:11.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:11.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.864655+0000", 2024-04-26T11:15:11.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4981000000000003e-05 2024-04-26T11:15:11.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:11.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.864737+0000", 2024-04-26T11:15:11.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1908000000000003e-05 2024-04-26T11:15:11.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:11.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.864798+0000", 2024-04-26T11:15:11.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1042000000000003e-05 2024-04-26T11:15:11.913 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:11.914 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:11.914 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:11.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.914 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:232728 5.9 5:955c1811:::benchmark_data_smithi029_44842_object88090:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T11:15:11.914 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:11.864633+0000", 2024-04-26T11:15:11.914 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00083048499999999995, 2024-04-26T11:15:11.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0013093950000000001, 2024-04-26T11:15:11.914 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:11.914 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:11.914 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:11.914 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:11.914 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:11.914 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 232728 2024-04-26T11:15:11.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.915 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:11.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:11.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.864633+0000", 2024-04-26T11:15:11.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:11.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:11.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.864633+0000", 2024-04-26T11:15:11.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:11.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:11.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.864632+0000", 2024-04-26T11:15:11.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:11.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:11.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.864635+0000", 2024-04-26T11:15:11.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4080000000000001e-06 2024-04-26T11:15:11.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:11.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.864641+0000", 2024-04-26T11:15:11.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7409999999999998e-06 2024-04-26T11:15:11.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:11.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.864646+0000", 2024-04-26T11:15:11.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2669999999999997e-06 2024-04-26T11:15:11.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:11.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.864692+0000", 2024-04-26T11:15:11.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6424999999999997e-05 2024-04-26T11:15:11.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:11.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:11.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:11.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:11.864825+0000", 2024-04-26T11:15:11.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132251 2024-04-26T11:15:11.917 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:11.917 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:11.917 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:11.917 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:11.917 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:15:11.917 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 9 2024-04-26T11:15:11.918 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:11.919 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:11.919 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:11.917+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:12.020 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:12.019+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:12.121 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:12.120+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:12.133 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:12.133 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:15:12.133 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:15:12.134 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:15:12.134 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:12.147 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:12.223 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:12.222+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:12.323 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:12.323 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:15:12.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:15:12.324 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:15:12.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.324 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:12.324 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:12.324 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.041628213999999, 2024-04-26T11:15:12.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:15:12.324 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:12.324 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:12.324 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:12.324 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:12.324 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.324 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:15:12.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.325 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:12.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:12.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:12.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:12.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:12.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.325 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:12.325 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:12.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:12.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:12.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:15:12.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:15:12.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:12.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:15:12.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:15:12.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:15:12.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:15:12.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:15:12.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:15:12.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:12.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:15:12.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:15:12.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:12.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:15:12.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:15:12.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:12.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:15:12.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:15:12.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:12.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:15:12.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:15:12.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:12.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:15:12.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:15:12.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:12.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:15:12.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:15:12.329 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.329 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:12.329 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.329 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:12.330 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:12.330 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.040978511999995, 2024-04-26T11:15:12.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:15:12.330 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:12.330 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:12.330 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:12.330 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:12.330 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.330 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:15:12.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.330 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:12.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:12.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:12.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:12.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:12.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:12.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:15:12.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:12.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:12.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:15:12.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:15:12.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:12.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:15:12.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:15:12.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:15:12.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:15:12.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:15:12.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:15:12.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:12.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:15:12.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:15:12.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:12.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:15:12.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:15:12.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:12.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:15:12.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:15:12.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:12.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:15:12.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:15:12.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.334 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.334 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:12.334 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:15:12.334 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:15:12.334 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.335 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:12.335 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:15:12.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:15:12.335 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.335 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:12.335 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.335 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.335 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.335 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:12.335 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:12.335 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 74.974336472999994, 2024-04-26T11:15:12.335 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:15:12.335 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:12.335 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:12.336 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:12.336 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:12.336 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.336 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:15:12.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.336 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:12.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:12.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:12.336 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.336 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.336 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.336 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:12.336 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:12.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:12.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:15:12.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:12.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.337 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:12.337 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:15:12.337 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:15:12.337 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.337 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:12.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:15:12.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:15:12.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:15:12.338 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:15:12.338 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.338 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.338 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.338 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:15:12.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:15:12.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:12.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:15:12.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:15:12.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.339 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.339 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:15:12.339 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:15:12.339 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.339 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.340 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:12.340 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:15:12.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:15:12.340 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.340 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:12.340 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.340 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.340 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.340 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:12.340 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:12.340 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 74.974240827000003, 2024-04-26T11:15:12.340 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:15:12.340 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:12.340 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:12.340 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:12.341 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:12.341 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.341 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:15:12.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.341 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:12.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:12.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:12.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.341 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.341 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.341 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:12.341 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:12.341 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:12.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:15:12.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:12.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:12.342 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:15:12.342 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:15:12.342 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.342 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.342 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:12.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:15:12.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:15:12.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:15:12.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:15:12.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.343 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:15:12.343 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:15:12.343 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.343 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.343 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:12.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:15:12.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:15:12.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:15:12.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:15:12.344 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.344 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.344 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:12.344 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:15:12.344 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:15:12.344 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.344 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:12.344 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.345 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.345 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:12.345 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:12.345 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 74.974109147999997, 2024-04-26T11:15:12.345 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:15:12.345 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:12.345 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:12.345 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:12.345 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:12.345 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.345 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:15:12.345 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.345 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:12.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:12.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:12.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:12.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:12.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.346 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.346 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.346 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:12.346 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:12.346 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:12.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:12.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:15:12.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:15:12.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:12.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:15:12.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:15:12.347 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.347 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.347 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.347 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:15:12.347 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:15:12.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:15:12.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:15:12.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:12.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:15:12.348 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:15:12.348 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.348 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.348 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.348 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:15:12.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:15:12.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.349 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:12.349 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:15:12.349 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:15:12.349 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.349 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:12.349 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.349 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.349 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.350 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:12.350 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:12.350 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 74.974000692000004, 2024-04-26T11:15:12.350 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:15:12.350 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:12.350 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:12.350 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:12.350 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:12.350 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.350 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:15:12.350 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.350 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:12.350 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:12.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:12.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:12.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:12.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.351 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:12.351 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:15:12.351 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:12.351 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.351 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:15:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:15:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:15:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:15:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:15:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:15:12.352 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:15:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:15:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:15:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:15:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:15:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:15:12.353 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:15:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:15:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 74.973899423999995, 2024-04-26T11:15:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:15:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:12.354 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:15:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:12.355 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:15:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:15:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:12.356 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:15:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:15:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:15:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:15:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.357 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:15:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:15:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:15:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:15:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:15:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:15:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.358 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:15:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:15:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:15:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:15:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:15:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:15:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.359 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:15:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:15:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 74.973830483, 2024-04-26T11:15:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:15:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:12.360 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:15:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.361 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:12.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:12.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.362 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.362 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:12.362 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:15:12.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:12.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:12.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:15:12.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:15:12.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:12.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:15:12.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:15:12.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:15:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:15:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:15:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:15:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:15:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:15:12.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:15:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:15:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:15:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:15:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:15:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:15:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:15:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:15:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:15:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:15:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:12.367 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 74.967834902000007, 2024-04-26T11:15:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:15:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:15:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:12.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:15:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:15:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:15:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:15:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:15:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:15:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:15:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:15:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:15:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:15:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:15:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:15:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:15:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:15:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:15:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:15:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:15:12.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:15:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:15:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:15:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:15:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.373 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101754 5.e 5:7ca15a5c:::benchmark_data_smithi029_44842_object101753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 53.201887159999998, 2024-04-26T11:15:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039171048999999999, 2024-04-26T11:15:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101754 2024-04-26T11:15:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.375 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118604+0000", 2024-04-26T11:15:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3399000000000007e-05 2024-04-26T11:15:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118613+0000", 2024-04-26T11:15:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6989999999999992e-06 2024-04-26T11:15:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118618+0000", 2024-04-26T11:15:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3850000000000001e-06 2024-04-26T11:15:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118646+0000", 2024-04-26T11:15:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7878e-05 2024-04-26T11:15:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118720+0000", 2024-04-26T11:15:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3461999999999996e-05 2024-04-26T11:15:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118807+0000", 2024-04-26T11:15:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7269999999999996e-05 2024-04-26T11:15:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142317+0000", 2024-04-26T11:15:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023510105999999999 2024-04-26T11:15:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.143287+0000", 2024-04-26T11:15:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096983599999999996 2024-04-26T11:15:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157662+0000", 2024-04-26T11:15:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014375393 2024-04-26T11:15:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157702+0000", 2024-04-26T11:15:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0295e-05 2024-04-26T11:15:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101755 5.f 5:fa973a83:::benchmark_data_smithi029_44842_object101754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:12.379 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:15:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 53.201721464000002, 2024-04-26T11:15:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039139064000000001, 2024-04-26T11:15:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101755 2024-04-26T11:15:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.380 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:15:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:15:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118696+0000", 2024-04-26T11:15:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:12.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118766+0000", 2024-04-26T11:15:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9423000000000003e-05 2024-04-26T11:15:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118774+0000", 2024-04-26T11:15:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9710000000000004e-06 2024-04-26T11:15:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118779+0000", 2024-04-26T11:15:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5629999999999999e-06 2024-04-26T11:15:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118817+0000", 2024-04-26T11:15:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7771000000000001e-05 2024-04-26T11:15:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118929+0000", 2024-04-26T11:15:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011222699999999999 2024-04-26T11:15:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157661+0000", 2024-04-26T11:15:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038731120000000001 2024-04-26T11:15:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157757+0000", 2024-04-26T11:15:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6910000000000006e-05 2024-04-26T11:15:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157836+0000", 2024-04-26T11:15:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8727999999999996e-05 2024-04-26T11:15:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:12.384 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101758 5.4 5:2525a4eb:::benchmark_data_smithi029_44842_object101757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:15:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 53.199538613000001, 2024-04-26T11:15:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.03686739, 2024-04-26T11:15:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101758 2024-04-26T11:15:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.385 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:12.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:12.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:15:12.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:12.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:15:12.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:12.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120879+0000", 2024-04-26T11:15:12.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:12.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:12.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120971+0000", 2024-04-26T11:15:12.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2133999999999996e-05 2024-04-26T11:15:12.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:12.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120977+0000", 2024-04-26T11:15:12.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5509999999999999e-06 2024-04-26T11:15:12.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120981+0000", 2024-04-26T11:15:12.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.245e-06 2024-04-26T11:15:12.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121010+0000", 2024-04-26T11:15:12.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9084000000000001e-05 2024-04-26T11:15:12.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:12.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121083+0000", 2024-04-26T11:15:12.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2942999999999996e-05 2024-04-26T11:15:12.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:12.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121163+0000", 2024-04-26T11:15:12.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0197000000000005e-05 2024-04-26T11:15:12.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:12.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142822+0000", 2024-04-26T11:15:12.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021658535999999999 2024-04-26T11:15:12.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:12.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157674+0000", 2024-04-26T11:15:12.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014851573999999999 2024-04-26T11:15:12.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:12.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157714+0000", 2024-04-26T11:15:12.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0473999999999999e-05 2024-04-26T11:15:12.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:12.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157747+0000", 2024-04-26T11:15:12.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3278999999999998e-05 2024-04-26T11:15:12.390 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.390 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:12.391 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.391 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101760 5.4 5:2510211a:::benchmark_data_smithi029_44842_object101759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:12.391 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:12.391 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 53.199106268000001, 2024-04-26T11:15:12.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039182383000000001, 2024-04-26T11:15:12.391 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:12.391 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:12.391 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:12.391 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:12.392 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.392 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101760 2024-04-26T11:15:12.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.392 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:12.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:12.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:12.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:12.392 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:12.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:12.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:12.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:12.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:12.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121389+0000", 2024-04-26T11:15:12.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6667000000000003e-05 2024-04-26T11:15:12.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:12.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121394+0000", 2024-04-26T11:15:12.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0839999999999999e-06 2024-04-26T11:15:12.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121397+0000", 2024-04-26T11:15:12.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4489999999999999e-06 2024-04-26T11:15:12.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122921+0000", 2024-04-26T11:15:12.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001524067 2024-04-26T11:15:12.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:12.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.123010+0000", 2024-04-26T11:15:12.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8449000000000006e-05 2024-04-26T11:15:12.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:12.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140838+0000", 2024-04-26T11:15:12.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017828796000000001 2024-04-26T11:15:12.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:12.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157665+0000", 2024-04-26T11:15:12.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016826574 2024-04-26T11:15:12.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:12.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160407+0000", 2024-04-26T11:15:12.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027423970000000002 2024-04-26T11:15:12.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:12.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160456+0000", 2024-04-26T11:15:12.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8678999999999999e-05 2024-04-26T11:15:12.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:12.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160495+0000", 2024-04-26T11:15:12.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8658000000000002e-05 2024-04-26T11:15:12.397 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.397 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:12.397 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.397 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101761 5.e 5:70294421:::benchmark_data_smithi029_44842_object101760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:12.397 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:15:12.398 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 53.197681895000002, 2024-04-26T11:15:12.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035270448000000003, 2024-04-26T11:15:12.398 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:12.398 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:12.398 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:12.398 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:12.398 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.398 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101761 2024-04-26T11:15:12.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.398 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:12.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:12.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:15:12.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:12.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:15:12.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:12.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122736+0000", 2024-04-26T11:15:12.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:12.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:12.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122805+0000", 2024-04-26T11:15:12.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9076000000000001e-05 2024-04-26T11:15:12.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:12.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122811+0000", 2024-04-26T11:15:12.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:15:12.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.400 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122815+0000", 2024-04-26T11:15:12.400 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2860000000000001e-06 2024-04-26T11:15:12.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.400 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.400 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122842+0000", 2024-04-26T11:15:12.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6429000000000001e-05 2024-04-26T11:15:12.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:12.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122916+0000", 2024-04-26T11:15:12.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4122999999999995e-05 2024-04-26T11:15:12.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:12.401 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122997+0000", 2024-04-26T11:15:12.401 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1428999999999996e-05 2024-04-26T11:15:12.401 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.401 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.401 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:12.402 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142344+0000", 2024-04-26T11:15:12.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019346452 2024-04-26T11:15:12.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.402 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:12.402 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157934+0000", 2024-04-26T11:15:12.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015589911999999999 2024-04-26T11:15:12.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.402 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:12.402 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157975+0000", 2024-04-26T11:15:12.402 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1604999999999999e-05 2024-04-26T11:15:12.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.402 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.403 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:12.403 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.158007+0000", 2024-04-26T11:15:12.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1921000000000002e-05 2024-04-26T11:15:12.403 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.403 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:12.403 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.403 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.403 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.403 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110145 5.9 5:9b275f16:::benchmark_data_smithi029_44842_object110144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:15:12.403 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:15:12.403 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 49.172120257000003, 2024-04-26T11:15:12.403 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032844496000000001, 2024-04-26T11:15:12.403 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:12.403 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:12.403 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:12.403 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:12.404 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.404 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110145 2024-04-26T11:15:12.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.404 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:12.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:12.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:15:12.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.404 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:12.404 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:15:12.404 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.404 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:12.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148297+0000", 2024-04-26T11:15:12.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:12.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:12.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148325+0000", 2024-04-26T11:15:12.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7511000000000001e-05 2024-04-26T11:15:12.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.405 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:12.405 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148338+0000", 2024-04-26T11:15:12.405 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2808e-05 2024-04-26T11:15:12.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.405 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.406 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.406 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148345+0000", 2024-04-26T11:15:12.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7200000000000006e-06 2024-04-26T11:15:12.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.406 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.406 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149888+0000", 2024-04-26T11:15:12.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001542666 2024-04-26T11:15:12.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.406 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.406 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:12.406 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149977+0000", 2024-04-26T11:15:12.406 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9247999999999997e-05 2024-04-26T11:15:12.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.407 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:12.407 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181006+0000", 2024-04-26T11:15:12.407 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031028535999999999 2024-04-26T11:15:12.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.407 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:12.407 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181051+0000", 2024-04-26T11:15:12.407 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5393999999999999e-05 2024-04-26T11:15:12.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.407 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.407 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:12.407 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181143+0000", 2024-04-26T11:15:12.407 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1458000000000004e-05 2024-04-26T11:15:12.408 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.408 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:12.408 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.408 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.408 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110155 5.9 5:9ebc6158:::benchmark_data_smithi029_44842_object110154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:15:12.408 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:15:12.408 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 49.167044464999996, 2024-04-26T11:15:12.408 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027886826999999999, 2024-04-26T11:15:12.408 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:12.408 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:12.408 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:12.408 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:12.409 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.409 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110155 2024-04-26T11:15:12.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.409 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:12.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:12.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:15:12.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.409 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.409 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:12.409 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:15:12.409 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:12.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153373+0000", 2024-04-26T11:15:12.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:12.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:12.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153479+0000", 2024-04-26T11:15:12.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105728 2024-04-26T11:15:12.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.410 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.410 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:12.410 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153491+0000", 2024-04-26T11:15:12.410 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2207e-05 2024-04-26T11:15:12.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153499+0000", 2024-04-26T11:15:12.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7729999999999999e-06 2024-04-26T11:15:12.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153655+0000", 2024-04-26T11:15:12.411 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015573 2024-04-26T11:15:12.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.411 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.411 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:12.411 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153770+0000", 2024-04-26T11:15:12.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011562500000000001 2024-04-26T11:15:12.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.412 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:12.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181153+0000", 2024-04-26T11:15:12.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027382113 2024-04-26T11:15:12.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.412 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:12.412 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181195+0000", 2024-04-26T11:15:12.412 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1921000000000001e-05 2024-04-26T11:15:12.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.412 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.412 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:12.413 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181261+0000", 2024-04-26T11:15:12.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6402999999999994e-05 2024-04-26T11:15:12.413 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.413 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:12.413 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.413 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.413 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174398 5.4 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:12.413 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:12.413 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.970528253000001, 2024-04-26T11:15:12.413 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.064773789999999998, 2024-04-26T11:15:12.413 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:12.413 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:12.413 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:12.413 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:12.414 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.414 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174398 2024-04-26T11:15:12.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.414 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:12.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:12.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:12.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.414 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.414 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:12.414 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:12.414 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:12.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349889+0000", 2024-04-26T11:15:12.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:12.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:12.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349895+0000", 2024-04-26T11:15:12.415 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4519999999999996e-06 2024-04-26T11:15:12.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.415 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.415 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:12.415 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349909+0000", 2024-04-26T11:15:12.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3791000000000001e-05 2024-04-26T11:15:12.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349919+0000", 2024-04-26T11:15:12.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0135999999999999e-05 2024-04-26T11:15:12.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.416 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349956+0000", 2024-04-26T11:15:12.416 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7642000000000003e-05 2024-04-26T11:15:12.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.416 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.416 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:12.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350080+0000", 2024-04-26T11:15:12.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123285 2024-04-26T11:15:12.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:12.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350192+0000", 2024-04-26T11:15:12.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112509 2024-04-26T11:15:12.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:12.417 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356232+0000", 2024-04-26T11:15:12.417 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060403339999999996 2024-04-26T11:15:12.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.417 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.417 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:12.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414616+0000", 2024-04-26T11:15:12.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.058383156999999998 2024-04-26T11:15:12.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:12.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414643+0000", 2024-04-26T11:15:12.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7317e-05 2024-04-26T11:15:12.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.418 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.418 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:12.418 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414664+0000", 2024-04-26T11:15:12.418 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1135999999999999e-05 2024-04-26T11:15:12.418 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.418 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:12.418 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.419 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174402 5.b 5:d8ad746d:::benchmark_data_smithi029_44842_object29764:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:12.419 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:12.419 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.966574064, 2024-04-26T11:15:12.419 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059017657000000001, 2024-04-26T11:15:12.419 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:12.419 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:12.419 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:12.419 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:12.419 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.419 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174402 2024-04-26T11:15:12.419 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.419 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:12.419 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:12.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:12.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:12.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:12.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.420 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.420 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:12.420 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:12.420 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:12.420 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:12.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353848+0000", 2024-04-26T11:15:12.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5040000000000004e-06 2024-04-26T11:15:12.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:12.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353858+0000", 2024-04-26T11:15:12.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7410000000000004e-06 2024-04-26T11:15:12.421 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.421 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.421 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.421 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353864+0000", 2024-04-26T11:15:12.421 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7899999999999996e-06 2024-04-26T11:15:12.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353902+0000", 2024-04-26T11:15:12.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8325000000000003e-05 2024-04-26T11:15:12.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:12.422 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353980+0000", 2024-04-26T11:15:12.422 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8077000000000005e-05 2024-04-26T11:15:12.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.422 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.422 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:12.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354046+0000", 2024-04-26T11:15:12.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6249999999999998e-05 2024-04-26T11:15:12.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:12.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356532+0000", 2024-04-26T11:15:12.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024850969999999999 2024-04-26T11:15:12.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:12.423 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412796+0000", 2024-04-26T11:15:12.423 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056264616000000003 2024-04-26T11:15:12.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.423 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.423 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:12.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412835+0000", 2024-04-26T11:15:12.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8863999999999999e-05 2024-04-26T11:15:12.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.424 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:12.424 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412862+0000", 2024-04-26T11:15:12.424 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7124e-05 2024-04-26T11:15:12.424 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.424 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:12.424 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.424 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.424 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.424 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174403 5.4 5:2d30cd6a:::benchmark_data_smithi029_44842_object29765:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:12.424 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:15:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.966546861000001, 2024-04-26T11:15:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.060873365999999998, 2024-04-26T11:15:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174403 2024-04-26T11:15:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:15:12.425 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:15:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353871+0000", 2024-04-26T11:15:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:12.426 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:12.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353874+0000", 2024-04-26T11:15:12.427 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869999999999999e-06 2024-04-26T11:15:12.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.427 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.427 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:12.427 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353881+0000", 2024-04-26T11:15:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2239999999999998e-06 2024-04-26T11:15:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353886+0000", 2024-04-26T11:15:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.259e-06 2024-04-26T11:15:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353912+0000", 2024-04-26T11:15:12.428 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6404999999999999e-05 2024-04-26T11:15:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353991+0000", 2024-04-26T11:15:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8104999999999998e-05 2024-04-26T11:15:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354055+0000", 2024-04-26T11:15:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4875999999999993e-05 2024-04-26T11:15:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.429 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.358000+0000", 2024-04-26T11:15:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039442629999999999 2024-04-26T11:15:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414690+0000", 2024-04-26T11:15:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056689940000000001 2024-04-26T11:15:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414714+0000", 2024-04-26T11:15:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4527000000000001e-05 2024-04-26T11:15:12.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414745+0000", 2024-04-26T11:15:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0874999999999998e-05 2024-04-26T11:15:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174404 5.4 5:2801f1e1:::benchmark_data_smithi029_44842_object29766:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:15:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 21.963929937, 2024-04-26T11:15:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059745741999999998, 2024-04-26T11:15:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:12.431 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174404 2024-04-26T11:15:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:15:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:15:12.432 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356488+0000", 2024-04-26T11:15:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356492+0000", 2024-04-26T11:15:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1169999999999997e-06 2024-04-26T11:15:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:12.433 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356502+0000", 2024-04-26T11:15:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0263e-05 2024-04-26T11:15:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356508+0000", 2024-04-26T11:15:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5890000000000002e-06 2024-04-26T11:15:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356545+0000", 2024-04-26T11:15:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7382999999999998e-05 2024-04-26T11:15:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.434 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356671+0000", 2024-04-26T11:15:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012535500000000001 2024-04-26T11:15:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356789+0000", 2024-04-26T11:15:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000118099 2024-04-26T11:15:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.359200+0000", 2024-04-26T11:15:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024110059999999998 2024-04-26T11:15:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.435 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416180+0000", 2024-04-26T11:15:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056980335999999999 2024-04-26T11:15:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416204+0000", 2024-04-26T11:15:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4301e-05 2024-04-26T11:15:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416234+0000", 2024-04-26T11:15:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9903000000000002e-05 2024-04-26T11:15:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.436 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:12.437 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.437 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:12.437 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:12.437 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:12.438 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:12.322+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:12.438 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:12.437+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:12.439 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:12.538 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:12.537+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:12.622 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:12.623 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:15:12.623 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.623 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:234735 5.4 e53/16 5:22a8b9b0:::benchmark_data_smithi029_44842_object90097:head v 53'14552, mlcod=53'14549)", 2024-04-26T11:15:12.623 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:12.618475+0000", 2024-04-26T11:15:12.623 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0022487599999999998, 2024-04-26T11:15:12.623 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002270659, 2024-04-26T11:15:12.623 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:12.623 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:12.623 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:12.623 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.623 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:12.623 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618475+0000", 2024-04-26T11:15:12.623 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.624 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.624 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:12.624 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618475+0000", 2024-04-26T11:15:12.624 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.624 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.624 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:12.624 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618475+0000", 2024-04-26T11:15:12.624 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:12.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.624 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.624 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:12.624 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618480+0000", 2024-04-26T11:15:12.625 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4759999999999997e-06 2024-04-26T11:15:12.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.625 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.625 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:12.625 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618489+0000", 2024-04-26T11:15:12.625 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.8519999999999993e-06 2024-04-26T11:15:12.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.625 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.625 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.625 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618494+0000", 2024-04-26T11:15:12.625 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7119999999999999e-06 2024-04-26T11:15:12.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.625 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.625 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:12.626 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618535+0000", 2024-04-26T11:15:12.626 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1254000000000002e-05 2024-04-26T11:15:12.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.626 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.626 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:12.626 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618547+0000", 2024-04-26T11:15:12.626 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1455e-05 2024-04-26T11:15:12.626 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.626 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:12.626 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.626 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.626 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:234739 5.3 5:c1f9bd4d:::benchmark_data_smithi029_44842_object90101:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T11:15:12.627 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:12.619979+0000", 2024-04-26T11:15:12.627 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00074497300000000001, 2024-04-26T11:15:12.627 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00081417100000000004, 2024-04-26T11:15:12.627 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:12.627 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:12.627 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:12.627 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:12.627 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.627 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 234739 2024-04-26T11:15:12.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.627 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:12.627 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.627 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:12.627 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.619979+0000", 2024-04-26T11:15:12.628 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.628 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:12.628 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.619979+0000", 2024-04-26T11:15:12.628 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.628 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:12.628 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.619979+0000", 2024-04-26T11:15:12.628 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:12.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.628 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:12.629 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.619983+0000", 2024-04-26T11:15:12.629 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.3719999999999998e-06 2024-04-26T11:15:12.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.630 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:12.631 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.619992+0000", 2024-04-26T11:15:12.631 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6479999999999992e-06 2024-04-26T11:15:12.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.631 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.619997+0000", 2024-04-26T11:15:12.631 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0749999999999997e-06 2024-04-26T11:15:12.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:12.632 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.620027+0000", 2024-04-26T11:15:12.632 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0360000000000001e-05 2024-04-26T11:15:12.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.632 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.632 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:12.632 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.620127+0000", 2024-04-26T11:15:12.632 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100074 2024-04-26T11:15:12.632 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.633 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:12.633 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.633 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:234727 5.5 5:a8b4b8a5:::benchmark_data_smithi029_44842_object90089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T11:15:12.633 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:12.612785+0000", 2024-04-26T11:15:12.633 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0079393450000000004, 2024-04-26T11:15:12.633 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0080503529999999997, 2024-04-26T11:15:12.633 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:12.633 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:12.633 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:12.634 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:12.634 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.634 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 234727 2024-04-26T11:15:12.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.634 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:12.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.634 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:12.634 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.612785+0000", 2024-04-26T11:15:12.634 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.634 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:12.634 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.612785+0000", 2024-04-26T11:15:12.634 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.635 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.635 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:12.635 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.612784+0000", 2024-04-26T11:15:12.635 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:12.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.635 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.635 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:12.635 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.612788+0000", 2024-04-26T11:15:12.635 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.286e-06 2024-04-26T11:15:12.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.635 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.635 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:12.635 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.612798+0000", 2024-04-26T11:15:12.635 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0556e-05 2024-04-26T11:15:12.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.636 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.636 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.612804+0000", 2024-04-26T11:15:12.636 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1179999999999997e-06 2024-04-26T11:15:12.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.636 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:12.636 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616489+0000", 2024-04-26T11:15:12.636 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0036849460000000001 2024-04-26T11:15:12.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.636 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:12.636 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616669+0000", 2024-04-26T11:15:12.637 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017944099999999999 2024-04-26T11:15:12.637 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.637 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:12.637 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.637 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:234726 5.a e53/31 5:5d4efe9c:::benchmark_data_smithi029_44842_object90088:head v 53'14896, mlcod=53'14893)", 2024-04-26T11:15:12.637 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:12.614028+0000", 2024-04-26T11:15:12.637 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0066958010000000004, 2024-04-26T11:15:12.637 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.006849529, 2024-04-26T11:15:12.637 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:12.637 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:12.637 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:12.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.637 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:12.638 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.614028+0000", 2024-04-26T11:15:12.638 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.638 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.638 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:12.638 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.614028+0000", 2024-04-26T11:15:12.639 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.639 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:12.639 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.614028+0000", 2024-04-26T11:15:12.639 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967296 2024-04-26T11:15:12.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.639 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:12.639 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.614032+0000", 2024-04-26T11:15:12.639 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2880000000000001e-06 2024-04-26T11:15:12.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.640 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.640 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:12.640 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.614037+0000", 2024-04-26T11:15:12.640 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0649999999999998e-06 2024-04-26T11:15:12.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.640 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.640 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.640 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.614040+0000", 2024-04-26T11:15:12.640 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.681e-06 2024-04-26T11:15:12.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.640 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.640 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:12.640 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.614062+0000", 2024-04-26T11:15:12.641 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2221e-05 2024-04-26T11:15:12.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.641 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.641 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:12.641 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.614080+0000", 2024-04-26T11:15:12.641 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7652e-05 2024-04-26T11:15:12.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.641 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.642 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:12.642 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.620876+0000", 2024-04-26T11:15:12.642 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0067957269999999997 2024-04-26T11:15:12.642 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.642 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:12.642 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.642 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.642 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.642 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:234729 5.2 5:4394d92c:::benchmark_data_smithi029_44842_object90091:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T11:15:12.642 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:12.614897+0000", 2024-04-26T11:15:12.642 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0058272990000000002, 2024-04-26T11:15:12.642 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.006022599, 2024-04-26T11:15:12.642 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:12.643 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:12.643 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:12.643 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:12.643 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.643 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 234729 2024-04-26T11:15:12.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.643 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:12.643 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.643 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:12.643 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.614897+0000", 2024-04-26T11:15:12.643 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.643 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.643 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:12.643 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.614897+0000", 2024-04-26T11:15:12.644 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.644 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.644 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:12.644 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.614896+0000", 2024-04-26T11:15:12.644 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:12.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.644 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.644 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:12.644 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.614902+0000", 2024-04-26T11:15:12.644 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4709999999999998e-06 2024-04-26T11:15:12.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.644 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.644 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:12.645 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.614913+0000", 2024-04-26T11:15:12.645 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1493e-05 2024-04-26T11:15:12.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.645 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.645 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.614922+0000", 2024-04-26T11:15:12.645 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6549999999999993e-06 2024-04-26T11:15:12.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.645 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:12.645 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.614977+0000", 2024-04-26T11:15:12.645 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5201999999999998e-05 2024-04-26T11:15:12.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.646 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:12.646 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.615099+0000", 2024-04-26T11:15:12.646 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012213600000000001 2024-04-26T11:15:12.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.646 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.646 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:12.646 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.620924+0000", 2024-04-26T11:15:12.646 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0058245750000000002 2024-04-26T11:15:12.646 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.646 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:12.646 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.646 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.647 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:234731 5.7 5:e29f1986:::benchmark_data_smithi029_44842_object90093:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T11:15:12.647 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:12.615800+0000", 2024-04-26T11:15:12.647 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0049243990000000003, 2024-04-26T11:15:12.647 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0051629629999999996, 2024-04-26T11:15:12.647 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:12.647 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:12.647 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:12.647 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:12.647 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.647 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 234731 2024-04-26T11:15:12.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.647 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:12.647 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.647 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:12.647 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.615800+0000", 2024-04-26T11:15:12.648 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.648 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.648 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:12.648 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.615800+0000", 2024-04-26T11:15:12.648 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.648 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.648 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:12.648 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.615799+0000", 2024-04-26T11:15:12.648 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:12.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.648 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.648 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:12.649 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.615804+0000", 2024-04-26T11:15:12.649 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1830000000000002e-06 2024-04-26T11:15:12.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.649 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:12.649 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.615818+0000", 2024-04-26T11:15:12.649 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3529e-05 2024-04-26T11:15:12.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.649 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.649 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.615826+0000", 2024-04-26T11:15:12.649 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4009999999999997e-06 2024-04-26T11:15:12.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.649 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:12.650 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.615868+0000", 2024-04-26T11:15:12.650 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2154999999999999e-05 2024-04-26T11:15:12.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.650 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.650 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:12.650 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.615986+0000", 2024-04-26T11:15:12.650 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000117588 2024-04-26T11:15:12.650 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.650 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:12.650 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.650 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.650 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:234733 5.5 5:a7a5de7e:::benchmark_data_smithi029_44842_object90095:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T11:15:12.650 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:12.615837+0000", 2024-04-26T11:15:12.651 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0048868729999999999, 2024-04-26T11:15:12.651 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0051685289999999998, 2024-04-26T11:15:12.651 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:12.651 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:12.651 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:12.651 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:12.651 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.651 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 234733 2024-04-26T11:15:12.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.652 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:12.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:12.652 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.615837+0000", 2024-04-26T11:15:12.652 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:12.652 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.615837+0000", 2024-04-26T11:15:12.652 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:12.653 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.615837+0000", 2024-04-26T11:15:12.653 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:12.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.653 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:12.653 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.615840+0000", 2024-04-26T11:15:12.653 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.553e-06 2024-04-26T11:15:12.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.653 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:12.653 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.615846+0000", 2024-04-26T11:15:12.653 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7390000000000002e-06 2024-04-26T11:15:12.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.653 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.654 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.615851+0000", 2024-04-26T11:15:12.654 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8080000000000004e-06 2024-04-26T11:15:12.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.654 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.654 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:12.654 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618383+0000", 2024-04-26T11:15:12.654 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0025322370000000001 2024-04-26T11:15:12.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.654 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.654 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:12.654 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618478+0000", 2024-04-26T11:15:12.654 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4629999999999994e-05 2024-04-26T11:15:12.654 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.654 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:12.655 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.655 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.655 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:234730 5.4 e53/16 5:21c69ee7:::benchmark_data_smithi029_44842_object90092:head v 53'14551, mlcod=53'14549)", 2024-04-26T11:15:12.655 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:12.616104+0000", 2024-04-26T11:15:12.655 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0046199350000000004, 2024-04-26T11:15:12.655 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0049395730000000001, 2024-04-26T11:15:12.655 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:12.655 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:12.655 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:12.655 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.655 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:12.655 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616104+0000", 2024-04-26T11:15:12.656 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.656 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:12.656 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616104+0000", 2024-04-26T11:15:12.656 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.656 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:12.656 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616104+0000", 2024-04-26T11:15:12.656 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:12.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.656 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:12.657 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616109+0000", 2024-04-26T11:15:12.657 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0590000000000002e-06 2024-04-26T11:15:12.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.657 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:12.657 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616118+0000", 2024-04-26T11:15:12.657 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4660000000000005e-06 2024-04-26T11:15:12.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.657 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.657 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616124+0000", 2024-04-26T11:15:12.657 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2569999999999998e-06 2024-04-26T11:15:12.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.658 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:12.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616170+0000", 2024-04-26T11:15:12.658 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6112999999999997e-05 2024-04-26T11:15:12.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.658 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:12.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616190+0000", 2024-04-26T11:15:12.658 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0078e-05 2024-04-26T11:15:12.658 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.658 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:12.658 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.658 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:234732 5.b e53/16 5:dc0d6f56:::benchmark_data_smithi029_44842_object90094:head v 53'14907, mlcod=53'14905)", 2024-04-26T11:15:12.658 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:12.616133+0000", 2024-04-26T11:15:12.659 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0045913669999999998, 2024-04-26T11:15:12.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0049439849999999997, 2024-04-26T11:15:12.659 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:12.659 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:12.659 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:12.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.659 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:12.659 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616133+0000", 2024-04-26T11:15:12.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.659 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:12.659 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616133+0000", 2024-04-26T11:15:12.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.660 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.660 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:12.660 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616133+0000", 2024-04-26T11:15:12.660 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:12.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.660 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.660 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:12.660 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616136+0000", 2024-04-26T11:15:12.660 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0230000000000001e-06 2024-04-26T11:15:12.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.660 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.660 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:12.660 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616148+0000", 2024-04-26T11:15:12.660 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2478e-05 2024-04-26T11:15:12.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.661 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.661 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.661 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616158+0000", 2024-04-26T11:15:12.661 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.5880000000000004e-06 2024-04-26T11:15:12.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.661 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.661 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:12.661 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616189+0000", 2024-04-26T11:15:12.661 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.1129e-05 2024-04-26T11:15:12.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.661 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.661 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:12.661 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616206+0000", 2024-04-26T11:15:12.662 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7484999999999999e-05 2024-04-26T11:15:12.662 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.662 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:12.662 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.662 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:234734 5.e e53/16 5:70321b2d:::benchmark_data_smithi029_44842_object90096:head v 53'14660, mlcod=53'14657)", 2024-04-26T11:15:12.662 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:12.616348+0000", 2024-04-26T11:15:12.662 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0043763530000000004, 2024-04-26T11:15:12.662 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0047620960000000004, 2024-04-26T11:15:12.663 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:12.663 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:12.663 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:12.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.663 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:12.663 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616348+0000", 2024-04-26T11:15:12.663 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.663 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:12.663 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616348+0000", 2024-04-26T11:15:12.663 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.663 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:12.664 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616347+0000", 2024-04-26T11:15:12.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:12.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.664 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:12.664 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616352+0000", 2024-04-26T11:15:12.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.045e-06 2024-04-26T11:15:12.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.664 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:12.664 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616360+0000", 2024-04-26T11:15:12.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.1969999999999999e-06 2024-04-26T11:15:12.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.664 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.664 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616365+0000", 2024-04-26T11:15:12.665 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4550000000000003e-06 2024-04-26T11:15:12.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.665 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:12.665 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616591+0000", 2024-04-26T11:15:12.665 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00022555900000000001 2024-04-26T11:15:12.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.665 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:12.665 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.616613+0000", 2024-04-26T11:15:12.665 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2007000000000001e-05 2024-04-26T11:15:12.665 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.665 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:12.665 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.666 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.666 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:234736 5.1 5:82ece582:::benchmark_data_smithi029_44842_object90098:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T11:15:12.666 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:12.618233+0000", 2024-04-26T11:15:12.666 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0024911870000000002, 2024-04-26T11:15:12.666 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0029103779999999999, 2024-04-26T11:15:12.666 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:12.666 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:12.666 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:12.666 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:12.666 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.666 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 234736 2024-04-26T11:15:12.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.666 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:12.666 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.667 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:12.667 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618233+0000", 2024-04-26T11:15:12.667 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.667 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.667 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:12.667 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618233+0000", 2024-04-26T11:15:12.667 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.667 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.667 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:12.667 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618232+0000", 2024-04-26T11:15:12.667 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:12.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.667 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.667 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:12.668 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618236+0000", 2024-04-26T11:15:12.668 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.109e-06 2024-04-26T11:15:12.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.668 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:12.668 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618244+0000", 2024-04-26T11:15:12.668 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8630000000000008e-06 2024-04-26T11:15:12.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.668 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.668 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618250+0000", 2024-04-26T11:15:12.668 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4689999999999996e-06 2024-04-26T11:15:12.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:12.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618289+0000", 2024-04-26T11:15:12.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9289999999999998e-05 2024-04-26T11:15:12.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:12.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618422+0000", 2024-04-26T11:15:12.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013285900000000001 2024-04-26T11:15:12.669 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.669 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:12.669 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.669 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:234737 5.5 5:abb9d508:::benchmark_data_smithi029_44842_object90099:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T11:15:12.669 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:12.618261+0000", 2024-04-26T11:15:12.670 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.002462957, 2024-04-26T11:15:12.670 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0029192089999999999, 2024-04-26T11:15:12.670 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:12.670 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:12.670 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:12.670 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:12.670 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.670 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 234737 2024-04-26T11:15:12.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.670 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:12.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.670 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:12.670 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618261+0000", 2024-04-26T11:15:12.670 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.671 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:12.671 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618261+0000", 2024-04-26T11:15:12.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.671 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:12.671 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618261+0000", 2024-04-26T11:15:12.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:12.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.671 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:12.671 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618263+0000", 2024-04-26T11:15:12.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2350000000000002e-06 2024-04-26T11:15:12.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:12.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618269+0000", 2024-04-26T11:15:12.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2769999999999996e-06 2024-04-26T11:15:12.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618272+0000", 2024-04-26T11:15:12.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0110000000000001e-06 2024-04-26T11:15:12.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:12.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.619711+0000", 2024-04-26T11:15:12.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0014398449999999999 2024-04-26T11:15:12.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:12.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.619793+0000", 2024-04-26T11:15:12.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.1295e-05 2024-04-26T11:15:12.673 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.673 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:12.673 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.673 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:234738 5.c 5:33c9d902:::benchmark_data_smithi029_44842_object90100:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T11:15:12.673 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:12.618455+0000", 2024-04-26T11:15:12.673 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0022691170000000002, 2024-04-26T11:15:12.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0027655890000000002, 2024-04-26T11:15:12.673 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:12.674 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:12.674 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:12.674 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:12.674 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:12.674 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 234738 2024-04-26T11:15:12.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.674 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:12.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.674 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:12.674 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618455+0000", 2024-04-26T11:15:12.674 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.674 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:12.674 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618455+0000", 2024-04-26T11:15:12.675 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:12.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.675 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:12.675 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618454+0000", 2024-04-26T11:15:12.675 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:12.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.675 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:12.675 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618459+0000", 2024-04-26T11:15:12.675 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2950000000000004e-06 2024-04-26T11:15:12.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.675 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:12.675 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618467+0000", 2024-04-26T11:15:12.676 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8329999999999994e-06 2024-04-26T11:15:12.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.676 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:12.676 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618472+0000", 2024-04-26T11:15:12.676 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8819999999999998e-06 2024-04-26T11:15:12.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.676 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:12.676 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618523+0000", 2024-04-26T11:15:12.676 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0349000000000002e-05 2024-04-26T11:15:12.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:12.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:12.676 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:12.676 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:12.618661+0000", 2024-04-26T11:15:12.677 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000138286 2024-04-26T11:15:12.677 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.677 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:12.677 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.677 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:12.677 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:15:12.677 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 13 2024-04-26T11:15:12.677 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:12.678 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:15:12.679 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:12.680 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:12.677+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:12.725 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:15:12.779 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:12.778+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:12.842 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:15:12.863 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:15:12.863 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:15:12.864 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:15:12.864 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:15:12.866 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:15:12.866 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:15:12.880 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:12.878+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:12.900 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:12.900 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:12.915 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:12.981 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:12.979+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:13.082 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:13.081+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:13.143 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:13.144 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:13.157 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:13.199 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:13.198+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:13.285 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:13.284+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:13.330 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:13.330 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:13.343 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:13.385 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:13.384+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:13.486 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:13.484+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:13.518 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:13.519 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:13.533 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:13.586 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:13.585+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:13.687 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:13.686+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:13.752 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:13.752 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:13.767 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:13.813 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:13.812+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:13.889 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:13.888+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:13.952 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:13.952 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:13.966 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:14.007 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:14.006+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:14.091 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:14.090+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:14.189 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:14.189 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:14.192 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:14.190+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:14.200 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:14.293 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:14.292+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:14.394 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:14.393+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:14.426 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:14.426 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:14.442 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:14.495 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:14.494+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:14.597 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:14.596+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:14.610 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:14.610 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:14.624 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:14.697 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:14.695+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:14.743 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:15:14.792 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:14.792 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:14.798 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:14.797+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:14.805 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:14.867 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:15:14.899 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:14.898+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:14.923 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~76s 2024-04-26T11:15:15.000 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:14.998+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:15.027 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:15:15.029 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:15.029 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:15.042 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:15.046 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:15:15.046 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:15:15.046 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:15:15.047 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:15:15.049 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:15:15.049 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:15:15.101 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:15.100+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:15.202 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:15.201+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:15.226 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:15.226 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:15:15.226 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.226 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:241633 5.e e54/16 5:7b3dd5bb:::benchmark_data_smithi029_44842_object96995:head v 54'15096, mlcod=54'15093)", 2024-04-26T11:15:15.226 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:15.217305+0000", 2024-04-26T11:15:15.227 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0071015519999999997, 2024-04-26T11:15:15.227 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0071221449999999999, 2024-04-26T11:15:15.227 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.227 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:15.227 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.227 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.227 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.227 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.217305+0000", 2024-04-26T11:15:15.227 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.227 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.227 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.227 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.227 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.217305+0000", 2024-04-26T11:15:15.227 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.227 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.228 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.228 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.228 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.217304+0000", 2024-04-26T11:15:15.228 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:15.228 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.228 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.228 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.228 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.217309+0000", 2024-04-26T11:15:15.228 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.356e-06 2024-04-26T11:15:15.228 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.228 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.228 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.228 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.217317+0000", 2024-04-26T11:15:15.228 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4039999999999998e-06 2024-04-26T11:15:15.229 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.229 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.229 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.229 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.217323+0000", 2024-04-26T11:15:15.229 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9859999999999999e-06 2024-04-26T11:15:15.229 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.229 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.229 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.229 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.217361+0000", 2024-04-26T11:15:15.229 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7715000000000001e-05 2024-04-26T11:15:15.229 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.229 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.229 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.229 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.217384+0000", 2024-04-26T11:15:15.229 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3172000000000001e-05 2024-04-26T11:15:15.230 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.230 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.230 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.230 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.230 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.230 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:241636 5.e e54/16 5:7c4a28f7:::benchmark_data_smithi029_44842_object96998:head v 54'15097, mlcod=54'15093)", 2024-04-26T11:15:15.230 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:15.218849+0000", 2024-04-26T11:15:15.230 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0055569690000000001, 2024-04-26T11:15:15.230 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0056251299999999999, 2024-04-26T11:15:15.230 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.230 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:15.230 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.230 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.230 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.231 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.218849+0000", 2024-04-26T11:15:15.231 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.231 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.231 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.231 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.231 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.218849+0000", 2024-04-26T11:15:15.231 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.231 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.231 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.231 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.231 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.218849+0000", 2024-04-26T11:15:15.231 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:15.231 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.231 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.232 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.232 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.218855+0000", 2024-04-26T11:15:15.232 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9379999999999997e-06 2024-04-26T11:15:15.232 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.232 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.232 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.232 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.218865+0000", 2024-04-26T11:15:15.232 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0730999999999999e-05 2024-04-26T11:15:15.232 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.232 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.232 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.232 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.218872+0000", 2024-04-26T11:15:15.232 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0090000000000001e-06 2024-04-26T11:15:15.232 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.233 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.233 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.233 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.218996+0000", 2024-04-26T11:15:15.233 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000123559 2024-04-26T11:15:15.233 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.233 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.233 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.233 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.219008+0000", 2024-04-26T11:15:15.233 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.221e-05 2024-04-26T11:15:15.233 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.233 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.233 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.233 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.233 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.233 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:241648 5.2 5:4c5fdde9:::benchmark_data_smithi029_44842_object97010:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T11:15:15.234 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:15.220611+0000", 2024-04-26T11:15:15.234 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.003795288, 2024-04-26T11:15:15.234 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0039138599999999999, 2024-04-26T11:15:15.234 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.234 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:15.234 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:15.234 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:15.234 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:15.234 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 241648 2024-04-26T11:15:15.234 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.234 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.234 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.234 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.234 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.220611+0000", 2024-04-26T11:15:15.235 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.235 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.235 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.235 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.220611+0000", 2024-04-26T11:15:15.235 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.235 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.235 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.235 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.220610+0000", 2024-04-26T11:15:15.235 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:15.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.235 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.235 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.235 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.220615+0000", 2024-04-26T11:15:15.236 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5040000000000004e-06 2024-04-26T11:15:15.236 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.236 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.236 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.236 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.220622+0000", 2024-04-26T11:15:15.236 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6459999999999993e-06 2024-04-26T11:15:15.236 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.236 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.236 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.236 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.220628+0000", 2024-04-26T11:15:15.236 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7339999999999996e-06 2024-04-26T11:15:15.236 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.236 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.236 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.237 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.220664+0000", 2024-04-26T11:15:15.237 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6334999999999997e-05 2024-04-26T11:15:15.237 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.237 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.237 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.237 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.220789+0000", 2024-04-26T11:15:15.237 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012454 2024-04-26T11:15:15.237 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.237 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.237 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.237 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.237 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.237 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:241645 5.e e54/16 5:7ecf662c:::benchmark_data_smithi029_44842_object97007:head v 54'15098, mlcod=54'15093)", 2024-04-26T11:15:15.237 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:15.221286+0000", 2024-04-26T11:15:15.237 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0031198530000000001, 2024-04-26T11:15:15.238 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0032884670000000002, 2024-04-26T11:15:15.238 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.238 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:15.238 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.238 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.238 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.238 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.221286+0000", 2024-04-26T11:15:15.238 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.238 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.238 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.238 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.238 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.221286+0000", 2024-04-26T11:15:15.238 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.238 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.238 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.239 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.239 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.221286+0000", 2024-04-26T11:15:15.239 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:15.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.239 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.239 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.239 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.221296+0000", 2024-04-26T11:15:15.239 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0056e-05 2024-04-26T11:15:15.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.239 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.239 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.239 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.221305+0000", 2024-04-26T11:15:15.239 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.5829999999999996e-06 2024-04-26T11:15:15.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.239 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.240 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.240 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.221312+0000", 2024-04-26T11:15:15.240 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4999999999999996e-06 2024-04-26T11:15:15.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.240 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.240 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.240 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.221350+0000", 2024-04-26T11:15:15.240 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7626000000000002e-05 2024-04-26T11:15:15.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.240 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.240 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.240 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.221369+0000", 2024-04-26T11:15:15.240 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9950999999999999e-05 2024-04-26T11:15:15.240 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.241 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.241 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.241 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.241 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.241 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:241646 5.b e54/16 5:d9c857ba:::benchmark_data_smithi029_44842_object97008:head v 54'15376, mlcod=54'15374)", 2024-04-26T11:15:15.241 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:15.221322+0000", 2024-04-26T11:15:15.241 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0030840630000000002, 2024-04-26T11:15:15.241 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0033243140000000001, 2024-04-26T11:15:15.241 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.241 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:15.241 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.241 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.241 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.241 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.221322+0000", 2024-04-26T11:15:15.241 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.242 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.242 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.242 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.242 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.221322+0000", 2024-04-26T11:15:15.242 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.242 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.242 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.242 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.242 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.221322+0000", 2024-04-26T11:15:15.242 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:15.242 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.242 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.242 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.242 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.221326+0000", 2024-04-26T11:15:15.243 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9349999999999996e-06 2024-04-26T11:15:15.243 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.243 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.243 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.243 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.221332+0000", 2024-04-26T11:15:15.243 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9510000000000003e-06 2024-04-26T11:15:15.243 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.243 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.243 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.243 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.221336+0000", 2024-04-26T11:15:15.243 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.3540000000000002e-06 2024-04-26T11:15:15.243 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.243 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.243 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.243 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.221372+0000", 2024-04-26T11:15:15.244 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5590999999999999e-05 2024-04-26T11:15:15.244 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.244 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.244 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.244 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.221388+0000", 2024-04-26T11:15:15.244 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6775000000000001e-05 2024-04-26T11:15:15.244 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.244 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.244 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.244 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.244 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.244 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:241647 5.0 e54/16 5:02aa5cf6:::benchmark_data_smithi029_44842_object97009:head v 54'15300, mlcod=54'15298)", 2024-04-26T11:15:15.244 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:15.222264+0000", 2024-04-26T11:15:15.244 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00214204, 2024-04-26T11:15:15.244 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0024559909999999998, 2024-04-26T11:15:15.245 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.245 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:15.245 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.245 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.245 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.245 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.222264+0000", 2024-04-26T11:15:15.245 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.245 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.245 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.245 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.245 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.222264+0000", 2024-04-26T11:15:15.245 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.245 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.245 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.245 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.246 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.222264+0000", 2024-04-26T11:15:15.246 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:15.246 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.246 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.246 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.246 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.222269+0000", 2024-04-26T11:15:15.246 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5990000000000001e-06 2024-04-26T11:15:15.246 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.246 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.246 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.246 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.222282+0000", 2024-04-26T11:15:15.246 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.3062e-05 2024-04-26T11:15:15.246 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.246 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.246 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.247 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.222289+0000", 2024-04-26T11:15:15.247 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6340000000000003e-06 2024-04-26T11:15:15.247 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.247 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.247 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.247 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.222933+0000", 2024-04-26T11:15:15.247 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00064455899999999995 2024-04-26T11:15:15.247 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.247 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.247 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.247 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.222952+0000", 2024-04-26T11:15:15.247 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8263000000000001e-05 2024-04-26T11:15:15.247 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.247 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.247 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.248 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.248 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.248 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:241652 5.8 e54/16 5:1de00141:::benchmark_data_smithi029_44842_object97014:head v 54'15148, mlcod=54'15144)", 2024-04-26T11:15:15.248 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:15.222781+0000", 2024-04-26T11:15:15.248 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0016250139999999999, 2024-04-26T11:15:15.248 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020102010000000001, 2024-04-26T11:15:15.248 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.248 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:15.248 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.248 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.248 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.248 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.222781+0000", 2024-04-26T11:15:15.248 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.248 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.248 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.248 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.249 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.222781+0000", 2024-04-26T11:15:15.249 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.249 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.249 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.249 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.249 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.222781+0000", 2024-04-26T11:15:15.249 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:15.249 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.249 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.249 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.249 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.222784+0000", 2024-04-26T11:15:15.249 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5049999999999999e-06 2024-04-26T11:15:15.249 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.249 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.249 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.250 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.222791+0000", 2024-04-26T11:15:15.250 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0689999999999998e-06 2024-04-26T11:15:15.250 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.250 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.250 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.250 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.222795+0000", 2024-04-26T11:15:15.250 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.3850000000000004e-06 2024-04-26T11:15:15.250 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.250 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.250 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.250 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.222972+0000", 2024-04-26T11:15:15.250 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017659899999999999 2024-04-26T11:15:15.250 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.250 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.250 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.251 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.222990+0000", 2024-04-26T11:15:15.251 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8430000000000001e-05 2024-04-26T11:15:15.251 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.251 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.251 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.251 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.251 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:241657 5.7 5:e4feb8d6:::benchmark_data_smithi029_44842_object97019:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T11:15:15.251 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:15.224569+0000", 2024-04-26T11:15:15.251 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9998369, 2024-04-26T11:15:15.251 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00028971500000000001, 2024-04-26T11:15:15.251 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.251 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:15.251 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:15.251 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:15.252 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:15.252 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 241657 2024-04-26T11:15:15.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.252 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.252 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.252 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.252 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224569+0000", 2024-04-26T11:15:15.252 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.252 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.252 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.252 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224569+0000", 2024-04-26T11:15:15.252 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.252 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.253 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.253 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224569+0000", 2024-04-26T11:15:15.253 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:15.253 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.253 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.253 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.253 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224574+0000", 2024-04-26T11:15:15.253 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2889999999999997e-06 2024-04-26T11:15:15.253 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.253 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.253 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.253 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224585+0000", 2024-04-26T11:15:15.253 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0702e-05 2024-04-26T11:15:15.253 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.253 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.254 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.254 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224592+0000", 2024-04-26T11:15:15.254 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4989999999999997e-06 2024-04-26T11:15:15.254 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.254 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.254 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.254 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224634+0000", 2024-04-26T11:15:15.254 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1496999999999999e-05 2024-04-26T11:15:15.254 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.254 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.254 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.254 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224768+0000", 2024-04-26T11:15:15.254 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013487500000000001 2024-04-26T11:15:15.254 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.255 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.255 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.255 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.255 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.255 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:241655 5.4 e54/16 5:21df2bf1:::benchmark_data_smithi029_44842_object97017:head v 54'15000, mlcod=54'14996)", 2024-04-26T11:15:15.255 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:15.224653+0000", 2024-04-26T11:15:15.255 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9997535, 2024-04-26T11:15:15.255 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00030076499999999998, 2024-04-26T11:15:15.255 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.255 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:15.255 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.255 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.255 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.255 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224653+0000", 2024-04-26T11:15:15.255 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.256 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.256 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.256 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224653+0000", 2024-04-26T11:15:15.256 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.256 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.256 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.256 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224652+0000", 2024-04-26T11:15:15.256 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:15.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.256 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.256 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.256 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224658+0000", 2024-04-26T11:15:15.256 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0510000000000002e-06 2024-04-26T11:15:15.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.257 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.257 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.257 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224667+0000", 2024-04-26T11:15:15.257 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4719999999999995e-06 2024-04-26T11:15:15.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.257 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.257 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.257 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224673+0000", 2024-04-26T11:15:15.257 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1009999999999997e-06 2024-04-26T11:15:15.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.257 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.257 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.257 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224707+0000", 2024-04-26T11:15:15.258 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4487999999999999e-05 2024-04-26T11:15:15.258 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.258 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.258 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.258 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224726+0000", 2024-04-26T11:15:15.258 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8587e-05 2024-04-26T11:15:15.258 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.258 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.258 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.258 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.258 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.258 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:241654 5.8 e54/16 5:11e3e1f9:::benchmark_data_smithi029_44842_object97016:head v 54'15149, mlcod=54'15145)", 2024-04-26T11:15:15.258 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:15.224745+0000", 2024-04-26T11:15:15.258 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9996614, 2024-04-26T11:15:15.259 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00026840700000000002, 2024-04-26T11:15:15.259 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.259 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:15.259 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.259 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.259 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.259 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224745+0000", 2024-04-26T11:15:15.259 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.259 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.259 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.259 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224745+0000", 2024-04-26T11:15:15.259 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.259 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.260 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.260 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224744+0000", 2024-04-26T11:15:15.260 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:15.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.260 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.260 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.260 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224749+0000", 2024-04-26T11:15:15.260 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0799999999999999e-06 2024-04-26T11:15:15.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.260 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.260 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.260 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224755+0000", 2024-04-26T11:15:15.260 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9369999999999998e-06 2024-04-26T11:15:15.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.260 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.261 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.261 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224760+0000", 2024-04-26T11:15:15.261 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.9250000000000003e-06 2024-04-26T11:15:15.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.261 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.261 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.261 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224787+0000", 2024-04-26T11:15:15.261 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6604000000000001e-05 2024-04-26T11:15:15.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.261 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.261 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.261 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224799+0000", 2024-04-26T11:15:15.261 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1836e-05 2024-04-26T11:15:15.261 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.261 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.262 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.262 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.262 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:241660 5.7 5.c378dce7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T11:15:15.262 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:15.224867+0000", 2024-04-26T11:15:15.262 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9995394, 2024-04-26T11:15:15.262 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00020342799999999999, 2024-04-26T11:15:15.262 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.262 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:15:15.262 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:15.262 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:15.262 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:15.262 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 241660 2024-04-26T11:15:15.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.263 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.263 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.263 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.263 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224867+0000", 2024-04-26T11:15:15.263 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.263 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.263 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.263 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.263 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224867+0000", 2024-04-26T11:15:15.263 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.263 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.263 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.263 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.263 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224866+0000", 2024-04-26T11:15:15.264 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:15.264 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.264 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.264 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.264 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224870+0000", 2024-04-26T11:15:15.264 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3809999999999999e-06 2024-04-26T11:15:15.264 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.264 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.264 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.264 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224878+0000", 2024-04-26T11:15:15.264 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.636e-06 2024-04-26T11:15:15.264 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.264 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.264 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.264 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:15.224884+0000", 2024-04-26T11:15:15.265 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:15:15.265 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.265 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.265 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.265 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.265 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:15:15.265 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 11 2024-04-26T11:15:15.265 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:15.266 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:15.303 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:15.301+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:15.404 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:15.402+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:15.493 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:15.493 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:15:15.493 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:15:15.493 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:15:15.493 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:15.504 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:15.503+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:15.507 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:15.605 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:15.604+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:15.699 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:15.699 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:15:15.699 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:15:15.699 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:15:15.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.699 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:15.699 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:15.699 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 82.424248558000002, 2024-04-26T11:15:15.699 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:15:15.700 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.700 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:15.700 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:15.700 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:15.700 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:15.700 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:15:15.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.700 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.700 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.700 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:15.700 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.701 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.701 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:15.701 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.701 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.701 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:15:15.701 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:15.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.701 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.701 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:15:15.701 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:15:15.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.702 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.702 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:15:15.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:15:15.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.702 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.702 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:15:15.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:15:15.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.702 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:15:15.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:15:15.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:15:15.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:15:15.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:15.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:15:15.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:15:15.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:15.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:15:15.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:15:15.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:15.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:15:15.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:15:15.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:15.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:15:15.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:15:15.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:15.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:15:15.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:15:15.705 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.705 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.705 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.706 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:15.706 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:15.706 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 82.423436992999996, 2024-04-26T11:15:15.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:15:15.706 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.706 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:15.706 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:15.706 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:15.706 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:15.706 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:15:15.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.706 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:15.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:15.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:15.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:15.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:15:15.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:15:15.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:15:15.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:15:15.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:15:15.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:15:15.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:15:15.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:15:15.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:15:15.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:15:15.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:15.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:15:15.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:15:15.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:15.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:15:15.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:15:15.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:15.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:15:15.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:15:15.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:15.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:15:15.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:15:15.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.711 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:15.711 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:15:15.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:15:15.711 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.711 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.711 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.711 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:15.711 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:15.711 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 82.416250156000004, 2024-04-26T11:15:15.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:15:15.712 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.712 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:15.712 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:15.712 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:15.712 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:15.712 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:15:15.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.712 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:15.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:15.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:15:15.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:15.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:15:15.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:15:15.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:15:15.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:15:15.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:15:15.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:15:15.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:15:15.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:15:15.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:15:15.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:15:15.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:15.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:15:15.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:15:15.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.716 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:15.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:15:15.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:15:15.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.716 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:15.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:15:15.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:15:15.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.716 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:15.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:15:15.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:15:15.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:15.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:15:15.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:15:15.717 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.717 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.717 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.717 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:15.717 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:15.717 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 82.415709277000005, 2024-04-26T11:15:15.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:15:15.718 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.718 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:15.718 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:15.718 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:15.718 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:15.718 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:15:15.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.718 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:15.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:15.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:15.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:15.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:15:15.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:15:15.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:15:15.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:15:15.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:15:15.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:15:15.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:15:15.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:15:15.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:15:15.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:15:15.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:15.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:15:15.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:15:15.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:15.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:15:15.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:15:15.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:15.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:15:15.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:15:15.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:15.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:15:15.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:15:15.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:15.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:15:15.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:15:15.723 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.724 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.724 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.724 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:15.724 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:15.724 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 78.372524830000003, 2024-04-26T11:15:15.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:15:15.724 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.724 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:15.724 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:15.725 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:15.725 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:15.725 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:15:15.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.725 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:15.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:15.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.726 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:15:15.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:15.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.726 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:15:15.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:15:15.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:15:15.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:15:15.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:15:15.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:15:15.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:15:15.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:15:15.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:15:15.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:15:15.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:15.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:15:15.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:15:15.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:15.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:15:15.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:15:15.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:15:15.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:15:15.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:15.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:15:15.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:15:15.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:15:15.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:15:15.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:15.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:15:15.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:15:15.730 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.730 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.730 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.731 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:15.731 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:15.731 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 78.370331489999998, 2024-04-26T11:15:15.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:15:15.731 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.731 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:15.731 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:15.731 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:15.731 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:15.731 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:15:15.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.731 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:15.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:15.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:15:15.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:15.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:15:15.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:15:15.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:15:15.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:15:15.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:15:15.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:15:15.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:15:15.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:15:15.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:15:15.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:15:15.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:15.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:15:15.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:15:15.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:15.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:15:15.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:15:15.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:15:15.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:15:15.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:15.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:15:15.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:15:15.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:15:15.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:15:15.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:15.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:15:15.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:15:15.737 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.738 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.738 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.738 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:15.738 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:15.739 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 78.365119665999998, 2024-04-26T11:15:15.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:15:15.739 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.739 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:15.739 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:15.740 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:15.740 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:15.740 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:15:15.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.740 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:15.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:15.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:15:15.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:15.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:15:15.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:15:15.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:15:15.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:15:15.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:15:15.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:15:15.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:15:15.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:15:15.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:15:15.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:15:15.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:15.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:15:15.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:15:15.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:15.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:15:15.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:15:15.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:15:15.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:15:15.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:15.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:15:15.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:15:15.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:15:15.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:15:15.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:15.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:15:15.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:15:15.745 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.745 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.745 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.745 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:15.745 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:15.745 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 78.348670966, 2024-04-26T11:15:15.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:15:15.745 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.746 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:15.746 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:15.746 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:15.746 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:15.746 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:15:15.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.746 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:15.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:15.747 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.747 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.747 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:15:15.747 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:15.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.747 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.747 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:15:15.747 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:15:15.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.747 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:15:15.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:15:15.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:15:15.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:15:15.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:15:15.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:15:15.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:15.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:15:15.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:15:15.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:15:15.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:15:15.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:15.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:15:15.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:15:15.749 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.749 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.750 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.750 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:15.750 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:15.750 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 78.346973461000005, 2024-04-26T11:15:15.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:15:15.750 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.750 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:15.750 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:15.750 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:15.750 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:15.750 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:15:15.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.751 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:15.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:15.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:15:15.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:15.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:15:15.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:15:15.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:15:15.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:15:15.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:15:15.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:15:15.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:15:15.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:15:15.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:15.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:15:15.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:15:15.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:15:15.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:15:15.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:15.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:15:15.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:15:15.754 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.754 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.754 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.754 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:15.754 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:15.754 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 78.346909159000006, 2024-04-26T11:15:15.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:15:15.755 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.755 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:15.755 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:15.755 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:15.755 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:15.755 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:15:15.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.755 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:15.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.756 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.756 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:15.756 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.756 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.756 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:15.756 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:15.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.756 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.756 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:15:15.756 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:15:15.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.757 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.757 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:15:15.757 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:15:15.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.757 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.757 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:15:15.757 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:15:15.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.757 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.757 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:15:15.757 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:15:15.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.758 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:15.758 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:15:15.758 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:15:15.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.758 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.758 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:15:15.758 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:15:15.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.758 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:15:15.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:15:15.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.759 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:15.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:15:15.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:15:15.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.759 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:15.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:15:15.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:15:15.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.760 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:15.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:15:15.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:15:15.760 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.760 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.760 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.760 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:15.760 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:15.760 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 78.346854934999996, 2024-04-26T11:15:15.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:15:15.760 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.760 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:15.760 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:15.761 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:15.761 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:15.761 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:15:15.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.761 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.761 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.761 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:15.761 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.761 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.761 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:15.762 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.762 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.762 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:15.762 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:15.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.762 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.762 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:15:15.762 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:15:15.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.762 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:15:15.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:15:15.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.763 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:15:15.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:15:15.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.763 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:15:15.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:15:15.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.763 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:15.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:15:15.764 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:15:15.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.764 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.764 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:15:15.764 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:15:15.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.764 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.764 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:15:15.764 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:15:15.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.764 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:15.764 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:15:15.764 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:15:15.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:15.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:15:15.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:15:15.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:15.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:15:15.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:15:15.765 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.765 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.765 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.766 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:15.766 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:15.766 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 78.346810422999994, 2024-04-26T11:15:15.766 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:15:15.766 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.766 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:15.766 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:15.766 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:15.766 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:15.766 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:15:15.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.766 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.766 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.766 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.766 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:15.767 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.767 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.767 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:15.767 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.767 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.767 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:15:15.767 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:15.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.767 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:15:15.768 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:15:15.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.768 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:15:15.768 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:15:15.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.768 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:15:15.768 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:15:15.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.768 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:15:15.769 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:15:15.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.769 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:15.769 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:15:15.769 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:15:15.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.769 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.769 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:15:15.769 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:15:15.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.770 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.770 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.770 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:15:15.770 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:15:15.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.770 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.770 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:15.770 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:15:15.770 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:15:15.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.770 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.771 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:15.771 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:15:15.771 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:15:15.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.771 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.771 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:15.771 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:15:15.771 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:15:15.771 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.771 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.771 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.771 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.771 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:15.772 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:15.772 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 78.342589421, 2024-04-26T11:15:15.772 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:15:15.772 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.772 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:15.772 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:15.772 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:15.772 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:15.772 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:15:15.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.772 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.772 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.772 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.772 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:15.773 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.773 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.773 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.773 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:15.773 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.773 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.773 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.773 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:15:15.773 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:15:15.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.773 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.773 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.774 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:15:15.774 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:15:15.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.774 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.774 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.774 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:15:15.774 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:15:15.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.774 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.774 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.774 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:15:15.774 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:15:15.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.775 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.775 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.775 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:15:15.775 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:15:15.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.775 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.775 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:15.775 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:15:15.775 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:15:15.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.775 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.775 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.775 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:15:15.775 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:15:15.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.776 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.776 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:15:15.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:15:15.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.776 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:15.776 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:15:15.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:15:15.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.776 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:15.776 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:15:15.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:15:15.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.777 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:15.777 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:15:15.777 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:15:15.777 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.777 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.777 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.777 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174388 5.c 5:312e5163:::benchmark_data_smithi029_44842_object29750:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:15.777 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:15.777 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.346763765999999, 2024-04-26T11:15:15.777 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.064002009999999998, 2024-04-26T11:15:15.778 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.778 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:15.778 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:15.778 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:15.778 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:15.778 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174388 2024-04-26T11:15:15.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.778 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.778 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.778 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.778 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:15.778 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.778 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.779 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.779 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:15.779 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.779 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.779 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348231+0000", 2024-04-26T11:15:15.779 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:15.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.779 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.779 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348233+0000", 2024-04-26T11:15:15.779 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2249999999999999e-06 2024-04-26T11:15:15.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.780 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.780 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348238+0000", 2024-04-26T11:15:15.780 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1899999999999997e-06 2024-04-26T11:15:15.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.780 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.780 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348241+0000", 2024-04-26T11:15:15.780 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.965e-06 2024-04-26T11:15:15.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.780 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.780 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348264+0000", 2024-04-26T11:15:15.780 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3014e-05 2024-04-26T11:15:15.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.781 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.781 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348371+0000", 2024-04-26T11:15:15.781 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000106889 2024-04-26T11:15:15.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.781 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.781 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:15.781 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412126+0000", 2024-04-26T11:15:15.781 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063755495999999995 2024-04-26T11:15:15.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.781 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.781 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:15.781 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412165+0000", 2024-04-26T11:15:15.781 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9269e-05 2024-04-26T11:15:15.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.782 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:15.782 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412234+0000", 2024-04-26T11:15:15.782 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8337000000000007e-05 2024-04-26T11:15:15.782 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.782 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.782 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.782 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174390 5.1 5:81c54fd7:::benchmark_data_smithi029_44842_object29752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:15.782 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:15.782 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.346648611999999, 2024-04-26T11:15:15.782 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063635918, 2024-04-26T11:15:15.782 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.783 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:15.783 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:15.783 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:15.783 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:15.783 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174390 2024-04-26T11:15:15.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.783 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.783 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.783 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.783 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:15.783 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.783 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.783 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.784 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:15.784 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.784 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.784 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348346+0000", 2024-04-26T11:15:15.784 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:15.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.784 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.784 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348351+0000", 2024-04-26T11:15:15.784 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.442e-06 2024-04-26T11:15:15.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.784 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.784 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348357+0000", 2024-04-26T11:15:15.784 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9530000000000002e-06 2024-04-26T11:15:15.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.785 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.785 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348363+0000", 2024-04-26T11:15:15.785 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2129999999999999e-06 2024-04-26T11:15:15.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.785 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.785 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348396+0000", 2024-04-26T11:15:15.785 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3161999999999999e-05 2024-04-26T11:15:15.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.785 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.785 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348511+0000", 2024-04-26T11:15:15.785 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000115253 2024-04-26T11:15:15.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.786 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:15.786 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411857+0000", 2024-04-26T11:15:15.786 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063345431999999993 2024-04-26T11:15:15.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.786 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:15.786 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411904+0000", 2024-04-26T11:15:15.786 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7389000000000003e-05 2024-04-26T11:15:15.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.786 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:15.787 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411983+0000", 2024-04-26T11:15:15.787 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8750000000000003e-05 2024-04-26T11:15:15.787 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.787 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.787 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.787 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.787 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174394 5.3 5:c91ce5cb:::benchmark_data_smithi029_44842_object29756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:15.787 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:15.787 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.346545668000001, 2024-04-26T11:15:15.787 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062247626, 2024-04-26T11:15:15.787 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.787 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:15.787 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:15.787 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:15.788 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:15.788 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174394 2024-04-26T11:15:15.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.788 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.788 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.788 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:15.788 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.788 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.788 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:15.788 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.789 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.789 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348449+0000", 2024-04-26T11:15:15.789 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:15.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.789 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.789 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348457+0000", 2024-04-26T11:15:15.789 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9619999999999993e-06 2024-04-26T11:15:15.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.789 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.789 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348462+0000", 2024-04-26T11:15:15.789 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6569999999999996e-06 2024-04-26T11:15:15.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.790 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.790 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348465+0000", 2024-04-26T11:15:15.790 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2990000000000001e-06 2024-04-26T11:15:15.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.790 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.790 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408427+0000", 2024-04-26T11:15:15.790 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.059961423 2024-04-26T11:15:15.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.790 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.791 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408554+0000", 2024-04-26T11:15:15.791 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012779600000000001 2024-04-26T11:15:15.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.791 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:15.791 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410570+0000", 2024-04-26T11:15:15.791 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020152719999999998 2024-04-26T11:15:15.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.791 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:15.791 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410624+0000", 2024-04-26T11:15:15.791 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4211e-05 2024-04-26T11:15:15.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.791 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:15.792 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410697+0000", 2024-04-26T11:15:15.792 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3447000000000003e-05 2024-04-26T11:15:15.792 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.792 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.792 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.792 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.792 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174395 5.1 5:8ee7f1d3:::benchmark_data_smithi029_44842_object29757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:15.792 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:15.792 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.345515577, 2024-04-26T11:15:15.792 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062622744999999994, 2024-04-26T11:15:15.792 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.792 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:15.792 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:15.792 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:15.793 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:15.793 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174395 2024-04-26T11:15:15.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.793 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.793 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.793 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:15.793 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.793 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.793 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:15.793 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.794 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.794 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349479+0000", 2024-04-26T11:15:15.794 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:15.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.794 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.794 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349483+0000", 2024-04-26T11:15:15.794 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.54e-06 2024-04-26T11:15:15.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.794 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.794 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349488+0000", 2024-04-26T11:15:15.795 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5119999999999999e-06 2024-04-26T11:15:15.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.795 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.795 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349492+0000", 2024-04-26T11:15:15.795 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7170000000000002e-06 2024-04-26T11:15:15.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.795 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.795 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350187+0000", 2024-04-26T11:15:15.795 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00069535899999999999 2024-04-26T11:15:15.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.796 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.796 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350292+0000", 2024-04-26T11:15:15.796 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0001047 2024-04-26T11:15:15.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.796 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:15.796 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411992+0000", 2024-04-26T11:15:15.796 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061699647000000003 2024-04-26T11:15:15.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.796 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:15.796 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412030+0000", 2024-04-26T11:15:15.796 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8124999999999998e-05 2024-04-26T11:15:15.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.797 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:15.797 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412103+0000", 2024-04-26T11:15:15.797 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2733999999999999e-05 2024-04-26T11:15:15.797 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.797 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.797 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.797 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.797 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174396 5.7 5:e0fad05d:::benchmark_data_smithi029_44842_object29758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:15.797 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:15.797 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.345431938000001, 2024-04-26T11:15:15.797 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062445026000000001, 2024-04-26T11:15:15.798 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.798 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:15.798 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:15.798 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:15.798 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:15.798 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174396 2024-04-26T11:15:15.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.798 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.798 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.798 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.798 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:15.798 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.798 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.799 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.799 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:15.799 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.799 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.799 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:15.799 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:15.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.799 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.799 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349566+0000", 2024-04-26T11:15:15.799 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2490000000000001e-06 2024-04-26T11:15:15.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.800 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349573+0000", 2024-04-26T11:15:15.800 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.776e-06 2024-04-26T11:15:15.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.800 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349576+0000", 2024-04-26T11:15:15.800 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3629999999999998e-06 2024-04-26T11:15:15.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.800 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350396+0000", 2024-04-26T11:15:15.801 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00081992199999999995 2024-04-26T11:15:15.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.801 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.801 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350516+0000", 2024-04-26T11:15:15.801 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012006900000000001 2024-04-26T11:15:15.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.801 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:15.801 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411924+0000", 2024-04-26T11:15:15.801 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061407960999999997 2024-04-26T11:15:15.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.802 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:15.802 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411947+0000", 2024-04-26T11:15:15.802 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2943999999999999e-05 2024-04-26T11:15:15.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.802 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:15.802 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412008+0000", 2024-04-26T11:15:15.802 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1237999999999999e-05 2024-04-26T11:15:15.802 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.802 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.802 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.802 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174397 5.7 5:e25daf9a:::benchmark_data_smithi029_44842_object29759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:15.803 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:15.803 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.345323809, 2024-04-26T11:15:15.803 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063878565999999998, 2024-04-26T11:15:15.803 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.803 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:15.803 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:15.803 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:15.803 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:15.803 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174397 2024-04-26T11:15:15.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.803 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.803 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.803 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:15.804 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.804 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.804 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:15.804 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.804 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.804 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349671+0000", 2024-04-26T11:15:15.804 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:15.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.804 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.805 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349674+0000", 2024-04-26T11:15:15.805 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3360000000000002e-06 2024-04-26T11:15:15.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.805 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.805 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349678+0000", 2024-04-26T11:15:15.805 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0709999999999996e-06 2024-04-26T11:15:15.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.805 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.805 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349681+0000", 2024-04-26T11:15:15.805 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3139999999999999e-06 2024-04-26T11:15:15.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.806 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.806 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410371+0000", 2024-04-26T11:15:15.806 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.060690202999999998 2024-04-26T11:15:15.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.806 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.806 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.806 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410463+0000", 2024-04-26T11:15:15.806 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2095000000000005e-05 2024-04-26T11:15:15.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.806 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.806 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:15.806 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413471+0000", 2024-04-26T11:15:15.806 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0030073909999999999 2024-04-26T11:15:15.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.807 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:15.807 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413499+0000", 2024-04-26T11:15:15.807 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8725e-05 2024-04-26T11:15:15.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.807 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:15.807 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413550+0000", 2024-04-26T11:15:15.807 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0810000000000003e-05 2024-04-26T11:15:15.807 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.807 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.807 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.807 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:174398 5.4 e46/16 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head v 46'10798, mlcod=46'10796)", 2024-04-26T11:15:15.808 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:15.808 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 25.344795598000001, 2024-04-26T11:15:15.808 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062067047, 2024-04-26T11:15:15.808 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:15.808 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:15.808 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:15.808 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.808 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:15.808 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:15.808 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.808 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.808 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:15.809 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:15.809 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:15.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.809 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.809 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:15.809 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350199+0000", 2024-04-26T11:15:15.809 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:15.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.809 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.809 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:15.809 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350205+0000", 2024-04-26T11:15:15.809 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6749999999999999e-06 2024-04-26T11:15:15.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.809 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.809 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:15.810 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350212+0000", 2024-04-26T11:15:15.810 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7000000000000002e-06 2024-04-26T11:15:15.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.810 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.810 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.810 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350216+0000", 2024-04-26T11:15:15.810 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5120000000000002e-06 2024-04-26T11:15:15.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.810 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.810 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:15.810 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350246+0000", 2024-04-26T11:15:15.810 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9978999999999999e-05 2024-04-26T11:15:15.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.810 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.811 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:15.811 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350263+0000", 2024-04-26T11:15:15.811 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.702e-05 2024-04-26T11:15:15.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.811 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:15.811 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412238+0000", 2024-04-26T11:15:15.811 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061974603000000003 2024-04-26T11:15:15.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:15.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:15.811 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:15.811 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412267+0000", 2024-04-26T11:15:15.811 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9116e-05 2024-04-26T11:15:15.811 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.812 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.812 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.812 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:15.812 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:15.812 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:15.814 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:15.811+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:15.814 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is set 2024-04-26T11:15:15.815 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:15.914 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:15.913+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:15.990 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:15.990 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:15:15.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:15.990 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:243742 5.e 5:745c1d4c:::benchmark_data_smithi029_44842_object99104:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T11:15:15.990 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:15.981129+0000", 2024-04-26T11:15:15.991 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0068701259999999998, 2024-04-26T11:15:15.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0068979949999999996, 2024-04-26T11:15:15.991 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:15.991 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:15.991 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:15.991 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:15.991 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:15.991 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 243742 2024-04-26T11:15:15.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:15.991 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:15.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:15.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:15.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.981129+0000", 2024-04-26T11:15:15.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:15.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:15.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:15.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:15.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.981129+0000", 2024-04-26T11:15:15.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:15.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:15.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:15.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:15.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.981128+0000", 2024-04-26T11:15:15.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:15.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:15.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:15.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:15.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.981133+0000", 2024-04-26T11:15:15.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5730000000000001e-06 2024-04-26T11:15:15.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:15.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:15.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:15.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.981143+0000", 2024-04-26T11:15:15.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0079e-05 2024-04-26T11:15:15.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:15.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:15.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.981152+0000", 2024-04-26T11:15:15.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.5480000000000002e-06 2024-04-26T11:15:15.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:15.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:15.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:15.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.981190+0000", 2024-04-26T11:15:15.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8588999999999999e-05 2024-04-26T11:15:15.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:15.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:15.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:15.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.981319+0000", 2024-04-26T11:15:15.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000128546 2024-04-26T11:15:15.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:15.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:15.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:15.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.981436+0000", 2024-04-26T11:15:15.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011728800000000001 2024-04-26T11:15:15.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:15.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:15.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:15.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.987758+0000", 2024-04-26T11:15:15.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0063218320000000003 2024-04-26T11:15:15.995 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:15.995 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:15.995 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:15.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:15.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:15.995 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:243744 5.0 5:0672f224:::benchmark_data_smithi029_44842_object99106:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T11:15:15.995 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:15.983059+0000", 2024-04-26T11:15:15.995 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0049404200000000001, 2024-04-26T11:15:15.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0050741370000000003, 2024-04-26T11:15:15.995 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:15.995 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:15.996 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:15.996 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:15.996 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:15.996 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 243744 2024-04-26T11:15:15.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:15.996 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:15.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:15.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:15.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983059+0000", 2024-04-26T11:15:15.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:15.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:15.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:15.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:15.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983059+0000", 2024-04-26T11:15:15.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:15.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:15.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:15.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:15.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983058+0000", 2024-04-26T11:15:15.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:15.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:15.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:15.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:15.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983061+0000", 2024-04-26T11:15:15.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.106e-06 2024-04-26T11:15:15.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:15.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:15.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:15.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983074+0000", 2024-04-26T11:15:15.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3030999999999999e-05 2024-04-26T11:15:15.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:15.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:15.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:15.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983079+0000", 2024-04-26T11:15:15.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7929999999999997e-06 2024-04-26T11:15:15.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:15.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:15.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:15.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983112+0000", 2024-04-26T11:15:15.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2396e-05 2024-04-26T11:15:15.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:15.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:15.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:15.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983231+0000", 2024-04-26T11:15:15.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011894 2024-04-26T11:15:15.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:15.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:16.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983341+0000", 2024-04-26T11:15:16.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000110956 2024-04-26T11:15:16.001 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.001 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.001 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.001 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:243748 5.b 5:d52372a0:::benchmark_data_smithi029_44842_object99110:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T11:15:16.001 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:15.983109+0000", 2024-04-26T11:15:16.001 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0048905190000000003, 2024-04-26T11:15:16.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051070869999999997, 2024-04-26T11:15:16.001 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.001 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:16.001 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.001 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.001 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.002 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 243748 2024-04-26T11:15:16.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.002 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983109+0000", 2024-04-26T11:15:16.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983109+0000", 2024-04-26T11:15:16.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983108+0000", 2024-04-26T11:15:16.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983111+0000", 2024-04-26T11:15:16.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.182e-06 2024-04-26T11:15:16.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983119+0000", 2024-04-26T11:15:16.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6519999999999995e-06 2024-04-26T11:15:16.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983124+0000", 2024-04-26T11:15:16.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.2469999999999999e-06 2024-04-26T11:15:16.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983165+0000", 2024-04-26T11:15:16.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0102000000000003e-05 2024-04-26T11:15:16.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983294+0000", 2024-04-26T11:15:16.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012947499999999999 2024-04-26T11:15:16.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:16.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983409+0000", 2024-04-26T11:15:16.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000114868 2024-04-26T11:15:16.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:16.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.987653+0000", 2024-04-26T11:15:16.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0042439640000000002 2024-04-26T11:15:16.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:16.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.988211+0000", 2024-04-26T11:15:16.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00055774799999999995 2024-04-26T11:15:16.006 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.006 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.006 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.006 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:243749 5.e 5:7566244d:::benchmark_data_smithi029_44842_object99111:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T11:15:16.006 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:15.983132+0000", 2024-04-26T11:15:16.006 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0048669380000000003, 2024-04-26T11:15:16.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051390469999999999, 2024-04-26T11:15:16.006 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.006 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:16.006 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.007 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.007 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.007 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 243749 2024-04-26T11:15:16.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.007 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983132+0000", 2024-04-26T11:15:16.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983132+0000", 2024-04-26T11:15:16.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983132+0000", 2024-04-26T11:15:16.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983134+0000", 2024-04-26T11:15:16.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1509999999999998e-06 2024-04-26T11:15:16.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983140+0000", 2024-04-26T11:15:16.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1330000000000004e-06 2024-04-26T11:15:16.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983145+0000", 2024-04-26T11:15:16.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4739999999999999e-06 2024-04-26T11:15:16.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983176+0000", 2024-04-26T11:15:16.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1346000000000001e-05 2024-04-26T11:15:16.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983287+0000", 2024-04-26T11:15:16.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000110577 2024-04-26T11:15:16.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:16.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983396+0000", 2024-04-26T11:15:16.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010888 2024-04-26T11:15:16.010 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.010 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.010 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.010 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:243750 5.b 5:d9fd2707:::benchmark_data_smithi029_44842_object99112:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T11:15:16.010 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:15.983153+0000", 2024-04-26T11:15:16.010 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0048466610000000004, 2024-04-26T11:15:16.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.005178345, 2024-04-26T11:15:16.011 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.011 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:16.011 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.011 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.011 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.011 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 243750 2024-04-26T11:15:16.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.011 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983153+0000", 2024-04-26T11:15:16.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983153+0000", 2024-04-26T11:15:16.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983152+0000", 2024-04-26T11:15:16.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983161+0000", 2024-04-26T11:15:16.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7439999999999996e-06 2024-04-26T11:15:16.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983167+0000", 2024-04-26T11:15:16.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0549999999999996e-06 2024-04-26T11:15:16.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983172+0000", 2024-04-26T11:15:16.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7310000000000001e-06 2024-04-26T11:15:16.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985369+0000", 2024-04-26T11:15:16.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021972200000000002 2024-04-26T11:15:16.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985489+0000", 2024-04-26T11:15:16.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120326 2024-04-26T11:15:16.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:16.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985606+0000", 2024-04-26T11:15:16.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011637300000000001 2024-04-26T11:15:16.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:16.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.987658+0000", 2024-04-26T11:15:16.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020527509999999998 2024-04-26T11:15:16.015 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.015 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.015 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.015 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:243751 5.e 5:7890f777:::benchmark_data_smithi029_44842_object99113:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T11:15:16.015 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:15.983177+0000", 2024-04-26T11:15:16.015 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0048225389999999998, 2024-04-26T11:15:16.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052135430000000002, 2024-04-26T11:15:16.015 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.015 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:16.016 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.016 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.016 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.016 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 243751 2024-04-26T11:15:16.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.016 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983177+0000", 2024-04-26T11:15:16.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.016 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983177+0000", 2024-04-26T11:15:16.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983176+0000", 2024-04-26T11:15:16.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983179+0000", 2024-04-26T11:15:16.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4449999999999999e-06 2024-04-26T11:15:16.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983184+0000", 2024-04-26T11:15:16.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6629999999999998e-06 2024-04-26T11:15:16.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983189+0000", 2024-04-26T11:15:16.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8810000000000004e-06 2024-04-26T11:15:16.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985708+0000", 2024-04-26T11:15:16.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025188620000000002 2024-04-26T11:15:16.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985851+0000", 2024-04-26T11:15:16.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000143015 2024-04-26T11:15:16.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:16.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985972+0000", 2024-04-26T11:15:16.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120868 2024-04-26T11:15:16.019 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.019 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.019 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.020 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:243752 5.f 5:fe13bfba:::benchmark_data_smithi029_44842_object99114:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T11:15:16.020 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:15.983194+0000", 2024-04-26T11:15:16.020 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0048053970000000003, 2024-04-26T11:15:16.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052486080000000001, 2024-04-26T11:15:16.020 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.020 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:16.020 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.020 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.020 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.020 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 243752 2024-04-26T11:15:16.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.020 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983194+0000", 2024-04-26T11:15:16.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983194+0000", 2024-04-26T11:15:16.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983193+0000", 2024-04-26T11:15:16.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983196+0000", 2024-04-26T11:15:16.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.272e-06 2024-04-26T11:15:16.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983201+0000", 2024-04-26T11:15:16.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7389999999999996e-06 2024-04-26T11:15:16.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983206+0000", 2024-04-26T11:15:16.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6419999999999998e-06 2024-04-26T11:15:16.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.984834+0000", 2024-04-26T11:15:16.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001628282 2024-04-26T11:15:16.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.984967+0000", 2024-04-26T11:15:16.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000132378 2024-04-26T11:15:16.023 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.023 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.023 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.024 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:243754 5.f 5:feb46bc6:::benchmark_data_smithi029_44842_object99116:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T11:15:16.024 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:15.983234+0000", 2024-04-26T11:15:16.024 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0047652440000000001, 2024-04-26T11:15:16.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052552739999999999, 2024-04-26T11:15:16.024 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.024 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:16.024 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.024 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.024 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.024 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 243754 2024-04-26T11:15:16.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.024 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983234+0000", 2024-04-26T11:15:16.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983234+0000", 2024-04-26T11:15:16.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983234+0000", 2024-04-26T11:15:16.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983236+0000", 2024-04-26T11:15:16.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4219999999999999e-06 2024-04-26T11:15:16.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983242+0000", 2024-04-26T11:15:16.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1589999999999998e-06 2024-04-26T11:15:16.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983247+0000", 2024-04-26T11:15:16.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0189999999999997e-06 2024-04-26T11:15:16.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.986507+0000", 2024-04-26T11:15:16.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0032594730000000001 2024-04-26T11:15:16.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.986602+0000", 2024-04-26T11:15:16.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5360999999999997e-05 2024-04-26T11:15:16.027 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.027 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.027 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.028 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:243756 5.0 5:03122b8b:::benchmark_data_smithi029_44842_object99118:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T11:15:16.028 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:15.983251+0000", 2024-04-26T11:15:16.028 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0047478310000000001, 2024-04-26T11:15:16.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052781149999999999, 2024-04-26T11:15:16.028 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.028 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:16.028 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.028 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.028 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.028 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 243756 2024-04-26T11:15:16.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.029 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983251+0000", 2024-04-26T11:15:16.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983251+0000", 2024-04-26T11:15:16.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983251+0000", 2024-04-26T11:15:16.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983253+0000", 2024-04-26T11:15:16.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.119e-06 2024-04-26T11:15:16.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983259+0000", 2024-04-26T11:15:16.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6659999999999996e-06 2024-04-26T11:15:16.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983264+0000", 2024-04-26T11:15:16.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5060000000000003e-06 2024-04-26T11:15:16.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985296+0000", 2024-04-26T11:15:16.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020312720000000002 2024-04-26T11:15:16.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985423+0000", 2024-04-26T11:15:16.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012682000000000001 2024-04-26T11:15:16.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:16.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985542+0000", 2024-04-26T11:15:16.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000119082 2024-04-26T11:15:16.032 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.032 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.032 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.033 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:243757 5.0 5:0f6f4b24:::benchmark_data_smithi029_44842_object99119:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T11:15:16.033 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:15.983271+0000", 2024-04-26T11:15:16.033 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0047285219999999998, 2024-04-26T11:15:16.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0052991799999999997, 2024-04-26T11:15:16.033 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.033 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:16.033 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.033 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.033 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.033 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 243757 2024-04-26T11:15:16.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.033 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983271+0000", 2024-04-26T11:15:16.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983271+0000", 2024-04-26T11:15:16.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983270+0000", 2024-04-26T11:15:16.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983273+0000", 2024-04-26T11:15:16.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1500000000000002e-06 2024-04-26T11:15:16.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983282+0000", 2024-04-26T11:15:16.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8830000000000001e-06 2024-04-26T11:15:16.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.983288+0000", 2024-04-26T11:15:16.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0610000000000003e-06 2024-04-26T11:15:16.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.987262+0000", 2024-04-26T11:15:16.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039747660000000002 2024-04-26T11:15:16.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.987545+0000", 2024-04-26T11:15:16.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028304699999999998 2024-04-26T11:15:16.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:16.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.987668+0000", 2024-04-26T11:15:16.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000122674 2024-04-26T11:15:16.037 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.037 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.037 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.037 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:243758 5.f 5:f495eff6:::benchmark_data_smithi029_44842_object99120:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T11:15:16.037 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:15.985268+0000", 2024-04-26T11:15:16.037 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0027315849999999999, 2024-04-26T11:15:16.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0033424370000000002, 2024-04-26T11:15:16.037 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.037 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:16.037 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.038 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.038 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.038 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 243758 2024-04-26T11:15:16.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.038 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985268+0000", 2024-04-26T11:15:16.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985268+0000", 2024-04-26T11:15:16.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985267+0000", 2024-04-26T11:15:16.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:16.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985270+0000", 2024-04-26T11:15:16.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5700000000000001e-06 2024-04-26T11:15:16.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985287+0000", 2024-04-26T11:15:16.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.6677999999999999e-05 2024-04-26T11:15:16.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985293+0000", 2024-04-26T11:15:16.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3339999999999998e-06 2024-04-26T11:15:16.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.988093+0000", 2024-04-26T11:15:16.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027993750000000002 2024-04-26T11:15:16.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.988213+0000", 2024-04-26T11:15:16.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120664 2024-04-26T11:15:16.041 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.041 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.041 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.042 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:243759 5.d 5:bb75d9c6:::benchmark_data_smithi029_44842_object99121:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T11:15:16.042 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:15.985300+0000", 2024-04-26T11:15:16.042 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0026992959999999999, 2024-04-26T11:15:16.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0033468339999999999, 2024-04-26T11:15:16.042 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.042 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:16.042 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.042 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.042 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.042 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 243759 2024-04-26T11:15:16.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.042 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985300+0000", 2024-04-26T11:15:16.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985300+0000", 2024-04-26T11:15:16.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.043 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.043 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.043 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.043 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985300+0000", 2024-04-26T11:15:16.043 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985302+0000", 2024-04-26T11:15:16.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.588e-06 2024-04-26T11:15:16.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985308+0000", 2024-04-26T11:15:16.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2859999999999996e-06 2024-04-26T11:15:16.044 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.044 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.044 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.044 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985314+0000", 2024-04-26T11:15:16.044 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.079e-06 2024-04-26T11:15:16.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.986319+0000", 2024-04-26T11:15:16.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010053 2024-04-26T11:15:16.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.045 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.045 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.045 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.986442+0000", 2024-04-26T11:15:16.045 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000122843 2024-04-26T11:15:16.045 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.045 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.045 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.045 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.046 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:243760 5.f 5.4f37c65f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T11:15:16.046 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:15.985322+0000", 2024-04-26T11:15:16.046 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.002677165, 2024-04-26T11:15:16.046 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0033750020000000002, 2024-04-26T11:15:16.046 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.046 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-26T11:15:16.046 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.046 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.046 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.046 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 243760 2024-04-26T11:15:16.046 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.046 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.046 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985322+0000", 2024-04-26T11:15:16.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985322+0000", 2024-04-26T11:15:16.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.047 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.047 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985322+0000", 2024-04-26T11:15:16.047 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.047 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.047 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985324+0000", 2024-04-26T11:15:16.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.576e-06 2024-04-26T11:15:16.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985330+0000", 2024-04-26T11:15:16.048 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8590000000000001e-06 2024-04-26T11:15:16.048 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.048 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.048 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.048 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.985335+0000", 2024-04-26T11:15:16.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7650000000000001e-06 2024-04-26T11:15:16.049 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.049 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.049 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.049 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.049 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.049 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:243762 5.e 5:7e2ecd5d:::benchmark_data_smithi029_44842_object99124:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T11:15:16.049 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:15.987640+0000", 2024-04-26T11:15:16.049 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00035901800000000001, 2024-04-26T11:15:16.049 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011279420000000001, 2024-04-26T11:15:16.049 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.049 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:16.049 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.049 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.049 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.050 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 243762 2024-04-26T11:15:16.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.050 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.987640+0000", 2024-04-26T11:15:16.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.050 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.987640+0000", 2024-04-26T11:15:16.050 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.050 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.050 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.050 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.987639+0000", 2024-04-26T11:15:16.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:16.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.987645+0000", 2024-04-26T11:15:16.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9730000000000002e-06 2024-04-26T11:15:16.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.051 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.051 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.987656+0000", 2024-04-26T11:15:16.051 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1019000000000001e-05 2024-04-26T11:15:16.051 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.051 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.987664+0000", 2024-04-26T11:15:16.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0150000000000003e-06 2024-04-26T11:15:16.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.987784+0000", 2024-04-26T11:15:16.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011921099999999999 2024-04-26T11:15:16.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.052 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.052 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.987904+0000", 2024-04-26T11:15:16.052 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120807 2024-04-26T11:15:16.052 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.052 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.053 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:16.053 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:15.987997+0000", 2024-04-26T11:15:16.053 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2429999999999994e-05 2024-04-26T11:15:16.053 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.053 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.053 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.053 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.053 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:15:16.053 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 14 2024-04-26T11:15:16.053 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:16.055 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:16.055 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:16.052+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:16.155 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:16.153+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:16.257 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:16.255+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:16.275 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:16.275 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:15:16.275 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:15:16.276 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:15:16.276 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:16.288 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:16.357 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:16.355+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:16.458 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:16.456+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:16.501 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:16.501 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:15:16.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:15:16.501 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:15:16.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.501 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:16.502 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:16.502 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 83.219133764999995, 2024-04-26T11:15:16.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:15:16.502 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.502 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:16.502 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.502 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.502 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.502 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:15:16.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.502 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:16.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:16.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:16.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:15:16.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:15:16.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:15:16.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:15:16.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:15:16.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:15:16.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:15:16.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:15:16.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:15:16.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:15:16.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:16.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:15:16.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:15:16.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:16.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:15:16.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:15:16.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.506 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:16.506 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:15:16.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:15:16.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:16.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:15:16.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:15:16.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:16.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:15:16.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:15:16.507 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.507 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.507 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.508 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:16.508 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:16.508 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 83.218484063000005, 2024-04-26T11:15:16.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:15:16.508 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.508 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:16.508 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.508 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.508 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.508 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:15:16.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.509 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:16.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:16.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:15:16.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:16.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:15:16.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:15:16.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:15:16.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:15:16.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:15:16.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:15:16.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:15:16.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:15:16.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:15:16.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:15:16.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:16.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:15:16.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:15:16.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:16.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:15:16.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:15:16.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:16.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:15:16.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:15:16.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:16.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:15:16.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:15:16.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:16.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:15:16.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:15:16.513 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.513 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.513 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.514 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:16.514 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:16.514 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.151842024000004, 2024-04-26T11:15:16.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:15:16.514 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.514 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:16.514 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.514 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.514 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.514 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:15:16.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.514 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:16.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:16.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:15:16.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:16.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:15:16.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:15:16.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:15:16.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:15:16.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:15:16.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:15:16.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:15:16.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:15:16.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.517 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:16.517 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:15:16.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:15:16.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:15:16.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:15:16.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:16.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:15:16.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:15:16.518 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.518 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.518 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.518 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:16.519 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:16.519 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.151746377999999, 2024-04-26T11:15:16.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:15:16.519 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.519 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:16.519 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.519 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.519 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.519 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:15:16.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.519 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:16.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:16.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:15:16.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:15:16.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:15:16.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:15:16.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:15:16.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:15:16.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:15:16.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:15:16.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:15:16.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:16.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:15:16.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:15:16.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:15:16.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:15:16.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:16.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:15:16.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:15:16.523 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.523 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.523 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.523 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:16.523 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:16.523 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.151614699000007, 2024-04-26T11:15:16.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:15:16.523 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.523 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:16.524 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.524 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.524 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.524 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:15:16.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.524 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:16.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:16.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:16.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:15:16.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:15:16.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:15:16.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:15:16.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:15:16.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:15:16.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:15:16.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:15:16.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:16.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:15:16.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:15:16.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:15:16.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:15:16.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:16.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:15:16.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:15:16.527 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.528 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.528 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.528 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:16.528 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:16.528 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.151506243, 2024-04-26T11:15:16.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:15:16.528 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.528 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:16.528 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.528 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.528 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.528 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:15:16.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.529 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:16.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:16.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:15:16.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:16.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:15:16.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:15:16.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:15:16.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:15:16.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:15:16.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:15:16.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:15:16.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:15:16.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:16.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:15:16.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:15:16.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:15:16.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:15:16.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:16.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:15:16.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:15:16.532 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.532 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.532 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.533 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:16.533 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:16.533 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.151404975000005, 2024-04-26T11:15:16.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:15:16.533 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.533 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:16.533 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.533 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.533 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.533 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:15:16.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.533 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:16.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:16.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:16.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:15:16.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:15:16.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:15:16.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:15:16.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:15:16.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:15:16.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:15:16.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:15:16.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:16.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:15:16.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:15:16.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:15:16.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:15:16.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:15:16.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:15:16.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:16.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:15:16.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:15:16.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:16.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:15:16.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:15:16.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.539 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:16.539 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:15:16.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:15:16.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.540 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.540 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.540 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:16.540 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:16.540 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.151336033999996, 2024-04-26T11:15:16.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:15:16.540 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.540 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:16.540 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.540 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.541 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.541 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:15:16.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.541 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:16.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:16.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:15:16.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:15:16.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:15:16.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:15:16.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:15:16.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:15:16.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:15:16.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:15:16.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:15:16.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:16.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:15:16.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:15:16.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:15:16.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:15:16.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:15:16.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:15:16.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:16.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:15:16.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:15:16.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:16.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:15:16.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:15:16.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:16.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:15:16.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:15:16.546 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.546 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.546 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.547 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:16.547 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:16.547 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 79.145340453000003, 2024-04-26T11:15:16.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:15:16.547 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.547 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:16.547 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.547 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.547 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.547 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:15:16.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.548 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:16.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:16.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:15:16.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:15:16.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:15:16.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:15:16.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:15:16.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:15:16.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:15:16.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:15:16.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:15:16.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:16.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:15:16.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:15:16.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:15:16.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:15:16.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:15:16.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:15:16.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:16.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:15:16.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:15:16.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:16.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:15:16.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:15:16.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:16.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:15:16.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:15:16.554 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.554 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.554 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.554 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101754 5.e 5:7ca15a5c:::benchmark_data_smithi029_44842_object101753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:16.555 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:16.555 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 57.379392711000001, 2024-04-26T11:15:16.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039171048999999999, 2024-04-26T11:15:16.555 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.555 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:16.555 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.555 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.555 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.555 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101754 2024-04-26T11:15:16.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.555 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:16.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:16.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.556 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:16.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.556 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118604+0000", 2024-04-26T11:15:16.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3399000000000007e-05 2024-04-26T11:15:16.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118613+0000", 2024-04-26T11:15:16.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6989999999999992e-06 2024-04-26T11:15:16.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118618+0000", 2024-04-26T11:15:16.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3850000000000001e-06 2024-04-26T11:15:16.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118646+0000", 2024-04-26T11:15:16.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7878e-05 2024-04-26T11:15:16.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118720+0000", 2024-04-26T11:15:16.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3461999999999996e-05 2024-04-26T11:15:16.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:16.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118807+0000", 2024-04-26T11:15:16.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7269999999999996e-05 2024-04-26T11:15:16.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:16.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142317+0000", 2024-04-26T11:15:16.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023510105999999999 2024-04-26T11:15:16.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:16.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.143287+0000", 2024-04-26T11:15:16.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096983599999999996 2024-04-26T11:15:16.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:16.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157662+0000", 2024-04-26T11:15:16.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014375393 2024-04-26T11:15:16.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:16.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157702+0000", 2024-04-26T11:15:16.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0295e-05 2024-04-26T11:15:16.560 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.560 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.560 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.560 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101755 5.f 5:fa973a83:::benchmark_data_smithi029_44842_object101754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:16.560 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:15:16.560 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 57.379227014999998, 2024-04-26T11:15:16.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039139064000000001, 2024-04-26T11:15:16.561 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.561 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:16.561 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.561 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.561 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.561 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101755 2024-04-26T11:15:16.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.561 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:15:16.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:15:16.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118696+0000", 2024-04-26T11:15:16.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118766+0000", 2024-04-26T11:15:16.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9423000000000003e-05 2024-04-26T11:15:16.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118774+0000", 2024-04-26T11:15:16.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9710000000000004e-06 2024-04-26T11:15:16.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118779+0000", 2024-04-26T11:15:16.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5629999999999999e-06 2024-04-26T11:15:16.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118817+0000", 2024-04-26T11:15:16.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7771000000000001e-05 2024-04-26T11:15:16.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118929+0000", 2024-04-26T11:15:16.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011222699999999999 2024-04-26T11:15:16.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:16.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157661+0000", 2024-04-26T11:15:16.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038731120000000001 2024-04-26T11:15:16.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:16.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157757+0000", 2024-04-26T11:15:16.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6910000000000006e-05 2024-04-26T11:15:16.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.565 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:16.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157836+0000", 2024-04-26T11:15:16.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8727999999999996e-05 2024-04-26T11:15:16.566 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.566 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.566 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.566 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101758 5.4 5:2525a4eb:::benchmark_data_smithi029_44842_object101757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:16.566 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:15:16.566 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 57.377044163999997, 2024-04-26T11:15:16.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.03686739, 2024-04-26T11:15:16.566 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.566 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:16.566 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.567 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.567 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.567 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101758 2024-04-26T11:15:16.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.567 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:15:16.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:15:16.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120879+0000", 2024-04-26T11:15:16.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120971+0000", 2024-04-26T11:15:16.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2133999999999996e-05 2024-04-26T11:15:16.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120977+0000", 2024-04-26T11:15:16.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5509999999999999e-06 2024-04-26T11:15:16.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120981+0000", 2024-04-26T11:15:16.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.245e-06 2024-04-26T11:15:16.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121010+0000", 2024-04-26T11:15:16.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9084000000000001e-05 2024-04-26T11:15:16.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121083+0000", 2024-04-26T11:15:16.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2942999999999996e-05 2024-04-26T11:15:16.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:16.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121163+0000", 2024-04-26T11:15:16.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0197000000000005e-05 2024-04-26T11:15:16.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:16.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142822+0000", 2024-04-26T11:15:16.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021658535999999999 2024-04-26T11:15:16.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:16.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157674+0000", 2024-04-26T11:15:16.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014851573999999999 2024-04-26T11:15:16.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:16.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157714+0000", 2024-04-26T11:15:16.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0473999999999999e-05 2024-04-26T11:15:16.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:16.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157747+0000", 2024-04-26T11:15:16.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3278999999999998e-05 2024-04-26T11:15:16.572 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.572 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.572 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.572 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101760 5.4 5:2510211a:::benchmark_data_smithi029_44842_object101759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:16.572 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:16.572 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 57.376611818999997, 2024-04-26T11:15:16.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039182383000000001, 2024-04-26T11:15:16.572 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.573 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:16.573 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.573 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.573 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.573 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101760 2024-04-26T11:15:16.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.573 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:16.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:16.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:16.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121389+0000", 2024-04-26T11:15:16.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6667000000000003e-05 2024-04-26T11:15:16.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.574 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121394+0000", 2024-04-26T11:15:16.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0839999999999999e-06 2024-04-26T11:15:16.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121397+0000", 2024-04-26T11:15:16.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4489999999999999e-06 2024-04-26T11:15:16.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122921+0000", 2024-04-26T11:15:16.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001524067 2024-04-26T11:15:16.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.123010+0000", 2024-04-26T11:15:16.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8449000000000006e-05 2024-04-26T11:15:16.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:16.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140838+0000", 2024-04-26T11:15:16.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017828796000000001 2024-04-26T11:15:16.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:16.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157665+0000", 2024-04-26T11:15:16.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016826574 2024-04-26T11:15:16.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:16.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160407+0000", 2024-04-26T11:15:16.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027423970000000002 2024-04-26T11:15:16.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:16.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160456+0000", 2024-04-26T11:15:16.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8678999999999999e-05 2024-04-26T11:15:16.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:16.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160495+0000", 2024-04-26T11:15:16.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8658000000000002e-05 2024-04-26T11:15:16.577 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.577 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.577 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.578 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101761 5.e 5:70294421:::benchmark_data_smithi029_44842_object101760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:16.578 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:15:16.578 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 57.375187445999998, 2024-04-26T11:15:16.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035270448000000003, 2024-04-26T11:15:16.578 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.578 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:16.578 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.578 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.578 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.579 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101761 2024-04-26T11:15:16.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.579 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:15:16.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:15:16.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122736+0000", 2024-04-26T11:15:16.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122805+0000", 2024-04-26T11:15:16.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9076000000000001e-05 2024-04-26T11:15:16.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122811+0000", 2024-04-26T11:15:16.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:15:16.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122815+0000", 2024-04-26T11:15:16.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2860000000000001e-06 2024-04-26T11:15:16.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122842+0000", 2024-04-26T11:15:16.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6429000000000001e-05 2024-04-26T11:15:16.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122916+0000", 2024-04-26T11:15:16.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4122999999999995e-05 2024-04-26T11:15:16.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:16.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122997+0000", 2024-04-26T11:15:16.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1428999999999996e-05 2024-04-26T11:15:16.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:16.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142344+0000", 2024-04-26T11:15:16.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019346452 2024-04-26T11:15:16.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:16.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157934+0000", 2024-04-26T11:15:16.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015589911999999999 2024-04-26T11:15:16.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:16.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157975+0000", 2024-04-26T11:15:16.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1604999999999999e-05 2024-04-26T11:15:16.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:16.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.158007+0000", 2024-04-26T11:15:16.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1921000000000002e-05 2024-04-26T11:15:16.583 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.583 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.583 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.583 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110145 5.9 5:9b275f16:::benchmark_data_smithi029_44842_object110144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:15:16.583 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:15:16.583 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 53.349625807999999, 2024-04-26T11:15:16.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032844496000000001, 2024-04-26T11:15:16.584 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.584 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:16.584 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.584 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.584 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.584 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110145 2024-04-26T11:15:16.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.584 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:15:16.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:15:16.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148297+0000", 2024-04-26T11:15:16.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:16.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148325+0000", 2024-04-26T11:15:16.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7511000000000001e-05 2024-04-26T11:15:16.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148338+0000", 2024-04-26T11:15:16.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2808e-05 2024-04-26T11:15:16.586 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.586 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148345+0000", 2024-04-26T11:15:16.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7200000000000006e-06 2024-04-26T11:15:16.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149888+0000", 2024-04-26T11:15:16.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001542666 2024-04-26T11:15:16.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.587 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.587 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.587 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149977+0000", 2024-04-26T11:15:16.587 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9247999999999997e-05 2024-04-26T11:15:16.587 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:16.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181006+0000", 2024-04-26T11:15:16.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031028535999999999 2024-04-26T11:15:16.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:16.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181051+0000", 2024-04-26T11:15:16.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5393999999999999e-05 2024-04-26T11:15:16.588 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.588 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.588 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:16.588 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181143+0000", 2024-04-26T11:15:16.588 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1458000000000004e-05 2024-04-26T11:15:16.589 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.589 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.589 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.589 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.589 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.589 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110155 5.9 5:9ebc6158:::benchmark_data_smithi029_44842_object110154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:15:16.589 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:15:16.589 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 53.344550015999999, 2024-04-26T11:15:16.589 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027886826999999999, 2024-04-26T11:15:16.589 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.589 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:16.589 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.589 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.589 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.589 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110155 2024-04-26T11:15:16.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.590 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:15:16.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:15:16.590 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.590 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.590 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.590 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.590 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153373+0000", 2024-04-26T11:15:16.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153479+0000", 2024-04-26T11:15:16.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105728 2024-04-26T11:15:16.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153491+0000", 2024-04-26T11:15:16.591 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2207e-05 2024-04-26T11:15:16.591 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.591 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.591 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.591 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153499+0000", 2024-04-26T11:15:16.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7729999999999999e-06 2024-04-26T11:15:16.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153655+0000", 2024-04-26T11:15:16.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015573 2024-04-26T11:15:16.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153770+0000", 2024-04-26T11:15:16.592 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011562500000000001 2024-04-26T11:15:16.592 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.592 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.592 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:16.592 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181153+0000", 2024-04-26T11:15:16.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027382113 2024-04-26T11:15:16.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:16.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181195+0000", 2024-04-26T11:15:16.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1921000000000001e-05 2024-04-26T11:15:16.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.593 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:16.593 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181261+0000", 2024-04-26T11:15:16.593 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6402999999999994e-05 2024-04-26T11:15:16.593 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.593 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.593 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.593 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.593 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.594 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174398 5.4 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:16.594 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:16.594 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.148033804000001, 2024-04-26T11:15:16.594 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.064773789999999998, 2024-04-26T11:15:16.594 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.594 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:16.594 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.594 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.594 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.594 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174398 2024-04-26T11:15:16.594 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.594 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.594 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.594 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:16.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:16.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.595 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349889+0000", 2024-04-26T11:15:16.595 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:16.595 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.595 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.595 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349895+0000", 2024-04-26T11:15:16.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4519999999999996e-06 2024-04-26T11:15:16.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349909+0000", 2024-04-26T11:15:16.596 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3791000000000001e-05 2024-04-26T11:15:16.596 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.596 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.596 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.596 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349919+0000", 2024-04-26T11:15:16.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0135999999999999e-05 2024-04-26T11:15:16.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349956+0000", 2024-04-26T11:15:16.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7642000000000003e-05 2024-04-26T11:15:16.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350080+0000", 2024-04-26T11:15:16.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123285 2024-04-26T11:15:16.597 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.597 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.597 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:16.597 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350192+0000", 2024-04-26T11:15:16.597 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112509 2024-04-26T11:15:16.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:16.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356232+0000", 2024-04-26T11:15:16.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060403339999999996 2024-04-26T11:15:16.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:16.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414616+0000", 2024-04-26T11:15:16.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.058383156999999998 2024-04-26T11:15:16.598 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.598 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.598 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:16.598 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414643+0000", 2024-04-26T11:15:16.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7317e-05 2024-04-26T11:15:16.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.599 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:16.599 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414664+0000", 2024-04-26T11:15:16.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1135999999999999e-05 2024-04-26T11:15:16.599 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.599 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.599 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.599 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174402 5.b 5:d8ad746d:::benchmark_data_smithi029_44842_object29764:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:16.599 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:16.599 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.144079614999999, 2024-04-26T11:15:16.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059017657000000001, 2024-04-26T11:15:16.599 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.600 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:16.600 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.600 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.600 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.600 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174402 2024-04-26T11:15:16.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.600 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:16.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:16.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:16.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:16.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353848+0000", 2024-04-26T11:15:16.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5040000000000004e-06 2024-04-26T11:15:16.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353858+0000", 2024-04-26T11:15:16.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7410000000000004e-06 2024-04-26T11:15:16.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353864+0000", 2024-04-26T11:15:16.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7899999999999996e-06 2024-04-26T11:15:16.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353902+0000", 2024-04-26T11:15:16.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8325000000000003e-05 2024-04-26T11:15:16.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353980+0000", 2024-04-26T11:15:16.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8077000000000005e-05 2024-04-26T11:15:16.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:16.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354046+0000", 2024-04-26T11:15:16.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6249999999999998e-05 2024-04-26T11:15:16.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:16.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356532+0000", 2024-04-26T11:15:16.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024850969999999999 2024-04-26T11:15:16.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:16.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412796+0000", 2024-04-26T11:15:16.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056264616000000003 2024-04-26T11:15:16.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:16.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412835+0000", 2024-04-26T11:15:16.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8863999999999999e-05 2024-04-26T11:15:16.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:16.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412862+0000", 2024-04-26T11:15:16.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7124e-05 2024-04-26T11:15:16.604 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.605 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.605 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.605 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174403 5.4 5:2d30cd6a:::benchmark_data_smithi029_44842_object29765:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:16.605 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:15:16.605 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.144052412000001, 2024-04-26T11:15:16.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.060873365999999998, 2024-04-26T11:15:16.606 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.606 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:16.606 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.606 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.606 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.606 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174403 2024-04-26T11:15:16.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.606 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:15:16.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:15:16.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353871+0000", 2024-04-26T11:15:16.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353874+0000", 2024-04-26T11:15:16.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869999999999999e-06 2024-04-26T11:15:16.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353881+0000", 2024-04-26T11:15:16.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2239999999999998e-06 2024-04-26T11:15:16.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353886+0000", 2024-04-26T11:15:16.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.259e-06 2024-04-26T11:15:16.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353912+0000", 2024-04-26T11:15:16.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6404999999999999e-05 2024-04-26T11:15:16.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353991+0000", 2024-04-26T11:15:16.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8104999999999998e-05 2024-04-26T11:15:16.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:16.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354055+0000", 2024-04-26T11:15:16.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4875999999999993e-05 2024-04-26T11:15:16.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:16.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.358000+0000", 2024-04-26T11:15:16.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039442629999999999 2024-04-26T11:15:16.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:16.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414690+0000", 2024-04-26T11:15:16.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056689940000000001 2024-04-26T11:15:16.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:16.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414714+0000", 2024-04-26T11:15:16.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4527000000000001e-05 2024-04-26T11:15:16.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:16.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414745+0000", 2024-04-26T11:15:16.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0874999999999998e-05 2024-04-26T11:15:16.610 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.611 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.611 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.611 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174404 5.4 5:2801f1e1:::benchmark_data_smithi029_44842_object29766:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:16.611 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:15:16.611 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 26.141435487999999, 2024-04-26T11:15:16.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059745741999999998, 2024-04-26T11:15:16.611 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:16.611 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:16.611 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:16.611 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:16.611 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.611 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174404 2024-04-26T11:15:16.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.612 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:16.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:16.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:15:16.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:16.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:15:16.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:16.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:16.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356488+0000", 2024-04-26T11:15:16.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:16.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356492+0000", 2024-04-26T11:15:16.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1169999999999997e-06 2024-04-26T11:15:16.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:16.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356502+0000", 2024-04-26T11:15:16.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0263e-05 2024-04-26T11:15:16.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356508+0000", 2024-04-26T11:15:16.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5890000000000002e-06 2024-04-26T11:15:16.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:16.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356545+0000", 2024-04-26T11:15:16.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7382999999999998e-05 2024-04-26T11:15:16.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:16.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356671+0000", 2024-04-26T11:15:16.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012535500000000001 2024-04-26T11:15:16.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:16.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356789+0000", 2024-04-26T11:15:16.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000118099 2024-04-26T11:15:16.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:16.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.359200+0000", 2024-04-26T11:15:16.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024110059999999998 2024-04-26T11:15:16.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:16.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416180+0000", 2024-04-26T11:15:16.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056980335999999999 2024-04-26T11:15:16.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:16.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416204+0000", 2024-04-26T11:15:16.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4301e-05 2024-04-26T11:15:16.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:16.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:16.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:16.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416234+0000", 2024-04-26T11:15:16.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9903000000000002e-05 2024-04-26T11:15:16.616 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.616 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.616 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.616 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:16.616 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:16.616 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:16.617 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:16.615+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:16.618 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:16.718 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:16.717+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:16.794 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:16.794 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:15:16.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.794 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:245943 5.6 5:6142029c:::benchmark_data_smithi029_44842_object101305:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T11:15:16.794 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:16.790282+0000", 2024-04-26T11:15:16.794 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.002159837, 2024-04-26T11:15:16.794 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0021858189999999999, 2024-04-26T11:15:16.795 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:16.795 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:16.795 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:16.795 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:16.795 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.795 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 245943 2024-04-26T11:15:16.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.795 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:16.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.795 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:16.795 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.790282+0000", 2024-04-26T11:15:16.795 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:16.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.795 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:16.796 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.790282+0000", 2024-04-26T11:15:16.796 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:16.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.796 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:16.796 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.790281+0000", 2024-04-26T11:15:16.796 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:16.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.796 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:16.796 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.790287+0000", 2024-04-26T11:15:16.796 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7769999999999999e-06 2024-04-26T11:15:16.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.797 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:16.797 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.790300+0000", 2024-04-26T11:15:16.797 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2976000000000001e-05 2024-04-26T11:15:16.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.797 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.797 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.797 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.790310+0000", 2024-04-26T11:15:16.797 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0294e-05 2024-04-26T11:15:16.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.797 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.797 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:16.797 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.790352+0000", 2024-04-26T11:15:16.797 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1779000000000001e-05 2024-04-26T11:15:16.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.798 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.798 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:16.798 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.790470+0000", 2024-04-26T11:15:16.798 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000117539 2024-04-26T11:15:16.798 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.798 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:16.798 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.798 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.798 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:245944 5.2 5:467c7d0a:::benchmark_data_smithi029_44842_object101306:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T11:15:16.798 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:16.790321+0000", 2024-04-26T11:15:16.798 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00212064, 2024-04-26T11:15:16.798 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0021995489999999999, 2024-04-26T11:15:16.799 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:16.799 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:16.799 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:16.799 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:16.799 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.799 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 245944 2024-04-26T11:15:16.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.799 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:16.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.799 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:16.799 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.790321+0000", 2024-04-26T11:15:16.799 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:16.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.800 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:16.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.790321+0000", 2024-04-26T11:15:16.800 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:16.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.800 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:16.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.790321+0000", 2024-04-26T11:15:16.800 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.800 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:16.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.790324+0000", 2024-04-26T11:15:16.800 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.129e-06 2024-04-26T11:15:16.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.801 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:16.801 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.790332+0000", 2024-04-26T11:15:16.801 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5839999999999997e-06 2024-04-26T11:15:16.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.801 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.801 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.790338+0000", 2024-04-26T11:15:16.801 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1299999999999998e-06 2024-04-26T11:15:16.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.801 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:16.801 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.791476+0000", 2024-04-26T11:15:16.801 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001137894 2024-04-26T11:15:16.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.802 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:16.802 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.791575+0000", 2024-04-26T11:15:16.802 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.9278999999999996e-05 2024-04-26T11:15:16.802 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.802 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:16.802 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.802 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:245947 5.5 5:a7c511fe:::benchmark_data_smithi029_44842_object101309:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T11:15:16.802 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:16.790800+0000", 2024-04-26T11:15:16.802 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.001641797, 2024-04-26T11:15:16.802 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00176005, 2024-04-26T11:15:16.802 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:16.802 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:16.803 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:16.803 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:16.803 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.803 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 245947 2024-04-26T11:15:16.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.803 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:16.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.803 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:16.803 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.790800+0000", 2024-04-26T11:15:16.803 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:16.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.803 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:16.803 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.790800+0000", 2024-04-26T11:15:16.803 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:16.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.804 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:16.804 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.790800+0000", 2024-04-26T11:15:16.804 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:16.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.804 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:16.804 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.790805+0000", 2024-04-26T11:15:16.804 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0889999999999999e-06 2024-04-26T11:15:16.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.804 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:16.804 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.790814+0000", 2024-04-26T11:15:16.804 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.7880000000000001e-06 2024-04-26T11:15:16.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.805 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.805 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.790821+0000", 2024-04-26T11:15:16.805 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9190000000000002e-06 2024-04-26T11:15:16.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.805 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:16.805 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.790856+0000", 2024-04-26T11:15:16.805 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4595999999999999e-05 2024-04-26T11:15:16.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.806 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:16.806 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.790964+0000", 2024-04-26T11:15:16.806 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000107675 2024-04-26T11:15:16.806 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.806 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:16.806 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.806 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.806 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:245946 5.4 e55/16 5:2519a6cc:::benchmark_data_smithi029_44842_object101308:head v 55'15257, mlcod=55'15252)", 2024-04-26T11:15:16.806 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:16.791133+0000", 2024-04-26T11:15:16.807 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0013089149999999999, 2024-04-26T11:15:16.807 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001468348, 2024-04-26T11:15:16.807 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:16.807 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:16.807 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:16.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.807 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:16.807 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.791133+0000", 2024-04-26T11:15:16.807 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:16.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.808 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:16.808 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.791133+0000", 2024-04-26T11:15:16.808 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:16.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.808 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.808 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:16.808 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.791133+0000", 2024-04-26T11:15:16.808 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.808 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.808 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:16.808 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.791138+0000", 2024-04-26T11:15:16.808 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.575e-06 2024-04-26T11:15:16.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.809 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.809 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:16.809 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.791145+0000", 2024-04-26T11:15:16.809 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0110000000000003e-06 2024-04-26T11:15:16.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.809 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.809 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.809 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.791151+0000", 2024-04-26T11:15:16.809 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5310000000000001e-06 2024-04-26T11:15:16.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.809 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.809 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:16.809 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.791543+0000", 2024-04-26T11:15:16.809 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00039222399999999999 2024-04-26T11:15:16.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.810 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.810 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:16.810 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.791568+0000", 2024-04-26T11:15:16.810 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5420000000000001e-05 2024-04-26T11:15:16.810 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.810 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:16.810 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.810 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.810 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:245945 5.0 e55/16 5:0d5a499e:::benchmark_data_smithi029_44842_object101307:head v 55'15569, mlcod=55'15566)", 2024-04-26T11:15:16.810 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:16.791156+0000", 2024-04-26T11:15:16.810 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0012861929999999999, 2024-04-26T11:15:16.810 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001491844, 2024-04-26T11:15:16.810 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:16.811 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:16.811 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:16.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.811 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:16.811 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.791156+0000", 2024-04-26T11:15:16.811 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:16.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.811 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:16.811 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.791156+0000", 2024-04-26T11:15:16.811 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:16.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.811 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:16.812 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.791156+0000", 2024-04-26T11:15:16.812 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967296 2024-04-26T11:15:16.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.812 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.812 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:16.812 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.791159+0000", 2024-04-26T11:15:16.812 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.517e-06 2024-04-26T11:15:16.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.812 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.812 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:16.812 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.791164+0000", 2024-04-26T11:15:16.812 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6110000000000004e-06 2024-04-26T11:15:16.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.812 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.812 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.813 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.791168+0000", 2024-04-26T11:15:16.813 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8029999999999998e-06 2024-04-26T11:15:16.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.813 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.813 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:16.813 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.791238+0000", 2024-04-26T11:15:16.813 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0737999999999999e-05 2024-04-26T11:15:16.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.813 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.813 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:16.813 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.791255+0000", 2024-04-26T11:15:16.813 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7070000000000001e-05 2024-04-26T11:15:16.813 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.813 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:16.813 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.814 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.814 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:245949 5.e e55/16 5:70fec5e4:::benchmark_data_smithi029_44842_object101311:head v 55'15378, mlcod=55'15374)", 2024-04-26T11:15:16.814 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:16.791180+0000", 2024-04-26T11:15:16.814 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0012617520000000001, 2024-04-26T11:15:16.814 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0015022939999999999, 2024-04-26T11:15:16.814 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:16.814 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:16.814 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:16.814 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.814 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:16.814 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.791180+0000", 2024-04-26T11:15:16.814 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:16.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.815 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.815 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:16.815 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.791180+0000", 2024-04-26T11:15:16.815 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:16.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.815 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.815 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:16.815 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.791180+0000", 2024-04-26T11:15:16.815 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967296 2024-04-26T11:15:16.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.815 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.815 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:16.815 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.791186+0000", 2024-04-26T11:15:16.815 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5199999999999997e-06 2024-04-26T11:15:16.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.816 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.816 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:16.816 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.791191+0000", 2024-04-26T11:15:16.816 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2839999999999997e-06 2024-04-26T11:15:16.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.816 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.816 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.816 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.791195+0000", 2024-04-26T11:15:16.816 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9999999999999998e-06 2024-04-26T11:15:16.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.816 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.816 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:16.816 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.792348+0000", 2024-04-26T11:15:16.816 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001153341 2024-04-26T11:15:16.817 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.817 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.817 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:16.817 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.792364+0000", 2024-04-26T11:15:16.817 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5384e-05 2024-04-26T11:15:16.817 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.817 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:16.817 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.817 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.817 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.817 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:245927 5.0 e55/16 5:02a726c0:::benchmark_data_smithi029_44842_object101289:head v 55'15568, mlcod=55'15565)", 2024-04-26T11:15:16.817 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:16.784465+0000", 2024-04-26T11:15:16.817 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0079770469999999993, 2024-04-26T11:15:16.817 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0082526760000000005, 2024-04-26T11:15:16.817 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:16.818 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:16.818 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:16.818 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.818 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:16.818 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.784465+0000", 2024-04-26T11:15:16.818 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:16.818 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.818 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.818 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:16.818 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.784465+0000", 2024-04-26T11:15:16.818 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:16.818 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.818 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.818 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:16.818 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.784465+0000", 2024-04-26T11:15:16.819 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.819 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.819 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:16.819 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.784470+0000", 2024-04-26T11:15:16.819 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9039999999999997e-06 2024-04-26T11:15:16.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.819 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.819 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:16.819 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.784479+0000", 2024-04-26T11:15:16.819 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.191e-06 2024-04-26T11:15:16.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.819 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.819 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.819 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.784485+0000", 2024-04-26T11:15:16.820 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2840000000000003e-06 2024-04-26T11:15:16.820 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.820 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.820 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:16.820 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.785507+0000", 2024-04-26T11:15:16.820 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0010220909999999999 2024-04-26T11:15:16.820 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.820 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.820 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:16.820 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.785526+0000", 2024-04-26T11:15:16.820 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8686e-05 2024-04-26T11:15:16.820 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.820 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:16.820 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.820 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.821 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.821 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:245932 5.2 5:4fd5f1ad:::benchmark_data_smithi029_44842_object101294:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T11:15:16.821 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:16.786234+0000", 2024-04-26T11:15:16.821 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.006207845, 2024-04-26T11:15:16.821 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0065183400000000001, 2024-04-26T11:15:16.821 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:16.821 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:16.821 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:16.821 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:16.821 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.821 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 245932 2024-04-26T11:15:16.821 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.821 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:16.821 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.822 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:16.822 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.786234+0000", 2024-04-26T11:15:16.822 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:16.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.822 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.822 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:16.822 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.786234+0000", 2024-04-26T11:15:16.822 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:16.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.822 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.822 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:16.822 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.786233+0000", 2024-04-26T11:15:16.822 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:16.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.823 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.823 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:16.823 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.786238+0000", 2024-04-26T11:15:16.823 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2669999999999997e-06 2024-04-26T11:15:16.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.823 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.823 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:16.823 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.786248+0000", 2024-04-26T11:15:16.823 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3829999999999998e-06 2024-04-26T11:15:16.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.823 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.823 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.823 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.786256+0000", 2024-04-26T11:15:16.823 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3270000000000001e-06 2024-04-26T11:15:16.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.824 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.824 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:16.824 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.786304+0000", 2024-04-26T11:15:16.824 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7808e-05 2024-04-26T11:15:16.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.824 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.824 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:16.824 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.786425+0000", 2024-04-26T11:15:16.824 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000120995 2024-04-26T11:15:16.824 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.824 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:16.824 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.824 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.824 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:245937 5.2 5:40f49444:::benchmark_data_smithi029_44842_object101299:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T11:15:16.825 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:16.786323+0000", 2024-04-26T11:15:16.825 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0061191780000000003, 2024-04-26T11:15:16.825 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0064711359999999997, 2024-04-26T11:15:16.825 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:16.825 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:16.825 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:16.825 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:16.825 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.825 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 245937 2024-04-26T11:15:16.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.825 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:16.825 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.825 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:16.825 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.786323+0000", 2024-04-26T11:15:16.826 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:16.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.826 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.826 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:16.826 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.786323+0000", 2024-04-26T11:15:16.826 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:16.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.826 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.826 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:16.826 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.786322+0000", 2024-04-26T11:15:16.826 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.826 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.826 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:16.826 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.786325+0000", 2024-04-26T11:15:16.827 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3149999999999999e-06 2024-04-26T11:15:16.827 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.827 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.827 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:16.827 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.786330+0000", 2024-04-26T11:15:16.827 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4759999999999997e-06 2024-04-26T11:15:16.827 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.827 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.827 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.827 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.786335+0000", 2024-04-26T11:15:16.827 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5179999999999998e-06 2024-04-26T11:15:16.827 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.827 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.827 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:16.828 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.788180+0000", 2024-04-26T11:15:16.828 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0018455660000000001 2024-04-26T11:15:16.828 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.828 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.828 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:16.828 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.788289+0000", 2024-04-26T11:15:16.828 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000108181 2024-04-26T11:15:16.828 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.828 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:16.828 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.828 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.828 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.828 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:245941 5.2 5:4bad2925:::benchmark_data_smithi029_44842_object101303:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T11:15:16.828 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:16.787862+0000", 2024-04-26T11:15:16.828 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0045800229999999999, 2024-04-26T11:15:16.829 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0049702690000000002, 2024-04-26T11:15:16.829 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:16.829 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:16.829 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:16.829 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:16.829 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:16.829 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 245941 2024-04-26T11:15:16.829 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.829 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:16.829 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.829 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:16.829 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.787862+0000", 2024-04-26T11:15:16.829 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:16.829 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.829 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.830 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:16.830 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.787862+0000", 2024-04-26T11:15:16.830 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:16.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.830 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.830 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:16.830 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.787861+0000", 2024-04-26T11:15:16.830 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:16.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.830 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.830 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:16.830 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.787865+0000", 2024-04-26T11:15:16.830 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8990000000000003e-06 2024-04-26T11:15:16.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.831 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.831 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:16.831 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.787874+0000", 2024-04-26T11:15:16.831 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.9269999999999994e-06 2024-04-26T11:15:16.831 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.831 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.831 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.831 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.787880+0000", 2024-04-26T11:15:16.831 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9390000000000002e-06 2024-04-26T11:15:16.831 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.831 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.831 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:16.831 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.789859+0000", 2024-04-26T11:15:16.831 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019791280000000001 2024-04-26T11:15:16.831 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.832 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.832 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:16.832 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.789988+0000", 2024-04-26T11:15:16.832 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000128255 2024-04-26T11:15:16.832 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.832 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:16.832 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.832 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.832 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.832 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:245938 5.4 e55/16 5:28f24a5f:::benchmark_data_smithi029_44842_object101300:head v 55'15256, mlcod=55'15252)", 2024-04-26T11:15:16.832 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:16.788476+0000", 2024-04-26T11:15:16.832 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0039661260000000004, 2024-04-26T11:15:16.832 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0043926750000000004, 2024-04-26T11:15:16.832 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:16.832 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:16.833 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:16.833 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.833 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:16.833 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.788476+0000", 2024-04-26T11:15:16.833 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:16.833 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.833 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.833 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:16.833 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.788476+0000", 2024-04-26T11:15:16.833 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:16.833 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.833 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.833 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:16.833 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.788475+0000", 2024-04-26T11:15:16.833 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.834 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.834 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:16.834 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.788480+0000", 2024-04-26T11:15:16.834 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0489999999999997e-06 2024-04-26T11:15:16.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.834 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.834 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:16.834 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.788486+0000", 2024-04-26T11:15:16.834 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1539999999999999e-06 2024-04-26T11:15:16.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.834 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.834 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.834 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.788490+0000", 2024-04-26T11:15:16.835 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2359999999999998e-06 2024-04-26T11:15:16.835 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.835 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.835 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:16.835 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.789998+0000", 2024-04-26T11:15:16.835 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0015080639999999999 2024-04-26T11:15:16.835 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.835 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.835 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:16.835 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.790010+0000", 2024-04-26T11:15:16.835 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1588e-05 2024-04-26T11:15:16.835 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.835 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:16.835 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.836 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.836 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.836 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:245942 5.e e55/16 5:7200065d:::benchmark_data_smithi029_44842_object101304:head v 55'15377, mlcod=55'15374)", 2024-04-26T11:15:16.836 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:16.789253+0000", 2024-04-26T11:15:16.836 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0031892909999999999, 2024-04-26T11:15:16.836 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003655775, 2024-04-26T11:15:16.836 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:16.836 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:16.836 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:16.836 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.836 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:16.836 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.789253+0000", 2024-04-26T11:15:16.836 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:16.836 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.836 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.837 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:16.837 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.789253+0000", 2024-04-26T11:15:16.837 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:16.837 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.837 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.837 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:16.837 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.789252+0000", 2024-04-26T11:15:16.837 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:16.837 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.837 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.837 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:16.837 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.789259+0000", 2024-04-26T11:15:16.837 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7599999999999997e-06 2024-04-26T11:15:16.837 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.837 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.838 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:16.838 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.789275+0000", 2024-04-26T11:15:16.838 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6303e-05 2024-04-26T11:15:16.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.838 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.838 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:16.838 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.789283+0000", 2024-04-26T11:15:16.838 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3860000000000001e-06 2024-04-26T11:15:16.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.838 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.838 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:16.838 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.789329+0000", 2024-04-26T11:15:16.838 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6808000000000003e-05 2024-04-26T11:15:16.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:16.839 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:16.839 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:16.839 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:16.789350+0000", 2024-04-26T11:15:16.839 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0202000000000001e-05 2024-04-26T11:15:16.839 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.839 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:16.839 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.839 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:16.839 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:15:16.839 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 12 2024-04-26T11:15:16.839 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:16.841 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:16.841 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:16.838+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:16.941 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:16.939+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:17.042 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:17.040+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:17.049 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:15:17.059 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:17.059 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:15:17.059 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:15:17.059 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:15:17.060 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:17.074 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:17.142 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:17.141+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:17.204 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:15:17.225 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:15:17.225 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:15:17.225 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:15:17.225 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:15:17.228 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:15:17.228 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:15:17.245 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:17.243+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:17.300 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:17.300 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:17.313 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:17.355 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:17.353+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:17.445 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:17.443+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:17.484 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:17.485 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:17.499 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:17.546 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:17.544+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:17.647 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:17.645+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:17.664 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:17.665 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:17.677 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:17.748 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:17.746+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:17.816 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:15:17.849 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:17.847+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:17.884 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:17.884 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:17.898 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:17.949 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:17.947+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:18.056 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:18.054+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:18.084 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:18.084 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:18.100 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:18.150 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:18.149+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:18.252 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:18.250+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:18.321 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:18.322 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:18.338 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:18.381 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:18.377+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:18.454 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:18.452+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:18.555 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:18.553+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:18.563 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:18.563 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:18.579 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:18.656 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:18.654+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:18.733 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:15:18.746 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:18.746 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:18.756 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:18.754+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:18.759 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:18.857 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:18.855+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:18.928 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:18.929 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:18.943 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:18.959 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:18.956+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:19.060 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:19.058+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:19.114 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:19.115 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:19.128 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:19.169 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:19.168+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:19.229 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:15:19.261 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:19.260+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:19.315 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:19.315 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:19.332 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:19.363 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:19.361+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:19.384 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:15:19.404 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:15:19.404 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:15:19.404 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:15:19.404 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:15:19.406 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:15:19.407 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:15:19.464 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:19.462+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:19.559 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:19.559 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:15:19.559 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:15:19.559 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:15:19.559 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:19.566 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:19.563+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:19.574 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:19.666 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:19.665+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:19.767 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:19.765+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:19.810 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:19.810 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:15:19.810 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:15:19.811 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:15:19.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.811 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:19.811 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:19.811 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 86.536108987000006, 2024-04-26T11:15:19.811 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:15:19.811 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:19.811 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:19.811 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:19.812 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:19.812 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:19.812 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:15:19.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.812 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:19.812 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.812 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:19.812 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:19.812 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.812 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.812 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:19.813 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:19.813 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.813 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.813 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:19.813 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:15:19.813 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:19.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.813 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.813 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:19.813 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:15:19.813 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:15:19.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.814 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.814 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:19.814 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:15:19.814 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:15:19.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.814 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.814 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:19.814 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:15:19.814 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:15:19.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.815 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.815 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.815 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:15:19.815 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:15:19.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.815 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.815 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:19.815 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:15:19.815 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:15:19.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.815 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.816 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:19.816 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:15:19.816 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:15:19.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.816 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.816 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:19.816 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:15:19.816 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:15:19.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.816 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.816 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:19.816 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:15:19.816 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:15:19.817 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.817 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.817 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:19.817 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:15:19.817 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:15:19.817 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.817 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.817 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:19.817 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:15:19.817 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:15:19.817 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.817 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:19.818 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.818 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.818 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.818 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:19.818 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:19.818 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 86.535297421999999, 2024-04-26T11:15:19.818 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:15:19.818 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:19.818 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:19.818 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:19.818 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:19.818 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:15:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.820 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.820 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:19.820 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:19.820 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:19.820 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.820 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.820 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:19.820 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:15:19.820 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:15:19.820 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.820 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.820 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:15:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:15:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:15:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:15:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:15:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:15:19.821 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.822 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.822 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:19.822 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:15:19.822 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:15:19.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.822 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.822 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:19.822 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:15:19.822 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:15:19.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.822 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.822 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:15:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:15:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:15:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:15:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:15:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:15:19.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:15:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:15:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 86.528110584999993, 2024-04-26T11:15:19.824 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:15:19.825 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:19.825 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:19.825 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:19.825 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:19.825 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:19.825 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:15:19.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.825 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:19.825 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.825 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:19.825 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:19.825 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.826 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.826 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:19.826 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:19.826 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.826 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.826 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:19.826 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:15:19.826 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:19.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.826 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:15:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:15:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:15:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:15:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:19.827 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:15:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:15:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:15:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:15:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:15:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:15:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.828 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:15:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:15:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:15:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:15:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:19.829 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:15:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:15:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:15:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:15:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:15:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:15:19.830 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 86.527569705999994, 2024-04-26T11:15:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:15:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:19.831 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:15:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.832 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:15:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:15:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.833 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:15:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:15:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:15:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:15:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:15:19.834 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:15:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:15:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:15:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:15:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:15:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.835 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:15:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:15:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:15:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:15:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:15:19.836 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:15:19.837 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.837 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.837 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:19.837 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:15:19.837 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:15:19.837 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.837 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:19.837 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.837 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.837 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.837 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:19.837 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 82.484385259000007, 2024-04-26T11:15:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:15:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:15:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.838 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:15:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:19.839 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:15:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:15:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:15:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:15:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:19.840 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:15:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:15:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:15:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:15:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:15:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:15:19.841 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:15:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:15:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:15:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:15:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.842 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:15:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:15:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:15:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:15:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:15:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:15:19.843 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:15:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:15:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:19.844 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 82.482191919000002, 2024-04-26T11:15:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:15:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:15:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.845 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:15:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:19.846 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.847 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.847 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:19.847 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:15:19.847 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:15:19.847 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.847 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.847 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:19.847 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:15:19.847 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:15:19.847 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.847 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.848 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:19.848 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:15:19.848 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:15:19.848 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.848 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.848 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.848 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:15:19.848 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:15:19.848 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.848 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.848 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:19.848 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:15:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:15:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:15:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:15:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:15:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:15:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.849 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.850 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.850 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:15:19.850 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:15:19.850 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.850 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.850 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:19.850 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:15:19.850 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:15:19.850 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.850 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.850 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.850 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:15:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:15:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:15:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:15:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.851 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:19.852 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:19.852 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 82.476980095000002, 2024-04-26T11:15:19.852 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:15:19.852 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:19.852 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:19.852 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:19.852 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:19.852 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:19.852 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:15:19.852 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.852 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:19.852 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.852 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:15:19.853 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:19.854 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.854 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.854 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:19.854 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:15:19.854 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:15:19.854 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.854 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.854 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:19.854 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:15:19.854 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:15:19.854 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:15:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:15:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:15:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:15:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.855 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:15:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:15:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:15:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:15:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:15:19.856 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:15:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:15:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:15:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:15:19.857 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:15:19.858 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.858 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.858 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.858 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:15:19.858 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:15:19.858 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.858 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.858 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:19.858 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:15:19.858 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:15:19.858 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 82.460531395000004, 2024-04-26T11:15:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:15:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:19.859 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:15:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:15:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:15:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:15:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.861 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:19.862 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:15:19.862 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:15:19.862 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.862 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.862 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:19.862 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:15:19.862 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:15:19.862 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.862 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.862 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.862 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:15:19.862 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:15:19.863 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.863 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.863 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:19.863 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:15:19.863 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:15:19.863 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.863 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.863 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.863 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:15:19.863 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:15:19.863 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.866 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.866 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:19.866 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:15:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:15:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 82.458833889999994, 2024-04-26T11:15:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:15:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:19.867 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:15:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.868 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:15:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:15:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:15:19.869 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:15:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:15:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:15:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:15:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.870 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:15:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:15:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:15:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:15:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:15:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:15:19.871 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:15:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:15:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 82.458769587999996, 2024-04-26T11:15:19.872 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:15:19.873 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:19.873 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:19.873 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:19.873 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:19.873 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:19.873 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:15:19.873 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.873 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:19.873 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.873 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:19.873 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:19.873 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.873 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.874 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.874 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:19.874 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:19.874 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.874 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.874 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.874 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:19.874 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:19.874 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:19.874 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.874 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.874 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:15:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:15:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:15:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:15:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:15:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:15:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:15:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:15:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:15:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:15:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.876 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:15:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:15:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:15:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:15:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:15:19.877 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:15:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:15:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:15:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:15:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:15:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.878 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:19.879 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.879 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.879 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.879 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:19.879 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:19.879 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 82.458715364, 2024-04-26T11:15:19.879 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:15:19.879 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:19.879 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:19.879 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:19.879 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:19.879 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:19.879 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:15:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.880 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:15:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:15:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:19.881 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:15:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:15:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:15:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:15:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:15:19.882 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:15:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:15:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:15:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:15:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:15:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.883 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:19.884 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:15:19.884 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:15:19.884 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.884 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.884 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:19.884 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:15:19.884 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:15:19.884 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.884 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.884 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:19.884 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:15:19.884 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:15:19.885 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.885 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.885 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:19.885 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:15:19.885 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:15:19.885 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.885 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:19.885 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.885 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.885 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.885 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:19.885 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 82.458670851999997, 2024-04-26T11:15:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:15:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:15:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.886 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:15:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:19.887 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:15:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:15:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:15:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:15:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.888 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:15:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:15:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:15:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:15:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:15:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:15:19.889 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.890 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.890 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.890 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:15:19.890 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:15:19.890 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.890 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.890 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:19.890 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:15:19.890 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:15:19.890 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.890 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.890 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:15:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:15:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:15:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:15:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:15:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:15:19.891 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 82.454449850000003, 2024-04-26T11:15:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:15:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:19.892 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:15:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:19.893 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.894 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.894 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.894 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:19.894 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:15:19.894 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:15:19.894 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.894 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.894 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:19.894 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:15:19.894 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:15:19.894 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.894 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:15:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:15:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:15:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:15:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:15:19.895 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:15:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:15:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:15:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:15:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:15:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.896 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:15:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:15:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:15:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:15:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:19.897 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:15:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:15:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:15:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:15:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.898 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174388 5.c 5:312e5163:::benchmark_data_smithi029_44842_object29750:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:19.899 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:19.899 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 29.458624194999999, 2024-04-26T11:15:19.899 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.064002009999999998, 2024-04-26T11:15:19.899 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:19.899 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:19.899 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:19.899 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:19.899 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:19.899 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174388 2024-04-26T11:15:19.899 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.899 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:19.899 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.900 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:19.900 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:19.900 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.900 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.900 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.900 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:19.900 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:19.900 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.900 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.901 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.901 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:19.901 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348231+0000", 2024-04-26T11:15:19.901 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:19.901 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.901 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.901 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:19.901 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348233+0000", 2024-04-26T11:15:19.901 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2249999999999999e-06 2024-04-26T11:15:19.901 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.901 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.901 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:19.902 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348238+0000", 2024-04-26T11:15:19.902 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1899999999999997e-06 2024-04-26T11:15:19.902 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.902 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.902 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:19.902 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348241+0000", 2024-04-26T11:15:19.902 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.965e-06 2024-04-26T11:15:19.902 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.902 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.902 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.902 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348264+0000", 2024-04-26T11:15:19.902 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3014e-05 2024-04-26T11:15:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348371+0000", 2024-04-26T11:15:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000106889 2024-04-26T11:15:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412126+0000", 2024-04-26T11:15:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063755495999999995 2024-04-26T11:15:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.903 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412165+0000", 2024-04-26T11:15:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9269e-05 2024-04-26T11:15:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412234+0000", 2024-04-26T11:15:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8337000000000007e-05 2024-04-26T11:15:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.904 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174390 5.1 5:81c54fd7:::benchmark_data_smithi029_44842_object29752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 29.458509040999999, 2024-04-26T11:15:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063635918, 2024-04-26T11:15:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174390 2024-04-26T11:15:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:19.905 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.906 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:19.906 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:19.906 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.906 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.906 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.906 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:19.906 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:19.906 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.906 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.906 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.906 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348346+0000", 2024-04-26T11:15:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348351+0000", 2024-04-26T11:15:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.442e-06 2024-04-26T11:15:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348357+0000", 2024-04-26T11:15:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9530000000000002e-06 2024-04-26T11:15:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348363+0000", 2024-04-26T11:15:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2129999999999999e-06 2024-04-26T11:15:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348396+0000", 2024-04-26T11:15:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3161999999999999e-05 2024-04-26T11:15:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.908 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348511+0000", 2024-04-26T11:15:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000115253 2024-04-26T11:15:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411857+0000", 2024-04-26T11:15:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063345431999999993 2024-04-26T11:15:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411904+0000", 2024-04-26T11:15:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7389000000000003e-05 2024-04-26T11:15:19.909 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411983+0000", 2024-04-26T11:15:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8750000000000003e-05 2024-04-26T11:15:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174394 5.3 5:c91ce5cb:::benchmark_data_smithi029_44842_object29756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:19.910 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 29.458406097000001, 2024-04-26T11:15:19.911 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062247626, 2024-04-26T11:15:19.911 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:19.911 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:19.911 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:19.911 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:19.911 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:19.911 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174394 2024-04-26T11:15:19.911 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.911 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:19.911 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348449+0000", 2024-04-26T11:15:19.912 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348457+0000", 2024-04-26T11:15:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9619999999999993e-06 2024-04-26T11:15:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348462+0000", 2024-04-26T11:15:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6569999999999996e-06 2024-04-26T11:15:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.913 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348465+0000", 2024-04-26T11:15:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2990000000000001e-06 2024-04-26T11:15:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408427+0000", 2024-04-26T11:15:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.059961423 2024-04-26T11:15:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408554+0000", 2024-04-26T11:15:19.914 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012779600000000001 2024-04-26T11:15:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410570+0000", 2024-04-26T11:15:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020152719999999998 2024-04-26T11:15:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410624+0000", 2024-04-26T11:15:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4211e-05 2024-04-26T11:15:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.915 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410697+0000", 2024-04-26T11:15:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3447000000000003e-05 2024-04-26T11:15:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174395 5.1 5:8ee7f1d3:::benchmark_data_smithi029_44842_object29757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 29.457376006000001, 2024-04-26T11:15:19.916 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062622744999999994, 2024-04-26T11:15:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174395 2024-04-26T11:15:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:19.917 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349479+0000", 2024-04-26T11:15:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.918 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349483+0000", 2024-04-26T11:15:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.54e-06 2024-04-26T11:15:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349488+0000", 2024-04-26T11:15:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5119999999999999e-06 2024-04-26T11:15:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349492+0000", 2024-04-26T11:15:19.919 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7170000000000002e-06 2024-04-26T11:15:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350187+0000", 2024-04-26T11:15:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00069535899999999999 2024-04-26T11:15:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350292+0000", 2024-04-26T11:15:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0001047 2024-04-26T11:15:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.920 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411992+0000", 2024-04-26T11:15:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061699647000000003 2024-04-26T11:15:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412030+0000", 2024-04-26T11:15:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8124999999999998e-05 2024-04-26T11:15:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:19.921 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412103+0000", 2024-04-26T11:15:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2733999999999999e-05 2024-04-26T11:15:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174396 5.7 5:e0fad05d:::benchmark_data_smithi029_44842_object29758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 29.457292367000001, 2024-04-26T11:15:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062445026000000001, 2024-04-26T11:15:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:19.922 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174396 2024-04-26T11:15:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.923 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.924 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:19.924 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:19.924 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.924 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.924 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.924 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:19.924 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:19.924 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:19.924 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.924 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.924 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:19.924 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349566+0000", 2024-04-26T11:15:19.924 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2490000000000001e-06 2024-04-26T11:15:19.925 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.925 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.925 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:19.925 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349573+0000", 2024-04-26T11:15:19.925 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.776e-06 2024-04-26T11:15:19.925 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.925 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.925 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:19.925 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349576+0000", 2024-04-26T11:15:19.925 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3629999999999998e-06 2024-04-26T11:15:19.925 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.925 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.925 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.926 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350396+0000", 2024-04-26T11:15:19.926 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00081992199999999995 2024-04-26T11:15:19.926 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.926 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.926 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:19.926 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350516+0000", 2024-04-26T11:15:19.926 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012006900000000001 2024-04-26T11:15:19.926 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.926 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.926 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:19.926 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411924+0000", 2024-04-26T11:15:19.926 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061407960999999997 2024-04-26T11:15:19.927 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.927 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.927 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:19.927 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411947+0000", 2024-04-26T11:15:19.927 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2943999999999999e-05 2024-04-26T11:15:19.927 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.927 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.927 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:19.927 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412008+0000", 2024-04-26T11:15:19.927 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1237999999999999e-05 2024-04-26T11:15:19.927 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.927 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:19.928 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.928 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.928 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.928 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174397 5.7 5:e25daf9a:::benchmark_data_smithi029_44842_object29759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:19.928 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:19.928 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 29.457184238, 2024-04-26T11:15:19.928 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063878565999999998, 2024-04-26T11:15:19.928 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:19.928 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:19.928 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:19.928 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:19.928 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:19.928 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174397 2024-04-26T11:15:19.929 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.929 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:19.929 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.929 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:19.929 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:19.929 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.929 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.929 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.929 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:19.929 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:19.929 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.929 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.930 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.930 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:19.930 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349671+0000", 2024-04-26T11:15:19.930 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:19.930 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.930 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.930 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:19.930 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349674+0000", 2024-04-26T11:15:19.930 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3360000000000002e-06 2024-04-26T11:15:19.930 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.930 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.930 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:19.931 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349678+0000", 2024-04-26T11:15:19.931 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0709999999999996e-06 2024-04-26T11:15:19.931 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.931 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.931 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:19.931 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349681+0000", 2024-04-26T11:15:19.931 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3139999999999999e-06 2024-04-26T11:15:19.931 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.931 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.931 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.931 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410371+0000", 2024-04-26T11:15:19.931 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.060690202999999998 2024-04-26T11:15:19.931 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.932 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.932 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:19.932 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410463+0000", 2024-04-26T11:15:19.932 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2095000000000005e-05 2024-04-26T11:15:19.932 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.932 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.932 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:19.932 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413471+0000", 2024-04-26T11:15:19.932 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0030073909999999999 2024-04-26T11:15:19.932 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.932 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.932 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:19.932 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413499+0000", 2024-04-26T11:15:19.933 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8725e-05 2024-04-26T11:15:19.933 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.933 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.933 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:19.933 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413550+0000", 2024-04-26T11:15:19.933 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0810000000000003e-05 2024-04-26T11:15:19.933 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.933 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:19.933 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.933 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.933 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.933 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:174398 5.4 e46/16 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head v 46'10798, mlcod=46'10796)", 2024-04-26T11:15:19.934 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:19.934 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 29.456656027000001, 2024-04-26T11:15:19.934 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062067047, 2024-04-26T11:15:19.934 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:19.934 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:19.934 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:19.934 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.934 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:19.934 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:19.934 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.934 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.934 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.935 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:19.935 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:19.935 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:19.935 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.935 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.935 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:19.935 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350199+0000", 2024-04-26T11:15:19.935 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:19.935 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.935 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.935 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:19.935 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350205+0000", 2024-04-26T11:15:19.936 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6749999999999999e-06 2024-04-26T11:15:19.936 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.936 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.936 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:19.936 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350212+0000", 2024-04-26T11:15:19.936 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7000000000000002e-06 2024-04-26T11:15:19.936 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.936 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.936 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:19.936 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350216+0000", 2024-04-26T11:15:19.936 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5120000000000002e-06 2024-04-26T11:15:19.936 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.936 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.937 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:19.937 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350246+0000", 2024-04-26T11:15:19.937 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9978999999999999e-05 2024-04-26T11:15:19.937 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.937 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.937 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:19.937 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350263+0000", 2024-04-26T11:15:19.937 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.702e-05 2024-04-26T11:15:19.937 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.937 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.937 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:19.937 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412238+0000", 2024-04-26T11:15:19.938 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061974603000000003 2024-04-26T11:15:19.938 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:19.938 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:19.938 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:19.938 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412267+0000", 2024-04-26T11:15:19.938 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9116e-05 2024-04-26T11:15:19.938 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.938 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:19.938 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.938 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:19.938 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:19.938 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:19.940 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:19.941 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:19.938+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:20.041 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:20.039+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:20.115 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:20.115 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:15:20.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:254735 5.b 5:d909f5e7:::benchmark_data_smithi029_44842_object110097:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:15:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:20.106247+0000", 2024-04-26T11:15:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0072136850000000001, 2024-04-26T11:15:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0072426180000000001, 2024-04-26T11:15:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 254735 2024-04-26T11:15:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.106247+0000", 2024-04-26T11:15:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.106247+0000", 2024-04-26T11:15:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.106247+0000", 2024-04-26T11:15:20.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.106249+0000", 2024-04-26T11:15:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.644e-06 2024-04-26T11:15:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.106256+0000", 2024-04-26T11:15:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2160000000000003e-06 2024-04-26T11:15:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.106259+0000", 2024-04-26T11:15:20.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2949999999999998e-06 2024-04-26T11:15:20.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.109194+0000", 2024-04-26T11:15:20.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0029348289999999999 2024-04-26T11:15:20.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.109266+0000", 2024-04-26T11:15:20.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2644000000000004e-05 2024-04-26T11:15:20.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:20.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.109342+0000", 2024-04-26T11:15:20.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6033999999999997e-05 2024-04-26T11:15:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.112253+0000", 2024-04-26T11:15:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0029101090000000001 2024-04-26T11:15:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:254742 5.b 5:dc233988:::benchmark_data_smithi029_44842_object110104:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:15:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:20.108711+0000", 2024-04-26T11:15:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0047497390000000002, 2024-04-26T11:15:20.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048874000000000001, 2024-04-26T11:15:20.122 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.122 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:20.122 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.122 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.122 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.122 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 254742 2024-04-26T11:15:20.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.122 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.108711+0000", 2024-04-26T11:15:20.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.108711+0000", 2024-04-26T11:15:20.123 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.108710+0000", 2024-04-26T11:15:20.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.108714+0000", 2024-04-26T11:15:20.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0500000000000002e-06 2024-04-26T11:15:20.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.108726+0000", 2024-04-26T11:15:20.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1253999999999999e-05 2024-04-26T11:15:20.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.108730+0000", 2024-04-26T11:15:20.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.724e-06 2024-04-26T11:15:20.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.110727+0000", 2024-04-26T11:15:20.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001996102 2024-04-26T11:15:20.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.110816+0000", 2024-04-26T11:15:20.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9228999999999996e-05 2024-04-26T11:15:20.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:20.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.110922+0000", 2024-04-26T11:15:20.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106254 2024-04-26T11:15:20.126 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.126 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.126 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.126 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:254744 5.8 5:1f1c4101:::benchmark_data_smithi029_44842_object110106:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:15:20.126 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:20.109758+0000", 2024-04-26T11:15:20.127 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0037023590000000001, 2024-04-26T11:15:20.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039251800000000003, 2024-04-26T11:15:20.127 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.127 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:20.127 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.127 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.127 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.127 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 254744 2024-04-26T11:15:20.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.127 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.109758+0000", 2024-04-26T11:15:20.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.109758+0000", 2024-04-26T11:15:20.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.109758+0000", 2024-04-26T11:15:20.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.109762+0000", 2024-04-26T11:15:20.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3059999999999999e-06 2024-04-26T11:15:20.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.109772+0000", 2024-04-26T11:15:20.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9539999999999999e-06 2024-04-26T11:15:20.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.109778+0000", 2024-04-26T11:15:20.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3570000000000003e-06 2024-04-26T11:15:20.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.109804+0000", 2024-04-26T11:15:20.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5477e-05 2024-04-26T11:15:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.109904+0000", 2024-04-26T11:15:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010047000000000001 2024-04-26T11:15:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.110005+0000", 2024-04-26T11:15:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010109 2024-04-26T11:15:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:20.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.113402+0000", 2024-04-26T11:15:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0033965319999999998 2024-04-26T11:15:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:254746 5.8 5:1def01bf:::benchmark_data_smithi029_44842_object110108:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:15:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:20.109792+0000", 2024-04-26T11:15:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0036686539999999999, 2024-04-26T11:15:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003980702, 2024-04-26T11:15:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.131 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 254746 2024-04-26T11:15:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.109792+0000", 2024-04-26T11:15:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.109792+0000", 2024-04-26T11:15:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.109792+0000", 2024-04-26T11:15:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.109794+0000", 2024-04-26T11:15:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.791e-06 2024-04-26T11:15:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.109804+0000", 2024-04-26T11:15:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2560000000000008e-06 2024-04-26T11:15:20.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.109809+0000", 2024-04-26T11:15:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4249999999999997e-06 2024-04-26T11:15:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.111685+0000", 2024-04-26T11:15:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018759880000000001 2024-04-26T11:15:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.111800+0000", 2024-04-26T11:15:20.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000114418 2024-04-26T11:15:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.111900+0000", 2024-04-26T11:15:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000100784 2024-04-26T11:15:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.113707+0000", 2024-04-26T11:15:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001807024 2024-04-26T11:15:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:254751 5.b 5:d926da53:::benchmark_data_smithi029_44842_object110113:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:15:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:20.110706+0000", 2024-04-26T11:15:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0027544890000000002, 2024-04-26T11:15:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0031620250000000002, 2024-04-26T11:15:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 254751 2024-04-26T11:15:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.110706+0000", 2024-04-26T11:15:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.110706+0000", 2024-04-26T11:15:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.110706+0000", 2024-04-26T11:15:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.110710+0000", 2024-04-26T11:15:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0099999999999997e-06 2024-04-26T11:15:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.110718+0000", 2024-04-26T11:15:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.191e-06 2024-04-26T11:15:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.110725+0000", 2024-04-26T11:15:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8709999999999999e-06 2024-04-26T11:15:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.112303+0000", 2024-04-26T11:15:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0015781040000000001 2024-04-26T11:15:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.112413+0000", 2024-04-26T11:15:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000109842 2024-04-26T11:15:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.112518+0000", 2024-04-26T11:15:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105666 2024-04-26T11:15:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.139 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:254752 5.a 5:596a74b5:::benchmark_data_smithi029_44842_object110114:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:15:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:20.110771+0000", 2024-04-26T11:15:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0026897589999999999, 2024-04-26T11:15:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0031536860000000002, 2024-04-26T11:15:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 254752 2024-04-26T11:15:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.140 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.110771+0000", 2024-04-26T11:15:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.110771+0000", 2024-04-26T11:15:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.110770+0000", 2024-04-26T11:15:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.110774+0000", 2024-04-26T11:15:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5810000000000001e-06 2024-04-26T11:15:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.110782+0000", 2024-04-26T11:15:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7489999999999998e-06 2024-04-26T11:15:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.110787+0000", 2024-04-26T11:15:20.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7520000000000002e-06 2024-04-26T11:15:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.110821+0000", 2024-04-26T11:15:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3243e-05 2024-04-26T11:15:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.110930+0000", 2024-04-26T11:15:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000109178 2024-04-26T11:15:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.111031+0000", 2024-04-26T11:15:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000101276 2024-04-26T11:15:20.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:20.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.113375+0000", 2024-04-26T11:15:20.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0023435000000000001 2024-04-26T11:15:20.144 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.144 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.144 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.144 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:254753 5.f 5:f6cc396d:::benchmark_data_smithi029_44842_object110115:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:15:20.144 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:20.112940+0000", 2024-04-26T11:15:20.144 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00052062699999999996, 2024-04-26T11:15:20.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010607279999999999, 2024-04-26T11:15:20.144 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.144 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:20.145 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.145 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.145 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.145 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 254753 2024-04-26T11:15:20.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.145 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.112940+0000", 2024-04-26T11:15:20.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.112940+0000", 2024-04-26T11:15:20.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.112939+0000", 2024-04-26T11:15:20.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.112943+0000", 2024-04-26T11:15:20.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4189999999999998e-06 2024-04-26T11:15:20.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.146 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.146 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.112951+0000", 2024-04-26T11:15:20.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.644e-06 2024-04-26T11:15:20.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.112956+0000", 2024-04-26T11:15:20.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8989999999999998e-06 2024-04-26T11:15:20.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.112998+0000", 2024-04-26T11:15:20.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1383e-05 2024-04-26T11:15:20.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.113117+0000", 2024-04-26T11:15:20.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000119305 2024-04-26T11:15:20.148 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.148 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.148 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.148 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:254754 5.e 5:7105626d:::benchmark_data_smithi029_44842_object110116:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:15:20.148 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:20.113092+0000", 2024-04-26T11:15:20.148 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.000369067, 2024-04-26T11:15:20.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00099234600000000007, 2024-04-26T11:15:20.148 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.148 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:20.148 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.148 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.148 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.149 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 254754 2024-04-26T11:15:20.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.149 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.113092+0000", 2024-04-26T11:15:20.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.113092+0000", 2024-04-26T11:15:20.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.113091+0000", 2024-04-26T11:15:20.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:20.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.113096+0000", 2024-04-26T11:15:20.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8029999999999996e-06 2024-04-26T11:15:20.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.113105+0000", 2024-04-26T11:15:20.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7149999999999993e-06 2024-04-26T11:15:20.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.113112+0000", 2024-04-26T11:15:20.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9149999999999999e-06 2024-04-26T11:15:20.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.113149+0000", 2024-04-26T11:15:20.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6993999999999999e-05 2024-04-26T11:15:20.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.113410+0000", 2024-04-26T11:15:20.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00026027299999999999 2024-04-26T11:15:20.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:20.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.113508+0000", 2024-04-26T11:15:20.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.8157000000000002e-05 2024-04-26T11:15:20.152 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.152 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.152 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.152 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:254755 5.8 5:17fd5f96:::benchmark_data_smithi029_44842_object110117:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:15:20.152 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:20.113968+0000", 2024-04-26T11:15:20.152 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9994931, 2024-04-26T11:15:20.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020586700000000001, 2024-04-26T11:15:20.152 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.152 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:20.152 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.152 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.153 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.153 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 254755 2024-04-26T11:15:20.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.153 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.113968+0000", 2024-04-26T11:15:20.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.113968+0000", 2024-04-26T11:15:20.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.113967+0000", 2024-04-26T11:15:20.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.113974+0000", 2024-04-26T11:15:20.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2960000000000001e-06 2024-04-26T11:15:20.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.113983+0000", 2024-04-26T11:15:20.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2640000000000008e-06 2024-04-26T11:15:20.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.113988+0000", 2024-04-26T11:15:20.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1059999999999999e-06 2024-04-26T11:15:20.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.114018+0000", 2024-04-26T11:15:20.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0521000000000001e-05 2024-04-26T11:15:20.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.114126+0000", 2024-04-26T11:15:20.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010827000000000001 2024-04-26T11:15:20.156 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.156 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.156 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.156 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:254756 5.b 5:dd08239d:::benchmark_data_smithi029_44842_object110118:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:15:20.156 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:20.113994+0000", 2024-04-26T11:15:20.156 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4294967295.9994664, 2024-04-26T11:15:20.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000262394, 2024-04-26T11:15:20.156 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.156 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:20.156 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.157 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.157 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.157 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 254756 2024-04-26T11:15:20.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.157 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.113994+0000", 2024-04-26T11:15:20.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.113994+0000", 2024-04-26T11:15:20.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.113994+0000", 2024-04-26T11:15:20.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.113996+0000", 2024-04-26T11:15:20.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.75e-06 2024-04-26T11:15:20.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.114000+0000", 2024-04-26T11:15:20.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4290000000000003e-06 2024-04-26T11:15:20.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.114003+0000", 2024-04-26T11:15:20.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9110000000000002e-06 2024-04-26T11:15:20.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.114026+0000", 2024-04-26T11:15:20.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3163000000000002e-05 2024-04-26T11:15:20.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.114098+0000", 2024-04-26T11:15:20.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1785999999999993e-05 2024-04-26T11:15:20.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:20.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:20.114194+0000", 2024-04-26T11:15:20.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5901000000000002e-05 2024-04-26T11:15:20.160 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.160 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.160 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.160 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.160 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:15:20.160 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 10 2024-04-26T11:15:20.160 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:20.161 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:20.159+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:20.162 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:20.262 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:20.260+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:20.365 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:20.361+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:20.369 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:20.369 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:15:20.369 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:15:20.369 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:15:20.369 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:20.383 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:20.463 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:20.461+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:20.564 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:20.562+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:20.598 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:20.598 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:15:20.598 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:15:20.599 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:15:20.599 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.599 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:20.599 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:20.599 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 87.316426516000007, 2024-04-26T11:15:20.599 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:15:20.599 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.599 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:20.599 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.599 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.599 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.599 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:15:20.599 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.600 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:20.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:20.600 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.600 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.600 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.600 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.600 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:20.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:15:20.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:15:20.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.601 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.601 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.601 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:15:20.601 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:15:20.601 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:15:20.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:15:20.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:15:20.602 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:15:20.602 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.602 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.602 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.602 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:15:20.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:15:20.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:20.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:15:20.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:15:20.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:20.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:15:20.603 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:15:20.603 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.603 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.603 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:20.603 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:15:20.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:15:20.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:20.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:15:20.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:15:20.604 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.604 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.604 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:20.604 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:15:20.604 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:15:20.604 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.604 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.605 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.605 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.605 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:20.605 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:20.605 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 87.315776814000003, 2024-04-26T11:15:20.605 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:15:20.605 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.605 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:20.605 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.605 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.605 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.605 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:15:20.605 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.605 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:20.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:20.606 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.606 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.606 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.606 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.606 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:15:20.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:20.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:15:20.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:15:20.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:15:20.607 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:15:20.607 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.607 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.607 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.607 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:15:20.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:15:20.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:15:20.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:15:20.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.608 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:15:20.608 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:15:20.608 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.608 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.608 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:20.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:15:20.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:15:20.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:20.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:15:20.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:15:20.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.609 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:20.609 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:15:20.609 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:15:20.609 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.609 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:20.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:15:20.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:15:20.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.610 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:20.610 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:15:20.610 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:15:20.610 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.610 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.610 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.610 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.610 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.610 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:20.611 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:20.611 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 83.249134775000002, 2024-04-26T11:15:20.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:15:20.611 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.611 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:20.611 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.611 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.611 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.611 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:15:20.611 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.611 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.611 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.611 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.611 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:20.611 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:20.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:15:20.612 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:20.612 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.612 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.612 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.612 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:15:20.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:15:20.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:15:20.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:15:20.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.613 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:15:20.613 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:15:20.613 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.613 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.613 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:15:20.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:15:20.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:20.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:15:20.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:15:20.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.614 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.614 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:15:20.614 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:15:20.614 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.614 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.615 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:20.615 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:15:20.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:15:20.615 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.615 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.615 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.615 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.615 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.615 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:20.615 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:20.615 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 83.249039128999996, 2024-04-26T11:15:20.615 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:15:20.616 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.616 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:20.616 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.616 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.616 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.616 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:15:20.616 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.616 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.616 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.616 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.616 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:20.616 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:20.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.617 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.617 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:15:20.617 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.617 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.617 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:15:20.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:15:20.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:15:20.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:15:20.618 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.618 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.618 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.618 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:15:20.618 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:15:20.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:15:20.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:15:20.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.619 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:20.619 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:15:20.619 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:15:20.619 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.619 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:15:20.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:15:20.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.620 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.620 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:20.620 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:15:20.620 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:15:20.620 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.620 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.620 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.620 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.621 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:20.621 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:20.621 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 83.248907450000004, 2024-04-26T11:15:20.621 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:15:20.621 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.621 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:20.621 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.621 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.621 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.621 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:15:20.621 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.621 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.621 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:20.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:20.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.622 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.622 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.622 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.622 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:20.622 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:15:20.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:15:20.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:15:20.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:15:20.623 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.623 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.623 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.623 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:15:20.623 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:15:20.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:15:20.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:15:20.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:20.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:15:20.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:15:20.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.624 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.624 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.624 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:15:20.624 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:15:20.624 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.625 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:20.625 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:15:20.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:15:20.625 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.625 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.625 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.625 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.625 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.625 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:20.625 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:20.625 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 83.248798993999998, 2024-04-26T11:15:20.625 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:15:20.625 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.626 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:20.626 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.626 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.626 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.626 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:15:20.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.626 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.626 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:20.626 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.626 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.626 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.626 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:20.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:15:20.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:20.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:15:20.627 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:15:20.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.627 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.627 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.627 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:15:20.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:15:20.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:15:20.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:15:20.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:15:20.628 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:15:20.628 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.628 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.628 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:20.628 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:15:20.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:15:20.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:15:20.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:15:20.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.629 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.629 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:20.629 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:15:20.629 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:15:20.629 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.629 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.629 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.630 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.630 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:20.630 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:20.630 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 83.248697726000003, 2024-04-26T11:15:20.630 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:15:20.630 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.630 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:20.630 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.630 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.630 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.630 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:15:20.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.631 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:20.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.631 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:20.631 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.631 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.631 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.631 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:20.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:15:20.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:15:20.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.632 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.632 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:15:20.632 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:15:20.632 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.632 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:15:20.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:15:20.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:15:20.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:15:20.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.633 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:20.633 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:15:20.633 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:15:20.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.633 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:15:20.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:15:20.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:15:20.634 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:15:20.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.634 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.634 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:20.634 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:15:20.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:15:20.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:20.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:15:20.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:15:20.635 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.635 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.635 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:20.635 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:15:20.635 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:15:20.635 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.635 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.636 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.636 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.636 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:20.636 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:20.636 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 83.248628784999994, 2024-04-26T11:15:20.636 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:15:20.636 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.636 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:20.636 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.636 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.636 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.636 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:15:20.636 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.636 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:20.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:20.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.637 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.637 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.637 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:15:20.637 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:15:20.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:15:20.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.638 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:15:20.638 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:15:20.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.638 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.638 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:15:20.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:15:20.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:15:20.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:15:20.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.639 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:20.639 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:15:20.639 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:15:20.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.639 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:15:20.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:15:20.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:15:20.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:15:20.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.640 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.640 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:20.640 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:15:20.640 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:15:20.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:20.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:15:20.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:15:20.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.641 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:20.641 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:15:20.641 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:15:20.641 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.641 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.641 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.641 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.642 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:20.642 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:20.642 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 83.242633204000001, 2024-04-26T11:15:20.642 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:15:20.642 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.642 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:20.642 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.642 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.642 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.642 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:15:20.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.642 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.642 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:20.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:20.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.643 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.643 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:15:20.643 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.643 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.643 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:15:20.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:15:20.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:15:20.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:15:20.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.644 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.644 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.644 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:15:20.644 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:15:20.644 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:15:20.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:15:20.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:20.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:15:20.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:15:20.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.645 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.645 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.645 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:15:20.645 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:15:20.645 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:15:20.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:15:20.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:20.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:15:20.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:15:20.646 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.646 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.646 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:20.646 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:15:20.646 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:15:20.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.647 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:20.647 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:15:20.647 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:15:20.647 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.647 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.647 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.647 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.647 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101754 5.e 5:7ca15a5c:::benchmark_data_smithi029_44842_object101753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:20.647 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:20.647 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 61.476685461999999, 2024-04-26T11:15:20.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039171048999999999, 2024-04-26T11:15:20.648 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.648 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:20.648 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.648 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.648 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.648 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101754 2024-04-26T11:15:20.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.648 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.648 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.648 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.648 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:20.648 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:20.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:20.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.649 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.649 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.649 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.649 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118604+0000", 2024-04-26T11:15:20.649 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3399000000000007e-05 2024-04-26T11:15:20.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118613+0000", 2024-04-26T11:15:20.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6989999999999992e-06 2024-04-26T11:15:20.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118618+0000", 2024-04-26T11:15:20.650 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3850000000000001e-06 2024-04-26T11:15:20.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.650 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.650 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.650 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118646+0000", 2024-04-26T11:15:20.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7878e-05 2024-04-26T11:15:20.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118720+0000", 2024-04-26T11:15:20.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3461999999999996e-05 2024-04-26T11:15:20.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:20.651 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118807+0000", 2024-04-26T11:15:20.651 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7269999999999996e-05 2024-04-26T11:15:20.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.651 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.651 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:20.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142317+0000", 2024-04-26T11:15:20.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023510105999999999 2024-04-26T11:15:20.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:20.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.143287+0000", 2024-04-26T11:15:20.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096983599999999996 2024-04-26T11:15:20.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.652 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:20.652 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157662+0000", 2024-04-26T11:15:20.652 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014375393 2024-04-26T11:15:20.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.652 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.653 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:20.653 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157702+0000", 2024-04-26T11:15:20.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0295e-05 2024-04-26T11:15:20.653 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.653 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.653 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.653 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.653 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101755 5.f 5:fa973a83:::benchmark_data_smithi029_44842_object101754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:20.653 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:15:20.653 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 61.476519766000003, 2024-04-26T11:15:20.653 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039139064000000001, 2024-04-26T11:15:20.653 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.653 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:20.654 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.654 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.654 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.654 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101755 2024-04-26T11:15:20.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.654 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:15:20.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.654 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.654 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.654 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:15:20.654 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118696+0000", 2024-04-26T11:15:20.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.655 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118766+0000", 2024-04-26T11:15:20.655 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9423000000000003e-05 2024-04-26T11:15:20.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.655 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.655 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118774+0000", 2024-04-26T11:15:20.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9710000000000004e-06 2024-04-26T11:15:20.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118779+0000", 2024-04-26T11:15:20.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5629999999999999e-06 2024-04-26T11:15:20.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.656 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118817+0000", 2024-04-26T11:15:20.656 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7771000000000001e-05 2024-04-26T11:15:20.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.656 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.656 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118929+0000", 2024-04-26T11:15:20.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011222699999999999 2024-04-26T11:15:20.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:20.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157661+0000", 2024-04-26T11:15:20.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038731120000000001 2024-04-26T11:15:20.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.657 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:20.657 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157757+0000", 2024-04-26T11:15:20.657 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6910000000000006e-05 2024-04-26T11:15:20.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.657 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.658 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:20.658 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157836+0000", 2024-04-26T11:15:20.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8727999999999996e-05 2024-04-26T11:15:20.658 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.658 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.658 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.658 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.658 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.658 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101758 5.4 5:2525a4eb:::benchmark_data_smithi029_44842_object101757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:20.658 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:15:20.658 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 61.474336915000002, 2024-04-26T11:15:20.658 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.03686739, 2024-04-26T11:15:20.658 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.659 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:20.659 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.659 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.659 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.659 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101758 2024-04-26T11:15:20.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.659 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.659 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.659 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:15:20.659 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.659 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:15:20.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120879+0000", 2024-04-26T11:15:20.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.660 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.660 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120971+0000", 2024-04-26T11:15:20.660 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2133999999999996e-05 2024-04-26T11:15:20.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.660 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120977+0000", 2024-04-26T11:15:20.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5509999999999999e-06 2024-04-26T11:15:20.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120981+0000", 2024-04-26T11:15:20.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.245e-06 2024-04-26T11:15:20.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.661 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.661 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.661 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121010+0000", 2024-04-26T11:15:20.661 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9084000000000001e-05 2024-04-26T11:15:20.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121083+0000", 2024-04-26T11:15:20.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2942999999999996e-05 2024-04-26T11:15:20.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:20.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121163+0000", 2024-04-26T11:15:20.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0197000000000005e-05 2024-04-26T11:15:20.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.662 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.662 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:20.662 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142822+0000", 2024-04-26T11:15:20.662 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021658535999999999 2024-04-26T11:15:20.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:20.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157674+0000", 2024-04-26T11:15:20.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014851573999999999 2024-04-26T11:15:20.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:20.663 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157714+0000", 2024-04-26T11:15:20.663 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0473999999999999e-05 2024-04-26T11:15:20.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.663 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.663 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:20.664 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157747+0000", 2024-04-26T11:15:20.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3278999999999998e-05 2024-04-26T11:15:20.664 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.664 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.664 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.664 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.664 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101760 5.4 5:2510211a:::benchmark_data_smithi029_44842_object101759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:20.664 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:20.664 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 61.473904570000002, 2024-04-26T11:15:20.664 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039182383000000001, 2024-04-26T11:15:20.664 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.664 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:20.664 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.665 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.665 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.665 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101760 2024-04-26T11:15:20.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.665 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:20.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.665 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.665 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.665 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:20.665 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:20.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121389+0000", 2024-04-26T11:15:20.666 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6667000000000003e-05 2024-04-26T11:15:20.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.666 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.666 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.666 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121394+0000", 2024-04-26T11:15:20.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0839999999999999e-06 2024-04-26T11:15:20.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121397+0000", 2024-04-26T11:15:20.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4489999999999999e-06 2024-04-26T11:15:20.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.667 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122921+0000", 2024-04-26T11:15:20.667 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001524067 2024-04-26T11:15:20.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.667 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.667 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.123010+0000", 2024-04-26T11:15:20.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8449000000000006e-05 2024-04-26T11:15:20.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:20.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140838+0000", 2024-04-26T11:15:20.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017828796000000001 2024-04-26T11:15:20.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.668 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:20.668 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157665+0000", 2024-04-26T11:15:20.668 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016826574 2024-04-26T11:15:20.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.668 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:20.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160407+0000", 2024-04-26T11:15:20.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027423970000000002 2024-04-26T11:15:20.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:20.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160456+0000", 2024-04-26T11:15:20.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8678999999999999e-05 2024-04-26T11:15:20.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.669 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.669 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:20.669 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160495+0000", 2024-04-26T11:15:20.669 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8658000000000002e-05 2024-04-26T11:15:20.669 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.670 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.670 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.670 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.670 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101761 5.e 5:70294421:::benchmark_data_smithi029_44842_object101760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:20.670 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:15:20.670 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 61.472480197000003, 2024-04-26T11:15:20.670 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035270448000000003, 2024-04-26T11:15:20.670 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.670 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:20.670 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.670 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.670 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.671 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101761 2024-04-26T11:15:20.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.671 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:15:20.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.671 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.671 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.671 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:15:20.671 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.671 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122736+0000", 2024-04-26T11:15:20.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122805+0000", 2024-04-26T11:15:20.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9076000000000001e-05 2024-04-26T11:15:20.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.672 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.672 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.672 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122811+0000", 2024-04-26T11:15:20.672 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:15:20.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122815+0000", 2024-04-26T11:15:20.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2860000000000001e-06 2024-04-26T11:15:20.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122842+0000", 2024-04-26T11:15:20.673 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6429000000000001e-05 2024-04-26T11:15:20.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.673 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.673 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.673 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122916+0000", 2024-04-26T11:15:20.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4122999999999995e-05 2024-04-26T11:15:20.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:20.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122997+0000", 2024-04-26T11:15:20.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1428999999999996e-05 2024-04-26T11:15:20.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:20.674 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142344+0000", 2024-04-26T11:15:20.674 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019346452 2024-04-26T11:15:20.674 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.674 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.674 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:20.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157934+0000", 2024-04-26T11:15:20.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015589911999999999 2024-04-26T11:15:20.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:20.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157975+0000", 2024-04-26T11:15:20.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1604999999999999e-05 2024-04-26T11:15:20.675 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.675 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.675 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:20.675 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.158007+0000", 2024-04-26T11:15:20.675 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1921000000000002e-05 2024-04-26T11:15:20.675 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.675 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.675 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.676 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.676 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110145 5.9 5:9b275f16:::benchmark_data_smithi029_44842_object110144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:15:20.676 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:15:20.676 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 57.446918558999997, 2024-04-26T11:15:20.676 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032844496000000001, 2024-04-26T11:15:20.676 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.676 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:20.676 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.676 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.676 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.676 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110145 2024-04-26T11:15:20.676 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.676 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:15:20.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:15:20.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.677 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.677 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.677 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148297+0000", 2024-04-26T11:15:20.677 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:20.677 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148325+0000", 2024-04-26T11:15:20.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7511000000000001e-05 2024-04-26T11:15:20.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148338+0000", 2024-04-26T11:15:20.678 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2808e-05 2024-04-26T11:15:20.678 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.678 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.678 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.678 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148345+0000", 2024-04-26T11:15:20.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7200000000000006e-06 2024-04-26T11:15:20.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149888+0000", 2024-04-26T11:15:20.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001542666 2024-04-26T11:15:20.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.679 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149977+0000", 2024-04-26T11:15:20.679 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9247999999999997e-05 2024-04-26T11:15:20.679 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.679 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.679 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:20.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181006+0000", 2024-04-26T11:15:20.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031028535999999999 2024-04-26T11:15:20.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:20.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181051+0000", 2024-04-26T11:15:20.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5393999999999999e-05 2024-04-26T11:15:20.680 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.680 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.680 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:20.680 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181143+0000", 2024-04-26T11:15:20.680 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1458000000000004e-05 2024-04-26T11:15:20.680 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.681 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.681 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.681 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.681 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.681 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110155 5.9 5:9ebc6158:::benchmark_data_smithi029_44842_object110154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:15:20.681 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:15:20.681 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 57.441842766999997, 2024-04-26T11:15:20.681 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027886826999999999, 2024-04-26T11:15:20.681 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.681 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:20.681 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.681 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.681 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.681 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110155 2024-04-26T11:15:20.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.682 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:15:20.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.682 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:15:20.682 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.682 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.682 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153373+0000", 2024-04-26T11:15:20.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153479+0000", 2024-04-26T11:15:20.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105728 2024-04-26T11:15:20.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.683 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.683 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153491+0000", 2024-04-26T11:15:20.683 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2207e-05 2024-04-26T11:15:20.683 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.683 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153499+0000", 2024-04-26T11:15:20.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7729999999999999e-06 2024-04-26T11:15:20.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153655+0000", 2024-04-26T11:15:20.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015573 2024-04-26T11:15:20.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.684 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.684 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.684 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153770+0000", 2024-04-26T11:15:20.684 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011562500000000001 2024-04-26T11:15:20.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:20.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181153+0000", 2024-04-26T11:15:20.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027382113 2024-04-26T11:15:20.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:20.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181195+0000", 2024-04-26T11:15:20.685 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1921000000000001e-05 2024-04-26T11:15:20.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.685 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.685 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:20.685 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181261+0000", 2024-04-26T11:15:20.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6402999999999994e-05 2024-04-26T11:15:20.686 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.686 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.686 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.686 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.686 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.686 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174398 5.4 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:20.686 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:20.686 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.245326554999998, 2024-04-26T11:15:20.686 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.064773789999999998, 2024-04-26T11:15:20.686 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.686 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:20.686 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.687 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.687 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.687 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174398 2024-04-26T11:15:20.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.687 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:20.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.687 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.687 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.687 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.687 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:20.687 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349889+0000", 2024-04-26T11:15:20.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:20.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349895+0000", 2024-04-26T11:15:20.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4519999999999996e-06 2024-04-26T11:15:20.688 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.688 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.688 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.688 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349909+0000", 2024-04-26T11:15:20.688 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3791000000000001e-05 2024-04-26T11:15:20.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349919+0000", 2024-04-26T11:15:20.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0135999999999999e-05 2024-04-26T11:15:20.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.689 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349956+0000", 2024-04-26T11:15:20.689 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7642000000000003e-05 2024-04-26T11:15:20.689 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.689 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.689 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350080+0000", 2024-04-26T11:15:20.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123285 2024-04-26T11:15:20.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:20.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350192+0000", 2024-04-26T11:15:20.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112509 2024-04-26T11:15:20.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:20.690 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356232+0000", 2024-04-26T11:15:20.690 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060403339999999996 2024-04-26T11:15:20.690 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.690 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.690 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:20.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414616+0000", 2024-04-26T11:15:20.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.058383156999999998 2024-04-26T11:15:20.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:20.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414643+0000", 2024-04-26T11:15:20.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7317e-05 2024-04-26T11:15:20.691 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.691 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.691 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:20.691 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414664+0000", 2024-04-26T11:15:20.691 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1135999999999999e-05 2024-04-26T11:15:20.691 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.691 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.692 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.692 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.692 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174402 5.b 5:d8ad746d:::benchmark_data_smithi029_44842_object29764:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:20.692 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:20.692 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.241372366, 2024-04-26T11:15:20.692 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059017657000000001, 2024-04-26T11:15:20.692 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.692 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:20.692 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.692 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.692 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.692 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174402 2024-04-26T11:15:20.692 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.693 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:20.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.693 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:20.693 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.693 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.693 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.693 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:20.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:20.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353848+0000", 2024-04-26T11:15:20.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5040000000000004e-06 2024-04-26T11:15:20.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.694 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.694 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.694 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353858+0000", 2024-04-26T11:15:20.694 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7410000000000004e-06 2024-04-26T11:15:20.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353864+0000", 2024-04-26T11:15:20.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7899999999999996e-06 2024-04-26T11:15:20.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353902+0000", 2024-04-26T11:15:20.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8325000000000003e-05 2024-04-26T11:15:20.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.695 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.695 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.695 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353980+0000", 2024-04-26T11:15:20.695 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8077000000000005e-05 2024-04-26T11:15:20.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:20.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354046+0000", 2024-04-26T11:15:20.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6249999999999998e-05 2024-04-26T11:15:20.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:20.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356532+0000", 2024-04-26T11:15:20.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024850969999999999 2024-04-26T11:15:20.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.696 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.696 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:20.696 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412796+0000", 2024-04-26T11:15:20.696 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056264616000000003 2024-04-26T11:15:20.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:20.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412835+0000", 2024-04-26T11:15:20.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8863999999999999e-05 2024-04-26T11:15:20.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.697 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.697 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:20.697 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412862+0000", 2024-04-26T11:15:20.697 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7124e-05 2024-04-26T11:15:20.697 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.697 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.697 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.697 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.698 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.698 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174403 5.4 5:2d30cd6a:::benchmark_data_smithi029_44842_object29765:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:20.698 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:15:20.698 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.241345162999998, 2024-04-26T11:15:20.698 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.060873365999999998, 2024-04-26T11:15:20.698 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.698 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:20.698 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.698 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.698 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.698 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174403 2024-04-26T11:15:20.698 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.698 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:15:20.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:15:20.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.699 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.699 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.699 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353871+0000", 2024-04-26T11:15:20.699 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353874+0000", 2024-04-26T11:15:20.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869999999999999e-06 2024-04-26T11:15:20.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353881+0000", 2024-04-26T11:15:20.700 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2239999999999998e-06 2024-04-26T11:15:20.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.700 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.700 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.700 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353886+0000", 2024-04-26T11:15:20.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.259e-06 2024-04-26T11:15:20.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353912+0000", 2024-04-26T11:15:20.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6404999999999999e-05 2024-04-26T11:15:20.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.701 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353991+0000", 2024-04-26T11:15:20.701 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8104999999999998e-05 2024-04-26T11:15:20.701 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.701 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.701 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:20.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354055+0000", 2024-04-26T11:15:20.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4875999999999993e-05 2024-04-26T11:15:20.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:20.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.358000+0000", 2024-04-26T11:15:20.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039442629999999999 2024-04-26T11:15:20.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.702 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:20.702 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414690+0000", 2024-04-26T11:15:20.702 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056689940000000001 2024-04-26T11:15:20.702 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.702 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:20.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414714+0000", 2024-04-26T11:15:20.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4527000000000001e-05 2024-04-26T11:15:20.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.703 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:20.703 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414745+0000", 2024-04-26T11:15:20.703 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0874999999999998e-05 2024-04-26T11:15:20.703 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.703 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.703 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.703 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.703 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.703 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174404 5.4 5:2801f1e1:::benchmark_data_smithi029_44842_object29766:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:20.703 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:15:20.704 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 30.238728239, 2024-04-26T11:15:20.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059745741999999998, 2024-04-26T11:15:20.704 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:20.704 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:20.704 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:20.704 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:20.704 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.704 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174404 2024-04-26T11:15:20.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.704 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:20.704 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.704 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:20.704 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:15:20.704 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:20.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:15:20.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:20.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:20.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356488+0000", 2024-04-26T11:15:20.705 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.705 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.705 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:20.705 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356492+0000", 2024-04-26T11:15:20.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1169999999999997e-06 2024-04-26T11:15:20.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:20.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356502+0000", 2024-04-26T11:15:20.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0263e-05 2024-04-26T11:15:20.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.706 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356508+0000", 2024-04-26T11:15:20.706 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5890000000000002e-06 2024-04-26T11:15:20.706 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.706 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.706 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:20.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356545+0000", 2024-04-26T11:15:20.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7382999999999998e-05 2024-04-26T11:15:20.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:20.707 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356671+0000", 2024-04-26T11:15:20.707 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012535500000000001 2024-04-26T11:15:20.707 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.707 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.707 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:20.708 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:20.706+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:20.709 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356789+0000", 2024-04-26T11:15:20.709 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000118099 2024-04-26T11:15:20.709 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.709 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.709 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:20.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.359200+0000", 2024-04-26T11:15:20.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024110059999999998 2024-04-26T11:15:20.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:20.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416180+0000", 2024-04-26T11:15:20.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056980335999999999 2024-04-26T11:15:20.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.710 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.710 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:20.710 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416204+0000", 2024-04-26T11:15:20.710 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4301e-05 2024-04-26T11:15:20.710 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:20.711 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:20.711 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:20.711 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416234+0000", 2024-04-26T11:15:20.711 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9903000000000002e-05 2024-04-26T11:15:20.711 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.711 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.711 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.711 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:20.711 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:20.711 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:20.711 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:20.746 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:15:20.809 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~82s 2024-04-26T11:15:20.812 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:20.810+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:20.897 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:20.898 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:15:20.898 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.898 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:256912 5.0 e56/16 5:03084f48:::benchmark_data_smithi029_44842_object112274:head v 56'16249, mlcod=56'16244)", 2024-04-26T11:15:20.898 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:20.894492+0000", 2024-04-26T11:15:20.898 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0015631149999999999, 2024-04-26T11:15:20.898 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001585936, 2024-04-26T11:15:20.898 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:20.898 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:20.898 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:20.898 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.898 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:20.898 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894492+0000", 2024-04-26T11:15:20.898 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:20.898 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.899 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.899 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:20.899 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894492+0000", 2024-04-26T11:15:20.899 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:20.899 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.899 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.899 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:20.899 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894492+0000", 2024-04-26T11:15:20.899 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.899 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.899 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.899 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:20.899 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894496+0000", 2024-04-26T11:15:20.899 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2490000000000003e-06 2024-04-26T11:15:20.899 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.900 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.900 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:20.900 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894502+0000", 2024-04-26T11:15:20.900 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.5339999999999996e-06 2024-04-26T11:15:20.900 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.900 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.900 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.900 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894508+0000", 2024-04-26T11:15:20.900 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.3079999999999998e-06 2024-04-26T11:15:20.900 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.900 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.900 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:20.900 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894544+0000", 2024-04-26T11:15:20.900 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6681000000000003e-05 2024-04-26T11:15:20.901 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.901 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.901 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:20.901 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894562+0000", 2024-04-26T11:15:20.901 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7391e-05 2024-04-26T11:15:20.901 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:20.901 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:20.901 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:20.901 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.901 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.901 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:256901 5.0 e56/16 5:05357f23:::benchmark_data_smithi029_44842_object112263:head v 56'16247, mlcod=56'16242)", 2024-04-26T11:15:20.901 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:20.890822+0000", 2024-04-26T11:15:20.901 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.005233031, 2024-04-26T11:15:20.901 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0053214849999999999, 2024-04-26T11:15:20.901 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:20.902 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:20.902 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:20.902 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.902 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:20.902 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.890822+0000", 2024-04-26T11:15:20.902 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:20.902 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.902 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.902 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:20.902 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.890822+0000", 2024-04-26T11:15:20.902 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:20.902 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.902 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.902 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:20.903 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.890821+0000", 2024-04-26T11:15:20.903 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.903 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.903 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.903 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:20.903 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.890827+0000", 2024-04-26T11:15:20.903 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5049999999999998e-06 2024-04-26T11:15:20.903 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.903 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.903 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:20.903 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.890836+0000", 2024-04-26T11:15:20.903 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1460000000000002e-06 2024-04-26T11:15:20.903 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.903 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.903 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.904 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.890842+0000", 2024-04-26T11:15:20.904 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7520000000000002e-06 2024-04-26T11:15:20.904 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.904 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.904 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:20.904 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.891303+0000", 2024-04-26T11:15:20.904 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00046146099999999998 2024-04-26T11:15:20.904 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.904 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.904 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:20.904 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.891321+0000", 2024-04-26T11:15:20.904 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7921999999999999e-05 2024-04-26T11:15:20.904 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.904 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.904 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:20.905 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.896132+0000", 2024-04-26T11:15:20.905 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0048107940000000002 2024-04-26T11:15:20.905 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.905 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.905 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:20.905 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.896144+0000", 2024-04-26T11:15:20.905 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1484000000000001e-05 2024-04-26T11:15:20.905 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:20.905 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:20.905 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:20.905 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.905 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.905 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:256908 5.0 e56/16 5:00dfd160:::benchmark_data_smithi029_44842_object112270:head v 56'16248, mlcod=56'16242)", 2024-04-26T11:15:20.905 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:20.891951+0000", 2024-04-26T11:15:20.905 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0041043759999999999, 2024-04-26T11:15:20.906 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042780910000000004, 2024-04-26T11:15:20.906 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:20.906 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:20.906 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:20.906 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.906 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:20.906 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.891951+0000", 2024-04-26T11:15:20.906 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:20.906 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.906 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.906 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:20.906 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.891951+0000", 2024-04-26T11:15:20.906 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:20.906 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.907 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.907 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:20.907 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.891950+0000", 2024-04-26T11:15:20.907 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.907 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.907 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.907 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:20.907 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.891956+0000", 2024-04-26T11:15:20.907 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7660000000000004e-06 2024-04-26T11:15:20.907 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.907 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.907 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:20.907 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.891966+0000", 2024-04-26T11:15:20.907 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0149000000000001e-05 2024-04-26T11:15:20.907 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.908 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.908 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.908 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.891972+0000", 2024-04-26T11:15:20.908 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1129999999999997e-06 2024-04-26T11:15:20.908 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.908 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.908 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:20.908 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.892324+0000", 2024-04-26T11:15:20.908 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00035172099999999999 2024-04-26T11:15:20.908 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.908 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.908 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:20.908 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.892343+0000", 2024-04-26T11:15:20.908 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9009999999999999e-05 2024-04-26T11:15:20.908 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.908 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.909 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:20.909 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.896219+0000", 2024-04-26T11:15:20.909 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003876371 2024-04-26T11:15:20.909 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:20.909 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:20.909 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:20.909 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.909 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.909 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:256907 5.e e56/16 5:7434f3e0:::benchmark_data_smithi029_44842_object112269:head v 56'16052, mlcod=56'16048)", 2024-04-26T11:15:20.909 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:20.893877+0000", 2024-04-26T11:15:20.909 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0021783729999999999, 2024-04-26T11:15:20.909 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0024253399999999998, 2024-04-26T11:15:20.909 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:20.909 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:20.909 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:20.910 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.910 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:20.910 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.893877+0000", 2024-04-26T11:15:20.910 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:20.910 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.910 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.910 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:20.910 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.893877+0000", 2024-04-26T11:15:20.910 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:20.910 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.910 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.910 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:20.910 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.893876+0000", 2024-04-26T11:15:20.910 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.910 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.911 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.911 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:20.911 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.893882+0000", 2024-04-26T11:15:20.911 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9460000000000003e-06 2024-04-26T11:15:20.911 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.911 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.911 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:20.911 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.893890+0000", 2024-04-26T11:15:20.911 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9880000000000004e-06 2024-04-26T11:15:20.911 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.911 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.911 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.911 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.893896+0000", 2024-04-26T11:15:20.911 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.19e-06 2024-04-26T11:15:20.912 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.912 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.912 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:20.912 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894069+0000", 2024-04-26T11:15:20.912 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017231599999999999 2024-04-26T11:15:20.912 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.912 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.912 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:20.912 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894087+0000", 2024-04-26T11:15:20.912 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.8053000000000001e-05 2024-04-26T11:15:20.912 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:20.912 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:20.912 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:20.912 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.912 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.913 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:256911 5.6 5:68cc2db4:::benchmark_data_smithi029_44842_object112273:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:15:20.913 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:20.894076+0000", 2024-04-26T11:15:20.913 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0019786790000000001, 2024-04-26T11:15:20.913 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022846139999999999, 2024-04-26T11:15:20.913 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:20.913 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:20.913 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:20.913 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:20.913 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:20.913 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 256911 2024-04-26T11:15:20.913 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.913 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:20.913 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.913 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:20.913 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894076+0000", 2024-04-26T11:15:20.914 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:20.914 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.914 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.914 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:20.914 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894076+0000", 2024-04-26T11:15:20.914 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:20.914 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.914 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.914 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:20.914 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894075+0000", 2024-04-26T11:15:20.914 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:20.914 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.914 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.914 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:20.915 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894081+0000", 2024-04-26T11:15:20.915 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4500000000000003e-06 2024-04-26T11:15:20.915 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.915 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.915 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:20.915 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894094+0000", 2024-04-26T11:15:20.915 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.2716e-05 2024-04-26T11:15:20.915 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.915 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.915 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.915 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894102+0000", 2024-04-26T11:15:20.915 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9710000000000004e-06 2024-04-26T11:15:20.915 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.915 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.915 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:20.916 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894141+0000", 2024-04-26T11:15:20.916 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9131000000000002e-05 2024-04-26T11:15:20.916 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.916 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.916 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:20.916 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894268+0000", 2024-04-26T11:15:20.916 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000126997 2024-04-26T11:15:20.916 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:20.916 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:20.916 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:20.916 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.916 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.916 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:256909 5.a e56/31 5:53f045f5:::benchmark_data_smithi029_44842_object112271:head v 56'16224, mlcod=56'16221)", 2024-04-26T11:15:20.916 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:20.894360+0000", 2024-04-26T11:15:20.916 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0016951710000000001, 2024-04-26T11:15:20.917 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020761849999999999, 2024-04-26T11:15:20.917 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:20.917 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:20.917 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:20.917 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.917 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:20.917 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894360+0000", 2024-04-26T11:15:20.917 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:20.917 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.917 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.917 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:20.917 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894360+0000", 2024-04-26T11:15:20.917 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:20.917 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.917 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.918 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:20.918 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894359+0000", 2024-04-26T11:15:20.918 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.918 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.918 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.918 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:20.918 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894365+0000", 2024-04-26T11:15:20.918 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6930000000000004e-06 2024-04-26T11:15:20.918 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.918 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.918 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:20.918 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894374+0000", 2024-04-26T11:15:20.918 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2529999999999993e-06 2024-04-26T11:15:20.918 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.919 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.919 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.919 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894381+0000", 2024-04-26T11:15:20.919 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3609999999999997e-06 2024-04-26T11:15:20.919 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.919 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.919 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:20.919 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894419+0000", 2024-04-26T11:15:20.919 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8337999999999998e-05 2024-04-26T11:15:20.919 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.919 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.919 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:20.919 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894439+0000", 2024-04-26T11:15:20.919 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9777000000000001e-05 2024-04-26T11:15:20.920 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:20.920 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:20.920 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:20.920 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.920 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.920 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:256910 5.8 e56/16 5:19edc310:::benchmark_data_smithi029_44842_object112272:head v 56'16096, mlcod=56'16093)", 2024-04-26T11:15:20.920 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:20.894437+0000", 2024-04-26T11:15:20.920 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0016180439999999999, 2024-04-26T11:15:20.920 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020794239999999999, 2024-04-26T11:15:20.920 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:20.920 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:20.920 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:20.920 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.920 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:20.920 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894437+0000", 2024-04-26T11:15:20.921 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:20.921 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.921 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.921 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:20.921 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894437+0000", 2024-04-26T11:15:20.921 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:20.921 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.921 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.921 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:20.921 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894437+0000", 2024-04-26T11:15:20.921 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:20.921 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.921 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.921 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:20.921 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894441+0000", 2024-04-26T11:15:20.922 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9910000000000004e-06 2024-04-26T11:15:20.922 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.922 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.922 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:20.922 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894448+0000", 2024-04-26T11:15:20.922 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.7009999999999996e-06 2024-04-26T11:15:20.922 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.922 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.922 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:20.922 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894458+0000", 2024-04-26T11:15:20.922 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0101e-05 2024-04-26T11:15:20.922 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.922 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.922 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:20.923 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894488+0000", 2024-04-26T11:15:20.923 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.0068000000000001e-05 2024-04-26T11:15:20.923 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:20.923 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:20.923 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:20.923 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:20.894508+0000", 2024-04-26T11:15:20.923 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9712e-05 2024-04-26T11:15:20.923 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:20.923 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:20.923 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:20.923 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:20.923 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:15:20.923 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 7 2024-04-26T11:15:20.923 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:20.924 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:20.923+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:20.925 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:21.026 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:21.024+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:21.129 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:21.126+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:21.147 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:21.148 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:15:21.148 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:15:21.148 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:15:21.148 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:21.164 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:21.228 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:21.226+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:21.329 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:21.327+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:21.393 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:21.393 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:15:21.393 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:15:21.393 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:15:21.393 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.394 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:21.394 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:21.394 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 88.118746530999999, 2024-04-26T11:15:21.394 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:15:21.394 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:21.394 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:21.394 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:21.394 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:21.394 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:21.394 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:15:21.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.394 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:21.394 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.395 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:21.395 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:21.395 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.395 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.395 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:21.395 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:21.395 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.395 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.395 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:21.395 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:15:21.395 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:21.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.395 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.395 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:21.396 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:15:21.396 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:15:21.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.396 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.396 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:21.396 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:15:21.396 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:15:21.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.396 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.396 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:21.396 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:15:21.396 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:15:21.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.396 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.396 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.396 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:15:21.396 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:15:21.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.397 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:21.397 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:15:21.397 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:15:21.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.397 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:21.397 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:15:21.397 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:15:21.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.397 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:21.397 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:15:21.397 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:15:21.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.398 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.398 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:21.398 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:15:21.398 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:15:21.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.398 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.398 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:21.398 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:15:21.398 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:15:21.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.398 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.398 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:21.399 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:15:21.399 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:15:21.399 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.399 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:21.399 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.399 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.399 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.399 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:21.399 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:21.399 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 88.117934966000007, 2024-04-26T11:15:21.399 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:15:21.399 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:21.399 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:21.399 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:21.400 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:21.400 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:21.400 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:15:21.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.400 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:21.400 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.400 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:21.400 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:21.400 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.400 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.400 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:21.400 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:21.400 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.401 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.401 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:21.401 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:21.401 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:21.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.401 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.401 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:21.401 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:15:21.401 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:15:21.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.401 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.401 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:21.401 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:15:21.401 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:15:21.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.402 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.402 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:21.402 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:15:21.402 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:15:21.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.402 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.402 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.402 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:15:21.402 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:15:21.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.402 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.402 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:21.403 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:15:21.403 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:15:21.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.403 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.403 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:21.403 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:15:21.403 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:15:21.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.403 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.403 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:21.403 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:15:21.403 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:15:21.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.403 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.404 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:21.404 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:15:21.404 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:15:21.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.404 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.404 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:21.404 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:15:21.404 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:15:21.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.404 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.404 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:21.404 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:15:21.404 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:15:21.404 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.404 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:21.405 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.405 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.405 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:21.405 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:21.405 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 88.110748129000001, 2024-04-26T11:15:21.405 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:15:21.405 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:21.405 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:21.405 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:21.405 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:21.405 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:21.405 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:15:21.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.406 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:21.406 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.406 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:21.406 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:21.406 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.406 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.406 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.406 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:21.406 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:21.406 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.406 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.406 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.406 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:21.406 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:15:21.407 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:21.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.407 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.407 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:21.407 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:15:21.407 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:15:21.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.407 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.407 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:21.407 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:15:21.407 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:15:21.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.407 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.407 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:21.407 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:15:21.408 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:15:21.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.408 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.408 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.408 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:15:21.408 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:15:21.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.408 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.408 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:21.408 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:15:21.408 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:15:21.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.408 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.408 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:21.408 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:15:21.409 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:15:21.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.409 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.409 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:21.409 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:15:21.409 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:15:21.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.409 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.409 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:21.409 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:15:21.409 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:15:21.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.409 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.409 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:21.409 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:15:21.409 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:15:21.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.410 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.410 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:21.410 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:15:21.410 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:15:21.410 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.410 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:21.410 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.410 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.410 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:21.410 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:21.410 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 88.110207250000002, 2024-04-26T11:15:21.410 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:15:21.410 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:21.411 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:21.411 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:21.411 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:21.411 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:21.411 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:15:21.411 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.411 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:21.411 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.411 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:21.411 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:21.411 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.411 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.411 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.411 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:21.411 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:21.411 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.411 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.412 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.412 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:21.412 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:21.412 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:21.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.412 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.412 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:21.412 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:15:21.412 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:15:21.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.412 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.412 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:21.412 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:15:21.412 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:15:21.413 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.413 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.413 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:21.413 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:15:21.413 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:15:21.413 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.413 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.413 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.413 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:15:21.413 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:15:21.413 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.413 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.413 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:21.413 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:15:21.413 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:15:21.413 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.413 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.414 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:21.414 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:15:21.414 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:15:21.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.414 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.414 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:21.414 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:15:21.414 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:15:21.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.414 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.414 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:21.414 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:15:21.414 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:15:21.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.415 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.415 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:21.415 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:15:21.415 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:15:21.415 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.415 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.415 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:21.415 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:15:21.415 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:15:21.415 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.415 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:21.415 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.416 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.416 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.416 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:21.416 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:21.416 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 84.067022803, 2024-04-26T11:15:21.416 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:15:21.416 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:21.416 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:21.416 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:21.416 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:21.416 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:21.416 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:15:21.416 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.416 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:21.417 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.417 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:21.417 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:21.417 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.417 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.417 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:21.417 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:21.417 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.417 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.417 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:21.417 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:15:21.418 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:21.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.418 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.418 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:21.418 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:15:21.418 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:15:21.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.418 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.418 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:21.418 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:15:21.418 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:15:21.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.418 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.418 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:21.419 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:15:21.419 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:15:21.419 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.419 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.419 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.419 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:15:21.419 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:15:21.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.420 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.420 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:21.420 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:15:21.420 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:15:21.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.421 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.421 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:21.421 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:15:21.421 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:15:21.421 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.421 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.422 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:21.422 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:15:21.422 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:15:21.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.422 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.422 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.423 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:15:21.423 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:15:21.423 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.423 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.423 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:21.423 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:15:21.424 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:15:21.424 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.424 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.424 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.424 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:15:21.424 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:15:21.425 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.425 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.425 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:21.425 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:15:21.425 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:15:21.425 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.426 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:21.426 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.426 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.426 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.426 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:21.426 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:21.427 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 84.064829462999995, 2024-04-26T11:15:21.427 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:15:21.427 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:21.427 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:21.427 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:21.427 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:21.428 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:21.428 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:15:21.428 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.428 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:21.428 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.428 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:21.429 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:21.429 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.429 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.429 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.429 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:21.429 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:21.430 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.430 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.430 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.430 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:21.430 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:15:21.430 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:21.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.431 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.431 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:21.431 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:15:21.431 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:15:21.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.432 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.432 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:21.432 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:15:21.432 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:15:21.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.432 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.433 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:21.433 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:15:21.433 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:15:21.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.433 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.433 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.434 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:15:21.434 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:15:21.434 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.434 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.434 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:21.434 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:15:21.435 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:15:21.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.435 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.435 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:21.435 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:15:21.435 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:15:21.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.436 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.436 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:21.436 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:15:21.436 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:15:21.436 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.436 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.437 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.437 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:15:21.437 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:15:21.437 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.437 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.437 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:21.438 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:15:21.438 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:15:21.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.438 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.438 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.438 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:15:21.439 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:15:21.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.439 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.439 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:21.439 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:15:21.439 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:15:21.440 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.440 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:21.440 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.440 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.440 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:21.440 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:21.441 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 84.059617638999995, 2024-04-26T11:15:21.441 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:15:21.441 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:21.441 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:21.441 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:21.441 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:21.442 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:21.442 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:15:21.442 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.442 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:21.442 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.443 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:21.443 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:21.443 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.443 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.443 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.443 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:21.444 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:21.444 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.444 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.444 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:21.444 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:15:21.445 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:21.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.445 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.445 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:21.445 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:15:21.446 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:15:21.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.446 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.446 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:21.446 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:15:21.446 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:15:21.447 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.447 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.447 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:21.447 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:15:21.447 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:15:21.447 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.448 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.448 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.448 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:15:21.448 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:15:21.448 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.448 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.449 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:21.449 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:15:21.449 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:15:21.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.449 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.449 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:21.449 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:15:21.450 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:15:21.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.450 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.450 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:21.450 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:15:21.451 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:15:21.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.451 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.451 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.451 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:15:21.451 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:15:21.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.452 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.452 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:21.452 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:15:21.452 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:15:21.453 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.453 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.453 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.453 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:15:21.453 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:15:21.453 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.453 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.454 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:21.454 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:15:21.454 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:15:21.454 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.454 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:21.455 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.455 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.455 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:21.455 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:21.455 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 84.043168938999997, 2024-04-26T11:15:21.456 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:15:21.456 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:21.456 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:21.456 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:21.456 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:21.456 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:21.457 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:15:21.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.457 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:21.457 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.457 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:21.457 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:21.458 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.458 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.458 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:21.458 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:21.458 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.459 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.459 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:21.459 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:15:21.459 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:21.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.460 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.460 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:21.460 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:15:21.460 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:15:21.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.461 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:21.461 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:15:21.461 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:15:21.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.462 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:21.462 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:15:21.462 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:15:21.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.462 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.462 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.463 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:15:21.463 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:15:21.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.463 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.463 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:21.463 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:15:21.464 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:15:21.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.464 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.464 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.464 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:15:21.464 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:15:21.465 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.465 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.465 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:21.465 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:15:21.465 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:15:21.466 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.466 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:21.466 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.466 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.466 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:21.467 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:21.467 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 84.041471434000002, 2024-04-26T11:15:21.467 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:15:21.467 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:21.467 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:21.467 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:21.468 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:21.468 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:21.468 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:15:21.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.468 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:21.468 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.469 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:21.469 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:21.469 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.469 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:21.470 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:21.470 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.470 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.470 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:21.471 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:15:21.471 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:21.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.471 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.471 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:21.471 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:15:21.472 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:15:21.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.472 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.472 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:21.472 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:15:21.472 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:15:21.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.473 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:21.473 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:15:21.473 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:15:21.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.474 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.474 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:15:21.474 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:15:21.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.475 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:21.475 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:15:21.475 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:15:21.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.475 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.476 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:15:21.476 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:15:21.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.476 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.476 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:21.476 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:15:21.477 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:15:21.477 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.477 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:21.477 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.477 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.478 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:21.478 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:21.478 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 84.041407132000003, 2024-04-26T11:15:21.478 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:15:21.478 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:21.478 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:21.479 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:21.479 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:21.479 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:21.479 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:15:21.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.479 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:21.480 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.480 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:21.480 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:21.480 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.480 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.481 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:21.481 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:21.481 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.481 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.481 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:21.482 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:21.482 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:21.482 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.482 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.482 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:21.482 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:15:21.483 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:15:21.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.483 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.483 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:21.483 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:15:21.483 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:15:21.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.484 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.484 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:21.484 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:15:21.484 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:15:21.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.485 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.485 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.485 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:15:21.485 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:15:21.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.485 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.486 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:21.486 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:15:21.486 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:15:21.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.486 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.487 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.487 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:15:21.487 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:15:21.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.487 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.487 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:21.488 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:15:21.488 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:15:21.488 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.488 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.488 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:21.488 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:15:21.488 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:15:21.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.489 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.489 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:21.489 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:15:21.489 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:15:21.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.489 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.489 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:21.489 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:15:21.489 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:15:21.490 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.490 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:21.490 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.490 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.490 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:21.490 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:21.490 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 84.041352907999993, 2024-04-26T11:15:21.490 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:15:21.490 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:21.490 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:21.490 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:21.490 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:21.490 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:21.491 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:15:21.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.491 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:21.491 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.491 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:21.491 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:21.491 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.491 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.491 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:21.491 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:21.491 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.491 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.491 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:21.492 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:21.492 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:21.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.492 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.492 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:21.492 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:15:21.492 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:15:21.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.492 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.492 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:21.492 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:15:21.492 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:15:21.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.492 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.492 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:21.493 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:15:21.493 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:15:21.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.493 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.493 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.493 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:15:21.493 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:15:21.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.493 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.493 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:21.493 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:15:21.493 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:15:21.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.493 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.494 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.494 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:15:21.494 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:15:21.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.494 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.494 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:21.494 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:15:21.494 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:15:21.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.494 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.494 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:21.494 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:15:21.494 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:15:21.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.494 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.495 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:21.495 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:15:21.495 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:15:21.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.495 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.495 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:21.495 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:15:21.495 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:15:21.495 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.495 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:21.495 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.495 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.495 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:21.496 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:21.496 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 84.041308396000005, 2024-04-26T11:15:21.496 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:15:21.496 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:21.496 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:21.496 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:21.496 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:21.496 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:21.496 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:15:21.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.496 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:21.496 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.496 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:21.496 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:21.496 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.497 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.497 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:21.497 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:21.497 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.497 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.497 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:21.497 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:15:21.497 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:21.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.497 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.497 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:21.497 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:15:21.497 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:15:21.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.498 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.498 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:21.498 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:15:21.498 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:15:21.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.498 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.498 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:21.498 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:15:21.498 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:15:21.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.498 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.498 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.498 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:15:21.498 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:15:21.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.499 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.499 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:21.499 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:15:21.499 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:15:21.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.499 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.499 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.499 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:15:21.499 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:15:21.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.499 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.499 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:21.499 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:15:21.499 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:15:21.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.500 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.500 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:21.500 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:15:21.500 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:15:21.500 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.500 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.500 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:21.500 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:15:21.500 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:15:21.500 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.500 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.500 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:21.500 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:15:21.500 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:15:21.500 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.501 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:21.501 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.501 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.501 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:21.501 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:21.501 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 84.037087393999997, 2024-04-26T11:15:21.501 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:15:21.501 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:21.501 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:21.501 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:21.501 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:21.501 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:21.501 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:15:21.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.502 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:21.502 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.502 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:21.502 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:21.502 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.502 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.502 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:21.502 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:21.502 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.502 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.502 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:21.502 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:15:21.502 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:15:21.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.503 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.503 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:21.503 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:15:21.503 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:15:21.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.503 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.503 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:21.503 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:15:21.503 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:15:21.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.503 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.503 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:21.503 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:15:21.503 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:15:21.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.504 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.504 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.504 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:15:21.504 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:15:21.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.504 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.504 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:21.504 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:15:21.504 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:15:21.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.504 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.504 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.504 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:15:21.505 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:15:21.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.505 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.505 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:21.505 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:15:21.505 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:15:21.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.505 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.505 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:21.505 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:15:21.505 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:15:21.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.505 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.505 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:21.505 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:15:21.506 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:15:21.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.506 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.506 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:21.506 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:15:21.506 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:15:21.506 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.506 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:21.506 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.506 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.506 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174388 5.c 5:312e5163:::benchmark_data_smithi029_44842_object29750:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:21.506 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:21.506 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 31.041261738999999, 2024-04-26T11:15:21.507 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.064002009999999998, 2024-04-26T11:15:21.507 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:21.507 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:21.507 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:21.507 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:21.507 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:21.507 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174388 2024-04-26T11:15:21.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.507 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:21.507 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.507 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:21.507 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:21.507 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.509 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.509 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:21.509 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:21.509 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.509 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.509 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:21.509 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348231+0000", 2024-04-26T11:15:21.509 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:21.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.510 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.510 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:21.510 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348233+0000", 2024-04-26T11:15:21.510 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2249999999999999e-06 2024-04-26T11:15:21.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.510 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.510 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:21.510 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348238+0000", 2024-04-26T11:15:21.510 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1899999999999997e-06 2024-04-26T11:15:21.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.510 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.510 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:21.510 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348241+0000", 2024-04-26T11:15:21.510 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.965e-06 2024-04-26T11:15:21.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.511 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.511 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.511 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348264+0000", 2024-04-26T11:15:21.511 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3014e-05 2024-04-26T11:15:21.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.511 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.511 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:21.511 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348371+0000", 2024-04-26T11:15:21.511 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000106889 2024-04-26T11:15:21.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.511 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.511 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:21.511 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412126+0000", 2024-04-26T11:15:21.511 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063755495999999995 2024-04-26T11:15:21.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.511 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.512 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:21.512 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412165+0000", 2024-04-26T11:15:21.512 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9269e-05 2024-04-26T11:15:21.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.512 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.512 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:21.512 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412234+0000", 2024-04-26T11:15:21.512 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8337000000000007e-05 2024-04-26T11:15:21.512 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.512 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:21.512 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.512 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.512 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174390 5.1 5:81c54fd7:::benchmark_data_smithi029_44842_object29752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:21.513 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:21.513 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 31.041146585, 2024-04-26T11:15:21.513 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063635918, 2024-04-26T11:15:21.513 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:21.513 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:21.513 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:21.513 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:21.513 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:21.513 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174390 2024-04-26T11:15:21.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.513 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:21.513 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.513 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:21.513 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:21.513 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.514 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.514 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:21.514 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:21.514 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.514 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.514 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:21.514 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348346+0000", 2024-04-26T11:15:21.514 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:21.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.514 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.514 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:21.514 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348351+0000", 2024-04-26T11:15:21.514 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.442e-06 2024-04-26T11:15:21.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.515 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.515 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:21.515 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348357+0000", 2024-04-26T11:15:21.515 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9530000000000002e-06 2024-04-26T11:15:21.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.515 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.515 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:21.515 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348363+0000", 2024-04-26T11:15:21.515 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2129999999999999e-06 2024-04-26T11:15:21.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.515 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.515 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.515 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348396+0000", 2024-04-26T11:15:21.515 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3161999999999999e-05 2024-04-26T11:15:21.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.516 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.516 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:21.516 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348511+0000", 2024-04-26T11:15:21.516 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000115253 2024-04-26T11:15:21.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.516 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.516 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:21.516 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411857+0000", 2024-04-26T11:15:21.516 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063345431999999993 2024-04-26T11:15:21.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.516 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.516 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:21.516 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411904+0000", 2024-04-26T11:15:21.516 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7389000000000003e-05 2024-04-26T11:15:21.517 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.517 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.517 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:21.517 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411983+0000", 2024-04-26T11:15:21.517 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8750000000000003e-05 2024-04-26T11:15:21.517 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.517 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:21.517 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.517 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.517 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.517 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174394 5.3 5:c91ce5cb:::benchmark_data_smithi029_44842_object29756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:21.517 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:21.517 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 31.041043641000002, 2024-04-26T11:15:21.517 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062247626, 2024-04-26T11:15:21.518 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:21.518 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:21.518 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:21.518 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:21.518 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:21.518 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174394 2024-04-26T11:15:21.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.518 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:21.518 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.518 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:21.518 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:21.518 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.518 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.519 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:21.519 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:21.519 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.519 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.519 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:21.519 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348449+0000", 2024-04-26T11:15:21.519 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:21.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.519 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.519 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:21.519 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348457+0000", 2024-04-26T11:15:21.519 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9619999999999993e-06 2024-04-26T11:15:21.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.519 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.520 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:21.520 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348462+0000", 2024-04-26T11:15:21.520 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6569999999999996e-06 2024-04-26T11:15:21.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.520 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.520 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:21.520 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348465+0000", 2024-04-26T11:15:21.520 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2990000000000001e-06 2024-04-26T11:15:21.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.520 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.520 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.520 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408427+0000", 2024-04-26T11:15:21.520 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.059961423 2024-04-26T11:15:21.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.520 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.521 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:21.521 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408554+0000", 2024-04-26T11:15:21.521 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012779600000000001 2024-04-26T11:15:21.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.521 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.521 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:21.521 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410570+0000", 2024-04-26T11:15:21.521 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020152719999999998 2024-04-26T11:15:21.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.521 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.521 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:21.521 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410624+0000", 2024-04-26T11:15:21.521 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4211e-05 2024-04-26T11:15:21.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.522 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.522 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:21.522 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410697+0000", 2024-04-26T11:15:21.522 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3447000000000003e-05 2024-04-26T11:15:21.522 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.522 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:21.522 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.522 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.522 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174395 5.1 5:8ee7f1d3:::benchmark_data_smithi029_44842_object29757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:21.522 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:21.522 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 31.040013550000001, 2024-04-26T11:15:21.522 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062622744999999994, 2024-04-26T11:15:21.522 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:21.523 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:21.523 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:21.523 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:21.523 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:21.523 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174395 2024-04-26T11:15:21.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.523 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:21.523 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.523 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:21.523 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:21.523 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.523 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.523 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:21.523 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:21.524 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.524 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.524 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:21.524 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349479+0000", 2024-04-26T11:15:21.524 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:21.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.524 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.524 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:21.524 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349483+0000", 2024-04-26T11:15:21.524 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.54e-06 2024-04-26T11:15:21.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.524 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.524 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:21.524 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349488+0000", 2024-04-26T11:15:21.525 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5119999999999999e-06 2024-04-26T11:15:21.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.525 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.525 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:21.525 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349492+0000", 2024-04-26T11:15:21.525 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7170000000000002e-06 2024-04-26T11:15:21.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.525 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.525 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.525 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350187+0000", 2024-04-26T11:15:21.525 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00069535899999999999 2024-04-26T11:15:21.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.525 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.525 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:21.525 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350292+0000", 2024-04-26T11:15:21.526 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0001047 2024-04-26T11:15:21.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.526 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.526 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:21.526 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411992+0000", 2024-04-26T11:15:21.526 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061699647000000003 2024-04-26T11:15:21.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.526 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.526 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:21.526 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412030+0000", 2024-04-26T11:15:21.526 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8124999999999998e-05 2024-04-26T11:15:21.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.526 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.526 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:21.526 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412103+0000", 2024-04-26T11:15:21.527 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2733999999999999e-05 2024-04-26T11:15:21.527 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.527 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:21.527 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.527 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.527 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174396 5.7 5:e0fad05d:::benchmark_data_smithi029_44842_object29758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:21.527 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:21.527 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 31.039929911000002, 2024-04-26T11:15:21.527 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062445026000000001, 2024-04-26T11:15:21.527 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:21.527 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:21.527 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:21.527 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:21.528 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:21.528 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174396 2024-04-26T11:15:21.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.528 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:21.528 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.528 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:21.528 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:21.528 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.528 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.528 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:21.528 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:21.528 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.528 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.528 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:21.529 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:21.529 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:21.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.529 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.529 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:21.529 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349566+0000", 2024-04-26T11:15:21.529 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2490000000000001e-06 2024-04-26T11:15:21.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.529 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.529 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:21.529 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349573+0000", 2024-04-26T11:15:21.529 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.776e-06 2024-04-26T11:15:21.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.529 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.530 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:21.530 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349576+0000", 2024-04-26T11:15:21.530 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3629999999999998e-06 2024-04-26T11:15:21.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.530 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.530 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.530 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350396+0000", 2024-04-26T11:15:21.530 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00081992199999999995 2024-04-26T11:15:21.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.530 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.530 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:21.530 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350516+0000", 2024-04-26T11:15:21.530 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012006900000000001 2024-04-26T11:15:21.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.531 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.531 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:21.531 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411924+0000", 2024-04-26T11:15:21.531 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061407960999999997 2024-04-26T11:15:21.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.531 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.531 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:21.531 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411947+0000", 2024-04-26T11:15:21.531 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2943999999999999e-05 2024-04-26T11:15:21.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.531 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.531 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:21.531 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412008+0000", 2024-04-26T11:15:21.531 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1237999999999999e-05 2024-04-26T11:15:21.531 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.532 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:21.532 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.532 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174397 5.7 5:e25daf9a:::benchmark_data_smithi029_44842_object29759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:21.532 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:21.532 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 31.039821782000001, 2024-04-26T11:15:21.532 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063878565999999998, 2024-04-26T11:15:21.532 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:21.532 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:21.532 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:21.532 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:21.532 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:21.532 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174397 2024-04-26T11:15:21.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.533 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:21.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:21.533 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:21.533 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:21.533 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:21.533 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.533 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:21.533 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349671+0000", 2024-04-26T11:15:21.534 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:21.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.534 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:21.534 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349674+0000", 2024-04-26T11:15:21.534 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3360000000000002e-06 2024-04-26T11:15:21.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.534 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:21.534 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349678+0000", 2024-04-26T11:15:21.534 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0709999999999996e-06 2024-04-26T11:15:21.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.534 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:21.534 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349681+0000", 2024-04-26T11:15:21.535 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3139999999999999e-06 2024-04-26T11:15:21.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.535 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.535 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.535 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410371+0000", 2024-04-26T11:15:21.535 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.060690202999999998 2024-04-26T11:15:21.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.535 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.535 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:21.535 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410463+0000", 2024-04-26T11:15:21.535 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2095000000000005e-05 2024-04-26T11:15:21.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.535 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.535 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:21.536 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413471+0000", 2024-04-26T11:15:21.536 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0030073909999999999 2024-04-26T11:15:21.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.536 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.536 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:21.536 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413499+0000", 2024-04-26T11:15:21.536 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8725e-05 2024-04-26T11:15:21.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.536 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.536 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:21.536 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413550+0000", 2024-04-26T11:15:21.536 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0810000000000003e-05 2024-04-26T11:15:21.536 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.536 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:21.536 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.537 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:174398 5.4 e46/16 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head v 46'10798, mlcod=46'10796)", 2024-04-26T11:15:21.537 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:21.537 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 31.039293571000002, 2024-04-26T11:15:21.537 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062067047, 2024-04-26T11:15:21.537 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:21.537 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:21.537 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:21.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.537 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:21.537 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:21.537 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.538 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:21.538 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:21.538 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:21.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.538 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:21.538 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350199+0000", 2024-04-26T11:15:21.538 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:21.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.538 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:21.538 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350205+0000", 2024-04-26T11:15:21.538 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6749999999999999e-06 2024-04-26T11:15:21.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.539 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:21.539 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350212+0000", 2024-04-26T11:15:21.539 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7000000000000002e-06 2024-04-26T11:15:21.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.539 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:21.539 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350216+0000", 2024-04-26T11:15:21.539 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5120000000000002e-06 2024-04-26T11:15:21.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.539 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:21.539 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350246+0000", 2024-04-26T11:15:21.539 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9978999999999999e-05 2024-04-26T11:15:21.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.540 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:21.540 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350263+0000", 2024-04-26T11:15:21.540 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.702e-05 2024-04-26T11:15:21.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.540 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:21.540 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412238+0000", 2024-04-26T11:15:21.540 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061974603000000003 2024-04-26T11:15:21.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:21.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:21.540 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:21.540 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412267+0000", 2024-04-26T11:15:21.540 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9116e-05 2024-04-26T11:15:21.540 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.541 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:21.541 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.541 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:21.541 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:21.541 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:21.541 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:15:21.543 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:21.544 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:21.541+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:21.643 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:21.641+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:21.692 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:15:21.713 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:15:21.714 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:15:21.714 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:15:21.714 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:15:21.715 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:15:21.715 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:15:21.718 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:21.718 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:21.732 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:21.738 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:15:21.776 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:21.774+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:21.845 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:21.843+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:21.905 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:21.905 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:21.918 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:21.959 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:21.957+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:22.047 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:22.045+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:22.125 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:22.125 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:22.139 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:22.182 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:22.180+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:22.250 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:22.248+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:22.321 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:22.321 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:22.337 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:22.350 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:22.348+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:22.451 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:22.449+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:22.552 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:22.551+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:22.563 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:22.563 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:22.579 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:22.654 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:22.652+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:22.757 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:22.753+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:22.800 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:22.800 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:22.815 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:22.859 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:22.857+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:22.956 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:22.954+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:22.985 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:22.986 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:22.999 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:23.057 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:23.055+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:23.158 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:23.156+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:23.210 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:23.210 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:23.224 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:23.268 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:23.266+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:23.360 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:23.358+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:23.399 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:23.399 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:23.413 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:23.461 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:23.459+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:23.561 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:23.559+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:23.600 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:23.601 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:23.617 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:23.662 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:23.661+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:23.717 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:15:23.751 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:15:23.763 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:23.761+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:23.843 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:23.844 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:23.859 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:23.889 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:15:23.900 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:23.898+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:23.914 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:15:23.914 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:15:23.915 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:15:23.915 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:15:23.917 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:15:23.918 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:15:23.967 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:23.964+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:24.066 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:24.064+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:24.084 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:24.084 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:15:24.084 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:15:24.084 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:15:24.084 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.084 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:24.084 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:24.084 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 90.809414833000005, 2024-04-26T11:15:24.084 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:15:24.084 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:24.084 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.085 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:24.085 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:24.085 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.085 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:15:24.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.085 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:24.085 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.085 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:24.085 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:24.085 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.085 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.085 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:24.085 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:24.086 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.086 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.086 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:24.086 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:15:24.086 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.086 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.086 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:24.086 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:15:24.086 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:15:24.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.086 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.086 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:24.087 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:15:24.087 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:15:24.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.087 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.087 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.087 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:15:24.087 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:15:24.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.087 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.087 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.087 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:15:24.087 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:15:24.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.087 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.087 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:24.088 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:15:24.088 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:15:24.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.088 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.088 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:24.088 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:15:24.088 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:15:24.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.088 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.088 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:24.088 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:15:24.088 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:15:24.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.088 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.089 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:24.089 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:15:24.089 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:15:24.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.089 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.089 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:24.089 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:15:24.089 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:15:24.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.089 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.089 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:24.089 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:15:24.089 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:15:24.089 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.089 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:24.090 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.090 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.090 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:24.090 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:24.090 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 90.808603267999999, 2024-04-26T11:15:24.090 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:15:24.090 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:24.090 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.090 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:24.090 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:24.090 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.090 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:15:24.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.091 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:24.091 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.091 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:24.091 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:24.091 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.091 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.091 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:24.091 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:24.091 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.091 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.091 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:24.091 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:24.092 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:24.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.092 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.092 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:24.092 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:15:24.092 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:15:24.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.092 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.092 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:24.092 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:15:24.092 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:15:24.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.092 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.092 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.092 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:15:24.093 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:15:24.093 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.093 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.093 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.093 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:15:24.093 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:15:24.093 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.093 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.093 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:24.093 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:15:24.093 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:15:24.093 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.094 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.094 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:24.094 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:15:24.094 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:15:24.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.094 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.094 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:24.094 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:15:24.094 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:15:24.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.094 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.094 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:24.094 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:15:24.094 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:15:24.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.095 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.095 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:24.095 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:15:24.095 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:15:24.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.095 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.095 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:24.095 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:15:24.095 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:15:24.095 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.095 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:24.095 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.095 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.096 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:24.096 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:24.096 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 90.801416431000007, 2024-04-26T11:15:24.096 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:15:24.096 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:24.096 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.096 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:24.096 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:24.096 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.096 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:15:24.096 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.096 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:24.096 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.096 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:24.096 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:24.097 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.097 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.097 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.097 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:24.097 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:24.097 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.097 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.097 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.097 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:24.097 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:15:24.097 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:24.097 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.097 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.098 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:24.098 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:15:24.098 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:15:24.098 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.098 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.098 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:24.098 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:15:24.098 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:15:24.098 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.098 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.098 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.098 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:15:24.098 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:15:24.098 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.098 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.099 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.099 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:15:24.099 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:15:24.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.099 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.099 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:24.099 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:15:24.099 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:15:24.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.099 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.099 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:24.099 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:15:24.099 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:15:24.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.099 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.100 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:24.100 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:15:24.100 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:15:24.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.100 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.100 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:24.100 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:15:24.100 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:15:24.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.100 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.100 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:24.100 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:15:24.100 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:15:24.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.101 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.101 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:24.101 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:15:24.101 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:15:24.101 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.101 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:24.101 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.101 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.101 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.101 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:24.101 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:24.101 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 90.800875551999994, 2024-04-26T11:15:24.101 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:15:24.101 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:24.101 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.102 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:24.102 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:24.102 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.102 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:15:24.102 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.102 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:24.102 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.102 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:24.102 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:24.102 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.102 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.102 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.102 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:24.102 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:15:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:15:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.103 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:24.104 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:15:24.104 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:15:24.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.104 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.104 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.104 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:15:24.104 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:15:24.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.104 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.104 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.104 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:15:24.104 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:15:24.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.104 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.104 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:24.105 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:15:24.105 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:15:24.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.105 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.105 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:24.105 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:15:24.105 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:15:24.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.105 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.105 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:24.105 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:15:24.105 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:15:24.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.105 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.105 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:15:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:15:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:15:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:15:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:15:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:15:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.106 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:24.107 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.107 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.107 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:24.107 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:24.107 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 86.757691105000006, 2024-04-26T11:15:24.107 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:15:24.107 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:24.107 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:24.107 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:24.107 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:24.107 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.107 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:15:24.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.107 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:15:24.108 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:15:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:15:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:15:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:15:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:15:24.109 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:15:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:15:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:15:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:15:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:15:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.110 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:15:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:15:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:15:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:15:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:15:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:15:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.111 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:15:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:15:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:15:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:15:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:15:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:15:24.112 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 86.755497765000001, 2024-04-26T11:15:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:15:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:15:24.113 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.114 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:15:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:15:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:15:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:15:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:15:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.115 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:15:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:15:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:15:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:15:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:15:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:15:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.116 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:24.117 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:15:24.117 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:15:24.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.117 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.117 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:24.117 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:15:24.117 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:15:24.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.117 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.117 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.117 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:15:24.117 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:15:24.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.117 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:15:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:15:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:15:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:15:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:15:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:15:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.118 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 86.750285941000001, 2024-04-26T11:15:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:15:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:15:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.119 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:24.120 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:15:24.121 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:24.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.121 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.121 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:24.121 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:15:24.121 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:15:24.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.121 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.121 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:24.121 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:15:24.121 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:15:24.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.121 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.121 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.121 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:15:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:15:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:15:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:15:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:15:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:15:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.122 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:15:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:15:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:15:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:15:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:15:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:15:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.123 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:15:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:15:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:15:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:15:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:15:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:15:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 86.733837241000003, 2024-04-26T11:15:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:15:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.125 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:15:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:24.126 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:15:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:15:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:15:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:15:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:15:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.127 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:15:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:15:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:15:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:15:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:15:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:15:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.128 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:15:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:15:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:15:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:15:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:24.129 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 86.732139735999993, 2024-04-26T11:15:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:15:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:15:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:24.130 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:15:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:15:24.131 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:15:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:15:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:15:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:15:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:15:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:15:24.132 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:15:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:15:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:15:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:15:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:15:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:15:24.133 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:15:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 86.732075433999995, 2024-04-26T11:15:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:15:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.134 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:15:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:24.135 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:15:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:15:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:15:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:15:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.136 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:15:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:15:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:15:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:15:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:15:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:15:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.137 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:15:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:15:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:15:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:15:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:15:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:15:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.138 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:15:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:15:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:15:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:15:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.139 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 86.732021209999999, 2024-04-26T11:15:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:15:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:15:24.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:24.141 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:15:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:15:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:15:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:15:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:15:24.142 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:15:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:15:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:15:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:15:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:15:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.143 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:15:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:15:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:15:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:15:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:15:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:15:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:24.144 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:15:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:15:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:15:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:15:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:24.145 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 86.731976697999997, 2024-04-26T11:15:24.146 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:15:24.146 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:24.146 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.146 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:24.146 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:24.146 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.146 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:15:24.146 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.146 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:24.146 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.146 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:15:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.147 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:15:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:15:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:15:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:15:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:15:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:15:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.148 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:15:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:15:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:15:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:15:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:15:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:15:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.149 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:15:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:15:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:15:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:15:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:15:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:15:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.150 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:15:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:15:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 86.727755696000003, 2024-04-26T11:15:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:15:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.151 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:15:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:24.152 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:15:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:15:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:15:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:15:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:15:24.153 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:15:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:15:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:15:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:15:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:15:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:15:24.154 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:15:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:15:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:15:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:15:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:15:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:15:24.155 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:15:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:15:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:15:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:15:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:15:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.156 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174388 5.c 5:312e5163:::benchmark_data_smithi029_44842_object29750:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 33.731930040999998, 2024-04-26T11:15:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.064002009999999998, 2024-04-26T11:15:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174388 2024-04-26T11:15:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.157 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348231+0000", 2024-04-26T11:15:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.158 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348233+0000", 2024-04-26T11:15:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2249999999999999e-06 2024-04-26T11:15:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348238+0000", 2024-04-26T11:15:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1899999999999997e-06 2024-04-26T11:15:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348241+0000", 2024-04-26T11:15:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.965e-06 2024-04-26T11:15:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.159 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348264+0000", 2024-04-26T11:15:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3014e-05 2024-04-26T11:15:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348371+0000", 2024-04-26T11:15:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000106889 2024-04-26T11:15:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412126+0000", 2024-04-26T11:15:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063755495999999995 2024-04-26T11:15:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.160 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412165+0000", 2024-04-26T11:15:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9269e-05 2024-04-26T11:15:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412234+0000", 2024-04-26T11:15:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8337000000000007e-05 2024-04-26T11:15:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174390 5.1 5:81c54fd7:::benchmark_data_smithi029_44842_object29752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:24.161 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 33.731814886999999, 2024-04-26T11:15:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063635918, 2024-04-26T11:15:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174390 2024-04-26T11:15:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348346+0000", 2024-04-26T11:15:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348351+0000", 2024-04-26T11:15:24.163 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.442e-06 2024-04-26T11:15:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348357+0000", 2024-04-26T11:15:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9530000000000002e-06 2024-04-26T11:15:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348363+0000", 2024-04-26T11:15:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2129999999999999e-06 2024-04-26T11:15:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348396+0000", 2024-04-26T11:15:24.164 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3161999999999999e-05 2024-04-26T11:15:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348511+0000", 2024-04-26T11:15:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000115253 2024-04-26T11:15:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411857+0000", 2024-04-26T11:15:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063345431999999993 2024-04-26T11:15:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411904+0000", 2024-04-26T11:15:24.165 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7389000000000003e-05 2024-04-26T11:15:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411983+0000", 2024-04-26T11:15:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8750000000000003e-05 2024-04-26T11:15:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174394 5.3 5:c91ce5cb:::benchmark_data_smithi029_44842_object29756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 33.731711943000001, 2024-04-26T11:15:24.166 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062247626, 2024-04-26T11:15:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174394 2024-04-26T11:15:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.167 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348449+0000", 2024-04-26T11:15:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.169 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348457+0000", 2024-04-26T11:15:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9619999999999993e-06 2024-04-26T11:15:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348462+0000", 2024-04-26T11:15:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6569999999999996e-06 2024-04-26T11:15:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348465+0000", 2024-04-26T11:15:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2990000000000001e-06 2024-04-26T11:15:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.170 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408427+0000", 2024-04-26T11:15:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.059961423 2024-04-26T11:15:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408554+0000", 2024-04-26T11:15:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012779600000000001 2024-04-26T11:15:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410570+0000", 2024-04-26T11:15:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020152719999999998 2024-04-26T11:15:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.171 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410624+0000", 2024-04-26T11:15:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4211e-05 2024-04-26T11:15:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410697+0000", 2024-04-26T11:15:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3447000000000003e-05 2024-04-26T11:15:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174395 5.1 5:8ee7f1d3:::benchmark_data_smithi029_44842_object29757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:24.172 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 33.730681852000004, 2024-04-26T11:15:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062622744999999994, 2024-04-26T11:15:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174395 2024-04-26T11:15:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349479+0000", 2024-04-26T11:15:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349483+0000", 2024-04-26T11:15:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.54e-06 2024-04-26T11:15:24.174 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349488+0000", 2024-04-26T11:15:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5119999999999999e-06 2024-04-26T11:15:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349492+0000", 2024-04-26T11:15:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7170000000000002e-06 2024-04-26T11:15:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350187+0000", 2024-04-26T11:15:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00069535899999999999 2024-04-26T11:15:24.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350292+0000", 2024-04-26T11:15:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0001047 2024-04-26T11:15:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411992+0000", 2024-04-26T11:15:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061699647000000003 2024-04-26T11:15:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412030+0000", 2024-04-26T11:15:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8124999999999998e-05 2024-04-26T11:15:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.176 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412103+0000", 2024-04-26T11:15:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2733999999999999e-05 2024-04-26T11:15:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174396 5.7 5:e0fad05d:::benchmark_data_smithi029_44842_object29758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 33.730598213, 2024-04-26T11:15:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062445026000000001, 2024-04-26T11:15:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:24.177 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174396 2024-04-26T11:15:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:24.178 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349566+0000", 2024-04-26T11:15:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2490000000000001e-06 2024-04-26T11:15:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349573+0000", 2024-04-26T11:15:24.179 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.776e-06 2024-04-26T11:15:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349576+0000", 2024-04-26T11:15:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3629999999999998e-06 2024-04-26T11:15:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350396+0000", 2024-04-26T11:15:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00081992199999999995 2024-04-26T11:15:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350516+0000", 2024-04-26T11:15:24.180 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012006900000000001 2024-04-26T11:15:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411924+0000", 2024-04-26T11:15:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061407960999999997 2024-04-26T11:15:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411947+0000", 2024-04-26T11:15:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2943999999999999e-05 2024-04-26T11:15:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412008+0000", 2024-04-26T11:15:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1237999999999999e-05 2024-04-26T11:15:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174397 5.7 5:e25daf9a:::benchmark_data_smithi029_44842_object29759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 33.730490084000003, 2024-04-26T11:15:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063878565999999998, 2024-04-26T11:15:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:24.182 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174397 2024-04-26T11:15:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:24.183 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349671+0000", 2024-04-26T11:15:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349674+0000", 2024-04-26T11:15:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3360000000000002e-06 2024-04-26T11:15:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349678+0000", 2024-04-26T11:15:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0709999999999996e-06 2024-04-26T11:15:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.184 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349681+0000", 2024-04-26T11:15:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3139999999999999e-06 2024-04-26T11:15:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410371+0000", 2024-04-26T11:15:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.060690202999999998 2024-04-26T11:15:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410463+0000", 2024-04-26T11:15:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2095000000000005e-05 2024-04-26T11:15:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413471+0000", 2024-04-26T11:15:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0030073909999999999 2024-04-26T11:15:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413499+0000", 2024-04-26T11:15:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8725e-05 2024-04-26T11:15:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413550+0000", 2024-04-26T11:15:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0810000000000003e-05 2024-04-26T11:15:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:24.186 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:174398 5.4 e46/16 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head v 46'10798, mlcod=46'10796)", 2024-04-26T11:15:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 33.729961873000001, 2024-04-26T11:15:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062067047, 2024-04-26T11:15:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.187 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350199+0000", 2024-04-26T11:15:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350205+0000", 2024-04-26T11:15:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6749999999999999e-06 2024-04-26T11:15:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.188 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350212+0000", 2024-04-26T11:15:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7000000000000002e-06 2024-04-26T11:15:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350216+0000", 2024-04-26T11:15:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5120000000000002e-06 2024-04-26T11:15:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350246+0000", 2024-04-26T11:15:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9978999999999999e-05 2024-04-26T11:15:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.189 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350263+0000", 2024-04-26T11:15:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.702e-05 2024-04-26T11:15:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412238+0000", 2024-04-26T11:15:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061974603000000003 2024-04-26T11:15:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412267+0000", 2024-04-26T11:15:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9116e-05 2024-04-26T11:15:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.190 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:24.191 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:24.191 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:24.192 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:24.193 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:24.190+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:24.293 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:24.291+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:24.362 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:24.362 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:15:24.362 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.362 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:266030 5.a 5:5cea53e2:::benchmark_data_smithi029_44842_object121392:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T11:15:24.362 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:24.359992+0000", 2024-04-26T11:15:24.362 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00044649000000000002, 2024-04-26T11:15:24.362 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00047064200000000001, 2024-04-26T11:15:24.362 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.362 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:24.363 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.363 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.363 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.363 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 266030 2024-04-26T11:15:24.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.363 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.359992+0000", 2024-04-26T11:15:24.363 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.363 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.363 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.363 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.363 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.359992+0000", 2024-04-26T11:15:24.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.359991+0000", 2024-04-26T11:15:24.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:24.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.359995+0000", 2024-04-26T11:15:24.364 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9500000000000003e-06 2024-04-26T11:15:24.364 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.364 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.364 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.364 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.360003+0000", 2024-04-26T11:15:24.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2899999999999997e-06 2024-04-26T11:15:24.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.360010+0000", 2024-04-26T11:15:24.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9639999999999997e-06 2024-04-26T11:15:24.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.365 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.360036+0000", 2024-04-26T11:15:24.365 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6758999999999999e-05 2024-04-26T11:15:24.365 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.365 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.365 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.360146+0000", 2024-04-26T11:15:24.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010991 2024-04-26T11:15:24.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.366 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:24.366 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.360259+0000", 2024-04-26T11:15:24.366 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011228 2024-04-26T11:15:24.366 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.366 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.366 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.366 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.366 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.366 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:266033 5.0 5:0bf81db0:::benchmark_data_smithi029_44842_object121395:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T11:15:24.366 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:24.360022+0000", 2024-04-26T11:15:24.366 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.000416191, 2024-04-26T11:15:24.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00052147599999999999, 2024-04-26T11:15:24.367 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.367 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:24.367 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.367 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.367 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.367 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 266033 2024-04-26T11:15:24.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.367 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.367 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.367 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.360022+0000", 2024-04-26T11:15:24.367 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.367 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.367 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.360022+0000", 2024-04-26T11:15:24.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.360022+0000", 2024-04-26T11:15:24.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.368 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.368 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.368 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.360025+0000", 2024-04-26T11:15:24.368 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9160000000000001e-06 2024-04-26T11:15:24.368 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.360035+0000", 2024-04-26T11:15:24.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.045e-05 2024-04-26T11:15:24.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.360041+0000", 2024-04-26T11:15:24.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1319999999999999e-06 2024-04-26T11:15:24.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.369 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.369 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.369 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.360071+0000", 2024-04-26T11:15:24.369 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9937000000000002e-05 2024-04-26T11:15:24.369 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.360176+0000", 2024-04-26T11:15:24.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104949 2024-04-26T11:15:24.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.370 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:24.370 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.360276+0000", 2024-04-26T11:15:24.370 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9366999999999999e-05 2024-04-26T11:15:24.370 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.370 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.370 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.370 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.370 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.371 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:266034 5.e 5:7e44af0e:::benchmark_data_smithi029_44842_object121396:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T11:15:24.371 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:24.360048+0000", 2024-04-26T11:15:24.371 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00039025099999999999, 2024-04-26T11:15:24.371 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00056794600000000005, 2024-04-26T11:15:24.371 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.371 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:24.371 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.371 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.371 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.371 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 266034 2024-04-26T11:15:24.371 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.371 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.371 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.371 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.360048+0000", 2024-04-26T11:15:24.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.360048+0000", 2024-04-26T11:15:24.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.360048+0000", 2024-04-26T11:15:24.372 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.372 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.372 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.372 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.372 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.360050+0000", 2024-04-26T11:15:24.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5849999999999998e-06 2024-04-26T11:15:24.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.360057+0000", 2024-04-26T11:15:24.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2609999999999999e-06 2024-04-26T11:15:24.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.373 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.373 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.360062+0000", 2024-04-26T11:15:24.373 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6919999999999999e-06 2024-04-26T11:15:24.373 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.373 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.360095+0000", 2024-04-26T11:15:24.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2931e-05 2024-04-26T11:15:24.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.360170+0000", 2024-04-26T11:15:24.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4295000000000006e-05 2024-04-26T11:15:24.374 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.374 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.374 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:24.374 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.360232+0000", 2024-04-26T11:15:24.374 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2800999999999997e-05 2024-04-26T11:15:24.374 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.374 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.375 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.375 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.375 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:266019 5.b 5:df93a87b:::benchmark_data_smithi029_44842_object121381:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T11:15:24.375 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:24.355303+0000", 2024-04-26T11:15:24.375 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0051360829999999996, 2024-04-26T11:15:24.375 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0053859989999999998, 2024-04-26T11:15:24.375 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.375 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:24.375 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.375 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.375 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.375 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 266019 2024-04-26T11:15:24.375 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.376 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.355303+0000", 2024-04-26T11:15:24.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.355303+0000", 2024-04-26T11:15:24.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.376 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.376 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.376 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.376 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.355302+0000", 2024-04-26T11:15:24.376 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.355306+0000", 2024-04-26T11:15:24.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6950000000000002e-06 2024-04-26T11:15:24.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.355313+0000", 2024-04-26T11:15:24.377 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3860000000000001e-06 2024-04-26T11:15:24.377 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.377 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.377 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.377 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.355319+0000", 2024-04-26T11:15:24.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4930000000000003e-06 2024-04-26T11:15:24.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.355348+0000", 2024-04-26T11:15:24.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8411999999999998e-05 2024-04-26T11:15:24.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.378 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.355424+0000", 2024-04-26T11:15:24.378 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.572e-05 2024-04-26T11:15:24.378 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.378 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.378 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:24.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.355487+0000", 2024-04-26T11:15:24.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3065999999999996e-05 2024-04-26T11:15:24.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.379 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:24.379 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.360679+0000", 2024-04-26T11:15:24.379 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0051926419999999999 2024-04-26T11:15:24.379 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.379 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.379 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.379 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.379 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.379 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:266022 5.9 5:9c70c1a9:::benchmark_data_smithi029_44842_object121384:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T11:15:24.379 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:24.356175+0000", 2024-04-26T11:15:24.380 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0042638830000000004, 2024-04-26T11:15:24.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0045917379999999997, 2024-04-26T11:15:24.380 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.380 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:24.380 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.380 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.380 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.380 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 266022 2024-04-26T11:15:24.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.380 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.380 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.380 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.380 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.356175+0000", 2024-04-26T11:15:24.380 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.380 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.356175+0000", 2024-04-26T11:15:24.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.356174+0000", 2024-04-26T11:15:24.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.381 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.381 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.381 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.381 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.356178+0000", 2024-04-26T11:15:24.381 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1219999999999997e-06 2024-04-26T11:15:24.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.356187+0000", 2024-04-26T11:15:24.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8340000000000005e-06 2024-04-26T11:15:24.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.356194+0000", 2024-04-26T11:15:24.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2139999999999999e-06 2024-04-26T11:15:24.382 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.382 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.382 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.382 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.356235+0000", 2024-04-26T11:15:24.382 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0701999999999998e-05 2024-04-26T11:15:24.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.383 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.383 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.356368+0000", 2024-04-26T11:15:24.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013324100000000001 2024-04-26T11:15:24.383 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.383 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.383 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.383 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.383 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.383 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:266023 5.a 5:5066fce8:::benchmark_data_smithi029_44842_object121385:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T11:15:24.383 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:24.357233+0000", 2024-04-26T11:15:24.383 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0032057370000000002, 2024-04-26T11:15:24.383 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0035982509999999998, 2024-04-26T11:15:24.383 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.383 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:24.384 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.384 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.384 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.384 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 266023 2024-04-26T11:15:24.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.384 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357233+0000", 2024-04-26T11:15:24.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.384 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.384 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.384 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.384 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357233+0000", 2024-04-26T11:15:24.384 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357232+0000", 2024-04-26T11:15:24.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357236+0000", 2024-04-26T11:15:24.385 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6859999999999999e-06 2024-04-26T11:15:24.385 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.385 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.385 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.385 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357245+0000", 2024-04-26T11:15:24.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9209999999999998e-06 2024-04-26T11:15:24.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357251+0000", 2024-04-26T11:15:24.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4819999999999999e-06 2024-04-26T11:15:24.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357294+0000", 2024-04-26T11:15:24.386 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3016999999999998e-05 2024-04-26T11:15:24.386 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.386 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.386 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.386 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357408+0000", 2024-04-26T11:15:24.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113224 2024-04-26T11:15:24.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.387 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:24.387 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357510+0000", 2024-04-26T11:15:24.387 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000102309 2024-04-26T11:15:24.387 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.387 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.387 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.387 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.387 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.387 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:266025 5.0 5:0b5ecf81:::benchmark_data_smithi029_44842_object121387:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T11:15:24.387 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:24.357265+0000", 2024-04-26T11:15:24.387 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.003174091, 2024-04-26T11:15:24.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036372610000000001, 2024-04-26T11:15:24.388 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.388 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:24.388 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.388 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.388 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.388 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 266025 2024-04-26T11:15:24.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.388 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.388 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.388 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.388 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357265+0000", 2024-04-26T11:15:24.388 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.388 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357265+0000", 2024-04-26T11:15:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357264+0000", 2024-04-26T11:15:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357267+0000", 2024-04-26T11:15:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.796e-06 2024-04-26T11:15:24.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357279+0000", 2024-04-26T11:15:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2483999999999999e-05 2024-04-26T11:15:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357286+0000", 2024-04-26T11:15:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3060000000000003e-06 2024-04-26T11:15:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357326+0000", 2024-04-26T11:15:24.390 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0200000000000001e-05 2024-04-26T11:15:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357445+0000", 2024-04-26T11:15:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011949499999999999 2024-04-26T11:15:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357560+0000", 2024-04-26T11:15:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011500100000000001 2024-04-26T11:15:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:266026 5.f 5:f843cb04:::benchmark_data_smithi029_44842_object121388:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T11:15:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:24.357296+0000", 2024-04-26T11:15:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.003142574, 2024-04-26T11:15:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003678265, 2024-04-26T11:15:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 266026 2024-04-26T11:15:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.392 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357296+0000", 2024-04-26T11:15:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357296+0000", 2024-04-26T11:15:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357296+0000", 2024-04-26T11:15:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.393 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357298+0000", 2024-04-26T11:15:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8140000000000001e-06 2024-04-26T11:15:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357306+0000", 2024-04-26T11:15:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8050000000000007e-06 2024-04-26T11:15:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357312+0000", 2024-04-26T11:15:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5280000000000003e-06 2024-04-26T11:15:24.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357340+0000", 2024-04-26T11:15:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7954999999999999e-05 2024-04-26T11:15:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357456+0000", 2024-04-26T11:15:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011669500000000001 2024-04-26T11:15:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.395 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:266027 5.8 5:1b11579d:::benchmark_data_smithi029_44842_object121389:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T11:15:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:24.357509+0000", 2024-04-26T11:15:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.002929601, 2024-04-26T11:15:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003529852, 2024-04-26T11:15:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 266027 2024-04-26T11:15:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.396 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357509+0000", 2024-04-26T11:15:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357509+0000", 2024-04-26T11:15:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357508+0000", 2024-04-26T11:15:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.397 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357512+0000", 2024-04-26T11:15:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5580000000000001e-06 2024-04-26T11:15:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357520+0000", 2024-04-26T11:15:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1329999999999999e-06 2024-04-26T11:15:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357526+0000", 2024-04-26T11:15:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8309999999999997e-06 2024-04-26T11:15:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.398 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357557+0000", 2024-04-26T11:15:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.129e-05 2024-04-26T11:15:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357666+0000", 2024-04-26T11:15:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000109244 2024-04-26T11:15:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:24.357771+0000", 2024-04-26T11:15:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104947 2024-04-26T11:15:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.399 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.400 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.400 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:15:24.400 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 9 2024-04-26T11:15:24.400 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:24.401 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:24.402 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:24.399+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:24.502 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:24.501+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:24.603 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:24.601+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:24.610 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:24.611 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:15:24.611 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:15:24.611 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:15:24.611 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:24.625 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:24.710 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:24.709+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:24.745 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:15:24.805 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:24.803+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:24.840 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:24.840 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:15:24.840 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:15:24.840 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:15:24.840 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.841 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:24.841 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:24.841 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.558339431999997, 2024-04-26T11:15:24.841 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:15:24.841 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.841 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.841 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.841 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.841 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.841 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:15:24.841 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.841 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.841 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.841 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.841 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:24.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:24.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.842 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.842 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:24.842 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.842 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.842 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:15:24.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:15:24.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:15:24.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:15:24.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.843 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.843 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.843 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:15:24.843 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:15:24.843 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:15:24.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:15:24.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:15:24.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:15:24.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.844 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.844 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:24.844 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:15:24.844 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:15:24.844 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:24.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:15:24.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:15:24.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:24.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:15:24.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:15:24.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.845 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.845 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:24.845 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:15:24.845 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:15:24.845 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.846 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:24.846 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:15:24.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:15:24.846 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.846 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.846 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.846 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.846 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.846 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:24.846 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:24.846 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.557689730000007, 2024-04-26T11:15:24.846 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:15:24.846 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.847 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.847 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.847 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.847 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.847 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:15:24.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.847 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:24.847 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.847 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.847 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.847 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.847 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:24.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:15:24.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:24.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:15:24.848 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:15:24.848 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.848 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.848 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.848 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:15:24.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:15:24.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:15:24.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:15:24.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:15:24.849 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:15:24.849 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.849 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.849 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.849 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:15:24.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:15:24.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:24.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:15:24.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:15:24.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:24.850 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:15:24.850 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:15:24.850 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.850 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.850 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:24.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:15:24.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:15:24.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:24.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:15:24.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:15:24.851 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.851 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.851 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:24.851 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:15:24.851 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:15:24.851 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.851 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.851 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.852 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:24.852 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:24.852 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 87.491047691000006, 2024-04-26T11:15:24.852 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:15:24.852 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.852 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:24.852 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.852 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.852 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.852 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:15:24.852 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.852 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.852 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:24.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:24.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.853 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.853 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.853 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:15:24.853 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:24.853 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:15:24.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:15:24.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:15:24.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:15:24.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.854 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.854 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.854 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:15:24.854 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:15:24.854 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:15:24.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:15:24.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:24.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:15:24.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:15:24.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.855 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.855 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.855 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:15:24.855 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:15:24.855 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.856 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:24.856 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:15:24.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:15:24.856 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.856 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.856 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.856 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.856 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.856 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:24.856 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:24.856 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 87.490952045, 2024-04-26T11:15:24.856 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:15:24.856 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.856 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:24.857 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.857 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.857 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.857 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:15:24.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.857 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:24.857 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.857 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.857 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.857 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.857 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:24.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:15:24.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:15:24.858 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:15:24.858 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.858 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.858 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.858 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:15:24.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:15:24.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:15:24.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:15:24.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:15:24.859 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:15:24.859 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.859 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.859 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:24.859 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:15:24.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:15:24.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:15:24.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:15:24.860 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.860 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.860 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:24.860 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:15:24.860 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:15:24.860 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.860 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.860 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.861 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:24.861 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:24.861 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 87.490820365999994, 2024-04-26T11:15:24.861 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:15:24.861 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.861 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:24.861 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.861 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.861 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.861 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:15:24.861 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.861 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.861 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:24.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:24.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.862 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.862 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:24.862 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.862 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.862 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:15:24.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:15:24.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:15:24.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:15:24.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.863 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.863 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:15:24.863 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:15:24.863 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.863 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:15:24.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:15:24.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:24.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:15:24.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:15:24.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.864 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.864 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:15:24.864 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:15:24.864 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.864 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.865 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:24.865 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:15:24.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:15:24.865 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.865 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.865 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.865 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.865 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.865 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:24.865 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:24.865 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 87.490711910000002, 2024-04-26T11:15:24.865 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:15:24.865 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.865 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:24.865 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.866 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.866 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.866 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:15:24.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.866 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:24.866 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.866 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.866 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.866 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.866 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:24.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:15:24.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:24.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.867 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:15:24.867 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:15:24.867 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.867 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.867 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:15:24.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:15:24.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:15:24.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:15:24.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.868 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:15:24.868 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:15:24.868 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.868 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.868 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:24.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:15:24.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:15:24.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:15:24.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:15:24.869 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.869 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.869 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:24.869 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:15:24.869 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:15:24.869 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.869 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.869 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.870 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:24.870 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:24.870 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 87.490610641999993, 2024-04-26T11:15:24.870 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:15:24.870 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.870 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.870 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.870 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.870 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.870 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:15:24.870 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.870 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.870 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:24.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:24.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.871 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.871 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:24.871 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.871 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.871 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:15:24.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:15:24.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:15:24.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:15:24.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.872 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.872 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.872 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:15:24.872 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:15:24.872 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:15:24.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:15:24.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:24.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:15:24.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:15:24.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.873 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.873 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.873 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:15:24.873 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:15:24.873 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:15:24.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:15:24.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:24.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:15:24.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:15:24.874 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.874 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.874 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:24.874 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:15:24.874 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:15:24.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.875 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:24.875 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:15:24.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:15:24.875 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.875 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.875 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.875 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.875 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.875 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:24.875 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:24.875 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 87.490541700999998, 2024-04-26T11:15:24.875 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:15:24.875 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.876 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.876 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.876 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.876 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.876 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:15:24.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.876 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:24.876 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.876 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.876 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.876 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.876 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:24.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:15:24.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:15:24.877 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:15:24.877 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.877 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.877 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.877 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:15:24.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:15:24.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:15:24.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:15:24.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:15:24.878 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:15:24.878 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.878 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.878 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:24.878 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:15:24.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:15:24.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:15:24.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:15:24.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.879 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:15:24.879 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:15:24.879 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.879 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.879 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:24.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:15:24.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:15:24.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:24.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:15:24.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:15:24.880 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.880 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.880 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:24.880 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:15:24.880 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:15:24.880 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.880 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.880 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.881 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:24.881 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:24.881 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 87.484546120000005, 2024-04-26T11:15:24.881 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:15:24.881 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.881 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.881 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.881 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.881 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.881 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:15:24.881 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.881 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.881 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:24.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:24.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.882 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.882 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.882 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:15:24.882 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.882 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:15:24.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:15:24.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:15:24.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:15:24.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.883 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.883 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.883 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:15:24.883 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:15:24.883 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:15:24.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:15:24.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:24.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:15:24.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:15:24.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.884 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.884 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.884 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:15:24.884 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:15:24.884 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:15:24.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:15:24.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:24.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:15:24.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:15:24.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.885 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.885 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:24.885 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:15:24.885 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:15:24.885 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.886 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:24.886 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:15:24.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:15:24.886 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.886 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.886 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.886 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.886 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.886 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101754 5.e 5:7ca15a5c:::benchmark_data_smithi029_44842_object101753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:24.886 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:24.886 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.718598377999996, 2024-04-26T11:15:24.886 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039171048999999999, 2024-04-26T11:15:24.886 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.887 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.887 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.887 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.887 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.887 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101754 2024-04-26T11:15:24.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.887 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:24.887 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.887 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.887 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.887 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.887 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:24.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118531+0000", 2024-04-26T11:15:24.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118604+0000", 2024-04-26T11:15:24.888 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3399000000000007e-05 2024-04-26T11:15:24.888 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.888 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.888 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.888 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118613+0000", 2024-04-26T11:15:24.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6989999999999992e-06 2024-04-26T11:15:24.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118618+0000", 2024-04-26T11:15:24.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3850000000000001e-06 2024-04-26T11:15:24.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118646+0000", 2024-04-26T11:15:24.889 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7878e-05 2024-04-26T11:15:24.889 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.889 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.889 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.889 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118720+0000", 2024-04-26T11:15:24.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3461999999999996e-05 2024-04-26T11:15:24.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:24.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118807+0000", 2024-04-26T11:15:24.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7269999999999996e-05 2024-04-26T11:15:24.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:24.890 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142317+0000", 2024-04-26T11:15:24.890 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.023510105999999999 2024-04-26T11:15:24.890 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.890 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.890 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:24.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.143287+0000", 2024-04-26T11:15:24.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00096983599999999996 2024-04-26T11:15:24.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:24.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157662+0000", 2024-04-26T11:15:24.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014375393 2024-04-26T11:15:24.891 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.891 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.891 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:24.891 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157702+0000", 2024-04-26T11:15:24.891 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0295e-05 2024-04-26T11:15:24.891 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.891 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.891 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.892 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101755 5.f 5:fa973a83:::benchmark_data_smithi029_44842_object101754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:24.892 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:15:24.892 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.718432682, 2024-04-26T11:15:24.892 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039139064000000001, 2024-04-26T11:15:24.892 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.892 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.892 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.892 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.892 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.892 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101755 2024-04-26T11:15:24.892 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.892 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.892 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:15:24.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118697+0000", 2024-04-26T11:15:24.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.893 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.893 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.893 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118696+0000", 2024-04-26T11:15:24.893 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.893 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118766+0000", 2024-04-26T11:15:24.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9423000000000003e-05 2024-04-26T11:15:24.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118774+0000", 2024-04-26T11:15:24.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9710000000000004e-06 2024-04-26T11:15:24.894 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.894 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.894 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.894 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118779+0000", 2024-04-26T11:15:24.894 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5629999999999999e-06 2024-04-26T11:15:24.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118817+0000", 2024-04-26T11:15:24.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7771000000000001e-05 2024-04-26T11:15:24.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.118929+0000", 2024-04-26T11:15:24.895 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011222699999999999 2024-04-26T11:15:24.895 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.895 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.895 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:24.895 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157661+0000", 2024-04-26T11:15:24.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.038731120000000001 2024-04-26T11:15:24.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:24.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157757+0000", 2024-04-26T11:15:24.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6910000000000006e-05 2024-04-26T11:15:24.896 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.896 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.896 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:24.896 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157836+0000", 2024-04-26T11:15:24.896 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8727999999999996e-05 2024-04-26T11:15:24.896 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.896 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.897 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.897 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.897 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101758 5.4 5:2525a4eb:::benchmark_data_smithi029_44842_object101757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:24.897 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:15:24.897 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.716249830999999, 2024-04-26T11:15:24.897 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.03686739, 2024-04-26T11:15:24.897 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.897 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.897 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.897 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.897 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.897 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101758 2024-04-26T11:15:24.897 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.897 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:15:24.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120880+0000", 2024-04-26T11:15:24.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.898 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.898 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.898 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120879+0000", 2024-04-26T11:15:24.898 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.898 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120971+0000", 2024-04-26T11:15:24.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2133999999999996e-05 2024-04-26T11:15:24.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120977+0000", 2024-04-26T11:15:24.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5509999999999999e-06 2024-04-26T11:15:24.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.899 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.899 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.120981+0000", 2024-04-26T11:15:24.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.245e-06 2024-04-26T11:15:24.899 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121010+0000", 2024-04-26T11:15:24.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9084000000000001e-05 2024-04-26T11:15:24.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121083+0000", 2024-04-26T11:15:24.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2942999999999996e-05 2024-04-26T11:15:24.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.900 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:24.900 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121163+0000", 2024-04-26T11:15:24.900 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0197000000000005e-05 2024-04-26T11:15:24.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:24.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142822+0000", 2024-04-26T11:15:24.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.021658535999999999 2024-04-26T11:15:24.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:24.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157674+0000", 2024-04-26T11:15:24.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.014851573999999999 2024-04-26T11:15:24.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:24.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157714+0000", 2024-04-26T11:15:24.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0473999999999999e-05 2024-04-26T11:15:24.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:24.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157747+0000", 2024-04-26T11:15:24.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3278999999999998e-05 2024-04-26T11:15:24.902 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.902 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.902 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.902 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.902 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.902 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101760 5.4 5:2510211a:::benchmark_data_smithi029_44842_object101759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:24.902 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:24.902 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.715817486000006, 2024-04-26T11:15:24.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.039182383000000001, 2024-04-26T11:15:24.902 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.903 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.903 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.903 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.903 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.903 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101760 2024-04-26T11:15:24.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.903 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:24.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:24.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121312+0000", 2024-04-26T11:15:24.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121389+0000", 2024-04-26T11:15:24.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6667000000000003e-05 2024-04-26T11:15:24.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.904 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.904 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121394+0000", 2024-04-26T11:15:24.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0839999999999999e-06 2024-04-26T11:15:24.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.121397+0000", 2024-04-26T11:15:24.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4489999999999999e-06 2024-04-26T11:15:24.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122921+0000", 2024-04-26T11:15:24.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001524067 2024-04-26T11:15:24.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.123010+0000", 2024-04-26T11:15:24.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8449000000000006e-05 2024-04-26T11:15:24.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:24.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.140838+0000", 2024-04-26T11:15:24.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.017828796000000001 2024-04-26T11:15:24.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:24.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157665+0000", 2024-04-26T11:15:24.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.016826574 2024-04-26T11:15:24.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:24.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160407+0000", 2024-04-26T11:15:24.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027423970000000002 2024-04-26T11:15:24.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:24.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160456+0000", 2024-04-26T11:15:24.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8678999999999999e-05 2024-04-26T11:15:24.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:24.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.160495+0000", 2024-04-26T11:15:24.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8658000000000002e-05 2024-04-26T11:15:24.907 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.907 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.907 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.908 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:101761 5.e 5:70294421:::benchmark_data_smithi029_44842_object101760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-26T11:15:24.908 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:15:24.908 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 65.714393113, 2024-04-26T11:15:24.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.035270448000000003, 2024-04-26T11:15:24.908 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.908 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.908 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.908 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.908 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.908 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 101761 2024-04-26T11:15:24.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.908 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:15:24.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122737+0000", 2024-04-26T11:15:24.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122736+0000", 2024-04-26T11:15:24.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122805+0000", 2024-04-26T11:15:24.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9076000000000001e-05 2024-04-26T11:15:24.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122811+0000", 2024-04-26T11:15:24.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8390000000000003e-06 2024-04-26T11:15:24.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122815+0000", 2024-04-26T11:15:24.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2860000000000001e-06 2024-04-26T11:15:24.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122842+0000", 2024-04-26T11:15:24.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6429000000000001e-05 2024-04-26T11:15:24.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122916+0000", 2024-04-26T11:15:24.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4122999999999995e-05 2024-04-26T11:15:24.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:24.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.122997+0000", 2024-04-26T11:15:24.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1428999999999996e-05 2024-04-26T11:15:24.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:24.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.142344+0000", 2024-04-26T11:15:24.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.019346452 2024-04-26T11:15:24.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:24.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157934+0000", 2024-04-26T11:15:24.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.015589911999999999 2024-04-26T11:15:24.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.912 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:24.912 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.157975+0000", 2024-04-26T11:15:24.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1604999999999999e-05 2024-04-26T11:15:24.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:24.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:19.158007+0000", 2024-04-26T11:15:24.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1921000000000002e-05 2024-04-26T11:15:24.913 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.913 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.913 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.913 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110145 5.9 5:9b275f16:::benchmark_data_smithi029_44842_object110144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:15:24.913 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:15:24.913 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 61.688831475000001, 2024-04-26T11:15:24.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.032844496000000001, 2024-04-26T11:15:24.913 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.913 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.914 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.914 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.914 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.914 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110145 2024-04-26T11:15:24.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.914 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:15:24.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148298+0000", 2024-04-26T11:15:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148297+0000", 2024-04-26T11:15:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148325+0000", 2024-04-26T11:15:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7511000000000001e-05 2024-04-26T11:15:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148338+0000", 2024-04-26T11:15:24.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2808e-05 2024-04-26T11:15:24.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.148345+0000", 2024-04-26T11:15:24.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7200000000000006e-06 2024-04-26T11:15:24.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149888+0000", 2024-04-26T11:15:24.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001542666 2024-04-26T11:15:24.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.149977+0000", 2024-04-26T11:15:24.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9247999999999997e-05 2024-04-26T11:15:24.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:24.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181006+0000", 2024-04-26T11:15:24.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.031028535999999999 2024-04-26T11:15:24.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:24.917 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181051+0000", 2024-04-26T11:15:24.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5393999999999999e-05 2024-04-26T11:15:24.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.917 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:24.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181143+0000", 2024-04-26T11:15:24.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1458000000000004e-05 2024-04-26T11:15:24.918 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.918 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.918 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.918 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:110155 5.9 5:9ebc6158:::benchmark_data_smithi029_44842_object110154:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T11:15:24.918 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:15:24.918 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 61.683755683000001, 2024-04-26T11:15:24.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027886826999999999, 2024-04-26T11:15:24.918 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.918 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.918 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.919 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.919 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.919 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 110155 2024-04-26T11:15:24.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.919 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:15:24.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153374+0000", 2024-04-26T11:15:24.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153373+0000", 2024-04-26T11:15:24.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153479+0000", 2024-04-26T11:15:24.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000105728 2024-04-26T11:15:24.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153491+0000", 2024-04-26T11:15:24.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2207e-05 2024-04-26T11:15:24.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153499+0000", 2024-04-26T11:15:24.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7729999999999999e-06 2024-04-26T11:15:24.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153655+0000", 2024-04-26T11:15:24.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015573 2024-04-26T11:15:24.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.921 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.153770+0000", 2024-04-26T11:15:24.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011562500000000001 2024-04-26T11:15:24.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:24.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181153+0000", 2024-04-26T11:15:24.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.027382113 2024-04-26T11:15:24.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:24.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181195+0000", 2024-04-26T11:15:24.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1921000000000001e-05 2024-04-26T11:15:24.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:24.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:23.181261+0000", 2024-04-26T11:15:24.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6402999999999994e-05 2024-04-26T11:15:24.922 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.923 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.923 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.923 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174398 5.4 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:24.923 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:24.923 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.487239471000002, 2024-04-26T11:15:24.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.064773789999999998, 2024-04-26T11:15:24.923 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.923 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.923 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.923 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.923 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.923 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174398 2024-04-26T11:15:24.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.924 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:24.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:24.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349889+0000", 2024-04-26T11:15:24.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:24.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349895+0000", 2024-04-26T11:15:24.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4519999999999996e-06 2024-04-26T11:15:24.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349909+0000", 2024-04-26T11:15:24.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3791000000000001e-05 2024-04-26T11:15:24.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349919+0000", 2024-04-26T11:15:24.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0135999999999999e-05 2024-04-26T11:15:24.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349956+0000", 2024-04-26T11:15:24.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7642000000000003e-05 2024-04-26T11:15:24.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350080+0000", 2024-04-26T11:15:24.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123285 2024-04-26T11:15:24.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:24.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350192+0000", 2024-04-26T11:15:24.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112509 2024-04-26T11:15:24.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:24.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356232+0000", 2024-04-26T11:15:24.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060403339999999996 2024-04-26T11:15:24.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:24.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414616+0000", 2024-04-26T11:15:24.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.058383156999999998 2024-04-26T11:15:24.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:24.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414643+0000", 2024-04-26T11:15:24.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7317e-05 2024-04-26T11:15:24.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:24.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414664+0000", 2024-04-26T11:15:24.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1135999999999999e-05 2024-04-26T11:15:24.928 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.928 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.928 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.929 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174402 5.b 5:d8ad746d:::benchmark_data_smithi029_44842_object29764:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:24.929 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:24.929 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.483285281999997, 2024-04-26T11:15:24.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059017657000000001, 2024-04-26T11:15:24.929 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.929 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.929 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.929 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.929 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.929 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174402 2024-04-26T11:15:24.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.929 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:24.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:24.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.930 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.930 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353844+0000", 2024-04-26T11:15:24.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:24.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353848+0000", 2024-04-26T11:15:24.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5040000000000004e-06 2024-04-26T11:15:24.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353858+0000", 2024-04-26T11:15:24.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7410000000000004e-06 2024-04-26T11:15:24.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353864+0000", 2024-04-26T11:15:24.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7899999999999996e-06 2024-04-26T11:15:24.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353902+0000", 2024-04-26T11:15:24.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8325000000000003e-05 2024-04-26T11:15:24.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353980+0000", 2024-04-26T11:15:24.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8077000000000005e-05 2024-04-26T11:15:24.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:24.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354046+0000", 2024-04-26T11:15:24.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6249999999999998e-05 2024-04-26T11:15:24.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:24.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356532+0000", 2024-04-26T11:15:24.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024850969999999999 2024-04-26T11:15:24.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:24.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412796+0000", 2024-04-26T11:15:24.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056264616000000003 2024-04-26T11:15:24.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:24.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412835+0000", 2024-04-26T11:15:24.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8863999999999999e-05 2024-04-26T11:15:24.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.934 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:24.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.412862+0000", 2024-04-26T11:15:24.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7124e-05 2024-04-26T11:15:24.934 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.934 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.934 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.934 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174403 5.4 5:2d30cd6a:::benchmark_data_smithi029_44842_object29765:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:24.934 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:15:24.934 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.483258079000002, 2024-04-26T11:15:24.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.060873365999999998, 2024-04-26T11:15:24.935 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.935 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.935 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.935 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.935 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.935 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174403 2024-04-26T11:15:24.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.935 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:15:24.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353872+0000", 2024-04-26T11:15:24.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353871+0000", 2024-04-26T11:15:24.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353874+0000", 2024-04-26T11:15:24.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2869999999999999e-06 2024-04-26T11:15:24.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353881+0000", 2024-04-26T11:15:24.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2239999999999998e-06 2024-04-26T11:15:24.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353886+0000", 2024-04-26T11:15:24.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.259e-06 2024-04-26T11:15:24.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353912+0000", 2024-04-26T11:15:24.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6404999999999999e-05 2024-04-26T11:15:24.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.353991+0000", 2024-04-26T11:15:24.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8104999999999998e-05 2024-04-26T11:15:24.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:24.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.354055+0000", 2024-04-26T11:15:24.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4875999999999993e-05 2024-04-26T11:15:24.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:24.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.358000+0000", 2024-04-26T11:15:24.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0039442629999999999 2024-04-26T11:15:24.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:24.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414690+0000", 2024-04-26T11:15:24.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056689940000000001 2024-04-26T11:15:24.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:24.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414714+0000", 2024-04-26T11:15:24.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4527000000000001e-05 2024-04-26T11:15:24.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:24.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414745+0000", 2024-04-26T11:15:24.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0874999999999998e-05 2024-04-26T11:15:24.939 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.939 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.939 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.940 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174404 5.4 5:2801f1e1:::benchmark_data_smithi029_44842_object29766:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:24.940 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:15:24.940 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 34.480641155000001, 2024-04-26T11:15:24.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.059745741999999998, 2024-04-26T11:15:24.940 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:24.940 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:24.940 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:24.940 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:24.940 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:24.940 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174404 2024-04-26T11:15:24.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.940 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:24.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:24.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:15:24.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:24.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356489+0000", 2024-04-26T11:15:24.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:24.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.941 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:24.941 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356488+0000", 2024-04-26T11:15:24.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:24.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:24.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356492+0000", 2024-04-26T11:15:24.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1169999999999997e-06 2024-04-26T11:15:24.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:24.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356502+0000", 2024-04-26T11:15:24.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0263e-05 2024-04-26T11:15:24.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:24.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356508+0000", 2024-04-26T11:15:24.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5890000000000002e-06 2024-04-26T11:15:24.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:24.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356545+0000", 2024-04-26T11:15:24.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7382999999999998e-05 2024-04-26T11:15:24.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:24.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356671+0000", 2024-04-26T11:15:24.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012535500000000001 2024-04-26T11:15:24.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:24.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356789+0000", 2024-04-26T11:15:24.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000118099 2024-04-26T11:15:24.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:24.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.359200+0000", 2024-04-26T11:15:24.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024110059999999998 2024-04-26T11:15:24.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:24.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416180+0000", 2024-04-26T11:15:24.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.056980335999999999 2024-04-26T11:15:24.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:24.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416204+0000", 2024-04-26T11:15:24.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4301e-05 2024-04-26T11:15:24.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:24.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:24.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:24.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.416234+0000", 2024-04-26T11:15:24.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9903000000000002e-05 2024-04-26T11:15:24.945 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.945 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.945 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.945 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:24.945 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:24.945 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:24.947 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:24.947 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:24.944+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:25.048 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:25.046+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:25.137 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:25.137 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:15:25.137 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.137 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:268148 5.5 5:aa154b2e:::benchmark_data_smithi029_44842_object123510:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:15:25.137 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:25.131603+0000", 2024-04-26T11:15:25.138 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0012794659999999999, 2024-04-26T11:15:25.138 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00130897, 2024-04-26T11:15:25.138 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.138 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:25.138 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:25.138 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:25.138 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.138 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 268148 2024-04-26T11:15:25.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.138 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.138 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.138 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.138 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.131603+0000", 2024-04-26T11:15:25.138 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.139 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.139 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.139 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.131603+0000", 2024-04-26T11:15:25.139 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.139 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.139 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.139 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.131602+0000", 2024-04-26T11:15:25.139 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:25.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.139 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.139 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.139 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.131607+0000", 2024-04-26T11:15:25.139 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4859999999999997e-06 2024-04-26T11:15:25.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.140 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.140 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.140 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.131617+0000", 2024-04-26T11:15:25.140 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.7680000000000003e-06 2024-04-26T11:15:25.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.140 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.140 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.140 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.131625+0000", 2024-04-26T11:15:25.140 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6469999999999998e-06 2024-04-26T11:15:25.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.140 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.140 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.140 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.131661+0000", 2024-04-26T11:15:25.140 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6408000000000001e-05 2024-04-26T11:15:25.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.141 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.141 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:25.141 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.131760+0000", 2024-04-26T11:15:25.141 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.9463000000000006e-05 2024-04-26T11:15:25.141 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.141 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.141 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.141 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.141 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:268149 5.c 5:39c13f4d:::benchmark_data_smithi029_44842_object123511:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:15:25.141 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:25.131735+0000", 2024-04-26T11:15:25.141 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0011470989999999999, 2024-04-26T11:15:25.141 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00124822, 2024-04-26T11:15:25.141 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.142 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:25.142 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:25.142 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:25.142 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.142 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 268149 2024-04-26T11:15:25.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.142 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.142 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.142 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.142 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.131735+0000", 2024-04-26T11:15:25.142 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.142 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.142 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.143 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.131735+0000", 2024-04-26T11:15:25.143 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.143 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.143 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.143 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.131734+0000", 2024-04-26T11:15:25.143 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:25.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.143 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.143 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.143 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.131739+0000", 2024-04-26T11:15:25.143 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4049999999999999e-06 2024-04-26T11:15:25.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.143 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.143 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.144 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.131751+0000", 2024-04-26T11:15:25.144 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.186e-05 2024-04-26T11:15:25.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.144 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.144 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.144 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.131760+0000", 2024-04-26T11:15:25.144 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3259999999999996e-06 2024-04-26T11:15:25.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.144 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.144 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.144 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.131800+0000", 2024-04-26T11:15:25.144 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0423000000000002e-05 2024-04-26T11:15:25.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.144 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.144 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:25.145 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.131923+0000", 2024-04-26T11:15:25.145 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000123316 2024-04-26T11:15:25.145 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.145 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.145 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.145 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.145 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:268153 5.c 5.a8580abc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:15:25.145 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:25.132565+0000", 2024-04-26T11:15:25.145 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00031649, 2024-04-26T11:15:25.145 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00045726000000000002, 2024-04-26T11:15:25.145 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.145 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:15:25.145 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:25.145 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:25.146 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.146 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 268153 2024-04-26T11:15:25.146 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.146 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.146 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.146 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.146 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132565+0000", 2024-04-26T11:15:25.146 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.146 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.146 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.146 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.146 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132565+0000", 2024-04-26T11:15:25.146 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.146 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.146 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.147 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.147 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132565+0000", 2024-04-26T11:15:25.147 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:25.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.147 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.147 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.147 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132570+0000", 2024-04-26T11:15:25.147 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1059999999999999e-06 2024-04-26T11:15:25.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.147 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.147 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.147 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132582+0000", 2024-04-26T11:15:25.147 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1875999999999999e-05 2024-04-26T11:15:25.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.147 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.148 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.148 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132591+0000", 2024-04-26T11:15:25.148 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2860000000000005e-06 2024-04-26T11:15:25.148 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.148 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.148 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.148 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.148 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:268154 5.3 5:cde03609:::benchmark_data_smithi029_44842_object123516:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:15:25.148 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:25.132602+0000", 2024-04-26T11:15:25.148 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00028044099999999998, 2024-04-26T11:15:25.148 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00045398200000000002, 2024-04-26T11:15:25.148 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.148 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:25.149 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:25.149 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:25.149 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.149 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 268154 2024-04-26T11:15:25.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.149 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.149 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.149 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.149 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132602+0000", 2024-04-26T11:15:25.149 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.149 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.149 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.149 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132602+0000", 2024-04-26T11:15:25.149 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.150 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.150 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.150 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132601+0000", 2024-04-26T11:15:25.150 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:25.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.150 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.150 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.150 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132604+0000", 2024-04-26T11:15:25.150 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9569999999999998e-06 2024-04-26T11:15:25.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.150 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.150 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.150 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132611+0000", 2024-04-26T11:15:25.151 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9280000000000004e-06 2024-04-26T11:15:25.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.151 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.151 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.151 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132617+0000", 2024-04-26T11:15:25.151 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3999999999999997e-06 2024-04-26T11:15:25.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.151 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.151 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.151 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132652+0000", 2024-04-26T11:15:25.151 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.4428000000000003e-05 2024-04-26T11:15:25.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.151 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.151 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:25.151 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132762+0000", 2024-04-26T11:15:25.152 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011057600000000001 2024-04-26T11:15:25.152 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.152 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.152 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.152 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.152 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.152 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:268150 5.0 e58/16 5:0adf7e11:::benchmark_data_smithi029_44842_object123512:head v 58'16995, mlcod=58'16990)", 2024-04-26T11:15:25.152 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:25.132629+0000", 2024-04-26T11:15:25.152 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00025257399999999998, 2024-04-26T11:15:25.152 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00046378899999999999, 2024-04-26T11:15:25.152 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.152 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:25.152 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.152 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.152 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.153 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132629+0000", 2024-04-26T11:15:25.153 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.153 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.153 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.153 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.153 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132629+0000", 2024-04-26T11:15:25.153 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.153 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.153 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.153 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.153 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132629+0000", 2024-04-26T11:15:25.153 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:25.153 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.153 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.154 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.154 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132639+0000", 2024-04-26T11:15:25.154 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0115000000000001e-05 2024-04-26T11:15:25.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.154 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.154 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.154 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132647+0000", 2024-04-26T11:15:25.154 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:15:25.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.154 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.154 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.154 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132653+0000", 2024-04-26T11:15:25.154 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2700000000000001e-06 2024-04-26T11:15:25.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.154 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.155 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.155 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132689+0000", 2024-04-26T11:15:25.155 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5774e-05 2024-04-26T11:15:25.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.155 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.155 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:25.155 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132709+0000", 2024-04-26T11:15:25.155 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.9556e-05 2024-04-26T11:15:25.155 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.155 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.155 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.155 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.155 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:268156 5.1 5:895ff0c4:::benchmark_data_smithi029_44842_object123518:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:15:25.155 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:25.132666+0000", 2024-04-26T11:15:25.156 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.000215823, 2024-04-26T11:15:25.156 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00046035100000000001, 2024-04-26T11:15:25.156 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.156 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:25.156 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:25.156 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:25.156 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.156 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 268156 2024-04-26T11:15:25.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.156 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.156 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.156 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.156 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132666+0000", 2024-04-26T11:15:25.156 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.157 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.157 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.157 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132666+0000", 2024-04-26T11:15:25.157 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.157 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.157 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.157 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.157 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132665+0000", 2024-04-26T11:15:25.157 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:25.157 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.157 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.157 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.157 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132669+0000", 2024-04-26T11:15:25.157 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1239999999999998e-06 2024-04-26T11:15:25.157 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.158 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.158 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.158 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132678+0000", 2024-04-26T11:15:25.158 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.6489999999999997e-06 2024-04-26T11:15:25.158 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.158 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.158 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.158 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132685+0000", 2024-04-26T11:15:25.158 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.567e-06 2024-04-26T11:15:25.158 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.158 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.158 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.158 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132724+0000", 2024-04-26T11:15:25.158 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9193000000000002e-05 2024-04-26T11:15:25.159 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.159 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.159 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:25.159 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132842+0000", 2024-04-26T11:15:25.159 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000117953 2024-04-26T11:15:25.159 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.159 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.159 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.159 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.159 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.159 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:268151 5.a e58/31)", 2024-04-26T11:15:25.159 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:25.132900+0000", 2024-04-26T11:15:25.159 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 4294967295.9999824, 2024-04-26T11:15:25.159 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00026832100000000002, 2024-04-26T11:15:25.159 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.159 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "queued for pg", 2024-04-26T11:15:25.160 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.160 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.160 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.160 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132900+0000", 2024-04-26T11:15:25.160 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.160 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.160 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.160 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.160 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132900+0000", 2024-04-26T11:15:25.160 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.160 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.160 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.160 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.160 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132899+0000", 2024-04-26T11:15:25.160 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:25.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.161 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.161 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.161 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132906+0000", 2024-04-26T11:15:25.161 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3249999999999996e-06 2024-04-26T11:15:25.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.161 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.161 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.161 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132915+0000", 2024-04-26T11:15:25.161 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.5559999999999996e-06 2024-04-26T11:15:25.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.161 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.161 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.161 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:25.132921+0000", 2024-04-26T11:15:25.161 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.251e-06 2024-04-26T11:15:25.162 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.162 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.162 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.162 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.162 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:15:25.162 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 7 2024-04-26T11:15:25.162 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:25.163 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:25.164 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:25.161+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:25.263 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:25.261+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:25.365 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:25.363+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:25.385 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:25.385 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:15:25.385 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:15:25.385 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:15:25.385 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:25.402 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:25.488 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:25.486+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:25.567 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:25.565+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:25.626 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:25.626 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:15:25.626 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:15:25.626 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:15:25.626 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.626 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:25.627 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:25.627 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 92.351892911999997, 2024-04-26T11:15:25.627 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:15:25.627 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.627 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:25.627 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:25.627 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:25.627 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.627 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:15:25.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.627 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.627 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.627 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.627 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:25.628 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.628 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.628 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:25.628 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.628 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.628 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:15:25.628 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:25.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.628 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.629 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:15:25.629 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:15:25.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.629 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.629 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.629 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:15:25.629 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:15:25.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.629 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.629 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.629 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:15:25.629 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:15:25.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.629 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.630 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.630 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:15:25.630 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:15:25.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.630 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:25.630 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:15:25.630 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:15:25.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.630 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:25.630 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:15:25.630 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:15:25.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:25.631 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:15:25.631 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:15:25.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:25.631 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:15:25.631 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:15:25.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.631 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:25.631 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:15:25.631 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:15:25.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.632 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:25.632 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:15:25.632 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:15:25.632 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.632 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.632 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.632 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.632 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:25.632 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:25.632 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 92.351081347000004, 2024-04-26T11:15:25.632 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:15:25.632 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.632 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:25.633 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:25.633 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:25.633 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.633 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:15:25.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.633 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.633 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.633 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:25.633 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.633 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.633 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:25.633 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.634 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.634 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:25.634 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:25.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.634 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.634 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:15:25.634 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:15:25.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.634 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.634 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:15:25.634 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:15:25.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.635 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.635 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.635 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:15:25.635 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:15:25.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.635 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.635 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.635 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:15:25.635 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:15:25.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.635 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.635 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:25.635 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:15:25.635 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:15:25.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.636 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:25.636 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:15:25.636 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:15:25.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.636 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:25.636 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:15:25.636 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:15:25.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.636 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:25.636 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:15:25.636 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:15:25.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.637 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:25.637 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:15:25.637 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:15:25.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.637 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:25.637 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:15:25.637 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:15:25.637 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.637 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.637 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.637 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:25.637 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:25.638 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 92.343894509999998, 2024-04-26T11:15:25.638 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:15:25.638 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.638 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:25.638 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:25.638 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:25.638 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.638 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:15:25.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.638 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.638 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.638 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.638 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:25.638 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.639 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.639 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:25.639 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.639 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.639 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:15:25.639 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:25.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.639 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.639 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:15:25.640 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:15:25.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.640 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.640 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.640 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:15:25.640 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:15:25.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.640 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.640 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.640 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:15:25.640 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:15:25.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.640 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.640 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.640 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:15:25.641 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:15:25.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.641 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.641 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:25.641 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:15:25.641 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:15:25.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.641 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.641 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:25.641 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:15:25.641 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:15:25.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.641 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.641 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:25.641 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:15:25.642 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:15:25.642 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.642 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.642 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:25.642 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:15:25.642 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:15:25.642 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.642 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.642 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:25.642 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:15:25.642 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:15:25.642 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.642 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.642 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:25.643 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:15:25.643 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:15:25.643 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.643 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.643 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.643 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.643 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:25.643 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:25.643 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 92.343353630999999, 2024-04-26T11:15:25.643 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:15:25.643 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.643 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:25.643 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:25.643 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:25.644 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.644 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:15:25.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.644 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.644 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.644 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.644 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:25.644 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.644 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.644 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.644 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:25.644 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.644 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.644 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.645 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:25.645 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:25.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.645 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.645 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:15:25.645 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:15:25.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.645 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.645 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:15:25.645 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:15:25.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.645 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.645 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:15:25.646 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:15:25.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.646 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.646 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.646 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:15:25.646 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:15:25.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.646 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.646 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:25.646 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:15:25.646 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:15:25.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.646 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.646 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:25.647 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:15:25.647 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:15:25.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.647 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.647 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:25.647 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:15:25.647 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:15:25.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.647 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.647 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:25.647 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:15:25.647 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:15:25.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.647 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.647 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:15:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:15:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:15:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:15:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:25.648 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 88.300169183999998, 2024-04-26T11:15:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:15:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:15:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:15:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:15:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:15:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.650 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.651 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.651 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:15:25.651 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:15:25.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.651 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.651 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.651 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:15:25.651 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:15:25.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.651 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.651 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.651 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:15:25.651 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:15:25.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.651 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:25.652 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:15:25.652 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:15:25.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:25.652 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:15:25.652 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:15:25.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:25.652 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:15:25.652 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:15:25.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.653 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.653 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:15:25.653 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:15:25.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.653 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:25.653 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:15:25.653 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:15:25.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.653 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.653 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:15:25.653 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:15:25.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.654 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:25.654 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:15:25.654 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:15:25.654 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.654 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.654 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.654 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.654 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:25.654 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:25.654 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 88.297975844000007, 2024-04-26T11:15:25.654 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:15:25.654 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.654 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:25.654 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:25.655 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:25.655 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.655 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:15:25.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.655 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.655 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.655 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.655 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:25.655 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.655 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.655 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.655 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:25.655 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.656 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.656 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:15:25.656 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:25.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.656 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.656 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:15:25.656 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:15:25.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.656 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.656 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:15:25.656 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:15:25.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.657 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.657 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:15:25.657 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:15:25.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.657 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.657 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:15:25.657 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:15:25.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.657 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:25.657 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:15:25.657 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:15:25.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.658 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:25.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:15:25.658 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:15:25.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.658 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:25.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:15:25.658 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:15:25.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.658 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:15:25.658 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:15:25.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.659 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:25.659 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:15:25.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:15:25.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.659 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.659 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:15:25.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:15:25.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.659 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:25.659 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:15:25.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:15:25.660 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.660 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.660 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.660 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.660 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:25.660 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:25.660 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 88.292764020000007, 2024-04-26T11:15:25.660 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:15:25.660 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.660 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:25.660 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:25.660 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:25.660 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.660 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:15:25.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.661 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.661 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.661 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.661 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:25.661 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.661 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.661 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.661 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:25.661 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.661 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.661 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.661 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:15:25.661 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:25.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.662 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.662 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:15:25.662 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:15:25.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.662 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.662 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:15:25.662 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:15:25.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.662 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.662 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:15:25.663 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:15:25.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.663 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.663 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:15:25.663 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:15:25.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.663 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:25.663 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:15:25.663 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:15:25.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.663 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:25.663 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:15:25.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:15:25.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.664 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:25.664 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:15:25.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:15:25.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.665 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.665 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:15:25.665 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:15:25.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.665 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:25.665 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:15:25.665 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:15:25.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.665 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.665 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:15:25.665 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:15:25.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.666 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.666 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:25.666 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:15:25.666 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:15:25.666 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.666 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.666 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.666 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.666 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:25.666 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:25.666 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 88.276315319999995, 2024-04-26T11:15:25.666 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:15:25.666 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.666 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:25.667 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:25.667 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:25.667 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.667 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:15:25.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.667 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.667 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.667 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.667 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:25.667 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.667 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.667 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.667 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:25.668 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.668 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.668 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:15:25.668 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:25.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.668 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.668 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:15:25.668 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:15:25.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.668 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:15:25.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:15:25.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:15:25.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:15:25.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:15:25.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:15:25.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:25.670 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:15:25.670 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:15:25.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.670 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.670 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:15:25.670 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:15:25.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.670 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:25.670 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:15:25.670 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:15:25.670 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.670 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.670 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.671 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:25.671 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:25.671 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 88.274617814999999, 2024-04-26T11:15:25.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:15:25.671 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.671 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:25.671 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:25.671 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:25.671 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.671 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:15:25.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.671 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:25.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:25.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:15:25.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:25.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:15:25.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:15:25.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:15:25.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:15:25.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:15:25.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:15:25.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.674 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.674 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:15:25.674 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:15:25.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.674 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:25.674 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:15:25.674 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:15:25.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.674 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.674 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:15:25.674 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:15:25.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.675 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:25.675 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:15:25.675 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:15:25.675 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.675 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.675 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.675 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:25.675 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:25.675 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 88.274553513000001, 2024-04-26T11:15:25.675 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:15:25.675 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.675 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:25.675 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:25.676 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:25.676 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.676 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:15:25.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.676 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.676 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.676 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:25.676 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.676 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.676 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:25.676 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.677 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.677 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:25.677 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:25.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.677 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.677 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:15:25.677 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:15:25.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.677 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.677 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:15:25.677 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:15:25.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.678 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:15:25.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:15:25.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.678 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:15:25.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:15:25.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.678 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:25.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:15:25.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:15:25.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.679 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.679 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:15:25.679 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:15:25.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.679 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:25.679 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:15:25.679 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:15:25.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.679 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:25.679 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:15:25.679 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:15:25.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.680 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:25.680 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:15:25.680 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:15:25.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.680 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:25.680 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:15:25.680 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:15:25.680 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.680 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.680 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.681 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:25.681 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:25.681 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 88.274499289000005, 2024-04-26T11:15:25.681 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:15:25.681 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.681 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:25.681 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:25.681 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:25.681 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.681 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:15:25.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.681 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.681 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.681 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.681 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:25.681 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.682 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.682 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:25.682 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.682 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.682 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:25.682 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:25.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.682 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.682 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:15:25.683 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:15:25.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.683 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.683 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.683 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:15:25.683 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:15:25.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.683 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.683 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.683 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:15:25.683 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:15:25.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.683 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.683 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.683 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:15:25.684 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:15:25.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.684 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:25.684 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:15:25.684 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:15:25.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.684 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.684 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:15:25.684 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:15:25.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.684 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:25.684 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:15:25.685 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:15:25.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.685 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.685 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:25.685 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:15:25.685 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:15:25.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.685 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.685 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:25.685 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:15:25.685 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:15:25.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.685 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.685 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:25.685 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:15:25.685 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:15:25.686 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.686 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.686 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.686 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.686 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:25.686 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:25.686 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 88.274454777000003, 2024-04-26T11:15:25.686 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:15:25.686 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.686 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:25.686 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:25.686 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:25.686 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.687 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:15:25.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.687 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.687 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.687 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:25.687 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.687 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.687 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:25.687 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.687 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.688 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:15:25.688 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:25.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.688 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.688 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:15:25.688 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:15:25.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.688 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.688 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:15:25.688 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:15:25.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.688 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.688 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:15:25.689 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:15:25.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.689 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.689 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:15:25.689 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:15:25.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.689 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:25.689 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:15:25.689 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:15:25.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.689 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.689 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:15:25.689 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:15:25.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.690 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.690 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:25.690 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:15:25.690 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:15:25.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.690 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.690 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:25.690 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:15:25.690 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:15:25.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.690 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.690 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:25.690 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:15:25.691 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:15:25.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.691 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:25.691 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:15:25.691 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:15:25.691 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.691 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.691 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.691 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:25.691 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:25.691 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 88.270233774999994, 2024-04-26T11:15:25.691 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:15:25.692 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.692 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:25.692 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:25.692 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:25.692 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.692 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:15:25.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.692 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.692 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.692 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:25.692 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.692 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.693 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:25.693 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.693 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.693 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:15:25.693 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:15:25.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.693 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.693 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:15:25.693 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:15:25.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.693 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.694 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:15:25.694 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:15:25.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.694 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.694 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:15:25.694 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:15:25.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.694 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.694 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:15:25.694 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:15:25.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.694 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:25.695 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:15:25.695 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:15:25.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.695 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.695 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:15:25.695 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:15:25.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.695 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:25.695 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:15:25.695 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:15:25.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.695 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:25.696 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:15:25.696 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:15:25.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.696 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:25.696 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:15:25.696 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:15:25.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.696 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:25.696 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:15:25.696 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:15:25.696 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.696 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.696 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.697 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174388 5.c 5:312e5163:::benchmark_data_smithi029_44842_object29750:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:25.697 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:25.697 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 35.274408119999997, 2024-04-26T11:15:25.697 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.064002009999999998, 2024-04-26T11:15:25.697 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.697 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:25.697 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:25.697 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:25.697 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.697 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174388 2024-04-26T11:15:25.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.697 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.698 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.698 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:25.698 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.698 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.698 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.698 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:25.698 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.698 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.698 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.698 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348231+0000", 2024-04-26T11:15:25.698 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:25.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.698 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.699 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.699 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348233+0000", 2024-04-26T11:15:25.699 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2249999999999999e-06 2024-04-26T11:15:25.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.699 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.699 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348238+0000", 2024-04-26T11:15:25.699 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1899999999999997e-06 2024-04-26T11:15:25.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.699 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.699 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348241+0000", 2024-04-26T11:15:25.699 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.965e-06 2024-04-26T11:15:25.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.700 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.700 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348264+0000", 2024-04-26T11:15:25.700 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3014e-05 2024-04-26T11:15:25.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.700 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:25.700 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348371+0000", 2024-04-26T11:15:25.700 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000106889 2024-04-26T11:15:25.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.700 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:25.700 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412126+0000", 2024-04-26T11:15:25.700 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063755495999999995 2024-04-26T11:15:25.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.701 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:25.701 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412165+0000", 2024-04-26T11:15:25.701 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9269e-05 2024-04-26T11:15:25.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.701 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:25.701 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412234+0000", 2024-04-26T11:15:25.701 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8337000000000007e-05 2024-04-26T11:15:25.701 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.701 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.701 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.701 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174390 5.1 5:81c54fd7:::benchmark_data_smithi029_44842_object29752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:25.701 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:25.702 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 35.274292965999997, 2024-04-26T11:15:25.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063635918, 2024-04-26T11:15:25.702 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.702 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:25.702 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:25.702 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:25.702 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.702 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174390 2024-04-26T11:15:25.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.702 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.702 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.702 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:25.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:25.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348346+0000", 2024-04-26T11:15:25.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:25.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348351+0000", 2024-04-26T11:15:25.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.442e-06 2024-04-26T11:15:25.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348357+0000", 2024-04-26T11:15:25.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9530000000000002e-06 2024-04-26T11:15:25.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348363+0000", 2024-04-26T11:15:25.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2129999999999999e-06 2024-04-26T11:15:25.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348396+0000", 2024-04-26T11:15:25.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3161999999999999e-05 2024-04-26T11:15:25.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:25.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348511+0000", 2024-04-26T11:15:25.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000115253 2024-04-26T11:15:25.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:25.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411857+0000", 2024-04-26T11:15:25.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063345431999999993 2024-04-26T11:15:25.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:25.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411904+0000", 2024-04-26T11:15:25.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7389000000000003e-05 2024-04-26T11:15:25.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:25.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411983+0000", 2024-04-26T11:15:25.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8750000000000003e-05 2024-04-26T11:15:25.706 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.706 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.706 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.706 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174394 5.3 5:c91ce5cb:::benchmark_data_smithi029_44842_object29756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:25.706 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:25.706 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 35.274190021999999, 2024-04-26T11:15:25.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062247626, 2024-04-26T11:15:25.706 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.707 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:25.707 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:25.707 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:25.707 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.707 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174394 2024-04-26T11:15:25.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.707 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:25.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:25.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348449+0000", 2024-04-26T11:15:25.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:25.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348457+0000", 2024-04-26T11:15:25.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9619999999999993e-06 2024-04-26T11:15:25.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348462+0000", 2024-04-26T11:15:25.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6569999999999996e-06 2024-04-26T11:15:25.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348465+0000", 2024-04-26T11:15:25.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2990000000000001e-06 2024-04-26T11:15:25.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408427+0000", 2024-04-26T11:15:25.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.059961423 2024-04-26T11:15:25.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:25.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408554+0000", 2024-04-26T11:15:25.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012779600000000001 2024-04-26T11:15:25.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:25.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410570+0000", 2024-04-26T11:15:25.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020152719999999998 2024-04-26T11:15:25.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:25.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410624+0000", 2024-04-26T11:15:25.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4211e-05 2024-04-26T11:15:25.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:25.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410697+0000", 2024-04-26T11:15:25.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3447000000000003e-05 2024-04-26T11:15:25.710 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.711 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.711 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.711 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174395 5.1 5:8ee7f1d3:::benchmark_data_smithi029_44842_object29757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:25.711 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:25.711 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 35.273159931000002, 2024-04-26T11:15:25.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062622744999999994, 2024-04-26T11:15:25.711 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.711 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:25.711 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:25.711 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:25.711 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.711 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174395 2024-04-26T11:15:25.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.712 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:25.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:25.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349479+0000", 2024-04-26T11:15:25.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:25.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349483+0000", 2024-04-26T11:15:25.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.54e-06 2024-04-26T11:15:25.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349488+0000", 2024-04-26T11:15:25.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5119999999999999e-06 2024-04-26T11:15:25.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349492+0000", 2024-04-26T11:15:25.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7170000000000002e-06 2024-04-26T11:15:25.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350187+0000", 2024-04-26T11:15:25.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00069535899999999999 2024-04-26T11:15:25.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:25.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350292+0000", 2024-04-26T11:15:25.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0001047 2024-04-26T11:15:25.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:25.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411992+0000", 2024-04-26T11:15:25.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061699647000000003 2024-04-26T11:15:25.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:25.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412030+0000", 2024-04-26T11:15:25.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8124999999999998e-05 2024-04-26T11:15:25.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:25.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412103+0000", 2024-04-26T11:15:25.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2733999999999999e-05 2024-04-26T11:15:25.715 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.715 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.715 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.716 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174396 5.7 5:e0fad05d:::benchmark_data_smithi029_44842_object29758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:25.716 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:25.716 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 35.273076291999999, 2024-04-26T11:15:25.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062445026000000001, 2024-04-26T11:15:25.716 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.716 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:25.716 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:25.716 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:25.716 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.716 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174396 2024-04-26T11:15:25.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.716 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.716 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:25.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:25.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:25.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:25.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349566+0000", 2024-04-26T11:15:25.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2490000000000001e-06 2024-04-26T11:15:25.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349573+0000", 2024-04-26T11:15:25.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.776e-06 2024-04-26T11:15:25.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349576+0000", 2024-04-26T11:15:25.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3629999999999998e-06 2024-04-26T11:15:25.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350396+0000", 2024-04-26T11:15:25.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00081992199999999995 2024-04-26T11:15:25.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:25.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350516+0000", 2024-04-26T11:15:25.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012006900000000001 2024-04-26T11:15:25.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:25.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411924+0000", 2024-04-26T11:15:25.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061407960999999997 2024-04-26T11:15:25.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:25.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411947+0000", 2024-04-26T11:15:25.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2943999999999999e-05 2024-04-26T11:15:25.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:25.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412008+0000", 2024-04-26T11:15:25.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1237999999999999e-05 2024-04-26T11:15:25.720 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.720 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.720 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.720 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174397 5.7 5:e25daf9a:::benchmark_data_smithi029_44842_object29759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:25.720 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:25.720 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 35.272968163000002, 2024-04-26T11:15:25.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063878565999999998, 2024-04-26T11:15:25.721 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.721 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:25.721 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:25.721 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:25.721 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.721 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174397 2024-04-26T11:15:25.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.721 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:25.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:25.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349671+0000", 2024-04-26T11:15:25.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:25.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349674+0000", 2024-04-26T11:15:25.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3360000000000002e-06 2024-04-26T11:15:25.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349678+0000", 2024-04-26T11:15:25.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0709999999999996e-06 2024-04-26T11:15:25.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349681+0000", 2024-04-26T11:15:25.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3139999999999999e-06 2024-04-26T11:15:25.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410371+0000", 2024-04-26T11:15:25.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.060690202999999998 2024-04-26T11:15:25.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:25.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410463+0000", 2024-04-26T11:15:25.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2095000000000005e-05 2024-04-26T11:15:25.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:25.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413471+0000", 2024-04-26T11:15:25.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0030073909999999999 2024-04-26T11:15:25.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:25.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413499+0000", 2024-04-26T11:15:25.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8725e-05 2024-04-26T11:15:25.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:25.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413550+0000", 2024-04-26T11:15:25.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0810000000000003e-05 2024-04-26T11:15:25.725 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.725 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.725 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.725 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:174398 5.4 e46/16 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head v 46'10798, mlcod=46'10796)", 2024-04-26T11:15:25.725 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:25.725 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 35.272439951999999, 2024-04-26T11:15:25.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062067047, 2024-04-26T11:15:25.725 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:25.725 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:25.725 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:25.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:25.726 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:25.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:25.726 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:25.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:25.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:25.726 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350199+0000", 2024-04-26T11:15:25.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:25.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:25.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350205+0000", 2024-04-26T11:15:25.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6749999999999999e-06 2024-04-26T11:15:25.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:25.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350212+0000", 2024-04-26T11:15:25.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7000000000000002e-06 2024-04-26T11:15:25.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350216+0000", 2024-04-26T11:15:25.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5120000000000002e-06 2024-04-26T11:15:25.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:25.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350246+0000", 2024-04-26T11:15:25.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9978999999999999e-05 2024-04-26T11:15:25.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:25.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350263+0000", 2024-04-26T11:15:25.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.702e-05 2024-04-26T11:15:25.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:25.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412238+0000", 2024-04-26T11:15:25.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061974603000000003 2024-04-26T11:15:25.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:25.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:25.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:25.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412267+0000", 2024-04-26T11:15:25.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9116e-05 2024-04-26T11:15:25.729 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.729 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.729 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.729 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:25.729 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:25.729 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:25.731 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:25.731 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:25.728+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:25.831 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:25.829+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:25.899 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:25.899 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:15:25.899 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.899 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:270127 5.f 5.4f8e288f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:15:25.899 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:25.896558+0000", 2024-04-26T11:15:25.899 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00087927700000000003, 2024-04-26T11:15:25.899 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00090754900000000001, 2024-04-26T11:15:25.899 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:25.900 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "queued for pg", 2024-04-26T11:15:25.900 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:25.900 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:25.900 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.900 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 270127 2024-04-26T11:15:25.900 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.900 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:25.900 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:25.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896558+0000", 2024-04-26T11:15:25.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:25.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:25.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896558+0000", 2024-04-26T11:15:25.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:25.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.901 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:25.901 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896557+0000", 2024-04-26T11:15:25.901 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:25.901 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.901 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.902 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:25.902 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896562+0000", 2024-04-26T11:15:25.902 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:15:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896572+0000", 2024-04-26T11:15:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0862999999999999e-05 2024-04-26T11:15:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896581+0000", 2024-04-26T11:15:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3639999999999999e-06 2024-04-26T11:15:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:25.903 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:270130 5.8 5:15293ec1:::benchmark_data_smithi029_44842_object125492:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:15:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:25.896896+0000", 2024-04-26T11:15:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.000540874, 2024-04-26T11:15:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000634502, 2024-04-26T11:15:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 270130 2024-04-26T11:15:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.904 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896896+0000", 2024-04-26T11:15:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896896+0000", 2024-04-26T11:15:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896895+0000", 2024-04-26T11:15:25.905 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:25.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:25.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896899+0000", 2024-04-26T11:15:25.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4520000000000002e-06 2024-04-26T11:15:25.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:25.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896908+0000", 2024-04-26T11:15:25.906 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.5589999999999994e-06 2024-04-26T11:15:25.906 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.906 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.906 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.906 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896914+0000", 2024-04-26T11:15:25.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1279999999999996e-06 2024-04-26T11:15:25.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:25.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896951+0000", 2024-04-26T11:15:25.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6078999999999998e-05 2024-04-26T11:15:25.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:25.907 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.897069+0000", 2024-04-26T11:15:25.907 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000118769 2024-04-26T11:15:25.907 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.907 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.907 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.897182+0000", 2024-04-26T11:15:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011250499999999999 2024-04-26T11:15:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:270131 5.d 5:b1b95df3:::benchmark_data_smithi029_44842_object125493:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:15:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:25.896927+0000", 2024-04-26T11:15:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00050941500000000004, 2024-04-26T11:15:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00067758100000000002, 2024-04-26T11:15:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:25.908 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 270131 2024-04-26T11:15:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896927+0000", 2024-04-26T11:15:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896927+0000", 2024-04-26T11:15:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.909 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896927+0000", 2024-04-26T11:15:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896930+0000", 2024-04-26T11:15:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7999999999999999e-06 2024-04-26T11:15:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896938+0000", 2024-04-26T11:15:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1070000000000005e-06 2024-04-26T11:15:25.910 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896943+0000", 2024-04-26T11:15:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9269999999999996e-06 2024-04-26T11:15:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896978+0000", 2024-04-26T11:15:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5510999999999999e-05 2024-04-26T11:15:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.897102+0000", 2024-04-26T11:15:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012398899999999999 2024-04-26T11:15:25.911 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:25.912 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:25.912 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:25.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.912 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.912 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:270116 5.a 5:54d9108a:::benchmark_data_smithi029_44842_object125478:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:15:25.912 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:25.891745+0000", 2024-04-26T11:15:25.912 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0056920219999999997, 2024-04-26T11:15:25.912 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0059274050000000002, 2024-04-26T11:15:25.912 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:25.912 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:25.912 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:25.912 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:25.912 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.912 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 270116 2024-04-26T11:15:25.912 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.913 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:25.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:25.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.891745+0000", 2024-04-26T11:15:25.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:25.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:25.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.891745+0000", 2024-04-26T11:15:25.913 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:25.913 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.913 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.913 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:25.913 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.891744+0000", 2024-04-26T11:15:25.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:25.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:25.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.891747+0000", 2024-04-26T11:15:25.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9960000000000002e-06 2024-04-26T11:15:25.914 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.914 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.914 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:25.914 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.891755+0000", 2024-04-26T11:15:25.914 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7800000000000001e-06 2024-04-26T11:15:25.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.891761+0000", 2024-04-26T11:15:25.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5439999999999998e-06 2024-04-26T11:15:25.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:25.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.891799+0000", 2024-04-26T11:15:25.915 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8614e-05 2024-04-26T11:15:25.915 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.915 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.915 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:25.915 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.891926+0000", 2024-04-26T11:15:25.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000126978 2024-04-26T11:15:25.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:25.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.892046+0000", 2024-04-26T11:15:25.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011959300000000001 2024-04-26T11:15:25.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.916 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.916 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:25.916 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896859+0000", 2024-04-26T11:15:25.916 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0048133200000000003 2024-04-26T11:15:25.916 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:25.916 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:25.916 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:25.916 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.917 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:270120 5.0 5:07204d4f:::benchmark_data_smithi029_44842_object125482:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:15:25.917 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:25.893501+0000", 2024-04-26T11:15:25.917 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0039353890000000001, 2024-04-26T11:15:25.917 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004250045, 2024-04-26T11:15:25.917 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:25.917 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:25.917 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:25.917 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:25.917 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.917 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 270120 2024-04-26T11:15:25.917 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.917 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:25.917 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:25.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.893501+0000", 2024-04-26T11:15:25.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:25.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:25.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.893501+0000", 2024-04-26T11:15:25.918 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:25.918 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.918 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.918 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:25.918 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.893500+0000", 2024-04-26T11:15:25.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:25.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:25.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.893506+0000", 2024-04-26T11:15:25.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4330000000000003e-06 2024-04-26T11:15:25.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:25.919 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.893518+0000", 2024-04-26T11:15:25.919 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2123000000000001e-05 2024-04-26T11:15:25.919 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.919 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.919 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.893526+0000", 2024-04-26T11:15:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4419999999999998e-06 2024-04-26T11:15:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.893556+0000", 2024-04-26T11:15:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9386999999999998e-05 2024-04-26T11:15:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.893632+0000", 2024-04-26T11:15:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6391999999999996e-05 2024-04-26T11:15:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.920 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:25.921 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.893698+0000", 2024-04-26T11:15:25.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6124000000000006e-05 2024-04-26T11:15:25.921 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:25.921 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:25.921 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:25.921 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.921 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.921 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:270123 5.4 5:2f003705:::benchmark_data_smithi029_44842_object125485:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:15:25.921 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:25.894536+0000", 2024-04-26T11:15:25.921 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0029003789999999998, 2024-04-26T11:15:25.921 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003286513, 2024-04-26T11:15:25.921 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:25.921 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:25.921 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:25.922 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:25.922 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.922 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 270123 2024-04-26T11:15:25.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.922 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:25.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:25.922 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.894536+0000", 2024-04-26T11:15:25.922 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:25.922 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.922 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.922 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:25.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.894536+0000", 2024-04-26T11:15:25.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:25.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:25.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.894536+0000", 2024-04-26T11:15:25.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:25.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.923 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:25.923 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.894540+0000", 2024-04-26T11:15:25.923 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4360000000000004e-06 2024-04-26T11:15:25.923 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.923 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:25.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.894549+0000", 2024-04-26T11:15:25.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4780000000000008e-06 2024-04-26T11:15:25.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.894554+0000", 2024-04-26T11:15:25.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0050000000000004e-06 2024-04-26T11:15:25.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.924 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:25.924 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.894592+0000", 2024-04-26T11:15:25.924 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8688e-05 2024-04-26T11:15:25.924 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.924 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:25.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.894711+0000", 2024-04-26T11:15:25.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011834599999999999 2024-04-26T11:15:25.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.925 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:25.925 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.894830+0000", 2024-04-26T11:15:25.925 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011963 2024-04-26T11:15:25.925 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:25.925 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:25.925 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:25.925 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.925 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.925 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:270124 5.8 5:1f705379:::benchmark_data_smithi029_44842_object125486:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:15:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:25.894560+0000", 2024-04-26T11:15:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0028766400000000002, 2024-04-26T11:15:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0033339709999999998, 2024-04-26T11:15:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 270124 2024-04-26T11:15:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:25.926 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.894560+0000", 2024-04-26T11:15:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.894560+0000", 2024-04-26T11:15:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.894560+0000", 2024-04-26T11:15:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.927 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:25.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.894562+0000", 2024-04-26T11:15:25.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7680000000000001e-06 2024-04-26T11:15:25.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:25.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.894567+0000", 2024-04-26T11:15:25.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0180000000000001e-06 2024-04-26T11:15:25.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.928 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.928 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.928 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.894570+0000", 2024-04-26T11:15:25.928 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9610000000000001e-06 2024-04-26T11:15:25.928 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.894601+0000", 2024-04-26T11:15:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1281000000000001e-05 2024-04-26T11:15:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.894712+0000", 2024-04-26T11:15:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000111371 2024-04-26T11:15:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.894809+0000", 2024-04-26T11:15:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.6825999999999998e-05 2024-04-26T11:15:25.929 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:270125 5.f 5:f7ed771c:::benchmark_data_smithi029_44842_object125487:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:15:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:25.895994+0000", 2024-04-26T11:15:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0014427369999999999, 2024-04-26T11:15:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0019771979999999999, 2024-04-26T11:15:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:25.930 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 270125 2024-04-26T11:15:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.895994+0000", 2024-04-26T11:15:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.895994+0000", 2024-04-26T11:15:25.931 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.895993+0000", 2024-04-26T11:15:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.895998+0000", 2024-04-26T11:15:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7010000000000004e-06 2024-04-26T11:15:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:25.932 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896009+0000", 2024-04-26T11:15:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0798000000000001e-05 2024-04-26T11:15:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896016+0000", 2024-04-26T11:15:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9569999999999996e-06 2024-04-26T11:15:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896057+0000", 2024-04-26T11:15:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.159e-05 2024-04-26T11:15:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.933 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896210+0000", 2024-04-26T11:15:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000152979 2024-04-26T11:15:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:270126 5.4 5:2e86f512:::benchmark_data_smithi029_44842_object125488:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:15:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:25.896025+0000", 2024-04-26T11:15:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0014118030000000001, 2024-04-26T11:15:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020156280000000002, 2024-04-26T11:15:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:25.934 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 270126 2024-04-26T11:15:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896025+0000", 2024-04-26T11:15:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:25.935 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896025+0000", 2024-04-26T11:15:25.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:25.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:25.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896025+0000", 2024-04-26T11:15:25.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:25.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:25.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896027+0000", 2024-04-26T11:15:25.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.322e-06 2024-04-26T11:15:25.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:25.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896034+0000", 2024-04-26T11:15:25.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.798e-06 2024-04-26T11:15:25.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:25.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896039+0000", 2024-04-26T11:15:25.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0549999999999999e-06 2024-04-26T11:15:25.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:25.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896296+0000", 2024-04-26T11:15:25.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00025723800000000002 2024-04-26T11:15:25.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:25.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896365+0000", 2024-04-26T11:15:25.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9324000000000002e-05 2024-04-26T11:15:25.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:25.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:25.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:25.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:25.896428+0000", 2024-04-26T11:15:25.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2389000000000002e-05 2024-04-26T11:15:25.938 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:25.938 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:25.938 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:25.938 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:25.938 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:15:25.938 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 9 2024-04-26T11:15:25.939 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:25.939 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:15:25.941 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:25.941 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:25.938+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:26.042 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:26.040+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:26.090 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:15:26.111 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:15:26.111 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:15:26.111 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:15:26.111 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:15:26.114 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:15:26.114 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:15:26.143 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:26.141+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:26.155 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:26.155 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:26.167 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:26.250 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:26.249+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:26.344 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:26.342+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:26.385 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:26.386 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:26.400 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:26.445 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:26.444+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:26.546 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:26.544+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:26.575 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:26.575 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:26.591 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:26.646 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~88s 2024-04-26T11:15:26.647 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:26.645+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:26.748 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:26.746+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:26.757 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:15:26.775 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:26.775 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:26.792 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:26.848 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:26.847+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:26.949 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:26.947+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:27.013 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:27.013 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:27.029 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:27.070 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:27.068+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:27.152 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:27.150+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:27.206 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:27.207 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:27.219 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:27.261 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:27.259+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:27.354 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:27.352+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:27.426 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:27.426 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:27.440 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:27.483 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:27.481+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:27.556 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:27.554+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:27.610 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:27.610 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:27.622 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:27.663 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:27.662+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:27.752 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is set 2024-04-26T11:15:27.760 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:27.757+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:27.803 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:27.803 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:27.818 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:27.859 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:27.857+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:27.960 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:27.958+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:28.047 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:28.047 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:28.060 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:28.059+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:28.064 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:28.115 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:15:28.161 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:28.159+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:28.262 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:28.260+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:28.266 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:15:28.284 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:28.284 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:15:28.284 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:15:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:15:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 95.010611921000006, 2024-04-26T11:15:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:15:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:15:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.285 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:28.286 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:15:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:15:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:15:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:15:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:15:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.287 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:15:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:15:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:15:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:15:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:15:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:15:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.288 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:15:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:15:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:15:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:15:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:15:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:15:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.289 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:15:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:15:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:15:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:15:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 95.009800356, 2024-04-26T11:15:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:15:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:15:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.291 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.292 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:15:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:15:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:15:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:15:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:15:28.293 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:15:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:15:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:15:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:15:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:15:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.294 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:28.295 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:15:28.295 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:15:28.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.295 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.295 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:28.295 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:15:28.295 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:15:28.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.295 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.295 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:28.295 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:15:28.295 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:15:28.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:15:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:15:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:15:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:15:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.296 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 95.002613518999993, 2024-04-26T11:15:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:15:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:15:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.297 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:15:28.298 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:15:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:15:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:15:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:15:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.299 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:15:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:15:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:15:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:15:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:15:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:15:28.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:15:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:15:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:15:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:15:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:15:28.301 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:15:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:15:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:15:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:15:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:15:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:28.302 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 95.002072639999994, 2024-04-26T11:15:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:15:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:15:28.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.304 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:15:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:15:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:15:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:15:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.305 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:15:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:15:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:15:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:15:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:15:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:15:28.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:15:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:15:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:15:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:15:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:15:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:15:28.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:15:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:15:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:15:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:15:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.308 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 90.958888193000007, 2024-04-26T11:15:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:15:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:15:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:15:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.310 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:15:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:15:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:15:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:15:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:15:28.311 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:15:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:15:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:15:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:15:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:15:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.312 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:15:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:15:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:15:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:15:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:15:28.313 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:15:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:15:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:15:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:15:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:15:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:28.314 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:15:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:15:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 90.956694853000002, 2024-04-26T11:15:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:15:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:28.315 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:15:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:28.316 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:15:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:15:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:15:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:28.317 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:15:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:15:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:15:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:15:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:15:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:15:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.318 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:15:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:15:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:15:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:15:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:15:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:15:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.319 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:15:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:15:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:15:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:15:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:15:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:15:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:15:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:15:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 90.951483029000002, 2024-04-26T11:15:28.321 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:15:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:15:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.322 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:15:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:28.323 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:15:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:15:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:15:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:15:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:15:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:15:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.324 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:15:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:15:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:15:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:15:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:15:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:15:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:15:28.325 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:15:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:15:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:15:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:15:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:15:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.326 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:15:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:15:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:15:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:15:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.327 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 90.935034329000004, 2024-04-26T11:15:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:15:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:15:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.328 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:15:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.329 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:15:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:15:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:15:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:15:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:15:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:15:28.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:15:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:15:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:15:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:15:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:15:28.331 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:15:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:15:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:15:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 90.933336823999994, 2024-04-26T11:15:28.332 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:15:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:15:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:15:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:15:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:15:28.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:15:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:15:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:15:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:15:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:15:28.335 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:15:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:15:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:15:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:15:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:15:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:28.336 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:15:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:15:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 90.933272521999996, 2024-04-26T11:15:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:15:28.337 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:15:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:15:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:15:28.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:15:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:15:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:15:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:15:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:15:28.340 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:15:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:15:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:15:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:15:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:15:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.341 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:15:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:15:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:15:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:15:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:15:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:15:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.343 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:28.343 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:15:28.343 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:15:28.343 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.343 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:28.343 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 90.933218298, 2024-04-26T11:15:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:15:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:28.344 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.345 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:15:28.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.345 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:28.345 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:28.346 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:15:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:15:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:15:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:15:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.347 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:15:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:15:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:15:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:15:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:15:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:15:28.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:15:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:15:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:15:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:15:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:15:28.349 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:15:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:15:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:15:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:15:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:15:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 90.933173785999998, 2024-04-26T11:15:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:15:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:15:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:28.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:15:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:15:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:15:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:15:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:15:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:15:28.353 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:15:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:15:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:15:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:15:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:15:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:15:28.354 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:15:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:15:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:15:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:15:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:15:28.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:15:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:15:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:15:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:15:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 90.928952784000003, 2024-04-26T11:15:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:15:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:15:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:28.357 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:15:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:15:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.358 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:15:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:15:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:15:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:15:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:15:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:15:28.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:15:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:15:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:15:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:15:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:15:28.360 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:15:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:15:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:15:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:15:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:15:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:28.361 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:15:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:15:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:15:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:15:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174388 5.c 5:312e5163:::benchmark_data_smithi029_44842_object29750:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:28.362 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 37.933127128999999, 2024-04-26T11:15:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.064002009999999998, 2024-04-26T11:15:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174388 2024-04-26T11:15:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:28.363 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348231+0000", 2024-04-26T11:15:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348233+0000", 2024-04-26T11:15:28.364 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2249999999999999e-06 2024-04-26T11:15:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348238+0000", 2024-04-26T11:15:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1899999999999997e-06 2024-04-26T11:15:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348241+0000", 2024-04-26T11:15:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.965e-06 2024-04-26T11:15:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.365 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348264+0000", 2024-04-26T11:15:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3014e-05 2024-04-26T11:15:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348371+0000", 2024-04-26T11:15:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000106889 2024-04-26T11:15:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412126+0000", 2024-04-26T11:15:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063755495999999995 2024-04-26T11:15:28.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412165+0000", 2024-04-26T11:15:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9269e-05 2024-04-26T11:15:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412234+0000", 2024-04-26T11:15:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8337000000000007e-05 2024-04-26T11:15:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174390 5.1 5:81c54fd7:::benchmark_data_smithi029_44842_object29752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 37.933011974999999, 2024-04-26T11:15:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063635918, 2024-04-26T11:15:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174390 2024-04-26T11:15:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:28.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:28.369 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348346+0000", 2024-04-26T11:15:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348351+0000", 2024-04-26T11:15:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.442e-06 2024-04-26T11:15:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348357+0000", 2024-04-26T11:15:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9530000000000002e-06 2024-04-26T11:15:28.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348363+0000", 2024-04-26T11:15:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2129999999999999e-06 2024-04-26T11:15:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348396+0000", 2024-04-26T11:15:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3161999999999999e-05 2024-04-26T11:15:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348511+0000", 2024-04-26T11:15:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000115253 2024-04-26T11:15:28.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411857+0000", 2024-04-26T11:15:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063345431999999993 2024-04-26T11:15:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411904+0000", 2024-04-26T11:15:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7389000000000003e-05 2024-04-26T11:15:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411983+0000", 2024-04-26T11:15:28.372 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8750000000000003e-05 2024-04-26T11:15:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174394 5.3 5:c91ce5cb:::benchmark_data_smithi029_44842_object29756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 37.932909031000001, 2024-04-26T11:15:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062247626, 2024-04-26T11:15:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.373 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174394 2024-04-26T11:15:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.374 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348449+0000", 2024-04-26T11:15:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348457+0000", 2024-04-26T11:15:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9619999999999993e-06 2024-04-26T11:15:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348462+0000", 2024-04-26T11:15:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6569999999999996e-06 2024-04-26T11:15:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348465+0000", 2024-04-26T11:15:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2990000000000001e-06 2024-04-26T11:15:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408427+0000", 2024-04-26T11:15:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.059961423 2024-04-26T11:15:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408554+0000", 2024-04-26T11:15:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012779600000000001 2024-04-26T11:15:28.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410570+0000", 2024-04-26T11:15:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020152719999999998 2024-04-26T11:15:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410624+0000", 2024-04-26T11:15:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4211e-05 2024-04-26T11:15:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.377 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410697+0000", 2024-04-26T11:15:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3447000000000003e-05 2024-04-26T11:15:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174395 5.1 5:8ee7f1d3:::benchmark_data_smithi029_44842_object29757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 37.931878939999997, 2024-04-26T11:15:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062622744999999994, 2024-04-26T11:15:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:28.378 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174395 2024-04-26T11:15:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:28.379 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349479+0000", 2024-04-26T11:15:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349483+0000", 2024-04-26T11:15:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.54e-06 2024-04-26T11:15:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.380 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349488+0000", 2024-04-26T11:15:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5119999999999999e-06 2024-04-26T11:15:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349492+0000", 2024-04-26T11:15:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7170000000000002e-06 2024-04-26T11:15:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350187+0000", 2024-04-26T11:15:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00069535899999999999 2024-04-26T11:15:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.381 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:28.382 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350292+0000", 2024-04-26T11:15:28.382 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0001047 2024-04-26T11:15:28.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.382 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.382 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:28.382 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411992+0000", 2024-04-26T11:15:28.382 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061699647000000003 2024-04-26T11:15:28.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.382 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.382 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:28.382 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412030+0000", 2024-04-26T11:15:28.382 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8124999999999998e-05 2024-04-26T11:15:28.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.382 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.383 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:28.383 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412103+0000", 2024-04-26T11:15:28.383 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2733999999999999e-05 2024-04-26T11:15:28.383 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.383 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:28.383 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.383 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174396 5.7 5:e0fad05d:::benchmark_data_smithi029_44842_object29758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:28.383 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:28.383 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 37.931795301000001, 2024-04-26T11:15:28.383 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062445026000000001, 2024-04-26T11:15:28.383 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:28.384 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:28.384 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:28.384 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:28.384 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.384 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174396 2024-04-26T11:15:28.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.384 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:28.384 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.384 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:28.384 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:28.384 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.384 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.384 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:28.384 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:28.385 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.385 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.385 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:28.385 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:28.385 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.385 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.385 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:28.385 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349566+0000", 2024-04-26T11:15:28.385 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2490000000000001e-06 2024-04-26T11:15:28.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.385 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.385 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:28.386 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349573+0000", 2024-04-26T11:15:28.386 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.776e-06 2024-04-26T11:15:28.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.386 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.386 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.386 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349576+0000", 2024-04-26T11:15:28.386 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3629999999999998e-06 2024-04-26T11:15:28.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.386 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.386 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.386 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350396+0000", 2024-04-26T11:15:28.386 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00081992199999999995 2024-04-26T11:15:28.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.386 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.387 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:28.387 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350516+0000", 2024-04-26T11:15:28.387 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012006900000000001 2024-04-26T11:15:28.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.387 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:28.387 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411924+0000", 2024-04-26T11:15:28.387 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061407960999999997 2024-04-26T11:15:28.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.387 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:28.387 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411947+0000", 2024-04-26T11:15:28.387 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2943999999999999e-05 2024-04-26T11:15:28.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.388 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:28.388 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412008+0000", 2024-04-26T11:15:28.388 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1237999999999999e-05 2024-04-26T11:15:28.388 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.388 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:28.388 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.388 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.388 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174397 5.7 5:e25daf9a:::benchmark_data_smithi029_44842_object29759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:28.388 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:28.388 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 37.931687171999997, 2024-04-26T11:15:28.388 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063878565999999998, 2024-04-26T11:15:28.388 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:28.389 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:28.389 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:28.389 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:28.389 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.389 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174397 2024-04-26T11:15:28.389 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.389 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:28.389 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.389 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:28.389 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:28.389 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.389 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.389 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.389 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:28.390 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:28.390 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.390 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.390 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:28.390 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349671+0000", 2024-04-26T11:15:28.390 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.390 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.390 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:28.390 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349674+0000", 2024-04-26T11:15:28.390 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3360000000000002e-06 2024-04-26T11:15:28.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.390 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.391 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:28.391 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349678+0000", 2024-04-26T11:15:28.391 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0709999999999996e-06 2024-04-26T11:15:28.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.391 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.391 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.391 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349681+0000", 2024-04-26T11:15:28.391 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3139999999999999e-06 2024-04-26T11:15:28.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.391 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.391 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.391 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410371+0000", 2024-04-26T11:15:28.391 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.060690202999999998 2024-04-26T11:15:28.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.392 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.392 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:28.392 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410463+0000", 2024-04-26T11:15:28.392 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2095000000000005e-05 2024-04-26T11:15:28.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.392 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.392 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:28.392 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413471+0000", 2024-04-26T11:15:28.392 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0030073909999999999 2024-04-26T11:15:28.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.392 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.392 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:28.392 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413499+0000", 2024-04-26T11:15:28.392 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8725e-05 2024-04-26T11:15:28.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.393 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.393 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:28.393 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413550+0000", 2024-04-26T11:15:28.393 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0810000000000003e-05 2024-04-26T11:15:28.393 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.393 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:28.393 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.393 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.393 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:174398 5.4 e46/16 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head v 46'10798, mlcod=46'10796)", 2024-04-26T11:15:28.393 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:28.393 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 37.931158961000001, 2024-04-26T11:15:28.393 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062067047, 2024-04-26T11:15:28.393 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:28.394 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:28.394 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:28.394 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.394 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:28.394 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:28.394 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.394 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.394 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:28.394 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:28.394 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:28.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.394 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.394 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:28.395 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350199+0000", 2024-04-26T11:15:28.395 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.395 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.395 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:28.395 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350205+0000", 2024-04-26T11:15:28.395 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6749999999999999e-06 2024-04-26T11:15:28.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.395 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.395 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:28.395 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350212+0000", 2024-04-26T11:15:28.395 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7000000000000002e-06 2024-04-26T11:15:28.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.395 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.395 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.395 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350216+0000", 2024-04-26T11:15:28.396 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5120000000000002e-06 2024-04-26T11:15:28.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.396 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.396 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:28.396 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350246+0000", 2024-04-26T11:15:28.396 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9978999999999999e-05 2024-04-26T11:15:28.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.396 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.396 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:28.396 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350263+0000", 2024-04-26T11:15:28.396 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.702e-05 2024-04-26T11:15:28.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.396 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.396 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:28.397 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412238+0000", 2024-04-26T11:15:28.397 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061974603000000003 2024-04-26T11:15:28.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:28.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:28.397 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:28.397 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412267+0000", 2024-04-26T11:15:28.397 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9116e-05 2024-04-26T11:15:28.397 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.397 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:28.397 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.397 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:28.397 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:28.397 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:28.398 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:15:28.399 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:15:28.400 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:28.400 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:28.397+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:15:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:15:28.401 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:15:28.401 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:15:28.499 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:28.497+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:28.543 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:28.544 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:15:28.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.544 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276736 5.8 5:11d71833:::benchmark_data_smithi029_44842_object132098:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:28.544 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.541676+0000", 2024-04-26T11:15:28.544 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00023295400000000001, 2024-04-26T11:15:28.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00026128399999999997, 2024-04-26T11:15:28.544 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:28.544 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:28.544 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:28.544 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:28.544 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.544 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276736 2024-04-26T11:15:28.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.545 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:28.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:28.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541676+0000", 2024-04-26T11:15:28.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:28.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541676+0000", 2024-04-26T11:15:28.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:28.545 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541675+0000", 2024-04-26T11:15:28.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:28.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541678+0000", 2024-04-26T11:15:28.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3440000000000001e-06 2024-04-26T11:15:28.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:28.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541686+0000", 2024-04-26T11:15:28.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5639999999999999e-06 2024-04-26T11:15:28.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541692+0000", 2024-04-26T11:15:28.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3539999999999996e-06 2024-04-26T11:15:28.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541730+0000", 2024-04-26T11:15:28.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7663999999999997e-05 2024-04-26T11:15:28.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:28.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541849+0000", 2024-04-26T11:15:28.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000118983 2024-04-26T11:15:28.547 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.548 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:28.548 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.548 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276737 5.b 5:db637b62:::benchmark_data_smithi029_44842_object132099:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:28.548 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.541758+0000", 2024-04-26T11:15:28.548 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00015011500000000001, 2024-04-26T11:15:28.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00026340000000000001, 2024-04-26T11:15:28.548 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:28.548 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:28.548 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:28.548 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:28.548 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.548 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276737 2024-04-26T11:15:28.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.549 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:28.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:28.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541758+0000", 2024-04-26T11:15:28.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:28.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541758+0000", 2024-04-26T11:15:28.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:28.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541758+0000", 2024-04-26T11:15:28.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:28.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541761+0000", 2024-04-26T11:15:28.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4860000000000002e-06 2024-04-26T11:15:28.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:28.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541769+0000", 2024-04-26T11:15:28.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4710000000000001e-06 2024-04-26T11:15:28.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541775+0000", 2024-04-26T11:15:28.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0769999999999996e-06 2024-04-26T11:15:28.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541810+0000", 2024-04-26T11:15:28.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5138999999999997e-05 2024-04-26T11:15:28.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:28.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541928+0000", 2024-04-26T11:15:28.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011804299999999999 2024-04-26T11:15:28.551 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.551 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:28.551 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.552 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276738 5.f 5:f79a3f63:::benchmark_data_smithi029_44842_object132100:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:28.552 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.541905+0000", 2024-04-26T11:15:28.552 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 3.8099999999999999e-06, 2024-04-26T11:15:28.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00020117400000000001, 2024-04-26T11:15:28.552 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:28.552 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:28.552 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:28.552 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:28.552 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.552 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276738 2024-04-26T11:15:28.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.552 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:28.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:28.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541905+0000", 2024-04-26T11:15:28.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:28.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541905+0000", 2024-04-26T11:15:28.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.553 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:28.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541904+0000", 2024-04-26T11:15:28.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:28.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:28.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541910+0000", 2024-04-26T11:15:28.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.818e-06 2024-04-26T11:15:28.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:28.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541919+0000", 2024-04-26T11:15:28.554 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4890000000000001e-06 2024-04-26T11:15:28.554 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.554 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.554 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.554 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541926+0000", 2024-04-26T11:15:28.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.934e-06 2024-04-26T11:15:28.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541963+0000", 2024-04-26T11:15:28.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6974000000000002e-05 2024-04-26T11:15:28.555 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.555 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.555 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:28.555 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.542072+0000", 2024-04-26T11:15:28.555 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108857 2024-04-26T11:15:28.555 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.555 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:28.555 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.556 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.556 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276721 5.0 5:0d4f3fcb:::benchmark_data_smithi029_44842_object132083:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:28.556 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.535647+0000", 2024-04-26T11:15:28.556 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0062619190000000003, 2024-04-26T11:15:28.556 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065221309999999996, 2024-04-26T11:15:28.556 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:28.556 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:28.556 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:28.556 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:28.556 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.556 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276721 2024-04-26T11:15:28.556 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.556 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:28.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:28.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.535647+0000", 2024-04-26T11:15:28.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:28.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.535647+0000", 2024-04-26T11:15:28.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.557 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.557 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.557 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:28.557 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.535646+0000", 2024-04-26T11:15:28.557 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.535648+0000", 2024-04-26T11:15:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.437e-06 2024-04-26T11:15:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.535653+0000", 2024-04-26T11:15:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8049999999999997e-06 2024-04-26T11:15:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.558 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.535656+0000", 2024-04-26T11:15:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.88e-06 2024-04-26T11:15:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.535687+0000", 2024-04-26T11:15:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1597000000000003e-05 2024-04-26T11:15:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.535795+0000", 2024-04-26T11:15:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108065 2024-04-26T11:15:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.559 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.535904+0000", 2024-04-26T11:15:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108399 2024-04-26T11:15:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541640+0000", 2024-04-26T11:15:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0057363889999999997 2024-04-26T11:15:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276724 5.b 5:dd40c1eb:::benchmark_data_smithi029_44842_object132086:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:28.560 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.535672+0000", 2024-04-26T11:15:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0062365320000000004, 2024-04-26T11:15:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0065701759999999996, 2024-04-26T11:15:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276724 2024-04-26T11:15:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.535672+0000", 2024-04-26T11:15:28.561 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.535672+0000", 2024-04-26T11:15:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.535672+0000", 2024-04-26T11:15:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.535674+0000", 2024-04-26T11:15:28.562 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1660000000000001e-06 2024-04-26T11:15:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.535681+0000", 2024-04-26T11:15:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8449999999999997e-06 2024-04-26T11:15:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.535686+0000", 2024-04-26T11:15:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4190000000000001e-06 2024-04-26T11:15:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.563 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.535722+0000", 2024-04-26T11:15:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6291000000000002e-05 2024-04-26T11:15:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.535845+0000", 2024-04-26T11:15:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012289500000000001 2024-04-26T11:15:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.535973+0000", 2024-04-26T11:15:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012763799999999999 2024-04-26T11:15:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.564 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.540355+0000", 2024-04-26T11:15:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004382408 2024-04-26T11:15:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276726 5.a 5:51f1974d:::benchmark_data_smithi029_44842_object132088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.535698+0000", 2024-04-26T11:15:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0062103130000000003, 2024-04-26T11:15:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00661606, 2024-04-26T11:15:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:28.565 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276726 2024-04-26T11:15:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.535698+0000", 2024-04-26T11:15:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.535698+0000", 2024-04-26T11:15:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.566 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.535698+0000", 2024-04-26T11:15:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.535700+0000", 2024-04-26T11:15:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.644e-06 2024-04-26T11:15:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.535707+0000", 2024-04-26T11:15:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.494e-06 2024-04-26T11:15:28.567 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.535712+0000", 2024-04-26T11:15:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.0499999999999999e-06 2024-04-26T11:15:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.537025+0000", 2024-04-26T11:15:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001312604 2024-04-26T11:15:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.537148+0000", 2024-04-26T11:15:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123905 2024-04-26T11:15:28.568 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.537267+0000", 2024-04-26T11:15:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000118433 2024-04-26T11:15:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541702+0000", 2024-04-26T11:15:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044352460000000003 2024-04-26T11:15:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.569 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276727 5.0 5:01b793ca:::benchmark_data_smithi029_44842_object132089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.538958+0000", 2024-04-26T11:15:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0029504890000000001, 2024-04-26T11:15:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00343203, 2024-04-26T11:15:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276727 2024-04-26T11:15:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.538958+0000", 2024-04-26T11:15:28.570 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.538958+0000", 2024-04-26T11:15:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.538957+0000", 2024-04-26T11:15:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.571 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.538962+0000", 2024-04-26T11:15:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7809999999999996e-06 2024-04-26T11:15:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.538973+0000", 2024-04-26T11:15:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0749e-05 2024-04-26T11:15:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.538980+0000", 2024-04-26T11:15:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.2130000000000002e-06 2024-04-26T11:15:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.572 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.539021+0000", 2024-04-26T11:15:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1122999999999999e-05 2024-04-26T11:15:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.539105+0000", 2024-04-26T11:15:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3599999999999999e-05 2024-04-26T11:15:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.539172+0000", 2024-04-26T11:15:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7445000000000002e-05 2024-04-26T11:15:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.573 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541871+0000", 2024-04-26T11:15:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0026989459999999998 2024-04-26T11:15:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276728 5.4 5:22b40949:::benchmark_data_smithi029_44842_object132090:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.539493+0000", 2024-04-26T11:15:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.002415731, 2024-04-26T11:15:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0029521209999999998, 2024-04-26T11:15:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:28.574 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276728 2024-04-26T11:15:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.539493+0000", 2024-04-26T11:15:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.539493+0000", 2024-04-26T11:15:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.575 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.539492+0000", 2024-04-26T11:15:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.539495+0000", 2024-04-26T11:15:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6359999999999998e-06 2024-04-26T11:15:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.539500+0000", 2024-04-26T11:15:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7949999999999998e-06 2024-04-26T11:15:28.576 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.539503+0000", 2024-04-26T11:15:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.546e-06 2024-04-26T11:15:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.539541+0000", 2024-04-26T11:15:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7731000000000002e-05 2024-04-26T11:15:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.539665+0000", 2024-04-26T11:15:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012379399999999999 2024-04-26T11:15:28.577 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.539783+0000", 2024-04-26T11:15:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011769699999999999 2024-04-26T11:15:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541898+0000", 2024-04-26T11:15:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0021153399999999998 2024-04-26T11:15:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.578 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276731 5.9 5:9a113beb:::benchmark_data_smithi029_44842_object132093:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.541513+0000", 2024-04-26T11:15:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00039542199999999998, 2024-04-26T11:15:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097591900000000001, 2024-04-26T11:15:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276731 2024-04-26T11:15:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541513+0000", 2024-04-26T11:15:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.579 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541513+0000", 2024-04-26T11:15:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541513+0000", 2024-04-26T11:15:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541515+0000", 2024-04-26T11:15:28.580 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6649999999999999e-06 2024-04-26T11:15:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541522+0000", 2024-04-26T11:15:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2230000000000004e-06 2024-04-26T11:15:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541526+0000", 2024-04-26T11:15:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2640000000000002e-06 2024-04-26T11:15:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541564+0000", 2024-04-26T11:15:28.581 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7834999999999999e-05 2024-04-26T11:15:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541676+0000", 2024-04-26T11:15:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011204 2024-04-26T11:15:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276732 5.d 5:b9f66b65:::benchmark_data_smithi029_44842_object132094:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.541533+0000", 2024-04-26T11:15:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.000376005, 2024-04-26T11:15:28.582 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00099327300000000003, 2024-04-26T11:15:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276732 2024-04-26T11:15:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541533+0000", 2024-04-26T11:15:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.583 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541533+0000", 2024-04-26T11:15:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541532+0000", 2024-04-26T11:15:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541534+0000", 2024-04-26T11:15:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0849999999999999e-06 2024-04-26T11:15:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.584 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541540+0000", 2024-04-26T11:15:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.5860000000000004e-06 2024-04-26T11:15:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541545+0000", 2024-04-26T11:15:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8069999999999999e-06 2024-04-26T11:15:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541583+0000", 2024-04-26T11:15:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8111999999999997e-05 2024-04-26T11:15:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.585 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.586 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:28.586 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.541677+0000", 2024-04-26T11:15:28.586 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4104999999999994e-05 2024-04-26T11:15:28.586 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.586 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:28.586 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.586 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.586 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:15:28.586 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 10 2024-04-26T11:15:28.586 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:28.587 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:28.600 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:28.598+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:28.701 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:28.699+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:28.753 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:28.753 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:15:28.753 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:15:28.753 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:15:28.753 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:28.766 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:28.809 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:28.808+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:28.903 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:28.901+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:28.935 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:28.935 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:15:28.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:15:28.935 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:15:28.935 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.935 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:28.935 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:28.935 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.653321105000003, 2024-04-26T11:15:28.935 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:15:28.936 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:28.936 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:28.936 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:28.936 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:28.936 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.936 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:15:28.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.936 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:28.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.936 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:28.936 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:28.936 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.936 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.936 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:28.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:28.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:28.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:28.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.937 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.937 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:28.937 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:15:28.937 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:15:28.937 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:28.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:15:28.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:15:28.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:15:28.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:15:28.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.938 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.938 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.938 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:15:28.938 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:15:28.938 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:28.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:15:28.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:15:28.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:28.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:15:28.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:15:28.939 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.939 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.939 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:28.939 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:15:28.939 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:15:28.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:28.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:15:28.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:15:28.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:28.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:15:28.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:15:28.940 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.940 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.940 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:28.940 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:15:28.940 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:15:28.941 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.941 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:28.941 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.941 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.941 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.941 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:28.941 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:28.941 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.652671402999999, 2024-04-26T11:15:28.941 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:15:28.941 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:28.941 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:28.941 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:28.941 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:28.941 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.942 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:15:28.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.942 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:28.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:28.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:28.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:28.942 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:28.942 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.942 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.942 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.942 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:28.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:15:28.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:28.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:28.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:15:28.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:15:28.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.943 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:28.943 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:15:28.943 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:15:28.943 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.943 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:15:28.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:15:28.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:15:28.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:15:28.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.944 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:28.944 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:15:28.944 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:15:28.944 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.944 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:28.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:15:28.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:15:28.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:28.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:15:28.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:15:28.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.945 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.945 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:28.945 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:15:28.945 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:15:28.945 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:28.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:15:28.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:15:28.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.946 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:28.946 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:15:28.946 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:15:28.946 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.946 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:28.946 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.946 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.946 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.946 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:28.947 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:28.947 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.586029363999998, 2024-04-26T11:15:28.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:15:28.947 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:28.947 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:28.947 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:28.947 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:28.947 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.947 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:15:28.947 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.947 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:28.947 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.947 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:28.947 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:28.947 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:28.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:28.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:28.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:15:28.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:28.948 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.948 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.948 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:28.948 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:15:28.948 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:15:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:15:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:15:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:15:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:15:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:15:28.949 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:15:28.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:28.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:15:28.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:15:28.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.950 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.950 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:15:28.950 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:15:28.950 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.950 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:15:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:15:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.585933718000007, 2024-04-26T11:15:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:15:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:28.951 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:15:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.952 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:15:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:15:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:15:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.953 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:15:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:15:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:15:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:15:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:15:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:15:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.954 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:15:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:15:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:15:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:15:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:15:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:15:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.955 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.585802039000001, 2024-04-26T11:15:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:15:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:15:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.956 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.957 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:15:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:15:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:15:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:15:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:15:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:15:28.958 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:15:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:15:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:15:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:15:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:15:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:15:28.959 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:15:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:15:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.585693582999994, 2024-04-26T11:15:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:15:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:28.960 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:15:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:28.961 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:15:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:15:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:15:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:28.962 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:15:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:15:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:15:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:15:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:15:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:15:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:28.963 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:15:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:15:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:15:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:15:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:15:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:15:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:28.964 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.585592315, 2024-04-26T11:15:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:15:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:15:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:28.965 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.966 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:15:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:15:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:15:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:15:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:15:28.967 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:15:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:15:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:15:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:15:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:15:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.968 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:15:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:15:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:15:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:15:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:15:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:15:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.969 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:28.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:15:28.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:15:28.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.970 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:28.970 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:15:28.970 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:15:28.970 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.970 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:28.970 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.970 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.970 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.585523374000005, 2024-04-26T11:15:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:15:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:15:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:28.971 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:15:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:28.972 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:15:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:15:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:15:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:15:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:15:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:15:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.973 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:15:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:15:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:15:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:15:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:15:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:15:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.974 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:15:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:15:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:15:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:15:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:15:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:15:28.975 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:15:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:15:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 91.579527792999997, 2024-04-26T11:15:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:15:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:28.976 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:15:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:28.977 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:15:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:15:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:15:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.978 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:15:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:15:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:15:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:15:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:15:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:15:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.979 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:15:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:15:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:15:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:15:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:15:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:15:28.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:15:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:15:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:15:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:15:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:15:28.981 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:15:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174398 5.4 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 38.582221144000002, 2024-04-26T11:15:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.064773789999999998, 2024-04-26T11:15:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:28.982 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174398 2024-04-26T11:15:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349889+0000", 2024-04-26T11:15:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349895+0000", 2024-04-26T11:15:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4519999999999996e-06 2024-04-26T11:15:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349909+0000", 2024-04-26T11:15:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3791000000000001e-05 2024-04-26T11:15:28.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349919+0000", 2024-04-26T11:15:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0135999999999999e-05 2024-04-26T11:15:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349956+0000", 2024-04-26T11:15:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7642000000000003e-05 2024-04-26T11:15:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350080+0000", 2024-04-26T11:15:28.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123285 2024-04-26T11:15:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350192+0000", 2024-04-26T11:15:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112509 2024-04-26T11:15:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356232+0000", 2024-04-26T11:15:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060403339999999996 2024-04-26T11:15:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414616+0000", 2024-04-26T11:15:28.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.058383156999999998 2024-04-26T11:15:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414643+0000", 2024-04-26T11:15:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7317e-05 2024-04-26T11:15:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414664+0000", 2024-04-26T11:15:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1135999999999999e-05 2024-04-26T11:15:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276551 5.a 5:5533d612:::benchmark_data_smithi029_44842_object131913:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.375399+0000", 2024-04-26T11:15:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.556712753, 2024-04-26T11:15:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.101897644, 2024-04-26T11:15:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276551 2024-04-26T11:15:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:28.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375399+0000", 2024-04-26T11:15:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375399+0000", 2024-04-26T11:15:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375398+0000", 2024-04-26T11:15:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375400+0000", 2024-04-26T11:15:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7230000000000001e-06 2024-04-26T11:15:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375404+0000", 2024-04-26T11:15:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4929999999999998e-06 2024-04-26T11:15:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375406+0000", 2024-04-26T11:15:28.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.74e-06 2024-04-26T11:15:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375447+0000", 2024-04-26T11:15:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0368999999999999e-05 2024-04-26T11:15:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375574+0000", 2024-04-26T11:15:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012730099999999999 2024-04-26T11:15:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375690+0000", 2024-04-26T11:15:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000115512 2024-04-26T11:15:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.380112+0000", 2024-04-26T11:15:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044225979999999998 2024-04-26T11:15:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477209+0000", 2024-04-26T11:15:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.097096846000000001 2024-04-26T11:15:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477250+0000", 2024-04-26T11:15:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1458000000000002e-05 2024-04-26T11:15:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477296+0000", 2024-04-26T11:15:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.587e-05 2024-04-26T11:15:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.993 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276552 5.8 5:12bf19e5:::benchmark_data_smithi029_44842_object131914:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.375412+0000", 2024-04-26T11:15:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.55669915999999997, 2024-04-26T11:15:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10418100700000001, 2024-04-26T11:15:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276552 2024-04-26T11:15:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:28.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375412+0000", 2024-04-26T11:15:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375412+0000", 2024-04-26T11:15:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375412+0000", 2024-04-26T11:15:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375414+0000", 2024-04-26T11:15:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0729999999999999e-06 2024-04-26T11:15:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375420+0000", 2024-04-26T11:15:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4759999999999997e-06 2024-04-26T11:15:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375422+0000", 2024-04-26T11:15:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8540000000000001e-06 2024-04-26T11:15:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377480+0000", 2024-04-26T11:15:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020577540000000002 2024-04-26T11:15:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377569+0000", 2024-04-26T11:15:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8406999999999996e-05 2024-04-26T11:15:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377630+0000", 2024-04-26T11:15:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1632999999999998e-05 2024-04-26T11:15:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479495+0000", 2024-04-26T11:15:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10186533 2024-04-26T11:15:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479508+0000", 2024-04-26T11:15:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-05 2024-04-26T11:15:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479554+0000", 2024-04-26T11:15:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6696999999999997e-05 2024-04-26T11:15:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479593+0000", 2024-04-26T11:15:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9059e-05 2024-04-26T11:15:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276554 5.e 5:7d1a16ce:::benchmark_data_smithi029_44842_object131916:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.375499+0000", 2024-04-26T11:15:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.55661225000000003, 2024-04-26T11:15:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10207537799999999, 2024-04-26T11:15:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:28.999 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276554 2024-04-26T11:15:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375499+0000", 2024-04-26T11:15:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375499+0000", 2024-04-26T11:15:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:29.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375498+0000", 2024-04-26T11:15:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375505+0000", 2024-04-26T11:15:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0839999999999997e-06 2024-04-26T11:15:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375512+0000", 2024-04-26T11:15:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3270000000000003e-06 2024-04-26T11:15:29.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375518+0000", 2024-04-26T11:15:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0619999999999997e-06 2024-04-26T11:15:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375578+0000", 2024-04-26T11:15:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0090999999999998e-05 2024-04-26T11:15:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375687+0000", 2024-04-26T11:15:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108933 2024-04-26T11:15:29.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375785+0000", 2024-04-26T11:15:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7744000000000005e-05 2024-04-26T11:15:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477165+0000", 2024-04-26T11:15:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10138062 2024-04-26T11:15:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477366+0000", 2024-04-26T11:15:29.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200526 2024-04-26T11:15:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477411+0000", 2024-04-26T11:15:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4684000000000001e-05 2024-04-26T11:15:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477575+0000", 2024-04-26T11:15:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000164029 2024-04-26T11:15:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276557 5.b 5:d2a87415:::benchmark_data_smithi029_44842_object131919:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.377684+0000", 2024-04-26T11:15:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.55442767999999998, 2024-04-26T11:15:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.099794806, 2024-04-26T11:15:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276557 2024-04-26T11:15:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377684+0000", 2024-04-26T11:15:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377684+0000", 2024-04-26T11:15:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377683+0000", 2024-04-26T11:15:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377687+0000", 2024-04-26T11:15:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5140000000000002e-06 2024-04-26T11:15:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377693+0000", 2024-04-26T11:15:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3609999999999997e-06 2024-04-26T11:15:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377701+0000", 2024-04-26T11:15:29.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0960000000000001e-06 2024-04-26T11:15:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377726+0000", 2024-04-26T11:15:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4635e-05 2024-04-26T11:15:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377795+0000", 2024-04-26T11:15:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8866000000000001e-05 2024-04-26T11:15:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:29.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377854+0000", 2024-04-26T11:15:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9781000000000002e-05 2024-04-26T11:15:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477243+0000", 2024-04-26T11:15:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.099388958999999999 2024-04-26T11:15:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477397+0000", 2024-04-26T11:15:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015366499999999999 2024-04-26T11:15:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477439+0000", 2024-04-26T11:15:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2432999999999998e-05 2024-04-26T11:15:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477479+0000", 2024-04-26T11:15:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9172999999999999e-05 2024-04-26T11:15:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276559 5.e 5:77601908:::benchmark_data_smithi029_44842_object131921:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:29.010 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.378420+0000", 2024-04-26T11:15:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.55369099499999996, 2024-04-26T11:15:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.101361861, 2024-04-26T11:15:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276559 2024-04-26T11:15:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378420+0000", 2024-04-26T11:15:29.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378420+0000", 2024-04-26T11:15:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378420+0000", 2024-04-26T11:15:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:29.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378422+0000", 2024-04-26T11:15:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.441e-06 2024-04-26T11:15:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378429+0000", 2024-04-26T11:15:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7909999999999999e-06 2024-04-26T11:15:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378434+0000", 2024-04-26T11:15:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3699999999999997e-06 2024-04-26T11:15:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:29.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378460+0000", 2024-04-26T11:15:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6205000000000001e-05 2024-04-26T11:15:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378553+0000", 2024-04-26T11:15:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2931999999999997e-05 2024-04-26T11:15:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378629+0000", 2024-04-26T11:15:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6558999999999997e-05 2024-04-26T11:15:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477294+0000", 2024-04-26T11:15:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.098665186000000002 2024-04-26T11:15:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479725+0000", 2024-04-26T11:15:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024302579999999998 2024-04-26T11:15:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479750+0000", 2024-04-26T11:15:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5349000000000001e-05 2024-04-26T11:15:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479782+0000", 2024-04-26T11:15:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2221999999999997e-05 2024-04-26T11:15:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276561 5.8 5:1f9b90aa:::benchmark_data_smithi029_44842_object131923:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.378765+0000", 2024-04-26T11:15:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.55334688200000004, 2024-04-26T11:15:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.100953418, 2024-04-26T11:15:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:29.016 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276561 2024-04-26T11:15:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378765+0000", 2024-04-26T11:15:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378765+0000", 2024-04-26T11:15:29.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378764+0000", 2024-04-26T11:15:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378767+0000", 2024-04-26T11:15:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.546e-06 2024-04-26T11:15:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378776+0000", 2024-04-26T11:15:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9309999999999997e-06 2024-04-26T11:15:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378783+0000", 2024-04-26T11:15:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.691e-06 2024-04-26T11:15:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378888+0000", 2024-04-26T11:15:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010509999999999999 2024-04-26T11:15:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378953+0000", 2024-04-26T11:15:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4867000000000001e-05 2024-04-26T11:15:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379114+0000", 2024-04-26T11:15:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000161395 2024-04-26T11:15:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479601+0000", 2024-04-26T11:15:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10048657699999999 2024-04-26T11:15:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479631+0000", 2024-04-26T11:15:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0514999999999998e-05 2024-04-26T11:15:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479677+0000", 2024-04-26T11:15:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5504999999999999e-05 2024-04-26T11:15:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479718+0000", 2024-04-26T11:15:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1013000000000002e-05 2024-04-26T11:15:29.021 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276563 5.0 5:098fc0d9:::benchmark_data_smithi029_44842_object131925:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.378996+0000", 2024-04-26T11:15:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.55311521799999996, 2024-04-26T11:15:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.100680769, 2024-04-26T11:15:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:29.022 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276563 2024-04-26T11:15:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378996+0000", 2024-04-26T11:15:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378996+0000", 2024-04-26T11:15:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:29.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378996+0000", 2024-04-26T11:15:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378999+0000", 2024-04-26T11:15:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6909999999999999e-06 2024-04-26T11:15:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379007+0000", 2024-04-26T11:15:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9519999999999994e-06 2024-04-26T11:15:29.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379013+0000", 2024-04-26T11:15:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:15:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379044+0000", 2024-04-26T11:15:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0546999999999997e-05 2024-04-26T11:15:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379148+0000", 2024-04-26T11:15:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010414199999999999 2024-04-26T11:15:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379245+0000", 2024-04-26T11:15:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7106000000000002e-05 2024-04-26T11:15:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479481+0000", 2024-04-26T11:15:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10023639500000001 2024-04-26T11:15:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479607+0000", 2024-04-26T11:15:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012559999999999999 2024-04-26T11:15:29.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479644+0000", 2024-04-26T11:15:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7323999999999997e-05 2024-04-26T11:15:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479677+0000", 2024-04-26T11:15:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2787999999999998e-05 2024-04-26T11:15:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.027 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276564 5.8 5:16aef732:::benchmark_data_smithi029_44842_object131926:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.381311+0000", 2024-04-26T11:15:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.55080091099999995, 2024-04-26T11:15:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.101656785, 2024-04-26T11:15:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276564 2024-04-26T11:15:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381311+0000", 2024-04-26T11:15:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381311+0000", 2024-04-26T11:15:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381309+0000", 2024-04-26T11:15:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:15:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381319+0000", 2024-04-26T11:15:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0186e-05 2024-04-26T11:15:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381337+0000", 2024-04-26T11:15:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7833e-05 2024-04-26T11:15:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381350+0000", 2024-04-26T11:15:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2563e-05 2024-04-26T11:15:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381478+0000", 2024-04-26T11:15:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012802899999999999 2024-04-26T11:15:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477201+0000", 2024-04-26T11:15:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.095722990999999993 2024-04-26T11:15:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477332+0000", 2024-04-26T11:15:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000131478 2024-04-26T11:15:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.481980+0000", 2024-04-26T11:15:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0046472670000000001 2024-04-26T11:15:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.482887+0000", 2024-04-26T11:15:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00090784299999999997 2024-04-26T11:15:29.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.482933+0000", 2024-04-26T11:15:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6050000000000001e-05 2024-04-26T11:15:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.482967+0000", 2024-04-26T11:15:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3868000000000002e-05 2024-04-26T11:15:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276566 5.d 5:bb7a4c9f:::benchmark_data_smithi029_44842_object131928:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.381378+0000", 2024-04-26T11:15:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.55073326, 2024-04-26T11:15:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.099107009999999995, 2024-04-26T11:15:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276566 2024-04-26T11:15:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381378+0000", 2024-04-26T11:15:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381378+0000", 2024-04-26T11:15:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381378+0000", 2024-04-26T11:15:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381380+0000", 2024-04-26T11:15:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9870000000000002e-06 2024-04-26T11:15:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381383+0000", 2024-04-26T11:15:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3440000000000001e-06 2024-04-26T11:15:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381386+0000", 2024-04-26T11:15:29.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9050000000000001e-06 2024-04-26T11:15:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381410+0000", 2024-04-26T11:15:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3589000000000001e-05 2024-04-26T11:15:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381488+0000", 2024-04-26T11:15:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8449999999999996e-05 2024-04-26T11:15:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.480404+0000", 2024-04-26T11:15:29.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.098916199999999996 2024-04-26T11:15:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.480432+0000", 2024-04-26T11:15:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7328999999999999e-05 2024-04-26T11:15:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.480485+0000", 2024-04-26T11:15:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3464000000000002e-05 2024-04-26T11:15:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:29.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(client.4534.0:276554 5.e e59/16 ondisk, result = 0)", 2024-04-26T11:15:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.382088+0000", 2024-04-26T11:15:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.55002337700000004, 2024-04-26T11:15:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.095081035999999994, 2024-04-26T11:15:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.382088+0000", 2024-04-26T11:15:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:29.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.382088+0000", 2024-04-26T11:15:29.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:29.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:29.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.382086+0000", 2024-04-26T11:15:29.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:15:29.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.040 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:29.040 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.382097+0000", 2024-04-26T11:15:29.040 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.041e-05 2024-04-26T11:15:29.040 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.040 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477080+0000", 2024-04-26T11:15:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.094983337000000001 2024-04-26T11:15:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477099+0000", 2024-04-26T11:15:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9040000000000001e-05 2024-04-26T11:15:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477148+0000", 2024-04-26T11:15:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8497e-05 2024-04-26T11:15:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.041 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477159+0000", 2024-04-26T11:15:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0933e-05 2024-04-26T11:15:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477169+0000", 2024-04-26T11:15:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0379e-05 2024-04-26T11:15:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:29.042 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:29.042 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:29.044 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:29.042+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:29.044 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:29.144 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:29.142+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:29.229 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:29.230 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:15:29.230 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.230 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:278536 5.6 5:662c26d5:::benchmark_data_smithi029_44842_object133898:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:29.230 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:29.223079+0000", 2024-04-26T11:15:29.230 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0051142499999999999, 2024-04-26T11:15:29.230 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.005135962, 2024-04-26T11:15:29.230 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.230 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:29.230 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:29.230 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:29.230 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.230 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 278536 2024-04-26T11:15:29.230 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.231 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.231 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.231 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.231 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.223079+0000", 2024-04-26T11:15:29.231 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.231 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.231 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.231 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.231 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.223079+0000", 2024-04-26T11:15:29.231 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.231 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.231 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.232 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.232 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.223078+0000", 2024-04-26T11:15:29.232 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:29.232 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.232 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.232 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.232 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.223081+0000", 2024-04-26T11:15:29.232 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6699999999999998e-06 2024-04-26T11:15:29.232 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.232 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.232 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.232 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.223089+0000", 2024-04-26T11:15:29.232 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.1149999999999994e-06 2024-04-26T11:15:29.232 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.233 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.233 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.233 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.223095+0000", 2024-04-26T11:15:29.233 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8599999999999998e-06 2024-04-26T11:15:29.233 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.233 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.233 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.233 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.225070+0000", 2024-04-26T11:15:29.233 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019753769999999999 2024-04-26T11:15:29.233 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.233 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.233 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.233 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.225185+0000", 2024-04-26T11:15:29.233 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00011472999999999999 2024-04-26T11:15:29.234 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.234 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.234 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.234 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.234 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.234 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:278531 5.0 e59/16 5:0e68fff5:::benchmark_data_smithi029_44842_object133893:head v 59'17682, mlcod=59'17678)", 2024-04-26T11:15:29.234 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:29.224491+0000", 2024-04-26T11:15:29.234 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0037021670000000001, 2024-04-26T11:15:29.234 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.003769522, 2024-04-26T11:15:29.234 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.234 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:29.234 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.234 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.235 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.235 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.224491+0000", 2024-04-26T11:15:29.235 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.235 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.235 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.235 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.224491+0000", 2024-04-26T11:15:29.235 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.235 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.235 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.235 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.224490+0000", 2024-04-26T11:15:29.235 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:29.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.236 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.236 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.236 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.224496+0000", 2024-04-26T11:15:29.236 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9719999999999997e-06 2024-04-26T11:15:29.236 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.236 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.236 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.236 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.224508+0000", 2024-04-26T11:15:29.236 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1846e-05 2024-04-26T11:15:29.236 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.236 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.237 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.237 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.224514+0000", 2024-04-26T11:15:29.237 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.3890000000000002e-06 2024-04-26T11:15:29.237 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.237 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.237 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.237 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.224544+0000", 2024-04-26T11:15:29.237 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9802e-05 2024-04-26T11:15:29.237 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.237 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.237 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.238 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.224561+0000", 2024-04-26T11:15:29.238 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6705e-05 2024-04-26T11:15:29.238 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.238 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.238 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.238 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.238 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.238 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:278539 5.e e59/16 5:7fdbfd01:::benchmark_data_smithi029_44842_object133901:head v 59'17377, mlcod=59'17374)", 2024-04-26T11:15:29.238 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:29.224757+0000", 2024-04-26T11:15:29.238 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0034354590000000001, 2024-04-26T11:15:29.238 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0035373890000000002, 2024-04-26T11:15:29.238 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.238 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:29.239 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.239 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.239 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.239 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.224757+0000", 2024-04-26T11:15:29.239 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.239 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.239 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.239 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.224757+0000", 2024-04-26T11:15:29.239 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.239 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.239 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.239 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.224757+0000", 2024-04-26T11:15:29.239 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:29.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.240 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.240 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.240 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.224762+0000", 2024-04-26T11:15:29.240 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4310000000000002e-06 2024-04-26T11:15:29.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.240 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.240 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.240 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.224778+0000", 2024-04-26T11:15:29.240 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.6084000000000001e-05 2024-04-26T11:15:29.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.240 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.240 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.240 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.224785+0000", 2024-04-26T11:15:29.240 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8170000000000001e-06 2024-04-26T11:15:29.241 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.241 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.241 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.241 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.225061+0000", 2024-04-26T11:15:29.241 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000275412 2024-04-26T11:15:29.241 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.241 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.241 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.241 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.225078+0000", 2024-04-26T11:15:29.241 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7410000000000001e-05 2024-04-26T11:15:29.241 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.241 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.241 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.241 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.241 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.242 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:278540 5.7 5:ef601775:::benchmark_data_smithi029_44842_object133902:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:29.242 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:29.225058+0000", 2024-04-26T11:15:29.242 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0031343629999999998, 2024-04-26T11:15:29.242 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0032711419999999999, 2024-04-26T11:15:29.242 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.242 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:29.242 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:29.242 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:29.242 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.242 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 278540 2024-04-26T11:15:29.242 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.242 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.242 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.243 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.243 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.225058+0000", 2024-04-26T11:15:29.243 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.243 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.243 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.243 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.243 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.225058+0000", 2024-04-26T11:15:29.243 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.243 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.243 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.243 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.243 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.225058+0000", 2024-04-26T11:15:29.243 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:29.243 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.244 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.244 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.244 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.225063+0000", 2024-04-26T11:15:29.244 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1070000000000004e-06 2024-04-26T11:15:29.244 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.244 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.244 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.244 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.225073+0000", 2024-04-26T11:15:29.244 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0818e-05 2024-04-26T11:15:29.244 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.244 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.244 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.244 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.225081+0000", 2024-04-26T11:15:29.244 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9060000000000002e-06 2024-04-26T11:15:29.245 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.245 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.245 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.245 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.225121+0000", 2024-04-26T11:15:29.245 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0009999999999998e-05 2024-04-26T11:15:29.245 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.245 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.245 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.245 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.225258+0000", 2024-04-26T11:15:29.245 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013658600000000001 2024-04-26T11:15:29.245 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.245 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.245 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.245 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.246 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.246 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:278537 5.0 e59/16 5:083f7eaa:::benchmark_data_smithi029_44842_object133899:head v 59'17683, mlcod=59'17678)", 2024-04-26T11:15:29.246 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:29.225104+0000", 2024-04-26T11:15:29.246 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.0030887340000000001, 2024-04-26T11:15:29.246 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0032634809999999999, 2024-04-26T11:15:29.246 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.246 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:29.246 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.246 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.246 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.246 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.225104+0000", 2024-04-26T11:15:29.247 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.247 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.247 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.247 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.247 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.225104+0000", 2024-04-26T11:15:29.247 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.247 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.247 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.247 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.247 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.225104+0000", 2024-04-26T11:15:29.247 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:29.247 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.247 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.247 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.247 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.225109+0000", 2024-04-26T11:15:29.248 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8659999999999997e-06 2024-04-26T11:15:29.248 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.248 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.248 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.248 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.225117+0000", 2024-04-26T11:15:29.248 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.1880000000000002e-06 2024-04-26T11:15:29.248 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.248 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.248 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.248 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.225122+0000", 2024-04-26T11:15:29.248 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6679999999999998e-06 2024-04-26T11:15:29.248 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.248 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.248 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.249 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.226104+0000", 2024-04-26T11:15:29.249 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00098162599999999998 2024-04-26T11:15:29.249 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.249 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.249 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.249 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.226122+0000", 2024-04-26T11:15:29.249 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.7827000000000001e-05 2024-04-26T11:15:29.249 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.249 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.249 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.249 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.249 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.249 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:278543 5.8 e59/16 5:1a637654:::benchmark_data_smithi029_44842_object133905:head v 59'17427, mlcod=59'17425)", 2024-04-26T11:15:29.249 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:29.227302+0000", 2024-04-26T11:15:29.250 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.000890375, 2024-04-26T11:15:29.250 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001109947, 2024-04-26T11:15:29.250 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.250 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:29.250 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.250 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.250 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.250 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.227302+0000", 2024-04-26T11:15:29.250 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.250 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.250 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.250 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.250 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.227302+0000", 2024-04-26T11:15:29.250 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.251 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.251 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.251 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.227302+0000", 2024-04-26T11:15:29.251 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:29.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.251 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.251 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.251 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.227308+0000", 2024-04-26T11:15:29.251 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.767e-06 2024-04-26T11:15:29.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.251 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.251 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.251 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.227319+0000", 2024-04-26T11:15:29.251 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1467999999999999e-05 2024-04-26T11:15:29.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.252 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.252 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.252 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.227326+0000", 2024-04-26T11:15:29.252 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.4850000000000003e-06 2024-04-26T11:15:29.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.252 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.252 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.252 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.227389+0000", 2024-04-26T11:15:29.252 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.2817999999999994e-05 2024-04-26T11:15:29.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.252 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.252 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.252 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.227400+0000", 2024-04-26T11:15:29.252 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0614e-05 2024-04-26T11:15:29.253 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.253 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.253 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.253 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.253 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.253 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:278545 5.0 e59/16 5:08041d9a:::benchmark_data_smithi029_44842_object133907:head v 59'17684, mlcod=59'17678)", 2024-04-26T11:15:29.253 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:15:29.227461+0000", 2024-04-26T11:15:29.253 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 0.00073203799999999996, 2024-04-26T11:15:29.253 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0010089210000000001, 2024-04-26T11:15:29.253 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.253 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "started", 2024-04-26T11:15:29.253 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.253 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.253 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.254 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.227461+0000", 2024-04-26T11:15:29.254 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.254 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.254 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.254 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.254 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.227461+0000", 2024-04-26T11:15:29.254 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.254 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.254 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.254 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.254 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.227460+0000", 2024-04-26T11:15:29.254 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:29.254 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.254 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.255 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.255 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.227465+0000", 2024-04-26T11:15:29.255 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.13e-06 2024-04-26T11:15:29.255 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.255 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.255 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.255 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.227476+0000", 2024-04-26T11:15:29.255 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0608000000000001e-05 2024-04-26T11:15:29.255 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.255 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.255 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.255 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.227482+0000", 2024-04-26T11:15:29.255 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1940000000000003e-06 2024-04-26T11:15:29.255 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.256 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.256 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.256 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.227522+0000", 2024-04-26T11:15:29.256 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9894999999999997e-05 2024-04-26T11:15:29.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.256 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.256 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.256 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:15:29.227542+0000", 2024-04-26T11:15:29.256 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0029000000000001e-05 2024-04-26T11:15:29.256 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.256 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.256 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.256 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.256 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-04-26T11:15:29.256 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 7 2024-04-26T11:15:29.257 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:29.258 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:29.256+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:29.258 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:29.358 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:29.357+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:29.459 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:29.457+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:29.490 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:29.490 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:15:29.490 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:15:29.490 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:15:29.490 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:29.505 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:29.559 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:29.558+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:29.661 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:29.659+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:29.704 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:29.704 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:15:29.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:15:29.704 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:15:29.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.704 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:29.704 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:29.704 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 96.429481218000006, 2024-04-26T11:15:29.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:15:29.705 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.705 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:29.705 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:29.705 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:29.705 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.705 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:15:29.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.705 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:29.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:29.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:15:29.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:29.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:15:29.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:15:29.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:15:29.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:15:29.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:15:29.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:15:29.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:15:29.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:15:29.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:15:29.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:15:29.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:29.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:15:29.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:15:29.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:29.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:15:29.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:15:29.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:29.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:15:29.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:15:29.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:29.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:15:29.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:15:29.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:29.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:15:29.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:15:29.710 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.710 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.710 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.710 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:29.710 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:29.710 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 96.428669653, 2024-04-26T11:15:29.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:15:29.710 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.711 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:29.711 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:29.711 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:29.711 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.711 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:15:29.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.711 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.711 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.711 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:29.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.711 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.711 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:29.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:29.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:29.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:15:29.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:15:29.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:15:29.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:15:29.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:15:29.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:15:29.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:15:29.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:15:29.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:15:29.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:15:29.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:29.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:15:29.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:15:29.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:29.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:15:29.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:15:29.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:29.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:15:29.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:15:29.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:29.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:15:29.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:15:29.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:29.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:15:29.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:15:29.716 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.716 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.716 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.716 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:29.716 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:29.716 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 96.421482815999994, 2024-04-26T11:15:29.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:15:29.716 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.716 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:29.716 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:29.717 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:29.717 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.717 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:15:29.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.717 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:29.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:29.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:15:29.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:29.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:15:29.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:15:29.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:15:29.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:15:29.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:15:29.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:15:29.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:15:29.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:15:29.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:15:29.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:15:29.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:29.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:15:29.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:15:29.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:29.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:15:29.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:15:29.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:29.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:15:29.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:15:29.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:29.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:15:29.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:15:29.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:29.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:15:29.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:15:29.722 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.722 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.722 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.722 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:29.722 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:29.722 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 96.420941936999995, 2024-04-26T11:15:29.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:15:29.722 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.722 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:29.722 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:29.722 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:29.722 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.723 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:15:29.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.723 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:29.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:29.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:29.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:29.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:15:29.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:15:29.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:15:29.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:15:29.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:15:29.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:15:29.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:15:29.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:15:29.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:15:29.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:15:29.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:29.726 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:15:29.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:15:29.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:29.726 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:15:29.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:15:29.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:29.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:15:29.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:15:29.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:29.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:15:29.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:15:29.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:29.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:15:29.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:15:29.727 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.727 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.728 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.728 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:29.728 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:29.728 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 92.377757489999993, 2024-04-26T11:15:29.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:15:29.728 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.728 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:29.728 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:29.728 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:29.728 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.728 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:15:29.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.728 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:29.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:29.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:15:29.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:29.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:15:29.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:15:29.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:15:29.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:15:29.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:15:29.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:15:29.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:15:29.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:15:29.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:15:29.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:15:29.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:29.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:15:29.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:15:29.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:29.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:15:29.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:15:29.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:15:29.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:15:29.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:29.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:15:29.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:15:29.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:15:29.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:15:29.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:29.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:15:29.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:15:29.734 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.734 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.734 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.734 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:29.734 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:29.734 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 92.375564150000002, 2024-04-26T11:15:29.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:15:29.734 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.734 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:29.734 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:29.735 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:29.735 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.735 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:15:29.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.735 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:29.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:29.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:15:29.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:29.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:15:29.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:15:29.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:15:29.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:15:29.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:15:29.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:15:29.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:15:29.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:15:29.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:15:29.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:15:29.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:29.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:15:29.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:15:29.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:29.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:15:29.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:15:29.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:15:29.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:15:29.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:29.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:15:29.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:15:29.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:15:29.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:15:29.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:29.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:15:29.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:15:29.740 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.740 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.740 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.740 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:29.740 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:29.740 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 92.370352326000003, 2024-04-26T11:15:29.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:15:29.740 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.740 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:29.741 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:29.741 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:29.741 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.741 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:15:29.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.741 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:29.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:29.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:15:29.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:29.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:15:29.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:15:29.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:15:29.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:15:29.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:15:29.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:15:29.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:15:29.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:15:29.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:15:29.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:15:29.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:29.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:15:29.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:15:29.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:29.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:15:29.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:15:29.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:15:29.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:15:29.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:29.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:15:29.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:15:29.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:15:29.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:15:29.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:29.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:15:29.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:15:29.746 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.746 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.746 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.746 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:29.746 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:29.746 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 92.353903626000005, 2024-04-26T11:15:29.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:15:29.747 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.747 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:29.747 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:29.747 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:29.747 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.747 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:15:29.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.747 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.747 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.747 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:29.747 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:29.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:15:29.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:29.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:15:29.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:15:29.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:15:29.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:15:29.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:15:29.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:15:29.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:15:29.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:15:29.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:29.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:15:29.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:15:29.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:15:29.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:15:29.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:29.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:15:29.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:15:29.751 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.751 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.751 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.751 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:29.751 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:29.751 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 92.352206120999995, 2024-04-26T11:15:29.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:15:29.751 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.751 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:29.752 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:29.752 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:29.752 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.752 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:15:29.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.752 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:29.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:29.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:15:29.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:29.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:15:29.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:15:29.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:15:29.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:15:29.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:15:29.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:15:29.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:15:29.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:15:29.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:29.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:15:29.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:15:29.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:15:29.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:15:29.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:29.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:15:29.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:15:29.755 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.755 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.755 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.756 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:29.756 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:29.756 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 92.352141818999996, 2024-04-26T11:15:29.756 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:15:29.756 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.756 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:29.756 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:29.756 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:29.756 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.756 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:15:29.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.756 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.757 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.757 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:29.757 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.757 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.757 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:29.757 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.757 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.757 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:29.757 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:29.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.758 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.758 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:15:29.758 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:15:29.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.758 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.758 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:15:29.758 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:15:29.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.758 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:15:29.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:15:29.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.759 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:15:29.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:15:29.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.759 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:29.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:15:29.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:15:29.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.760 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:15:29.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:15:29.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.760 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:15:29.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:15:29.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.760 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:29.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:15:29.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:15:29.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.761 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:29.761 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:15:29.761 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:15:29.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.761 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:29.761 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:15:29.761 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:15:29.761 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.761 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.761 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.762 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:29.762 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:29.762 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 92.352087595, 2024-04-26T11:15:29.762 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:15:29.762 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.762 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:29.762 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:29.762 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:29.762 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.762 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:15:29.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.762 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.763 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:29.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.763 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:29.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.763 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:29.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:29.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.764 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.764 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:15:29.764 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:15:29.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.764 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.764 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:15:29.764 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:15:29.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.764 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.764 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:15:29.764 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:15:29.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:15:29.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:15:29.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:29.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:15:29.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:15:29.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:15:29.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:15:29.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.766 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.766 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.766 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:15:29.766 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:15:29.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.766 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.766 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:29.766 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:15:29.766 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:15:29.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.766 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.766 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:29.767 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:15:29.767 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:15:29.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.767 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:29.767 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:15:29.767 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:15:29.767 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.767 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.767 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.767 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:29.767 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:29.768 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 92.352043082999998, 2024-04-26T11:15:29.768 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:15:29.768 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.768 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:29.768 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:29.768 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:29.768 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.768 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:15:29.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.768 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.768 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:29.769 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.769 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.769 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:29.769 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.769 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.769 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:15:29.769 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:29.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.769 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.769 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:15:29.770 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:15:29.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.770 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.770 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.770 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:15:29.770 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:15:29.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.770 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.770 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.770 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:15:29.770 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:15:29.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.770 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.770 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.771 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:15:29.771 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:15:29.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.771 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.771 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:29.771 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:15:29.771 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:15:29.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.771 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.771 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.771 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:15:29.771 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:15:29.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.771 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.771 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.772 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:15:29.772 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:15:29.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.772 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.772 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:29.772 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:15:29.772 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:15:29.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.772 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.772 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:29.772 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:15:29.772 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:15:29.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.773 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.773 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:29.773 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:15:29.773 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:15:29.773 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.773 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.773 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.773 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.773 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:29.773 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:29.773 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 92.347822081000004, 2024-04-26T11:15:29.773 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:15:29.773 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.773 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:29.774 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:29.774 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:29.774 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.774 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:15:29.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.774 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.774 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.774 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.774 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:29.774 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.774 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.774 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.774 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:29.775 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.775 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.775 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.775 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:15:29.775 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:15:29.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.775 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.775 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.775 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:15:29.775 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:15:29.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.775 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.775 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.775 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:15:29.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:15:29.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.776 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.776 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:15:29.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:15:29.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.776 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.776 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:15:29.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:15:29.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.776 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:29.777 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:15:29.777 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:15:29.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.777 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.777 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:15:29.777 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:15:29.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.777 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.777 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:15:29.777 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:15:29.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.778 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:29.778 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:15:29.778 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:15:29.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.778 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.778 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:29.778 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:15:29.778 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:15:29.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.778 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.778 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:29.778 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:15:29.778 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:15:29.778 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.779 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.779 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.779 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174388 5.c 5:312e5163:::benchmark_data_smithi029_44842_object29750:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:29.779 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:29.779 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 39.351996425999999, 2024-04-26T11:15:29.779 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.064002009999999998, 2024-04-26T11:15:29.779 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.779 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:29.779 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:29.779 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:29.779 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.779 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174388 2024-04-26T11:15:29.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.780 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.780 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.780 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:29.780 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.780 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.780 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:29.780 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.780 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.780 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348231+0000", 2024-04-26T11:15:29.781 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:29.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.781 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.781 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.781 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348233+0000", 2024-04-26T11:15:29.781 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2249999999999999e-06 2024-04-26T11:15:29.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.781 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.781 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.781 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348238+0000", 2024-04-26T11:15:29.781 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1899999999999997e-06 2024-04-26T11:15:29.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.781 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.781 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.781 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348241+0000", 2024-04-26T11:15:29.782 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.965e-06 2024-04-26T11:15:29.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.782 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.782 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348264+0000", 2024-04-26T11:15:29.782 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3014e-05 2024-04-26T11:15:29.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.782 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.782 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348371+0000", 2024-04-26T11:15:29.782 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000106889 2024-04-26T11:15:29.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.782 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:29.783 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412126+0000", 2024-04-26T11:15:29.783 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063755495999999995 2024-04-26T11:15:29.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.783 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.783 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:29.783 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412165+0000", 2024-04-26T11:15:29.783 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9269e-05 2024-04-26T11:15:29.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.783 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.783 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:29.783 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412234+0000", 2024-04-26T11:15:29.783 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8337000000000007e-05 2024-04-26T11:15:29.783 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.783 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.783 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.784 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174390 5.1 5:81c54fd7:::benchmark_data_smithi029_44842_object29752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:29.784 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:29.784 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 39.351881272, 2024-04-26T11:15:29.784 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063635918, 2024-04-26T11:15:29.784 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.784 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:29.784 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:29.784 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:29.784 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.784 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174390 2024-04-26T11:15:29.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.784 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.785 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.785 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:29.785 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.785 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.785 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:29.785 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.785 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.785 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348346+0000", 2024-04-26T11:15:29.785 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:29.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.786 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.786 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348351+0000", 2024-04-26T11:15:29.786 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.442e-06 2024-04-26T11:15:29.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.786 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.786 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348357+0000", 2024-04-26T11:15:29.786 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9530000000000002e-06 2024-04-26T11:15:29.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.786 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.786 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348363+0000", 2024-04-26T11:15:29.787 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2129999999999999e-06 2024-04-26T11:15:29.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.787 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.787 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.787 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348396+0000", 2024-04-26T11:15:29.787 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3161999999999999e-05 2024-04-26T11:15:29.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.787 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.787 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.787 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348511+0000", 2024-04-26T11:15:29.787 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000115253 2024-04-26T11:15:29.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.787 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.787 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:29.788 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411857+0000", 2024-04-26T11:15:29.788 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063345431999999993 2024-04-26T11:15:29.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.788 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:29.788 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411904+0000", 2024-04-26T11:15:29.788 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7389000000000003e-05 2024-04-26T11:15:29.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.788 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:29.788 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411983+0000", 2024-04-26T11:15:29.788 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8750000000000003e-05 2024-04-26T11:15:29.788 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.788 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.789 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.789 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174394 5.3 5:c91ce5cb:::benchmark_data_smithi029_44842_object29756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:29.789 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:29.789 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 39.351778328000002, 2024-04-26T11:15:29.789 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062247626, 2024-04-26T11:15:29.789 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.789 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:29.789 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:29.789 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:29.789 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.789 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174394 2024-04-26T11:15:29.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.790 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.790 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.790 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:29.790 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.790 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.790 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:29.790 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.790 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.790 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348449+0000", 2024-04-26T11:15:29.791 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:29.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.791 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.791 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348457+0000", 2024-04-26T11:15:29.791 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9619999999999993e-06 2024-04-26T11:15:29.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.791 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.791 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348462+0000", 2024-04-26T11:15:29.791 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6569999999999996e-06 2024-04-26T11:15:29.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.791 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.791 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348465+0000", 2024-04-26T11:15:29.792 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2990000000000001e-06 2024-04-26T11:15:29.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.792 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.792 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.792 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408427+0000", 2024-04-26T11:15:29.792 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.059961423 2024-04-26T11:15:29.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.792 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.792 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.792 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408554+0000", 2024-04-26T11:15:29.792 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012779600000000001 2024-04-26T11:15:29.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.792 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.793 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:29.793 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410570+0000", 2024-04-26T11:15:29.793 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020152719999999998 2024-04-26T11:15:29.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.793 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:29.793 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410624+0000", 2024-04-26T11:15:29.793 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4211e-05 2024-04-26T11:15:29.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.793 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:29.793 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410697+0000", 2024-04-26T11:15:29.793 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3447000000000003e-05 2024-04-26T11:15:29.793 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.793 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.794 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.794 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174395 5.1 5:8ee7f1d3:::benchmark_data_smithi029_44842_object29757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:29.794 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:29.794 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 39.350748236999998, 2024-04-26T11:15:29.794 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062622744999999994, 2024-04-26T11:15:29.794 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.794 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:29.794 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:29.794 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:29.794 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.794 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174395 2024-04-26T11:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.795 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349479+0000", 2024-04-26T11:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349483+0000", 2024-04-26T11:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.54e-06 2024-04-26T11:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349488+0000", 2024-04-26T11:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5119999999999999e-06 2024-04-26T11:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.796 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.797 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349492+0000", 2024-04-26T11:15:29.797 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7170000000000002e-06 2024-04-26T11:15:29.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.797 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.797 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.797 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350187+0000", 2024-04-26T11:15:29.797 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00069535899999999999 2024-04-26T11:15:29.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.797 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.797 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.797 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350292+0000", 2024-04-26T11:15:29.797 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0001047 2024-04-26T11:15:29.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.797 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.798 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:29.798 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411992+0000", 2024-04-26T11:15:29.798 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061699647000000003 2024-04-26T11:15:29.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.798 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.798 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:29.798 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412030+0000", 2024-04-26T11:15:29.798 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8124999999999998e-05 2024-04-26T11:15:29.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.798 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.798 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:29.798 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412103+0000", 2024-04-26T11:15:29.798 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2733999999999999e-05 2024-04-26T11:15:29.798 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.799 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.799 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.799 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174396 5.7 5:e0fad05d:::benchmark_data_smithi029_44842_object29758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:29.799 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:29.799 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 39.350664598000002, 2024-04-26T11:15:29.799 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062445026000000001, 2024-04-26T11:15:29.799 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.799 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:29.799 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:29.799 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:29.799 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.799 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174396 2024-04-26T11:15:29.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.800 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.800 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:29.800 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.800 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:29.800 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.800 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:29.801 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:29.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.801 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.801 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349566+0000", 2024-04-26T11:15:29.801 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2490000000000001e-06 2024-04-26T11:15:29.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.801 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.801 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349573+0000", 2024-04-26T11:15:29.801 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.776e-06 2024-04-26T11:15:29.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.801 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.802 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349576+0000", 2024-04-26T11:15:29.802 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3629999999999998e-06 2024-04-26T11:15:29.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.802 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.802 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350396+0000", 2024-04-26T11:15:29.802 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00081992199999999995 2024-04-26T11:15:29.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.802 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.802 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350516+0000", 2024-04-26T11:15:29.802 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012006900000000001 2024-04-26T11:15:29.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.803 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:29.803 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411924+0000", 2024-04-26T11:15:29.803 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061407960999999997 2024-04-26T11:15:29.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.803 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:29.803 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411947+0000", 2024-04-26T11:15:29.803 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2943999999999999e-05 2024-04-26T11:15:29.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.803 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:29.803 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412008+0000", 2024-04-26T11:15:29.803 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1237999999999999e-05 2024-04-26T11:15:29.804 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.804 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.804 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.804 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174397 5.7 5:e25daf9a:::benchmark_data_smithi029_44842_object29759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:29.804 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:29.804 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 39.350556468999997, 2024-04-26T11:15:29.804 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063878565999999998, 2024-04-26T11:15:29.804 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.804 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:29.804 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:29.804 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:29.804 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.805 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174397 2024-04-26T11:15:29.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.805 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.805 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.805 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:29.805 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.805 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.805 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:29.805 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.806 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.806 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349671+0000", 2024-04-26T11:15:29.806 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:29.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.806 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.806 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.806 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349674+0000", 2024-04-26T11:15:29.806 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3360000000000002e-06 2024-04-26T11:15:29.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.806 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.806 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.806 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349678+0000", 2024-04-26T11:15:29.806 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0709999999999996e-06 2024-04-26T11:15:29.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.806 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.807 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.807 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349681+0000", 2024-04-26T11:15:29.807 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3139999999999999e-06 2024-04-26T11:15:29.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.807 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.807 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410371+0000", 2024-04-26T11:15:29.807 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.060690202999999998 2024-04-26T11:15:29.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.807 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.807 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410463+0000", 2024-04-26T11:15:29.807 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2095000000000005e-05 2024-04-26T11:15:29.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.808 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:29.808 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413471+0000", 2024-04-26T11:15:29.808 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0030073909999999999 2024-04-26T11:15:29.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.808 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.808 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:29.808 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413499+0000", 2024-04-26T11:15:29.808 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8725e-05 2024-04-26T11:15:29.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.808 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.808 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:29.808 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413550+0000", 2024-04-26T11:15:29.808 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0810000000000003e-05 2024-04-26T11:15:29.808 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.809 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.809 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.809 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.809 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:174398 5.4 e46/16 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head v 46'10798, mlcod=46'10796)", 2024-04-26T11:15:29.809 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:29.809 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 39.350028258000002, 2024-04-26T11:15:29.809 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062067047, 2024-04-26T11:15:29.809 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:29.809 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:29.809 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:29.809 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.809 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:29.809 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:29.810 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.810 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.810 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:29.810 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:29.810 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:29.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.810 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.810 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:29.810 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350199+0000", 2024-04-26T11:15:29.810 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:29.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.810 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.810 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:29.810 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350205+0000", 2024-04-26T11:15:29.811 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6749999999999999e-06 2024-04-26T11:15:29.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.811 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:29.811 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350212+0000", 2024-04-26T11:15:29.811 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7000000000000002e-06 2024-04-26T11:15:29.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.811 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.811 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350216+0000", 2024-04-26T11:15:29.811 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5120000000000002e-06 2024-04-26T11:15:29.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.812 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:29.812 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350246+0000", 2024-04-26T11:15:29.812 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9978999999999999e-05 2024-04-26T11:15:29.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.812 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.812 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:29.812 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350263+0000", 2024-04-26T11:15:29.812 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.702e-05 2024-04-26T11:15:29.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.812 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.812 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:29.812 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412238+0000", 2024-04-26T11:15:29.812 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061974603000000003 2024-04-26T11:15:29.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:29.812 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:29.813 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:29.813 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412267+0000", 2024-04-26T11:15:29.813 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9116e-05 2024-04-26T11:15:29.813 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.813 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.813 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.813 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:29.813 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:29.813 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:29.814 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:15:29.815 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:29.816 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:29.812+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:29.915 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:29.913+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:29.984 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:29.984 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:15:29.984 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.984 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:280562 5.b 5:dc8296e6:::benchmark_data_smithi029_44842_object135924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:29.985 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:29.973129+0000", 2024-04-26T11:15:29.985 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0087883189999999993, 2024-04-26T11:15:29.985 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0088150350000000006, 2024-04-26T11:15:29.985 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:29.985 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:29.985 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:29.985 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:29.985 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.985 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 280562 2024-04-26T11:15:29.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.985 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:29.985 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.985 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:29.985 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.973129+0000", 2024-04-26T11:15:29.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:29.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:29.986 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.973129+0000", 2024-04-26T11:15:29.986 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:29.986 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.986 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.986 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:29.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.973128+0000", 2024-04-26T11:15:29.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:29.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:29.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.973135+0000", 2024-04-26T11:15:29.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6900000000000003e-06 2024-04-26T11:15:29.987 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.987 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.987 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:29.987 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.973146+0000", 2024-04-26T11:15:29.987 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.131e-05 2024-04-26T11:15:29.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.973153+0000", 2024-04-26T11:15:29.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0049999999999998e-06 2024-04-26T11:15:29.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.988 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:29.988 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.973191+0000", 2024-04-26T11:15:29.988 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7866e-05 2024-04-26T11:15:29.988 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.988 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:29.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.973313+0000", 2024-04-26T11:15:29.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000122433 2024-04-26T11:15:29.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:29.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.973418+0000", 2024-04-26T11:15:29.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000104957 2024-04-26T11:15:29.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.989 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.989 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:29.989 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.975975+0000", 2024-04-26T11:15:29.989 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0025567580000000001 2024-04-26T11:15:29.990 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:29.990 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:29.990 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:29.990 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.990 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.990 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:280565 5.b 5:ddf019d5:::benchmark_data_smithi029_44842_object135927:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:29.990 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:29.973555+0000", 2024-04-26T11:15:29.990 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0083620810000000004, 2024-04-26T11:15:29.990 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0084885559999999995, 2024-04-26T11:15:29.990 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:29.990 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:29.990 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:29.991 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:29.991 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.991 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 280565 2024-04-26T11:15:29.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.991 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:29.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:29.991 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.973555+0000", 2024-04-26T11:15:29.991 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:29.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.991 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.991 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:29.992 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.973555+0000", 2024-04-26T11:15:29.992 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:29.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.992 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.993 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:29.993 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.973554+0000", 2024-04-26T11:15:29.993 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:29.993 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:29.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.973558+0000", 2024-04-26T11:15:29.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0729999999999998e-06 2024-04-26T11:15:29.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.994 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:29.994 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.973570+0000", 2024-04-26T11:15:29.994 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1963e-05 2024-04-26T11:15:29.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.994 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:29.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.973577+0000", 2024-04-26T11:15:29.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.9210000000000003e-06 2024-04-26T11:15:29.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:29.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.974698+0000", 2024-04-26T11:15:29.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011213390000000001 2024-04-26T11:15:29.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.995 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:29.995 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.974811+0000", 2024-04-26T11:15:29.995 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112735 2024-04-26T11:15:29.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.995 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:29.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.974924+0000", 2024-04-26T11:15:29.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011244 2024-04-26T11:15:29.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.996 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:29.996 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.976190+0000", 2024-04-26T11:15:29.996 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0012666330000000001 2024-04-26T11:15:29.996 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:29.996 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:29.996 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:29.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.996 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.996 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:280569 5.e 5:7f0c3d7a:::benchmark_data_smithi029_44842_object135931:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:29.996 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:29.974949+0000", 2024-04-26T11:15:29.997 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0069678359999999998, 2024-04-26T11:15:29.997 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0071876589999999999, 2024-04-26T11:15:29.997 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:29.997 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:29.997 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:29.997 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:29.997 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:29.997 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 280569 2024-04-26T11:15:29.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.997 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:29.997 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.997 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:29.998 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.974949+0000", 2024-04-26T11:15:29.998 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:29.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.998 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:29.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.974949+0000", 2024-04-26T11:15:29.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:29.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:29.999 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:29.999 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:29.999 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.974948+0000", 2024-04-26T11:15:29.999 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:29.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.974952+0000", 2024-04-26T11:15:30.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4309999999999998e-06 2024-04-26T11:15:30.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.974958+0000", 2024-04-26T11:15:30.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0410000000000003e-06 2024-04-26T11:15:30.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.000 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.000 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.000 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.974962+0000", 2024-04-26T11:15:30.000 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5170000000000001e-06 2024-04-26T11:15:30.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.974997+0000", 2024-04-26T11:15:30.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4113999999999999e-05 2024-04-26T11:15:30.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.975110+0000", 2024-04-26T11:15:30.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000113548 2024-04-26T11:15:30.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.001 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.001 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:30.001 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.975216+0000", 2024-04-26T11:15:30.001 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000106152 2024-04-26T11:15:30.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.002 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:30.002 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.979628+0000", 2024-04-26T11:15:30.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004412025 2024-04-26T11:15:30.002 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.002 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.002 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.002 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.002 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:280574 5.e 5:776bf791:::benchmark_data_smithi029_44842_object135936:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:30.002 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:29.977271+0000", 2024-04-26T11:15:30.002 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.004645967, 2024-04-26T11:15:30.002 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0049543800000000004, 2024-04-26T11:15:30.002 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.003 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:30.003 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.003 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.003 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.003 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 280574 2024-04-26T11:15:30.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.003 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.977271+0000", 2024-04-26T11:15:30.003 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.003 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.003 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.003 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.977271+0000", 2024-04-26T11:15:30.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.977270+0000", 2024-04-26T11:15:30.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:30.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.977273+0000", 2024-04-26T11:15:30.004 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1030000000000002e-06 2024-04-26T11:15:30.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.004 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.004 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.004 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.977285+0000", 2024-04-26T11:15:30.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1542999999999999e-05 2024-04-26T11:15:30.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.977290+0000", 2024-04-26T11:15:30.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6870000000000002e-06 2024-04-26T11:15:30.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.977315+0000", 2024-04-26T11:15:30.005 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5001e-05 2024-04-26T11:15:30.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.005 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.005 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.005 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.977403+0000", 2024-04-26T11:15:30.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.7863999999999998e-05 2024-04-26T11:15:30.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:30.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.977628+0000", 2024-04-26T11:15:30.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00022533500000000001 2024-04-26T11:15:30.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.006 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.006 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:30.006 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.980880+0000", 2024-04-26T11:15:30.006 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0032519319999999999 2024-04-26T11:15:30.006 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.006 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.006 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.007 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:280579 5.b 5:d49362b5:::benchmark_data_smithi029_44842_object135941:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:30.007 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:29.978206+0000", 2024-04-26T11:15:30.007 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0037109280000000001, 2024-04-26T11:15:30.007 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.004120238, 2024-04-26T11:15:30.007 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.007 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:30.007 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.007 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.007 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.007 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 280579 2024-04-26T11:15:30.007 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.007 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.007 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.978206+0000", 2024-04-26T11:15:30.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.978206+0000", 2024-04-26T11:15:30.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.008 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.008 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.978205+0000", 2024-04-26T11:15:30.008 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:30.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.008 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.978209+0000", 2024-04-26T11:15:30.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2219999999999998e-06 2024-04-26T11:15:30.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.978221+0000", 2024-04-26T11:15:30.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2906e-05 2024-04-26T11:15:30.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.009 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.009 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.009 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.978232+0000", 2024-04-26T11:15:30.009 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.03e-05 2024-04-26T11:15:30.009 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.978273+0000", 2024-04-26T11:15:30.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1582000000000003e-05 2024-04-26T11:15:30.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.978405+0000", 2024-04-26T11:15:30.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013158700000000001 2024-04-26T11:15:30.010 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.010 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.010 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:30.010 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.978525+0000", 2024-04-26T11:15:30.010 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000120177 2024-04-26T11:15:30.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.011 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:30.011 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981259+0000", 2024-04-26T11:15:30.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027335570000000002 2024-04-26T11:15:30.011 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.011 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.011 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.011 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.011 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.011 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:280582 5.9 5:9292d542:::benchmark_data_smithi029_44842_object135944:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:30.011 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:29.978374+0000", 2024-04-26T11:15:30.011 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.003542496, 2024-04-26T11:15:30.011 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0040411910000000004, 2024-04-26T11:15:30.012 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.012 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:30.012 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.012 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.012 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.012 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 280582 2024-04-26T11:15:30.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.012 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.012 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.978374+0000", 2024-04-26T11:15:30.012 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.012 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.012 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.978374+0000", 2024-04-26T11:15:30.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.978374+0000", 2024-04-26T11:15:30.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:30.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.013 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.978377+0000", 2024-04-26T11:15:30.013 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2229999999999999e-06 2024-04-26T11:15:30.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.013 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.013 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.978385+0000", 2024-04-26T11:15:30.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3899999999999993e-06 2024-04-26T11:15:30.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.978391+0000", 2024-04-26T11:15:30.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9859999999999999e-06 2024-04-26T11:15:30.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.014 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.014 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.980218+0000", 2024-04-26T11:15:30.014 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0018261869999999999 2024-04-26T11:15:30.014 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.014 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.015 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.015 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.980299+0000", 2024-04-26T11:15:30.016 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1617000000000001e-05 2024-04-26T11:15:30.016 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.016 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.016 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.016 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.016 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.016 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:280583 5.e 5:7a8b28b5:::benchmark_data_smithi029_44842_object135945:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:30.016 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:29.978493+0000", 2024-04-26T11:15:30.016 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0034242449999999998, 2024-04-26T11:15:30.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.003995129, 2024-04-26T11:15:30.017 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.017 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:30.017 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.017 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.017 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.017 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 280583 2024-04-26T11:15:30.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.017 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.017 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.017 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.978493+0000", 2024-04-26T11:15:30.017 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.017 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.978493+0000", 2024-04-26T11:15:30.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.978492+0000", 2024-04-26T11:15:30.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:30.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.018 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.018 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.018 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.978495+0000", 2024-04-26T11:15:30.018 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2030000000000001e-06 2024-04-26T11:15:30.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.978503+0000", 2024-04-26T11:15:30.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.5449999999999998e-06 2024-04-26T11:15:30.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.978508+0000", 2024-04-26T11:15:30.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.6629999999999998e-06 2024-04-26T11:15:30.019 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.019 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.019 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.019 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.979643+0000", 2024-04-26T11:15:30.019 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001134127 2024-04-26T11:15:30.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.979726+0000", 2024-04-26T11:15:30.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.3535000000000006e-05 2024-04-26T11:15:30.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.020 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.020 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:30.020 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.979789+0000", 2024-04-26T11:15:30.020 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2730000000000004e-05 2024-04-26T11:15:30.021 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.021 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.021 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.021 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.021 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:280585 5.a 5:5895aaef:::benchmark_data_smithi029_44842_object135947:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:30.021 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:29.979796+0000", 2024-04-26T11:15:30.021 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.0021210819999999998, 2024-04-26T11:15:30.021 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0027675970000000001, 2024-04-26T11:15:30.021 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.021 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:30.021 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.021 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.021 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.021 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 280585 2024-04-26T11:15:30.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.022 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.979796+0000", 2024-04-26T11:15:30.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.022 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.022 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.979796+0000", 2024-04-26T11:15:30.022 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.022 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.022 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.979795+0000", 2024-04-26T11:15:30.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:30.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.979800+0000", 2024-04-26T11:15:30.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3460000000000001e-06 2024-04-26T11:15:30.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.023 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.023 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.979813+0000", 2024-04-26T11:15:30.023 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2533e-05 2024-04-26T11:15:30.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.023 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.979821+0000", 2024-04-26T11:15:30.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4409999999999993e-06 2024-04-26T11:15:30.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.979858+0000", 2024-04-26T11:15:30.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7153000000000002e-05 2024-04-26T11:15:30.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.024 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.024 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.979978+0000", 2024-04-26T11:15:30.024 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00011942699999999999 2024-04-26T11:15:30.024 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.024 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.025 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:30.025 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.980088+0000", 2024-04-26T11:15:30.025 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000109944 2024-04-26T11:15:30.025 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.025 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.025 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.025 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.025 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:280587 5.9 5:9b0cf9a2:::benchmark_data_smithi029_44842_object135949:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:30.025 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:29.981249+0000", 2024-04-26T11:15:30.026 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00066795199999999998, 2024-04-26T11:15:30.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001402875, 2024-04-26T11:15:30.026 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.026 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:30.026 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.026 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.026 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.026 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 280587 2024-04-26T11:15:30.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.026 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.026 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.026 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.026 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981249+0000", 2024-04-26T11:15:30.026 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.026 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981249+0000", 2024-04-26T11:15:30.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981248+0000", 2024-04-26T11:15:30.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:30.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.027 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.027 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.027 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981253+0000", 2024-04-26T11:15:30.027 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9509999999999997e-06 2024-04-26T11:15:30.027 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981263+0000", 2024-04-26T11:15:30.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9480000000000003e-06 2024-04-26T11:15:30.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981269+0000", 2024-04-26T11:15:30.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.8459999999999996e-06 2024-04-26T11:15:30.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.028 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.028 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.028 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981726+0000", 2024-04-26T11:15:30.028 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00045681999999999998 2024-04-26T11:15:30.028 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.029 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.029 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981804+0000", 2024-04-26T11:15:30.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8301999999999997e-05 2024-04-26T11:15:30.029 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.029 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.029 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.029 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.029 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.029 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:280588 5.e 5:770df818:::benchmark_data_smithi029_44842_object135950:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:30.029 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:29.981274+0000", 2024-04-26T11:15:30.029 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 0.00064297300000000003, 2024-04-26T11:15:30.029 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001460002, 2024-04-26T11:15:30.029 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.029 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:30.030 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.030 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.030 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.030 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 280588 2024-04-26T11:15:30.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.030 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.030 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.030 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.030 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981274+0000", 2024-04-26T11:15:30.030 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.030 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981274+0000", 2024-04-26T11:15:30.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.031 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981274+0000", 2024-04-26T11:15:30.031 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:30.031 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.031 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.031 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981276+0000", 2024-04-26T11:15:30.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9460000000000001e-06 2024-04-26T11:15:30.032 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.032 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.032 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.032 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981293+0000", 2024-04-26T11:15:30.032 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7408e-05 2024-04-26T11:15:30.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981298+0000", 2024-04-26T11:15:30.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.9180000000000002e-06 2024-04-26T11:15:30.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.033 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981320+0000", 2024-04-26T11:15:30.033 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2558e-05 2024-04-26T11:15:30.033 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.033 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.033 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981398+0000", 2024-04-26T11:15:30.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7273000000000004e-05 2024-04-26T11:15:30.034 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.034 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.034 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:30.034 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981461+0000", 2024-04-26T11:15:30.034 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3418999999999997e-05 2024-04-26T11:15:30.034 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.034 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.035 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.035 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.035 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.035 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:280589 5.8 5:14e82086:::benchmark_data_smithi029_44842_object135951:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:30.035 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:29.981847+0000", 2024-04-26T11:15:30.035 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 6.9847999999999999e-05, 2024-04-26T11:15:30.035 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097399699999999999, 2024-04-26T11:15:30.035 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.035 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:15:30.035 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.035 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.036 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.036 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 280589 2024-04-26T11:15:30.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.036 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.036 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.036 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981847+0000", 2024-04-26T11:15:30.036 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.036 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.036 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981847+0000", 2024-04-26T11:15:30.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981846+0000", 2024-04-26T11:15:30.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:30.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.037 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.037 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981851+0000", 2024-04-26T11:15:30.037 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.1580000000000004e-06 2024-04-26T11:15:30.037 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.037 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981860+0000", 2024-04-26T11:15:30.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.6819999999999992e-06 2024-04-26T11:15:30.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981868+0000", 2024-04-26T11:15:30.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4889999999999998e-06 2024-04-26T11:15:30.038 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.038 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.038 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.038 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.981906+0000", 2024-04-26T11:15:30.038 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8377000000000002e-05 2024-04-26T11:15:30.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.982029+0000", 2024-04-26T11:15:30.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012321500000000001 2024-04-26T11:15:30.039 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.039 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.039 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:30.039 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:29.982144+0000", 2024-04-26T11:15:30.039 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000115233 2024-04-26T11:15:30.040 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.040 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.040 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.040 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.040 INFO:teuthology.orchestra.run.smithi122.stdout: ], 2024-04-26T11:15:30.040 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 11 2024-04-26T11:15:30.040 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:30.041 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:30.041 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:30.015+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:30.117 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:30.115+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:30.218 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:30.216+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:30.227 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:30.227 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:15:30.227 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:15:30.227 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:15:30.227 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:30.239 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:30.323 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:30.322+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:30.402 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:15:30.420 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:30.418+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:30.448 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:30.449 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:15:30.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:15:30.449 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:15:30.449 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.449 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:30.449 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:30.449 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 97.166452875000004, 2024-04-26T11:15:30.449 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:15:30.449 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.449 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:30.449 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.449 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.449 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.449 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:15:30.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.450 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:30.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.450 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:30.450 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.450 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.450 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.450 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:30.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:30.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:15:30.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:15:30.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.451 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.451 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:15:30.451 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:15:30.451 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.451 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:15:30.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:15:30.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:15:30.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:15:30.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.452 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.452 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:15:30.452 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:15:30.452 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.452 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:30.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:15:30.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:15:30.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:30.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:15:30.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:15:30.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.453 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:30.453 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:15:30.453 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:15:30.453 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.453 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:30.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:15:30.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:15:30.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.454 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:30.454 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:15:30.454 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:15:30.454 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.454 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.454 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.454 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.454 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.454 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:30.455 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:30.455 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 97.165803173, 2024-04-26T11:15:30.455 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:15:30.455 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.455 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:30.455 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.455 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.455 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.455 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:15:30.455 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.455 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.455 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.455 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.455 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:30.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:30.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.456 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:15:30.456 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:30.456 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.456 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.456 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:15:30.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:15:30.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:15:30.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:15:30.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.457 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:15:30.457 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:15:30.457 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.457 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.457 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:15:30.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:15:30.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:15:30.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:15:30.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.458 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:30.458 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:15:30.458 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:15:30.458 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.458 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:30.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:15:30.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:15:30.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:30.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:15:30.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:15:30.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.459 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.459 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:30.459 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:15:30.459 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:15:30.459 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.460 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:30.460 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:15:30.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:15:30.460 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.460 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.460 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.460 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.460 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.460 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:30.460 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:30.460 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 93.099161133999999, 2024-04-26T11:15:30.460 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:15:30.460 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.460 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:30.461 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.461 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.461 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.461 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:15:30.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.461 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:30.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.461 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.461 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.461 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.461 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:30.461 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:15:30.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:30.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:15:30.462 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:15:30.462 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.462 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.462 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.462 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:15:30.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:15:30.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:15:30.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:15:30.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:15:30.463 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:15:30.463 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.463 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.463 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:30.463 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:15:30.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:15:30.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:15:30.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:15:30.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.464 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.464 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:30.464 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:15:30.464 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:15:30.464 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.464 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.464 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.464 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.465 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:30.465 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:30.465 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 93.099065487999994, 2024-04-26T11:15:30.465 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:15:30.465 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.465 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:30.465 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.465 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.465 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.465 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:15:30.465 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.465 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.465 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.465 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:30.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:30.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.466 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.466 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:15:30.466 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:30.466 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.466 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:15:30.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:15:30.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:15:30.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:15:30.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.467 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.467 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:15:30.467 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:15:30.467 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.467 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:15:30.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:15:30.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:30.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:15:30.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:15:30.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.468 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.468 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:15:30.468 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:15:30.468 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.468 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.469 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:30.469 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:15:30.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:15:30.469 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.469 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.469 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.469 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.469 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.469 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:30.469 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:30.469 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 93.098933809000002, 2024-04-26T11:15:30.469 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:15:30.469 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.469 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:30.469 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.470 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.470 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.470 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:15:30.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.470 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:30.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.470 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.470 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.470 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:30.470 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.470 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:30.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:30.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:15:30.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:15:30.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.471 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.471 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.471 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:15:30.471 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:15:30.471 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:15:30.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:15:30.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:15:30.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:15:30.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.472 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.472 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:30.472 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:15:30.472 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:15:30.472 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:15:30.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:15:30.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.473 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:30.473 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:15:30.473 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:15:30.473 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.473 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.473 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.473 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.473 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.473 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:30.474 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:30.474 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 93.098825352999995, 2024-04-26T11:15:30.474 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:15:30.474 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.474 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:30.474 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.474 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.474 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.474 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:15:30.474 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.474 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.474 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.474 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.474 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:30.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:30.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:15:30.475 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:30.475 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.475 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.475 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.475 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:15:30.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:15:30.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:15:30.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:15:30.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:15:30.476 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:15:30.476 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.476 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.476 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.476 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:15:30.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:15:30.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:30.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:15:30.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:15:30.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:15:30.477 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:15:30.477 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.477 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.477 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:30.477 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:15:30.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:15:30.478 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.478 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.478 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.478 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.478 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.478 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:30.478 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:30.478 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 93.098724085000001, 2024-04-26T11:15:30.478 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:15:30.478 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.478 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:30.478 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.478 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.478 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.479 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:15:30.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.479 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:30.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.479 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:30.479 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.479 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.479 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.479 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:30.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:30.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:15:30.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:15:30.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.480 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.480 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:15:30.480 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:15:30.480 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.480 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:15:30.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:15:30.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:15:30.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:15:30.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.481 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:30.481 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:15:30.481 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:15:30.481 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.481 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:15:30.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:15:30.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:15:30.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:15:30.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.482 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.482 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:30.482 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:15:30.482 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:15:30.482 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:30.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:15:30.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:15:30.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.483 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:30.483 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:15:30.483 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:15:30.483 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.483 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.483 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.483 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.483 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.483 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:30.484 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:30.484 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 93.098655144000006, 2024-04-26T11:15:30.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:15:30.484 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.484 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:30.484 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.484 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.484 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.484 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:15:30.484 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.484 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.484 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.484 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.484 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:30.484 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:30.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.485 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.485 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.485 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:15:30.485 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:30.485 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:15:30.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:15:30.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:15:30.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:15:30.486 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.486 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.486 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.486 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:15:30.486 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:15:30.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:15:30.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:15:30.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:30.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:15:30.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:15:30.487 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.487 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.487 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.487 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:15:30.487 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:15:30.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:15:30.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:15:30.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:30.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:15:30.488 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:15:30.488 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.488 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.488 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:30.488 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:15:30.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:15:30.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.489 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:30.489 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:15:30.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:15:30.489 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.489 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.489 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.489 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.489 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.489 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:30.489 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:30.489 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 93.092659562999998, 2024-04-26T11:15:30.489 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:15:30.490 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.490 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:30.490 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.490 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.490 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.490 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:15:30.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.490 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.490 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.490 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:30.490 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.490 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.490 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:30.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:15:30.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:30.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.491 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.491 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:15:30.491 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:15:30.491 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.491 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:15:30.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:15:30.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:15:30.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:15:30.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.492 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.492 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.492 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:15:30.492 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:15:30.492 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:30.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:15:30.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:15:30.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:15:30.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:15:30.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.493 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.493 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.493 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:15:30.493 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:15:30.493 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:30.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:15:30.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:15:30.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:30.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:15:30.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:15:30.494 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.494 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.494 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:30.494 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:15:30.494 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:15:30.495 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.495 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.495 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.495 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.495 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.495 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174398 5.4 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:30.495 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:30.495 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 40.095352914000003, 2024-04-26T11:15:30.495 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.064773789999999998, 2024-04-26T11:15:30.495 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.495 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:30.495 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.495 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.495 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.496 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174398 2024-04-26T11:15:30.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.496 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:30.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:30.496 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.496 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.496 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.496 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.496 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349889+0000", 2024-04-26T11:15:30.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:30.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349895+0000", 2024-04-26T11:15:30.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4519999999999996e-06 2024-04-26T11:15:30.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349909+0000", 2024-04-26T11:15:30.497 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3791000000000001e-05 2024-04-26T11:15:30.497 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.497 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.497 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.497 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349919+0000", 2024-04-26T11:15:30.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0135999999999999e-05 2024-04-26T11:15:30.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349956+0000", 2024-04-26T11:15:30.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7642000000000003e-05 2024-04-26T11:15:30.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.498 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350080+0000", 2024-04-26T11:15:30.498 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123285 2024-04-26T11:15:30.498 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.498 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.498 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:30.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350192+0000", 2024-04-26T11:15:30.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112509 2024-04-26T11:15:30.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:30.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356232+0000", 2024-04-26T11:15:30.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060403339999999996 2024-04-26T11:15:30.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:30.499 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414616+0000", 2024-04-26T11:15:30.499 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.058383156999999998 2024-04-26T11:15:30.499 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.499 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.499 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:30.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414643+0000", 2024-04-26T11:15:30.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7317e-05 2024-04-26T11:15:30.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.500 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:30.500 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414664+0000", 2024-04-26T11:15:30.500 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1135999999999999e-05 2024-04-26T11:15:30.500 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.500 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.500 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.500 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.500 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.500 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276551 5.a 5:5533d612:::benchmark_data_smithi029_44842_object131913:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:30.500 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.375399+0000", 2024-04-26T11:15:30.500 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 2.069844523, 2024-04-26T11:15:30.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.101897644, 2024-04-26T11:15:30.501 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.501 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:30.501 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.501 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.501 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.501 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276551 2024-04-26T11:15:30.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.501 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.501 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.501 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375399+0000", 2024-04-26T11:15:30.501 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.501 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.501 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375399+0000", 2024-04-26T11:15:30.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375398+0000", 2024-04-26T11:15:30.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:30.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.502 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.502 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.502 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375400+0000", 2024-04-26T11:15:30.502 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7230000000000001e-06 2024-04-26T11:15:30.502 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375404+0000", 2024-04-26T11:15:30.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4929999999999998e-06 2024-04-26T11:15:30.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375406+0000", 2024-04-26T11:15:30.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.74e-06 2024-04-26T11:15:30.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.503 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.503 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.503 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375447+0000", 2024-04-26T11:15:30.503 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0368999999999999e-05 2024-04-26T11:15:30.503 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375574+0000", 2024-04-26T11:15:30.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012730099999999999 2024-04-26T11:15:30.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:30.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375690+0000", 2024-04-26T11:15:30.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000115512 2024-04-26T11:15:30.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.504 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.504 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:30.504 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.380112+0000", 2024-04-26T11:15:30.504 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044225979999999998 2024-04-26T11:15:30.504 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:30.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477209+0000", 2024-04-26T11:15:30.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.097096846000000001 2024-04-26T11:15:30.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:30.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477250+0000", 2024-04-26T11:15:30.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1458000000000002e-05 2024-04-26T11:15:30.505 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.505 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.505 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:30.505 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477296+0000", 2024-04-26T11:15:30.505 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.587e-05 2024-04-26T11:15:30.505 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.505 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.506 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.506 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.506 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.506 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276552 5.8 5:12bf19e5:::benchmark_data_smithi029_44842_object131914:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:30.506 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.375412+0000", 2024-04-26T11:15:30.506 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 2.0698309300000002, 2024-04-26T11:15:30.506 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10418100700000001, 2024-04-26T11:15:30.506 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.506 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:30.506 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.506 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.506 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.506 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276552 2024-04-26T11:15:30.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.507 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375412+0000", 2024-04-26T11:15:30.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.507 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375412+0000", 2024-04-26T11:15:30.507 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.507 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.507 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.507 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375412+0000", 2024-04-26T11:15:30.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:30.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375414+0000", 2024-04-26T11:15:30.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0729999999999999e-06 2024-04-26T11:15:30.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.508 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375420+0000", 2024-04-26T11:15:30.508 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4759999999999997e-06 2024-04-26T11:15:30.508 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.508 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.508 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375422+0000", 2024-04-26T11:15:30.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8540000000000001e-06 2024-04-26T11:15:30.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377480+0000", 2024-04-26T11:15:30.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020577540000000002 2024-04-26T11:15:30.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.509 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377569+0000", 2024-04-26T11:15:30.509 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8406999999999996e-05 2024-04-26T11:15:30.509 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.509 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.509 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:30.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377630+0000", 2024-04-26T11:15:30.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1632999999999998e-05 2024-04-26T11:15:30.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:30.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479495+0000", 2024-04-26T11:15:30.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10186533 2024-04-26T11:15:30.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.510 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:30.510 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479508+0000", 2024-04-26T11:15:30.510 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-05 2024-04-26T11:15:30.510 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.510 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:30.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479554+0000", 2024-04-26T11:15:30.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6696999999999997e-05 2024-04-26T11:15:30.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.511 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:30.511 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479593+0000", 2024-04-26T11:15:30.511 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9059e-05 2024-04-26T11:15:30.511 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.511 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.511 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.511 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.511 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.511 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276554 5.e 5:7d1a16ce:::benchmark_data_smithi029_44842_object131916:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:30.511 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.375499+0000", 2024-04-26T11:15:30.512 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 2.0697440199999999, 2024-04-26T11:15:30.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10207537799999999, 2024-04-26T11:15:30.512 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.512 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:30.512 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.512 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.512 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.512 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276554 2024-04-26T11:15:30.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.512 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.512 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.512 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375499+0000", 2024-04-26T11:15:30.512 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.512 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.512 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375499+0000", 2024-04-26T11:15:30.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375498+0000", 2024-04-26T11:15:30.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:30.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.513 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.513 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.513 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375505+0000", 2024-04-26T11:15:30.513 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0839999999999997e-06 2024-04-26T11:15:30.513 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375512+0000", 2024-04-26T11:15:30.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3270000000000003e-06 2024-04-26T11:15:30.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375518+0000", 2024-04-26T11:15:30.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0619999999999997e-06 2024-04-26T11:15:30.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.514 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.514 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.514 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375578+0000", 2024-04-26T11:15:30.514 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0090999999999998e-05 2024-04-26T11:15:30.514 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375687+0000", 2024-04-26T11:15:30.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108933 2024-04-26T11:15:30.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:30.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375785+0000", 2024-04-26T11:15:30.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7744000000000005e-05 2024-04-26T11:15:30.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.515 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.515 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:30.515 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477165+0000", 2024-04-26T11:15:30.515 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10138062 2024-04-26T11:15:30.515 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:30.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477366+0000", 2024-04-26T11:15:30.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200526 2024-04-26T11:15:30.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:30.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477411+0000", 2024-04-26T11:15:30.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4684000000000001e-05 2024-04-26T11:15:30.516 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.516 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.516 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:30.516 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477575+0000", 2024-04-26T11:15:30.516 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000164029 2024-04-26T11:15:30.516 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.517 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.517 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.517 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.517 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276557 5.b 5:d2a87415:::benchmark_data_smithi029_44842_object131919:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:30.517 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.377684+0000", 2024-04-26T11:15:30.517 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 2.0675594500000001, 2024-04-26T11:15:30.517 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.099794806, 2024-04-26T11:15:30.517 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.517 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:30.517 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.517 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.517 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.517 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276557 2024-04-26T11:15:30.517 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.518 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377684+0000", 2024-04-26T11:15:30.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377684+0000", 2024-04-26T11:15:30.518 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.518 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.518 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.518 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.518 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377683+0000", 2024-04-26T11:15:30.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:30.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377687+0000", 2024-04-26T11:15:30.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5140000000000002e-06 2024-04-26T11:15:30.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377693+0000", 2024-04-26T11:15:30.519 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3609999999999997e-06 2024-04-26T11:15:30.519 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.519 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.519 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.519 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377701+0000", 2024-04-26T11:15:30.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0960000000000001e-06 2024-04-26T11:15:30.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377726+0000", 2024-04-26T11:15:30.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4635e-05 2024-04-26T11:15:30.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.520 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377795+0000", 2024-04-26T11:15:30.520 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8866000000000001e-05 2024-04-26T11:15:30.520 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.520 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.520 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:30.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377854+0000", 2024-04-26T11:15:30.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9781000000000002e-05 2024-04-26T11:15:30.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:30.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477243+0000", 2024-04-26T11:15:30.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.099388958999999999 2024-04-26T11:15:30.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:30.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477397+0000", 2024-04-26T11:15:30.521 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015366499999999999 2024-04-26T11:15:30.521 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.521 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.521 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:30.521 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477439+0000", 2024-04-26T11:15:30.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2432999999999998e-05 2024-04-26T11:15:30.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.522 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:30.522 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477479+0000", 2024-04-26T11:15:30.522 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9172999999999999e-05 2024-04-26T11:15:30.522 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.522 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.522 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.522 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.522 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.522 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276559 5.e 5:77601908:::benchmark_data_smithi029_44842_object131921:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:30.522 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.378420+0000", 2024-04-26T11:15:30.522 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 2.066822765, 2024-04-26T11:15:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.101361861, 2024-04-26T11:15:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276559 2024-04-26T11:15:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378420+0000", 2024-04-26T11:15:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.523 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378420+0000", 2024-04-26T11:15:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378420+0000", 2024-04-26T11:15:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378422+0000", 2024-04-26T11:15:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.441e-06 2024-04-26T11:15:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.524 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378429+0000", 2024-04-26T11:15:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7909999999999999e-06 2024-04-26T11:15:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378434+0000", 2024-04-26T11:15:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3699999999999997e-06 2024-04-26T11:15:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378460+0000", 2024-04-26T11:15:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6205000000000001e-05 2024-04-26T11:15:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.525 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378553+0000", 2024-04-26T11:15:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2931999999999997e-05 2024-04-26T11:15:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378629+0000", 2024-04-26T11:15:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6558999999999997e-05 2024-04-26T11:15:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477294+0000", 2024-04-26T11:15:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.098665186000000002 2024-04-26T11:15:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.526 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479725+0000", 2024-04-26T11:15:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024302579999999998 2024-04-26T11:15:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479750+0000", 2024-04-26T11:15:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5349000000000001e-05 2024-04-26T11:15:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479782+0000", 2024-04-26T11:15:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2221999999999997e-05 2024-04-26T11:15:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.527 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276561 5.8 5:1f9b90aa:::benchmark_data_smithi029_44842_object131923:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.378765+0000", 2024-04-26T11:15:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 2.0664786519999998, 2024-04-26T11:15:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.100953418, 2024-04-26T11:15:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276561 2024-04-26T11:15:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.528 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378765+0000", 2024-04-26T11:15:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378765+0000", 2024-04-26T11:15:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378764+0000", 2024-04-26T11:15:30.529 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378767+0000", 2024-04-26T11:15:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.546e-06 2024-04-26T11:15:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378776+0000", 2024-04-26T11:15:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9309999999999997e-06 2024-04-26T11:15:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.530 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378783+0000", 2024-04-26T11:15:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.691e-06 2024-04-26T11:15:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378888+0000", 2024-04-26T11:15:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010509999999999999 2024-04-26T11:15:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378953+0000", 2024-04-26T11:15:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4867000000000001e-05 2024-04-26T11:15:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:30.531 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379114+0000", 2024-04-26T11:15:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000161395 2024-04-26T11:15:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479601+0000", 2024-04-26T11:15:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10048657699999999 2024-04-26T11:15:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479631+0000", 2024-04-26T11:15:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0514999999999998e-05 2024-04-26T11:15:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:30.532 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479677+0000", 2024-04-26T11:15:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5504999999999999e-05 2024-04-26T11:15:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479718+0000", 2024-04-26T11:15:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1013000000000002e-05 2024-04-26T11:15:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276563 5.0 5:098fc0d9:::benchmark_data_smithi029_44842_object131925:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.378996+0000", 2024-04-26T11:15:30.533 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 2.0662469880000001, 2024-04-26T11:15:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.100680769, 2024-04-26T11:15:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276563 2024-04-26T11:15:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378996+0000", 2024-04-26T11:15:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.534 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378996+0000", 2024-04-26T11:15:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378996+0000", 2024-04-26T11:15:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378999+0000", 2024-04-26T11:15:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6909999999999999e-06 2024-04-26T11:15:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.535 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379007+0000", 2024-04-26T11:15:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9519999999999994e-06 2024-04-26T11:15:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379013+0000", 2024-04-26T11:15:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:15:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379044+0000", 2024-04-26T11:15:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0546999999999997e-05 2024-04-26T11:15:30.536 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379148+0000", 2024-04-26T11:15:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010414199999999999 2024-04-26T11:15:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379245+0000", 2024-04-26T11:15:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7106000000000002e-05 2024-04-26T11:15:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479481+0000", 2024-04-26T11:15:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10023639500000001 2024-04-26T11:15:30.537 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479607+0000", 2024-04-26T11:15:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012559999999999999 2024-04-26T11:15:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479644+0000", 2024-04-26T11:15:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7323999999999997e-05 2024-04-26T11:15:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479677+0000", 2024-04-26T11:15:30.538 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2787999999999998e-05 2024-04-26T11:15:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276564 5.8 5:16aef732:::benchmark_data_smithi029_44842_object131926:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.381311+0000", 2024-04-26T11:15:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 2.0639326809999998, 2024-04-26T11:15:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.101656785, 2024-04-26T11:15:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.539 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276564 2024-04-26T11:15:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381311+0000", 2024-04-26T11:15:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381311+0000", 2024-04-26T11:15:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.540 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381309+0000", 2024-04-26T11:15:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:15:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381319+0000", 2024-04-26T11:15:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0186e-05 2024-04-26T11:15:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381337+0000", 2024-04-26T11:15:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7833e-05 2024-04-26T11:15:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.541 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381350+0000", 2024-04-26T11:15:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2563e-05 2024-04-26T11:15:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381478+0000", 2024-04-26T11:15:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012802899999999999 2024-04-26T11:15:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477201+0000", 2024-04-26T11:15:30.542 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.095722990999999993 2024-04-26T11:15:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477332+0000", 2024-04-26T11:15:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000131478 2024-04-26T11:15:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.481980+0000", 2024-04-26T11:15:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0046472670000000001 2024-04-26T11:15:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.482887+0000", 2024-04-26T11:15:30.543 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00090784299999999997 2024-04-26T11:15:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.482933+0000", 2024-04-26T11:15:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6050000000000001e-05 2024-04-26T11:15:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.482967+0000", 2024-04-26T11:15:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3868000000000002e-05 2024-04-26T11:15:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.544 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276566 5.d 5:bb7a4c9f:::benchmark_data_smithi029_44842_object131928:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.381378+0000", 2024-04-26T11:15:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 2.0638650300000001, 2024-04-26T11:15:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.099107009999999995, 2024-04-26T11:15:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276566 2024-04-26T11:15:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.545 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381378+0000", 2024-04-26T11:15:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381378+0000", 2024-04-26T11:15:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381378+0000", 2024-04-26T11:15:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.546 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381380+0000", 2024-04-26T11:15:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9870000000000002e-06 2024-04-26T11:15:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381383+0000", 2024-04-26T11:15:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3440000000000001e-06 2024-04-26T11:15:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381386+0000", 2024-04-26T11:15:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9050000000000001e-06 2024-04-26T11:15:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.547 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381410+0000", 2024-04-26T11:15:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3589000000000001e-05 2024-04-26T11:15:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381488+0000", 2024-04-26T11:15:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8449999999999996e-05 2024-04-26T11:15:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.480404+0000", 2024-04-26T11:15:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.098916199999999996 2024-04-26T11:15:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.548 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.480432+0000", 2024-04-26T11:15:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7328999999999999e-05 2024-04-26T11:15:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.480485+0000", 2024-04-26T11:15:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3464000000000002e-05 2024-04-26T11:15:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.549 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(client.4534.0:276554 5.e e59/16 ondisk, result = 0)", 2024-04-26T11:15:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.382088+0000", 2024-04-26T11:15:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 2.0631551469999998, 2024-04-26T11:15:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.095081035999999994, 2024-04-26T11:15:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.382088+0000", 2024-04-26T11:15:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.382088+0000", 2024-04-26T11:15:30.550 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.382086+0000", 2024-04-26T11:15:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:15:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.382097+0000", 2024-04-26T11:15:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.041e-05 2024-04-26T11:15:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477080+0000", 2024-04-26T11:15:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.094983337000000001 2024-04-26T11:15:30.551 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477099+0000", 2024-04-26T11:15:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9040000000000001e-05 2024-04-26T11:15:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477148+0000", 2024-04-26T11:15:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8497e-05 2024-04-26T11:15:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477159+0000", 2024-04-26T11:15:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0933e-05 2024-04-26T11:15:30.552 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:30.553 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:30.553 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:30.553 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477169+0000", 2024-04-26T11:15:30.553 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0379e-05 2024-04-26T11:15:30.553 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.553 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.553 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.553 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:30.553 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:30.553 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:30.554 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:15:30.555 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:30.552+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:30.555 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:30.574 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:15:30.575 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:15:30.575 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:15:30.575 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:15:30.577 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:15:30.577 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:15:30.656 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:30.654+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:30.740 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:30.740 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:30.753 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:30.757 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:30.755+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:30.759 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:15:30.857 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:30.855+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:30.963 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:30.961+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:30.975 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:30.975 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:30.991 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:31.059 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:31.057+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:31.160 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:31.158+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:31.218 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:31.218 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:31.232 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:31.276 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:31.274+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:31.361 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:31.359+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:31.398 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:31.398 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:31.411 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:31.462 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:31.460+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:31.562 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:31.561+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:31.625 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:31.625 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:31.640 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:31.681 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:31.679+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:31.764 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:31.762+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:31.848 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:31.849 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:31.862 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:31.865 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:31.863+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:31.965 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:31.963+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:32.044 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:32.044 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:32.060 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:32.102 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:32.100+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:32.168 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:32.166+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:32.269 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:32.267+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:32.278 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:32.278 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:32.294 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:32.369 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:32.367+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:32.451 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~94s 2024-04-26T11:15:32.470 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:32.468+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:32.480 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:32.480 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:32.495 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:32.572 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:32.571+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:32.578 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:15:32.664 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:32.665 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:32.674 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:32.672+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:32.678 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:32.732 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:15:32.756 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:15:32.756 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:15:32.756 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:15:32.756 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:15:32.760 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:15:32.760 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:15:32.772 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:15:32.774 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:32.772+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:32.846 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:32.847 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:15:32.847 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:15:32.847 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:15:32.847 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:32.863 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:32.875 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:32.873+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:32.976 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:32.974+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:33.077 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:33.075+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:33.086 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:33.087 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:15:33.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:15:33.087 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:15:33.087 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.087 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:33.087 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:33.087 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.804570165000001, 2024-04-26T11:15:33.087 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:15:33.087 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:33.087 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.087 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:33.087 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:33.087 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.088 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:15:33.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.088 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:33.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:33.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:33.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.088 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.088 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:33.088 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:33.088 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:33.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:33.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:33.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:33.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:15:33.089 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:15:33.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.089 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.089 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:33.089 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:15:33.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:15:33.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:15:33.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:15:33.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:15:33.090 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:15:33.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.090 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.090 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:33.090 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:15:33.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:15:33.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:33.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:15:33.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:15:33.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:33.091 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:15:33.091 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:15:33.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.091 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.091 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:33.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:15:33.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:15:33.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:33.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:15:33.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:15:33.092 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.092 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.092 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:33.092 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:15:33.092 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:15:33.092 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.092 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:33.092 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.093 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.093 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:33.093 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:33.093 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 99.803920462999997, 2024-04-26T11:15:33.093 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:15:33.093 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:33.093 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.093 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:33.093 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:33.093 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.093 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:15:33.093 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.093 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:33.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:33.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:33.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:33.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:33.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.094 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.094 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.094 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:33.094 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:15:33.094 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:33.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:33.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:15:33.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:15:33.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:33.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:15:33.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:15:33.095 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.095 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.095 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.095 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:15:33.095 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:15:33.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:15:33.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:15:33.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:33.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:15:33.096 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:15:33.096 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.096 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.096 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:33.096 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:15:33.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:15:33.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:33.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:15:33.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:15:33.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:33.097 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:15:33.097 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:15:33.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.097 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.097 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:33.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:15:33.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:15:33.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.098 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:33.098 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:15:33.098 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:15:33.098 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.098 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:33.098 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.098 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.098 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.098 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:33.098 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:33.099 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.737278423999996, 2024-04-26T11:15:33.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:15:33.099 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:33.099 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:33.099 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:33.099 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:33.099 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.099 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:15:33.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.099 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:33.099 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.099 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:33.099 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:33.099 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:33.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:33.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:33.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:15:33.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:33.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.100 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.100 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:33.100 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:15:33.100 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:15:33.100 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:33.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:15:33.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:15:33.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:15:33.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:15:33.101 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.101 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.101 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.101 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:15:33.101 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:15:33.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:33.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:15:33.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:15:33.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:15:33.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:15:33.102 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.102 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.102 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:33.102 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:15:33.102 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:15:33.103 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.103 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:33.103 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.103 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.103 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.103 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:33.103 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:33.103 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.737182778000005, 2024-04-26T11:15:33.103 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:15:33.103 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:33.103 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:33.103 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:33.103 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:33.103 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.103 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:15:33.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.104 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:33.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:33.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:33.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:33.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:33.104 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.104 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.104 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:33.104 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:15:33.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:33.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:33.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:15:33.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:15:33.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:33.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:15:33.105 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:15:33.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.105 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.105 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.105 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:15:33.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:15:33.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:15:33.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:15:33.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.106 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.106 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:33.106 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:15:33.106 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:15:33.106 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:15:33.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:15:33.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.107 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:33.107 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:15:33.107 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:15:33.107 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.107 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:33.107 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.107 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.107 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:33.108 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:33.108 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.737051098999999, 2024-04-26T11:15:33.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:15:33.108 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:33.108 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:33.108 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:33.108 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:33.108 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.108 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:15:33.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.108 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:33.108 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.108 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:33.108 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:33.108 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:33.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:33.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:33.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:33.109 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:33.109 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.109 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.109 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:33.109 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:15:33.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:15:33.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:33.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:15:33.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:15:33.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.110 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:15:33.110 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:15:33.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.110 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.110 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:15:33.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:15:33.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:33.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:15:33.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:15:33.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:15:33.111 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:15:33.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.111 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.111 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:33.111 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:15:33.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:15:33.112 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.112 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:33.112 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.112 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.112 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.112 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:33.112 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:33.112 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.736942643000006, 2024-04-26T11:15:33.112 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:15:33.112 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:33.112 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:33.112 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:33.112 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:33.112 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.113 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:15:33.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.113 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:33.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:33.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:33.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.113 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:33.113 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:33.113 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.113 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.113 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:33.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:15:33.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:33.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:33.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:15:33.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:15:33.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.114 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.114 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:33.114 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:15:33.114 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:15:33.114 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:15:33.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:15:33.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:15:33.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:15:33.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.115 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:33.115 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:15:33.115 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:15:33.115 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.115 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:15:33.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:15:33.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.116 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:33.116 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:15:33.116 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:15:33.116 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.116 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:33.116 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.116 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.116 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.116 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:33.117 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:33.117 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.736841374999997, 2024-04-26T11:15:33.117 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:15:33.117 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:33.117 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.117 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:33.117 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:33.117 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.117 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:15:33.117 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.117 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:33.117 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.117 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:33.117 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:33.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:33.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:33.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:33.118 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:33.118 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:33.118 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.118 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.118 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:33.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:15:33.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:15:33.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:33.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:15:33.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:15:33.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.119 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:15:33.119 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:15:33.119 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.119 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.119 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:15:33.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:15:33.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:33.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:15:33.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:15:33.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.120 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.120 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:15:33.120 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:15:33.120 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.120 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:33.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:15:33.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:15:33.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:33.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:15:33.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:15:33.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.121 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:33.121 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:15:33.121 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:15:33.121 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.121 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.122 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:33.122 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:15:33.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:15:33.122 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.122 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:33.122 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.122 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.122 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.122 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:33.122 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:33.122 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.736772434000002, 2024-04-26T11:15:33.122 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:15:33.122 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:33.122 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.123 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:33.123 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:33.123 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.123 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:15:33.123 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.123 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:33.123 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.123 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:33.123 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:33.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:33.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:33.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:33.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:15:33.124 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:33.124 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.124 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.124 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:33.124 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:15:33.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:15:33.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:33.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:15:33.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:15:33.125 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.125 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.125 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.125 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:15:33.125 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:15:33.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:15:33.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:15:33.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.126 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:33.126 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:15:33.126 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:15:33.126 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.126 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:15:33.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:15:33.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:33.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:15:33.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:15:33.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.127 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.127 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:33.127 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:15:33.127 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:15:33.127 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:33.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:15:33.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:15:33.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.128 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:33.128 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:15:33.128 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:15:33.128 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.128 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:33.128 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.128 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.128 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.128 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:33.129 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:33.129 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 95.730776852999995, 2024-04-26T11:15:33.129 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:15:33.129 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:33.129 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.129 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:33.129 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:33.129 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.129 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:15:33.129 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.129 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:33.129 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.129 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:33.129 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:33.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:33.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:33.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:33.130 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:15:33.130 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:33.130 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.130 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.130 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:33.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:15:33.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:15:33.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:33.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:15:33.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:15:33.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.131 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.131 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:15:33.131 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:15:33.131 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.131 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:15:33.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:15:33.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:33.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:15:33.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:15:33.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.132 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.132 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.132 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:15:33.132 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:15:33.132 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:33.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:15:33.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:15:33.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:33.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:15:33.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:15:33.133 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.133 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.133 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:33.133 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:15:33.133 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:15:33.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.134 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:33.134 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:15:33.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:15:33.134 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.134 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:33.134 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.134 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.134 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.134 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174398 5.4 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:33.134 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:33.134 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 42.733470204, 2024-04-26T11:15:33.134 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.064773789999999998, 2024-04-26T11:15:33.135 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:33.135 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.135 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:33.135 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:33.135 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.135 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174398 2024-04-26T11:15:33.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.135 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:33.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.135 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:33.135 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:33.135 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.135 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.135 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:33.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:33.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:33.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349889+0000", 2024-04-26T11:15:33.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:33.136 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.136 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.136 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:33.136 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349895+0000", 2024-04-26T11:15:33.136 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4519999999999996e-06 2024-04-26T11:15:33.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:33.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349909+0000", 2024-04-26T11:15:33.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3791000000000001e-05 2024-04-26T11:15:33.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349919+0000", 2024-04-26T11:15:33.137 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0135999999999999e-05 2024-04-26T11:15:33.137 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.137 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.137 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.137 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349956+0000", 2024-04-26T11:15:33.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7642000000000003e-05 2024-04-26T11:15:33.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:33.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350080+0000", 2024-04-26T11:15:33.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123285 2024-04-26T11:15:33.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:33.138 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350192+0000", 2024-04-26T11:15:33.138 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112509 2024-04-26T11:15:33.138 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.138 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.138 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:33.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356232+0000", 2024-04-26T11:15:33.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060403339999999996 2024-04-26T11:15:33.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:33.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414616+0000", 2024-04-26T11:15:33.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.058383156999999998 2024-04-26T11:15:33.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.139 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:33.139 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414643+0000", 2024-04-26T11:15:33.139 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7317e-05 2024-04-26T11:15:33.139 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.139 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.140 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:33.140 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414664+0000", 2024-04-26T11:15:33.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1135999999999999e-05 2024-04-26T11:15:33.140 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.140 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:33.140 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.140 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.140 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.140 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276551 5.a 5:5533d612:::benchmark_data_smithi029_44842_object131913:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:33.140 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.375399+0000", 2024-04-26T11:15:33.140 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.7079618129999998, 2024-04-26T11:15:33.140 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.101897644, 2024-04-26T11:15:33.140 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:33.140 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.141 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:33.141 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:33.141 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.141 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276551 2024-04-26T11:15:33.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.141 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:33.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:33.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375399+0000", 2024-04-26T11:15:33.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.141 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.141 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.141 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:33.141 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375399+0000", 2024-04-26T11:15:33.141 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:33.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375398+0000", 2024-04-26T11:15:33.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:33.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:33.142 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375400+0000", 2024-04-26T11:15:33.142 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7230000000000001e-06 2024-04-26T11:15:33.142 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.142 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.142 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:33.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375404+0000", 2024-04-26T11:15:33.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4929999999999998e-06 2024-04-26T11:15:33.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375406+0000", 2024-04-26T11:15:33.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.74e-06 2024-04-26T11:15:33.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.143 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375447+0000", 2024-04-26T11:15:33.143 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0368999999999999e-05 2024-04-26T11:15:33.143 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.143 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.143 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:33.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375574+0000", 2024-04-26T11:15:33.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012730099999999999 2024-04-26T11:15:33.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:33.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375690+0000", 2024-04-26T11:15:33.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000115512 2024-04-26T11:15:33.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:33.144 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.380112+0000", 2024-04-26T11:15:33.144 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044225979999999998 2024-04-26T11:15:33.144 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.144 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.144 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:33.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477209+0000", 2024-04-26T11:15:33.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.097096846000000001 2024-04-26T11:15:33.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:33.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477250+0000", 2024-04-26T11:15:33.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1458000000000002e-05 2024-04-26T11:15:33.145 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.145 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.145 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:33.145 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477296+0000", 2024-04-26T11:15:33.145 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.587e-05 2024-04-26T11:15:33.145 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.145 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:33.145 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.146 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.146 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.146 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276552 5.8 5:12bf19e5:::benchmark_data_smithi029_44842_object131914:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:33.146 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.375412+0000", 2024-04-26T11:15:33.146 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.7079482200000005, 2024-04-26T11:15:33.146 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10418100700000001, 2024-04-26T11:15:33.146 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:33.146 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.146 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:33.146 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:33.146 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.147 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276552 2024-04-26T11:15:33.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.147 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:33.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:33.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375412+0000", 2024-04-26T11:15:33.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.147 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:33.147 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375412+0000", 2024-04-26T11:15:33.147 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.147 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.147 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:33.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375412+0000", 2024-04-26T11:15:33.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:33.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:33.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375414+0000", 2024-04-26T11:15:33.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0729999999999999e-06 2024-04-26T11:15:33.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.148 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:33.148 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375420+0000", 2024-04-26T11:15:33.148 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4759999999999997e-06 2024-04-26T11:15:33.148 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.148 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375422+0000", 2024-04-26T11:15:33.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8540000000000001e-06 2024-04-26T11:15:33.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377480+0000", 2024-04-26T11:15:33.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020577540000000002 2024-04-26T11:15:33.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.149 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.149 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:33.149 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377569+0000", 2024-04-26T11:15:33.149 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8406999999999996e-05 2024-04-26T11:15:33.149 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:33.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377630+0000", 2024-04-26T11:15:33.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1632999999999998e-05 2024-04-26T11:15:33.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:33.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479495+0000", 2024-04-26T11:15:33.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10186533 2024-04-26T11:15:33.150 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.150 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.150 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:33.150 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479508+0000", 2024-04-26T11:15:33.150 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-05 2024-04-26T11:15:33.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:33.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479554+0000", 2024-04-26T11:15:33.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6696999999999997e-05 2024-04-26T11:15:33.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.151 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:33.151 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479593+0000", 2024-04-26T11:15:33.151 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9059e-05 2024-04-26T11:15:33.151 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.151 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:33.151 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.151 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.151 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.151 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276554 5.e 5:7d1a16ce:::benchmark_data_smithi029_44842_object131916:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:33.152 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.375499+0000", 2024-04-26T11:15:33.152 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.7078613100000002, 2024-04-26T11:15:33.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10207537799999999, 2024-04-26T11:15:33.152 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:33.152 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.152 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:33.152 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:33.152 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.152 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276554 2024-04-26T11:15:33.152 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.152 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:33.152 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.152 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:33.152 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375499+0000", 2024-04-26T11:15:33.152 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:33.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375499+0000", 2024-04-26T11:15:33.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.153 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:33.153 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375498+0000", 2024-04-26T11:15:33.153 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:33.153 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.153 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:33.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375505+0000", 2024-04-26T11:15:33.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0839999999999997e-06 2024-04-26T11:15:33.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:33.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375512+0000", 2024-04-26T11:15:33.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3270000000000003e-06 2024-04-26T11:15:33.154 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.154 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.154 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.154 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375518+0000", 2024-04-26T11:15:33.154 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0619999999999997e-06 2024-04-26T11:15:33.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375578+0000", 2024-04-26T11:15:33.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0090999999999998e-05 2024-04-26T11:15:33.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:33.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375687+0000", 2024-04-26T11:15:33.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108933 2024-04-26T11:15:33.155 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.155 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.155 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:33.155 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375785+0000", 2024-04-26T11:15:33.155 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7744000000000005e-05 2024-04-26T11:15:33.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:33.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477165+0000", 2024-04-26T11:15:33.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10138062 2024-04-26T11:15:33.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:33.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477366+0000", 2024-04-26T11:15:33.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200526 2024-04-26T11:15:33.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.156 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.156 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:33.156 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477411+0000", 2024-04-26T11:15:33.156 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4684000000000001e-05 2024-04-26T11:15:33.156 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.157 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:33.157 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477575+0000", 2024-04-26T11:15:33.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000164029 2024-04-26T11:15:33.157 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.157 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:33.157 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.157 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.157 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.157 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276557 5.b 5:d2a87415:::benchmark_data_smithi029_44842_object131919:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:33.157 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.377684+0000", 2024-04-26T11:15:33.157 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.7056767400000004, 2024-04-26T11:15:33.157 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.099794806, 2024-04-26T11:15:33.157 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:33.157 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.158 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:33.158 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:33.158 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.158 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276557 2024-04-26T11:15:33.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.158 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:33.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:33.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377684+0000", 2024-04-26T11:15:33.158 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.158 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.158 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.158 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:33.158 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377684+0000", 2024-04-26T11:15:33.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:33.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377683+0000", 2024-04-26T11:15:33.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:33.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:33.159 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377687+0000", 2024-04-26T11:15:33.159 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5140000000000002e-06 2024-04-26T11:15:33.159 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.159 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.159 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:33.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377693+0000", 2024-04-26T11:15:33.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3609999999999997e-06 2024-04-26T11:15:33.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377701+0000", 2024-04-26T11:15:33.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0960000000000001e-06 2024-04-26T11:15:33.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.160 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377726+0000", 2024-04-26T11:15:33.160 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4635e-05 2024-04-26T11:15:33.160 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.160 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.160 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:33.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377795+0000", 2024-04-26T11:15:33.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8866000000000001e-05 2024-04-26T11:15:33.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:33.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377854+0000", 2024-04-26T11:15:33.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9781000000000002e-05 2024-04-26T11:15:33.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:33.161 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477243+0000", 2024-04-26T11:15:33.161 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.099388958999999999 2024-04-26T11:15:33.161 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.161 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.161 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:33.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477397+0000", 2024-04-26T11:15:33.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015366499999999999 2024-04-26T11:15:33.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:33.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477439+0000", 2024-04-26T11:15:33.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2432999999999998e-05 2024-04-26T11:15:33.162 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.162 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.162 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:33.162 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477479+0000", 2024-04-26T11:15:33.162 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9172999999999999e-05 2024-04-26T11:15:33.162 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.163 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:33.163 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.163 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.163 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.163 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276559 5.e 5:77601908:::benchmark_data_smithi029_44842_object131921:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:33.163 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.378420+0000", 2024-04-26T11:15:33.163 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.7049400549999998, 2024-04-26T11:15:33.163 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.101361861, 2024-04-26T11:15:33.163 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:33.163 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.163 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:33.163 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:33.163 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.163 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276559 2024-04-26T11:15:33.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.164 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:33.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:33.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378420+0000", 2024-04-26T11:15:33.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:33.164 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378420+0000", 2024-04-26T11:15:33.164 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.164 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.164 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.164 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:33.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378420+0000", 2024-04-26T11:15:33.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:33.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:33.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378422+0000", 2024-04-26T11:15:33.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.441e-06 2024-04-26T11:15:33.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.165 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:33.165 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378429+0000", 2024-04-26T11:15:33.165 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7909999999999999e-06 2024-04-26T11:15:33.165 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.165 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378434+0000", 2024-04-26T11:15:33.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3699999999999997e-06 2024-04-26T11:15:33.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378460+0000", 2024-04-26T11:15:33.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6205000000000001e-05 2024-04-26T11:15:33.166 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.166 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.166 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:33.166 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378553+0000", 2024-04-26T11:15:33.166 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2931999999999997e-05 2024-04-26T11:15:33.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:33.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378629+0000", 2024-04-26T11:15:33.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6558999999999997e-05 2024-04-26T11:15:33.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:33.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477294+0000", 2024-04-26T11:15:33.167 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.098665186000000002 2024-04-26T11:15:33.167 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.167 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.167 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:33.167 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479725+0000", 2024-04-26T11:15:33.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024302579999999998 2024-04-26T11:15:33.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:33.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479750+0000", 2024-04-26T11:15:33.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5349000000000001e-05 2024-04-26T11:15:33.168 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.168 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.168 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:33.168 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479782+0000", 2024-04-26T11:15:33.168 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2221999999999997e-05 2024-04-26T11:15:33.168 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.168 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:33.168 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.169 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276561 5.8 5:1f9b90aa:::benchmark_data_smithi029_44842_object131923:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:33.169 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.378765+0000", 2024-04-26T11:15:33.169 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.7045959420000001, 2024-04-26T11:15:33.169 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.100953418, 2024-04-26T11:15:33.169 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:33.169 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.169 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:33.169 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:33.169 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.169 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276561 2024-04-26T11:15:33.169 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.169 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:33.169 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:33.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378765+0000", 2024-04-26T11:15:33.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:33.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378765+0000", 2024-04-26T11:15:33.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.170 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.170 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:33.170 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378764+0000", 2024-04-26T11:15:33.170 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:33.170 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378767+0000", 2024-04-26T11:15:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.546e-06 2024-04-26T11:15:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378776+0000", 2024-04-26T11:15:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9309999999999997e-06 2024-04-26T11:15:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378783+0000", 2024-04-26T11:15:33.171 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.691e-06 2024-04-26T11:15:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378888+0000", 2024-04-26T11:15:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010509999999999999 2024-04-26T11:15:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378953+0000", 2024-04-26T11:15:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4867000000000001e-05 2024-04-26T11:15:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379114+0000", 2024-04-26T11:15:33.172 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000161395 2024-04-26T11:15:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479601+0000", 2024-04-26T11:15:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10048657699999999 2024-04-26T11:15:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479631+0000", 2024-04-26T11:15:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0514999999999998e-05 2024-04-26T11:15:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:33.173 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479677+0000", 2024-04-26T11:15:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5504999999999999e-05 2024-04-26T11:15:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479718+0000", 2024-04-26T11:15:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1013000000000002e-05 2024-04-26T11:15:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276563 5.0 5:098fc0d9:::benchmark_data_smithi029_44842_object131925:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.378996+0000", 2024-04-26T11:15:33.174 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.7043642779999999, 2024-04-26T11:15:33.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.100680769, 2024-04-26T11:15:33.175 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:33.175 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.175 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:33.175 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:33.175 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.175 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276563 2024-04-26T11:15:33.175 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.175 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:33.175 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.175 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:33.175 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378996+0000", 2024-04-26T11:15:33.175 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:33.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378996+0000", 2024-04-26T11:15:33.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:33.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378996+0000", 2024-04-26T11:15:33.176 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:33.176 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.176 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.176 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:33.176 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378999+0000", 2024-04-26T11:15:33.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6909999999999999e-06 2024-04-26T11:15:33.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:33.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379007+0000", 2024-04-26T11:15:33.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9519999999999994e-06 2024-04-26T11:15:33.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.177 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.177 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.177 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379013+0000", 2024-04-26T11:15:33.177 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:15:33.177 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379044+0000", 2024-04-26T11:15:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0546999999999997e-05 2024-04-26T11:15:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379148+0000", 2024-04-26T11:15:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010414199999999999 2024-04-26T11:15:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379245+0000", 2024-04-26T11:15:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7106000000000002e-05 2024-04-26T11:15:33.178 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479481+0000", 2024-04-26T11:15:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10023639500000001 2024-04-26T11:15:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479607+0000", 2024-04-26T11:15:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012559999999999999 2024-04-26T11:15:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479644+0000", 2024-04-26T11:15:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7323999999999997e-05 2024-04-26T11:15:33.179 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479677+0000", 2024-04-26T11:15:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2787999999999998e-05 2024-04-26T11:15:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276564 5.8 5:16aef732:::benchmark_data_smithi029_44842_object131926:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.381311+0000", 2024-04-26T11:15:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.7020499710000001, 2024-04-26T11:15:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.101656785, 2024-04-26T11:15:33.180 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276564 2024-04-26T11:15:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381311+0000", 2024-04-26T11:15:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:33.181 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381311+0000", 2024-04-26T11:15:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381309+0000", 2024-04-26T11:15:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:15:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381319+0000", 2024-04-26T11:15:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0186e-05 2024-04-26T11:15:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.182 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381337+0000", 2024-04-26T11:15:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7833e-05 2024-04-26T11:15:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381350+0000", 2024-04-26T11:15:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2563e-05 2024-04-26T11:15:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381478+0000", 2024-04-26T11:15:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012802899999999999 2024-04-26T11:15:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.183 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477201+0000", 2024-04-26T11:15:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.095722990999999993 2024-04-26T11:15:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477332+0000", 2024-04-26T11:15:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000131478 2024-04-26T11:15:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.481980+0000", 2024-04-26T11:15:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0046472670000000001 2024-04-26T11:15:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.184 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.482887+0000", 2024-04-26T11:15:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00090784299999999997 2024-04-26T11:15:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.482933+0000", 2024-04-26T11:15:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6050000000000001e-05 2024-04-26T11:15:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.482967+0000", 2024-04-26T11:15:33.185 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3868000000000002e-05 2024-04-26T11:15:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276566 5.d 5:bb7a4c9f:::benchmark_data_smithi029_44842_object131928:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.381378+0000", 2024-04-26T11:15:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.7019823199999999, 2024-04-26T11:15:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.099107009999999995, 2024-04-26T11:15:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:33.186 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276566 2024-04-26T11:15:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381378+0000", 2024-04-26T11:15:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381378+0000", 2024-04-26T11:15:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.187 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381378+0000", 2024-04-26T11:15:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381380+0000", 2024-04-26T11:15:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9870000000000002e-06 2024-04-26T11:15:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381383+0000", 2024-04-26T11:15:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3440000000000001e-06 2024-04-26T11:15:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.188 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381386+0000", 2024-04-26T11:15:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9050000000000001e-06 2024-04-26T11:15:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381410+0000", 2024-04-26T11:15:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3589000000000001e-05 2024-04-26T11:15:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381488+0000", 2024-04-26T11:15:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8449999999999996e-05 2024-04-26T11:15:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.189 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.480404+0000", 2024-04-26T11:15:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.098916199999999996 2024-04-26T11:15:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.480432+0000", 2024-04-26T11:15:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7328999999999999e-05 2024-04-26T11:15:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.480485+0000", 2024-04-26T11:15:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3464000000000002e-05 2024-04-26T11:15:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.190 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(client.4534.0:276554 5.e e59/16 ondisk, result = 0)", 2024-04-26T11:15:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.382088+0000", 2024-04-26T11:15:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 4.7012724370000001, 2024-04-26T11:15:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.095081035999999994, 2024-04-26T11:15:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.382088+0000", 2024-04-26T11:15:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.191 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.382088+0000", 2024-04-26T11:15:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.382086+0000", 2024-04-26T11:15:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:15:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.382097+0000", 2024-04-26T11:15:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.041e-05 2024-04-26T11:15:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.192 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477080+0000", 2024-04-26T11:15:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.094983337000000001 2024-04-26T11:15:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477099+0000", 2024-04-26T11:15:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9040000000000001e-05 2024-04-26T11:15:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477148+0000", 2024-04-26T11:15:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8497e-05 2024-04-26T11:15:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.193 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477159+0000", 2024-04-26T11:15:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0933e-05 2024-04-26T11:15:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477169+0000", 2024-04-26T11:15:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0379e-05 2024-04-26T11:15:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:33.194 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:33.194 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:33.196 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:33.193+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:33.196 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:33.296 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:33.295+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:33.304 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:Removed 144635 objects 2024-04-26T11:15:33.304 INFO:tasks.radosbench.radosbench.0.smithi029.stdout:Clean up completed and total clean up time :53.8822 2024-04-26T11:15:33.358 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:33.358 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:15:33.358 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 0 2024-04-26T11:15:33.358 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:33.369 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:33.398 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:33.397+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:33.495 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:33.496 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:15:33.496 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:15:33.496 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:15:33.496 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:33.499 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:33.498+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:33.505 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:33.600 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:33.598+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:33.633 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:33.633 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:15:33.633 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:15:33.633 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:15:33.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.634 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:33.634 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:33.634 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 100.359674895, 2024-04-26T11:15:33.634 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:15:33.634 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:33.634 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.634 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:33.634 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:33.634 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.634 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:15:33.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.634 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:33.635 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.635 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:33.635 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:33.635 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.635 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.635 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:33.635 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:33.635 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.635 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.635 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:33.635 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:15:33.635 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:33.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.636 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:33.636 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:15:33.636 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:15:33.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.636 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:33.636 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:15:33.636 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:15:33.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.636 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.636 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:15:33.636 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:15:33.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.637 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.637 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:15:33.637 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:15:33.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.637 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:33.637 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:15:33.637 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:15:33.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.637 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:33.637 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:15:33.637 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:15:33.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.638 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.638 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:33.638 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:15:33.638 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:15:33.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.638 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.638 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:33.638 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:15:33.638 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:15:33.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.638 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.638 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:33.638 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:15:33.638 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:15:33.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.639 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:33.639 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:15:33.639 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:15:33.639 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.639 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:33.639 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.639 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:33.640 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:33.640 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 100.35886333000001, 2024-04-26T11:15:33.640 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:15:33.640 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:33.640 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.640 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:33.640 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:33.640 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.640 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:15:33.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.640 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:33.641 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.641 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:33.641 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:33.641 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.641 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.642 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:33.642 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:33.642 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.642 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.642 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.643 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:33.643 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:33.643 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:33.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.643 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.643 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:33.643 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:15:33.643 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:15:33.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.643 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.643 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:33.643 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:15:33.644 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:15:33.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.644 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.644 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.644 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:15:33.644 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:15:33.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.644 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.644 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.644 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:15:33.644 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:15:33.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.645 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:33.645 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:15:33.645 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:15:33.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.645 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:33.645 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:15:33.645 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:15:33.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.645 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:33.645 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:15:33.645 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:15:33.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.646 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.646 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:33.646 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:15:33.646 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:15:33.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.646 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.646 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:33.646 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:15:33.646 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:15:33.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.646 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.647 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:33.647 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:15:33.647 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:15:33.647 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.647 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:33.647 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.647 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.647 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:33.647 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:33.648 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 100.351676493, 2024-04-26T11:15:33.648 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:15:33.648 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:33.648 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.648 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:33.648 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:33.648 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.648 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:15:33.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.648 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:33.648 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.648 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:33.648 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:33.649 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.649 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:33.649 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:33.649 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.649 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:33.649 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:15:33.649 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:33.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.650 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:33.650 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:15:33.650 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:15:33.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.650 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.650 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:33.650 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:15:33.650 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:15:33.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.650 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.650 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.651 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:15:33.651 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:15:33.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.651 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.651 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.651 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:15:33.651 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:15:33.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.651 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.651 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:33.651 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:15:33.651 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:15:33.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.651 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:33.652 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:15:33.652 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:15:33.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:33.652 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:15:33.652 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:15:33.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:33.652 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:15:33.653 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:15:33.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.653 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:33.653 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:15:33.653 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:15:33.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.653 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:33.653 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:15:33.653 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:15:33.654 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.654 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:33.654 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.654 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.654 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:33.654 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:33.654 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 100.351135614, 2024-04-26T11:15:33.654 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:15:33.654 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:33.654 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.654 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:33.655 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:33.655 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.655 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:15:33.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.655 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:33.655 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.655 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:33.655 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:33.655 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.655 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.655 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:33.655 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:33.656 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.656 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:33.656 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:33.656 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:33.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.656 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:33.656 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:15:33.656 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:15:33.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.657 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:33.657 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:15:33.657 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:15:33.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.657 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.657 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:15:33.657 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:15:33.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.657 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:15:33.658 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:15:33.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.658 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:33.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:15:33.658 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:15:33.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.658 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:33.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:15:33.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:15:33.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.659 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:33.659 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:15:33.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:15:33.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.659 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:33.659 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:15:33.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:15:33.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.660 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.660 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:33.660 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:15:33.660 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:15:33.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.660 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.660 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:33.660 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:15:33.660 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:15:33.660 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.660 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:33.660 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.661 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.661 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:33.661 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:33.661 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 96.307951166999999, 2024-04-26T11:15:33.661 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:15:33.661 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:33.661 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:33.661 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:33.661 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:33.661 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.661 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:15:33.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.662 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:33.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.662 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:33.662 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:33.662 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.662 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:33.662 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:33.662 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.662 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:33.663 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:15:33.663 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:33.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.663 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:33.663 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:15:33.663 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:15:33.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.663 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:33.663 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:15:33.663 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:15:33.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.664 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.664 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:15:33.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:15:33.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.664 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.664 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:15:33.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:15:33.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.664 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:33.664 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:15:33.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:15:33.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.665 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:33.665 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:15:33.665 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:15:33.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.665 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:33.665 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:15:33.665 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:15:33.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.665 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.665 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:15:33.665 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:15:33.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.666 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.666 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:33.666 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:15:33.666 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:15:33.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.666 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.666 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.666 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:15:33.666 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:15:33.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.666 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.666 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:33.666 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:15:33.667 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:15:33.667 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.667 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:33.667 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.667 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.667 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:33.667 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:33.667 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 96.305757826999994, 2024-04-26T11:15:33.667 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:15:33.667 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:33.667 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:33.667 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:33.667 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:33.667 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.668 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:15:33.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.668 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:33.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.668 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:33.668 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:33.668 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.668 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:33.668 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:33.668 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:33.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:15:33.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:33.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:33.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:15:33.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:15:33.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:33.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:15:33.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:15:33.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.670 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.670 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:15:33.670 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:15:33.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.670 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.670 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:15:33.670 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:15:33.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.670 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:33.670 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:15:33.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:15:33.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.671 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:33.671 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:15:33.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:15:33.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.671 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:33.671 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:15:33.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:15:33.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:15:33.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:15:33.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:33.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:15:33.672 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:15:33.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.672 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.672 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:15:33.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:15:33.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:33.673 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:15:33.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:15:33.673 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.673 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:33.673 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.673 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:33.673 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:33.673 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 96.300546002999994, 2024-04-26T11:15:33.673 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:15:33.673 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:33.674 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:33.674 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:33.674 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:33.674 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.674 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:15:33.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.674 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:33.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.674 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:33.674 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:33.674 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.674 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:33.675 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:33.675 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.675 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:33.675 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:15:33.675 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:33.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.675 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:33.675 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:15:33.675 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:15:33.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.675 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:33.676 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:15:33.676 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:15:33.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.676 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.676 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:15:33.676 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:15:33.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.676 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.676 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:15:33.676 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:15:33.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.676 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:33.677 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:15:33.677 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:15:33.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.677 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:33.677 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:15:33.677 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:15:33.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.677 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:33.677 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:15:33.677 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:15:33.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.677 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:15:33.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:15:33.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.678 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:33.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:15:33.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:15:33.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.678 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:15:33.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:15:33.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.679 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:33.679 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:15:33.679 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:15:33.679 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.679 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:33.679 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.679 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:33.679 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:33.679 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 96.284097302999996, 2024-04-26T11:15:33.679 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:15:33.679 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:33.679 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:33.679 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:33.680 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:33.680 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.680 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:15:33.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.680 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:33.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.680 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:33.680 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:33.680 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.680 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:33.681 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:33.681 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.681 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.681 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:33.681 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:15:33.681 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:33.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.681 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.681 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:33.681 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:15:33.681 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:15:33.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.682 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:33.682 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:15:33.682 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:15:33.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.682 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.682 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:15:33.682 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:15:33.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.683 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.683 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.683 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:15:33.683 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:15:33.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.683 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.683 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:33.683 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:15:33.683 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:15:33.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.683 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.683 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.683 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:15:33.683 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:15:33.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.684 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:33.684 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:15:33.684 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:15:33.684 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.684 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:33.684 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.684 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:33.685 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:33.685 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 96.282399798, 2024-04-26T11:15:33.685 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:15:33.685 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:33.685 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:33.685 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:33.685 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:33.685 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.685 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:15:33.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.685 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:33.686 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.686 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:33.686 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:33.686 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.686 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.686 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:33.686 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:33.686 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.686 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.686 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:33.687 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:15:33.687 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:33.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.687 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:33.687 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:15:33.687 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:15:33.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.687 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:33.687 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:15:33.687 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:15:33.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.688 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.688 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:15:33.688 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:15:33.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.688 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.688 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:15:33.688 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:15:33.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.688 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:33.689 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:15:33.689 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:15:33.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.689 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.689 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:15:33.689 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:15:33.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.689 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:33.689 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:15:33.689 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:15:33.689 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.690 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:33.690 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.690 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.690 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:33.690 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:33.690 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 96.282335496000002, 2024-04-26T11:15:33.690 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:15:33.690 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:33.690 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.690 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:33.690 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:33.690 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.691 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:15:33.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.691 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:33.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.691 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:33.691 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:33.691 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.691 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:33.691 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:33.692 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.692 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:33.692 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:33.692 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:33.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.692 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:33.692 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:15:33.692 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:15:33.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.693 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:33.693 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:15:33.693 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:15:33.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.693 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.693 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:15:33.693 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:15:33.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.693 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.693 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:15:33.693 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:15:33.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.694 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:33.694 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:15:33.694 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:15:33.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.694 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.694 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:15:33.694 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:15:33.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.695 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:33.695 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:15:33.695 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:15:33.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.695 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:33.695 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:15:33.695 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:15:33.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.695 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:33.695 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:15:33.696 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:15:33.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.696 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:33.696 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:15:33.696 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:15:33.696 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.696 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:33.696 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.697 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:33.697 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:33.697 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 96.282281272000006, 2024-04-26T11:15:33.697 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:15:33.697 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:33.697 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.697 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:33.697 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:33.697 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.697 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:15:33.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.698 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:33.698 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.698 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:33.698 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:33.698 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.698 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.698 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:33.698 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:33.698 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.698 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.699 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:33.699 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:33.699 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:33.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.699 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:33.699 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:15:33.699 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:15:33.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.699 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:33.700 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:15:33.700 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:15:33.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.700 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.700 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:15:33.700 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:15:33.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.700 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.700 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:15:33.700 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:15:33.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.701 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:33.701 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:15:33.701 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:15:33.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.701 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.701 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:15:33.701 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:15:33.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.702 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:33.702 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:15:33.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:15:33.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.702 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:33.702 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:15:33.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:15:33.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.702 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:33.702 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:15:33.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:15:33.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:33.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:15:33.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:15:33.703 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.703 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:33.703 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.703 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:33.704 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:33.704 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 96.282236760000004, 2024-04-26T11:15:33.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:15:33.704 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:33.704 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.704 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:33.704 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:33.704 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.704 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:15:33.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.704 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:33.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:33.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:33.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:33.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:33.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.705 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:33.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:15:33.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:33.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:33.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:15:33.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:15:33.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:33.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:15:33.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:15:33.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:15:33.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:15:33.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:15:33.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:15:33.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:33.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:15:33.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:15:33.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:15:33.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:15:33.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:33.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:15:33.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:15:33.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:33.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:15:33.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:15:33.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:33.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:15:33.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:15:33.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.709 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:33.709 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:15:33.709 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:15:33.709 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.709 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:33.709 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.709 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:33.709 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:33.709 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 96.278015757999995, 2024-04-26T11:15:33.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:15:33.710 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:33.710 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.710 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:33.710 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:33.710 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.710 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:15:33.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.710 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:33.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.710 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:33.710 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:33.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.711 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:33.711 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:33.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.711 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:33.711 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:15:33.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:15:33.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.711 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:33.711 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:15:33.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:15:33.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:33.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:15:33.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:15:33.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:15:33.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:15:33.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:15:33.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:15:33.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:33.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:15:33.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:15:33.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:15:33.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:15:33.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:33.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:15:33.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:15:33.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:33.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:15:33.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:15:33.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:33.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:15:33.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:15:33.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:33.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:15:33.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:15:33.715 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.715 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:33.715 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.715 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174388 5.c 5:312e5163:::benchmark_data_smithi029_44842_object29750:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:33.715 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:33.715 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 43.282190102999998, 2024-04-26T11:15:33.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.064002009999999998, 2024-04-26T11:15:33.715 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:33.715 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.715 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:33.716 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:33.716 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.716 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174388 2024-04-26T11:15:33.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.716 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:33.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.716 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:33.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:33.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.716 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:33.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:33.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:33.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348231+0000", 2024-04-26T11:15:33.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:33.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:33.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348233+0000", 2024-04-26T11:15:33.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2249999999999999e-06 2024-04-26T11:15:33.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:33.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348238+0000", 2024-04-26T11:15:33.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1899999999999997e-06 2024-04-26T11:15:33.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348241+0000", 2024-04-26T11:15:33.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.965e-06 2024-04-26T11:15:33.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348264+0000", 2024-04-26T11:15:33.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3014e-05 2024-04-26T11:15:33.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:33.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348371+0000", 2024-04-26T11:15:33.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000106889 2024-04-26T11:15:33.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:33.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412126+0000", 2024-04-26T11:15:33.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063755495999999995 2024-04-26T11:15:33.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:33.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412165+0000", 2024-04-26T11:15:33.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9269e-05 2024-04-26T11:15:33.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:33.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412234+0000", 2024-04-26T11:15:33.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8337000000000007e-05 2024-04-26T11:15:33.720 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.720 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:33.720 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.720 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174390 5.1 5:81c54fd7:::benchmark_data_smithi029_44842_object29752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:33.720 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:33.720 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 43.282074948999998, 2024-04-26T11:15:33.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063635918, 2024-04-26T11:15:33.721 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:33.721 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.721 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:33.721 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:33.721 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.721 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174390 2024-04-26T11:15:33.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.721 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:33.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:33.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:33.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:33.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:33.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:33.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348346+0000", 2024-04-26T11:15:33.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:33.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:33.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348351+0000", 2024-04-26T11:15:33.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.442e-06 2024-04-26T11:15:33.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:33.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348357+0000", 2024-04-26T11:15:33.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9530000000000002e-06 2024-04-26T11:15:33.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348363+0000", 2024-04-26T11:15:33.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2129999999999999e-06 2024-04-26T11:15:33.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348396+0000", 2024-04-26T11:15:33.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3161999999999999e-05 2024-04-26T11:15:33.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:33.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348511+0000", 2024-04-26T11:15:33.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000115253 2024-04-26T11:15:33.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:33.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411857+0000", 2024-04-26T11:15:33.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063345431999999993 2024-04-26T11:15:33.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:33.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411904+0000", 2024-04-26T11:15:33.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7389000000000003e-05 2024-04-26T11:15:33.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:33.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411983+0000", 2024-04-26T11:15:33.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8750000000000003e-05 2024-04-26T11:15:33.725 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.725 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:33.725 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.725 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174394 5.3 5:c91ce5cb:::benchmark_data_smithi029_44842_object29756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:33.726 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:33.726 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 43.281972005, 2024-04-26T11:15:33.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062247626, 2024-04-26T11:15:33.726 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:33.726 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.726 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:33.726 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:33.726 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.726 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174394 2024-04-26T11:15:33.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.726 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:33.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:33.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:33.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:33.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:33.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:33.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348449+0000", 2024-04-26T11:15:33.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:33.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:33.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348457+0000", 2024-04-26T11:15:33.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9619999999999993e-06 2024-04-26T11:15:33.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:33.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348462+0000", 2024-04-26T11:15:33.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6569999999999996e-06 2024-04-26T11:15:33.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348465+0000", 2024-04-26T11:15:33.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2990000000000001e-06 2024-04-26T11:15:33.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408427+0000", 2024-04-26T11:15:33.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.059961423 2024-04-26T11:15:33.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:33.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408554+0000", 2024-04-26T11:15:33.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012779600000000001 2024-04-26T11:15:33.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:33.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410570+0000", 2024-04-26T11:15:33.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020152719999999998 2024-04-26T11:15:33.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:33.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410624+0000", 2024-04-26T11:15:33.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4211e-05 2024-04-26T11:15:33.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:33.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410697+0000", 2024-04-26T11:15:33.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3447000000000003e-05 2024-04-26T11:15:33.732 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.732 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:33.732 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.732 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174395 5.1 5:8ee7f1d3:::benchmark_data_smithi029_44842_object29757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:33.732 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:33.732 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 43.280941914000003, 2024-04-26T11:15:33.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062622744999999994, 2024-04-26T11:15:33.732 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:33.732 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.733 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:33.733 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:33.733 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.733 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174395 2024-04-26T11:15:33.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.733 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:33.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:33.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:33.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:33.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:33.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:33.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349479+0000", 2024-04-26T11:15:33.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:33.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:33.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349483+0000", 2024-04-26T11:15:33.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.54e-06 2024-04-26T11:15:33.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:33.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349488+0000", 2024-04-26T11:15:33.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5119999999999999e-06 2024-04-26T11:15:33.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349492+0000", 2024-04-26T11:15:33.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7170000000000002e-06 2024-04-26T11:15:33.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350187+0000", 2024-04-26T11:15:33.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00069535899999999999 2024-04-26T11:15:33.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:33.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350292+0000", 2024-04-26T11:15:33.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0001047 2024-04-26T11:15:33.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:33.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411992+0000", 2024-04-26T11:15:33.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061699647000000003 2024-04-26T11:15:33.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:33.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412030+0000", 2024-04-26T11:15:33.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8124999999999998e-05 2024-04-26T11:15:33.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:33.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412103+0000", 2024-04-26T11:15:33.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2733999999999999e-05 2024-04-26T11:15:33.737 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.737 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:33.737 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.737 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174396 5.7 5:e0fad05d:::benchmark_data_smithi029_44842_object29758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:33.737 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:33.737 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 43.280858275, 2024-04-26T11:15:33.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062445026000000001, 2024-04-26T11:15:33.738 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:33.738 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.738 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:33.738 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:33.738 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.738 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174396 2024-04-26T11:15:33.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.738 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:33.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:33.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:33.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:33.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:33.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:33.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:33.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:33.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:33.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349566+0000", 2024-04-26T11:15:33.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2490000000000001e-06 2024-04-26T11:15:33.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:33.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349573+0000", 2024-04-26T11:15:33.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.776e-06 2024-04-26T11:15:33.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349576+0000", 2024-04-26T11:15:33.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3629999999999998e-06 2024-04-26T11:15:33.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350396+0000", 2024-04-26T11:15:33.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00081992199999999995 2024-04-26T11:15:33.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:33.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350516+0000", 2024-04-26T11:15:33.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012006900000000001 2024-04-26T11:15:33.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:33.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411924+0000", 2024-04-26T11:15:33.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061407960999999997 2024-04-26T11:15:33.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:33.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411947+0000", 2024-04-26T11:15:33.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2943999999999999e-05 2024-04-26T11:15:33.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:33.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412008+0000", 2024-04-26T11:15:33.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1237999999999999e-05 2024-04-26T11:15:33.742 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.742 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:33.742 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.743 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174397 5.7 5:e25daf9a:::benchmark_data_smithi029_44842_object29759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:33.743 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:33.743 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 43.280750146000003, 2024-04-26T11:15:33.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063878565999999998, 2024-04-26T11:15:33.743 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:33.743 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.743 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:33.743 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:33.743 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:33.743 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174397 2024-04-26T11:15:33.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.743 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:33.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:33.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:33.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:33.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:33.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:33.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349671+0000", 2024-04-26T11:15:33.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:33.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:33.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349674+0000", 2024-04-26T11:15:33.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3360000000000002e-06 2024-04-26T11:15:33.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:33.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349678+0000", 2024-04-26T11:15:33.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0709999999999996e-06 2024-04-26T11:15:33.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349681+0000", 2024-04-26T11:15:33.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3139999999999999e-06 2024-04-26T11:15:33.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410371+0000", 2024-04-26T11:15:33.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.060690202999999998 2024-04-26T11:15:33.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:33.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410463+0000", 2024-04-26T11:15:33.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2095000000000005e-05 2024-04-26T11:15:33.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:33.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413471+0000", 2024-04-26T11:15:33.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0030073909999999999 2024-04-26T11:15:33.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.747 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:33.747 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413499+0000", 2024-04-26T11:15:33.747 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8725e-05 2024-04-26T11:15:33.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.747 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:33.747 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413550+0000", 2024-04-26T11:15:33.747 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0810000000000003e-05 2024-04-26T11:15:33.747 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.747 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:33.747 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.748 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:174398 5.4 e46/16 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head v 46'10798, mlcod=46'10796)", 2024-04-26T11:15:33.748 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:33.748 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 43.280221935, 2024-04-26T11:15:33.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062067047, 2024-04-26T11:15:33.748 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:33.748 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:33.748 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:33.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:33.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:33.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:33.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:33.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:33.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:33.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350199+0000", 2024-04-26T11:15:33.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:33.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:33.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350205+0000", 2024-04-26T11:15:33.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6749999999999999e-06 2024-04-26T11:15:33.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:33.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350212+0000", 2024-04-26T11:15:33.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7000000000000002e-06 2024-04-26T11:15:33.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:33.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350216+0000", 2024-04-26T11:15:33.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5120000000000002e-06 2024-04-26T11:15:33.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:33.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350246+0000", 2024-04-26T11:15:33.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9978999999999999e-05 2024-04-26T11:15:33.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:33.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350263+0000", 2024-04-26T11:15:33.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.702e-05 2024-04-26T11:15:33.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:33.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412238+0000", 2024-04-26T11:15:33.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061974603000000003 2024-04-26T11:15:33.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:33.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:33.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:33.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412267+0000", 2024-04-26T11:15:33.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9116e-05 2024-04-26T11:15:33.752 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.752 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:33.752 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.752 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:33.752 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:33.752 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:33.754 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:33.754 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:33.751+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:33.766 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:15:33.854 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:33.853+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:33.883 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:33.883 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:15:33.883 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:15:33.883 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:33.893 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:33.955 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:33.954+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:34.019 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:34.019 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:15:34.019 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:15:34.019 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:15:34.019 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:34.029 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:34.070 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:34.068+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:34.157 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:34.155+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:34.197 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:34.197 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:15:34.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:15:34.197 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:15:34.197 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.197 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:34.197 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:34.197 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.91576239, 2024-04-26T11:15:34.197 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:15:34.197 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:34.197 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.198 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:34.198 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:34.198 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.198 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:15:34.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.198 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:34.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:34.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:34.198 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.198 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.198 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.198 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:34.198 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:34.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:34.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:34.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:34.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:34.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:15:34.199 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:15:34.199 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.199 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.199 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:34.199 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:15:34.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:15:34.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:15:34.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:15:34.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:15:34.200 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:15:34.200 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.200 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.200 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:34.200 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:15:34.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:15:34.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:34.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:15:34.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:15:34.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:34.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:15:34.201 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:15:34.201 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.201 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.201 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:34.201 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:15:34.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:15:34.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:34.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:15:34.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:15:34.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.202 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.202 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:34.202 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:15:34.202 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:15:34.202 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.202 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:34.202 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.202 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.203 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.203 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:34.203 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:34.203 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.91511268799999, 2024-04-26T11:15:34.203 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:15:34.203 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:34.203 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.203 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:34.203 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:34.203 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.203 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:15:34.203 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.203 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:34.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:34.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:34.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:34.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:34.204 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.204 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.204 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.204 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:34.204 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:15:34.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:34.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:34.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:15:34.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:15:34.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:34.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:15:34.205 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:15:34.205 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.205 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.205 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.205 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:15:34.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:15:34.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:15:34.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:15:34.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:34.206 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:15:34.206 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:15:34.206 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.206 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.206 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:34.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:15:34.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:15:34.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:34.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:15:34.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:15:34.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:34.207 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:15:34.207 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:15:34.207 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.207 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.207 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:34.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:15:34.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:15:34.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.208 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:34.208 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:15:34.208 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:15:34.208 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.208 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:34.208 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.208 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.208 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.208 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:34.208 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:34.208 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 96.848470649000006, 2024-04-26T11:15:34.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:15:34.209 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:34.209 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:34.209 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:34.209 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:34.209 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.209 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:15:34.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.209 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:34.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:34.209 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:34.209 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.209 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.209 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.209 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:34.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:34.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:34.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:15:34.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:34.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.210 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:34.210 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:15:34.210 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:15:34.210 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.210 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:34.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:15:34.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:15:34.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:15:34.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:15:34.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.211 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:15:34.211 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:15:34.211 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.211 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.211 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:34.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:15:34.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:15:34.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:15:34.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:15:34.212 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.212 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.212 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:34.212 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:15:34.212 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:15:34.212 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.212 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:34.212 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.213 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:34.213 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:34.213 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 96.848375003000001, 2024-04-26T11:15:34.213 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:15:34.213 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:34.213 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:34.213 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:34.213 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:34.213 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.213 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:15:34.213 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.213 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:34.213 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:34.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:34.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:34.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:34.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.214 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.214 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:34.214 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:15:34.214 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:34.214 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:34.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:15:34.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:15:34.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:34.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:15:34.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:15:34.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.215 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.215 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.215 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:15:34.215 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:15:34.215 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:15:34.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:15:34.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:34.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:15:34.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:15:34.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.216 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:15:34.216 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:15:34.216 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.216 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.216 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:34.217 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:15:34.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:15:34.217 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.217 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:34.217 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.217 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.217 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.217 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:34.217 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:34.217 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 96.848243323999995, 2024-04-26T11:15:34.217 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:15:34.217 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:34.217 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:34.217 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:34.217 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:34.218 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.218 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:15:34.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.218 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:34.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:34.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:34.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.218 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.218 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:34.218 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:34.218 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.218 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:34.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:34.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:34.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:34.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:15:34.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:15:34.219 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.219 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.219 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:34.219 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:15:34.219 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:15:34.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:15:34.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:15:34.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:15:34.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:15:34.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.220 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.220 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:34.220 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:15:34.220 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:15:34.220 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:15:34.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:15:34.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.221 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:34.221 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:15:34.221 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:15:34.221 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.221 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:34.221 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.221 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.221 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.221 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:34.222 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:34.222 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 96.848134868000002, 2024-04-26T11:15:34.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:15:34.222 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:34.222 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:34.222 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:34.222 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:34.222 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.222 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:15:34.222 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.222 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:34.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.222 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:34.222 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:34.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:34.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:34.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:34.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:15:34.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:34.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:34.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:15:34.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:15:34.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:34.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:15:34.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:15:34.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:15:34.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:15:34.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:15:34.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:15:34.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:34.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:15:34.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:15:34.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:15:34.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:15:34.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:34.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:15:34.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:15:34.226 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.226 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:34.226 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.226 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:34.226 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:34.226 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 96.848033599999994, 2024-04-26T11:15:34.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:15:34.226 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:34.226 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.226 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:34.226 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:34.227 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.227 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:15:34.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.227 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:34.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:34.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:34.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:34.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:34.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:34.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:34.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:34.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:34.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:15:34.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:15:34.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:34.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:15:34.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:15:34.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:15:34.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:15:34.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:15:34.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:15:34.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:34.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:15:34.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:15:34.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:15:34.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:15:34.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:34.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:15:34.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:15:34.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:34.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:15:34.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:15:34.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:34.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:15:34.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:15:34.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:34.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:15:34.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:15:34.231 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.231 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:34.231 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.232 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:34.232 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:34.232 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 96.847964658999999, 2024-04-26T11:15:34.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:15:34.232 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:34.232 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.232 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:34.232 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:34.232 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.232 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:15:34.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.232 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:34.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:34.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:34.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:34.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:34.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:34.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:15:34.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:34.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:34.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:15:34.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:15:34.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:34.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:15:34.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:15:34.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.234 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.234 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:15:34.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:15:34.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:15:34.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:15:34.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:34.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:15:34.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:15:34.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:15:34.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:15:34.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:34.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:15:34.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:15:34.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:34.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:15:34.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:15:34.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:34.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:15:34.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:15:34.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:34.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:15:34.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:15:34.237 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.237 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:34.237 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.237 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:34.237 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:34.237 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 96.841969078000005, 2024-04-26T11:15:34.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:15:34.238 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:34.238 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.238 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:34.238 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:34.238 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.238 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:15:34.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.238 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:34.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:34.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:34.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:34.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:34.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:34.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:15:34.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:34.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.239 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:34.239 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:15:34.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:15:34.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:34.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:15:34.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:15:34.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:15:34.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:15:34.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:15:34.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:15:34.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:34.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:15:34.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:15:34.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:15:34.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:15:34.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:34.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:15:34.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:15:34.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:34.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:15:34.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:15:34.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:34.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:15:34.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:15:34.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:34.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:15:34.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:15:34.243 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.243 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:34.243 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.243 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174398 5.4 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:34.243 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:34.243 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 43.844662429000003, 2024-04-26T11:15:34.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.064773789999999998, 2024-04-26T11:15:34.243 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:34.243 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.243 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:34.244 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:34.244 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.244 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174398 2024-04-26T11:15:34.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.244 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:34.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:34.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:34.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:34.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:34.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:34.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349889+0000", 2024-04-26T11:15:34.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:34.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:34.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349895+0000", 2024-04-26T11:15:34.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4519999999999996e-06 2024-04-26T11:15:34.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:34.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349909+0000", 2024-04-26T11:15:34.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3791000000000001e-05 2024-04-26T11:15:34.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349919+0000", 2024-04-26T11:15:34.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0135999999999999e-05 2024-04-26T11:15:34.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349956+0000", 2024-04-26T11:15:34.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7642000000000003e-05 2024-04-26T11:15:34.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:34.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350080+0000", 2024-04-26T11:15:34.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123285 2024-04-26T11:15:34.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:34.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350192+0000", 2024-04-26T11:15:34.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112509 2024-04-26T11:15:34.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:34.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356232+0000", 2024-04-26T11:15:34.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060403339999999996 2024-04-26T11:15:34.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:34.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414616+0000", 2024-04-26T11:15:34.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.058383156999999998 2024-04-26T11:15:34.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:34.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414643+0000", 2024-04-26T11:15:34.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7317e-05 2024-04-26T11:15:34.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:34.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414664+0000", 2024-04-26T11:15:34.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1135999999999999e-05 2024-04-26T11:15:34.248 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.248 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:34.248 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.249 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276551 5.a 5:5533d612:::benchmark_data_smithi029_44842_object131913:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:34.249 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.375399+0000", 2024-04-26T11:15:34.249 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.8191540379999998, 2024-04-26T11:15:34.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.101897644, 2024-04-26T11:15:34.249 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:34.249 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.249 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:34.249 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:34.249 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.249 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276551 2024-04-26T11:15:34.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.250 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:34.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:34.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375399+0000", 2024-04-26T11:15:34.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:34.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375399+0000", 2024-04-26T11:15:34.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:34.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375398+0000", 2024-04-26T11:15:34.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:34.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:34.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375400+0000", 2024-04-26T11:15:34.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7230000000000001e-06 2024-04-26T11:15:34.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:34.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375404+0000", 2024-04-26T11:15:34.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4929999999999998e-06 2024-04-26T11:15:34.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375406+0000", 2024-04-26T11:15:34.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.74e-06 2024-04-26T11:15:34.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375447+0000", 2024-04-26T11:15:34.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0368999999999999e-05 2024-04-26T11:15:34.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:34.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375574+0000", 2024-04-26T11:15:34.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012730099999999999 2024-04-26T11:15:34.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:34.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375690+0000", 2024-04-26T11:15:34.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000115512 2024-04-26T11:15:34.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:34.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.380112+0000", 2024-04-26T11:15:34.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044225979999999998 2024-04-26T11:15:34.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:34.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477209+0000", 2024-04-26T11:15:34.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.097096846000000001 2024-04-26T11:15:34.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:34.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477250+0000", 2024-04-26T11:15:34.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1458000000000002e-05 2024-04-26T11:15:34.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:34.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477296+0000", 2024-04-26T11:15:34.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.587e-05 2024-04-26T11:15:34.254 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.254 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:34.254 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.255 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276552 5.8 5:12bf19e5:::benchmark_data_smithi029_44842_object131914:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:34.255 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.375412+0000", 2024-04-26T11:15:34.255 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.8191404450000004, 2024-04-26T11:15:34.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10418100700000001, 2024-04-26T11:15:34.255 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:34.255 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.255 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:34.255 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:34.255 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.255 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276552 2024-04-26T11:15:34.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.255 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:34.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:34.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375412+0000", 2024-04-26T11:15:34.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:34.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375412+0000", 2024-04-26T11:15:34.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:34.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375412+0000", 2024-04-26T11:15:34.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:34.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:34.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375414+0000", 2024-04-26T11:15:34.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0729999999999999e-06 2024-04-26T11:15:34.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:34.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375420+0000", 2024-04-26T11:15:34.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4759999999999997e-06 2024-04-26T11:15:34.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375422+0000", 2024-04-26T11:15:34.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8540000000000001e-06 2024-04-26T11:15:34.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377480+0000", 2024-04-26T11:15:34.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020577540000000002 2024-04-26T11:15:34.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:34.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377569+0000", 2024-04-26T11:15:34.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8406999999999996e-05 2024-04-26T11:15:34.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:34.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377630+0000", 2024-04-26T11:15:34.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1632999999999998e-05 2024-04-26T11:15:34.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479495+0000", 2024-04-26T11:15:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10186533 2024-04-26T11:15:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479508+0000", 2024-04-26T11:15:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-05 2024-04-26T11:15:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479554+0000", 2024-04-26T11:15:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6696999999999997e-05 2024-04-26T11:15:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:34.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479593+0000", 2024-04-26T11:15:34.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9059e-05 2024-04-26T11:15:34.260 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.260 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:34.260 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.260 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276554 5.e 5:7d1a16ce:::benchmark_data_smithi029_44842_object131916:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:34.260 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.375499+0000", 2024-04-26T11:15:34.260 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.8190535350000001, 2024-04-26T11:15:34.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10207537799999999, 2024-04-26T11:15:34.260 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:34.260 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.260 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:34.261 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:34.261 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.261 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276554 2024-04-26T11:15:34.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.261 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:34.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:34.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375499+0000", 2024-04-26T11:15:34.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:34.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375499+0000", 2024-04-26T11:15:34.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:34.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375498+0000", 2024-04-26T11:15:34.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:34.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:34.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375505+0000", 2024-04-26T11:15:34.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0839999999999997e-06 2024-04-26T11:15:34.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375512+0000", 2024-04-26T11:15:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3270000000000003e-06 2024-04-26T11:15:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375518+0000", 2024-04-26T11:15:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0619999999999997e-06 2024-04-26T11:15:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375578+0000", 2024-04-26T11:15:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0090999999999998e-05 2024-04-26T11:15:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:34.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375687+0000", 2024-04-26T11:15:34.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108933 2024-04-26T11:15:34.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:34.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375785+0000", 2024-04-26T11:15:34.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7744000000000005e-05 2024-04-26T11:15:34.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:34.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477165+0000", 2024-04-26T11:15:34.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10138062 2024-04-26T11:15:34.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477366+0000", 2024-04-26T11:15:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200526 2024-04-26T11:15:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477411+0000", 2024-04-26T11:15:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4684000000000001e-05 2024-04-26T11:15:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477575+0000", 2024-04-26T11:15:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000164029 2024-04-26T11:15:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.265 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:34.266 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.266 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276557 5.b 5:d2a87415:::benchmark_data_smithi029_44842_object131919:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:34.266 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.377684+0000", 2024-04-26T11:15:34.266 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.8168689650000003, 2024-04-26T11:15:34.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.099794806, 2024-04-26T11:15:34.266 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:34.266 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.266 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:34.266 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:34.266 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.266 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276557 2024-04-26T11:15:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377684+0000", 2024-04-26T11:15:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377684+0000", 2024-04-26T11:15:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377683+0000", 2024-04-26T11:15:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377687+0000", 2024-04-26T11:15:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5140000000000002e-06 2024-04-26T11:15:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377693+0000", 2024-04-26T11:15:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3609999999999997e-06 2024-04-26T11:15:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377701+0000", 2024-04-26T11:15:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0960000000000001e-06 2024-04-26T11:15:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377726+0000", 2024-04-26T11:15:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4635e-05 2024-04-26T11:15:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377795+0000", 2024-04-26T11:15:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8866000000000001e-05 2024-04-26T11:15:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377854+0000", 2024-04-26T11:15:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9781000000000002e-05 2024-04-26T11:15:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477243+0000", 2024-04-26T11:15:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.099388958999999999 2024-04-26T11:15:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477397+0000", 2024-04-26T11:15:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015366499999999999 2024-04-26T11:15:34.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:34.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477439+0000", 2024-04-26T11:15:34.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2432999999999998e-05 2024-04-26T11:15:34.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.271 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:34.271 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477479+0000", 2024-04-26T11:15:34.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9172999999999999e-05 2024-04-26T11:15:34.271 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.271 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:34.271 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.271 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276559 5.e 5:77601908:::benchmark_data_smithi029_44842_object131921:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.378420+0000", 2024-04-26T11:15:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.8161322799999997, 2024-04-26T11:15:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.101361861, 2024-04-26T11:15:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276559 2024-04-26T11:15:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378420+0000", 2024-04-26T11:15:34.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378420+0000", 2024-04-26T11:15:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378420+0000", 2024-04-26T11:15:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378422+0000", 2024-04-26T11:15:34.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.441e-06 2024-04-26T11:15:34.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:34.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378429+0000", 2024-04-26T11:15:34.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7909999999999999e-06 2024-04-26T11:15:34.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378434+0000", 2024-04-26T11:15:34.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3699999999999997e-06 2024-04-26T11:15:34.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378460+0000", 2024-04-26T11:15:34.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6205000000000001e-05 2024-04-26T11:15:34.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:34.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378553+0000", 2024-04-26T11:15:34.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2931999999999997e-05 2024-04-26T11:15:34.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:34.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378629+0000", 2024-04-26T11:15:34.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6558999999999997e-05 2024-04-26T11:15:34.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:34.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477294+0000", 2024-04-26T11:15:34.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.098665186000000002 2024-04-26T11:15:34.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:34.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479725+0000", 2024-04-26T11:15:34.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024302579999999998 2024-04-26T11:15:34.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:34.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479750+0000", 2024-04-26T11:15:34.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5349000000000001e-05 2024-04-26T11:15:34.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479782+0000", 2024-04-26T11:15:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2221999999999997e-05 2024-04-26T11:15:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276561 5.8 5:1f9b90aa:::benchmark_data_smithi029_44842_object131923:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.378765+0000", 2024-04-26T11:15:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.815788167, 2024-04-26T11:15:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.100953418, 2024-04-26T11:15:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:34.277 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:34.278 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.278 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276561 2024-04-26T11:15:34.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.278 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:34.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:34.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378765+0000", 2024-04-26T11:15:34.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:34.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378765+0000", 2024-04-26T11:15:34.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378764+0000", 2024-04-26T11:15:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378767+0000", 2024-04-26T11:15:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.546e-06 2024-04-26T11:15:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378776+0000", 2024-04-26T11:15:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9309999999999997e-06 2024-04-26T11:15:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378783+0000", 2024-04-26T11:15:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.691e-06 2024-04-26T11:15:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378888+0000", 2024-04-26T11:15:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010509999999999999 2024-04-26T11:15:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378953+0000", 2024-04-26T11:15:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4867000000000001e-05 2024-04-26T11:15:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379114+0000", 2024-04-26T11:15:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000161395 2024-04-26T11:15:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479601+0000", 2024-04-26T11:15:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10048657699999999 2024-04-26T11:15:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479631+0000", 2024-04-26T11:15:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0514999999999998e-05 2024-04-26T11:15:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479677+0000", 2024-04-26T11:15:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5504999999999999e-05 2024-04-26T11:15:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479718+0000", 2024-04-26T11:15:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1013000000000002e-05 2024-04-26T11:15:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.282 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276563 5.0 5:098fc0d9:::benchmark_data_smithi029_44842_object131925:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.378996+0000", 2024-04-26T11:15:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.8155565029999998, 2024-04-26T11:15:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.100680769, 2024-04-26T11:15:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276563 2024-04-26T11:15:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378996+0000", 2024-04-26T11:15:34.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378996+0000", 2024-04-26T11:15:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378996+0000", 2024-04-26T11:15:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:34.284 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378999+0000", 2024-04-26T11:15:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6909999999999999e-06 2024-04-26T11:15:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379007+0000", 2024-04-26T11:15:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9519999999999994e-06 2024-04-26T11:15:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379013+0000", 2024-04-26T11:15:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:15:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379044+0000", 2024-04-26T11:15:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0546999999999997e-05 2024-04-26T11:15:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379148+0000", 2024-04-26T11:15:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010414199999999999 2024-04-26T11:15:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379245+0000", 2024-04-26T11:15:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7106000000000002e-05 2024-04-26T11:15:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479481+0000", 2024-04-26T11:15:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10023639500000001 2024-04-26T11:15:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479607+0000", 2024-04-26T11:15:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012559999999999999 2024-04-26T11:15:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479644+0000", 2024-04-26T11:15:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7323999999999997e-05 2024-04-26T11:15:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:34.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479677+0000", 2024-04-26T11:15:34.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2787999999999998e-05 2024-04-26T11:15:34.288 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.288 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:34.288 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.288 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276564 5.8 5:16aef732:::benchmark_data_smithi029_44842_object131926:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:34.288 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.381311+0000", 2024-04-26T11:15:34.288 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.813242196, 2024-04-26T11:15:34.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.101656785, 2024-04-26T11:15:34.288 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:34.288 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276564 2024-04-26T11:15:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381311+0000", 2024-04-26T11:15:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381311+0000", 2024-04-26T11:15:34.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381309+0000", 2024-04-26T11:15:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:15:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381319+0000", 2024-04-26T11:15:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0186e-05 2024-04-26T11:15:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:34.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381337+0000", 2024-04-26T11:15:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7833e-05 2024-04-26T11:15:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381350+0000", 2024-04-26T11:15:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2563e-05 2024-04-26T11:15:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381478+0000", 2024-04-26T11:15:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012802899999999999 2024-04-26T11:15:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:34.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477201+0000", 2024-04-26T11:15:34.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.095722990999999993 2024-04-26T11:15:34.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:34.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477332+0000", 2024-04-26T11:15:34.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000131478 2024-04-26T11:15:34.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:34.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.481980+0000", 2024-04-26T11:15:34.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0046472670000000001 2024-04-26T11:15:34.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.482887+0000", 2024-04-26T11:15:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00090784299999999997 2024-04-26T11:15:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.482933+0000", 2024-04-26T11:15:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6050000000000001e-05 2024-04-26T11:15:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.482967+0000", 2024-04-26T11:15:34.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3868000000000002e-05 2024-04-26T11:15:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276566 5.d 5:bb7a4c9f:::benchmark_data_smithi029_44842_object131928:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.381378+0000", 2024-04-26T11:15:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.8131745449999999, 2024-04-26T11:15:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.099107009999999995, 2024-04-26T11:15:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:34.294 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276566 2024-04-26T11:15:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381378+0000", 2024-04-26T11:15:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381378+0000", 2024-04-26T11:15:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381378+0000", 2024-04-26T11:15:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381380+0000", 2024-04-26T11:15:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9870000000000002e-06 2024-04-26T11:15:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381383+0000", 2024-04-26T11:15:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3440000000000001e-06 2024-04-26T11:15:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.296 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381386+0000", 2024-04-26T11:15:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9050000000000001e-06 2024-04-26T11:15:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381410+0000", 2024-04-26T11:15:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3589000000000001e-05 2024-04-26T11:15:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381488+0000", 2024-04-26T11:15:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8449999999999996e-05 2024-04-26T11:15:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:34.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.480404+0000", 2024-04-26T11:15:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.098916199999999996 2024-04-26T11:15:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.480432+0000", 2024-04-26T11:15:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7328999999999999e-05 2024-04-26T11:15:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.480485+0000", 2024-04-26T11:15:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3464000000000002e-05 2024-04-26T11:15:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:34.298 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(client.4534.0:276554 5.e e59/16 ondisk, result = 0)", 2024-04-26T11:15:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.382088+0000", 2024-04-26T11:15:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 5.812464662, 2024-04-26T11:15:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.095081035999999994, 2024-04-26T11:15:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.382088+0000", 2024-04-26T11:15:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:34.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.382088+0000", 2024-04-26T11:15:34.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:34.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:34.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.382086+0000", 2024-04-26T11:15:34.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:15:34.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:34.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.382097+0000", 2024-04-26T11:15:34.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.041e-05 2024-04-26T11:15:34.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:34.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477080+0000", 2024-04-26T11:15:34.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.094983337000000001 2024-04-26T11:15:34.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477099+0000", 2024-04-26T11:15:34.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9040000000000001e-05 2024-04-26T11:15:34.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:34.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477148+0000", 2024-04-26T11:15:34.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8497e-05 2024-04-26T11:15:34.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:34.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477159+0000", 2024-04-26T11:15:34.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0933e-05 2024-04-26T11:15:34.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:34.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:34.302 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:34.302 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477169+0000", 2024-04-26T11:15:34.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0379e-05 2024-04-26T11:15:34.302 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.302 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:34.302 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.302 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:34.303 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:34.303 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:34.304 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:34.305 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:34.302+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:34.405 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:34.404+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:34.437 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:34.437 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:15:34.437 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 0 2024-04-26T11:15:34.437 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:34.447 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:34.506 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:34.505+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:34.572 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:34.572 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:15:34.572 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:15:34.572 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:15:34.573 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:34.582 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:34.606 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:34.606+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:34.707 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:34.705+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:34.710 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:34.710 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:15:34.710 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:15:34.710 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:15:34.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.710 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:34.710 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:34.710 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 101.43683127200001, 2024-04-26T11:15:34.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:15:34.711 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:34.711 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.711 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:34.711 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:34.711 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.711 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:15:34.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.711 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:34.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.711 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:34.711 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:34.711 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:34.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:34.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:34.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:15:34.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:34.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.712 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:34.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:15:34.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:15:34.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:34.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:15:34.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:15:34.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:15:34.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:15:34.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:15:34.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:15:34.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:34.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:15:34.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:15:34.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:34.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:15:34.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:15:34.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:34.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:15:34.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:15:34.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:34.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:15:34.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:15:34.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:34.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:15:34.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:15:34.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:34.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:15:34.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:15:34.716 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.716 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:34.716 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.716 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:34.716 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:34.716 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 101.436019707, 2024-04-26T11:15:34.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:15:34.716 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:34.716 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.716 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:34.716 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:34.716 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.717 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:15:34.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.717 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:34.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:34.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:34.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:34.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:34.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:34.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:34.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:34.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:34.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:15:34.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:15:34.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:34.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:15:34.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:15:34.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:15:34.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:15:34.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:15:34.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:15:34.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:34.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:15:34.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:15:34.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:34.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:15:34.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:15:34.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:34.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:15:34.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:15:34.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:34.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:15:34.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:15:34.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:34.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:15:34.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:15:34.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.721 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:34.721 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:15:34.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:15:34.721 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.721 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:34.721 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.721 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:34.721 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:34.721 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 101.42883286999999, 2024-04-26T11:15:34.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:15:34.722 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:34.722 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.722 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:34.722 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:34.722 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.722 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:15:34.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.722 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:34.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:34.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:34.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:34.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:34.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:34.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:15:34.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:34.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:34.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:15:34.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:15:34.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:34.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:15:34.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:15:34.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:15:34.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:15:34.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:15:34.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:15:34.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:34.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:15:34.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:15:34.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:34.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:15:34.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:15:34.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:34.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:15:34.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:15:34.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.726 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:34.726 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:15:34.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:15:34.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:34.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:15:34.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:15:34.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:34.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:15:34.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:15:34.727 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.727 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:34.727 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.728 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:34.728 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:34.728 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 101.42829199099999, 2024-04-26T11:15:34.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:15:34.728 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:34.728 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.728 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:34.728 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:34.728 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.728 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:15:34.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.728 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:34.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:34.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:34.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:34.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:34.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:34.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:34.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:34.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:34.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:15:34.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:15:34.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:34.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:15:34.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:15:34.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:15:34.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:15:34.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:15:34.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:15:34.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:34.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:15:34.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:15:34.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:34.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:15:34.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:15:34.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:34.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:15:34.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:15:34.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:34.732 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:15:34.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:15:34.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:34.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:15:34.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:15:34.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:34.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:15:34.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:15:34.733 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.733 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:34.734 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.734 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:34.734 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:34.734 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 97.385107543999993, 2024-04-26T11:15:34.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:15:34.734 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:34.734 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:34.734 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:34.734 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:34.734 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.734 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:15:34.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.735 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:34.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:34.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:34.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:34.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:34.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:34.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:15:34.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:34.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:34.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:15:34.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:15:34.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:34.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:15:34.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:15:34.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:15:34.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:15:34.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.737 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:15:34.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:15:34.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:34.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:15:34.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:15:34.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:34.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:15:34.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:15:34.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:34.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:15:34.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:15:34.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:15:34.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:15:34.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:34.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:15:34.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:15:34.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:15:34.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:15:34.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:34.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:15:34.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:15:34.740 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.740 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:34.740 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.741 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:34.741 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:34.741 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 97.382914204000002, 2024-04-26T11:15:34.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:15:34.741 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:34.741 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:34.741 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:34.741 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:34.741 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.741 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:15:34.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.741 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:34.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:34.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:34.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:34.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:34.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:34.742 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:15:34.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:34.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:34.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:15:34.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:15:34.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:34.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:15:34.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:15:34.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:15:34.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:15:34.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:15:34.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:15:34.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:34.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:15:34.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:15:34.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:34.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:15:34.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:15:34.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:34.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:15:34.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:15:34.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:15:34.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:15:34.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:34.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:15:34.747 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:15:34.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.747 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.747 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:15:34.747 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:15:34.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.747 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:34.747 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:15:34.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:15:34.748 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.748 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:34.748 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.748 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:34.748 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:34.748 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 97.377702380000002, 2024-04-26T11:15:34.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:15:34.748 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:34.749 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:34.749 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:34.749 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:34.749 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.749 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:15:34.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.749 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:34.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:34.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:34.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:34.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:34.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:34.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:15:34.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:34.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:34.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:15:34.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:15:34.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:34.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:15:34.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:15:34.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:15:34.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:15:34.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:15:34.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:15:34.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:34.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:15:34.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:15:34.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:34.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:15:34.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:15:34.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:34.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:15:34.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:15:34.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:15:34.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:15:34.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:34.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:15:34.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:15:34.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:15:34.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:15:34.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:34.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:15:34.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:15:34.755 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.756 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:34.756 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.756 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:34.756 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:34.756 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 97.361253680000004, 2024-04-26T11:15:34.756 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:15:34.756 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:34.756 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:34.756 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:34.756 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:34.757 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.757 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:15:34.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.757 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:34.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.757 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:34.757 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:34.757 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.757 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:34.757 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:34.757 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.758 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:34.758 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:15:34.758 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:34.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.758 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:34.758 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:15:34.758 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:15:34.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.758 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.759 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:34.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:15:34.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:15:34.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.759 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:15:34.759 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:15:34.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.759 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.759 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:15:34.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:15:34.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.760 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:34.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:15:34.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:15:34.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.760 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.760 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:15:34.760 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:15:34.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.760 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:34.761 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:15:34.761 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:15:34.761 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.761 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:34.761 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.761 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:34.761 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:34.761 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 97.359556174999994, 2024-04-26T11:15:34.761 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:15:34.761 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:34.761 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:34.761 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:34.762 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:34.762 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.762 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:15:34.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.762 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:34.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.762 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:34.762 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:34.762 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.762 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:34.762 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:34.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.763 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:34.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:15:34.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:34.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.763 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:34.763 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:15:34.763 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:15:34.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.763 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:34.764 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:15:34.764 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:15:34.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.764 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.764 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:15:34.764 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:15:34.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.764 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.764 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.764 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:15:34.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:15:34.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:34.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:15:34.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:15:34.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.765 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:15:34.765 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:15:34.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.765 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:34.766 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:15:34.766 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:15:34.766 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.766 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:34.766 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.766 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.766 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:34.766 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:34.766 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 97.359491872999996, 2024-04-26T11:15:34.766 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:15:34.766 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:34.767 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.767 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:34.767 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:34.767 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.767 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:15:34.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.767 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:34.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.767 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:34.767 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:34.767 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.767 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:34.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:34.768 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.768 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:34.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:34.768 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:34.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.768 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:34.768 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:15:34.768 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:15:34.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.769 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:34.769 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:15:34.769 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:15:34.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.769 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.769 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:15:34.769 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:15:34.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.769 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.769 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:15:34.770 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:15:34.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.770 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.770 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:34.770 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:15:34.770 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:15:34.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.770 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.770 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.770 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:15:34.770 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:15:34.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.770 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.771 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:34.771 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:15:34.771 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:15:34.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.771 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.771 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:34.771 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:15:34.771 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:15:34.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.771 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.771 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:34.771 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:15:34.771 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:15:34.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.772 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.772 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:34.772 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:15:34.772 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:15:34.772 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.772 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:34.772 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.772 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.772 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:34.772 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:34.772 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 97.359437649, 2024-04-26T11:15:34.772 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:15:34.772 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:34.772 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.772 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:34.773 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:34.773 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.773 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:15:34.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.773 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:34.773 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.773 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:34.773 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:34.773 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.773 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.773 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:34.774 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:34.774 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.774 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.774 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:34.774 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:34.774 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:34.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.774 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.774 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:34.774 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:15:34.774 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:15:34.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.775 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.775 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:34.775 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:15:34.775 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:15:34.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.775 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.775 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.775 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:15:34.775 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:15:34.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.775 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.775 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.775 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:15:34.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:15:34.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.776 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:34.776 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:15:34.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:15:34.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.776 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.776 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:15:34.776 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:15:34.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.777 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:34.777 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:15:34.777 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:15:34.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.777 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:34.777 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:15:34.777 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:15:34.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.778 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:34.778 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:15:34.778 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:15:34.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.778 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.778 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:34.778 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:15:34.778 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:15:34.778 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.778 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:34.778 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.778 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.779 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:34.779 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:34.779 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 97.359393136999998, 2024-04-26T11:15:34.779 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:15:34.779 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:34.779 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.779 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:34.779 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:34.779 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.779 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:15:34.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.780 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:34.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.780 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:34.780 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:34.780 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.780 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:34.780 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:34.780 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.781 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:34.781 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:15:34.781 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:34.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.781 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.781 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:34.781 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:15:34.781 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:15:34.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.781 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.781 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:34.781 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:15:34.781 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:15:34.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.782 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.782 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:15:34.782 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:15:34.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.782 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.782 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:15:34.782 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:15:34.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.782 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:34.782 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:15:34.782 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:15:34.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.783 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.783 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.783 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:15:34.783 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:15:34.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.783 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.783 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:34.783 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:15:34.783 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:15:34.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.783 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.783 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:34.783 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:15:34.783 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:15:34.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.784 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:34.784 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:15:34.784 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:15:34.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.784 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:34.784 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:15:34.784 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:15:34.784 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.784 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:34.784 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.785 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:34.785 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:34.785 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 97.355172135000004, 2024-04-26T11:15:34.785 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:15:34.785 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:34.785 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.785 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:34.785 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:34.785 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.785 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:15:34.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.785 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:34.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.786 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:34.786 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:34.786 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.786 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:34.786 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:34.786 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.786 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:34.786 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:15:34.786 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:15:34.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.787 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.787 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:34.787 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:15:34.787 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:15:34.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.787 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.787 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:34.787 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:15:34.787 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:15:34.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.787 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.787 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.787 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:15:34.787 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:15:34.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.788 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.788 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:15:34.788 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:15:34.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.788 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:34.788 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:15:34.788 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:15:34.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.788 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.788 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:15:34.788 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:15:34.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.789 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:34.789 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:15:34.789 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:15:34.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.789 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:34.789 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:15:34.789 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:15:34.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.789 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:34.789 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:15:34.790 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:15:34.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.790 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:34.790 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:15:34.790 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:15:34.790 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.790 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:34.790 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.790 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174388 5.c 5:312e5163:::benchmark_data_smithi029_44842_object29750:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:34.790 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:34.791 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 44.359346479999999, 2024-04-26T11:15:34.791 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.064002009999999998, 2024-04-26T11:15:34.791 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:34.791 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.791 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:34.791 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:34.791 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.791 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174388 2024-04-26T11:15:34.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.791 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:34.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.791 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:34.791 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:34.792 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.792 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.792 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:34.792 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:34.792 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.792 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.792 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:34.792 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348231+0000", 2024-04-26T11:15:34.792 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:34.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.792 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.793 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:34.793 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348233+0000", 2024-04-26T11:15:34.793 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2249999999999999e-06 2024-04-26T11:15:34.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.793 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:34.793 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348238+0000", 2024-04-26T11:15:34.793 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1899999999999997e-06 2024-04-26T11:15:34.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.793 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.793 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348241+0000", 2024-04-26T11:15:34.793 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.965e-06 2024-04-26T11:15:34.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.794 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.794 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348264+0000", 2024-04-26T11:15:34.794 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3014e-05 2024-04-26T11:15:34.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.794 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:34.794 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348371+0000", 2024-04-26T11:15:34.794 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000106889 2024-04-26T11:15:34.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.794 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:34.794 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412126+0000", 2024-04-26T11:15:34.794 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063755495999999995 2024-04-26T11:15:34.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.795 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:34.795 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412165+0000", 2024-04-26T11:15:34.795 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9269e-05 2024-04-26T11:15:34.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.795 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:34.795 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412234+0000", 2024-04-26T11:15:34.795 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8337000000000007e-05 2024-04-26T11:15:34.795 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.795 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:34.795 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.795 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174390 5.1 5:81c54fd7:::benchmark_data_smithi029_44842_object29752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:34.796 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:34.796 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 44.359231326, 2024-04-26T11:15:34.796 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063635918, 2024-04-26T11:15:34.796 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:34.796 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.796 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:34.796 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:34.796 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.796 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174390 2024-04-26T11:15:34.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.796 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:34.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.796 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:34.796 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:34.797 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.797 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.797 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:34.797 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:34.797 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.797 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.797 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:34.797 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348346+0000", 2024-04-26T11:15:34.797 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:34.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.797 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.798 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:34.798 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348351+0000", 2024-04-26T11:15:34.798 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.442e-06 2024-04-26T11:15:34.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.798 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.798 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:34.798 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348357+0000", 2024-04-26T11:15:34.798 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9530000000000002e-06 2024-04-26T11:15:34.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.798 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.798 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.798 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348363+0000", 2024-04-26T11:15:34.798 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2129999999999999e-06 2024-04-26T11:15:34.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.799 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.799 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348396+0000", 2024-04-26T11:15:34.799 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3161999999999999e-05 2024-04-26T11:15:34.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.799 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:34.799 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348511+0000", 2024-04-26T11:15:34.799 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000115253 2024-04-26T11:15:34.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.799 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:34.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411857+0000", 2024-04-26T11:15:34.800 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063345431999999993 2024-04-26T11:15:34.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.800 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:34.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411904+0000", 2024-04-26T11:15:34.800 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7389000000000003e-05 2024-04-26T11:15:34.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.800 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:34.800 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411983+0000", 2024-04-26T11:15:34.800 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8750000000000003e-05 2024-04-26T11:15:34.801 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.801 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:34.801 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.801 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174394 5.3 5:c91ce5cb:::benchmark_data_smithi029_44842_object29756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:34.801 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:34.801 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 44.359128382000002, 2024-04-26T11:15:34.801 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062247626, 2024-04-26T11:15:34.801 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:34.801 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.801 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:34.801 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:34.802 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.802 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174394 2024-04-26T11:15:34.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.802 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:34.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.802 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:34.802 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:34.802 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.802 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:34.802 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:34.802 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.803 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:34.803 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348449+0000", 2024-04-26T11:15:34.803 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:34.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.803 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:34.803 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348457+0000", 2024-04-26T11:15:34.803 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9619999999999993e-06 2024-04-26T11:15:34.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.803 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:34.803 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348462+0000", 2024-04-26T11:15:34.804 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6569999999999996e-06 2024-04-26T11:15:34.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.804 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.804 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348465+0000", 2024-04-26T11:15:34.804 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2990000000000001e-06 2024-04-26T11:15:34.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.804 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.804 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408427+0000", 2024-04-26T11:15:34.804 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.059961423 2024-04-26T11:15:34.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.805 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:34.805 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408554+0000", 2024-04-26T11:15:34.805 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012779600000000001 2024-04-26T11:15:34.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.805 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:34.805 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410570+0000", 2024-04-26T11:15:34.805 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020152719999999998 2024-04-26T11:15:34.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.805 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:34.805 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410624+0000", 2024-04-26T11:15:34.805 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4211e-05 2024-04-26T11:15:34.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.806 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:34.806 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410697+0000", 2024-04-26T11:15:34.806 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3447000000000003e-05 2024-04-26T11:15:34.806 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.806 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:34.806 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.806 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.806 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174395 5.1 5:8ee7f1d3:::benchmark_data_smithi029_44842_object29757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:34.806 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:34.806 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 44.358098290999997, 2024-04-26T11:15:34.806 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062622744999999994, 2024-04-26T11:15:34.806 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:34.806 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.807 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:34.807 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:34.807 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.807 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174395 2024-04-26T11:15:34.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.807 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:34.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.807 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:34.807 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:34.807 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.807 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:34.807 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:34.808 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.808 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.808 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:34.808 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349479+0000", 2024-04-26T11:15:34.808 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:34.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.808 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.808 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:34.808 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349483+0000", 2024-04-26T11:15:34.808 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.54e-06 2024-04-26T11:15:34.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.808 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.808 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:34.808 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349488+0000", 2024-04-26T11:15:34.809 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5119999999999999e-06 2024-04-26T11:15:34.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.809 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.809 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.809 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349492+0000", 2024-04-26T11:15:34.809 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7170000000000002e-06 2024-04-26T11:15:34.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.809 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.809 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.809 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350187+0000", 2024-04-26T11:15:34.809 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00069535899999999999 2024-04-26T11:15:34.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.809 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.809 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:34.810 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350292+0000", 2024-04-26T11:15:34.810 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0001047 2024-04-26T11:15:34.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.810 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.810 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:34.810 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411992+0000", 2024-04-26T11:15:34.810 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061699647000000003 2024-04-26T11:15:34.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.810 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.810 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:34.810 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412030+0000", 2024-04-26T11:15:34.810 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8124999999999998e-05 2024-04-26T11:15:34.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.811 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:34.811 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412103+0000", 2024-04-26T11:15:34.811 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2733999999999999e-05 2024-04-26T11:15:34.811 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.811 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:34.811 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.811 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174396 5.7 5:e0fad05d:::benchmark_data_smithi029_44842_object29758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:34.811 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:34.811 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 44.358014652000001, 2024-04-26T11:15:34.812 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062445026000000001, 2024-04-26T11:15:34.812 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:34.812 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.812 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:34.812 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:34.812 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.812 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174396 2024-04-26T11:15:34.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.812 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:34.812 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.812 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:34.812 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:34.812 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.813 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.813 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:34.813 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:34.813 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.813 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.813 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:34.813 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:34.813 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:34.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.813 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.813 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:34.813 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349566+0000", 2024-04-26T11:15:34.814 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2490000000000001e-06 2024-04-26T11:15:34.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.814 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.814 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:34.814 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349573+0000", 2024-04-26T11:15:34.814 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.776e-06 2024-04-26T11:15:34.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.814 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.814 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.814 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349576+0000", 2024-04-26T11:15:34.814 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3629999999999998e-06 2024-04-26T11:15:34.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.814 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.814 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.815 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350396+0000", 2024-04-26T11:15:34.815 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00081992199999999995 2024-04-26T11:15:34.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.815 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.815 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:34.815 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350516+0000", 2024-04-26T11:15:34.815 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012006900000000001 2024-04-26T11:15:34.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.815 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.815 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:34.815 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411924+0000", 2024-04-26T11:15:34.815 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061407960999999997 2024-04-26T11:15:34.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.816 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.816 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:34.816 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411947+0000", 2024-04-26T11:15:34.816 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2943999999999999e-05 2024-04-26T11:15:34.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.816 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.816 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:34.816 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412008+0000", 2024-04-26T11:15:34.816 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1237999999999999e-05 2024-04-26T11:15:34.816 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.816 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:34.816 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.817 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.817 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174397 5.7 5:e25daf9a:::benchmark_data_smithi029_44842_object29759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:34.817 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:34.817 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 44.357906522999997, 2024-04-26T11:15:34.817 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063878565999999998, 2024-04-26T11:15:34.817 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:34.817 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.817 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:34.817 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:34.817 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:34.817 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174397 2024-04-26T11:15:34.817 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.817 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:34.817 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.818 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:34.818 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:34.818 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.818 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.818 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.818 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:34.818 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:34.818 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.818 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.818 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.818 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:34.818 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349671+0000", 2024-04-26T11:15:34.818 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:34.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.819 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.819 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:34.819 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349674+0000", 2024-04-26T11:15:34.819 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3360000000000002e-06 2024-04-26T11:15:34.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.819 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.819 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:34.819 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349678+0000", 2024-04-26T11:15:34.819 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0709999999999996e-06 2024-04-26T11:15:34.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.820 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.820 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.820 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349681+0000", 2024-04-26T11:15:34.820 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3139999999999999e-06 2024-04-26T11:15:34.820 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.820 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.820 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.820 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410371+0000", 2024-04-26T11:15:34.820 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.060690202999999998 2024-04-26T11:15:34.820 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.820 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.821 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:34.821 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410463+0000", 2024-04-26T11:15:34.821 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2095000000000005e-05 2024-04-26T11:15:34.821 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.821 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.821 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:34.821 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413471+0000", 2024-04-26T11:15:34.821 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0030073909999999999 2024-04-26T11:15:34.821 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.821 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.821 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:34.821 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413499+0000", 2024-04-26T11:15:34.821 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8725e-05 2024-04-26T11:15:34.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.822 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.822 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:34.822 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413550+0000", 2024-04-26T11:15:34.822 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0810000000000003e-05 2024-04-26T11:15:34.822 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.822 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:34.822 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.822 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.822 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:174398 5.4 e46/16 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head v 46'10798, mlcod=46'10796)", 2024-04-26T11:15:34.822 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:34.822 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 44.357378312000002, 2024-04-26T11:15:34.822 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062067047, 2024-04-26T11:15:34.823 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:34.823 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:34.823 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:34.823 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.823 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:34.823 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:34.823 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.823 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.823 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:34.823 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:34.823 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:34.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.824 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.824 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:34.824 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350199+0000", 2024-04-26T11:15:34.824 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:34.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.824 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.824 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:34.824 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350205+0000", 2024-04-26T11:15:34.824 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6749999999999999e-06 2024-04-26T11:15:34.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.824 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.824 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:34.825 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350212+0000", 2024-04-26T11:15:34.825 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7000000000000002e-06 2024-04-26T11:15:34.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.825 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.825 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:34.825 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350216+0000", 2024-04-26T11:15:34.825 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5120000000000002e-06 2024-04-26T11:15:34.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.825 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.825 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:34.825 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350246+0000", 2024-04-26T11:15:34.825 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9978999999999999e-05 2024-04-26T11:15:34.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.826 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.826 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:34.826 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350263+0000", 2024-04-26T11:15:34.826 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.702e-05 2024-04-26T11:15:34.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.826 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.826 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:34.826 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412238+0000", 2024-04-26T11:15:34.826 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061974603000000003 2024-04-26T11:15:34.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:34.826 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:34.826 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:34.826 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412267+0000", 2024-04-26T11:15:34.827 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9116e-05 2024-04-26T11:15:34.827 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.827 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:34.827 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.827 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:34.827 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:34.828 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:34.828 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:15:34.830 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:34.828+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:34.830 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:34.931 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:34.929+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:34.959 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:34.959 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:15:34.959 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:15:34.959 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:34.968 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:34.989 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:15:35.009 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:15:35.010 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:15:35.010 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:15:35.010 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:15:35.011 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:15:35.011 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:15:35.032 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:35.030+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:35.095 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:35.153 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:35.155 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:35.155 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:35.154+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:35.256 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:35.254+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:35.325 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:35.325 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:35.335 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:35.383 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:35.381+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:35.457 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:35.456+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:35.466 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:35.466 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:35.477 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:35.558 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:35.557+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:35.644 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:35.644 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:35.654 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:35.658 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:35.657+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:35.759 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:35.757+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:35.780 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:15:35.780 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:35.781 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:35.790 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:35.859 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:35.857+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:35.918 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:35.919 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:35.928 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:35.961 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:35.959+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:36.056 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:36.056 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:36.061 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:36.060+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:36.066 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:36.162 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:36.160+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:36.193 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:36.193 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:36.203 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:36.263 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:36.262+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:36.331 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:36.331 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:36.342 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:36.365 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:36.363+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:36.465 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:36.463+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:36.469 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:36.469 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:36.479 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:36.555 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-04-26T11:15:36.555 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-04-26T11:15:36.566 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:36.565+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:36.646 INFO:teuthology.orchestra.run.smithi082.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:36.646 INFO:teuthology.orchestra.run.smithi082.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:36.657 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:36.701 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:36.699+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:36.767 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:36.766+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:36.773 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is set 2024-04-26T11:15:36.785 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:36.786 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:36.796 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:36.868 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:36.866+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:36.963 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:36.963 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:36.970 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:36.968+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:36.973 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:37.013 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:15:37.071 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:37.069+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:37.139 INFO:teuthology.orchestra.run.smithi122.stdout:ERROR: (22) Invalid argument 2024-04-26T11:15:37.140 INFO:teuthology.orchestra.run.smithi122.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:15:37.150 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:15:37.162 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1: {} 2024-04-26T11:15:37.182 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2: {} 2024-04-26T11:15:37.183 INFO:teuthology.orchestra.run.smithi029.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:15:37.183 INFO:teuthology.orchestra.run.smithi029.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:15:37.183 INFO:teuthology.orchestra.run.smithi029.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:15:37.185 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:15:37.185 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:15:37.191 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:37.190+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:37.273 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:37.271+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:37.280 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:37.280 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:15:37.280 INFO:teuthology.orchestra.run.smithi082.stdout: "num_ops": 0 2024-04-26T11:15:37.280 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:37.290 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:15:37.375 INFO:tasks.ceph.osd.1.smithi082.stderr:2024-04-26T11:15:37.373+0000 7f9e2b477700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41440) UID: 0 2024-04-26T11:15:37.457 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:37.457 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [], 2024-04-26T11:15:37.457 INFO:teuthology.orchestra.run.smithi082.stdout: "complaint_time": 30, 2024-04-26T11:15:37.457 INFO:teuthology.orchestra.run.smithi082.stdout: "num_blocked_ops": 0 2024-04-26T11:15:37.457 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:37.467 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:15:37.475 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:37.473+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:37.576 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:37.575+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:37.635 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-04-26T11:15:37.635 INFO:teuthology.orchestra.run.smithi082.stdout: "size": 20, 2024-04-26T11:15:37.635 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 600, 2024-04-26T11:15:37.635 INFO:teuthology.orchestra.run.smithi082.stdout: "ops": [ 2024-04-26T11:15:37.635 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.635 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47267 5.3 5:c2bfe18b:::benchmark_data_smithi029_44842_object47266:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:37.635 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:37.636 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 104.361624956, 2024-04-26T11:15:37.636 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.15150543499999999, 2024-04-26T11:15:37.636 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:37.636 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:37.636 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:37.636 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:37.636 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:37.636 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47267 2024-04-26T11:15:37.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.637 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:37.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.637 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:37.637 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:37.637 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.637 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:37.637 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270747+0000", 2024-04-26T11:15:37.637 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.637 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.637 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:37.638 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270746+0000", 2024-04-26T11:15:37.638 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:37.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.638 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.638 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:37.638 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270877+0000", 2024-04-26T11:15:37.638 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013107799999999999 2024-04-26T11:15:37.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.638 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.638 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:37.638 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270886+0000", 2024-04-26T11:15:37.638 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.2150000000000001e-06 2024-04-26T11:15:37.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.639 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:37.639 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.270891+0000", 2024-04-26T11:15:37.639 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7189999999999998e-06 2024-04-26T11:15:37.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.639 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.639 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273133+0000", 2024-04-26T11:15:37.639 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0022418149999999999 2024-04-26T11:15:37.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.639 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:37.640 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273213+0000", 2024-04-26T11:15:37.640 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0020999999999998e-05 2024-04-26T11:15:37.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.640 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.640 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:37.640 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.273294+0000", 2024-04-26T11:15:37.640 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0681999999999998e-05 2024-04-26T11:15:37.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.640 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.640 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:37.640 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279004+0000", 2024-04-26T11:15:37.640 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0057106329999999997 2024-04-26T11:15:37.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.641 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.641 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:37.641 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422165+0000", 2024-04-26T11:15:37.641 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14316061999999999 2024-04-26T11:15:37.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.641 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.641 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:37.641 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422215+0000", 2024-04-26T11:15:37.641 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0207999999999998e-05 2024-04-26T11:15:37.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.641 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.642 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:37.642 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422252+0000", 2024-04-26T11:15:37.642 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6961000000000001e-05 2024-04-26T11:15:37.642 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.642 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:37.642 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.642 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.642 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.642 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47274 5.5 5:a0367bdb:::benchmark_data_smithi029_44842_object47273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:37.642 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:37.642 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 104.36081339099999, 2024-04-26T11:15:37.642 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.150525673, 2024-04-26T11:15:37.643 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:37.643 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:37.643 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:37.643 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:37.643 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:37.643 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47274 2024-04-26T11:15:37.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.643 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:37.643 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.643 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:37.643 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:37.643 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.643 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.644 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:37.644 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:37.644 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.644 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.644 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:37.644 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271558+0000", 2024-04-26T11:15:37.644 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:37.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.644 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.644 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:37.644 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271661+0000", 2024-04-26T11:15:37.645 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00010373 2024-04-26T11:15:37.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.645 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:37.645 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271672+0000", 2024-04-26T11:15:37.645 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0698e-05 2024-04-26T11:15:37.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.645 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:37.645 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271679+0000", 2024-04-26T11:15:37.645 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3669999999999999e-06 2024-04-26T11:15:37.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.645 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.646 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.646 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271720+0000", 2024-04-26T11:15:37.646 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1044999999999998e-05 2024-04-26T11:15:37.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.646 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.646 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:37.646 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271850+0000", 2024-04-26T11:15:37.646 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012956900000000001 2024-04-26T11:15:37.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.646 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.646 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:37.646 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.271986+0000", 2024-04-26T11:15:37.646 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000136293 2024-04-26T11:15:37.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.647 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.647 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:37.647 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278917+0000", 2024-04-26T11:15:37.647 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0069310379999999996 2024-04-26T11:15:37.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.647 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.647 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:37.647 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422027+0000", 2024-04-26T11:15:37.647 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14310996600000001 2024-04-26T11:15:37.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.647 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.647 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:37.648 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422061+0000", 2024-04-26T11:15:37.648 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3674000000000003e-05 2024-04-26T11:15:37.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.648 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.648 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:37.648 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.422084+0000", 2024-04-26T11:15:37.648 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3147e-05 2024-04-26T11:15:37.648 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.648 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:37.648 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.648 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.648 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47278 5.c 5:3a69d71c:::benchmark_data_smithi029_44842_object47277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:37.648 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:37.649 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 104.353626554, 2024-04-26T11:15:37.649 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.14689340300000001, 2024-04-26T11:15:37.649 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:37.649 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:37.649 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:37.649 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:37.649 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:37.649 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47278 2024-04-26T11:15:37.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.649 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:37.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.649 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:37.649 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:37.650 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.650 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.650 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:37.650 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278745+0000", 2024-04-26T11:15:37.650 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.650 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.650 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:37.650 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278744+0000", 2024-04-26T11:15:37.650 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:37.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.651 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.651 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:37.651 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278849+0000", 2024-04-26T11:15:37.651 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000104842 2024-04-26T11:15:37.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.651 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.651 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:37.651 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278857+0000", 2024-04-26T11:15:37.651 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.0819999999999999e-06 2024-04-26T11:15:37.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.651 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.651 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:37.651 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278863+0000", 2024-04-26T11:15:37.651 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1669999999999998e-06 2024-04-26T11:15:37.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.652 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278898+0000", 2024-04-26T11:15:37.652 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.5246000000000001e-05 2024-04-26T11:15:37.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:37.652 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.278983+0000", 2024-04-26T11:15:37.652 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4790000000000006e-05 2024-04-26T11:15:37.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.652 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:37.652 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279061+0000", 2024-04-26T11:15:37.653 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8407999999999999e-05 2024-04-26T11:15:37.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.653 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:37.653 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.280673+0000", 2024-04-26T11:15:37.653 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0016119420000000001 2024-04-26T11:15:37.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.653 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:37.653 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425555+0000", 2024-04-26T11:15:37.653 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.144882277 2024-04-26T11:15:37.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.654 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.654 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:37.654 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425602+0000", 2024-04-26T11:15:37.654 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6294000000000001e-05 2024-04-26T11:15:37.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.654 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.654 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:37.654 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425639+0000", 2024-04-26T11:15:37.654 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7086999999999999e-05 2024-04-26T11:15:37.654 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.654 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:37.654 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.654 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.655 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:47283 5.3 5:c779d4da:::benchmark_data_smithi029_44842_object47282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:37.655 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:37.655 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 104.353085675, 2024-04-26T11:15:37.655 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.146343746, 2024-04-26T11:15:37.655 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:37.655 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:37.655 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:37.655 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:37.655 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:37.655 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 47283 2024-04-26T11:15:37.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.655 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:37.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.656 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:37.656 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:37.656 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.656 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:37.656 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:37.656 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.656 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:37.656 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279286+0000", 2024-04-26T11:15:37.657 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:37.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.657 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:37.657 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279419+0000", 2024-04-26T11:15:37.657 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013310500000000001 2024-04-26T11:15:37.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.657 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:37.657 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279430+0000", 2024-04-26T11:15:37.657 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1079e-05 2024-04-26T11:15:37.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.657 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.657 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:37.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279437+0000", 2024-04-26T11:15:37.658 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9789999999999996e-06 2024-04-26T11:15:37.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.658 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279486+0000", 2024-04-26T11:15:37.658 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.8785000000000001e-05 2024-04-26T11:15:37.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.658 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:37.658 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279619+0000", 2024-04-26T11:15:37.658 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013396099999999999 2024-04-26T11:15:37.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.659 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:37.659 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.279755+0000", 2024-04-26T11:15:37.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00013537900000000001 2024-04-26T11:15:37.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.659 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:37.659 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.281692+0000", 2024-04-26T11:15:37.659 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0019367900000000001 2024-04-26T11:15:37.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.660 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.660 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:37.660 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425584+0000", 2024-04-26T11:15:37.660 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.143892198 2024-04-26T11:15:37.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.660 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.660 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:37.660 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425609+0000", 2024-04-26T11:15:37.660 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5451000000000001e-05 2024-04-26T11:15:37.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.660 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.660 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:37.660 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:53.425630+0000", 2024-04-26T11:15:37.660 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.0550000000000001e-05 2024-04-26T11:15:37.661 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.661 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:37.661 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.661 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.661 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56409 5.5 5:a52acc0b:::benchmark_data_smithi029_44842_object56408:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:37.661 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:37.661 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 100.309901228, 2024-04-26T11:15:37.661 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0318682560000001, 2024-04-26T11:15:37.661 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:37.661 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:37.661 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:37.661 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:37.661 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:37.662 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56409 2024-04-26T11:15:37.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.662 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:37.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.662 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:37.662 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:37.662 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.662 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:37.662 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322471+0000", 2024-04-26T11:15:37.662 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.663 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:37.663 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322470+0000", 2024-04-26T11:15:37.663 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:37.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.663 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:37.663 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322553+0000", 2024-04-26T11:15:37.663 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.284e-05 2024-04-26T11:15:37.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.663 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:37.663 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322561+0000", 2024-04-26T11:15:37.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.4179999999999997e-06 2024-04-26T11:15:37.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.664 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:37.664 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322568+0000", 2024-04-26T11:15:37.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.6120000000000004e-06 2024-04-26T11:15:37.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.664 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.664 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322606+0000", 2024-04-26T11:15:37.664 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8090999999999998e-05 2024-04-26T11:15:37.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.664 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:37.665 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322730+0000", 2024-04-26T11:15:37.665 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000124177 2024-04-26T11:15:37.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.665 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:37.665 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.322857+0000", 2024-04-26T11:15:37.665 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012670800000000001 2024-04-26T11:15:37.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.665 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:37.665 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.325464+0000", 2024-04-26T11:15:37.665 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0026071419999999998 2024-04-26T11:15:37.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.665 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.666 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345837+0000", 2024-04-26T11:15:37.666 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.020372834999999999 2024-04-26T11:15:37.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.666 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.666 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:37.666 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.345848+0000", 2024-04-26T11:15:37.666 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.1789e-05 2024-04-26T11:15:37.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.666 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.666 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.666 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354165+0000", 2024-04-26T11:15:37.666 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0083167200000001 2024-04-26T11:15:37.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.667 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.667 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:37.667 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354339+0000", 2024-04-26T11:15:37.667 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00017364799999999999 2024-04-26T11:15:37.667 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.667 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:37.667 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.667 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.667 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56415 5.c 5:383c21cf:::benchmark_data_smithi029_44842_object56414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:37.667 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:37.667 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 100.307707888, 2024-04-26T11:15:37.667 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.025792681, 2024-04-26T11:15:37.668 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:37.668 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:37.668 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:37.668 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:37.668 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:37.668 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56415 2024-04-26T11:15:37.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.668 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:37.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.668 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:37.668 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:37.668 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:37.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324664+0000", 2024-04-26T11:15:37.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:37.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324663+0000", 2024-04-26T11:15:37.669 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:37.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.669 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:37.669 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324715+0000", 2024-04-26T11:15:37.670 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.1771000000000003e-05 2024-04-26T11:15:37.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.670 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:37.670 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324730+0000", 2024-04-26T11:15:37.670 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.5126999999999999e-05 2024-04-26T11:15:37.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.670 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:37.670 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324738+0000", 2024-04-26T11:15:37.670 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.807e-06 2024-04-26T11:15:37.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.670 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.671 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324777+0000", 2024-04-26T11:15:37.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9042999999999999e-05 2024-04-26T11:15:37.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.671 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:37.671 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324882+0000", 2024-04-26T11:15:37.671 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000105758 2024-04-26T11:15:37.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.673 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:37.674 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.324983+0000", 2024-04-26T11:15:37.674 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000100147 2024-04-26T11:15:37.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.674 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:37.674 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329208+0000", 2024-04-26T11:15:37.674 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0042252180000000002 2024-04-26T11:15:37.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.675 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.675 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349198+0000", 2024-04-26T11:15:37.675 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.019989837 2024-04-26T11:15:37.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.675 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:37.675 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.349207+0000", 2024-04-26T11:15:37.675 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.6150000000000003e-06 2024-04-26T11:15:37.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.676 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.676 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350371+0000", 2024-04-26T11:15:37.676 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0011639919999999 2024-04-26T11:15:37.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.676 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:37.676 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350457+0000", 2024-04-26T11:15:37.676 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5267999999999997e-05 2024-04-26T11:15:37.676 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.676 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:37.676 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.677 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56423 5.5 5:aacd6415:::benchmark_data_smithi029_44842_object56422:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T11:15:37.677 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:37.677 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 100.302496064, 2024-04-26T11:15:37.677 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0246382060000001, 2024-04-26T11:15:37.677 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:37.677 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:37.677 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:37.677 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:37.677 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:37.677 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56423 2024-04-26T11:15:37.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.678 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:37.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.678 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:37.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:37.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.678 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:37.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329876+0000", 2024-04-26T11:15:37.678 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.678 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:37.678 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329875+0000", 2024-04-26T11:15:37.679 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:37.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.679 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:37.679 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329932+0000", 2024-04-26T11:15:37.679 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6879000000000002e-05 2024-04-26T11:15:37.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.679 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:37.679 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329939+0000", 2024-04-26T11:15:37.679 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.6720000000000004e-06 2024-04-26T11:15:37.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.679 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:37.680 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329944+0000", 2024-04-26T11:15:37.680 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7060000000000003e-06 2024-04-26T11:15:37.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.680 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.680 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.329971+0000", 2024-04-26T11:15:37.680 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6829999999999999e-05 2024-04-26T11:15:37.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.680 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:37.680 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330059+0000", 2024-04-26T11:15:37.680 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.7868999999999995e-05 2024-04-26T11:15:37.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.681 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:37.681 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.330144+0000", 2024-04-26T11:15:37.681 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.5148999999999994e-05 2024-04-26T11:15:37.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.681 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.681 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:37.681 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.331789+0000", 2024-04-26T11:15:37.681 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001645477 2024-04-26T11:15:37.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.681 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.681 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.681 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347689+0000", 2024-04-26T11:15:37.681 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.015899705 2024-04-26T11:15:37.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.682 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:37.682 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.347700+0000", 2024-04-26T11:15:37.682 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0669000000000001e-05 2024-04-26T11:15:37.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.682 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.682 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354427+0000", 2024-04-26T11:15:37.682 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0067273080000001 2024-04-26T11:15:37.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.682 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:37.682 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.354514+0000", 2024-04-26T11:15:37.683 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.687e-05 2024-04-26T11:15:37.683 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.683 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:37.683 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.683 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.683 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56411 5.2 5:4cbcfafa:::benchmark_data_smithi029_44842_object56410:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:37.683 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:37.683 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 100.286047364, 2024-04-26T11:15:37.683 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0049285050000001, 2024-04-26T11:15:37.684 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:37.684 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:37.684 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:37.684 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:37.684 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:37.684 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56411 2024-04-26T11:15:37.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.684 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:37.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.684 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:37.684 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:37.684 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.685 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.685 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:37.685 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346324+0000", 2024-04-26T11:15:37.685 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.685 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.685 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:37.685 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346323+0000", 2024-04-26T11:15:37.685 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:37.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.685 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.685 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:37.685 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.346350+0000", 2024-04-26T11:15:37.686 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6356e-05 2024-04-26T11:15:37.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.686 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.686 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:37.686 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348002+0000", 2024-04-26T11:15:37.686 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001652422 2024-04-26T11:15:37.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.686 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.686 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:37.686 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348011+0000", 2024-04-26T11:15:37.686 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.3209999999999994e-06 2024-04-26T11:15:37.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.687 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.687 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348302+0000", 2024-04-26T11:15:37.687 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00029081700000000002 2024-04-26T11:15:37.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.687 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:37.687 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348311+0000", 2024-04-26T11:15:37.687 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 8.3739999999999998e-06 2024-04-26T11:15:37.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.687 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.687 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.349709+0000", 2024-04-26T11:15:37.687 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.001398244 2024-04-26T11:15:37.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.688 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:37.688 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.351253+0000", 2024-04-26T11:15:37.688 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001544084 2024-04-26T11:15:37.688 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.688 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:37.688 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.688 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56414 5.1 5:8aafe4b5:::benchmark_data_smithi029_44842_object56413:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:37.688 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:37.688 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 100.284349859, 2024-04-26T11:15:37.688 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0040009379999999, 2024-04-26T11:15:37.689 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:37.689 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "reached pg", 2024-04-26T11:15:37.689 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:37.689 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:37.689 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:37.689 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56414 2024-04-26T11:15:37.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.689 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:37.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.689 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:37.689 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:37.689 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.690 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:37.690 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348022+0000", 2024-04-26T11:15:37.690 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.690 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.690 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:37.690 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348021+0000", 2024-04-26T11:15:37.690 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.999999 2024-04-26T11:15:37.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.690 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.690 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:37.690 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348059+0000", 2024-04-26T11:15:37.691 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8092000000000001e-05 2024-04-26T11:15:37.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.691 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:37.691 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348068+0000", 2024-04-26T11:15:37.691 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.1479999999999995e-06 2024-04-26T11:15:37.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.691 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:37.691 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348074+0000", 2024-04-26T11:15:37.691 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.8919999999999997e-06 2024-04-26T11:15:37.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.691 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.692 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348287+0000", 2024-04-26T11:15:37.692 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00021303699999999999 2024-04-26T11:15:37.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.692 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:37.692 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348295+0000", 2024-04-26T11:15:37.692 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5870000000000004e-06 2024-04-26T11:15:37.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.692 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.692 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.350617+0000", 2024-04-26T11:15:37.692 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0023221680000001 2024-04-26T11:15:37.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.693 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:37.693 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352023+0000", 2024-04-26T11:15:37.693 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001405835 2024-04-26T11:15:37.693 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.693 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:37.693 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.693 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56420 5.7 5:e8befbdf:::benchmark_data_smithi029_44842_object56419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:37.693 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:37.693 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 100.284285557, 2024-04-26T11:15:37.693 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0120472300000001, 2024-04-26T11:15:37.693 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:37.694 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:37.694 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:37.694 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:37.694 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:37.694 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56420 2024-04-26T11:15:37.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.694 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:37.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.694 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:37.694 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:37.694 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.694 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:37.695 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:37.695 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.695 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:37.695 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348086+0000", 2024-04-26T11:15:37.695 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:37.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.695 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:37.695 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348114+0000", 2024-04-26T11:15:37.695 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8631000000000001e-05 2024-04-26T11:15:37.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.696 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:37.696 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348122+0000", 2024-04-26T11:15:37.696 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.5270000000000001e-06 2024-04-26T11:15:37.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.696 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:37.696 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348128+0000", 2024-04-26T11:15:37.696 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.0039999999999996e-06 2024-04-26T11:15:37.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.696 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.696 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348178+0000", 2024-04-26T11:15:37.696 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0495999999999999e-05 2024-04-26T11:15:37.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.697 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:37.697 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348186+0000", 2024-04-26T11:15:37.697 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.233e-06 2024-04-26T11:15:37.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.697 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.697 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352634+0000", 2024-04-26T11:15:37.697 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0044479150000001 2024-04-26T11:15:37.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.697 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:37.698 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.353915+0000", 2024-04-26T11:15:37.698 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.001281258 2024-04-26T11:15:37.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.698 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.698 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:37.698 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.359979+0000", 2024-04-26T11:15:37.698 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0060640499999999996 2024-04-26T11:15:37.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.698 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.698 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:37.698 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360039+0000", 2024-04-26T11:15:37.698 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.9997000000000002e-05 2024-04-26T11:15:37.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.699 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:37.699 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360133+0000", 2024-04-26T11:15:37.699 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.4603000000000002e-05 2024-04-26T11:15:37.699 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.699 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:37.699 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.699 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56421 5.1 5:82c494db:::benchmark_data_smithi029_44842_object56420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:37.699 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:37.699 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 100.28423133299999, 2024-04-26T11:15:37.699 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136122679999999, 2024-04-26T11:15:37.699 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:37.700 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:37.700 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:37.700 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:37.700 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:37.700 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56421 2024-04-26T11:15:37.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.700 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:37.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.700 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:37.700 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:37.700 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.701 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:37.701 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:37.701 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.701 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:37.701 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348140+0000", 2024-04-26T11:15:37.701 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:37.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.701 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:37.701 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348167+0000", 2024-04-26T11:15:37.701 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.6656e-05 2024-04-26T11:15:37.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.702 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:37.702 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348174+0000", 2024-04-26T11:15:37.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0929999999999997e-06 2024-04-26T11:15:37.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.702 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:37.702 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348180+0000", 2024-04-26T11:15:37.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.852e-06 2024-04-26T11:15:37.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.702 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.702 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348319+0000", 2024-04-26T11:15:37.702 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000139672 2024-04-26T11:15:37.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:37.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348326+0000", 2024-04-26T11:15:37.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.596e-06 2024-04-26T11:15:37.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352320+0000", 2024-04-26T11:15:37.703 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0039938369999999 2024-04-26T11:15:37.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.703 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:37.703 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.352699+0000", 2024-04-26T11:15:37.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00037954999999999998 2024-04-26T11:15:37.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:37.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361669+0000", 2024-04-26T11:15:37.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0089694909999999996 2024-04-26T11:15:37.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:37.704 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361709+0000", 2024-04-26T11:15:37.704 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9792000000000001e-05 2024-04-26T11:15:37.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.704 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:37.705 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361753+0000", 2024-04-26T11:15:37.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4199000000000002e-05 2024-04-26T11:15:37.705 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.705 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:37.705 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.705 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56425 5.1 5:8f332120:::benchmark_data_smithi029_44842_object56424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:37.705 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:37.705 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 100.28418682100001, 2024-04-26T11:15:37.705 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0136337550000001, 2024-04-26T11:15:37.706 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:37.706 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:37.706 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:37.706 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:37.706 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:37.706 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56425 2024-04-26T11:15:37.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.706 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:37.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.706 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:37.706 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:37.706 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:37.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348185+0000", 2024-04-26T11:15:37.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:37.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348184+0000", 2024-04-26T11:15:37.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:37.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.707 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:37.707 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348210+0000", 2024-04-26T11:15:37.707 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.5766999999999999e-05 2024-04-26T11:15:37.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:37.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348217+0000", 2024-04-26T11:15:37.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8630000000000002e-06 2024-04-26T11:15:37.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.708 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:37.708 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348223+0000", 2024-04-26T11:15:37.708 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6840000000000001e-06 2024-04-26T11:15:37.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.711 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.712 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348354+0000", 2024-04-26T11:15:37.712 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000131118 2024-04-26T11:15:37.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:37.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.348361+0000", 2024-04-26T11:15:37.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.0949999999999998e-06 2024-04-26T11:15:37.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.713 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.713 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.356969+0000", 2024-04-26T11:15:37.713 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0086082080000001 2024-04-26T11:15:37.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:37.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357097+0000", 2024-04-26T11:15:37.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012737800000000001 2024-04-26T11:15:37.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:37.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361758+0000", 2024-04-26T11:15:37.714 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0046612279999999999 2024-04-26T11:15:37.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.714 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:37.714 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361782+0000", 2024-04-26T11:15:37.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.4260000000000002e-05 2024-04-26T11:15:37.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.715 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:37.715 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.361819+0000", 2024-04-26T11:15:37.715 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.6721000000000003e-05 2024-04-26T11:15:37.715 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.715 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:37.715 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.715 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:56429 5.7 5:e1263710:::benchmark_data_smithi029_44842_object56428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:37.715 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:37.715 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 100.279965819, 2024-04-26T11:15:37.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0078408969999999, 2024-04-26T11:15:37.716 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:37.716 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:37.716 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:37.716 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:37.716 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:37.716 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 56429 2024-04-26T11:15:37.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.716 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:37.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.716 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:37.716 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:37.716 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:37.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352406+0000", 2024-04-26T11:15:37.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:37.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352402+0000", 2024-04-26T11:15:37.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999962 2024-04-26T11:15:37.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:37.717 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352446+0000", 2024-04-26T11:15:37.717 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.4209999999999999e-05 2024-04-26T11:15:37.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.717 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:37.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352461+0000", 2024-04-26T11:15:37.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.4738e-05 2024-04-26T11:15:37.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:37.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352467+0000", 2024-04-26T11:15:37.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.7640000000000002e-06 2024-04-26T11:15:37.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.718 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.718 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352501+0000", 2024-04-26T11:15:37.718 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3997e-05 2024-04-26T11:15:37.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "waiting for peered", 2024-04-26T11:15:37.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:57.352507+0000", 2024-04-26T11:15:37.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.4489999999999996e-06 2024-04-26T11:15:37.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357046+0000", 2024-04-26T11:15:37.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.0045390219999999 2024-04-26T11:15:37.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.719 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:37.719 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.357190+0000", 2024-04-26T11:15:37.719 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00014332 2024-04-26T11:15:37.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:37.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360142+0000", 2024-04-26T11:15:37.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.002952844 2024-04-26T11:15:37.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:37.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360185+0000", 2024-04-26T11:15:37.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.2880000000000003e-05 2024-04-26T11:15:37.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.720 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:37.720 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:13:58.360247+0000", 2024-04-26T11:15:37.720 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1509999999999999e-05 2024-04-26T11:15:37.721 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.721 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:37.721 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.721 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174388 5.c 5:312e5163:::benchmark_data_smithi029_44842_object29750:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:37.721 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:37.721 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 47.284140164, 2024-04-26T11:15:37.721 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.064002009999999998, 2024-04-26T11:15:37.721 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:37.721 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:37.721 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:37.721 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:37.721 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:37.722 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174388 2024-04-26T11:15:37.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.722 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:37.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:37.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:37.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.722 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:37.722 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348232+0000", 2024-04-26T11:15:37.722 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:37.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348231+0000", 2024-04-26T11:15:37.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:37.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:37.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348233+0000", 2024-04-26T11:15:37.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2249999999999999e-06 2024-04-26T11:15:37.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.723 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:37.723 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348238+0000", 2024-04-26T11:15:37.723 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.1899999999999997e-06 2024-04-26T11:15:37.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:37.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348241+0000", 2024-04-26T11:15:37.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.965e-06 2024-04-26T11:15:37.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348264+0000", 2024-04-26T11:15:37.724 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3014e-05 2024-04-26T11:15:37.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.724 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:37.724 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348371+0000", 2024-04-26T11:15:37.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000106889 2024-04-26T11:15:37.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:37.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412126+0000", 2024-04-26T11:15:37.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063755495999999995 2024-04-26T11:15:37.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:37.725 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412165+0000", 2024-04-26T11:15:37.725 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.9269e-05 2024-04-26T11:15:37.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.725 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:37.726 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412234+0000", 2024-04-26T11:15:37.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.8337000000000007e-05 2024-04-26T11:15:37.726 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.726 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:37.726 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.726 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174390 5.1 5:81c54fd7:::benchmark_data_smithi029_44842_object29752:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:37.726 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:37.726 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 47.284025010000001, 2024-04-26T11:15:37.726 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063635918, 2024-04-26T11:15:37.726 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:37.726 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:37.726 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:37.727 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:37.727 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:37.727 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174390 2024-04-26T11:15:37.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.727 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:37.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.727 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:37.727 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:37.727 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:37.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348347+0000", 2024-04-26T11:15:37.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.728 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:37.728 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348346+0000", 2024-04-26T11:15:37.728 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:37.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:37.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348351+0000", 2024-04-26T11:15:37.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.442e-06 2024-04-26T11:15:37.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:37.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348357+0000", 2024-04-26T11:15:37.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.9530000000000002e-06 2024-04-26T11:15:37.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.729 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:37.729 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348363+0000", 2024-04-26T11:15:37.729 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.2129999999999999e-06 2024-04-26T11:15:37.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348396+0000", 2024-04-26T11:15:37.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3161999999999999e-05 2024-04-26T11:15:37.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:37.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348511+0000", 2024-04-26T11:15:37.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.000115253 2024-04-26T11:15:37.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.730 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:37.730 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411857+0000", 2024-04-26T11:15:37.730 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063345431999999993 2024-04-26T11:15:37.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:37.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411904+0000", 2024-04-26T11:15:37.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.7389000000000003e-05 2024-04-26T11:15:37.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.731 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:37.731 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411983+0000", 2024-04-26T11:15:37.731 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.8750000000000003e-05 2024-04-26T11:15:37.731 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.731 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:37.731 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.732 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174394 5.3 5:c91ce5cb:::benchmark_data_smithi029_44842_object29756:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:37.732 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:37.732 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 47.283922066000002, 2024-04-26T11:15:37.732 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062247626, 2024-04-26T11:15:37.732 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:37.732 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:37.732 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:37.732 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:37.732 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:37.732 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174394 2024-04-26T11:15:37.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.732 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:37.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.732 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:37.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:37.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:37.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348450+0000", 2024-04-26T11:15:37.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:37.733 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348449+0000", 2024-04-26T11:15:37.733 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:37.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.733 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:37.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348457+0000", 2024-04-26T11:15:37.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.9619999999999993e-06 2024-04-26T11:15:37.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:37.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348462+0000", 2024-04-26T11:15:37.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.6569999999999996e-06 2024-04-26T11:15:37.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.734 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:37.734 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.348465+0000", 2024-04-26T11:15:37.734 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2990000000000001e-06 2024-04-26T11:15:37.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408427+0000", 2024-04-26T11:15:37.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.059961423 2024-04-26T11:15:37.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:37.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.408554+0000", 2024-04-26T11:15:37.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012779600000000001 2024-04-26T11:15:37.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.735 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:37.735 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410570+0000", 2024-04-26T11:15:37.735 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0020152719999999998 2024-04-26T11:15:37.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:37.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410624+0000", 2024-04-26T11:15:37.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.4211e-05 2024-04-26T11:15:37.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.736 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:37.736 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410697+0000", 2024-04-26T11:15:37.736 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.3447000000000003e-05 2024-04-26T11:15:37.736 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.736 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:37.736 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.737 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174395 5.1 5:8ee7f1d3:::benchmark_data_smithi029_44842_object29757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:37.737 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:37.737 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 47.282891974999998, 2024-04-26T11:15:37.737 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062622744999999994, 2024-04-26T11:15:37.737 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:37.737 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:37.737 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:37.737 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:37.737 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:37.737 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174395 2024-04-26T11:15:37.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.737 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:37.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.737 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:37.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:37.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:37.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349480+0000", 2024-04-26T11:15:37.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.738 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:37.738 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349479+0000", 2024-04-26T11:15:37.738 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:37.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:37.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349483+0000", 2024-04-26T11:15:37.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.54e-06 2024-04-26T11:15:37.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:37.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349488+0000", 2024-04-26T11:15:37.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.5119999999999999e-06 2024-04-26T11:15:37.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.739 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:37.739 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349492+0000", 2024-04-26T11:15:37.739 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.7170000000000002e-06 2024-04-26T11:15:37.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350187+0000", 2024-04-26T11:15:37.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00069535899999999999 2024-04-26T11:15:37.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:37.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350292+0000", 2024-04-26T11:15:37.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0001047 2024-04-26T11:15:37.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.740 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:37.740 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411992+0000", 2024-04-26T11:15:37.740 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061699647000000003 2024-04-26T11:15:37.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:37.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412030+0000", 2024-04-26T11:15:37.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.8124999999999998e-05 2024-04-26T11:15:37.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.741 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:37.741 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412103+0000", 2024-04-26T11:15:37.741 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 7.2733999999999999e-05 2024-04-26T11:15:37.741 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.741 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:37.741 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.742 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174396 5.7 5:e0fad05d:::benchmark_data_smithi029_44842_object29758:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:37.742 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:37.742 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 47.282808336000002, 2024-04-26T11:15:37.742 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062445026000000001, 2024-04-26T11:15:37.742 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:37.742 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:37.742 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:37.742 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:37.742 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:37.742 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174396 2024-04-26T11:15:37.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.742 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:37.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.742 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:37.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:37.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:37.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:37.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.743 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:37.743 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349563+0000", 2024-04-26T11:15:37.743 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:37.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.743 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:37.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349566+0000", 2024-04-26T11:15:37.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.2490000000000001e-06 2024-04-26T11:15:37.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:37.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349573+0000", 2024-04-26T11:15:37.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.776e-06 2024-04-26T11:15:37.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.744 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:37.744 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349576+0000", 2024-04-26T11:15:37.744 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3629999999999998e-06 2024-04-26T11:15:37.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350396+0000", 2024-04-26T11:15:37.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00081992199999999995 2024-04-26T11:15:37.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:37.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350516+0000", 2024-04-26T11:15:37.745 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.00012006900000000001 2024-04-26T11:15:37.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.745 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:37.745 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411924+0000", 2024-04-26T11:15:37.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061407960999999997 2024-04-26T11:15:37.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:37.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.411947+0000", 2024-04-26T11:15:37.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.2943999999999999e-05 2024-04-26T11:15:37.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.746 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:37.746 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412008+0000", 2024-04-26T11:15:37.746 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.1237999999999999e-05 2024-04-26T11:15:37.746 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.746 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:37.746 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.747 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_op(client.4534.0:174397 5.7 5:e25daf9a:::benchmark_data_smithi029_44842_object29759:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:37.747 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:37.747 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 47.282700206999998, 2024-04-26T11:15:37.747 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.063878565999999998, 2024-04-26T11:15:37.747 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:37.747 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:37.747 INFO:teuthology.orchestra.run.smithi082.stdout: "client_info": { 2024-04-26T11:15:37.747 INFO:teuthology.orchestra.run.smithi082.stdout: "client": "client.4534", 2024-04-26T11:15:37.747 INFO:teuthology.orchestra.run.smithi082.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:37.747 INFO:teuthology.orchestra.run.smithi082.stdout: "tid": 174397 2024-04-26T11:15:37.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.748 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:37.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:37.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:37.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:37.748 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349672+0000", 2024-04-26T11:15:37.748 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.748 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.748 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:37.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349671+0000", 2024-04-26T11:15:37.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:37.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:37.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349674+0000", 2024-04-26T11:15:37.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.3360000000000002e-06 2024-04-26T11:15:37.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:37.749 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349678+0000", 2024-04-26T11:15:37.749 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.0709999999999996e-06 2024-04-26T11:15:37.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.749 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:37.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.349681+0000", 2024-04-26T11:15:37.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 3.3139999999999999e-06 2024-04-26T11:15:37.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410371+0000", 2024-04-26T11:15:37.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.060690202999999998 2024-04-26T11:15:37.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:37.750 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.410463+0000", 2024-04-26T11:15:37.750 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 9.2095000000000005e-05 2024-04-26T11:15:37.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.750 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "op_commit", 2024-04-26T11:15:37.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413471+0000", 2024-04-26T11:15:37.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.0030073909999999999 2024-04-26T11:15:37.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:37.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413499+0000", 2024-04-26T11:15:37.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.8725e-05 2024-04-26T11:15:37.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.751 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:37.751 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.413550+0000", 2024-04-26T11:15:37.751 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.0810000000000003e-05 2024-04-26T11:15:37.751 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.751 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:37.751 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.752 INFO:teuthology.orchestra.run.smithi082.stdout: "description": "osd_repop(client.4534.0:174398 5.4 e46/16 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head v 46'10798, mlcod=46'10796)", 2024-04-26T11:15:37.752 INFO:teuthology.orchestra.run.smithi082.stdout: "initiated_at": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:37.752 INFO:teuthology.orchestra.run.smithi082.stdout: "age": 47.282171996000002, 2024-04-26T11:15:37.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.062067047, 2024-04-26T11:15:37.752 INFO:teuthology.orchestra.run.smithi082.stdout: "type_data": { 2024-04-26T11:15:37.752 INFO:teuthology.orchestra.run.smithi082.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:37.752 INFO:teuthology.orchestra.run.smithi082.stdout: "events": [ 2024-04-26T11:15:37.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.752 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "initiated", 2024-04-26T11:15:37.752 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:37.752 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "throttled", 2024-04-26T11:15:37.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350200+0000", 2024-04-26T11:15:37.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0 2024-04-26T11:15:37.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "header_read", 2024-04-26T11:15:37.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350199+0000", 2024-04-26T11:15:37.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:37.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.753 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "all_read", 2024-04-26T11:15:37.753 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350205+0000", 2024-04-26T11:15:37.753 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 5.6749999999999999e-06 2024-04-26T11:15:37.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "dispatched", 2024-04-26T11:15:37.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350212+0000", 2024-04-26T11:15:37.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 6.7000000000000002e-06 2024-04-26T11:15:37.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "queued_for_pg", 2024-04-26T11:15:37.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350216+0000", 2024-04-26T11:15:37.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 4.5120000000000002e-06 2024-04-26T11:15:37.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.754 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "reached_pg", 2024-04-26T11:15:37.754 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350246+0000", 2024-04-26T11:15:37.754 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9978999999999999e-05 2024-04-26T11:15:37.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "started", 2024-04-26T11:15:37.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.350263+0000", 2024-04-26T11:15:37.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 1.702e-05 2024-04-26T11:15:37.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "commit_sent", 2024-04-26T11:15:37.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412238+0000", 2024-04-26T11:15:37.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 0.061974603000000003 2024-04-26T11:15:37.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-04-26T11:15:37.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-04-26T11:15:37.755 INFO:teuthology.orchestra.run.smithi082.stdout: "event": "done", 2024-04-26T11:15:37.755 INFO:teuthology.orchestra.run.smithi082.stdout: "time": "2024-04-26T11:14:50.412267+0000", 2024-04-26T11:15:37.755 INFO:teuthology.orchestra.run.smithi082.stdout: "duration": 2.9116e-05 2024-04-26T11:15:37.756 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.756 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:37.756 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.756 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-04-26T11:15:37.756 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-04-26T11:15:37.756 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-04-26T11:15:37.757 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:15:37.758 INFO:tasks.ceph.osd.2.smithi122.stderr:2024-04-26T11:15:37.756+0000 7f2361470700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41569) UID: 0 2024-04-26T11:15:37.778 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'unique_pool_0' removed 2024-04-26T11:15:37.792 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-26T11:15:37.802 INFO:tasks.thrashosds:joining thrashosds 2024-04-26T11:15:37.943 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:37.943 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:15:37.944 INFO:teuthology.orchestra.run.smithi122.stdout: "num_ops": 0 2024-04-26T11:15:37.944 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:37.954 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:15:38.084 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [], 2024-04-26T11:15:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: "complaint_time": 30, 2024-04-26T11:15:38.084 INFO:teuthology.orchestra.run.smithi122.stdout: "num_blocked_ops": 0 2024-04-26T11:15:38.085 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:38.094 DEBUG:teuthology.orchestra.run.smithi122:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:15:38.221 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-04-26T11:15:38.222 INFO:teuthology.orchestra.run.smithi122.stdout: "size": 20, 2024-04-26T11:15:38.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 600, 2024-04-26T11:15:38.222 INFO:teuthology.orchestra.run.smithi122.stdout: "ops": [ 2024-04-26T11:15:38.222 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.222 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47279 5.d 5:b8eae9a1:::benchmark_data_smithi029_44842_object47278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:38.222 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:38.222 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.94028188999999, 2024-04-26T11:15:38.222 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14436086300000001, 2024-04-26T11:15:38.222 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:38.223 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:38.223 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:38.223 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:38.223 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:38.223 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47279 2024-04-26T11:15:38.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.223 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:38.223 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.223 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:38.223 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:38.223 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.223 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:38.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:38.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:38.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278790+0000", 2024-04-26T11:15:38.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:38.224 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.224 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.224 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:38.224 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278913+0000", 2024-04-26T11:15:38.224 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123349 2024-04-26T11:15:38.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:38.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278928+0000", 2024-04-26T11:15:38.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.5288999999999999e-05 2024-04-26T11:15:38.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:38.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278935+0000", 2024-04-26T11:15:38.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2879999999999998e-06 2024-04-26T11:15:38.225 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.225 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.225 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.225 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.278965+0000", 2024-04-26T11:15:38.225 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0926999999999997e-05 2024-04-26T11:15:38.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:38.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279065+0000", 2024-04-26T11:15:38.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.9378999999999998e-05 2024-04-26T11:15:38.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:38.226 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279193+0000", 2024-04-26T11:15:38.226 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012828699999999999 2024-04-26T11:15:38.226 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.226 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.226 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:38.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.281919+0000", 2024-04-26T11:15:38.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.002725487 2024-04-26T11:15:38.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:38.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423100+0000", 2024-04-26T11:15:38.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14118162400000001 2024-04-26T11:15:38.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.227 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:38.227 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423128+0000", 2024-04-26T11:15:38.227 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.775e-05 2024-04-26T11:15:38.227 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.227 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.228 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:38.228 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.423151+0000", 2024-04-26T11:15:38.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3195000000000001e-05 2024-04-26T11:15:38.228 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.228 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:38.228 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.228 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.228 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.228 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:47284 5.d 5:b209cb9b:::benchmark_data_smithi029_44842_object47283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T11:15:38.228 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:38.228 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 104.939632188, 2024-04-26T11:15:38.228 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.14622442599999999, 2024-04-26T11:15:38.228 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:38.228 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:38.228 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:38.229 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:38.229 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:38.229 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 47284 2024-04-26T11:15:38.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.229 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:38.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:38.229 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:38.229 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.229 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.229 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.229 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:38.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279440+0000", 2024-04-26T11:15:38.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:38.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279439+0000", 2024-04-26T11:15:38.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:38.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:38.230 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279507+0000", 2024-04-26T11:15:38.230 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7605000000000001e-05 2024-04-26T11:15:38.230 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.230 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.230 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:38.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279516+0000", 2024-04-26T11:15:38.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.38e-06 2024-04-26T11:15:38.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:38.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.279523+0000", 2024-04-26T11:15:38.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4670000000000001e-06 2024-04-26T11:15:38.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.231 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.231 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280502+0000", 2024-04-26T11:15:38.231 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00097966299999999997 2024-04-26T11:15:38.231 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.231 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:38.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280641+0000", 2024-04-26T11:15:38.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00013896700000000001 2024-04-26T11:15:38.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 0", 2024-04-26T11:15:38.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.280772+0000", 2024-04-26T11:15:38.232 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000130746 2024-04-26T11:15:38.232 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.232 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.232 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:38.232 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.287541+0000", 2024-04-26T11:15:38.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0067688399999999999 2024-04-26T11:15:38.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:38.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425613+0000", 2024-04-26T11:15:38.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.138071785 2024-04-26T11:15:38.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:38.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425642+0000", 2024-04-26T11:15:38.233 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9689e-05 2024-04-26T11:15:38.233 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.233 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.233 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:38.233 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:53.425664+0000", 2024-04-26T11:15:38.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.2098000000000001e-05 2024-04-26T11:15:38.234 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.234 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:38.234 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.234 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.234 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.234 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56407 5.9 5:9c65a908:::benchmark_data_smithi029_44842_object56406:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:38.234 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:38.234 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.872990149, 2024-04-26T11:15:38.234 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.007001169, 2024-04-26T11:15:38.234 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:38.234 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:38.234 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:38.235 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:38.235 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:38.235 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56407 2024-04-26T11:15:38.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.235 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:38.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:38.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:38.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.235 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.235 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:38.235 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346082+0000", 2024-04-26T11:15:38.235 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.235 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:38.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346081+0000", 2024-04-26T11:15:38.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:38.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:38.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346151+0000", 2024-04-26T11:15:38.236 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0087999999999997e-05 2024-04-26T11:15:38.236 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.236 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.236 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:38.236 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346162+0000", 2024-04-26T11:15:38.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1106e-05 2024-04-26T11:15:38.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:38.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346169+0000", 2024-04-26T11:15:38.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2029999999999997e-06 2024-04-26T11:15:38.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346209+0000", 2024-04-26T11:15:38.237 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9993999999999997e-05 2024-04-26T11:15:38.237 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.237 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.237 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:38.237 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346217+0000", 2024-04-26T11:15:38.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0590000000000003e-06 2024-04-26T11:15:38.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352074+0000", 2024-04-26T11:15:38.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005856909 2024-04-26T11:15:38.238 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.238 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.238 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:38.238 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353083+0000", 2024-04-26T11:15:38.238 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0010097050000000001 2024-04-26T11:15:38.238 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.238 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:38.238 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.239 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.239 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56408 5.f 5:f7fbc2cb:::benchmark_data_smithi029_44842_object56407:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:38.239 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:38.239 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.872894503, 2024-04-26T11:15:38.239 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070643770000001, 2024-04-26T11:15:38.239 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:38.239 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:38.239 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:38.239 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:38.239 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:38.239 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56408 2024-04-26T11:15:38.239 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.239 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:38.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:38.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:38.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:38.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346178+0000", 2024-04-26T11:15:38.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.240 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.240 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:38.240 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346177+0000", 2024-04-26T11:15:38.240 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:38.240 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:38.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346271+0000", 2024-04-26T11:15:38.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.4211999999999999e-05 2024-04-26T11:15:38.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:38.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346283+0000", 2024-04-26T11:15:38.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.1705999999999999e-05 2024-04-26T11:15:38.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.241 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.241 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:38.241 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346290+0000", 2024-04-26T11:15:38.241 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.6889999999999998e-06 2024-04-26T11:15:38.241 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347468+0000", 2024-04-26T11:15:38.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0011778750000000001 2024-04-26T11:15:38.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:38.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347475+0000", 2024-04-26T11:15:38.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.1319999999999996e-06 2024-04-26T11:15:38.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.242 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.242 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.242 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352399+0000", 2024-04-26T11:15:38.242 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004924602 2024-04-26T11:15:38.242 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.243 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:38.243 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353242+0000", 2024-04-26T11:15:38.243 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00084277199999999999 2024-04-26T11:15:38.243 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.243 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:38.243 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.243 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.243 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.243 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56413 5.f 5:f2843de5:::benchmark_data_smithi029_44842_object56412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:38.244 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:38.244 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.87276282400001, 2024-04-26T11:15:38.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0070113590000001, 2024-04-26T11:15:38.244 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:38.244 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:38.244 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:38.244 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:38.244 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:38.244 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56413 2024-04-26T11:15:38.244 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.244 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:38.244 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.244 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:38.244 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:38.244 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:38.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:38.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:38.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346309+0000", 2024-04-26T11:15:38.245 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:38.245 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.245 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.245 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:38.245 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346391+0000", 2024-04-26T11:15:38.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.2525e-05 2024-04-26T11:15:38.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:38.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346402+0000", 2024-04-26T11:15:38.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0481e-05 2024-04-26T11:15:38.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:38.246 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346410+0000", 2024-04-26T11:15:38.246 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8080000000000005e-06 2024-04-26T11:15:38.246 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.246 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.246 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347497+0000", 2024-04-26T11:15:38.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.001087263 2024-04-26T11:15:38.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:38.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347504+0000", 2024-04-26T11:15:38.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.0489999999999998e-06 2024-04-26T11:15:38.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.247 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.247 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.247 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353258+0000", 2024-04-26T11:15:38.247 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0057545640000001 2024-04-26T11:15:38.247 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.248 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:38.248 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353321+0000", 2024-04-26T11:15:38.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2279999999999993e-05 2024-04-26T11:15:38.248 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.248 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:38.248 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.248 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.248 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.248 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56417 5.9 5:9397e5ee:::benchmark_data_smithi029_44842_object56416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:38.248 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:38.248 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.872654368, 2024-04-26T11:15:38.248 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006756201, 2024-04-26T11:15:38.249 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:38.249 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "reached pg", 2024-04-26T11:15:38.249 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:38.249 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:38.249 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:38.249 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56417 2024-04-26T11:15:38.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.249 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:38.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.249 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:38.249 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:38.249 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.249 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.249 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:38.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346418+0000", 2024-04-26T11:15:38.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:38.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346417+0000", 2024-04-26T11:15:38.250 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:38.250 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.250 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.250 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:38.250 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346495+0000", 2024-04-26T11:15:38.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.7711000000000002e-05 2024-04-26T11:15:38.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:38.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346503+0000", 2024-04-26T11:15:38.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.1580000000000005e-06 2024-04-26T11:15:38.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:38.251 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346509+0000", 2024-04-26T11:15:38.251 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4710000000000004e-06 2024-04-26T11:15:38.251 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.251 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.251 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346540+0000", 2024-04-26T11:15:38.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0361e-05 2024-04-26T11:15:38.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:38.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346545+0000", 2024-04-26T11:15:38.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.604e-06 2024-04-26T11:15:38.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.252 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.252 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353106+0000", 2024-04-26T11:15:38.252 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0065610439999999 2024-04-26T11:15:38.252 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.252 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.253 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:38.253 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353174+0000", 2024-04-26T11:15:38.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7613000000000005e-05 2024-04-26T11:15:38.253 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.253 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:38.253 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.253 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.253 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.253 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56422 5.9 5:9a12aaf3:::benchmark_data_smithi029_44842_object56421:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:38.253 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:38.253 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.8725531, 2024-04-26T11:15:38.253 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010648534, 2024-04-26T11:15:38.253 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:38.253 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:38.254 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:38.254 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:38.254 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:38.254 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56422 2024-04-26T11:15:38.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.254 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:38.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:38.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:38.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.254 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.254 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.254 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:38.254 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:38.254 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:38.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346519+0000", 2024-04-26T11:15:38.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:38.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:38.255 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346555+0000", 2024-04-26T11:15:38.255 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6715000000000003e-05 2024-04-26T11:15:38.255 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.255 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.255 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:38.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346564+0000", 2024-04-26T11:15:38.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.1449999999999997e-06 2024-04-26T11:15:38.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:38.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346570+0000", 2024-04-26T11:15:38.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9710000000000001e-06 2024-04-26T11:15:38.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.256 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.256 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346612+0000", 2024-04-26T11:15:38.256 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2126999999999998e-05 2024-04-26T11:15:38.256 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.256 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:38.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346620+0000", 2024-04-26T11:15:38.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.763e-06 2024-04-26T11:15:38.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353187+0000", 2024-04-26T11:15:38.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.006566995 2024-04-26T11:15:38.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.257 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.257 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:38.257 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353464+0000", 2024-04-26T11:15:38.257 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00027638899999999999 2024-04-26T11:15:38.257 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:38.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357067+0000", 2024-04-26T11:15:38.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0036037059999999999 2024-04-26T11:15:38.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:38.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357105+0000", 2024-04-26T11:15:38.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8065999999999998e-05 2024-04-26T11:15:38.258 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.258 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.258 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:38.258 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357168+0000", 2024-04-26T11:15:38.258 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.2236999999999994e-05 2024-04-26T11:15:38.259 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.259 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:38.259 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.259 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.259 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.259 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56426 5.f 5:f06d02df:::benchmark_data_smithi029_44842_object56425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:38.259 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:38.259 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.872484159, 2024-04-26T11:15:38.259 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.010576562, 2024-04-26T11:15:38.259 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:38.259 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:38.259 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:38.259 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:38.259 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:38.259 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56426 2024-04-26T11:15:38.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.260 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:38.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:38.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:38.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:38.260 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346588+0000", 2024-04-26T11:15:38.260 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.260 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.260 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.260 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:38.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346587+0000", 2024-04-26T11:15:38.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:38.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:38.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346630+0000", 2024-04-26T11:15:38.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2762000000000002e-05 2024-04-26T11:15:38.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.261 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.261 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:38.261 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346638+0000", 2024-04-26T11:15:38.261 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4309999999999997e-06 2024-04-26T11:15:38.261 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:38.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.346642+0000", 2024-04-26T11:15:38.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.7369999999999997e-06 2024-04-26T11:15:38.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.262 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347526+0000", 2024-04-26T11:15:38.262 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00088413499999999998 2024-04-26T11:15:38.262 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.262 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.262 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:38.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.347533+0000", 2024-04-26T11:15:38.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8859999999999998e-06 2024-04-26T11:15:38.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353344+0000", 2024-04-26T11:15:38.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.005810775 2024-04-26T11:15:38.263 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.263 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.263 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:38.263 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.353633+0000", 2024-04-26T11:15:38.263 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00028898900000000002 2024-04-26T11:15:38.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:38.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357072+0000", 2024-04-26T11:15:38.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0034384369999999999 2024-04-26T11:15:38.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.264 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:38.264 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357103+0000", 2024-04-26T11:15:38.264 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.1365000000000002e-05 2024-04-26T11:15:38.264 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.264 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.265 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:38.265 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357165+0000", 2024-04-26T11:15:38.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1688999999999998e-05 2024-04-26T11:15:38.265 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.265 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:38.265 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.265 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.265 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.265 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:56430 5.d 5:b5636e72:::benchmark_data_smithi029_44842_object56429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T11:15:38.265 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:38.265 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 100.866488578, 2024-04-26T11:15:38.265 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.004578977, 2024-04-26T11:15:38.265 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:38.266 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:38.266 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:38.266 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:38.266 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:38.266 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 56430 2024-04-26T11:15:38.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.266 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:38.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:38.266 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:38.266 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.266 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.266 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.266 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:38.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352584+0000", 2024-04-26T11:15:38.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:38.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352583+0000", 2024-04-26T11:15:38.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:38.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:38.267 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352618+0000", 2024-04-26T11:15:38.267 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5349000000000003e-05 2024-04-26T11:15:38.267 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.267 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.267 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:38.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352627+0000", 2024-04-26T11:15:38.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.4519999999999997e-06 2024-04-26T11:15:38.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:38.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352634+0000", 2024-04-26T11:15:38.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.844e-06 2024-04-26T11:15:38.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.268 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.268 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.268 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352672+0000", 2024-04-26T11:15:38.268 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.8269000000000002e-05 2024-04-26T11:15:38.268 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for peered", 2024-04-26T11:15:38.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:57.352678+0000", 2024-04-26T11:15:38.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:15:38.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352511+0000", 2024-04-26T11:15:38.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.99983323899999998 2024-04-26T11:15:38.269 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.269 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.269 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:38.269 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.352628+0000", 2024-04-26T11:15:38.269 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000117191 2024-04-26T11:15:38.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:38.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357040+0000", 2024-04-26T11:15:38.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044121589999999997 2024-04-26T11:15:38.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:38.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357088+0000", 2024-04-26T11:15:38.270 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8136000000000001e-05 2024-04-26T11:15:38.270 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.270 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.270 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:38.270 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:13:58.357163+0000", 2024-04-26T11:15:38.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.4221999999999995e-05 2024-04-26T11:15:38.271 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.271 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:38.271 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.271 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.271 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.271 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:174398 5.4 5:2a8621d4:::benchmark_data_smithi029_44842_object29760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T11:15:38.271 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:38.271 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 47.869181929, 2024-04-26T11:15:38.271 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.064773789999999998, 2024-04-26T11:15:38.271 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:38.271 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:38.271 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:38.271 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:38.271 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:38.272 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 174398 2024-04-26T11:15:38.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.272 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:38.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:38.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:38.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.272 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:38.272 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349890+0000", 2024-04-26T11:15:38.272 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.272 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.272 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:38.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349889+0000", 2024-04-26T11:15:38.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:38.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:38.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349895+0000", 2024-04-26T11:15:38.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4519999999999996e-06 2024-04-26T11:15:38.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.273 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.273 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:38.273 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349909+0000", 2024-04-26T11:15:38.273 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.3791000000000001e-05 2024-04-26T11:15:38.273 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:38.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349919+0000", 2024-04-26T11:15:38.274 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0135999999999999e-05 2024-04-26T11:15:38.274 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.274 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.274 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.274 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.349956+0000", 2024-04-26T11:15:38.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7642000000000003e-05 2024-04-26T11:15:38.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:38.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350080+0000", 2024-04-26T11:15:38.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000123285 2024-04-26T11:15:38.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.275 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:38.275 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.350192+0000", 2024-04-26T11:15:38.275 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000112509 2024-04-26T11:15:38.275 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.275 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:38.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.356232+0000", 2024-04-26T11:15:38.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0060403339999999996 2024-04-26T11:15:38.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:38.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414616+0000", 2024-04-26T11:15:38.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.058383156999999998 2024-04-26T11:15:38.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.276 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.276 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:38.276 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414643+0000", 2024-04-26T11:15:38.276 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7317e-05 2024-04-26T11:15:38.276 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.277 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:38.277 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:14:50.414664+0000", 2024-04-26T11:15:38.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.1135999999999999e-05 2024-04-26T11:15:38.277 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.277 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:38.277 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.277 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.277 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.277 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276551 5.a 5:5533d612:::benchmark_data_smithi029_44842_object131913:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:38.277 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.375399+0000", 2024-04-26T11:15:38.277 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.8436735380000009, 2024-04-26T11:15:38.277 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.101897644, 2024-04-26T11:15:38.277 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:38.278 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:38.278 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:38.278 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:38.278 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:38.278 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276551 2024-04-26T11:15:38.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.278 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:38.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:38.278 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375399+0000", 2024-04-26T11:15:38.278 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.278 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.278 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.278 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:38.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375399+0000", 2024-04-26T11:15:38.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:38.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375398+0000", 2024-04-26T11:15:38.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:38.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.279 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.279 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:38.279 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375400+0000", 2024-04-26T11:15:38.279 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7230000000000001e-06 2024-04-26T11:15:38.279 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:38.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375404+0000", 2024-04-26T11:15:38.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.4929999999999998e-06 2024-04-26T11:15:38.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:38.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375406+0000", 2024-04-26T11:15:38.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.74e-06 2024-04-26T11:15:38.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.280 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.280 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.280 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375447+0000", 2024-04-26T11:15:38.280 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.0368999999999999e-05 2024-04-26T11:15:38.280 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:38.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375574+0000", 2024-04-26T11:15:38.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012730099999999999 2024-04-26T11:15:38.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:38.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375690+0000", 2024-04-26T11:15:38.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000115512 2024-04-26T11:15:38.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.281 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.281 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:38.281 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.380112+0000", 2024-04-26T11:15:38.281 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0044225979999999998 2024-04-26T11:15:38.281 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:38.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477209+0000", 2024-04-26T11:15:38.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.097096846000000001 2024-04-26T11:15:38.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:38.282 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477250+0000", 2024-04-26T11:15:38.282 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1458000000000002e-05 2024-04-26T11:15:38.282 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.282 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.282 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:38.283 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477296+0000", 2024-04-26T11:15:38.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.587e-05 2024-04-26T11:15:38.283 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.283 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:38.283 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.283 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.283 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.283 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276552 5.8 5:12bf19e5:::benchmark_data_smithi029_44842_object131914:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:38.283 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.375412+0000", 2024-04-26T11:15:38.283 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.8436599450000006, 2024-04-26T11:15:38.283 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10418100700000001, 2024-04-26T11:15:38.283 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:38.283 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:38.283 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:38.283 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:38.284 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:38.284 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276552 2024-04-26T11:15:38.284 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.284 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:38.284 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.285 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:38.285 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375412+0000", 2024-04-26T11:15:38.285 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.285 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:38.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375412+0000", 2024-04-26T11:15:38.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:38.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375412+0000", 2024-04-26T11:15:38.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:38.286 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.286 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.286 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:38.286 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375414+0000", 2024-04-26T11:15:38.286 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.0729999999999999e-06 2024-04-26T11:15:38.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:38.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375420+0000", 2024-04-26T11:15:38.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.4759999999999997e-06 2024-04-26T11:15:38.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:38.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375422+0000", 2024-04-26T11:15:38.287 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.8540000000000001e-06 2024-04-26T11:15:38.287 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.287 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.287 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.287 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377480+0000", 2024-04-26T11:15:38.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0020577540000000002 2024-04-26T11:15:38.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:38.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377569+0000", 2024-04-26T11:15:38.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.8406999999999996e-05 2024-04-26T11:15:38.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:38.288 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377630+0000", 2024-04-26T11:15:38.288 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.1632999999999998e-05 2024-04-26T11:15:38.288 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.288 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.288 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:38.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479495+0000", 2024-04-26T11:15:38.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10186533 2024-04-26T11:15:38.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:38.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479508+0000", 2024-04-26T11:15:38.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.203e-05 2024-04-26T11:15:38.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.289 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:38.289 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479554+0000", 2024-04-26T11:15:38.289 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6696999999999997e-05 2024-04-26T11:15:38.289 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.289 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.290 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:38.290 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479593+0000", 2024-04-26T11:15:38.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9059e-05 2024-04-26T11:15:38.290 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.290 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:38.290 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.290 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.290 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.290 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276554 5.e 5:7d1a16ce:::benchmark_data_smithi029_44842_object131916:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:38.290 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.375499+0000", 2024-04-26T11:15:38.290 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.8435730350000004, 2024-04-26T11:15:38.290 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10207537799999999, 2024-04-26T11:15:38.290 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:38.290 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:38.291 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:38.291 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:38.291 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:38.291 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276554 2024-04-26T11:15:38.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.291 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:38.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:38.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375499+0000", 2024-04-26T11:15:38.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.291 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.291 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.291 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:38.291 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375499+0000", 2024-04-26T11:15:38.291 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:38.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375498+0000", 2024-04-26T11:15:38.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:38.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:38.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375505+0000", 2024-04-26T11:15:38.292 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0839999999999997e-06 2024-04-26T11:15:38.292 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.292 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.292 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:38.292 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375512+0000", 2024-04-26T11:15:38.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.3270000000000003e-06 2024-04-26T11:15:38.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:38.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375518+0000", 2024-04-26T11:15:38.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0619999999999997e-06 2024-04-26T11:15:38.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375578+0000", 2024-04-26T11:15:38.293 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.0090999999999998e-05 2024-04-26T11:15:38.293 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.293 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.293 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:38.293 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375687+0000", 2024-04-26T11:15:38.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000108933 2024-04-26T11:15:38.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:38.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.375785+0000", 2024-04-26T11:15:38.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7744000000000005e-05 2024-04-26T11:15:38.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:38.294 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477165+0000", 2024-04-26T11:15:38.294 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10138062 2024-04-26T11:15:38.294 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.294 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.294 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:38.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477366+0000", 2024-04-26T11:15:38.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000200526 2024-04-26T11:15:38.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:38.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477411+0000", 2024-04-26T11:15:38.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.4684000000000001e-05 2024-04-26T11:15:38.295 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.295 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.295 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:38.295 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477575+0000", 2024-04-26T11:15:38.295 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000164029 2024-04-26T11:15:38.295 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.295 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:38.295 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.296 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276557 5.b 5:d2a87415:::benchmark_data_smithi029_44842_object131919:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:38.296 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.377684+0000", 2024-04-26T11:15:38.296 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.8413884649999996, 2024-04-26T11:15:38.296 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.099794806, 2024-04-26T11:15:38.296 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:38.296 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:38.296 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:38.296 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:38.296 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:38.296 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276557 2024-04-26T11:15:38.296 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.296 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:38.296 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:38.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377684+0000", 2024-04-26T11:15:38.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:38.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377684+0000", 2024-04-26T11:15:38.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.297 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.297 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:38.297 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377683+0000", 2024-04-26T11:15:38.297 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:38.297 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:38.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377687+0000", 2024-04-26T11:15:38.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.5140000000000002e-06 2024-04-26T11:15:38.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:38.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377693+0000", 2024-04-26T11:15:38.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.3609999999999997e-06 2024-04-26T11:15:38.298 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.298 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.298 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:38.298 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377701+0000", 2024-04-26T11:15:38.298 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.0960000000000001e-06 2024-04-26T11:15:38.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377726+0000", 2024-04-26T11:15:38.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.4635e-05 2024-04-26T11:15:38.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.299 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:38.299 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377795+0000", 2024-04-26T11:15:38.299 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.8866000000000001e-05 2024-04-26T11:15:38.299 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.299 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:38.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.377854+0000", 2024-04-26T11:15:38.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.9781000000000002e-05 2024-04-26T11:15:38.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:38.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477243+0000", 2024-04-26T11:15:38.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.099388958999999999 2024-04-26T11:15:38.300 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.300 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.300 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:38.300 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477397+0000", 2024-04-26T11:15:38.300 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00015366499999999999 2024-04-26T11:15:38.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:38.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477439+0000", 2024-04-26T11:15:38.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.2432999999999998e-05 2024-04-26T11:15:38.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.301 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.301 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:38.301 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477479+0000", 2024-04-26T11:15:38.301 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.9172999999999999e-05 2024-04-26T11:15:38.301 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.301 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:38.301 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.301 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.302 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.302 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276559 5.e 5:77601908:::benchmark_data_smithi029_44842_object131921:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:38.302 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.378420+0000", 2024-04-26T11:15:38.302 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.84065178, 2024-04-26T11:15:38.302 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.101361861, 2024-04-26T11:15:38.302 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:38.302 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:38.302 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:38.302 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:38.302 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:38.302 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276559 2024-04-26T11:15:38.302 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.302 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:38.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:38.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378420+0000", 2024-04-26T11:15:38.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:38.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378420+0000", 2024-04-26T11:15:38.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.303 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.303 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:38.303 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378420+0000", 2024-04-26T11:15:38.303 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:38.303 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:38.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378422+0000", 2024-04-26T11:15:38.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.441e-06 2024-04-26T11:15:38.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:38.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378429+0000", 2024-04-26T11:15:38.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.7909999999999999e-06 2024-04-26T11:15:38.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.304 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.304 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:38.304 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378434+0000", 2024-04-26T11:15:38.304 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.3699999999999997e-06 2024-04-26T11:15:38.304 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378460+0000", 2024-04-26T11:15:38.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.6205000000000001e-05 2024-04-26T11:15:38.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:38.305 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378553+0000", 2024-04-26T11:15:38.305 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.2931999999999997e-05 2024-04-26T11:15:38.305 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.305 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.305 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:38.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378629+0000", 2024-04-26T11:15:38.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.6558999999999997e-05 2024-04-26T11:15:38.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:38.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477294+0000", 2024-04-26T11:15:38.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.098665186000000002 2024-04-26T11:15:38.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.306 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:38.306 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479725+0000", 2024-04-26T11:15:38.306 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0024302579999999998 2024-04-26T11:15:38.306 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.306 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:38.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479750+0000", 2024-04-26T11:15:38.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.5349000000000001e-05 2024-04-26T11:15:38.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.307 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:38.307 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479782+0000", 2024-04-26T11:15:38.307 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2221999999999997e-05 2024-04-26T11:15:38.307 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.307 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:38.307 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.307 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.307 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.307 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276561 5.8 5:1f9b90aa:::benchmark_data_smithi029_44842_object131923:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:38.308 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.378765+0000", 2024-04-26T11:15:38.308 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.8403076669999994, 2024-04-26T11:15:38.308 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.100953418, 2024-04-26T11:15:38.308 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:38.308 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:38.308 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:38.308 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:38.308 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:38.308 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276561 2024-04-26T11:15:38.308 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.308 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:38.308 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.308 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:38.308 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378765+0000", 2024-04-26T11:15:38.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:38.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378765+0000", 2024-04-26T11:15:38.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:38.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378764+0000", 2024-04-26T11:15:38.309 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.999999 2024-04-26T11:15:38.309 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.309 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.309 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:38.309 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378767+0000", 2024-04-26T11:15:38.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.546e-06 2024-04-26T11:15:38.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:38.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378776+0000", 2024-04-26T11:15:38.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 8.9309999999999997e-06 2024-04-26T11:15:38.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:38.310 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378783+0000", 2024-04-26T11:15:38.310 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.691e-06 2024-04-26T11:15:38.310 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.310 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.310 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378888+0000", 2024-04-26T11:15:38.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010509999999999999 2024-04-26T11:15:38.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:38.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378953+0000", 2024-04-26T11:15:38.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 6.4867000000000001e-05 2024-04-26T11:15:38.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.311 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:38.311 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379114+0000", 2024-04-26T11:15:38.311 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000161395 2024-04-26T11:15:38.311 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.311 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:38.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479601+0000", 2024-04-26T11:15:38.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10048657699999999 2024-04-26T11:15:38.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:38.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479631+0000", 2024-04-26T11:15:38.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0514999999999998e-05 2024-04-26T11:15:38.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.312 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.312 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:38.312 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479677+0000", 2024-04-26T11:15:38.312 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.5504999999999999e-05 2024-04-26T11:15:38.312 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.313 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:38.313 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479718+0000", 2024-04-26T11:15:38.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.1013000000000002e-05 2024-04-26T11:15:38.313 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.313 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:38.313 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.313 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.313 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.313 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276563 5.0 5:098fc0d9:::benchmark_data_smithi029_44842_object131925:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:38.313 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.378996+0000", 2024-04-26T11:15:38.313 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.8400760030000001, 2024-04-26T11:15:38.313 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.100680769, 2024-04-26T11:15:38.313 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:38.313 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:38.314 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:38.314 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:38.314 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:38.314 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276563 2024-04-26T11:15:38.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.314 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:38.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:38.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378996+0000", 2024-04-26T11:15:38.314 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.314 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.314 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.314 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:38.314 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378996+0000", 2024-04-26T11:15:38.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:38.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378996+0000", 2024-04-26T11:15:38.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:38.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:38.315 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.378999+0000", 2024-04-26T11:15:38.315 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.6909999999999999e-06 2024-04-26T11:15:38.315 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.315 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.315 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:38.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379007+0000", 2024-04-26T11:15:38.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.9519999999999994e-06 2024-04-26T11:15:38.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:38.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379013+0000", 2024-04-26T11:15:38.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.7989999999999999e-06 2024-04-26T11:15:38.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.316 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.316 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.316 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379044+0000", 2024-04-26T11:15:38.316 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.0546999999999997e-05 2024-04-26T11:15:38.316 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:38.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379148+0000", 2024-04-26T11:15:38.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00010414199999999999 2024-04-26T11:15:38.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:38.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.379245+0000", 2024-04-26T11:15:38.317 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 9.7106000000000002e-05 2024-04-26T11:15:38.317 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.317 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.317 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:38.317 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479481+0000", 2024-04-26T11:15:38.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.10023639500000001 2024-04-26T11:15:38.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:38.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479607+0000", 2024-04-26T11:15:38.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012559999999999999 2024-04-26T11:15:38.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:38.318 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479644+0000", 2024-04-26T11:15:38.318 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.7323999999999997e-05 2024-04-26T11:15:38.318 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.318 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.318 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:38.319 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.479677+0000", 2024-04-26T11:15:38.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.2787999999999998e-05 2024-04-26T11:15:38.319 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.319 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:38.319 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.319 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.319 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.319 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276564 5.8 5:16aef732:::benchmark_data_smithi029_44842_object131926:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:38.319 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.381311+0000", 2024-04-26T11:15:38.319 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.8377616959999994, 2024-04-26T11:15:38.319 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.101656785, 2024-04-26T11:15:38.319 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:38.319 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:38.319 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:38.320 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:38.320 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:38.320 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276564 2024-04-26T11:15:38.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.320 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:38.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:38.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381311+0000", 2024-04-26T11:15:38.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.320 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.320 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.320 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:38.320 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381311+0000", 2024-04-26T11:15:38.320 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:38.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381309+0000", 2024-04-26T11:15:38.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:15:38.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:38.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381319+0000", 2024-04-26T11:15:38.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0186e-05 2024-04-26T11:15:38.321 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.321 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.321 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:38.321 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381337+0000", 2024-04-26T11:15:38.321 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.7833e-05 2024-04-26T11:15:38.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:38.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381350+0000", 2024-04-26T11:15:38.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.2563e-05 2024-04-26T11:15:38.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381478+0000", 2024-04-26T11:15:38.322 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00012802899999999999 2024-04-26T11:15:38.322 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.322 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.322 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:38.322 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477201+0000", 2024-04-26T11:15:38.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.095722990999999993 2024-04-26T11:15:38.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "waiting for subops from 1", 2024-04-26T11:15:38.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477332+0000", 2024-04-26T11:15:38.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.000131478 2024-04-26T11:15:38.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:15:38.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.481980+0000", 2024-04-26T11:15:38.323 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.0046472670000000001 2024-04-26T11:15:38.323 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.323 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.323 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:38.323 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.482887+0000", 2024-04-26T11:15:38.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.00090784299999999997 2024-04-26T11:15:38.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:38.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.482933+0000", 2024-04-26T11:15:38.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.6050000000000001e-05 2024-04-26T11:15:38.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.324 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.324 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:38.324 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.482967+0000", 2024-04-26T11:15:38.324 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3868000000000002e-05 2024-04-26T11:15:38.324 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.324 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:38.324 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.324 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.325 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.325 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_op(client.4534.0:276566 5.d 5:bb7a4c9f:::benchmark_data_smithi029_44842_object131928:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:15:38.325 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.381378+0000", 2024-04-26T11:15:38.325 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.8376940449999992, 2024-04-26T11:15:38.325 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.099107009999999995, 2024-04-26T11:15:38.325 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:38.325 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:15:38.325 INFO:teuthology.orchestra.run.smithi122.stdout: "client_info": { 2024-04-26T11:15:38.325 INFO:teuthology.orchestra.run.smithi122.stdout: "client": "client.4534", 2024-04-26T11:15:38.325 INFO:teuthology.orchestra.run.smithi122.stdout: "client_addr": "172.21.15.29:0/2439456501", 2024-04-26T11:15:38.325 INFO:teuthology.orchestra.run.smithi122.stdout: "tid": 276566 2024-04-26T11:15:38.325 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.325 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:38.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:38.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381378+0000", 2024-04-26T11:15:38.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:38.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381378+0000", 2024-04-26T11:15:38.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.326 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.326 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.326 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:38.326 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381378+0000", 2024-04-26T11:15:38.326 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999995 2024-04-26T11:15:38.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:38.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381380+0000", 2024-04-26T11:15:38.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9870000000000002e-06 2024-04-26T11:15:38.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:38.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381383+0000", 2024-04-26T11:15:38.327 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 3.3440000000000001e-06 2024-04-26T11:15:38.327 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.327 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.327 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:38.327 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381386+0000", 2024-04-26T11:15:38.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.9050000000000001e-06 2024-04-26T11:15:38.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381410+0000", 2024-04-26T11:15:38.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.3589000000000001e-05 2024-04-26T11:15:38.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:38.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.381488+0000", 2024-04-26T11:15:38.328 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 7.8449999999999996e-05 2024-04-26T11:15:38.328 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.328 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.328 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "op_commit", 2024-04-26T11:15:38.328 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.480404+0000", 2024-04-26T11:15:38.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.098916199999999996 2024-04-26T11:15:38.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "commit_sent", 2024-04-26T11:15:38.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.480432+0000", 2024-04-26T11:15:38.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 2.7328999999999999e-05 2024-04-26T11:15:38.329 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.329 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.329 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:38.329 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.480485+0000", 2024-04-26T11:15:38.329 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 5.3464000000000002e-05 2024-04-26T11:15:38.329 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.329 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:38.329 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.330 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.330 INFO:teuthology.orchestra.run.smithi122.stdout: "description": "osd_repop_reply(client.4534.0:276554 5.e e59/16 ondisk, result = 0)", 2024-04-26T11:15:38.330 INFO:teuthology.orchestra.run.smithi122.stdout: "initiated_at": "2024-04-26T11:15:28.382088+0000", 2024-04-26T11:15:38.330 INFO:teuthology.orchestra.run.smithi122.stdout: "age": 9.8369841620000003, 2024-04-26T11:15:38.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.095081035999999994, 2024-04-26T11:15:38.330 INFO:teuthology.orchestra.run.smithi122.stdout: "type_data": { 2024-04-26T11:15:38.330 INFO:teuthology.orchestra.run.smithi122.stdout: "flag_point": "started", 2024-04-26T11:15:38.330 INFO:teuthology.orchestra.run.smithi122.stdout: "events": [ 2024-04-26T11:15:38.330 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.330 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "initiated", 2024-04-26T11:15:38.330 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.382088+0000", 2024-04-26T11:15:38.330 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "throttled", 2024-04-26T11:15:38.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.382088+0000", 2024-04-26T11:15:38.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0 2024-04-26T11:15:38.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "header_read", 2024-04-26T11:15:38.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.382086+0000", 2024-04-26T11:15:38.331 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4294967295.9999986 2024-04-26T11:15:38.331 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.331 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.331 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "all_read", 2024-04-26T11:15:38.331 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.382097+0000", 2024-04-26T11:15:38.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.041e-05 2024-04-26T11:15:38.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "dispatched", 2024-04-26T11:15:38.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477080+0000", 2024-04-26T11:15:38.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 0.094983337000000001 2024-04-26T11:15:38.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "queued_for_pg", 2024-04-26T11:15:38.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477099+0000", 2024-04-26T11:15:38.332 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.9040000000000001e-05 2024-04-26T11:15:38.332 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.332 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.332 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "reached_pg", 2024-04-26T11:15:38.332 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477148+0000", 2024-04-26T11:15:38.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 4.8497e-05 2024-04-26T11:15:38.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "started", 2024-04-26T11:15:38.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477159+0000", 2024-04-26T11:15:38.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0933e-05 2024-04-26T11:15:38.333 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-04-26T11:15:38.333 INFO:teuthology.orchestra.run.smithi122.stdout: { 2024-04-26T11:15:38.333 INFO:teuthology.orchestra.run.smithi122.stdout: "event": "done", 2024-04-26T11:15:38.333 INFO:teuthology.orchestra.run.smithi122.stdout: "time": "2024-04-26T11:15:28.477169+0000", 2024-04-26T11:15:38.333 INFO:teuthology.orchestra.run.smithi122.stdout: "duration": 1.0379e-05 2024-04-26T11:15:38.333 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.333 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:38.334 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.334 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-04-26T11:15:38.334 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-04-26T11:15:38.334 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-04-26T11:15:38.434 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~100s 2024-04-26T11:15:38.789 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:15:39.786 INFO:teuthology.orchestra.run.smithi029.stderr:noscrub is unset 2024-04-26T11:15:39.800 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:15:40.794 INFO:teuthology.orchestra.run.smithi029.stderr:nodeep-scrub is unset 2024-04-26T11:15:44.243 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~106s 2024-04-26T11:15:50.051 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~111s 2024-04-26T11:15:55.857 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~117s 2024-04-26T11:16:01.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~123s 2024-04-26T11:16:07.471 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~129s 2024-04-26T11:16:13.280 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~135s 2024-04-26T11:16:19.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~140s 2024-04-26T11:16:23.726 DEBUG:teuthology.orchestra.console.smithi072:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctnter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F B7 65 GUID: 00000000 0000 0000 0000 0CC47AD8DAF4 DHCP./                    DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ CLIENT IP: 172.21.15.72 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:b7:65)... Configuring (net0 0c:c4:7a:8f:b7:65).... Configuring (net0 0c:c4:7a:8f:b7:65)..... Configuring (net0 0c:c4:7a:8f:b7:65)...... ok [?25l20;7HUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (4.18.0-552.el8.x86_64) 8  CentOS Stream (4.18.0-489.el8.x86_64) 8  CentOS Stream (4.18.0-348.el8.x86_64) 8  CentOS Stream (0-rescue-a1b29d6c289747bdb22930598d39874a) 8              The selected entry will be started automatically in 5s.   CentOS Stream (4.18.0-552.el8.x86_64) 8   CentOS Stream (4.18.0-489.el8.x86_64) 8  CentOS Stream (4.18.0-348.el8.x86_64) 8  CentOS Stream (0-rescue-a1b29d6c289747bdb22930598d39874a) 8            Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a comm The selected entry will be started automatically in 4s. and prompt.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       Probing EDD (edd=off to disabl [ 0.000000] Linux version 4.18.0-552.el8.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-21) (GCC)) #1 SMP Sun Apr 7 19:39:51 UTC 2024 [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-552.el8.x86_64 root=UUID=c5236ddf-553d-41ea-8bce-5708f99a0430 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078e70fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f23000-0x00000000798acfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ad000-0x0000000079d49fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4a000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.994 MHz processor [ 0.000000] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0x78e71 max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.000000] Using GB pages for direct mapping [ 0.000000] RAMDISK: [mem 0x34b91000-0x365c0fff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.000000] ACPI: XSDT 0x00000000798AD098 0000B4 (v01 01072009 AMI 00010013) [ 0.000000] ACPI: FACP 0x00000000798E05B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: DSDT 0x00000000798AD1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.000000] ACPI: FACS 0x0000000079D48F80 000040 [ 0.000000] ACPI: APIC 0x00000000798E06C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FPDT 0x00000000798E0788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FIDT 0x00000000798E07D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: SPMI 0x00000000798E0870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.000000] ACPI: MCFG 0x00000000798E08B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.000000] ACPI: UEFI 0x00000000798E08F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.000000] ACPI: HPET 0x00000000798E0938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: WDDT 0x00000000798E0970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.000000] ACPI: SSDT 0x00000000798E09B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798F7B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798FA180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.000000] ACPI: PRAD 0x00000000798FA1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.000000] ACPI: DMAR 0x00000000798FA2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: HEST 0x00000000798FA3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 0x00000000798FA630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 0x00000000798FA660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 0x00000000798FA890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0x798e05b0-0x798e06bb] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0x798ad1e8-0x798e05ab] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0x79d48f80-0x79d48fbf] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0x798e06c0-0x798e0787] [ 0.000000] ACPI: Reserving FPDT table memory at [mem 0x798e0788-0x798e07cb] [ 0.000000] ACPI: Reserving FIDT table memory at [mem 0x798e07d0-0x798e086b] [ 0.000000] ACPI: Reserving SPMI table memory at [mem 0x798e0870-0x798e08af] [ 0.000000] ACPI: Reserving MCFG table memory at [mem 0x798e08b0-0x798e08eb] [ 0.000000] ACPI: Reserving UEFI table memory at [mem 0x798e08f0-0x798e0931] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0x798e0938-0x798e096f] [ 0.000000] ACPI: Reserving WDDT table memory at [mem 0x798e0970-0x798e09af] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798e09b0-0x798f7b2e] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798f7b30-0x798fa17b] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798fa180-0x798fa1e3] [ 0.000000] ACPI: Reserving PRAD table memory at [mem 0x798fa1e8-0x798fa2e9] [ 0.000000] ACPI: Reserving DMAR table memory at [mem 0x798fa2f0-0x798fa3ab] [ 0.000000] ACPI: Reserving HEST table memory at [mem 0x798fa3b0-0x798fa62b] [ 0.000000] ACPI: Reserving BERT table memory at [mem 0x798fa630-0x798fa65f] [ 0.000000] ACPI: Reserving ERST table memory at [mem 0x798fa660-0x798fa88f] [ 0.000000] ACPI: Reserving EINJ table memory at [mem 0x798fa890-0x798fa9bf] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.000000] Using crashkernel=auto, the size chosen is a best effort estimation. [ 0.000000] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32653MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.000000] node 0: [mem 0x0000000000100000-0x0000000078e70fff] [ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Zeroed struct page in unavailable ranges: 29189 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.000000] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78e71000-0x78f22fff] [ 0.000000] PM: Registered nosave memory: [mem 0x78f23000-0x798acfff] [ 0.000000] PM: Registered nosave memory: [mem 0x798ad000-0x79d49fff] [ 0.000000] PM: Registered nosave memory: [mem 0x79d4a000-0x8fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.000000] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 8228663 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-552.el8.x86_64 root=UUID=c5236ddf-553d-41ea-8bce-5708f99a0430 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] software IO TLB: area num 8. [ 0.000000] Memory: 1756420K/33437676K available (14339K kernel code, 5957K rwdata, 8568K rodata, 2820K init, 13792K bss, 935740K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.000000] Kernel/User page tables isolation: enabled [ 0.000000] ftrace: allocating 41053 entries in 161 pages [ 0.000000] ftrace: allocated 161 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.000000] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.000000] random: crng done (trusting CPU's manufacturer) [ 0.001000] Console: colour VGA+ 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 0.001000] APIC: Switch to symmetric I/O mode setup [ 0.001003] DMAR: Host address width 46 [ 0.002001] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 0.003005] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 0.004001] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 0.005002] DMAR: ATSR flags: 0x0 [ 0.006001] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 0.007002] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 0.008001] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 0.009001] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 0.010001] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 0.010002] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 0.013035] DMAR-IR: Enabled IRQ remapping in xapic mode [ 0.014000] x2apic: IRQ remapping doesn't support X2APIC mode [ 0.014475] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.019001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32734b4358f, max_idle_ns: 440795367814 ns [ 0.020001] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.98 BogoMIPS (lpj=3499994) [ 0.021000] pid_max: default: 32768 minimum: 301 [ 0.022022] LSM: Security Framework initializing [ 0.023007] Yama: becoming mindful. [ 0.024004] SELinux: Initializing. [ 0.025020] LSM support for eBPF active [ 0.030410] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, vmalloc) [ 0.033680] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, vmalloc) [ 0.034077] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.035071] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.036207] CPU0: Thermal monitoring enabled (TM1) [ 0.037055] process: using mwait in idle threads [ 0.038002] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 0.039000] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 0.040003] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.041001] Spectre V2 : Mitigation: Retpolines [ 0.042000] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.043000] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 0.044000] Speculative Store Bypass: Vulnerable [ 0.045005] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.046000] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.047000] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.058805] Freeing SMP alternatives memory: 36K [ 0.059186] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 0.162565] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 0.164097] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 0.165001] ... version: 3 [ 0.166000] ... bit width: 48 [ 0.167000] ... generic registers: 4 [ 0.168000] ... value mask: 0000ffffffffffff [ 0.169000] ... max period: 00007fffffffffff [ 0.170000] ... fixed-purpose events: 3 [ 0.171000] ... event mask: 000000070000000f [ 0.172028] rcu: Hierarchical SRCU implementation. [ 0.174051] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 0.175014] smp: Bringing up secondary CPUs ... [ 0.176069] x86: Booting SMP configuration: [ 0.177001] .... node #0, CPUs: #1 #2 #3 #4 [ 0.180094] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 0.182000] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 0.183001] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 0.184090] #5 #6 #7 [ 0.185533] smp: Brought up 1 node, 8 CPUs [ 0.187001] smpboot: Max logical packages: 1 [ 0.188001] smpboot: Total of 8 processors activated (55999.90 BogoMIPS) [ 0.225020] node 0 deferred pages initialised in 35ms [ 0.231230] devtmpfs: initialized [ 0.232041] x86/mm: Memory block size: 128MB [ 0.235711] ACPI: PM: Registering ACPI NVS region [mem 0x798ad000-0x79d49fff] (4837376 bytes) [ 0.244082] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.254008] futex hash table entries: 2048 (order: 5, 131072 bytes, vmalloc) [ 0.261058] pinctrl core: initialized pinctrl subsystem [ 0.266114] NET: Registered protocol family 16 [ 0.271060] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 0.278012] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.286009] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.294018] audit: initializing netlink subsys (disabled) [ 0.299009] audit: type=2000 audit(1714130147.299:1): state=initialized audit_enabled=0 res=1 [ 0.308002] cpuidle: using governor menu [ 0.311029] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.319001] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.326051] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 0.335001] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 0.342014] PCI: Using configuration type 1 for base access [ 0.349011] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.355002] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.362022] cryptd: max_cpu_qlen set to 1000 [ 0.366047] ACPI: Added _OSI(Module Device) [ 0.371001] ACPI: Added _OSI(Processor Device) [ 0.375004] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.380001] ACPI: Added _OSI(Processor Aggregator Device) [ 0.410782] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 0.419666] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 0.428086] ACPI: Dynamic OEM Table Load: [ 0.445620] ACPI: Interpreter enabled [ 0.449009] ACPI: PM: (supports S0 S4 S5) [ 0.453000] ACPI: Using IOAPIC for interrupt routing [ 0.460542] HEST: Enabling Firmware First mode for corrected errors. [ 0.467074] HEST: Table parsing has been initialized. [ 0.472135] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 0.480002] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.489545] ACPI: Enabled 5 GPEs in block 00 to 3F [ 0.517514] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 0.524003] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.534223] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.543418] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.551001] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.560030] PCI host bridge to bus 0000:ff [ 0.564001] pci_bus 0000:ff: root bus resource [bus ff] [ 0.569009] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 0.575043] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 0.581017] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 0.587033] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 0.593035] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 0.599032] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 0.605031] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 0.611031] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 0.618032] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 0.624030] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 0.630032] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 0.636030] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 0.642030] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 0.648031] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 0.654031] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 0.660025] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 0.666031] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 0.672030] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 0.678030] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 0.684022] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 0.690038] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 0.696059] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 0.702042] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 0.708042] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 0.714041] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 0.720043] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 0.726031] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 0.732033] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 0.738034] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 0.744042] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 0.750042] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 0.756041] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 0.762042] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 0.768025] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 0.774033] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 0.781032] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 0.787035] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 0.793044] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 0.799042] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 0.805043] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 0.811044] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 0.817031] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 0.823032] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 0.829033] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 0.835038] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 0.841026] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 0.847033] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 0.853032] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 0.859035] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 0.865017] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 0.871032] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 0.877033] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 0.883028] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 0.889035] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 0.895033] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 0.903855] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 0.910002] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.919140] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.927250] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.935001] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.944016] PCI host bridge to bus 0000:00 [ 0.948002] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.955001] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 0.962000] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.969000] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 0.976000] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 0.984001] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 0.991001] pci_bus 0000:00: root bus resource [bus 00-fe] [ 0.997024] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 1.003096] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 1.009042] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.015089] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 1.021041] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.027085] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 1.033041] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.040078] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 1.046007] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.052078] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 1.059008] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 1.065072] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 1.071008] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 1.078081] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 1.084007] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 1.091078] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 1.097007] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.104077] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 1.110007] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 1.117077] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 1.123004] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 1.130078] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 1.136007] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 1.143063] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 1.149048] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 1.155085] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 1.161057] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 1.167005] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 1.173074] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 1.179157] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 1.185011] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 1.191006] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 1.196006] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 1.202005] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 1.208006] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 1.213006] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 1.219028] pci 0000:00:11.4: PME# supported from D3hot [ 1.225036] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 1.231013] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 1.238049] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.243087] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 1.250014] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 1.256029] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.262059] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 1.269013] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 1.275050] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.281069] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 1.288013] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 1.294042] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.300078] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 1.306067] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.312077] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 1.318041] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.324076] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 1.331066] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.337080] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 1.343013] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 1.349073] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.355074] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 1.361100] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 1.367010] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 1.373005] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 1.379005] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 1.384005] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 1.390005] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 1.395005] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 1.402024] pci 0000:00:1f.2: PME# supported from D3hot [ 1.407062] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 1.413013] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 1.420015] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 1.425154] acpiphp: Slot [1] registered [ 1.429014] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.434082] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 1.440009] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 1.447015] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 1.454003] pci 0000:02:00.0: enabling Extended Tags [ 1.459076] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.464002] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.471121] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 1.477009] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.484004] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 1.490009] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.497004] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 1.504036] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.510016] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.517000] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.527008] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.534000] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.545083] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 1.551010] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.558004] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 1.564009] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.571004] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 1.578038] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.584013] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.591000] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.601008] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.609001] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.619081] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.624002] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.630001] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.637002] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.645028] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.650063] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 1.656065] pci 0000:05:00.0: enabling Extended Tags [ 1.661070] pci 0000:05:00.0: supports D1 D2 [ 1.665000] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.672090] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.677002] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.683002] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.690040] pci_bus 0000:06: extended config space not accessible [ 1.696024] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 1.702022] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 1.708012] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 1.714012] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 1.720096] pci 0000:06:00.0: supports D1 D2 [ 1.724001] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.731105] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.736007] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.742003] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.749081] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 1.755016] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 1.761018] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 1.767009] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 1.773075] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.779033] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.787001] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.797021] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.804000] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.814167] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 1.820017] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 1.827017] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 1.832009] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 1.839115] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.845034] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.852000] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.862014] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.870000] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.880086] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.885002] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.891002] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.898003] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.905467] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.911034] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.917037] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.923032] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.929044] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.935001] ACPI: PCI: Interrupt link LNKE disabled [ 1.940034] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.946000] ACPI: PCI: Interrupt link LNKF disabled [ 1.951024] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.957000] ACPI: PCI: Interrupt link LNKG disabled [ 1.962031] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.968000] ACPI: PCI: Interrupt link LNKH disabled [ 1.973012] iommu: Default domain type: Passthrough [ 1.978068] SCSI subsystem initialized [ 1.981015] ACPI: bus type USB registered [ 1.985013] usbcore: registered new interface driver usbfs [ 1.991006] usbcore: registered new interface driver hub [ 1.996007] usbcore: registered new device driver usb [ 2.001020] pps_core: LinuxPPS API ver. 1 registered [ 2.006000] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.015001] PTP clock support registered [ 2.019013] EDAC MC: Ver: 3.0.0 [ 2.023023] PCI: Using ACPI for IRQ routing [ 2.032022] NetLabel: Initializing [ 2.035000] NetLabel: domain hash size = 128 [ 2.040000] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.045013] NetLabel: unlabeled traffic allowed by default [ 2.051024] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.052000] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.066001] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.071000] vgaarb: loaded [ 2.074037] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.080000] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.088025] clocksource: Switched to clocksource tsc-early [ 2.103585] VFS: Disk quotas dquot_6.6.0 [ 2.107523] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.114451] pnp: PnP ACPI init [ 2.117838] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.123753] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.129664] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.135574] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.141485] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.147394] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.153307] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.159910] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.166515] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.173119] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.179722] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.186327] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.192931] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.199691] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.205601] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.211512] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.217423] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.223335] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.229922] pnp: PnP ACPI: found 5 devices [ 2.239402] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 2.248303] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 2.259771] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 2.267588] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.272547] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.277503] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.284285] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.291846] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.299750] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.307395] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.315384] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.322943] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.330847] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.338489] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.346481] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.354038] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.361943] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.369586] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.377579] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.385136] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.393040] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.400685] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.408676] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.413633] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.419717] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.426494] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.434226] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.439188] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.444151] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.450236] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.457028] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.462244] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.468331] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.475111] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 2.482850] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 2.490676] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 2.498414] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 2.506233] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.511197] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.517282] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.524058] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 2.531791] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 2.540827] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 2.546997] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 2.553168] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 2.560032] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 2.566896] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 2.573762] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 2.580627] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 2.586883] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 2.592446] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 2.598704] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.605916] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 2.611478] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.617737] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 2.623301] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.629559] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 2.635123] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 2.641380] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 2.648688] NET: Registered protocol family 2 [ 2.653239] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.662507] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, vmalloc) [ 2.671366] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.679766] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc) [ 2.687343] TCP: Hash tables configured (established 262144 bind 65536) [ 2.694057] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, vmalloc) [ 2.701806] UDP hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.708823] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.716291] NET: Registered protocol family 1 [ 2.720655] NET: Registered protocol family 44 [ 2.725174] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 2.744091] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x627 took 11437 usecs [ 2.763125] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x627 took 11354 usecs [ 2.770530] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 2.776979] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.785361] Unpacking initramfs... [ 3.059286] Freeing initrd memory: 26816K [ 3.063368] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.069804] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 3.077723] ACPI: bus type thunderbolt registered [ 3.083997] Initialise system trusted keyrings [ 3.088448] Key type blacklist registered [ 3.092483] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.100469] zbud: loaded [ 3.103313] pstore: using deflate compression [ 3.107846] Platform Keyring initialized [ 3.150118] NET: Registered protocol family 38 [ 3.154555] Key type asymmetric registered [ 3.158645] Asymmetric key parser 'x509' registered [ 3.163517] Running certificate verification selftests [ 3.193863] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 3.204741] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.212159] io scheduler mq-deadline registered [ 3.216688] io scheduler kyber registered [ 3.220725] io scheduler bfq registered [ 3.224625] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.231831] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.237732] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.243620] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.249490] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.255353] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.261217] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.267096] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.274388] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.282750] ACPI: Power Button [PWRB] [ 3.286437] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.293844] ACPI: Power Button [PWRF] [ 3.298593] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.306099] pstore: Registered erst as persistent store backend [ 3.312113] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.338961] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.366881] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.374528] Non-volatile memory driver v1.3 [ 3.379149] rdac: device handler registered [ 3.383391] hp_sw: device handler registered [ 3.387659] emc: device handler registered [ 3.391811] alua: device handler registered [ 3.396056] libphy: Fixed MDIO Bus: probed [ 3.400327] usbcore: registered new interface driver usbserial_generic [ 3.400422] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.406853] usbserial: USB Serial support registered for generic [ 3.412127] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 3.418088] i8042: PNP: No PS/2 controller found. [ 3.425464] ehci-pci 0000:00:1d.0: debug port 2 [ 3.430195] mousedev: PS/2 mouse device common for all mice [ 3.438590] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.440298] rtc_cmos 00:00: RTC can wake from S4 [ 3.450699] rtc_cmos 00:00: registered as rtc0 [ 3.452032] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.455150] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 3.460908] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.476782] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.483992] usb usb1: Product: EHCI Host Controller [ 3.488861] usb usb1: Manufacturer: Linux 4.18.0-552.el8.x86_64 ehci_hcd [ 3.495552] usb usb1: SerialNumber: 0000:00:1d.0 [ 3.500277] intel_pstate: Intel P-state driver initializing [ 3.500307] hub 1-0:1.0: USB hub found [ 3.509599] hub 1-0:1.0: 2 ports detected [ 3.513831] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.519095] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 3.526747] hid: raw HID events driver (C) Jiri Kosina [ 3.527568] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 3.531904] usbcore: registered new interface driver usbhid [ 3.541208] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.541214] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.541263] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 3.541264] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 3.541289] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.541290] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.541291] usb usb2: Product: xHCI Host Controller [ 3.541292] usb usb2: Manufacturer: Linux 4.18.0-552.el8.x86_64 xhci-hcd [ 3.541293] usb usb2: SerialNumber: 0000:00:14.0 [ 3.541425] hub 2-0:1.0: USB hub found [ 3.541450] hub 2-0:1.0: 15 ports detected [ 3.544634] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 4.18 [ 3.544637] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.544638] usb usb3: Product: xHCI Host Controller [ 3.544640] usb usb3: Manufacturer: Linux 4.18.0-552.el8.x86_64 xhci-hcd [ 3.544641] usb usb3: SerialNumber: 0000:00:14.0 [ 3.544746] hub 3-0:1.0: USB hub found [ 3.544761] hub 3-0:1.0: 6 ports detected [ 3.546566] usbhid: USB HID core driver [ 3.546647] drop_monitor: Initializing network drop monitor service [ 3.551837] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 4 [ 3.557060] Initializing XFRM netlink socket [ 3.417] ehci-pci 0000:00:1a.0: debug port 2 [ 3.570738] NET: Registered protocol family 10 [ 3.582813] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.586325] Segment Routing with IPv6 [ 3.597046] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.597731] NET: Registered protocol family 17 [ 3.602371] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.606144] mpls_gso: MPLS GSO support [ 3.610181] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.718952] usb usb4: Product: EHCI Host Controller [ 3.723822] usb usb4: Manufacturer: Linux 4.18.0-552.el8.x86_64 ehci_hcd [ 3.730512] usb usb4: SerialNumber: 0000:00:1a.0 [ 3.735253] hub 4-0:1.0: USB hub found [ 3.739051] hub 4-0:1.0: 2 ports detected [ 3.743104] microcode: Microcode Update Driver: v2.2. [ 3.743197] resctrl: L3 allocation detected [ 3.752423] resctrl: L3 monitoring detected [ 3.753013] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 3.756691] AVX2 version of gcm_enc/dec engaged. [ 3.767734] AES CTR mode by8 optimization enabled [ 3.782841] sched_clock: Marking stable (3782837986, 0)->(5655317774, -1872479788) [ 3.785005] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 3.797087] registered taskstats version 1 [ 3.801290] Loading compiled-in X.509 certificates [ 3.806381] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: b8c8c7a1297a11ed2e36e7913cdfd6f59248d125' [ 3.817265] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 3.829090] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 3.839708] zswap: loaded using pool lzo/zbud [ 3.844110] page_owner is disabled [ 3.850970] Key type big_key registered [ 3.856638] Key type encrypted registered [ 3.860652] ima: No TPM chip found, activating TPM-bypass! [ 3.866135] ima: Allocated hash algorithm: sha256 [ 3.870844] ima: No architecture policies found [ 3.875392] evm: Initialising EVM extended attributes: [ 3.880532] evm: security.selinux [ 3.883846] evm: security.ima [ 3.886810] evm: security.capability [ 3.890380] evm: HMAC attrs: 0x1 [ 3.893836] rtc_cmos 00:00: setting system clock to 2024-04-26 11:15:53 UTC (1714130153) [ 3.900423] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 3.910083] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.917449] hub 1-1:1.0: USB hub found [ 3.921297] hub 1-1:1.0: 8 ports detected [ 3.921473] Freeing unused decrypted memory: 2028K [ 3.923203] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 3.923206] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.923674] hub 2-12:1.0: USB hub found [ 3.923753] hub 2-12:1.0: 4 ports detected [ 3.954150] Freeing unused kernel image (initmem) memory: 2820K [ 3.960096] Write protecting the kernel read-only data: 26624k [ 3.966286] Freeing unused kernel image (text/rodata gap) memory: 2016K [ 3.973146] Freeing unused kernel image (rodata/data gap) memory: 1672K [ 3.989073] systemd[1]: systemd 239 (239-75.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 4.011465] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 4.030100] systemd[1]: Detected architecture x86-64. [ 4.035150] systemd[1]: Running in initial RAM disk. Welcome to CentOS Stream 8 dracut-049-224.git20230330.el8 (Initramfs)! [ 4.066061] systemd[1]: Set hostname to . [ 4.102735] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 4.115115] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 4.125184] systemd[1]: Listening on udev Control Socket. [ 4.127048] tsc: Refined TSC clocksource calibration: 3499.998 MHz [ 4.136767] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734efdd03, max_idle_ns: 440795244944 ns [ 4.136816] clocksource: Switched to clocksource tsc [ 4.146303] usb 4-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.159921] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ OK ] Listening on udev Control So[ 4.170552] hub 4-1:1.0: USB hub found cket. [ 4.175109] hub 4-1:1.0: 6 ports detected [ 4.179726] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 4.192006] systemd[1]: Starting Setup Virtual Console... Starting Setup Virtual Console... [ 4.203498] systemd[1]: Started Memstrack Anylazing Service. [ OK ] Started Memstrack Anylazing Service. Starting Load Kernel Modules... [ OK ] Reached target Swap. [ OK [[ 4.231231] fuse: init (API version 7.34) 0m] Reached target Timers. [ OK ] Reached target Local File Systems. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Reached target Sockets. Starting Journal Service... Starting Create Volatile Files and Directories... [ OK ] Started Setup Virtual Console. [ OK ] Started Load Kernel Modules. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. Starting Create Static Device Nodes in /dev... Starting Apply Kernel Variables... Starting dracut cmdline hook... [ OK ] Started Journal Service. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Apply Kernel Variables. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Reached target System Initialization. Starting dracut initqueue hook... Starting Show Plymouth Boot Screen... [ 4.559841] dca service started, version 1.12.1 [ 4.572373] nvme nvme0: pci function 0000:02:00.0 [ OK [[ 4.579866] nvme nvme0: 8/0/0 default/read/poll queues 0m] Started Show[ 4.585576] igb: Intel(R) Gigabit Ethernet Network Driver [ 4.586300] nvme0n1: detected capacity change from 0 to 400088457216 Plymouth Boot S[ 4.592109] igb: Copyright (c) 2007-2014 Intel Corporation. creen. [[0;32[ 4.605845] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode m OK ] Rea[ 4.614887] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst ched target Path[ 4.624335] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver s. [ O[ 4.631356] ixgbe: Copyright (c) 1999-2016 Intel Corporation. K ] Started[ 4.638781] ACPI: bus type drm_connector registered [ 4.643930] scsi host0: ahci Forward Passwor[ 4.647729] scsi host1: ahci [ 4.647816] scsi host2: ahci d Requests to Pl[ 4.654894] scsi host3: ahci ymouth Directory Watch. [ OK ] Re[ 4.659232] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 43 ached target Bas[ 4.659239] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 43 [ 4.659244] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 43 ic System. [ 4.659249] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 43 [ 4.659784] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 4.659788] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.663638] igb 0000:07:00.0: added PHC on eth0 [ 4.687313] scsi host4: ahci [ 4.695364] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 4.703636] scsi host5: ahci [ 4.711082] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:da:f4 [ 4.715714] scsi host6: ahci [ 4.718576] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 4.718680] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 4.718683] ast 0000:06:00.0: [drm] AST 2400 detected [ 4.718700] ast 0000:06:00.0: [drm] Using analog VGA [ 4.718709] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 4.718839] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 4.725506] scsi host7: ahci [ 4.728277] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.735556] scsi host8: ahci [ 4.787130] fbcon: astdrmfb (fb0) is primary device [ 4.787234] scsi host9: ahci [ 4.787271] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 [ 4.787274] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 [ 4.787276] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 [ 4.787278] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 [ 4.787279] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 [ 4.787281] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 [ 4.791438] igb 0000:07:00.1: added PHC on eth1 [ 4.791468] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 4.791469] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:da:f5 [ 4.791556] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 4.791557] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.792789] igb 0000:07:00.0 eno1: renamed from eth0 [ 4.836712] Console: switching to colour frame buffer device 128x48 [ 4.863989] igb 0000:07:00.1 eno2: renamed from eth1 [ 4.964305] ata2: SATA link down (SStatus 0 SControl 300) [ 4.968063] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 4.973048] ata4: SATA link down (SStatus 0 SControl 300) [ 4.990260] ata3: SATA link down (SStatus 0 SControl 300) [ 4.990294] ata1: SATA link down (SStatus 0 SControl 300) [ 5.097179] ata6: SATA link down (SStatus 0 SControl 300) [ 5.102595] ata7: SATA link down (SStatus 0 SControl 300) [ 5.108002] ata8: SATA link down (SStatus 0 SControl 300) [ 5.113411] ata9: SATA link down (SStatus 0 SControl 300) [ 5.118834] ata10: SATA link down (SStatus 0 SControl 300) [ 5.124347] ata5: SATA link up 3.0 Gbps (SStatus 123 SControl 300) [ 5.131538] ata5.00: ATA-7: HUA721010KLA330, GKAOA94A, max UDMA/133 [ 5.137803] ata5.00: sectors, multi 1), AA [ 5.140] ata5.00: configured for UDMA/133 [ 5.150397] scsi 4:0:0:0: Direct-Access ATA HUA721010KLA330 A94A PQ: 0 ANSI: 5 [ 5.162932] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.171971] sbyte logical blocks: (1.00 TB/932 GiB) [ 5.179631] sd 4:0:0:0: [sda] Write Protect is off [ 5.184440] sd 4:0:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA [ 5.206220] sda: sda1 [ 5.208801] sd 4:0:0:0: [sda] Attached SCSI disk [ 5.248083] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 5.358556] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 5.366983] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.379630] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ OK ] Found device HUA721010KLA330 1. [ OK ] Reached target Initrd Root Device. [ 5.443196] hneric 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 5.455652] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 5.467388] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.772228] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.782505] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 5.791026] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 5.797196] ixgbe 0000:03:00.0: 0c:c4:7a:8f:b7:64 [ 5.805019] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 5.811644] libphy: ixgbe-mdio: probed [ 5.972117] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.982387] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 5.990893] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 5.997938] ixgbe 0000:03:00.1: 0c:c4:7a:8f:b7:65 [ 6.005921] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.012505] libphy: ixgbe-mdio: probed [ 6.017122] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 6.031180] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting File System Check on /dev/…ddf-553d-41ea-8bce-5708f99a0430... [ OK ] Started File System Check on /dev/d…36ddf-553d-41ea-8bce-5708f99a0430. Mounting /sysroot... [ 6.214392] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Starting Setup Virtual Console... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped target Paths. [ OK ] Stopped target System Initialization. Stopping udev Kernel Device Manager... [ OK ] Stopped target Swap. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped target Slices. Starting Plymouth switch root service... [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Started Setup Virtual Console. [ OK ] Reached target Switch Root. [ OK ] Started Plymouth switch root service. Starting Switch Root... [ 6.732122] printk: systemd: 19 output lines suppressed due to ratelimiting [ 7.725584] SELinux: policy capability network_peer_controls=1 [ 7.731505] SELinux: policy capability open_perms=1 [ 7.736468] SELinux: policy capability extended_socket_class=1 [ 7.742377] SELinux: policy capability always_check_network=0 [ 7.748202] SELinux: policy capability cgroup_seclabel=1 [ 7.753590] SELinux: policy capability nnp_nosuid_transition=1 [ 7.781128] audit: type=1403 audit(1714130157.386:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 7.782950] systemd[1]: Successfully loaded SELinux policy in 301.952ms. [ 7.894344] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 19.984ms. [ 7.925056] systemd[1]: systemd 239 (239-75.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 7.959131] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 8! [ 7.992058] systemd[1]: Set hostname to . [ 9.698931] systemd[1]: initrd-switch-root.service: Succeeded. [ 9.705004] systemd[1]: Stopped Switch Root. [ OK [[ 9.709694] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. 0m] Stopped Swit[ 9.721318] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. ch Root. [ 9.731606] systemd[1]: Stopped Journal Service. [ OK [[ 9.737789] systemd[1]: Starting Journal Service... 0m] Stopped Jour[ 9.744417] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. nal Service. Starting Journal Service... [ OK ] Set up automount Arbitrary Executab…rmats File System Automount Point. [ OK ] Listening on udev Control Socket. [ OK ] Created slice system-sshd\x2dkeygen.slice. Mounting Kernel Debug File System... Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Listening on udev Kernel Socket. Starting udev Coldplug all Devices... [ OK ] Listening on Process Core Dump Socket. Mounting POSIX Message Queue File System... [ OK ] Reached target ceph target allowing…ph-mon@.service instances at once. [ OK ] Reached target ceph target allowing…ph-osd@.service instances at once. [ OK ] Reached target ceph target allowing…ph-mds@.service instances at once. [ OK ] Reached target ceph target allowing…ph-mgr@.service instances at once. [ OK ] Reached target Swap. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Created slice system-getty.slice. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Listening on Device-mapper event daemon FIFOs. Starting Monitoring of LVM2 mirrors…ng dmeventd or progress polling... [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. Starting Setup Virtual Console... Mounting Huge Pages File System... Starting Remount Root and Kernel File Systems... [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target Paths. [ OK ] Reached target ceph target allowing…adosgw@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK [ 9.942588] EXT4-fs (sda1): re-mounted. Opts: (null) [0m] Created slice User and Session Slice. [ OK ] Reached target Slices. [ OK ] Reached target ceph target allowing…mirror@.service instances at once. [ OK ] Listening on initctl Compatibility Named Pipe. Starting Create list of required st…ce nodes for the current kernel... Starting Load Kernel Modules... [ OK ] Started Journal Service. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Huge Pages File System. [ OK ] Started Remount Root and Kernel File Systems. [ OK ] Started Create list of required sta…vice nodes for the current kernel. Starting Load/Save Random Seed... Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started udev Coldplug all Devices. [ OK ] Started Load/Save Random Seed. [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Load Kernel Modules. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK [[ 10.384130] device-mapper: uevent: version 1.0.3 0m] Started Setu[ 10.389186] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com p Virtual Console. [ OK ] Started Monitoring of LVM2 mirrors,…sing dmeventd or progress polling. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Import network configuration from initramfs... Starting Tell Plymouth To Write Out Runtime Data... [ OK ] Started Tell Plymouth To Write Out Runtime Data. [ 10.999361] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 11.013188] igb 0000:07:00.0: DCA enabled [ 11.017211] igb 0000:07:00.1: DCA enabled [ 11.031347] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ OK ] Started Import network configuration from initramfs. Starting Create Volatile Files and Directories... [ 11.095281] power_meter ACPI000D:00: Found ACPI power meter. [ 11.100986] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 11.108059] IPMI message handler: version 39.2 [ 11.130287] ipmi device interface [ 11.153206] ipmi_si: IPMI System Interface driver [ 11.157997] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 11.164353] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 11.171569] ipmi_si: Adding SMBIOS-specified kcs state machine [ 11.177447] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 11.183387] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 11.183607] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 11.191625] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 11.205729] ipmi_si: Adding ACPI-specified kcs state machine [ 11.211457] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ OK ] Created slice system-lvm2\x2dpvscan.slice. [ 11.255394] input: PC Speaker as /devices/platform/pcspkr/input/input4 Startin[ 11.290034] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. g LVM event activation on device 259:0... [ 11.315909] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 11.361560] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 11.487468] ipmi_ssif: IPMI SSIF Interface driver [ 11.505516] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 11.513426] RAPL PMU: hw unit of domain package 2^-14 Joules [ 11.519084] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 11.524563] iTCO_vendor_support: vendor-support=0 [ 11.533326] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 [ 11.539404] iTCO_wdt: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 11.546905] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ OK ] Started LVM event activation on device 259:0. [ OK ] Started Create Volatile Files and Directories. [ 11.818341] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 11.845357] XFS (dm-4): Mounting V4 Filesystem [ 11.853963] XFS (dm-4): Ending clean mount Mounting RPC Pipe File System... Starting Security Auditing Service... Starting RPC Bind... [ OK ] Mounted /var/lib/ceph. [ OK ] Started RPC Bind. [ 12.139041] RPC: Registered named UNIX socket transport module. [ 12.144967] RPC: Registered udp transport module. [ 12.149693] RPC: Registered tcp transport module. [ 12.154411] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ 12.197226] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 12.208178] EDAC sbridge: Ver: 1.1.2 [ 12.363099] intel_rapl_common: Found RAPL domain package [ 12.368416] intel_rapl_common: Found RAPL domain dram [ 12.373467] intel_rapl_common: DRAM domain energy unit 15300pj [ OK ] Started Security Auditing Service. Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Reached target System Initialization. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting Restore /run/initramfs on shutdown... [ OK ] Started Machine Check Exception Logging Daemon. Starting VDO volume services... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. Starting NTP client/server... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowing… ceph*@.service instances at once. [ OK ] Reached target sshd-keygen.target. Starting Resets System Activity Logs... [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ OK ] Reached target User and Group Name Lookups. Starting Login Service... Starting Authorization Manager... [ OK ] Started Updates mlocate database every day. Starting Kernel Samepage Merging... [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Reached target Timers. Starting Self Monitoring and Reporting Technology (SMART) Daemon... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Kernel Samepage Merging. Starting Kernel Samepage Merging (KSM) Tuning Daemon... [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Started Resets System Activity Logs. [ OK ] Started Kernel Samepage Merging (KSM) Tuning Daemon. [ OK ] Started Login Service. [ OK ] Started NTP client/server. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting Dynamic System Tuning Daemon... Starting OpenSSH server daemon... Starting GSSAPI Proxy Daemon... Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Started OpenSSH server daemon. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Authorization Manager. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Job spooling tools. [ OK ] Started Command Scheduler. [ 17.069750] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 17.126125] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 17.133874] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 17.191134] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 17.198494] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 17.240846] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 17.351974] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 17.359555] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 17.401774] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 17.511956] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 17.627581] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ 17.831160] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 17.839014] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started VDO volume services. [ OK ] Started Dynamic System Tuning Daemon. [* ] A start job is running for Network …nager Wait Online (14s / no limit) [** ] A start job is running for Network …nager Wait Online (14s / no limit) [*** ] A start job is running for Network …nager Wait Online (15s / no limit) [ *** ] A start job is running for Network …nager Wait Online (15s / no limit) [ *** ] A start job is running for Network …nager Wait Online (16s / no limit) [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. [ OK ] Started Nagios Remote Plugin Executor. Starting Notify NFS peers of a restart... Starting System Logging Service... Starting Crash recovery kernel arming... Starting /etc/rc.d/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.72 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. + '[' 172.21.15.72 '!=' '' ']' + set -e + '[' -n 172.21.15.72 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.72 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.72 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi072.front.sepia.ceph.com + '[' -n smithi072.front.sepia.ceph.com ']' + hostname smithi072.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi072 + echo smithi072 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.72 smithi072.front.sepia.ceph.com smithi072/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T11:16:23.727 DEBUG:teuthology.orchestra.console.smithi072:expect after: smithi072 login: 2024-04-26T11:16:23.781 DEBUG:teuthology.orchestra.console.smithi072:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctnter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F B7 65 GUID: 00000000 0000 0000 0000 0CC47AD8DAF4 DHCP./                    DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ CLIENT IP: 172.21.15.72 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:b7:65)... Configuring (net0 0c:c4:7a:8f:b7:65).... Configuring (net0 0c:c4:7a:8f:b7:65)..... Configuring (net0 0c:c4:7a:8f:b7:65)...... ok [?25l20;7HUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (4.18.0-552.el8.x86_64) 8  CentOS Stream (4.18.0-489.el8.x86_64) 8  CentOS Stream (4.18.0-348.el8.x86_64) 8  CentOS Stream (0-rescue-a1b29d6c289747bdb22930598d39874a) 8              The selected entry will be started automatically in 5s.   CentOS Stream (4.18.0-552.el8.x86_64) 8   CentOS Stream (4.18.0-489.el8.x86_64) 8  CentOS Stream (4.18.0-348.el8.x86_64) 8  CentOS Stream (0-rescue-a1b29d6c289747bdb22930598d39874a) 8            Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a comm The selected entry will be started automatically in 4s. and prompt.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       Probing EDD (edd=off to disabl [ 0.000000] Linux version 4.18.0-552.el8.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-21) (GCC)) #1 SMP Sun Apr 7 19:39:51 UTC 2024 [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-552.el8.x86_64 root=UUID=c5236ddf-553d-41ea-8bce-5708f99a0430 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078e70fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f23000-0x00000000798acfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ad000-0x0000000079d49fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4a000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.994 MHz processor [ 0.000000] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0x78e71 max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.000000] Using GB pages for direct mapping [ 0.000000] RAMDISK: [mem 0x34b91000-0x365c0fff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.000000] ACPI: XSDT 0x00000000798AD098 0000B4 (v01 01072009 AMI 00010013) [ 0.000000] ACPI: FACP 0x00000000798E05B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: DSDT 0x00000000798AD1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.000000] ACPI: FACS 0x0000000079D48F80 000040 [ 0.000000] ACPI: APIC 0x00000000798E06C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FPDT 0x00000000798E0788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FIDT 0x00000000798E07D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: SPMI 0x00000000798E0870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.000000] ACPI: MCFG 0x00000000798E08B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.000000] ACPI: UEFI 0x00000000798E08F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.000000] ACPI: HPET 0x00000000798E0938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: WDDT 0x00000000798E0970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.000000] ACPI: SSDT 0x00000000798E09B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798F7B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798FA180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.000000] ACPI: PRAD 0x00000000798FA1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.000000] ACPI: DMAR 0x00000000798FA2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: HEST 0x00000000798FA3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 0x00000000798FA630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 0x00000000798FA660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 0x00000000798FA890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0x798e05b0-0x798e06bb] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0x798ad1e8-0x798e05ab] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0x79d48f80-0x79d48fbf] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0x798e06c0-0x798e0787] [ 0.000000] ACPI: Reserving FPDT table memory at [mem 0x798e0788-0x798e07cb] [ 0.000000] ACPI: Reserving FIDT table memory at [mem 0x798e07d0-0x798e086b] [ 0.000000] ACPI: Reserving SPMI table memory at [mem 0x798e0870-0x798e08af] [ 0.000000] ACPI: Reserving MCFG table memory at [mem 0x798e08b0-0x798e08eb] [ 0.000000] ACPI: Reserving UEFI table memory at [mem 0x798e08f0-0x798e0931] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0x798e0938-0x798e096f] [ 0.000000] ACPI: Reserving WDDT table memory at [mem 0x798e0970-0x798e09af] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798e09b0-0x798f7b2e] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798f7b30-0x798fa17b] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798fa180-0x798fa1e3] [ 0.000000] ACPI: Reserving PRAD table memory at [mem 0x798fa1e8-0x798fa2e9] [ 0.000000] ACPI: Reserving DMAR table memory at [mem 0x798fa2f0-0x798fa3ab] [ 0.000000] ACPI: Reserving HEST table memory at [mem 0x798fa3b0-0x798fa62b] [ 0.000000] ACPI: Reserving BERT table memory at [mem 0x798fa630-0x798fa65f] [ 0.000000] ACPI: Reserving ERST table memory at [mem 0x798fa660-0x798fa88f] [ 0.000000] ACPI: Reserving EINJ table memory at [mem 0x798fa890-0x798fa9bf] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.000000] Using crashkernel=auto, the size chosen is a best effort estimation. [ 0.000000] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32653MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.000000] node 0: [mem 0x0000000000100000-0x0000000078e70fff] [ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Zeroed struct page in unavailable ranges: 29189 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.000000] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78e71000-0x78f22fff] [ 0.000000] PM: Registered nosave memory: [mem 0x78f23000-0x798acfff] [ 0.000000] PM: Registered nosave memory: [mem 0x798ad000-0x79d49fff] [ 0.000000] PM: Registered nosave memory: [mem 0x79d4a000-0x8fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.000000] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 8228663 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-552.el8.x86_64 root=UUID=c5236ddf-553d-41ea-8bce-5708f99a0430 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] software IO TLB: area num 8. [ 0.000000] Memory: 1756420K/33437676K available (14339K kernel code, 5957K rwdata, 8568K rodata, 2820K init, 13792K bss, 935740K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.000000] Kernel/User page tables isolation: enabled [ 0.000000] ftrace: allocating 41053 entries in 161 pages [ 0.000000] ftrace: allocated 161 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.000000] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.000000] random: crng done (trusting CPU's manufacturer) [ 0.001000] Console: colour VGA+ 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 0.001000] APIC: Switch to symmetric I/O mode setup [ 0.001003] DMAR: Host address width 46 [ 0.002001] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 0.003005] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 0.004001] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 0.005002] DMAR: ATSR flags: 0x0 [ 0.006001] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 0.007002] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 0.008001] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 0.009001] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 0.010001] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 0.010002] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 0.013035] DMAR-IR: Enabled IRQ remapping in xapic mode [ 0.014000] x2apic: IRQ remapping doesn't support X2APIC mode [ 0.014475] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.019001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32734b4358f, max_idle_ns: 440795367814 ns [ 0.020001] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.98 BogoMIPS (lpj=3499994) [ 0.021000] pid_max: default: 32768 minimum: 301 [ 0.022022] LSM: Security Framework initializing [ 0.023007] Yama: becoming mindful. [ 0.024004] SELinux: Initializing. [ 0.025020] LSM support for eBPF active [ 0.030410] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, vmalloc) [ 0.033680] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, vmalloc) [ 0.034077] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.035071] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.036207] CPU0: Thermal monitoring enabled (TM1) [ 0.037055] process: using mwait in idle threads [ 0.038002] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 0.039000] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 0.040003] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.041001] Spectre V2 : Mitigation: Retpolines [ 0.042000] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.043000] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 0.044000] Speculative Store Bypass: Vulnerable [ 0.045005] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.046000] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.047000] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.058805] Freeing SMP alternatives memory: 36K [ 0.059186] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 0.162565] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 0.164097] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 0.165001] ... version: 3 [ 0.166000] ... bit width: 48 [ 0.167000] ... generic registers: 4 [ 0.168000] ... value mask: 0000ffffffffffff [ 0.169000] ... max period: 00007fffffffffff [ 0.170000] ... fixed-purpose events: 3 [ 0.171000] ... event mask: 000000070000000f [ 0.172028] rcu: Hierarchical SRCU implementation. [ 0.174051] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 0.175014] smp: Bringing up secondary CPUs ... [ 0.176069] x86: Booting SMP configuration: [ 0.177001] .... node #0, CPUs: #1 #2 #3 #4 [ 0.180094] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 0.182000] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 0.183001] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 0.184090] #5 #6 #7 [ 0.185533] smp: Brought up 1 node, 8 CPUs [ 0.187001] smpboot: Max logical packages: 1 [ 0.188001] smpboot: Total of 8 processors activated (55999.90 BogoMIPS) [ 0.225020] node 0 deferred pages initialised in 35ms [ 0.231230] devtmpfs: initialized [ 0.232041] x86/mm: Memory block size: 128MB [ 0.235711] ACPI: PM: Registering ACPI NVS region [mem 0x798ad000-0x79d49fff] (4837376 bytes) [ 0.244082] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.254008] futex hash table entries: 2048 (order: 5, 131072 bytes, vmalloc) [ 0.261058] pinctrl core: initialized pinctrl subsystem [ 0.266114] NET: Registered protocol family 16 [ 0.271060] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 0.278012] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.286009] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.294018] audit: initializing netlink subsys (disabled) [ 0.299009] audit: type=2000 audit(1714130147.299:1): state=initialized audit_enabled=0 res=1 [ 0.308002] cpuidle: using governor menu [ 0.311029] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.319001] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.326051] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 0.335001] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 0.342014] PCI: Using configuration type 1 for base access [ 0.349011] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.355002] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.362022] cryptd: max_cpu_qlen set to 1000 [ 0.366047] ACPI: Added _OSI(Module Device) [ 0.371001] ACPI: Added _OSI(Processor Device) [ 0.375004] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.380001] ACPI: Added _OSI(Processor Aggregator Device) [ 0.410782] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 0.419666] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 0.428086] ACPI: Dynamic OEM Table Load: [ 0.445620] ACPI: Interpreter enabled [ 0.449009] ACPI: PM: (supports S0 S4 S5) [ 0.453000] ACPI: Using IOAPIC for interrupt routing [ 0.460542] HEST: Enabling Firmware First mode for corrected errors. [ 0.467074] HEST: Table parsing has been initialized. [ 0.472135] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 0.480002] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.489545] ACPI: Enabled 5 GPEs in block 00 to 3F [ 0.517514] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 0.524003] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.534223] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.543418] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.551001] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.560030] PCI host bridge to bus 0000:ff [ 0.564001] pci_bus 0000:ff: root bus resource [bus ff] [ 0.569009] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 0.575043] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 0.581017] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 0.587033] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 0.593035] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 0.599032] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 0.605031] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 0.611031] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 0.618032] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 0.624030] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 0.630032] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 0.636030] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 0.642030] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 0.648031] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 0.654031] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 0.660025] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 0.666031] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 0.672030] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 0.678030] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 0.684022] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 0.690038] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 0.696059] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 0.702042] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 0.708042] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 0.714041] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 0.720043] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 0.726031] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 0.732033] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 0.738034] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 0.744042] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 0.750042] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 0.756041] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 0.762042] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 0.768025] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 0.774033] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 0.781032] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 0.787035] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 0.793044] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 0.799042] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 0.805043] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 0.811044] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 0.817031] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 0.823032] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 0.829033] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 0.835038] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 0.841026] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 0.847033] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 0.853032] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 0.859035] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 0.865017] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 0.871032] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 0.877033] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 0.883028] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 0.889035] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 0.895033] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 0.903855] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 0.910002] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.919140] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.927250] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.935001] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.944016] PCI host bridge to bus 0000:00 [ 0.948002] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.955001] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 0.962000] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.969000] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 0.976000] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 0.984001] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 0.991001] pci_bus 0000:00: root bus resource [bus 00-fe] [ 0.997024] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 1.003096] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 1.009042] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.015089] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 1.021041] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.027085] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 1.033041] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.040078] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 1.046007] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.052078] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 1.059008] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 1.065072] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 1.071008] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 1.078081] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 1.084007] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 1.091078] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 1.097007] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.104077] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 1.110007] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 1.117077] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 1.123004] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 1.130078] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 1.136007] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 1.143063] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 1.149048] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 1.155085] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 1.161057] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 1.167005] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 1.173074] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 1.179157] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 1.185011] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 1.191006] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 1.196006] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 1.202005] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 1.208006] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 1.213006] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 1.219028] pci 0000:00:11.4: PME# supported from D3hot [ 1.225036] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 1.231013] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 1.238049] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.243087] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 1.250014] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 1.256029] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.262059] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 1.269013] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 1.275050] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.281069] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 1.288013] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 1.294042] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.300078] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 1.306067] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.312077] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 1.318041] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.324076] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 1.331066] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.337080] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 1.343013] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 1.349073] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.355074] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 1.361100] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 1.367010] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 1.373005] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 1.379005] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 1.384005] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 1.390005] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 1.395005] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 1.402024] pci 0000:00:1f.2: PME# supported from D3hot [ 1.407062] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 1.413013] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 1.420015] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 1.425154] acpiphp: Slot [1] registered [ 1.429014] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.434082] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 1.440009] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 1.447015] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 1.454003] pci 0000:02:00.0: enabling Extended Tags [ 1.459076] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.464002] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.471121] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 1.477009] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.484004] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 1.490009] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.497004] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 1.504036] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.510016] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.517000] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.527008] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.534000] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.545083] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 1.551010] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.558004] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 1.564009] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.571004] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 1.578038] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.584013] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.591000] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.601008] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.609001] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.619081] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.624002] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.630001] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.637002] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.645028] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.650063] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 1.656065] pci 0000:05:00.0: enabling Extended Tags [ 1.661070] pci 0000:05:00.0: supports D1 D2 [ 1.665000] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.672090] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.677002] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.683002] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.690040] pci_bus 0000:06: extended config space not accessible [ 1.696024] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 1.702022] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 1.708012] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 1.714012] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 1.720096] pci 0000:06:00.0: supports D1 D2 [ 1.724001] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.731105] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.736007] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.742003] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.749081] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 1.755016] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 1.761018] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 1.767009] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 1.773075] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.779033] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.787001] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.797021] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.804000] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.814167] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 1.820017] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 1.827017] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 1.832009] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 1.839115] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.845034] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.852000] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.862014] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.870000] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.880086] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.885002] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.891002] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.898003] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.905467] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.911034] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.917037] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.923032] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.929044] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.935001] ACPI: PCI: Interrupt link LNKE disabled [ 1.940034] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.946000] ACPI: PCI: Interrupt link LNKF disabled [ 1.951024] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.957000] ACPI: PCI: Interrupt link LNKG disabled [ 1.962031] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.968000] ACPI: PCI: Interrupt link LNKH disabled [ 1.973012] iommu: Default domain type: Passthrough [ 1.978068] SCSI subsystem initialized [ 1.981015] ACPI: bus type USB registered [ 1.985013] usbcore: registered new interface driver usbfs [ 1.991006] usbcore: registered new interface driver hub [ 1.996007] usbcore: registered new device driver usb [ 2.001020] pps_core: LinuxPPS API ver. 1 registered [ 2.006000] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.015001] PTP clock support registered [ 2.019013] EDAC MC: Ver: 3.0.0 [ 2.023023] PCI: Using ACPI for IRQ routing [ 2.032022] NetLabel: Initializing [ 2.035000] NetLabel: domain hash size = 128 [ 2.040000] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.045013] NetLabel: unlabeled traffic allowed by default [ 2.051024] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.052000] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.066001] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.071000] vgaarb: loaded [ 2.074037] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.080000] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.088025] clocksource: Switched to clocksource tsc-early [ 2.103585] VFS: Disk quotas dquot_6.6.0 [ 2.107523] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.114451] pnp: PnP ACPI init [ 2.117838] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.123753] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.129664] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.135574] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.141485] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.147394] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.153307] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.159910] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.166515] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.173119] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.179722] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.186327] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.192931] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.199691] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.205601] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.211512] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.217423] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.223335] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.229922] pnp: PnP ACPI: found 5 devices [ 2.239402] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 2.248303] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 2.259771] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 2.267588] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.272547] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.277503] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.284285] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.291846] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.299750] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.307395] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.315384] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.322943] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.330847] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.338489] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.346481] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.354038] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.361943] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.369586] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.377579] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.385136] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.393040] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.400685] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.408676] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.413633] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.419717] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.426494] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.434226] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.439188] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.444151] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.450236] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.457028] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.462244] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.468331] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.475111] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 2.482850] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 2.490676] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 2.498414] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 2.506233] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.511197] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.517282] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.524058] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 2.531791] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 2.540827] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 2.546997] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 2.553168] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 2.560032] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 2.566896] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 2.573762] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 2.580627] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 2.586883] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 2.592446] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 2.598704] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.605916] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 2.611478] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.617737] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 2.623301] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.629559] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 2.635123] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 2.641380] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 2.648688] NET: Registered protocol family 2 [ 2.653239] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.662507] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, vmalloc) [ 2.671366] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.679766] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc) [ 2.687343] TCP: Hash tables configured (established 262144 bind 65536) [ 2.694057] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, vmalloc) [ 2.701806] UDP hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.708823] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.716291] NET: Registered protocol family 1 [ 2.720655] NET: Registered protocol family 44 [ 2.725174] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 2.744091] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x627 took 11437 usecs [ 2.763125] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x627 took 11354 usecs [ 2.770530] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 2.776979] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.785361] Unpacking initramfs... [ 3.059286] Freeing initrd memory: 26816K [ 3.063368] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.069804] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 3.077723] ACPI: bus type thunderbolt registered [ 3.083997] Initialise system trusted keyrings [ 3.088448] Key type blacklist registered [ 3.092483] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.100469] zbud: loaded [ 3.103313] pstore: using deflate compression [ 3.107846] Platform Keyring initialized [ 3.150118] NET: Registered protocol family 38 [ 3.154555] Key type asymmetric registered [ 3.158645] Asymmetric key parser 'x509' registered [ 3.163517] Running certificate verification selftests [ 3.193863] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 3.204741] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.212159] io scheduler mq-deadline registered [ 3.216688] io scheduler kyber registered [ 3.220725] io scheduler bfq registered [ 3.224625] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.231831] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.237732] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.243620] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.249490] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.255353] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.261217] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.267096] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.274388] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.282750] ACPI: Power Button [PWRB] [ 3.286437] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.293844] ACPI: Power Button [PWRF] [ 3.298593] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.306099] pstore: Registered erst as persistent store backend [ 3.312113] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.338961] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.366881] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.374528] Non-volatile memory driver v1.3 [ 3.379149] rdac: device handler registered [ 3.383391] hp_sw: device handler registered [ 3.387659] emc: device handler registered [ 3.391811] alua: device handler registered [ 3.396056] libphy: Fixed MDIO Bus: probed [ 3.400327] usbcore: registered new interface driver usbserial_generic [ 3.400422] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.406853] usbserial: USB Serial support registered for generic [ 3.412127] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 3.418088] i8042: PNP: No PS/2 controller found. [ 3.425464] ehci-pci 0000:00:1d.0: debug port 2 [ 3.430195] mousedev: PS/2 mouse device common for all mice [ 3.438590] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.440298] rtc_cmos 00:00: RTC can wake from S4 [ 3.450699] rtc_cmos 00:00: registered as rtc0 [ 3.452032] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.455150] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 3.460908] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.476782] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.483992] usb usb1: Product: EHCI Host Controller [ 3.488861] usb usb1: Manufacturer: Linux 4.18.0-552.el8.x86_64 ehci_hcd [ 3.495552] usb usb1: SerialNumber: 0000:00:1d.0 [ 3.500277] intel_pstate: Intel P-state driver initializing [ 3.500307] hub 1-0:1.0: USB hub found [ 3.509599] hub 1-0:1.0: 2 ports detected [ 3.513831] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.519095] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 3.526747] hid: raw HID events driver (C) Jiri Kosina [ 3.527568] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 3.531904] usbcore: registered new interface driver usbhid [ 3.541208] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.541214] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.541263] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 3.541264] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 3.541289] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.541290] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.541291] usb usb2: Product: xHCI Host Controller [ 3.541292] usb usb2: Manufacturer: Linux 4.18.0-552.el8.x86_64 xhci-hcd [ 3.541293] usb usb2: SerialNumber: 0000:00:14.0 [ 3.541425] hub 2-0:1.0: USB hub found [ 3.541450] hub 2-0:1.0: 15 ports detected [ 3.544634] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 4.18 [ 3.544637] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.544638] usb usb3: Product: xHCI Host Controller [ 3.544640] usb usb3: Manufacturer: Linux 4.18.0-552.el8.x86_64 xhci-hcd [ 3.544641] usb usb3: SerialNumber: 0000:00:14.0 [ 3.544746] hub 3-0:1.0: USB hub found [ 3.544761] hub 3-0:1.0: 6 ports detected [ 3.546566] usbhid: USB HID core driver [ 3.546647] drop_monitor: Initializing network drop monitor service [ 3.551837] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 4 [ 3.557060] Initializing XFRM netlink socket [ 3.417] ehci-pci 0000:00:1a.0: debug port 2 [ 3.570738] NET: Registered protocol family 10 [ 3.582813] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.586325] Segment Routing with IPv6 [ 3.597046] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.597731] NET: Registered protocol family 17 [ 3.602371] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.606144] mpls_gso: MPLS GSO support [ 3.610181] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.718952] usb usb4: Product: EHCI Host Controller [ 3.723822] usb usb4: Manufacturer: Linux 4.18.0-552.el8.x86_64 ehci_hcd [ 3.730512] usb usb4: SerialNumber: 0000:00:1a.0 [ 3.735253] hub 4-0:1.0: USB hub found [ 3.739051] hub 4-0:1.0: 2 ports detected [ 3.743104] microcode: Microcode Update Driver: v2.2. [ 3.743197] resctrl: L3 allocation detected [ 3.752423] resctrl: L3 monitoring detected [ 3.753013] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 3.756691] AVX2 version of gcm_enc/dec engaged. [ 3.767734] AES CTR mode by8 optimization enabled [ 3.782841] sched_clock: Marking stable (3782837986, 0)->(5655317774, -1872479788) [ 3.785005] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 3.797087] registered taskstats version 1 [ 3.801290] Loading compiled-in X.509 certificates [ 3.806381] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: b8c8c7a1297a11ed2e36e7913cdfd6f59248d125' [ 3.817265] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 3.829090] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 3.839708] zswap: loaded using pool lzo/zbud [ 3.844110] page_owner is disabled [ 3.850970] Key type big_key registered [ 3.856638] Key type encrypted registered [ 3.860652] ima: No TPM chip found, activating TPM-bypass! [ 3.866135] ima: Allocated hash algorithm: sha256 [ 3.870844] ima: No architecture policies found [ 3.875392] evm: Initialising EVM extended attributes: [ 3.880532] evm: security.selinux [ 3.883846] evm: security.ima [ 3.886810] evm: security.capability [ 3.890380] evm: HMAC attrs: 0x1 [ 3.893836] rtc_cmos 00:00: setting system clock to 2024-04-26 11:15:53 UTC (1714130153) [ 3.900423] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 3.910083] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.917449] hub 1-1:1.0: USB hub found [ 3.921297] hub 1-1:1.0: 8 ports detected [ 3.921473] Freeing unused decrypted memory: 2028K [ 3.923203] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 3.923206] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.923674] hub 2-12:1.0: USB hub found [ 3.923753] hub 2-12:1.0: 4 ports detected [ 3.954150] Freeing unused kernel image (initmem) memory: 2820K [ 3.960096] Write protecting the kernel read-only data: 26624k [ 3.966286] Freeing unused kernel image (text/rodata gap) memory: 2016K [ 3.973146] Freeing unused kernel image (rodata/data gap) memory: 1672K [ 3.989073] systemd[1]: systemd 239 (239-75.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 4.011465] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 4.030100] systemd[1]: Detected architecture x86-64. [ 4.035150] systemd[1]: Running in initial RAM disk. Welcome to CentOS Stream 8 dracut-049-224.git20230330.el8 (Initramfs)! [ 4.066061] systemd[1]: Set hostname to . [ 4.102735] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 4.115115] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 4.125184] systemd[1]: Listening on udev Control Socket. [ 4.127048] tsc: Refined TSC clocksource calibration: 3499.998 MHz [ 4.136767] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734efdd03, max_idle_ns: 440795244944 ns [ 4.136816] clocksource: Switched to clocksource tsc [ 4.146303] usb 4-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.159921] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ OK ] Listening on udev Control So[ 4.170552] hub 4-1:1.0: USB hub found cket. [ 4.175109] hub 4-1:1.0: 6 ports detected [ 4.179726] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 4.192006] systemd[1]: Starting Setup Virtual Console... Starting Setup Virtual Console... [ 4.203498] systemd[1]: Started Memstrack Anylazing Service. [ OK ] Started Memstrack Anylazing Service. Starting Load Kernel Modules... [ OK ] Reached target Swap. [ OK [[ 4.231231] fuse: init (API version 7.34) 0m] Reached target Timers. [ OK ] Reached target Local File Systems. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Listening on Journal Socket (/dev/log). [ OK ] Reached target Sockets. Starting Journal Service... Starting Create Volatile Files and Directories... [ OK ] Started Setup Virtual Console. [ OK ] Started Load Kernel Modules. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. Starting Create Static Device Nodes in /dev... Starting Apply Kernel Variables... Starting dracut cmdline hook... [ OK ] Started Journal Service. [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Apply Kernel Variables. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Reached target System Initialization. Starting dracut initqueue hook... Starting Show Plymouth Boot Screen... [ 4.559841] dca service started, version 1.12.1 [ 4.572373] nvme nvme0: pci function 0000:02:00.0 [ OK [[ 4.579866] nvme nvme0: 8/0/0 default/read/poll queues 0m] Started Show[ 4.585576] igb: Intel(R) Gigabit Ethernet Network Driver [ 4.586300] nvme0n1: detected capacity change from 0 to 400088457216 Plymouth Boot S[ 4.592109] igb: Copyright (c) 2007-2014 Intel Corporation. creen. [[0;32[ 4.605845] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode m OK ] Rea[ 4.614887] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst ched target Path[ 4.624335] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver s. [ O[ 4.631356] ixgbe: Copyright (c) 1999-2016 Intel Corporation. K ] Started[ 4.638781] ACPI: bus type drm_connector registered [ 4.643930] scsi host0: ahci Forward Passwor[ 4.647729] scsi host1: ahci [ 4.647816] scsi host2: ahci d Requests to Pl[ 4.654894] scsi host3: ahci ymouth Directory Watch. [ OK ] Re[ 4.659232] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 43 ached target Bas[ 4.659239] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 43 [ 4.659244] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 43 ic System. [ 4.659249] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 43 [ 4.659784] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 4.659788] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.663638] igb 0000:07:00.0: added PHC on eth0 [ 4.687313] scsi host4: ahci [ 4.695364] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 4.703636] scsi host5: ahci [ 4.711082] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:da:f4 [ 4.715714] scsi host6: ahci [ 4.718576] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 4.718680] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 4.718683] ast 0000:06:00.0: [drm] AST 2400 detected [ 4.718700] ast 0000:06:00.0: [drm] Using analog VGA [ 4.718709] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 4.718839] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 4.725506] scsi host7: ahci [ 4.728277] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.735556] scsi host8: ahci [ 4.787130] fbcon: astdrmfb (fb0) is primary device [ 4.787234] scsi host9: ahci [ 4.787271] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 [ 4.787274] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 [ 4.787276] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 [ 4.787278] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 [ 4.787279] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 [ 4.787281] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 [ 4.791438] igb 0000:07:00.1: added PHC on eth1 [ 4.791468] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 4.791469] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:da:f5 [ 4.791556] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 4.791557] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.792789] igb 0000:07:00.0 eno1: renamed from eth0 [ 4.836712] Console: switching to colour frame buffer device 128x48 [ 4.863989] igb 0000:07:00.1 eno2: renamed from eth1 [ 4.964305] ata2: SATA link down (SStatus 0 SControl 300) [ 4.968063] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 4.973048] ata4: SATA link down (SStatus 0 SControl 300) [ 4.990260] ata3: SATA link down (SStatus 0 SControl 300) [ 4.990294] ata1: SATA link down (SStatus 0 SControl 300) [ 5.097179] ata6: SATA link down (SStatus 0 SControl 300) [ 5.102595] ata7: SATA link down (SStatus 0 SControl 300) [ 5.108002] ata8: SATA link down (SStatus 0 SControl 300) [ 5.113411] ata9: SATA link down (SStatus 0 SControl 300) [ 5.118834] ata10: SATA link down (SStatus 0 SControl 300) [ 5.124347] ata5: SATA link up 3.0 Gbps (SStatus 123 SControl 300) [ 5.131538] ata5.00: ATA-7: HUA721010KLA330, GKAOA94A, max UDMA/133 [ 5.137803] ata5.00: sectors, multi 1), AA [ 5.140] ata5.00: configured for UDMA/133 [ 5.150397] scsi 4:0:0:0: Direct-Access ATA HUA721010KLA330 A94A PQ: 0 ANSI: 5 [ 5.162932] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.171971] sbyte logical blocks: (1.00 TB/932 GiB) [ 5.179631] sd 4:0:0:0: [sda] Write Protect is off [ 5.184440] sd 4:0:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA [ 5.206220] sda: sda1 [ 5.208801] sd 4:0:0:0: [sda] Attached SCSI disk [ 5.248083] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 5.358556] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 5.366983] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.379630] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ OK ] Found device HUA721010KLA330 1. [ OK ] Reached target Initrd Root Device. [ 5.443196] hneric 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 5.455652] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 5.467388] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.772228] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.782505] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 5.791026] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 5.797196] ixgbe 0000:03:00.0: 0c:c4:7a:8f:b7:64 [ 5.805019] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 5.811644] libphy: ixgbe-mdio: probed [ 5.972117] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.982387] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 5.990893] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 5.997938] ixgbe 0000:03:00.1: 0c:c4:7a:8f:b7:65 [ 6.005921] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.012505] libphy: ixgbe-mdio: probed [ 6.017122] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 6.031180] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting File System Check on /dev/…ddf-553d-41ea-8bce-5708f99a0430... [ OK ] Started File System Check on /dev/d…36ddf-553d-41ea-8bce-5708f99a0430. Mounting /sysroot... [ 6.214392] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Starting Setup Virtual Console... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Sockets. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped target Paths. [ OK ] Stopped target System Initialization. Stopping udev Kernel Device Manager... [ OK ] Stopped target Swap. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped target Slices. Starting Plymouth switch root service... [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Started Setup Virtual Console. [ OK ] Reached target Switch Root. [ OK ] Started Plymouth switch root service. Starting Switch Root... [ 6.732122] printk: systemd: 19 output lines suppressed due to ratelimiting [ 7.725584] SELinux: policy capability network_peer_controls=1 [ 7.731505] SELinux: policy capability open_perms=1 [ 7.736468] SELinux: policy capability extended_socket_class=1 [ 7.742377] SELinux: policy capability always_check_network=0 [ 7.748202] SELinux: policy capability cgroup_seclabel=1 [ 7.753590] SELinux: policy capability nnp_nosuid_transition=1 [ 7.781128] audit: type=1403 audit(1714130157.386:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 7.782950] systemd[1]: Successfully loaded SELinux policy in 301.952ms. [ 7.894344] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 19.984ms. [ 7.925056] systemd[1]: systemd 239 (239-75.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 7.959131] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 8! [ 7.992058] systemd[1]: Set hostname to . [ 9.698931] systemd[1]: initrd-switch-root.service: Succeeded. [ 9.705004] systemd[1]: Stopped Switch Root. [ OK [[ 9.709694] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. 0m] Stopped Swit[ 9.721318] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. ch Root. [ 9.731606] systemd[1]: Stopped Journal Service. [ OK [[ 9.737789] systemd[1]: Starting Journal Service... 0m] Stopped Jour[ 9.744417] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. nal Service. Starting Journal Service... [ OK ] Set up automount Arbitrary Executab…rmats File System Automount Point. [ OK ] Listening on udev Control Socket. [ OK ] Created slice system-sshd\x2dkeygen.slice. Mounting Kernel Debug File System... Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Listening on udev Kernel Socket. Starting udev Coldplug all Devices... [ OK ] Listening on Process Core Dump Socket. Mounting POSIX Message Queue File System... [ OK ] Reached target ceph target allowing…ph-mon@.service instances at once. [ OK ] Reached target ceph target allowing…ph-osd@.service instances at once. [ OK ] Reached target ceph target allowing…ph-mds@.service instances at once. [ OK ] Reached target ceph target allowing…ph-mgr@.service instances at once. [ OK ] Reached target Swap. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Created slice system-getty.slice. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Listening on Device-mapper event daemon FIFOs. Starting Monitoring of LVM2 mirrors…ng dmeventd or progress polling... [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. Starting Setup Virtual Console... Mounting Huge Pages File System... Starting Remount Root and Kernel File Systems... [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target Paths. [ OK ] Reached target ceph target allowing…adosgw@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK [ 9.942588] EXT4-fs (sda1): re-mounted. Opts: (null) [0m] Created slice User and Session Slice. [ OK ] Reached target Slices. [ OK ] Reached target ceph target allowing…mirror@.service instances at once. [ OK ] Listening on initctl Compatibility Named Pipe. Starting Create list of required st…ce nodes for the current kernel... Starting Load Kernel Modules... [ OK ] Started Journal Service. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Huge Pages File System. [ OK ] Started Remount Root and Kernel File Systems. [ OK ] Started Create list of required sta…vice nodes for the current kernel. Starting Load/Save Random Seed... Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started udev Coldplug all Devices. [ OK ] Started Load/Save Random Seed. [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Load Kernel Modules. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK [[ 10.384130] device-mapper: uevent: version 1.0.3 0m] Started Setu[ 10.389186] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com p Virtual Console. [ OK ] Started Monitoring of LVM2 mirrors,…sing dmeventd or progress polling. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Import network configuration from initramfs... Starting Tell Plymouth To Write Out Runtime Data... [ OK ] Started Tell Plymouth To Write Out Runtime Data. [ 10.999361] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 11.013188] igb 0000:07:00.0: DCA enabled [ 11.017211] igb 0000:07:00.1: DCA enabled [ 11.031347] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ OK ] Started Import network configuration from initramfs. Starting Create Volatile Files and Directories... [ 11.095281] power_meter ACPI000D:00: Found ACPI power meter. [ 11.100986] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 11.108059] IPMI message handler: version 39.2 [ 11.130287] ipmi device interface [ 11.153206] ipmi_si: IPMI System Interface driver [ 11.157997] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 11.164353] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 11.171569] ipmi_si: Adding SMBIOS-specified kcs state machine [ 11.177447] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 11.183387] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 11.183607] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 11.191625] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 11.205729] ipmi_si: Adding ACPI-specified kcs state machine [ 11.211457] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ OK ] Created slice system-lvm2\x2dpvscan.slice. [ 11.255394] input: PC Speaker as /devices/platform/pcspkr/input/input4 Startin[ 11.290034] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. g LVM event activation on device 259:0... [ 11.315909] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 11.361560] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 11.487468] ipmi_ssif: IPMI SSIF Interface driver [ 11.505516] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 11.513426] RAPL PMU: hw unit of domain package 2^-14 Joules [ 11.519084] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 11.524563] iTCO_vendor_support: vendor-support=0 [ 11.533326] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 [ 11.539404] iTCO_wdt: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 11.546905] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ OK ] Started LVM event activation on device 259:0. [ OK ] Started Create Volatile Files and Directories. [ 11.818341] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 11.845357] XFS (dm-4): Mounting V4 Filesystem [ 11.853963] XFS (dm-4): Ending clean mount Mounting RPC Pipe File System... Starting Security Auditing Service... Starting RPC Bind... [ OK ] Mounted /var/lib/ceph. [ OK ] Started RPC Bind. [ 12.139041] RPC: Registered named UNIX socket transport module. [ 12.144967] RPC: Registered udp transport module. [ 12.149693] RPC: Registered tcp transport module. [ 12.154411] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ 12.197226] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 12.208178] EDAC sbridge: Ver: 1.1.2 [ 12.363099] intel_rapl_common: Found RAPL domain package [ 12.368416] intel_rapl_common: Found RAPL domain dram [ 12.373467] intel_rapl_common: DRAM domain energy unit 15300pj [ OK ] Started Security Auditing Service. Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Reached target System Initialization. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting Restore /run/initramfs on shutdown... [ OK ] Started Machine Check Exception Logging Daemon. Starting VDO volume services... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. Starting NTP client/server... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowing… ceph*@.service instances at once. [ OK ] Reached target sshd-keygen.target. Starting Resets System Activity Logs... [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ OK ] Reached target User and Group Name Lookups. Starting Login Service... Starting Authorization Manager... [ OK ] Started Updates mlocate database every day. Starting Kernel Samepage Merging... [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Reached target Timers. Starting Self Monitoring and Reporting Technology (SMART) Daemon... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Kernel Samepage Merging. Starting Kernel Samepage Merging (KSM) Tuning Daemon... [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Started Resets System Activity Logs. [ OK ] Started Kernel Samepage Merging (KSM) Tuning Daemon. [ OK ] Started Login Service. [ OK ] Started NTP client/server. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting Dynamic System Tuning Daemon... Starting OpenSSH server daemon... Starting GSSAPI Proxy Daemon... Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Started OpenSSH server daemon. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Authorization Manager. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Permit User Sessions. [ OK ] Started Job spooling tools. [ OK ] Started Command Scheduler. [ 17.069750] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 17.126125] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 17.133874] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 17.191134] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 17.198494] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 17.240846] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 17.351974] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 17.359555] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 17.401774] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 17.511956] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 17.627581] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ 17.831160] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 17.839014] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started VDO volume services. [ OK ] Started Dynamic System Tuning Daemon. [* ] A start job is running for Network …nager Wait Online (14s / no limit) [** ] A start job is running for Network …nager Wait Online (14s / no limit) [*** ] A start job is running for Network …nager Wait Online (15s / no limit) [ *** ] A start job is running for Network …nager Wait Online (15s / no limit) [ *** ] A start job is running for Network …nager Wait Online (16s / no limit) [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. [ OK ] Started Nagios Remote Plugin Executor. Starting Notify NFS peers of a restart... Starting System Logging Service... Starting Crash recovery kernel arming... Starting /etc/rc.d/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.72 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. + '[' 172.21.15.72 '!=' '' ']' + set -e + '[' -n 172.21.15.72 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.72 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.72 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi072.front.sepia.ceph.com + '[' -n smithi072.front.sepia.ceph.com ']' + hostname smithi072.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi072 + echo smithi072 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.72 smithi072.front.sepia.ceph.com smithi072/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi072 login: [disconnect] 2024-04-26T11:16:23.883 INFO:teuthology.misc:Re-opening connections... 2024-04-26T11:16:23.883 INFO:teuthology.misc:trying to connect to ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T11:16:23.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-26T11:16:23.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:16:24.898 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~146s 2024-04-26T11:16:25.142 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-04-26T11:16:26.365 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-26T11:16:26.365 DEBUG:teuthology.misc:waited 2.4818925857543945 2024-04-26T11:16:27.366 DEBUG:tasks.ceph_manager:Mounting data for osd.0 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T11:16:27.366 INFO:tasks.ceph_manager:Mounting osd.0: dev: ubuntu@smithi072.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-0, type: xfs, options: ['noatime'] 2024-04-26T11:16:27.366 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T11:16:27.525 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T11:16:27.640 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T11:16:27.640 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T11:16:27.642 INFO:tasks.ceph.osd.0:Started 2024-04-26T11:16:27.642 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:16:28.028 INFO:teuthology.orchestra.run.smithi072.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-26T11:16:28.030 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T11:16:28.031 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-04-26T11:16:29.682 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:16:29.680+0000 7fd9d80e9800 -1 Falling back to public interface 2024-04-26T11:16:30.809 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-26T11:16:33.031 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:16:33.153 INFO:teuthology.orchestra.run.smithi072.stderr:no valid command found; 10 closest matches: 2024-04-26T11:16:33.154 INFO:teuthology.orchestra.run.smithi072.stderr:0 2024-04-26T11:16:33.154 INFO:teuthology.orchestra.run.smithi072.stderr:1 2024-04-26T11:16:33.154 INFO:teuthology.orchestra.run.smithi072.stderr:2 2024-04-26T11:16:33.154 INFO:teuthology.orchestra.run.smithi072.stderr:abort 2024-04-26T11:16:33.154 INFO:teuthology.orchestra.run.smithi072.stderr:assert 2024-04-26T11:16:33.154 INFO:teuthology.orchestra.run.smithi072.stderr:config diff 2024-04-26T11:16:33.154 INFO:teuthology.orchestra.run.smithi072.stderr:config diff get 2024-04-26T11:16:33.154 INFO:teuthology.orchestra.run.smithi072.stderr:config get 2024-04-26T11:16:33.154 INFO:teuthology.orchestra.run.smithi072.stderr:config help [] 2024-04-26T11:16:33.154 INFO:teuthology.orchestra.run.smithi072.stderr:config set ... 2024-04-26T11:16:33.154 INFO:teuthology.orchestra.run.smithi072.stderr:admin_socket: invalid command 2024-04-26T11:16:33.155 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T11:16:33.156 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-04-26T11:16:34.325 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:16:34.323+0000 7fd9d80e9800 -1 osd.0 25 log_to_monitors true 2024-04-26T11:16:34.911 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:16:34.909+0000 7fd9c4064700 -1 osd.0 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T11:16:38.157 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:16:38.297 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:16:38.298 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:16:38.298 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:16:38.298 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:16:38.307 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T11:16:38.867 INFO:teuthology.orchestra.run.smithi029.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T11:16:38.879 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T11:16:39.872 INFO:teuthology.orchestra.run.smithi029.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T11:16:39.886 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T11:16:40.878 INFO:teuthology.orchestra.run.smithi029.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T11:16:40.891 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T11:16:40.892 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:16:41.244 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:16:41.246 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:16:41.255 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-04-26T11:16:40.870395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":3,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":216,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":722376,"kb_used_data":3428,"kb_used_omap":10,"kb_used_meta":718901,"kb_avail":282393144,"statfs":{"total":289910292480,"available":289170579456,"internally_reserved":0,"allocated":3510272,"data_stored":2046594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10252,"internal_metadata":736155636},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":3,"num_objects_degraded":-20,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.363952"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.851235+0000","last_change":"2024-04-26T11:13:12.919196+0000","last_active":"2024-04-26T11:16:34.851235+0000","last_peered":"2024-04-26T11:16:34.851235+0000","last_clean":"2024-04-26T11:16:34.851235+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:16:34.851235+0000","last_undegraded":"2024-04-26T11:16:34.851235+0000","last_fullsized":"2024-04-26T11:16:34.851235+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850200+0000","last_change":"2024-04-26T11:13:12.917670+0000","last_active":"2024-04-26T11:16:34.850200+0000","last_peered":"2024-04-26T11:16:34.850200+0000","last_clean":"2024-04-26T11:16:34.850200+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:16:34.850200+0000","last_undegraded":"2024-04-26T11:16:34.850200+0000","last_fullsized":"2024-04-26T11:16:34.850200+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.870181+0000","last_change":"2024-04-26T11:16:36.866575+0000","last_active":"2024-04-26T11:16:36.870181+0000","last_peered":"2024-04-26T11:16:36.870181+0000","last_clean":"2024-04-26T11:16:36.870181+0000","last_became_active":"2024-04-26T11:16:36.864565+0000","last_became_peered":"2024-04-26T11:16:36.864565+0000","last_unstale":"2024-04-26T11:16:36.870181+0000","last_undegraded":"2024-04-26T11:16:36.870181+0000","last_fullsized":"2024-04-26T11:16:36.870181+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:38.756428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871248+0000","last_change":"2024-04-26T11:16:36.868086+0000","last_active":"2024-04-26T11:16:36.871248+0000","last_peered":"2024-04-26T11:16:36.871248+0000","last_clean":"2024-04-26T11:16:36.871248+0000","last_became_active":"2024-04-26T11:16:36.865679+0000","last_became_peered":"2024-04-26T11:16:36.865679+0000","last_unstale":"2024-04-26T11:16:36.871248+0000","last_undegraded":"2024-04-26T11:16:36.871248+0000","last_fullsized":"2024-04-26T11:16:36.871248+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:22.051599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849437+0000","last_change":"2024-04-26T11:13:12.917403+0000","last_active":"2024-04-26T11:16:34.849437+0000","last_peered":"2024-04-26T11:16:34.849437+0000","last_clean":"2024-04-26T11:16:34.849437+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:16:34.849437+0000","last_undegraded":"2024-04-26T11:16:34.849437+0000","last_fullsized":"2024-04-26T11:16:34.849437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:42.014955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871352+0000","last_change":"2024-04-26T11:16:36.868338+0000","last_active":"2024-04-26T11:16:36.871352+0000","last_peered":"2024-04-26T11:16:36.871352+0000","last_clean":"2024-04-26T11:16:36.871352+0000","last_became_active":"2024-04-26T11:16:36.867049+0000","last_became_peered":"2024-04-26T11:16:36.867049+0000","last_unstale":"2024-04-26T11:16:36.871352+0000","last_undegraded":"2024-04-26T11:16:36.871352+0000","last_fullsized":"2024-04-26T11:16:36.871352+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:57.262622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.864496+0000","last_change":"2024-04-26T11:16:36.860337+0000","last_active":"2024-04-26T11:16:36.864496+0000","last_peered":"2024-04-26T11:16:36.864496+0000","last_clean":"2024-04-26T11:16:36.864496+0000","last_became_active":"2024-04-26T11:16:36.859342+0000","last_became_peered":"2024-04-26T11:16:36.859342+0000","last_unstale":"2024-04-26T11:16:36.864496+0000","last_undegraded":"2024-04-26T11:16:36.864496+0000","last_fullsized":"2024-04-26T11:16:36.864496+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:23.653811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.870476+0000","last_change":"2024-04-26T11:16:36.863996+0000","last_active":"2024-04-26T11:16:36.870476+0000","last_peered":"2024-04-26T11:16:36.870476+0000","last_clean":"2024-04-26T11:16:36.870476+0000","last_became_active":"2024-04-26T11:16:36.863048+0000","last_became_peered":"2024-04-26T11:16:36.863048+0000","last_unstale":"2024-04-26T11:16:36.870476+0000","last_undegraded":"2024-04-26T11:16:36.870476+0000","last_fullsized":"2024-04-26T11:16:36.870476+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:42.503116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":47,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T11:16:35.853449+0000","last_change":"2024-04-26T11:14:08.592223+0000","last_active":"2024-04-26T11:16:35.853449+0000","last_peered":"2024-04-26T11:16:35.853449+0000","last_clean":"2024-04-26T11:16:35.853449+0000","last_became_active":"2024-04-26T11:14:08.591660+0000","last_became_peered":"2024-04-26T11:14:08.591660+0000","last_unstale":"2024-04-26T11:16:35.853449+0000","last_undegraded":"2024-04-26T11:16:35.853449+0000","last_fullsized":"2024-04-26T11:16:35.853449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:06.208634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850628+0000","last_change":"2024-04-26T11:13:12.918521+0000","last_active":"2024-04-26T11:16:34.850628+0000","last_peered":"2024-04-26T11:16:34.850628+0000","last_clean":"2024-04-26T11:16:34.850628+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:16:34.850628+0000","last_undegraded":"2024-04-26T11:16:34.850628+0000","last_fullsized":"2024-04-26T11:16:34.850628+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":2,"reported_epoch":69,"state":"peering","last_fresh":"2024-04-26T11:14:08.583071+0000","last_change":"2024-04-26T11:13:42.306377+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:14:08.583071+0000","last_undegraded":"2024-04-26T11:14:08.583071+0000","last_fullsized":"2024-04-26T11:14:08.583071+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:54.379763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.852956+0000","last_change":"2024-04-26T11:16:35.854908+0000","last_active":"2024-04-26T11:16:35.852956+0000","last_peered":"2024-04-26T11:16:34.850106+0000","last_clean":"2024-04-26T11:13:54.340528+0000","last_became_active":"2024-04-26T11:13:58.346341+0000","last_became_peered":"2024-04-26T11:13:58.346341+0000","last_unstale":"2024-04-26T11:16:35.852956+0000","last_undegraded":"2024-04-26T11:16:35.852956+0000","last_fullsized":"2024-04-26T11:16:35.852956+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:56.481301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849691+0000","last_change":"2024-04-26T11:13:12.915484+0000","last_active":"2024-04-26T11:16:34.849691+0000","last_peered":"2024-04-26T11:16:34.849691+0000","last_clean":"2024-04-26T11:16:34.849691+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:16:34.849691+0000","last_undegraded":"2024-04-26T11:16:34.849691+0000","last_fullsized":"2024-04-26T11:16:34.849691+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.869304+0000","last_change":"2024-04-26T11:16:36.865308+0000","last_active":"2024-04-26T11:16:36.869304+0000","last_peered":"2024-04-26T11:16:36.869304+0000","last_clean":"2024-04-26T11:16:36.869304+0000","last_became_active":"2024-04-26T11:16:36.864119+0000","last_became_peered":"2024-04-26T11:16:36.864119+0000","last_unstale":"2024-04-26T11:16:36.869304+0000","last_undegraded":"2024-04-26T11:16:36.869304+0000","last_fullsized":"2024-04-26T11:16:36.869304+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:29.265536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":2,"reported_epoch":69,"state":"peering","last_fresh":"2024-04-26T11:13:43.317311+0000","last_change":"2024-04-26T11:13:42.309392+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:43.317311+0000","last_undegraded":"2024-04-26T11:13:43.317311+0000","last_fullsized":"2024-04-26T11:13:43.317311+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:45.107551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871462+0000","last_change":"2024-04-26T11:16:36.868941+0000","last_active":"2024-04-26T11:16:36.871462+0000","last_peered":"2024-04-26T11:16:36.871462+0000","last_clean":"2024-04-26T11:16:36.871462+0000","last_became_active":"2024-04-26T11:16:36.864605+0000","last_became_peered":"2024-04-26T11:16:36.864605+0000","last_unstale":"2024-04-26T11:16:36.871462+0000","last_undegraded":"2024-04-26T11:16:36.871462+0000","last_fullsized":"2024-04-26T11:16:36.871462+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:26.687980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850921+0000","last_change":"2024-04-26T11:14:08.592349+0000","last_active":"2024-04-26T11:16:34.850921+0000","last_peered":"2024-04-26T11:16:34.850921+0000","last_clean":"2024-04-26T11:16:34.850921+0000","last_became_active":"2024-04-26T11:14:08.591886+0000","last_became_peered":"2024-04-26T11:14:08.591886+0000","last_unstale":"2024-04-26T11:16:34.850921+0000","last_undegraded":"2024-04-26T11:16:34.850921+0000","last_fullsized":"2024-04-26T11:16:34.850921+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:29.835852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850742+0000","last_change":"2024-04-26T11:13:12.918759+0000","last_active":"2024-04-26T11:16:34.850742+0000","last_peered":"2024-04-26T11:16:34.850742+0000","last_clean":"2024-04-26T11:16:34.850742+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:16:34.850742+0000","last_undegraded":"2024-04-26T11:16:34.850742+0000","last_fullsized":"2024-04-26T11:16:34.850742+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:55.002972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850968+0000","last_change":"2024-04-26T11:14:08.591804+0000","last_active":"2024-04-26T11:16:34.850968+0000","last_peered":"2024-04-26T11:16:34.850968+0000","last_clean":"2024-04-26T11:16:34.850968+0000","last_became_active":"2024-04-26T11:14:08.591519+0000","last_became_peered":"2024-04-26T11:14:08.591519+0000","last_unstale":"2024-04-26T11:16:34.850968+0000","last_undegraded":"2024-04-26T11:16:34.850968+0000","last_fullsized":"2024-04-26T11:16:34.850968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:00:27.447921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871384+0000","last_change":"2024-04-26T11:16:36.868357+0000","last_active":"2024-04-26T11:16:36.871384+0000","last_peered":"2024-04-26T11:16:36.871384+0000","last_clean":"2024-04-26T11:16:36.871384+0000","last_became_active":"2024-04-26T11:16:36.866698+0000","last_became_peered":"2024-04-26T11:16:36.866698+0000","last_unstale":"2024-04-26T11:16:36.871384+0000","last_undegraded":"2024-04-26T11:16:36.871384+0000","last_fullsized":"2024-04-26T11:16:36.871384+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:56.560147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.868372+0000","last_change":"2024-04-26T11:16:36.864212+0000","last_active":"2024-04-26T11:16:36.868372+0000","last_peered":"2024-04-26T11:16:36.868372+0000","last_clean":"2024-04-26T11:16:36.868372+0000","last_became_active":"2024-04-26T11:16:36.862787+0000","last_became_peered":"2024-04-26T11:16:36.862787+0000","last_unstale":"2024-04-26T11:16:36.868372+0000","last_undegraded":"2024-04-26T11:16:36.868372+0000","last_fullsized":"2024-04-26T11:16:36.868372+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:50.035179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.851719+0000","last_change":"2024-04-26T11:16:35.851923+0000","last_active":"2024-04-26T11:16:35.851719+0000","last_peered":"2024-04-26T11:16:34.849524+0000","last_clean":"2024-04-26T11:13:54.337507+0000","last_became_active":"2024-04-26T11:13:58.346333+0000","last_became_peered":"2024-04-26T11:13:58.346333+0000","last_unstale":"2024-04-26T11:16:35.851719+0000","last_undegraded":"2024-04-26T11:16:35.851719+0000","last_fullsized":"2024-04-26T11:16:35.851719+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:40.907075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862003+0000","last_change":"2024-04-26T11:16:36.865177+0000","last_active":"2024-04-26T11:16:38.862003+0000","last_peered":"2024-04-26T11:16:38.862003+0000","last_clean":"2024-04-26T11:16:38.862003+0000","last_became_active":"2024-04-26T11:16:36.864276+0000","last_became_peered":"2024-04-26T11:16:36.864276+0000","last_unstale":"2024-04-26T11:16:38.862003+0000","last_undegraded":"2024-04-26T11:16:38.862003+0000","last_fullsized":"2024-04-26T11:16:38.862003+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:21.982286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849609+0000","last_change":"2024-04-26T11:13:12.912756+0000","last_active":"2024-04-26T11:16:34.849609+0000","last_peered":"2024-04-26T11:16:34.849609+0000","last_clean":"2024-04-26T11:16:34.849609+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:16:34.849609+0000","last_undegraded":"2024-04-26T11:16:34.849609+0000","last_fullsized":"2024-04-26T11:16:34.849609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:04.177831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.856554+0000","last_change":"2024-04-26T11:16:35.857313+0000","last_active":"2024-04-26T11:16:35.856554+0000","last_peered":"2024-04-26T11:16:34.851220+0000","last_clean":"2024-04-26T11:13:54.340820+0000","last_became_active":"2024-04-26T11:13:58.351912+0000","last_became_peered":"2024-04-26T11:13:58.351912+0000","last_unstale":"2024-04-26T11:16:35.856554+0000","last_undegraded":"2024-04-26T11:16:35.856554+0000","last_fullsized":"2024-04-26T11:16:35.856554+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:00.997636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862718+0000","last_change":"2024-04-26T11:16:36.868960+0000","last_active":"2024-04-26T11:16:38.862718+0000","last_peered":"2024-04-26T11:16:38.862718+0000","last_clean":"2024-04-26T11:16:38.862718+0000","last_became_active":"2024-04-26T11:16:36.868050+0000","last_became_peered":"2024-04-26T11:16:36.868050+0000","last_unstale":"2024-04-26T11:16:38.862718+0000","last_undegraded":"2024-04-26T11:16:38.862718+0000","last_fullsized":"2024-04-26T11:16:38.862718+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:28.198210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.870640+0000","last_change":"2024-04-26T11:16:36.867664+0000","last_active":"2024-04-26T11:16:36.870640+0000","last_peered":"2024-04-26T11:16:36.870640+0000","last_clean":"2024-04-26T11:16:36.870640+0000","last_became_active":"2024-04-26T11:16:36.865582+0000","last_became_peered":"2024-04-26T11:16:36.865582+0000","last_unstale":"2024-04-26T11:16:36.870640+0000","last_undegraded":"2024-04-26T11:16:36.870640+0000","last_fullsized":"2024-04-26T11:16:36.870640+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:24.063678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":65,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849385+0000","last_change":"2024-04-26T11:13:12.493425+0000","last_active":"2024-04-26T11:16:34.849385+0000","last_peered":"2024-04-26T11:16:34.849385+0000","last_clean":"2024-04-26T11:16:34.849385+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:16:34.849385+0000","last_undegraded":"2024-04-26T11:16:34.849385+0000","last_fullsized":"2024-04-26T11:16:34.849385+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:23.279580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.858633+0000","last_change":"2024-04-26T11:16:35.858771+0000","last_active":"2024-04-26T11:16:35.858633+0000","last_peered":"2024-04-26T11:16:34.850851+0000","last_clean":"2024-04-26T11:13:54.340499+0000","last_became_active":"2024-04-26T11:13:58.349652+0000","last_became_peered":"2024-04-26T11:13:58.349652+0000","last_unstale":"2024-04-26T11:16:35.858633+0000","last_undegraded":"2024-04-26T11:16:35.858633+0000","last_fullsized":"2024-04-26T11:16:35.858633+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:28.176115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":2,"reported_epoch":69,"state":"peering","last_fresh":"2024-04-26T11:14:08.582802+0000","last_change":"2024-04-26T11:13:42.306227+0000","last_active":"2024-04-26T11:13:42.306070+0000","last_peered":"2024-04-26T11:13:39.301410+0000","last_clean":"2024-04-26T11:13:39.301410+0000","last_became_active":"2024-04-26T11:13:12.488819+0000","last_became_peered":"2024-04-26T11:13:12.488819+0000","last_unstale":"2024-04-26T11:14:08.582802+0000","last_undegraded":"2024-04-26T11:14:08.582802+0000","last_fullsized":"2024-04-26T11:14:08.582802+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:48.191394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862478+0000","last_change":"2024-04-26T11:16:36.866812+0000","last_active":"2024-04-26T11:16:38.862478+0000","last_peered":"2024-04-26T11:16:38.862478+0000","last_clean":"2024-04-26T11:16:38.862478+0000","last_became_active":"2024-04-26T11:16:36.865841+0000","last_became_peered":"2024-04-26T11:16:36.865841+0000","last_unstale":"2024-04-26T11:16:38.862478+0000","last_undegraded":"2024-04-26T11:16:38.862478+0000","last_fullsized":"2024-04-26T11:16:38.862478+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:20.948589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T11:16:35.852313+0000","last_change":"2024-04-26T11:14:08.589659+0000","last_active":"2024-04-26T11:16:35.852313+0000","last_peered":"2024-04-26T11:16:35.852313+0000","last_clean":"2024-04-26T11:16:35.852313+0000","last_became_active":"2024-04-26T11:14:08.589404+0000","last_became_peered":"2024-04-26T11:14:08.589404+0000","last_unstale":"2024-04-26T11:16:35.852313+0000","last_undegraded":"2024-04-26T11:16:35.852313+0000","last_fullsized":"2024-04-26T11:16:35.852313+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:29.354141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.856412+0000","last_change":"2024-04-26T11:16:35.856596+0000","last_active":"2024-04-26T11:16:35.856412+0000","last_peered":"2024-04-26T11:16:34.851133+0000","last_clean":"2024-04-26T11:13:54.340778+0000","last_became_active":"2024-04-26T11:13:58.351797+0000","last_became_peered":"2024-04-26T11:13:58.351797+0000","last_unstale":"2024-04-26T11:16:35.856412+0000","last_undegraded":"2024-04-26T11:16:35.856412+0000","last_fullsized":"2024-04-26T11:16:35.856412+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:56.030721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862900+0000","last_change":"2024-04-26T11:16:36.870740+0000","last_active":"2024-04-26T11:16:38.862900+0000","last_peered":"2024-04-26T11:16:38.862900+0000","last_clean":"2024-04-26T11:16:38.862900+0000","last_became_active":"2024-04-26T11:16:36.865334+0000","last_became_peered":"2024-04-26T11:16:36.865334+0000","last_unstale":"2024-04-26T11:16:38.862900+0000","last_undegraded":"2024-04-26T11:16:38.862900+0000","last_fullsized":"2024-04-26T11:16:38.862900+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:46.263242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849390+0000","last_change":"2024-04-26T11:14:08.588941+0000","last_active":"2024-04-26T11:16:34.849390+0000","last_peered":"2024-04-26T11:16:34.849390+0000","last_clean":"2024-04-26T11:16:34.849390+0000","last_became_active":"2024-04-26T11:14:08.588699+0000","last_became_peered":"2024-04-26T11:14:08.588699+0000","last_unstale":"2024-04-26T11:16:34.849390+0000","last_undegraded":"2024-04-26T11:16:34.849390+0000","last_fullsized":"2024-04-26T11:16:34.849390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:05.957122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.864080+0000","last_change":"2024-04-26T11:16:36.861341+0000","last_active":"2024-04-26T11:16:36.864080+0000","last_peered":"2024-04-26T11:16:36.864080+0000","last_clean":"2024-04-26T11:16:36.864080+0000","last_became_active":"2024-04-26T11:16:36.860498+0000","last_became_peered":"2024-04-26T11:16:36.860498+0000","last_unstale":"2024-04-26T11:16:36.864080+0000","last_undegraded":"2024-04-26T11:16:36.864080+0000","last_fullsized":"2024-04-26T11:16:36.864080+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:12.295055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.861846+0000","last_change":"2024-04-26T11:16:36.861607+0000","last_active":"2024-04-26T11:16:38.861846+0000","last_peered":"2024-04-26T11:16:38.861846+0000","last_clean":"2024-04-26T11:16:38.861846+0000","last_became_active":"2024-04-26T11:16:36.860624+0000","last_became_peered":"2024-04-26T11:16:36.860624+0000","last_unstale":"2024-04-26T11:16:38.861846+0000","last_undegraded":"2024-04-26T11:16:38.861846+0000","last_fullsized":"2024-04-26T11:16:38.861846+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:52.246126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":73,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.857757+0000","last_change":"2024-04-26T11:16:35.857926+0000","last_active":"2024-04-26T11:16:35.857757+0000","last_peered":"2024-04-26T11:16:34.850584+0000","last_clean":"2024-04-26T11:13:54.340344+0000","last_became_active":"2024-04-26T11:13:58.349342+0000","last_became_peered":"2024-04-26T11:13:58.349342+0000","last_unstale":"2024-04-26T11:16:35.857757+0000","last_undegraded":"2024-04-26T11:16:35.857757+0000","last_fullsized":"2024-04-26T11:16:35.857757+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:25.155273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850289+0000","last_change":"2024-04-26T11:14:08.590078+0000","last_active":"2024-04-26T11:16:34.850289+0000","last_peered":"2024-04-26T11:16:34.850289+0000","last_clean":"2024-04-26T11:16:34.850289+0000","last_became_active":"2024-04-26T11:14:08.589497+0000","last_became_peered":"2024-04-26T11:14:08.589497+0000","last_unstale":"2024-04-26T11:16:34.850289+0000","last_undegraded":"2024-04-26T11:16:34.850289+0000","last_fullsized":"2024-04-26T11:16:34.850289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:21.955581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":28,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.869351+0000","last_change":"2024-04-26T11:16:36.863969+0000","last_active":"2024-04-26T11:16:36.869351+0000","last_peered":"2024-04-26T11:16:36.869351+0000","last_clean":"2024-04-26T11:16:36.869351+0000","last_became_active":"2024-04-26T11:16:36.863038+0000","last_became_peered":"2024-04-26T11:16:36.863038+0000","last_unstale":"2024-04-26T11:16:36.869351+0000","last_undegraded":"2024-04-26T11:16:36.869351+0000","last_fullsized":"2024-04-26T11:16:36.869351+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:18.680458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.868352+0000","last_change":"2024-04-26T11:16:36.863400+0000","last_active":"2024-04-26T11:16:36.868352+0000","last_peered":"2024-04-26T11:16:36.868352+0000","last_clean":"2024-04-26T11:16:36.868352+0000","last_became_active":"2024-04-26T11:16:36.861887+0000","last_became_peered":"2024-04-26T11:16:36.861887+0000","last_unstale":"2024-04-26T11:16:36.868352+0000","last_undegraded":"2024-04-26T11:16:36.868352+0000","last_fullsized":"2024-04-26T11:16:36.868352+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:58.091135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":23,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.868328+0000","last_change":"2024-04-26T11:16:36.863160+0000","last_active":"2024-04-26T11:16:36.868328+0000","last_peered":"2024-04-26T11:16:36.868328+0000","last_clean":"2024-04-26T11:16:36.868328+0000","last_became_active":"2024-04-26T11:16:36.861563+0000","last_became_peered":"2024-04-26T11:16:36.861563+0000","last_unstale":"2024-04-26T11:16:36.868328+0000","last_undegraded":"2024-04-26T11:16:36.868328+0000","last_fullsized":"2024-04-26T11:16:36.868328+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:32.284607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850537+0000","last_change":"2024-04-26T11:13:12.916685+0000","last_active":"2024-04-26T11:16:34.850537+0000","last_peered":"2024-04-26T11:16:34.850537+0000","last_clean":"2024-04-26T11:16:34.850537+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:16:34.850537+0000","last_undegraded":"2024-04-26T11:16:34.850537+0000","last_fullsized":"2024-04-26T11:16:34.850537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.861955+0000","last_change":"2024-04-26T11:16:36.862068+0000","last_active":"2024-04-26T11:16:38.861955+0000","last_peered":"2024-04-26T11:16:38.861955+0000","last_clean":"2024-04-26T11:16:38.861955+0000","last_became_active":"2024-04-26T11:16:36.860845+0000","last_became_peered":"2024-04-26T11:16:36.860845+0000","last_unstale":"2024-04-26T11:16:38.861955+0000","last_undegraded":"2024-04-26T11:16:38.861955+0000","last_fullsized":"2024-04-26T11:16:38.861955+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:54.740487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850748+0000","last_change":"2024-04-26T11:13:12.915238+0000","last_active":"2024-04-26T11:16:34.850748+0000","last_peered":"2024-04-26T11:16:34.850748+0000","last_clean":"2024-04-26T11:16:34.850748+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:16:34.850748+0000","last_undegraded":"2024-04-26T11:16:34.850748+0000","last_fullsized":"2024-04-26T11:16:34.850748+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:48.068465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":70,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.851874+0000","last_change":"2024-04-26T11:16:35.852036+0000","last_active":"2024-04-26T11:16:35.851874+0000","last_peered":"2024-04-26T11:16:34.849749+0000","last_clean":"2024-04-26T11:13:54.337541+0000","last_became_active":"2024-04-26T11:13:58.348978+0000","last_became_peered":"2024-04-26T11:13:58.348978+0000","last_unstale":"2024-04-26T11:16:35.851874+0000","last_undegraded":"2024-04-26T11:16:35.851874+0000","last_fullsized":"2024-04-26T11:16:35.851874+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:09.159278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862619+0000","last_change":"2024-04-26T11:16:36.869499+0000","last_active":"2024-04-26T11:16:38.862619+0000","last_peered":"2024-04-26T11:16:38.862619+0000","last_clean":"2024-04-26T11:16:38.862619+0000","last_became_active":"2024-04-26T11:16:36.868256+0000","last_became_peered":"2024-04-26T11:16:36.868256+0000","last_unstale":"2024-04-26T11:16:38.862619+0000","last_undegraded":"2024-04-26T11:16:38.862619+0000","last_fullsized":"2024-04-26T11:16:38.862619+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:02.923235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":24,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871953+0000","last_change":"2024-04-26T11:16:36.870080+0000","last_active":"2024-04-26T11:16:36.871953+0000","last_peered":"2024-04-26T11:16:36.871953+0000","last_clean":"2024-04-26T11:16:36.871953+0000","last_became_active":"2024-04-26T11:16:36.867077+0000","last_became_peered":"2024-04-26T11:16:36.867077+0000","last_unstale":"2024-04-26T11:16:36.871953+0000","last_undegraded":"2024-04-26T11:16:36.871953+0000","last_fullsized":"2024-04-26T11:16:36.871953+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:25.497636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862804+0000","last_change":"2024-04-26T11:16:36.862068+0000","last_active":"2024-04-26T11:16:38.862804+0000","last_peered":"2024-04-26T11:16:38.862804+0000","last_clean":"2024-04-26T11:16:38.862804+0000","last_became_active":"2024-04-26T11:16:36.860565+0000","last_became_peered":"2024-04-26T11:16:36.860565+0000","last_unstale":"2024-04-26T11:16:38.862804+0000","last_undegraded":"2024-04-26T11:16:38.862804+0000","last_fullsized":"2024-04-26T11:16:38.862804+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:38:14.430827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":23,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.866965+0000","last_change":"2024-04-26T11:16:36.861810+0000","last_active":"2024-04-26T11:16:36.866965+0000","last_peered":"2024-04-26T11:16:36.866965+0000","last_clean":"2024-04-26T11:16:36.866965+0000","last_became_active":"2024-04-26T11:16:36.860299+0000","last_became_peered":"2024-04-26T11:16:36.860299+0000","last_unstale":"2024-04-26T11:16:36.866965+0000","last_undegraded":"2024-04-26T11:16:36.866965+0000","last_fullsized":"2024-04-26T11:16:36.866965+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:13.262452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.851523+0000","last_change":"2024-04-26T11:16:35.851691+0000","last_active":"2024-04-26T11:16:35.851523+0000","last_peered":"2024-04-26T11:16:34.849205+0000","last_clean":"2024-04-26T11:13:54.338893+0000","last_became_active":"2024-04-26T11:13:58.345004+0000","last_became_peered":"2024-04-26T11:13:58.345004+0000","last_unstale":"2024-04-26T11:16:35.851523+0000","last_undegraded":"2024-04-26T11:16:35.851523+0000","last_fullsized":"2024-04-26T11:16:35.851523+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:13.889611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":72,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.854828+0000","last_change":"2024-04-26T11:16:35.856366+0000","last_active":"2024-04-26T11:16:35.854828+0000","last_peered":"2024-04-26T11:16:34.850489+0000","last_clean":"2024-04-26T11:13:54.341218+0000","last_became_active":"2024-04-26T11:13:58.349390+0000","last_became_peered":"2024-04-26T11:13:58.349390+0000","last_unstale":"2024-04-26T11:16:35.854828+0000","last_undegraded":"2024-04-26T11:16:35.854828+0000","last_fullsized":"2024-04-26T11:16:35.854828+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:00.368944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850144+0000","last_change":"2024-04-26T11:13:12.912207+0000","last_active":"2024-04-26T11:16:34.850144+0000","last_peered":"2024-04-26T11:16:34.850144+0000","last_clean":"2024-04-26T11:16:34.850144+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:16:34.850144+0000","last_undegraded":"2024-04-26T11:16:34.850144+0000","last_fullsized":"2024-04-26T11:16:34.850144+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":23,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.868015+0000","last_change":"2024-04-26T11:16:36.861887+0000","last_active":"2024-04-26T11:16:36.868015+0000","last_peered":"2024-04-26T11:16:36.868015+0000","last_clean":"2024-04-26T11:16:36.868015+0000","last_became_active":"2024-04-26T11:16:36.861385+0000","last_became_peered":"2024-04-26T11:16:36.861385+0000","last_unstale":"2024-04-26T11:16:36.868015+0000","last_undegraded":"2024-04-26T11:16:36.868015+0000","last_fullsized":"2024-04-26T11:16:36.868015+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:59.045795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.870155+0000","last_change":"2024-04-26T11:16:36.866558+0000","last_active":"2024-04-26T11:16:36.870155+0000","last_peered":"2024-04-26T11:16:36.870155+0000","last_clean":"2024-04-26T11:16:36.870155+0000","last_became_active":"2024-04-26T11:16:36.865645+0000","last_became_peered":"2024-04-26T11:16:36.865645+0000","last_unstale":"2024-04-26T11:16:36.870155+0000","last_undegraded":"2024-04-26T11:16:36.870155+0000","last_fullsized":"2024-04-26T11:16:36.870155+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:26.653256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871699+0000","last_change":"2024-04-26T11:16:36.869527+0000","last_active":"2024-04-26T11:16:36.871699+0000","last_peered":"2024-04-26T11:16:36.871699+0000","last_clean":"2024-04-26T11:16:36.871699+0000","last_became_active":"2024-04-26T11:16:36.869081+0000","last_became_peered":"2024-04-26T11:16:36.869081+0000","last_unstale":"2024-04-26T11:16:36.871699+0000","last_undegraded":"2024-04-26T11:16:36.871699+0000","last_fullsized":"2024-04-26T11:16:36.871699+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:25.536503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862609+0000","last_change":"2024-04-26T11:16:36.867197+0000","last_active":"2024-04-26T11:16:38.862609+0000","last_peered":"2024-04-26T11:16:38.862609+0000","last_clean":"2024-04-26T11:16:38.862609+0000","last_became_active":"2024-04-26T11:16:36.866699+0000","last_became_peered":"2024-04-26T11:16:36.866699+0000","last_unstale":"2024-04-26T11:16:38.862609+0000","last_undegraded":"2024-04-26T11:16:38.862609+0000","last_fullsized":"2024-04-26T11:16:38.862609+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:10.074682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":22,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862680+0000","last_change":"2024-04-26T11:16:36.866905+0000","last_active":"2024-04-26T11:16:38.862680+0000","last_peered":"2024-04-26T11:16:38.862680+0000","last_clean":"2024-04-26T11:16:38.862680+0000","last_became_active":"2024-04-26T11:16:36.865531+0000","last_became_peered":"2024-04-26T11:16:36.865531+0000","last_unstale":"2024-04-26T11:16:38.862680+0000","last_undegraded":"2024-04-26T11:16:38.862680+0000","last_fullsized":"2024-04-26T11:16:38.862680+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:16.961092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871146+0000","last_change":"2024-04-26T11:16:36.867822+0000","last_active":"2024-04-26T11:16:36.871146+0000","last_peered":"2024-04-26T11:16:36.871146+0000","last_clean":"2024-04-26T11:16:36.871146+0000","last_became_active":"2024-04-26T11:16:36.865633+0000","last_became_peered":"2024-04-26T11:16:36.865633+0000","last_unstale":"2024-04-26T11:16:36.871146+0000","last_undegraded":"2024-04-26T11:16:36.871146+0000","last_fullsized":"2024-04-26T11:16:36.871146+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:07.461066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.867886+0000","last_change":"2024-04-26T11:16:36.861799+0000","last_active":"2024-04-26T11:16:36.867886+0000","last_peered":"2024-04-26T11:16:36.867886+0000","last_clean":"2024-04-26T11:16:36.867886+0000","last_became_active":"2024-04-26T11:16:36.860707+0000","last_became_peered":"2024-04-26T11:16:36.860707+0000","last_unstale":"2024-04-26T11:16:36.867886+0000","last_undegraded":"2024-04-26T11:16:36.867886+0000","last_fullsized":"2024-04-26T11:16:36.867886+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:04.733669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.870621+0000","last_change":"2024-04-26T11:16:36.866866+0000","last_active":"2024-04-26T11:16:36.870621+0000","last_peered":"2024-04-26T11:16:36.870621+0000","last_clean":"2024-04-26T11:16:36.870621+0000","last_became_active":"2024-04-26T11:16:36.865663+0000","last_became_peered":"2024-04-26T11:16:36.865663+0000","last_unstale":"2024-04-26T11:16:36.870621+0000","last_undegraded":"2024-04-26T11:16:36.870621+0000","last_fullsized":"2024-04-26T11:16:36.870621+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:40:33.235331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":70,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.851540+0000","last_change":"2024-04-26T11:16:35.851691+0000","last_active":"2024-04-26T11:16:35.851540+0000","last_peered":"2024-04-26T11:16:34.849424+0000","last_clean":"2024-04-26T11:13:54.337409+0000","last_became_active":"2024-04-26T11:13:58.346295+0000","last_became_peered":"2024-04-26T11:13:58.346295+0000","last_unstale":"2024-04-26T11:16:35.851540+0000","last_undegraded":"2024-04-26T11:16:35.851540+0000","last_fullsized":"2024-04-26T11:16:35.851540+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:58.190995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.864154+0000","last_change":"2024-04-26T11:16:36.861324+0000","last_active":"2024-04-26T11:16:36.864154+0000","last_peered":"2024-04-26T11:16:36.864154+0000","last_clean":"2024-04-26T11:16:36.864154+0000","last_became_active":"2024-04-26T11:16:36.859490+0000","last_became_peered":"2024-04-26T11:16:36.859490+0000","last_unstale":"2024-04-26T11:16:36.864154+0000","last_undegraded":"2024-04-26T11:16:36.864154+0000","last_fullsized":"2024-04-26T11:16:36.864154+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:08.842836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849544+0000","last_change":"2024-04-26T11:13:12.493217+0000","last_active":"2024-04-26T11:16:34.849544+0000","last_peered":"2024-04-26T11:16:34.849544+0000","last_clean":"2024-04-26T11:16:34.849544+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:16:34.849544+0000","last_undegraded":"2024-04-26T11:16:34.849544+0000","last_fullsized":"2024-04-26T11:16:34.849544+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:00.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.851035+0000","last_change":"2024-04-26T11:14:08.592365+0000","last_active":"2024-04-26T11:16:34.851035+0000","last_peered":"2024-04-26T11:16:34.851035+0000","last_clean":"2024-04-26T11:16:34.851035+0000","last_became_active":"2024-04-26T11:14:08.591926+0000","last_became_peered":"2024-04-26T11:14:08.591926+0000","last_unstale":"2024-04-26T11:16:34.851035+0000","last_undegraded":"2024-04-26T11:16:34.851035+0000","last_fullsized":"2024-04-26T11:16:34.851035+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:52.475134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850356+0000","last_change":"2024-04-26T11:14:08.590727+0000","last_active":"2024-04-26T11:16:34.850356+0000","last_peered":"2024-04-26T11:16:34.850356+0000","last_clean":"2024-04-26T11:16:34.850356+0000","last_became_active":"2024-04-26T11:14:08.590371+0000","last_became_peered":"2024-04-26T11:14:08.590371+0000","last_unstale":"2024-04-26T11:16:34.850356+0000","last_undegraded":"2024-04-26T11:16:34.850356+0000","last_fullsized":"2024-04-26T11:16:34.850356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:32.002629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871195+0000","last_change":"2024-04-26T11:16:36.867874+0000","last_active":"2024-04-26T11:16:36.871195+0000","last_peered":"2024-04-26T11:16:36.871195+0000","last_clean":"2024-04-26T11:16:36.871195+0000","last_became_active":"2024-04-26T11:16:36.866878+0000","last_became_peered":"2024-04-26T11:16:36.866878+0000","last_unstale":"2024-04-26T11:16:36.871195+0000","last_undegraded":"2024-04-26T11:16:36.871195+0000","last_fullsized":"2024-04-26T11:16:36.871195+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:14.516925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.852941+0000","last_change":"2024-04-26T11:16:35.853117+0000","last_active":"2024-04-26T11:16:35.852941+0000","last_peered":"2024-04-26T11:16:34.849651+0000","last_clean":"2024-04-26T11:13:54.337583+0000","last_became_active":"2024-04-26T11:13:58.346850+0000","last_became_peered":"2024-04-26T11:13:58.346850+0000","last_unstale":"2024-04-26T11:16:35.852941+0000","last_undegraded":"2024-04-26T11:16:35.852941+0000","last_fullsized":"2024-04-26T11:16:35.852941+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:36.627979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.864258+0000","last_change":"2024-04-26T11:16:36.861685+0000","last_active":"2024-04-26T11:16:36.864258+0000","last_peered":"2024-04-26T11:16:36.864258+0000","last_clean":"2024-04-26T11:16:36.864258+0000","last_became_active":"2024-04-26T11:16:36.859534+0000","last_became_peered":"2024-04-26T11:16:36.859534+0000","last_unstale":"2024-04-26T11:16:36.864258+0000","last_undegraded":"2024-04-26T11:16:36.864258+0000","last_fullsized":"2024-04-26T11:16:36.864258+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:53:17.183514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.868297+0000","last_change":"2024-04-26T11:16:36.862872+0000","last_active":"2024-04-26T11:16:36.868297+0000","last_peered":"2024-04-26T11:16:36.868297+0000","last_clean":"2024-04-26T11:16:36.868297+0000","last_became_active":"2024-04-26T11:16:36.860322+0000","last_became_peered":"2024-04-26T11:16:36.860322+0000","last_unstale":"2024-04-26T11:16:36.868297+0000","last_undegraded":"2024-04-26T11:16:36.868297+0000","last_fullsized":"2024-04-26T11:16:36.868297+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:37.186329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849889+0000","last_change":"2024-04-26T11:14:08.589823+0000","last_active":"2024-04-26T11:16:34.849889+0000","last_peered":"2024-04-26T11:16:34.849889+0000","last_clean":"2024-04-26T11:16:34.849889+0000","last_became_active":"2024-04-26T11:14:08.588808+0000","last_became_peered":"2024-04-26T11:14:08.588808+0000","last_unstale":"2024-04-26T11:16:34.849889+0000","last_undegraded":"2024-04-26T11:16:34.849889+0000","last_fullsized":"2024-04-26T11:16:34.849889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:31.499991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849872+0000","last_change":"2024-04-26T11:14:08.590654+0000","last_active":"2024-04-26T11:16:34.849872+0000","last_peered":"2024-04-26T11:16:34.849872+0000","last_clean":"2024-04-26T11:16:34.849872+0000","last_became_active":"2024-04-26T11:14:08.590089+0000","last_became_peered":"2024-04-26T11:14:08.590089+0000","last_unstale":"2024-04-26T11:16:34.849872+0000","last_undegraded":"2024-04-26T11:16:34.849872+0000","last_fullsized":"2024-04-26T11:16:34.849872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:56.592753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":70,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.852737+0000","last_change":"2024-04-26T11:16:35.852966+0000","last_active":"2024-04-26T11:16:35.852737+0000","last_peered":"2024-04-26T11:16:34.849450+0000","last_clean":"2024-04-26T11:13:54.339345+0000","last_became_active":"2024-04-26T11:13:58.349251+0000","last_became_peered":"2024-04-26T11:13:58.349251+0000","last_unstale":"2024-04-26T11:16:35.852737+0000","last_undegraded":"2024-04-26T11:16:35.852737+0000","last_fullsized":"2024-04-26T11:16:35.852737+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:45.123453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.851294+0000","last_change":"2024-04-26T11:14:08.592455+0000","last_active":"2024-04-26T11:16:34.851294+0000","last_peered":"2024-04-26T11:16:34.851294+0000","last_clean":"2024-04-26T11:16:34.851294+0000","last_became_active":"2024-04-26T11:14:08.592069+0000","last_became_peered":"2024-04-26T11:14:08.592069+0000","last_unstale":"2024-04-26T11:16:34.851294+0000","last_undegraded":"2024-04-26T11:16:34.851294+0000","last_fullsized":"2024-04-26T11:16:34.851294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:51:18.264318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.866327+0000","last_change":"2024-04-26T11:16:36.860776+0000","last_active":"2024-04-26T11:16:36.866327+0000","last_peered":"2024-04-26T11:16:36.866327+0000","last_clean":"2024-04-26T11:16:36.866327+0000","last_became_active":"2024-04-26T11:16:36.859301+0000","last_became_peered":"2024-04-26T11:16:36.859301+0000","last_unstale":"2024-04-26T11:16:36.866327+0000","last_undegraded":"2024-04-26T11:16:36.866327+0000","last_fullsized":"2024-04-26T11:16:36.866327+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:27.648935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":217,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.869995+0000","last_change":"2024-04-26T11:16:36.864256+0000","last_active":"2024-04-26T11:16:36.869995+0000","last_peered":"2024-04-26T11:16:36.869995+0000","last_clean":"2024-04-26T11:16:36.869995+0000","last_became_active":"2024-04-26T11:16:36.863058+0000","last_became_peered":"2024-04-26T11:16:36.863058+0000","last_unstale":"2024-04-26T11:16:36.869995+0000","last_undegraded":"2024-04-26T11:16:36.869995+0000","last_fullsized":"2024-04-26T11:16:36.869995+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:49.355165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850082+0000","last_change":"2024-04-26T11:14:08.589733+0000","last_active":"2024-04-26T11:16:34.850082+0000","last_peered":"2024-04-26T11:16:34.850082+0000","last_clean":"2024-04-26T11:16:34.850082+0000","last_became_active":"2024-04-26T11:14:08.589187+0000","last_became_peered":"2024-04-26T11:14:08.589187+0000","last_unstale":"2024-04-26T11:16:34.850082+0000","last_undegraded":"2024-04-26T11:16:34.850082+0000","last_fullsized":"2024-04-26T11:16:34.850082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:47.437503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.868046+0000","last_change":"2024-04-26T11:16:36.864249+0000","last_active":"2024-04-26T11:16:36.868046+0000","last_peered":"2024-04-26T11:16:36.868046+0000","last_clean":"2024-04-26T11:16:36.868046+0000","last_became_active":"2024-04-26T11:16:36.863279+0000","last_became_peered":"2024-04-26T11:16:36.863279+0000","last_unstale":"2024-04-26T11:16:36.868046+0000","last_undegraded":"2024-04-26T11:16:36.868046+0000","last_fullsized":"2024-04-26T11:16:36.868046+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:19.053419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871871+0000","last_change":"2024-04-26T11:16:36.869342+0000","last_active":"2024-04-26T11:16:36.871871+0000","last_peered":"2024-04-26T11:16:36.871871+0000","last_clean":"2024-04-26T11:16:36.871871+0000","last_became_active":"2024-04-26T11:16:36.866494+0000","last_became_peered":"2024-04-26T11:16:36.866494+0000","last_unstale":"2024-04-26T11:16:36.871871+0000","last_undegraded":"2024-04-26T11:16:36.871871+0000","last_fullsized":"2024-04-26T11:16:36.871871+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:19.386938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.861732+0000","last_change":"2024-04-26T11:16:36.863211+0000","last_active":"2024-04-26T11:16:38.861732+0000","last_peered":"2024-04-26T11:16:38.861732+0000","last_clean":"2024-04-26T11:16:38.861732+0000","last_became_active":"2024-04-26T11:16:36.862085+0000","last_became_peered":"2024-04-26T11:16:36.862085+0000","last_unstale":"2024-04-26T11:16:38.861732+0000","last_undegraded":"2024-04-26T11:16:38.861732+0000","last_fullsized":"2024-04-26T11:16:38.861732+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:55.260721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850676+0000","last_change":"2024-04-26T11:13:12.918648+0000","last_active":"2024-04-26T11:16:34.850676+0000","last_peered":"2024-04-26T11:16:34.850676+0000","last_clean":"2024-04-26T11:16:34.850676+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:16:34.850676+0000","last_undegraded":"2024-04-26T11:16:34.850676+0000","last_fullsized":"2024-04-26T11:16:34.850676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":67,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850886+0000","last_change":"2024-04-26T11:13:08.110433+0000","last_active":"2024-04-26T11:16:34.850886+0000","last_peered":"2024-04-26T11:16:34.850886+0000","last_clean":"2024-04-26T11:16:34.850886+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:16:34.850886+0000","last_undegraded":"2024-04-26T11:16:34.850886+0000","last_fullsized":"2024-04-26T11:16:34.850886+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850558+0000","last_change":"2024-04-26T11:14:08.590798+0000","last_active":"2024-04-26T11:16:34.850558+0000","last_peered":"2024-04-26T11:16:34.850558+0000","last_clean":"2024-04-26T11:16:34.850558+0000","last_became_active":"2024-04-26T11:14:08.590535+0000","last_became_peered":"2024-04-26T11:14:08.590535+0000","last_unstale":"2024-04-26T11:16:34.850558+0000","last_undegraded":"2024-04-26T11:16:34.850558+0000","last_fullsized":"2024-04-26T11:16:34.850558+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:04.692288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.851855+0000","last_change":"2024-04-26T11:16:35.852016+0000","last_active":"2024-04-26T11:16:35.851855+0000","last_peered":"2024-04-26T11:16:34.849514+0000","last_clean":"2024-04-26T11:13:54.339822+0000","last_became_active":"2024-04-26T11:13:58.346388+0000","last_became_peered":"2024-04-26T11:13:58.346388+0000","last_unstale":"2024-04-26T11:16:35.851855+0000","last_undegraded":"2024-04-26T11:16:35.851855+0000","last_fullsized":"2024-04-26T11:16:35.851855+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:37.633783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":55,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.851363+0000","last_change":"2024-04-26T11:14:08.592482+0000","last_active":"2024-04-26T11:16:34.851363+0000","last_peered":"2024-04-26T11:16:34.851363+0000","last_clean":"2024-04-26T11:16:34.851363+0000","last_became_active":"2024-04-26T11:14:08.592093+0000","last_became_peered":"2024-04-26T11:14:08.592093+0000","last_unstale":"2024-04-26T11:16:34.851363+0000","last_undegraded":"2024-04-26T11:16:34.851363+0000","last_fullsized":"2024-04-26T11:16:34.851363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:38.939541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850472+0000","last_change":"2024-04-26T11:14:08.589530+0000","last_active":"2024-04-26T11:16:34.850472+0000","last_peered":"2024-04-26T11:16:34.850472+0000","last_clean":"2024-04-26T11:16:34.850472+0000","last_became_active":"2024-04-26T11:14:08.589288+0000","last_became_peered":"2024-04-26T11:14:08.589288+0000","last_unstale":"2024-04-26T11:16:34.850472+0000","last_undegraded":"2024-04-26T11:16:34.850472+0000","last_fullsized":"2024-04-26T11:16:34.850472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:52.096175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":2,"reported_epoch":69,"state":"peering","last_fresh":"2024-04-26T11:14:08.582736+0000","last_change":"2024-04-26T11:13:42.307124+0000","last_active":"2024-04-26T11:13:42.305890+0000","last_peered":"2024-04-26T11:13:39.301215+0000","last_clean":"2024-04-26T11:13:39.301215+0000","last_became_active":"2024-04-26T11:13:12.918816+0000","last_became_peered":"2024-04-26T11:13:12.918816+0000","last_unstale":"2024-04-26T11:14:08.582736+0000","last_undegraded":"2024-04-26T11:14:08.582736+0000","last_fullsized":"2024-04-26T11:14:08.582736+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:02.747912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.863957+0000","last_change":"2024-04-26T11:16:36.860868+0000","last_active":"2024-04-26T11:16:36.863957+0000","last_peered":"2024-04-26T11:16:36.863957+0000","last_clean":"2024-04-26T11:16:36.863957+0000","last_became_active":"2024-04-26T11:16:36.858042+0000","last_became_peered":"2024-04-26T11:16:36.858042+0000","last_unstale":"2024-04-26T11:16:36.863957+0000","last_undegraded":"2024-04-26T11:16:36.863957+0000","last_fullsized":"2024-04-26T11:16:36.863957+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:57:35.285183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862568+0000","last_change":"2024-04-26T11:16:36.867856+0000","last_active":"2024-04-26T11:16:38.862568+0000","last_peered":"2024-04-26T11:16:38.862568+0000","last_clean":"2024-04-26T11:16:38.862568+0000","last_became_active":"2024-04-26T11:16:36.865816+0000","last_became_peered":"2024-04-26T11:16:36.865816+0000","last_unstale":"2024-04-26T11:16:38.862568+0000","last_undegraded":"2024-04-26T11:16:38.862568+0000","last_fullsized":"2024-04-26T11:16:38.862568+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:35.210355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.853363+0000","last_change":"2024-04-26T11:16:35.854139+0000","last_active":"2024-04-26T11:16:35.853363+0000","last_peered":"2024-04-26T11:16:34.850014+0000","last_clean":"2024-04-26T11:13:54.337565+0000","last_became_active":"2024-04-26T11:13:58.346538+0000","last_became_peered":"2024-04-26T11:13:58.346538+0000","last_unstale":"2024-04-26T11:16:35.853363+0000","last_undegraded":"2024-04-26T11:16:35.853363+0000","last_fullsized":"2024-04-26T11:16:35.853363+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:35.209914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":73,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849560+0000","last_change":"2024-04-26T11:13:43.321498+0000","last_active":"2024-04-26T11:16:34.849560+0000","last_peered":"2024-04-26T11:16:34.849560+0000","last_clean":"2024-04-26T11:16:34.849560+0000","last_became_active":"2024-04-26T11:13:43.320420+0000","last_became_peered":"2024-04-26T11:13:43.320420+0000","last_unstale":"2024-04-26T11:16:34.849560+0000","last_undegraded":"2024-04-26T11:16:34.849560+0000","last_fullsized":"2024-04-26T11:16:34.849560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:06.135274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850670+0000","last_change":"2024-04-26T11:13:12.917812+0000","last_active":"2024-04-26T11:16:34.850670+0000","last_peered":"2024-04-26T11:16:34.850670+0000","last_clean":"2024-04-26T11:16:34.850670+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:16:34.850670+0000","last_undegraded":"2024-04-26T11:16:34.850670+0000","last_fullsized":"2024-04-26T11:16:34.850670+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":2,"reported_epoch":69,"state":"peering","last_fresh":"2024-04-26T11:14:06.583168+0000","last_change":"2024-04-26T11:16:39.863541+0000","last_active":"2024-04-26T11:16:39.863541+0000","last_peered":"2024-04-26T11:14:06.583168+0000","last_clean":"2024-04-26T11:14:06.583168+0000","last_became_active":"2024-04-26T11:13:43.321846+0000","last_became_peered":"2024-04-26T11:13:43.321846+0000","last_unstale":"2024-04-26T11:14:06.583168+0000","last_undegraded":"2024-04-26T11:14:06.583168+0000","last_fullsized":"2024-04-26T11:14:06.583168+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:14.138907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.869411+0000","last_change":"2024-04-26T11:16:36.865623+0000","last_active":"2024-04-26T11:16:36.869411+0000","last_peered":"2024-04-26T11:16:36.869411+0000","last_clean":"2024-04-26T11:16:36.869411+0000","last_became_active":"2024-04-26T11:16:36.864187+0000","last_became_peered":"2024-04-26T11:16:36.864187+0000","last_unstale":"2024-04-26T11:16:36.869411+0000","last_undegraded":"2024-04-26T11:16:36.869411+0000","last_fullsized":"2024-04-26T11:16:36.869411+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:25.032691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":72,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.858100+0000","last_change":"2024-04-26T11:16:35.858284+0000","last_active":"2024-04-26T11:16:35.858100+0000","last_peered":"2024-04-26T11:16:34.850560+0000","last_clean":"2024-04-26T11:13:54.340365+0000","last_became_active":"2024-04-26T11:13:58.349479+0000","last_became_peered":"2024-04-26T11:13:58.349479+0000","last_unstale":"2024-04-26T11:16:35.858100+0000","last_undegraded":"2024-04-26T11:16:35.858100+0000","last_fullsized":"2024-04-26T11:16:35.858100+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:25:53.597934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.870137+0000","last_change":"2024-04-26T11:16:36.865772+0000","last_active":"2024-04-26T11:16:36.870137+0000","last_peered":"2024-04-26T11:16:36.870137+0000","last_clean":"2024-04-26T11:16:36.870137+0000","last_became_active":"2024-04-26T11:16:36.865213+0000","last_became_peered":"2024-04-26T11:16:36.865213+0000","last_unstale":"2024-04-26T11:16:36.870137+0000","last_undegraded":"2024-04-26T11:16:36.870137+0000","last_fullsized":"2024-04-26T11:16:36.870137+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:03.220593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850169+0000","last_change":"2024-04-26T11:14:08.589726+0000","last_active":"2024-04-26T11:16:34.850169+0000","last_peered":"2024-04-26T11:16:34.850169+0000","last_clean":"2024-04-26T11:16:34.850169+0000","last_became_active":"2024-04-26T11:14:08.588687+0000","last_became_peered":"2024-04-26T11:14:08.588687+0000","last_unstale":"2024-04-26T11:16:34.850169+0000","last_undegraded":"2024-04-26T11:16:34.850169+0000","last_fullsized":"2024-04-26T11:16:34.850169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:05.617266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850283+0000","last_change":"2024-04-26T11:13:12.917763+0000","last_active":"2024-04-26T11:16:34.850283+0000","last_peered":"2024-04-26T11:16:34.850283+0000","last_clean":"2024-04-26T11:16:34.850283+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:16:34.850283+0000","last_undegraded":"2024-04-26T11:16:34.850283+0000","last_fullsized":"2024-04-26T11:16:34.850283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":2,"reported_epoch":69,"state":"peering","last_fresh":"2024-04-26T11:14:06.582422+0000","last_change":"2024-04-26T11:16:39.863687+0000","last_active":"2024-04-26T11:16:39.863687+0000","last_peered":"2024-04-26T11:14:06.582422+0000","last_clean":"2024-04-26T11:14:06.582422+0000","last_became_active":"2024-04-26T11:13:43.321829+0000","last_became_peered":"2024-04-26T11:13:43.321829+0000","last_unstale":"2024-04-26T11:14:06.582422+0000","last_undegraded":"2024-04-26T11:14:06.582422+0000","last_fullsized":"2024-04-26T11:14:06.582422+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:56.385417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.872318+0000","last_change":"2024-04-26T11:16:36.870651+0000","last_active":"2024-04-26T11:16:36.872318+0000","last_peered":"2024-04-26T11:16:36.872318+0000","last_clean":"2024-04-26T11:16:36.872318+0000","last_became_active":"2024-04-26T11:16:36.869018+0000","last_became_peered":"2024-04-26T11:16:36.869018+0000","last_unstale":"2024-04-26T11:16:36.872318+0000","last_undegraded":"2024-04-26T11:16:36.872318+0000","last_fullsized":"2024-04-26T11:16:36.872318+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:59.337390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871964+0000","last_change":"2024-04-26T11:16:36.870356+0000","last_active":"2024-04-26T11:16:36.871964+0000","last_peered":"2024-04-26T11:16:36.871964+0000","last_clean":"2024-04-26T11:16:36.871964+0000","last_became_active":"2024-04-26T11:16:36.868029+0000","last_became_peered":"2024-04-26T11:16:36.868029+0000","last_unstale":"2024-04-26T11:16:36.871964+0000","last_undegraded":"2024-04-26T11:16:36.871964+0000","last_fullsized":"2024-04-26T11:16:36.871964+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:13:24.219419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849594+0000","last_change":"2024-04-26T11:14:08.590838+0000","last_active":"2024-04-26T11:16:34.849594+0000","last_peered":"2024-04-26T11:16:34.849594+0000","last_clean":"2024-04-26T11:16:34.849594+0000","last_became_active":"2024-04-26T11:14:08.590386+0000","last_became_peered":"2024-04-26T11:14:08.590386+0000","last_unstale":"2024-04-26T11:16:34.849594+0000","last_undegraded":"2024-04-26T11:16:34.849594+0000","last_fullsized":"2024-04-26T11:16:34.849594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:50.791318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.854354+0000","last_change":"2024-04-26T11:16:35.854521+0000","last_active":"2024-04-26T11:16:35.854354+0000","last_peered":"2024-04-26T11:16:34.849726+0000","last_clean":"2024-04-26T11:13:54.337655+0000","last_became_active":"2024-04-26T11:13:58.349005+0000","last_became_peered":"2024-04-26T11:13:58.349005+0000","last_unstale":"2024-04-26T11:16:35.854354+0000","last_undegraded":"2024-04-26T11:16:35.854354+0000","last_fullsized":"2024-04-26T11:16:35.854354+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:25.369855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850253+0000","last_change":"2024-04-26T11:14:08.589117+0000","last_active":"2024-04-26T11:16:34.850253+0000","last_peered":"2024-04-26T11:16:34.850253+0000","last_clean":"2024-04-26T11:16:34.850253+0000","last_became_active":"2024-04-26T11:14:08.588762+0000","last_became_peered":"2024-04-26T11:14:08.588762+0000","last_unstale":"2024-04-26T11:16:34.850253+0000","last_undegraded":"2024-04-26T11:16:34.850253+0000","last_fullsized":"2024-04-26T11:16:34.850253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:05.658069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.856451+0000","last_change":"2024-04-26T11:16:35.856628+0000","last_active":"2024-04-26T11:16:35.856451+0000","last_peered":"2024-04-26T11:16:34.850819+0000","last_clean":"2024-04-26T11:13:54.340822+0000","last_became_active":"2024-04-26T11:13:58.349129+0000","last_became_peered":"2024-04-26T11:13:58.349129+0000","last_unstale":"2024-04-26T11:16:35.856451+0000","last_undegraded":"2024-04-26T11:16:35.856451+0000","last_fullsized":"2024-04-26T11:16:35.856451+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:41.218246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":3,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5470,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738412,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281024,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94090816,"statfs":{"total":96636764160,"available":96348995584,"internally_reserved":0,"allocated":1363968,"data_stored":874145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":1,"last update":"Fri Apr 26 11:16:17 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40200000000000002,"15min":0.378},"min":{"1min":0.20000000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.96499999999999997,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.44400000000000001,"15min":0.44600000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.57599999999999996,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.621}]}]},{"osd":0,"up_from":67,"seq":287762808834,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40348,"kb_used_data":1360,"kb_used_omap":6,"kb_used_meta":38969,"kb_avail":94331492,"statfs":{"total":96636764160,"available":96595447808,"internally_reserved":0,"allocated":1392640,"data_stored":889273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7064,"internal_metadata":39904360},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738413,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401004,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":400254,"kb_avail":93970836,"statfs":{"total":96636764160,"available":96226136064,"internally_reserved":0,"allocated":753664,"data_stored":283176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":409860550},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23400000000000001}]},{"osd":2,"last update":"Fri Apr 26 11:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.40300000000000002,"15min":0.39300000000000002},"min":{"1min":0.14999999999999999,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.61299999999999999,"5min":2.056,"15min":2.056},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.47899999999999998,"15min":0.45700000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":3.9609999999999999,"5min":3.9609999999999999,"15min":3.9609999999999999},"last":0.47399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5470,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:16:41.260 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:16:41.643 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:16:41.645 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:16:41.655 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-04-26T11:16:40.870395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":3,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":216,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":722376,"kb_used_data":3428,"kb_used_omap":10,"kb_used_meta":718901,"kb_avail":282393144,"statfs":{"total":289910292480,"available":289170579456,"internally_reserved":0,"allocated":3510272,"data_stored":2046594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10252,"internal_metadata":736155636},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":3,"num_objects_degraded":-20,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.363952"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.851235+0000","last_change":"2024-04-26T11:13:12.919196+0000","last_active":"2024-04-26T11:16:34.851235+0000","last_peered":"2024-04-26T11:16:34.851235+0000","last_clean":"2024-04-26T11:16:34.851235+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:16:34.851235+0000","last_undegraded":"2024-04-26T11:16:34.851235+0000","last_fullsized":"2024-04-26T11:16:34.851235+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850200+0000","last_change":"2024-04-26T11:13:12.917670+0000","last_active":"2024-04-26T11:16:34.850200+0000","last_peered":"2024-04-26T11:16:34.850200+0000","last_clean":"2024-04-26T11:16:34.850200+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:16:34.850200+0000","last_undegraded":"2024-04-26T11:16:34.850200+0000","last_fullsized":"2024-04-26T11:16:34.850200+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.870181+0000","last_change":"2024-04-26T11:16:36.866575+0000","last_active":"2024-04-26T11:16:36.870181+0000","last_peered":"2024-04-26T11:16:36.870181+0000","last_clean":"2024-04-26T11:16:36.870181+0000","last_became_active":"2024-04-26T11:16:36.864565+0000","last_became_peered":"2024-04-26T11:16:36.864565+0000","last_unstale":"2024-04-26T11:16:36.870181+0000","last_undegraded":"2024-04-26T11:16:36.870181+0000","last_fullsized":"2024-04-26T11:16:36.870181+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:38.756428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871248+0000","last_change":"2024-04-26T11:16:36.868086+0000","last_active":"2024-04-26T11:16:36.871248+0000","last_peered":"2024-04-26T11:16:36.871248+0000","last_clean":"2024-04-26T11:16:36.871248+0000","last_became_active":"2024-04-26T11:16:36.865679+0000","last_became_peered":"2024-04-26T11:16:36.865679+0000","last_unstale":"2024-04-26T11:16:36.871248+0000","last_undegraded":"2024-04-26T11:16:36.871248+0000","last_fullsized":"2024-04-26T11:16:36.871248+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:22.051599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849437+0000","last_change":"2024-04-26T11:13:12.917403+0000","last_active":"2024-04-26T11:16:34.849437+0000","last_peered":"2024-04-26T11:16:34.849437+0000","last_clean":"2024-04-26T11:16:34.849437+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:16:34.849437+0000","last_undegraded":"2024-04-26T11:16:34.849437+0000","last_fullsized":"2024-04-26T11:16:34.849437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:42.014955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871352+0000","last_change":"2024-04-26T11:16:36.868338+0000","last_active":"2024-04-26T11:16:36.871352+0000","last_peered":"2024-04-26T11:16:36.871352+0000","last_clean":"2024-04-26T11:16:36.871352+0000","last_became_active":"2024-04-26T11:16:36.867049+0000","last_became_peered":"2024-04-26T11:16:36.867049+0000","last_unstale":"2024-04-26T11:16:36.871352+0000","last_undegraded":"2024-04-26T11:16:36.871352+0000","last_fullsized":"2024-04-26T11:16:36.871352+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:57.262622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.864496+0000","last_change":"2024-04-26T11:16:36.860337+0000","last_active":"2024-04-26T11:16:36.864496+0000","last_peered":"2024-04-26T11:16:36.864496+0000","last_clean":"2024-04-26T11:16:36.864496+0000","last_became_active":"2024-04-26T11:16:36.859342+0000","last_became_peered":"2024-04-26T11:16:36.859342+0000","last_unstale":"2024-04-26T11:16:36.864496+0000","last_undegraded":"2024-04-26T11:16:36.864496+0000","last_fullsized":"2024-04-26T11:16:36.864496+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:23.653811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.870476+0000","last_change":"2024-04-26T11:16:36.863996+0000","last_active":"2024-04-26T11:16:36.870476+0000","last_peered":"2024-04-26T11:16:36.870476+0000","last_clean":"2024-04-26T11:16:36.870476+0000","last_became_active":"2024-04-26T11:16:36.863048+0000","last_became_peered":"2024-04-26T11:16:36.863048+0000","last_unstale":"2024-04-26T11:16:36.870476+0000","last_undegraded":"2024-04-26T11:16:36.870476+0000","last_fullsized":"2024-04-26T11:16:36.870476+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:42.503116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":47,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T11:16:35.853449+0000","last_change":"2024-04-26T11:14:08.592223+0000","last_active":"2024-04-26T11:16:35.853449+0000","last_peered":"2024-04-26T11:16:35.853449+0000","last_clean":"2024-04-26T11:16:35.853449+0000","last_became_active":"2024-04-26T11:14:08.591660+0000","last_became_peered":"2024-04-26T11:14:08.591660+0000","last_unstale":"2024-04-26T11:16:35.853449+0000","last_undegraded":"2024-04-26T11:16:35.853449+0000","last_fullsized":"2024-04-26T11:16:35.853449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:06.208634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850628+0000","last_change":"2024-04-26T11:13:12.918521+0000","last_active":"2024-04-26T11:16:34.850628+0000","last_peered":"2024-04-26T11:16:34.850628+0000","last_clean":"2024-04-26T11:16:34.850628+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:16:34.850628+0000","last_undegraded":"2024-04-26T11:16:34.850628+0000","last_fullsized":"2024-04-26T11:16:34.850628+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":2,"reported_epoch":69,"state":"peering","last_fresh":"2024-04-26T11:14:08.583071+0000","last_change":"2024-04-26T11:13:42.306377+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:14:08.583071+0000","last_undegraded":"2024-04-26T11:14:08.583071+0000","last_fullsized":"2024-04-26T11:14:08.583071+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:54.379763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.852956+0000","last_change":"2024-04-26T11:16:35.854908+0000","last_active":"2024-04-26T11:16:35.852956+0000","last_peered":"2024-04-26T11:16:34.850106+0000","last_clean":"2024-04-26T11:13:54.340528+0000","last_became_active":"2024-04-26T11:13:58.346341+0000","last_became_peered":"2024-04-26T11:13:58.346341+0000","last_unstale":"2024-04-26T11:16:35.852956+0000","last_undegraded":"2024-04-26T11:16:35.852956+0000","last_fullsized":"2024-04-26T11:16:35.852956+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:56.481301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849691+0000","last_change":"2024-04-26T11:13:12.915484+0000","last_active":"2024-04-26T11:16:34.849691+0000","last_peered":"2024-04-26T11:16:34.849691+0000","last_clean":"2024-04-26T11:16:34.849691+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:16:34.849691+0000","last_undegraded":"2024-04-26T11:16:34.849691+0000","last_fullsized":"2024-04-26T11:16:34.849691+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.869304+0000","last_change":"2024-04-26T11:16:36.865308+0000","last_active":"2024-04-26T11:16:36.869304+0000","last_peered":"2024-04-26T11:16:36.869304+0000","last_clean":"2024-04-26T11:16:36.869304+0000","last_became_active":"2024-04-26T11:16:36.864119+0000","last_became_peered":"2024-04-26T11:16:36.864119+0000","last_unstale":"2024-04-26T11:16:36.869304+0000","last_undegraded":"2024-04-26T11:16:36.869304+0000","last_fullsized":"2024-04-26T11:16:36.869304+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:29.265536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":2,"reported_epoch":69,"state":"peering","last_fresh":"2024-04-26T11:13:43.317311+0000","last_change":"2024-04-26T11:13:42.309392+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:43.317311+0000","last_undegraded":"2024-04-26T11:13:43.317311+0000","last_fullsized":"2024-04-26T11:13:43.317311+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:45.107551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871462+0000","last_change":"2024-04-26T11:16:36.868941+0000","last_active":"2024-04-26T11:16:36.871462+0000","last_peered":"2024-04-26T11:16:36.871462+0000","last_clean":"2024-04-26T11:16:36.871462+0000","last_became_active":"2024-04-26T11:16:36.864605+0000","last_became_peered":"2024-04-26T11:16:36.864605+0000","last_unstale":"2024-04-26T11:16:36.871462+0000","last_undegraded":"2024-04-26T11:16:36.871462+0000","last_fullsized":"2024-04-26T11:16:36.871462+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:26.687980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850921+0000","last_change":"2024-04-26T11:14:08.592349+0000","last_active":"2024-04-26T11:16:34.850921+0000","last_peered":"2024-04-26T11:16:34.850921+0000","last_clean":"2024-04-26T11:16:34.850921+0000","last_became_active":"2024-04-26T11:14:08.591886+0000","last_became_peered":"2024-04-26T11:14:08.591886+0000","last_unstale":"2024-04-26T11:16:34.850921+0000","last_undegraded":"2024-04-26T11:16:34.850921+0000","last_fullsized":"2024-04-26T11:16:34.850921+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:29.835852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850742+0000","last_change":"2024-04-26T11:13:12.918759+0000","last_active":"2024-04-26T11:16:34.850742+0000","last_peered":"2024-04-26T11:16:34.850742+0000","last_clean":"2024-04-26T11:16:34.850742+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:16:34.850742+0000","last_undegraded":"2024-04-26T11:16:34.850742+0000","last_fullsized":"2024-04-26T11:16:34.850742+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:55.002972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850968+0000","last_change":"2024-04-26T11:14:08.591804+0000","last_active":"2024-04-26T11:16:34.850968+0000","last_peered":"2024-04-26T11:16:34.850968+0000","last_clean":"2024-04-26T11:16:34.850968+0000","last_became_active":"2024-04-26T11:14:08.591519+0000","last_became_peered":"2024-04-26T11:14:08.591519+0000","last_unstale":"2024-04-26T11:16:34.850968+0000","last_undegraded":"2024-04-26T11:16:34.850968+0000","last_fullsized":"2024-04-26T11:16:34.850968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:00:27.447921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871384+0000","last_change":"2024-04-26T11:16:36.868357+0000","last_active":"2024-04-26T11:16:36.871384+0000","last_peered":"2024-04-26T11:16:36.871384+0000","last_clean":"2024-04-26T11:16:36.871384+0000","last_became_active":"2024-04-26T11:16:36.866698+0000","last_became_peered":"2024-04-26T11:16:36.866698+0000","last_unstale":"2024-04-26T11:16:36.871384+0000","last_undegraded":"2024-04-26T11:16:36.871384+0000","last_fullsized":"2024-04-26T11:16:36.871384+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:56.560147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.868372+0000","last_change":"2024-04-26T11:16:36.864212+0000","last_active":"2024-04-26T11:16:36.868372+0000","last_peered":"2024-04-26T11:16:36.868372+0000","last_clean":"2024-04-26T11:16:36.868372+0000","last_became_active":"2024-04-26T11:16:36.862787+0000","last_became_peered":"2024-04-26T11:16:36.862787+0000","last_unstale":"2024-04-26T11:16:36.868372+0000","last_undegraded":"2024-04-26T11:16:36.868372+0000","last_fullsized":"2024-04-26T11:16:36.868372+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:50.035179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.851719+0000","last_change":"2024-04-26T11:16:35.851923+0000","last_active":"2024-04-26T11:16:35.851719+0000","last_peered":"2024-04-26T11:16:34.849524+0000","last_clean":"2024-04-26T11:13:54.337507+0000","last_became_active":"2024-04-26T11:13:58.346333+0000","last_became_peered":"2024-04-26T11:13:58.346333+0000","last_unstale":"2024-04-26T11:16:35.851719+0000","last_undegraded":"2024-04-26T11:16:35.851719+0000","last_fullsized":"2024-04-26T11:16:35.851719+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:40.907075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862003+0000","last_change":"2024-04-26T11:16:36.865177+0000","last_active":"2024-04-26T11:16:38.862003+0000","last_peered":"2024-04-26T11:16:38.862003+0000","last_clean":"2024-04-26T11:16:38.862003+0000","last_became_active":"2024-04-26T11:16:36.864276+0000","last_became_peered":"2024-04-26T11:16:36.864276+0000","last_unstale":"2024-04-26T11:16:38.862003+0000","last_undegraded":"2024-04-26T11:16:38.862003+0000","last_fullsized":"2024-04-26T11:16:38.862003+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:21.982286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849609+0000","last_change":"2024-04-26T11:13:12.912756+0000","last_active":"2024-04-26T11:16:34.849609+0000","last_peered":"2024-04-26T11:16:34.849609+0000","last_clean":"2024-04-26T11:16:34.849609+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:16:34.849609+0000","last_undegraded":"2024-04-26T11:16:34.849609+0000","last_fullsized":"2024-04-26T11:16:34.849609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:04.177831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.856554+0000","last_change":"2024-04-26T11:16:35.857313+0000","last_active":"2024-04-26T11:16:35.856554+0000","last_peered":"2024-04-26T11:16:34.851220+0000","last_clean":"2024-04-26T11:13:54.340820+0000","last_became_active":"2024-04-26T11:13:58.351912+0000","last_became_peered":"2024-04-26T11:13:58.351912+0000","last_unstale":"2024-04-26T11:16:35.856554+0000","last_undegraded":"2024-04-26T11:16:35.856554+0000","last_fullsized":"2024-04-26T11:16:35.856554+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:00.997636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862718+0000","last_change":"2024-04-26T11:16:36.868960+0000","last_active":"2024-04-26T11:16:38.862718+0000","last_peered":"2024-04-26T11:16:38.862718+0000","last_clean":"2024-04-26T11:16:38.862718+0000","last_became_active":"2024-04-26T11:16:36.868050+0000","last_became_peered":"2024-04-26T11:16:36.868050+0000","last_unstale":"2024-04-26T11:16:38.862718+0000","last_undegraded":"2024-04-26T11:16:38.862718+0000","last_fullsized":"2024-04-26T11:16:38.862718+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:28.198210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.870640+0000","last_change":"2024-04-26T11:16:36.867664+0000","last_active":"2024-04-26T11:16:36.870640+0000","last_peered":"2024-04-26T11:16:36.870640+0000","last_clean":"2024-04-26T11:16:36.870640+0000","last_became_active":"2024-04-26T11:16:36.865582+0000","last_became_peered":"2024-04-26T11:16:36.865582+0000","last_unstale":"2024-04-26T11:16:36.870640+0000","last_undegraded":"2024-04-26T11:16:36.870640+0000","last_fullsized":"2024-04-26T11:16:36.870640+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:24.063678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":65,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849385+0000","last_change":"2024-04-26T11:13:12.493425+0000","last_active":"2024-04-26T11:16:34.849385+0000","last_peered":"2024-04-26T11:16:34.849385+0000","last_clean":"2024-04-26T11:16:34.849385+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:16:34.849385+0000","last_undegraded":"2024-04-26T11:16:34.849385+0000","last_fullsized":"2024-04-26T11:16:34.849385+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:23.279580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.858633+0000","last_change":"2024-04-26T11:16:35.858771+0000","last_active":"2024-04-26T11:16:35.858633+0000","last_peered":"2024-04-26T11:16:34.850851+0000","last_clean":"2024-04-26T11:13:54.340499+0000","last_became_active":"2024-04-26T11:13:58.349652+0000","last_became_peered":"2024-04-26T11:13:58.349652+0000","last_unstale":"2024-04-26T11:16:35.858633+0000","last_undegraded":"2024-04-26T11:16:35.858633+0000","last_fullsized":"2024-04-26T11:16:35.858633+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:28.176115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":2,"reported_epoch":69,"state":"peering","last_fresh":"2024-04-26T11:14:08.582802+0000","last_change":"2024-04-26T11:13:42.306227+0000","last_active":"2024-04-26T11:13:42.306070+0000","last_peered":"2024-04-26T11:13:39.301410+0000","last_clean":"2024-04-26T11:13:39.301410+0000","last_became_active":"2024-04-26T11:13:12.488819+0000","last_became_peered":"2024-04-26T11:13:12.488819+0000","last_unstale":"2024-04-26T11:14:08.582802+0000","last_undegraded":"2024-04-26T11:14:08.582802+0000","last_fullsized":"2024-04-26T11:14:08.582802+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:48.191394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862478+0000","last_change":"2024-04-26T11:16:36.866812+0000","last_active":"2024-04-26T11:16:38.862478+0000","last_peered":"2024-04-26T11:16:38.862478+0000","last_clean":"2024-04-26T11:16:38.862478+0000","last_became_active":"2024-04-26T11:16:36.865841+0000","last_became_peered":"2024-04-26T11:16:36.865841+0000","last_unstale":"2024-04-26T11:16:38.862478+0000","last_undegraded":"2024-04-26T11:16:38.862478+0000","last_fullsized":"2024-04-26T11:16:38.862478+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:20.948589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T11:16:35.852313+0000","last_change":"2024-04-26T11:14:08.589659+0000","last_active":"2024-04-26T11:16:35.852313+0000","last_peered":"2024-04-26T11:16:35.852313+0000","last_clean":"2024-04-26T11:16:35.852313+0000","last_became_active":"2024-04-26T11:14:08.589404+0000","last_became_peered":"2024-04-26T11:14:08.589404+0000","last_unstale":"2024-04-26T11:16:35.852313+0000","last_undegraded":"2024-04-26T11:16:35.852313+0000","last_fullsized":"2024-04-26T11:16:35.852313+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:29.354141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.856412+0000","last_change":"2024-04-26T11:16:35.856596+0000","last_active":"2024-04-26T11:16:35.856412+0000","last_peered":"2024-04-26T11:16:34.851133+0000","last_clean":"2024-04-26T11:13:54.340778+0000","last_became_active":"2024-04-26T11:13:58.351797+0000","last_became_peered":"2024-04-26T11:13:58.351797+0000","last_unstale":"2024-04-26T11:16:35.856412+0000","last_undegraded":"2024-04-26T11:16:35.856412+0000","last_fullsized":"2024-04-26T11:16:35.856412+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:56.030721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862900+0000","last_change":"2024-04-26T11:16:36.870740+0000","last_active":"2024-04-26T11:16:38.862900+0000","last_peered":"2024-04-26T11:16:38.862900+0000","last_clean":"2024-04-26T11:16:38.862900+0000","last_became_active":"2024-04-26T11:16:36.865334+0000","last_became_peered":"2024-04-26T11:16:36.865334+0000","last_unstale":"2024-04-26T11:16:38.862900+0000","last_undegraded":"2024-04-26T11:16:38.862900+0000","last_fullsized":"2024-04-26T11:16:38.862900+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:46.263242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849390+0000","last_change":"2024-04-26T11:14:08.588941+0000","last_active":"2024-04-26T11:16:34.849390+0000","last_peered":"2024-04-26T11:16:34.849390+0000","last_clean":"2024-04-26T11:16:34.849390+0000","last_became_active":"2024-04-26T11:14:08.588699+0000","last_became_peered":"2024-04-26T11:14:08.588699+0000","last_unstale":"2024-04-26T11:16:34.849390+0000","last_undegraded":"2024-04-26T11:16:34.849390+0000","last_fullsized":"2024-04-26T11:16:34.849390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:05.957122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.864080+0000","last_change":"2024-04-26T11:16:36.861341+0000","last_active":"2024-04-26T11:16:36.864080+0000","last_peered":"2024-04-26T11:16:36.864080+0000","last_clean":"2024-04-26T11:16:36.864080+0000","last_became_active":"2024-04-26T11:16:36.860498+0000","last_became_peered":"2024-04-26T11:16:36.860498+0000","last_unstale":"2024-04-26T11:16:36.864080+0000","last_undegraded":"2024-04-26T11:16:36.864080+0000","last_fullsized":"2024-04-26T11:16:36.864080+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:12.295055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.861846+0000","last_change":"2024-04-26T11:16:36.861607+0000","last_active":"2024-04-26T11:16:38.861846+0000","last_peered":"2024-04-26T11:16:38.861846+0000","last_clean":"2024-04-26T11:16:38.861846+0000","last_became_active":"2024-04-26T11:16:36.860624+0000","last_became_peered":"2024-04-26T11:16:36.860624+0000","last_unstale":"2024-04-26T11:16:38.861846+0000","last_undegraded":"2024-04-26T11:16:38.861846+0000","last_fullsized":"2024-04-26T11:16:38.861846+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:52.246126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":73,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.857757+0000","last_change":"2024-04-26T11:16:35.857926+0000","last_active":"2024-04-26T11:16:35.857757+0000","last_peered":"2024-04-26T11:16:34.850584+0000","last_clean":"2024-04-26T11:13:54.340344+0000","last_became_active":"2024-04-26T11:13:58.349342+0000","last_became_peered":"2024-04-26T11:13:58.349342+0000","last_unstale":"2024-04-26T11:16:35.857757+0000","last_undegraded":"2024-04-26T11:16:35.857757+0000","last_fullsized":"2024-04-26T11:16:35.857757+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:25.155273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850289+0000","last_change":"2024-04-26T11:14:08.590078+0000","last_active":"2024-04-26T11:16:34.850289+0000","last_peered":"2024-04-26T11:16:34.850289+0000","last_clean":"2024-04-26T11:16:34.850289+0000","last_became_active":"2024-04-26T11:14:08.589497+0000","last_became_peered":"2024-04-26T11:14:08.589497+0000","last_unstale":"2024-04-26T11:16:34.850289+0000","last_undegraded":"2024-04-26T11:16:34.850289+0000","last_fullsized":"2024-04-26T11:16:34.850289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:21.955581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":28,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.869351+0000","last_change":"2024-04-26T11:16:36.863969+0000","last_active":"2024-04-26T11:16:36.869351+0000","last_peered":"2024-04-26T11:16:36.869351+0000","last_clean":"2024-04-26T11:16:36.869351+0000","last_became_active":"2024-04-26T11:16:36.863038+0000","last_became_peered":"2024-04-26T11:16:36.863038+0000","last_unstale":"2024-04-26T11:16:36.869351+0000","last_undegraded":"2024-04-26T11:16:36.869351+0000","last_fullsized":"2024-04-26T11:16:36.869351+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:18.680458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.868352+0000","last_change":"2024-04-26T11:16:36.863400+0000","last_active":"2024-04-26T11:16:36.868352+0000","last_peered":"2024-04-26T11:16:36.868352+0000","last_clean":"2024-04-26T11:16:36.868352+0000","last_became_active":"2024-04-26T11:16:36.861887+0000","last_became_peered":"2024-04-26T11:16:36.861887+0000","last_unstale":"2024-04-26T11:16:36.868352+0000","last_undegraded":"2024-04-26T11:16:36.868352+0000","last_fullsized":"2024-04-26T11:16:36.868352+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:58.091135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":23,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.868328+0000","last_change":"2024-04-26T11:16:36.863160+0000","last_active":"2024-04-26T11:16:36.868328+0000","last_peered":"2024-04-26T11:16:36.868328+0000","last_clean":"2024-04-26T11:16:36.868328+0000","last_became_active":"2024-04-26T11:16:36.861563+0000","last_became_peered":"2024-04-26T11:16:36.861563+0000","last_unstale":"2024-04-26T11:16:36.868328+0000","last_undegraded":"2024-04-26T11:16:36.868328+0000","last_fullsized":"2024-04-26T11:16:36.868328+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:32.284607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850537+0000","last_change":"2024-04-26T11:13:12.916685+0000","last_active":"2024-04-26T11:16:34.850537+0000","last_peered":"2024-04-26T11:16:34.850537+0000","last_clean":"2024-04-26T11:16:34.850537+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:16:34.850537+0000","last_undegraded":"2024-04-26T11:16:34.850537+0000","last_fullsized":"2024-04-26T11:16:34.850537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.861955+0000","last_change":"2024-04-26T11:16:36.862068+0000","last_active":"2024-04-26T11:16:38.861955+0000","last_peered":"2024-04-26T11:16:38.861955+0000","last_clean":"2024-04-26T11:16:38.861955+0000","last_became_active":"2024-04-26T11:16:36.860845+0000","last_became_peered":"2024-04-26T11:16:36.860845+0000","last_unstale":"2024-04-26T11:16:38.861955+0000","last_undegraded":"2024-04-26T11:16:38.861955+0000","last_fullsized":"2024-04-26T11:16:38.861955+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:54.740487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850748+0000","last_change":"2024-04-26T11:13:12.915238+0000","last_active":"2024-04-26T11:16:34.850748+0000","last_peered":"2024-04-26T11:16:34.850748+0000","last_clean":"2024-04-26T11:16:34.850748+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:16:34.850748+0000","last_undegraded":"2024-04-26T11:16:34.850748+0000","last_fullsized":"2024-04-26T11:16:34.850748+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:48.068465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":70,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.851874+0000","last_change":"2024-04-26T11:16:35.852036+0000","last_active":"2024-04-26T11:16:35.851874+0000","last_peered":"2024-04-26T11:16:34.849749+0000","last_clean":"2024-04-26T11:13:54.337541+0000","last_became_active":"2024-04-26T11:13:58.348978+0000","last_became_peered":"2024-04-26T11:13:58.348978+0000","last_unstale":"2024-04-26T11:16:35.851874+0000","last_undegraded":"2024-04-26T11:16:35.851874+0000","last_fullsized":"2024-04-26T11:16:35.851874+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:09.159278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862619+0000","last_change":"2024-04-26T11:16:36.869499+0000","last_active":"2024-04-26T11:16:38.862619+0000","last_peered":"2024-04-26T11:16:38.862619+0000","last_clean":"2024-04-26T11:16:38.862619+0000","last_became_active":"2024-04-26T11:16:36.868256+0000","last_became_peered":"2024-04-26T11:16:36.868256+0000","last_unstale":"2024-04-26T11:16:38.862619+0000","last_undegraded":"2024-04-26T11:16:38.862619+0000","last_fullsized":"2024-04-26T11:16:38.862619+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:02.923235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":24,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871953+0000","last_change":"2024-04-26T11:16:36.870080+0000","last_active":"2024-04-26T11:16:36.871953+0000","last_peered":"2024-04-26T11:16:36.871953+0000","last_clean":"2024-04-26T11:16:36.871953+0000","last_became_active":"2024-04-26T11:16:36.867077+0000","last_became_peered":"2024-04-26T11:16:36.867077+0000","last_unstale":"2024-04-26T11:16:36.871953+0000","last_undegraded":"2024-04-26T11:16:36.871953+0000","last_fullsized":"2024-04-26T11:16:36.871953+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:25.497636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862804+0000","last_change":"2024-04-26T11:16:36.862068+0000","last_active":"2024-04-26T11:16:38.862804+0000","last_peered":"2024-04-26T11:16:38.862804+0000","last_clean":"2024-04-26T11:16:38.862804+0000","last_became_active":"2024-04-26T11:16:36.860565+0000","last_became_peered":"2024-04-26T11:16:36.860565+0000","last_unstale":"2024-04-26T11:16:38.862804+0000","last_undegraded":"2024-04-26T11:16:38.862804+0000","last_fullsized":"2024-04-26T11:16:38.862804+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:38:14.430827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":23,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.866965+0000","last_change":"2024-04-26T11:16:36.861810+0000","last_active":"2024-04-26T11:16:36.866965+0000","last_peered":"2024-04-26T11:16:36.866965+0000","last_clean":"2024-04-26T11:16:36.866965+0000","last_became_active":"2024-04-26T11:16:36.860299+0000","last_became_peered":"2024-04-26T11:16:36.860299+0000","last_unstale":"2024-04-26T11:16:36.866965+0000","last_undegraded":"2024-04-26T11:16:36.866965+0000","last_fullsized":"2024-04-26T11:16:36.866965+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:13.262452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.851523+0000","last_change":"2024-04-26T11:16:35.851691+0000","last_active":"2024-04-26T11:16:35.851523+0000","last_peered":"2024-04-26T11:16:34.849205+0000","last_clean":"2024-04-26T11:13:54.338893+0000","last_became_active":"2024-04-26T11:13:58.345004+0000","last_became_peered":"2024-04-26T11:13:58.345004+0000","last_unstale":"2024-04-26T11:16:35.851523+0000","last_undegraded":"2024-04-26T11:16:35.851523+0000","last_fullsized":"2024-04-26T11:16:35.851523+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:13.889611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":72,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.854828+0000","last_change":"2024-04-26T11:16:35.856366+0000","last_active":"2024-04-26T11:16:35.854828+0000","last_peered":"2024-04-26T11:16:34.850489+0000","last_clean":"2024-04-26T11:13:54.341218+0000","last_became_active":"2024-04-26T11:13:58.349390+0000","last_became_peered":"2024-04-26T11:13:58.349390+0000","last_unstale":"2024-04-26T11:16:35.854828+0000","last_undegraded":"2024-04-26T11:16:35.854828+0000","last_fullsized":"2024-04-26T11:16:35.854828+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:00.368944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850144+0000","last_change":"2024-04-26T11:13:12.912207+0000","last_active":"2024-04-26T11:16:34.850144+0000","last_peered":"2024-04-26T11:16:34.850144+0000","last_clean":"2024-04-26T11:16:34.850144+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:16:34.850144+0000","last_undegraded":"2024-04-26T11:16:34.850144+0000","last_fullsized":"2024-04-26T11:16:34.850144+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":23,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.868015+0000","last_change":"2024-04-26T11:16:36.861887+0000","last_active":"2024-04-26T11:16:36.868015+0000","last_peered":"2024-04-26T11:16:36.868015+0000","last_clean":"2024-04-26T11:16:36.868015+0000","last_became_active":"2024-04-26T11:16:36.861385+0000","last_became_peered":"2024-04-26T11:16:36.861385+0000","last_unstale":"2024-04-26T11:16:36.868015+0000","last_undegraded":"2024-04-26T11:16:36.868015+0000","last_fullsized":"2024-04-26T11:16:36.868015+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:59.045795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.870155+0000","last_change":"2024-04-26T11:16:36.866558+0000","last_active":"2024-04-26T11:16:36.870155+0000","last_peered":"2024-04-26T11:16:36.870155+0000","last_clean":"2024-04-26T11:16:36.870155+0000","last_became_active":"2024-04-26T11:16:36.865645+0000","last_became_peered":"2024-04-26T11:16:36.865645+0000","last_unstale":"2024-04-26T11:16:36.870155+0000","last_undegraded":"2024-04-26T11:16:36.870155+0000","last_fullsized":"2024-04-26T11:16:36.870155+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:26.653256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871699+0000","last_change":"2024-04-26T11:16:36.869527+0000","last_active":"2024-04-26T11:16:36.871699+0000","last_peered":"2024-04-26T11:16:36.871699+0000","last_clean":"2024-04-26T11:16:36.871699+0000","last_became_active":"2024-04-26T11:16:36.869081+0000","last_became_peered":"2024-04-26T11:16:36.869081+0000","last_unstale":"2024-04-26T11:16:36.871699+0000","last_undegraded":"2024-04-26T11:16:36.871699+0000","last_fullsized":"2024-04-26T11:16:36.871699+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:25.536503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862609+0000","last_change":"2024-04-26T11:16:36.867197+0000","last_active":"2024-04-26T11:16:38.862609+0000","last_peered":"2024-04-26T11:16:38.862609+0000","last_clean":"2024-04-26T11:16:38.862609+0000","last_became_active":"2024-04-26T11:16:36.866699+0000","last_became_peered":"2024-04-26T11:16:36.866699+0000","last_unstale":"2024-04-26T11:16:38.862609+0000","last_undegraded":"2024-04-26T11:16:38.862609+0000","last_fullsized":"2024-04-26T11:16:38.862609+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:10.074682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":22,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862680+0000","last_change":"2024-04-26T11:16:36.866905+0000","last_active":"2024-04-26T11:16:38.862680+0000","last_peered":"2024-04-26T11:16:38.862680+0000","last_clean":"2024-04-26T11:16:38.862680+0000","last_became_active":"2024-04-26T11:16:36.865531+0000","last_became_peered":"2024-04-26T11:16:36.865531+0000","last_unstale":"2024-04-26T11:16:38.862680+0000","last_undegraded":"2024-04-26T11:16:38.862680+0000","last_fullsized":"2024-04-26T11:16:38.862680+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:16.961092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871146+0000","last_change":"2024-04-26T11:16:36.867822+0000","last_active":"2024-04-26T11:16:36.871146+0000","last_peered":"2024-04-26T11:16:36.871146+0000","last_clean":"2024-04-26T11:16:36.871146+0000","last_became_active":"2024-04-26T11:16:36.865633+0000","last_became_peered":"2024-04-26T11:16:36.865633+0000","last_unstale":"2024-04-26T11:16:36.871146+0000","last_undegraded":"2024-04-26T11:16:36.871146+0000","last_fullsized":"2024-04-26T11:16:36.871146+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:07.461066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.867886+0000","last_change":"2024-04-26T11:16:36.861799+0000","last_active":"2024-04-26T11:16:36.867886+0000","last_peered":"2024-04-26T11:16:36.867886+0000","last_clean":"2024-04-26T11:16:36.867886+0000","last_became_active":"2024-04-26T11:16:36.860707+0000","last_became_peered":"2024-04-26T11:16:36.860707+0000","last_unstale":"2024-04-26T11:16:36.867886+0000","last_undegraded":"2024-04-26T11:16:36.867886+0000","last_fullsized":"2024-04-26T11:16:36.867886+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:04.733669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.870621+0000","last_change":"2024-04-26T11:16:36.866866+0000","last_active":"2024-04-26T11:16:36.870621+0000","last_peered":"2024-04-26T11:16:36.870621+0000","last_clean":"2024-04-26T11:16:36.870621+0000","last_became_active":"2024-04-26T11:16:36.865663+0000","last_became_peered":"2024-04-26T11:16:36.865663+0000","last_unstale":"2024-04-26T11:16:36.870621+0000","last_undegraded":"2024-04-26T11:16:36.870621+0000","last_fullsized":"2024-04-26T11:16:36.870621+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:40:33.235331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":70,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.851540+0000","last_change":"2024-04-26T11:16:35.851691+0000","last_active":"2024-04-26T11:16:35.851540+0000","last_peered":"2024-04-26T11:16:34.849424+0000","last_clean":"2024-04-26T11:13:54.337409+0000","last_became_active":"2024-04-26T11:13:58.346295+0000","last_became_peered":"2024-04-26T11:13:58.346295+0000","last_unstale":"2024-04-26T11:16:35.851540+0000","last_undegraded":"2024-04-26T11:16:35.851540+0000","last_fullsized":"2024-04-26T11:16:35.851540+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:58.190995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.864154+0000","last_change":"2024-04-26T11:16:36.861324+0000","last_active":"2024-04-26T11:16:36.864154+0000","last_peered":"2024-04-26T11:16:36.864154+0000","last_clean":"2024-04-26T11:16:36.864154+0000","last_became_active":"2024-04-26T11:16:36.859490+0000","last_became_peered":"2024-04-26T11:16:36.859490+0000","last_unstale":"2024-04-26T11:16:36.864154+0000","last_undegraded":"2024-04-26T11:16:36.864154+0000","last_fullsized":"2024-04-26T11:16:36.864154+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:08.842836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849544+0000","last_change":"2024-04-26T11:13:12.493217+0000","last_active":"2024-04-26T11:16:34.849544+0000","last_peered":"2024-04-26T11:16:34.849544+0000","last_clean":"2024-04-26T11:16:34.849544+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:16:34.849544+0000","last_undegraded":"2024-04-26T11:16:34.849544+0000","last_fullsized":"2024-04-26T11:16:34.849544+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:00.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.851035+0000","last_change":"2024-04-26T11:14:08.592365+0000","last_active":"2024-04-26T11:16:34.851035+0000","last_peered":"2024-04-26T11:16:34.851035+0000","last_clean":"2024-04-26T11:16:34.851035+0000","last_became_active":"2024-04-26T11:14:08.591926+0000","last_became_peered":"2024-04-26T11:14:08.591926+0000","last_unstale":"2024-04-26T11:16:34.851035+0000","last_undegraded":"2024-04-26T11:16:34.851035+0000","last_fullsized":"2024-04-26T11:16:34.851035+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:52.475134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850356+0000","last_change":"2024-04-26T11:14:08.590727+0000","last_active":"2024-04-26T11:16:34.850356+0000","last_peered":"2024-04-26T11:16:34.850356+0000","last_clean":"2024-04-26T11:16:34.850356+0000","last_became_active":"2024-04-26T11:14:08.590371+0000","last_became_peered":"2024-04-26T11:14:08.590371+0000","last_unstale":"2024-04-26T11:16:34.850356+0000","last_undegraded":"2024-04-26T11:16:34.850356+0000","last_fullsized":"2024-04-26T11:16:34.850356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:32.002629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871195+0000","last_change":"2024-04-26T11:16:36.867874+0000","last_active":"2024-04-26T11:16:36.871195+0000","last_peered":"2024-04-26T11:16:36.871195+0000","last_clean":"2024-04-26T11:16:36.871195+0000","last_became_active":"2024-04-26T11:16:36.866878+0000","last_became_peered":"2024-04-26T11:16:36.866878+0000","last_unstale":"2024-04-26T11:16:36.871195+0000","last_undegraded":"2024-04-26T11:16:36.871195+0000","last_fullsized":"2024-04-26T11:16:36.871195+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:14.516925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.852941+0000","last_change":"2024-04-26T11:16:35.853117+0000","last_active":"2024-04-26T11:16:35.852941+0000","last_peered":"2024-04-26T11:16:34.849651+0000","last_clean":"2024-04-26T11:13:54.337583+0000","last_became_active":"2024-04-26T11:13:58.346850+0000","last_became_peered":"2024-04-26T11:13:58.346850+0000","last_unstale":"2024-04-26T11:16:35.852941+0000","last_undegraded":"2024-04-26T11:16:35.852941+0000","last_fullsized":"2024-04-26T11:16:35.852941+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:36.627979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.864258+0000","last_change":"2024-04-26T11:16:36.861685+0000","last_active":"2024-04-26T11:16:36.864258+0000","last_peered":"2024-04-26T11:16:36.864258+0000","last_clean":"2024-04-26T11:16:36.864258+0000","last_became_active":"2024-04-26T11:16:36.859534+0000","last_became_peered":"2024-04-26T11:16:36.859534+0000","last_unstale":"2024-04-26T11:16:36.864258+0000","last_undegraded":"2024-04-26T11:16:36.864258+0000","last_fullsized":"2024-04-26T11:16:36.864258+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:53:17.183514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.868297+0000","last_change":"2024-04-26T11:16:36.862872+0000","last_active":"2024-04-26T11:16:36.868297+0000","last_peered":"2024-04-26T11:16:36.868297+0000","last_clean":"2024-04-26T11:16:36.868297+0000","last_became_active":"2024-04-26T11:16:36.860322+0000","last_became_peered":"2024-04-26T11:16:36.860322+0000","last_unstale":"2024-04-26T11:16:36.868297+0000","last_undegraded":"2024-04-26T11:16:36.868297+0000","last_fullsized":"2024-04-26T11:16:36.868297+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:37.186329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849889+0000","last_change":"2024-04-26T11:14:08.589823+0000","last_active":"2024-04-26T11:16:34.849889+0000","last_peered":"2024-04-26T11:16:34.849889+0000","last_clean":"2024-04-26T11:16:34.849889+0000","last_became_active":"2024-04-26T11:14:08.588808+0000","last_became_peered":"2024-04-26T11:14:08.588808+0000","last_unstale":"2024-04-26T11:16:34.849889+0000","last_undegraded":"2024-04-26T11:16:34.849889+0000","last_fullsized":"2024-04-26T11:16:34.849889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:31.499991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849872+0000","last_change":"2024-04-26T11:14:08.590654+0000","last_active":"2024-04-26T11:16:34.849872+0000","last_peered":"2024-04-26T11:16:34.849872+0000","last_clean":"2024-04-26T11:16:34.849872+0000","last_became_active":"2024-04-26T11:14:08.590089+0000","last_became_peered":"2024-04-26T11:14:08.590089+0000","last_unstale":"2024-04-26T11:16:34.849872+0000","last_undegraded":"2024-04-26T11:16:34.849872+0000","last_fullsized":"2024-04-26T11:16:34.849872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:56.592753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":70,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.852737+0000","last_change":"2024-04-26T11:16:35.852966+0000","last_active":"2024-04-26T11:16:35.852737+0000","last_peered":"2024-04-26T11:16:34.849450+0000","last_clean":"2024-04-26T11:13:54.339345+0000","last_became_active":"2024-04-26T11:13:58.349251+0000","last_became_peered":"2024-04-26T11:13:58.349251+0000","last_unstale":"2024-04-26T11:16:35.852737+0000","last_undegraded":"2024-04-26T11:16:35.852737+0000","last_fullsized":"2024-04-26T11:16:35.852737+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:45.123453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.851294+0000","last_change":"2024-04-26T11:14:08.592455+0000","last_active":"2024-04-26T11:16:34.851294+0000","last_peered":"2024-04-26T11:16:34.851294+0000","last_clean":"2024-04-26T11:16:34.851294+0000","last_became_active":"2024-04-26T11:14:08.592069+0000","last_became_peered":"2024-04-26T11:14:08.592069+0000","last_unstale":"2024-04-26T11:16:34.851294+0000","last_undegraded":"2024-04-26T11:16:34.851294+0000","last_fullsized":"2024-04-26T11:16:34.851294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:51:18.264318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.866327+0000","last_change":"2024-04-26T11:16:36.860776+0000","last_active":"2024-04-26T11:16:36.866327+0000","last_peered":"2024-04-26T11:16:36.866327+0000","last_clean":"2024-04-26T11:16:36.866327+0000","last_became_active":"2024-04-26T11:16:36.859301+0000","last_became_peered":"2024-04-26T11:16:36.859301+0000","last_unstale":"2024-04-26T11:16:36.866327+0000","last_undegraded":"2024-04-26T11:16:36.866327+0000","last_fullsized":"2024-04-26T11:16:36.866327+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:27.648935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":217,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.869995+0000","last_change":"2024-04-26T11:16:36.864256+0000","last_active":"2024-04-26T11:16:36.869995+0000","last_peered":"2024-04-26T11:16:36.869995+0000","last_clean":"2024-04-26T11:16:36.869995+0000","last_became_active":"2024-04-26T11:16:36.863058+0000","last_became_peered":"2024-04-26T11:16:36.863058+0000","last_unstale":"2024-04-26T11:16:36.869995+0000","last_undegraded":"2024-04-26T11:16:36.869995+0000","last_fullsized":"2024-04-26T11:16:36.869995+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:49.355165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850082+0000","last_change":"2024-04-26T11:14:08.589733+0000","last_active":"2024-04-26T11:16:34.850082+0000","last_peered":"2024-04-26T11:16:34.850082+0000","last_clean":"2024-04-26T11:16:34.850082+0000","last_became_active":"2024-04-26T11:14:08.589187+0000","last_became_peered":"2024-04-26T11:14:08.589187+0000","last_unstale":"2024-04-26T11:16:34.850082+0000","last_undegraded":"2024-04-26T11:16:34.850082+0000","last_fullsized":"2024-04-26T11:16:34.850082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:47.437503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.868046+0000","last_change":"2024-04-26T11:16:36.864249+0000","last_active":"2024-04-26T11:16:36.868046+0000","last_peered":"2024-04-26T11:16:36.868046+0000","last_clean":"2024-04-26T11:16:36.868046+0000","last_became_active":"2024-04-26T11:16:36.863279+0000","last_became_peered":"2024-04-26T11:16:36.863279+0000","last_unstale":"2024-04-26T11:16:36.868046+0000","last_undegraded":"2024-04-26T11:16:36.868046+0000","last_fullsized":"2024-04-26T11:16:36.868046+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:19.053419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871871+0000","last_change":"2024-04-26T11:16:36.869342+0000","last_active":"2024-04-26T11:16:36.871871+0000","last_peered":"2024-04-26T11:16:36.871871+0000","last_clean":"2024-04-26T11:16:36.871871+0000","last_became_active":"2024-04-26T11:16:36.866494+0000","last_became_peered":"2024-04-26T11:16:36.866494+0000","last_unstale":"2024-04-26T11:16:36.871871+0000","last_undegraded":"2024-04-26T11:16:36.871871+0000","last_fullsized":"2024-04-26T11:16:36.871871+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:19.386938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.861732+0000","last_change":"2024-04-26T11:16:36.863211+0000","last_active":"2024-04-26T11:16:38.861732+0000","last_peered":"2024-04-26T11:16:38.861732+0000","last_clean":"2024-04-26T11:16:38.861732+0000","last_became_active":"2024-04-26T11:16:36.862085+0000","last_became_peered":"2024-04-26T11:16:36.862085+0000","last_unstale":"2024-04-26T11:16:38.861732+0000","last_undegraded":"2024-04-26T11:16:38.861732+0000","last_fullsized":"2024-04-26T11:16:38.861732+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:55.260721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850676+0000","last_change":"2024-04-26T11:13:12.918648+0000","last_active":"2024-04-26T11:16:34.850676+0000","last_peered":"2024-04-26T11:16:34.850676+0000","last_clean":"2024-04-26T11:16:34.850676+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:16:34.850676+0000","last_undegraded":"2024-04-26T11:16:34.850676+0000","last_fullsized":"2024-04-26T11:16:34.850676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":67,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850886+0000","last_change":"2024-04-26T11:13:08.110433+0000","last_active":"2024-04-26T11:16:34.850886+0000","last_peered":"2024-04-26T11:16:34.850886+0000","last_clean":"2024-04-26T11:16:34.850886+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:16:34.850886+0000","last_undegraded":"2024-04-26T11:16:34.850886+0000","last_fullsized":"2024-04-26T11:16:34.850886+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850558+0000","last_change":"2024-04-26T11:14:08.590798+0000","last_active":"2024-04-26T11:16:34.850558+0000","last_peered":"2024-04-26T11:16:34.850558+0000","last_clean":"2024-04-26T11:16:34.850558+0000","last_became_active":"2024-04-26T11:14:08.590535+0000","last_became_peered":"2024-04-26T11:14:08.590535+0000","last_unstale":"2024-04-26T11:16:34.850558+0000","last_undegraded":"2024-04-26T11:16:34.850558+0000","last_fullsized":"2024-04-26T11:16:34.850558+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:04.692288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.851855+0000","last_change":"2024-04-26T11:16:35.852016+0000","last_active":"2024-04-26T11:16:35.851855+0000","last_peered":"2024-04-26T11:16:34.849514+0000","last_clean":"2024-04-26T11:13:54.339822+0000","last_became_active":"2024-04-26T11:13:58.346388+0000","last_became_peered":"2024-04-26T11:13:58.346388+0000","last_unstale":"2024-04-26T11:16:35.851855+0000","last_undegraded":"2024-04-26T11:16:35.851855+0000","last_fullsized":"2024-04-26T11:16:35.851855+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:37.633783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":55,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.851363+0000","last_change":"2024-04-26T11:14:08.592482+0000","last_active":"2024-04-26T11:16:34.851363+0000","last_peered":"2024-04-26T11:16:34.851363+0000","last_clean":"2024-04-26T11:16:34.851363+0000","last_became_active":"2024-04-26T11:14:08.592093+0000","last_became_peered":"2024-04-26T11:14:08.592093+0000","last_unstale":"2024-04-26T11:16:34.851363+0000","last_undegraded":"2024-04-26T11:16:34.851363+0000","last_fullsized":"2024-04-26T11:16:34.851363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:38.939541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850472+0000","last_change":"2024-04-26T11:14:08.589530+0000","last_active":"2024-04-26T11:16:34.850472+0000","last_peered":"2024-04-26T11:16:34.850472+0000","last_clean":"2024-04-26T11:16:34.850472+0000","last_became_active":"2024-04-26T11:14:08.589288+0000","last_became_peered":"2024-04-26T11:14:08.589288+0000","last_unstale":"2024-04-26T11:16:34.850472+0000","last_undegraded":"2024-04-26T11:16:34.850472+0000","last_fullsized":"2024-04-26T11:16:34.850472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:52.096175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":2,"reported_epoch":69,"state":"peering","last_fresh":"2024-04-26T11:14:08.582736+0000","last_change":"2024-04-26T11:13:42.307124+0000","last_active":"2024-04-26T11:13:42.305890+0000","last_peered":"2024-04-26T11:13:39.301215+0000","last_clean":"2024-04-26T11:13:39.301215+0000","last_became_active":"2024-04-26T11:13:12.918816+0000","last_became_peered":"2024-04-26T11:13:12.918816+0000","last_unstale":"2024-04-26T11:14:08.582736+0000","last_undegraded":"2024-04-26T11:14:08.582736+0000","last_fullsized":"2024-04-26T11:14:08.582736+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:02.747912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.863957+0000","last_change":"2024-04-26T11:16:36.860868+0000","last_active":"2024-04-26T11:16:36.863957+0000","last_peered":"2024-04-26T11:16:36.863957+0000","last_clean":"2024-04-26T11:16:36.863957+0000","last_became_active":"2024-04-26T11:16:36.858042+0000","last_became_peered":"2024-04-26T11:16:36.858042+0000","last_unstale":"2024-04-26T11:16:36.863957+0000","last_undegraded":"2024-04-26T11:16:36.863957+0000","last_fullsized":"2024-04-26T11:16:36.863957+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:57:35.285183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862568+0000","last_change":"2024-04-26T11:16:36.867856+0000","last_active":"2024-04-26T11:16:38.862568+0000","last_peered":"2024-04-26T11:16:38.862568+0000","last_clean":"2024-04-26T11:16:38.862568+0000","last_became_active":"2024-04-26T11:16:36.865816+0000","last_became_peered":"2024-04-26T11:16:36.865816+0000","last_unstale":"2024-04-26T11:16:38.862568+0000","last_undegraded":"2024-04-26T11:16:38.862568+0000","last_fullsized":"2024-04-26T11:16:38.862568+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:35.210355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.853363+0000","last_change":"2024-04-26T11:16:35.854139+0000","last_active":"2024-04-26T11:16:35.853363+0000","last_peered":"2024-04-26T11:16:34.850014+0000","last_clean":"2024-04-26T11:13:54.337565+0000","last_became_active":"2024-04-26T11:13:58.346538+0000","last_became_peered":"2024-04-26T11:13:58.346538+0000","last_unstale":"2024-04-26T11:16:35.853363+0000","last_undegraded":"2024-04-26T11:16:35.853363+0000","last_fullsized":"2024-04-26T11:16:35.853363+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:35.209914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":73,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849560+0000","last_change":"2024-04-26T11:13:43.321498+0000","last_active":"2024-04-26T11:16:34.849560+0000","last_peered":"2024-04-26T11:16:34.849560+0000","last_clean":"2024-04-26T11:16:34.849560+0000","last_became_active":"2024-04-26T11:13:43.320420+0000","last_became_peered":"2024-04-26T11:13:43.320420+0000","last_unstale":"2024-04-26T11:16:34.849560+0000","last_undegraded":"2024-04-26T11:16:34.849560+0000","last_fullsized":"2024-04-26T11:16:34.849560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:06.135274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850670+0000","last_change":"2024-04-26T11:13:12.917812+0000","last_active":"2024-04-26T11:16:34.850670+0000","last_peered":"2024-04-26T11:16:34.850670+0000","last_clean":"2024-04-26T11:16:34.850670+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:16:34.850670+0000","last_undegraded":"2024-04-26T11:16:34.850670+0000","last_fullsized":"2024-04-26T11:16:34.850670+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":2,"reported_epoch":69,"state":"peering","last_fresh":"2024-04-26T11:14:06.583168+0000","last_change":"2024-04-26T11:16:39.863541+0000","last_active":"2024-04-26T11:16:39.863541+0000","last_peered":"2024-04-26T11:14:06.583168+0000","last_clean":"2024-04-26T11:14:06.583168+0000","last_became_active":"2024-04-26T11:13:43.321846+0000","last_became_peered":"2024-04-26T11:13:43.321846+0000","last_unstale":"2024-04-26T11:14:06.583168+0000","last_undegraded":"2024-04-26T11:14:06.583168+0000","last_fullsized":"2024-04-26T11:14:06.583168+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:14.138907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.869411+0000","last_change":"2024-04-26T11:16:36.865623+0000","last_active":"2024-04-26T11:16:36.869411+0000","last_peered":"2024-04-26T11:16:36.869411+0000","last_clean":"2024-04-26T11:16:36.869411+0000","last_became_active":"2024-04-26T11:16:36.864187+0000","last_became_peered":"2024-04-26T11:16:36.864187+0000","last_unstale":"2024-04-26T11:16:36.869411+0000","last_undegraded":"2024-04-26T11:16:36.869411+0000","last_fullsized":"2024-04-26T11:16:36.869411+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:25.032691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":72,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.858100+0000","last_change":"2024-04-26T11:16:35.858284+0000","last_active":"2024-04-26T11:16:35.858100+0000","last_peered":"2024-04-26T11:16:34.850560+0000","last_clean":"2024-04-26T11:13:54.340365+0000","last_became_active":"2024-04-26T11:13:58.349479+0000","last_became_peered":"2024-04-26T11:13:58.349479+0000","last_unstale":"2024-04-26T11:16:35.858100+0000","last_undegraded":"2024-04-26T11:16:35.858100+0000","last_fullsized":"2024-04-26T11:16:35.858100+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:25:53.597934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.870137+0000","last_change":"2024-04-26T11:16:36.865772+0000","last_active":"2024-04-26T11:16:36.870137+0000","last_peered":"2024-04-26T11:16:36.870137+0000","last_clean":"2024-04-26T11:16:36.870137+0000","last_became_active":"2024-04-26T11:16:36.865213+0000","last_became_peered":"2024-04-26T11:16:36.865213+0000","last_unstale":"2024-04-26T11:16:36.870137+0000","last_undegraded":"2024-04-26T11:16:36.870137+0000","last_fullsized":"2024-04-26T11:16:36.870137+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:03.220593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850169+0000","last_change":"2024-04-26T11:14:08.589726+0000","last_active":"2024-04-26T11:16:34.850169+0000","last_peered":"2024-04-26T11:16:34.850169+0000","last_clean":"2024-04-26T11:16:34.850169+0000","last_became_active":"2024-04-26T11:14:08.588687+0000","last_became_peered":"2024-04-26T11:14:08.588687+0000","last_unstale":"2024-04-26T11:16:34.850169+0000","last_undegraded":"2024-04-26T11:16:34.850169+0000","last_fullsized":"2024-04-26T11:16:34.850169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:05.617266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850283+0000","last_change":"2024-04-26T11:13:12.917763+0000","last_active":"2024-04-26T11:16:34.850283+0000","last_peered":"2024-04-26T11:16:34.850283+0000","last_clean":"2024-04-26T11:16:34.850283+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:16:34.850283+0000","last_undegraded":"2024-04-26T11:16:34.850283+0000","last_fullsized":"2024-04-26T11:16:34.850283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":2,"reported_epoch":69,"state":"peering","last_fresh":"2024-04-26T11:14:06.582422+0000","last_change":"2024-04-26T11:16:39.863687+0000","last_active":"2024-04-26T11:16:39.863687+0000","last_peered":"2024-04-26T11:14:06.582422+0000","last_clean":"2024-04-26T11:14:06.582422+0000","last_became_active":"2024-04-26T11:13:43.321829+0000","last_became_peered":"2024-04-26T11:13:43.321829+0000","last_unstale":"2024-04-26T11:14:06.582422+0000","last_undegraded":"2024-04-26T11:14:06.582422+0000","last_fullsized":"2024-04-26T11:14:06.582422+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:56.385417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.872318+0000","last_change":"2024-04-26T11:16:36.870651+0000","last_active":"2024-04-26T11:16:36.872318+0000","last_peered":"2024-04-26T11:16:36.872318+0000","last_clean":"2024-04-26T11:16:36.872318+0000","last_became_active":"2024-04-26T11:16:36.869018+0000","last_became_peered":"2024-04-26T11:16:36.869018+0000","last_unstale":"2024-04-26T11:16:36.872318+0000","last_undegraded":"2024-04-26T11:16:36.872318+0000","last_fullsized":"2024-04-26T11:16:36.872318+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:59.337390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871964+0000","last_change":"2024-04-26T11:16:36.870356+0000","last_active":"2024-04-26T11:16:36.871964+0000","last_peered":"2024-04-26T11:16:36.871964+0000","last_clean":"2024-04-26T11:16:36.871964+0000","last_became_active":"2024-04-26T11:16:36.868029+0000","last_became_peered":"2024-04-26T11:16:36.868029+0000","last_unstale":"2024-04-26T11:16:36.871964+0000","last_undegraded":"2024-04-26T11:16:36.871964+0000","last_fullsized":"2024-04-26T11:16:36.871964+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:13:24.219419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849594+0000","last_change":"2024-04-26T11:14:08.590838+0000","last_active":"2024-04-26T11:16:34.849594+0000","last_peered":"2024-04-26T11:16:34.849594+0000","last_clean":"2024-04-26T11:16:34.849594+0000","last_became_active":"2024-04-26T11:14:08.590386+0000","last_became_peered":"2024-04-26T11:14:08.590386+0000","last_unstale":"2024-04-26T11:16:34.849594+0000","last_undegraded":"2024-04-26T11:16:34.849594+0000","last_fullsized":"2024-04-26T11:16:34.849594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:50.791318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.854354+0000","last_change":"2024-04-26T11:16:35.854521+0000","last_active":"2024-04-26T11:16:35.854354+0000","last_peered":"2024-04-26T11:16:34.849726+0000","last_clean":"2024-04-26T11:13:54.337655+0000","last_became_active":"2024-04-26T11:13:58.349005+0000","last_became_peered":"2024-04-26T11:13:58.349005+0000","last_unstale":"2024-04-26T11:16:35.854354+0000","last_undegraded":"2024-04-26T11:16:35.854354+0000","last_fullsized":"2024-04-26T11:16:35.854354+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:25.369855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850253+0000","last_change":"2024-04-26T11:14:08.589117+0000","last_active":"2024-04-26T11:16:34.850253+0000","last_peered":"2024-04-26T11:16:34.850253+0000","last_clean":"2024-04-26T11:16:34.850253+0000","last_became_active":"2024-04-26T11:14:08.588762+0000","last_became_peered":"2024-04-26T11:14:08.588762+0000","last_unstale":"2024-04-26T11:16:34.850253+0000","last_undegraded":"2024-04-26T11:16:34.850253+0000","last_fullsized":"2024-04-26T11:16:34.850253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:05.658069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.856451+0000","last_change":"2024-04-26T11:16:35.856628+0000","last_active":"2024-04-26T11:16:35.856451+0000","last_peered":"2024-04-26T11:16:34.850819+0000","last_clean":"2024-04-26T11:13:54.340822+0000","last_became_active":"2024-04-26T11:13:58.349129+0000","last_became_peered":"2024-04-26T11:13:58.349129+0000","last_unstale":"2024-04-26T11:16:35.856451+0000","last_undegraded":"2024-04-26T11:16:35.856451+0000","last_fullsized":"2024-04-26T11:16:35.856451+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:41.218246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":3,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5470,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738412,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281024,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94090816,"statfs":{"total":96636764160,"available":96348995584,"internally_reserved":0,"allocated":1363968,"data_stored":874145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":1,"last update":"Fri Apr 26 11:16:17 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40200000000000002,"15min":0.378},"min":{"1min":0.20000000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.96499999999999997,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.44400000000000001,"15min":0.44600000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.57599999999999996,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.621}]}]},{"osd":0,"up_from":67,"seq":287762808834,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40348,"kb_used_data":1360,"kb_used_omap":6,"kb_used_meta":38969,"kb_avail":94331492,"statfs":{"total":96636764160,"available":96595447808,"internally_reserved":0,"allocated":1392640,"data_stored":889273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7064,"internal_metadata":39904360},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738413,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401004,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":400254,"kb_avail":93970836,"statfs":{"total":96636764160,"available":96226136064,"internally_reserved":0,"allocated":753664,"data_stored":283176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":409860550},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23400000000000001}]},{"osd":2,"last update":"Fri Apr 26 11:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.40300000000000002,"15min":0.39300000000000002},"min":{"1min":0.14999999999999999,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.61299999999999999,"5min":2.056,"15min":2.056},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.47899999999999998,"15min":0.45700000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":3.9609999999999999,"5min":3.9609999999999999,"15min":3.9609999999999999},"last":0.47399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5470,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:16:41.660 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T11:16:42.116 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:16:42.116 INFO:teuthology.orchestra.run.smithi029.stdout:{"fsid":"2b52ce04-9559-478f-9787-c3cc3b261c15","health":{"status":"HEALTH_WARN","checks":{"PG_AVAILABILITY":{"severity":"HEALTH_WARN","summary":{"message":"Reduced data availability: 4 pgs inactive, 6 pgs peering","count":10},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":223,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":71,"num_osds":3,"num_up_osds":3,"osd_up_since":1714130195,"num_in_osds":3,"osd_in_since":1714129979,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":82},{"state_name":"peering","count":23}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592730,"bytes_used":739713024,"bytes_avail":289170579456,"bytes_total":289910292480,"inactive_pgs_ratio":0.21904762089252472,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":124,"recovering_keys_per_sec":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4193}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-04-26T11:14:18.463533+0000","services":{}},"progress_events":{}} 2024-04-26T11:16:42.130 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-26T11:16:42.130 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:16:42.475 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:16:42.477 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:16:42.486 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-04-26T11:16:40.870395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":3,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":216,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":722376,"kb_used_data":3428,"kb_used_omap":10,"kb_used_meta":718901,"kb_avail":282393144,"statfs":{"total":289910292480,"available":289170579456,"internally_reserved":0,"allocated":3510272,"data_stored":2046594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10252,"internal_metadata":736155636},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":3,"num_objects_degraded":-20,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.363952"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.851235+0000","last_change":"2024-04-26T11:13:12.919196+0000","last_active":"2024-04-26T11:16:34.851235+0000","last_peered":"2024-04-26T11:16:34.851235+0000","last_clean":"2024-04-26T11:16:34.851235+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:16:34.851235+0000","last_undegraded":"2024-04-26T11:16:34.851235+0000","last_fullsized":"2024-04-26T11:16:34.851235+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850200+0000","last_change":"2024-04-26T11:13:12.917670+0000","last_active":"2024-04-26T11:16:34.850200+0000","last_peered":"2024-04-26T11:16:34.850200+0000","last_clean":"2024-04-26T11:16:34.850200+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:16:34.850200+0000","last_undegraded":"2024-04-26T11:16:34.850200+0000","last_fullsized":"2024-04-26T11:16:34.850200+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.870181+0000","last_change":"2024-04-26T11:16:36.866575+0000","last_active":"2024-04-26T11:16:36.870181+0000","last_peered":"2024-04-26T11:16:36.870181+0000","last_clean":"2024-04-26T11:16:36.870181+0000","last_became_active":"2024-04-26T11:16:36.864565+0000","last_became_peered":"2024-04-26T11:16:36.864565+0000","last_unstale":"2024-04-26T11:16:36.870181+0000","last_undegraded":"2024-04-26T11:16:36.870181+0000","last_fullsized":"2024-04-26T11:16:36.870181+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:38.756428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871248+0000","last_change":"2024-04-26T11:16:36.868086+0000","last_active":"2024-04-26T11:16:36.871248+0000","last_peered":"2024-04-26T11:16:36.871248+0000","last_clean":"2024-04-26T11:16:36.871248+0000","last_became_active":"2024-04-26T11:16:36.865679+0000","last_became_peered":"2024-04-26T11:16:36.865679+0000","last_unstale":"2024-04-26T11:16:36.871248+0000","last_undegraded":"2024-04-26T11:16:36.871248+0000","last_fullsized":"2024-04-26T11:16:36.871248+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:22.051599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849437+0000","last_change":"2024-04-26T11:13:12.917403+0000","last_active":"2024-04-26T11:16:34.849437+0000","last_peered":"2024-04-26T11:16:34.849437+0000","last_clean":"2024-04-26T11:16:34.849437+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:16:34.849437+0000","last_undegraded":"2024-04-26T11:16:34.849437+0000","last_fullsized":"2024-04-26T11:16:34.849437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:42.014955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871352+0000","last_change":"2024-04-26T11:16:36.868338+0000","last_active":"2024-04-26T11:16:36.871352+0000","last_peered":"2024-04-26T11:16:36.871352+0000","last_clean":"2024-04-26T11:16:36.871352+0000","last_became_active":"2024-04-26T11:16:36.867049+0000","last_became_peered":"2024-04-26T11:16:36.867049+0000","last_unstale":"2024-04-26T11:16:36.871352+0000","last_undegraded":"2024-04-26T11:16:36.871352+0000","last_fullsized":"2024-04-26T11:16:36.871352+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:57.262622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.864496+0000","last_change":"2024-04-26T11:16:36.860337+0000","last_active":"2024-04-26T11:16:36.864496+0000","last_peered":"2024-04-26T11:16:36.864496+0000","last_clean":"2024-04-26T11:16:36.864496+0000","last_became_active":"2024-04-26T11:16:36.859342+0000","last_became_peered":"2024-04-26T11:16:36.859342+0000","last_unstale":"2024-04-26T11:16:36.864496+0000","last_undegraded":"2024-04-26T11:16:36.864496+0000","last_fullsized":"2024-04-26T11:16:36.864496+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:23.653811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.870476+0000","last_change":"2024-04-26T11:16:36.863996+0000","last_active":"2024-04-26T11:16:36.870476+0000","last_peered":"2024-04-26T11:16:36.870476+0000","last_clean":"2024-04-26T11:16:36.870476+0000","last_became_active":"2024-04-26T11:16:36.863048+0000","last_became_peered":"2024-04-26T11:16:36.863048+0000","last_unstale":"2024-04-26T11:16:36.870476+0000","last_undegraded":"2024-04-26T11:16:36.870476+0000","last_fullsized":"2024-04-26T11:16:36.870476+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:42.503116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":47,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T11:16:35.853449+0000","last_change":"2024-04-26T11:14:08.592223+0000","last_active":"2024-04-26T11:16:35.853449+0000","last_peered":"2024-04-26T11:16:35.853449+0000","last_clean":"2024-04-26T11:16:35.853449+0000","last_became_active":"2024-04-26T11:14:08.591660+0000","last_became_peered":"2024-04-26T11:14:08.591660+0000","last_unstale":"2024-04-26T11:16:35.853449+0000","last_undegraded":"2024-04-26T11:16:35.853449+0000","last_fullsized":"2024-04-26T11:16:35.853449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:06.208634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850628+0000","last_change":"2024-04-26T11:13:12.918521+0000","last_active":"2024-04-26T11:16:34.850628+0000","last_peered":"2024-04-26T11:16:34.850628+0000","last_clean":"2024-04-26T11:16:34.850628+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:16:34.850628+0000","last_undegraded":"2024-04-26T11:16:34.850628+0000","last_fullsized":"2024-04-26T11:16:34.850628+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":2,"reported_epoch":69,"state":"peering","last_fresh":"2024-04-26T11:14:08.583071+0000","last_change":"2024-04-26T11:13:42.306377+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:14:08.583071+0000","last_undegraded":"2024-04-26T11:14:08.583071+0000","last_fullsized":"2024-04-26T11:14:08.583071+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:54.379763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.852956+0000","last_change":"2024-04-26T11:16:35.854908+0000","last_active":"2024-04-26T11:16:35.852956+0000","last_peered":"2024-04-26T11:16:34.850106+0000","last_clean":"2024-04-26T11:13:54.340528+0000","last_became_active":"2024-04-26T11:13:58.346341+0000","last_became_peered":"2024-04-26T11:13:58.346341+0000","last_unstale":"2024-04-26T11:16:35.852956+0000","last_undegraded":"2024-04-26T11:16:35.852956+0000","last_fullsized":"2024-04-26T11:16:35.852956+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:56.481301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849691+0000","last_change":"2024-04-26T11:13:12.915484+0000","last_active":"2024-04-26T11:16:34.849691+0000","last_peered":"2024-04-26T11:16:34.849691+0000","last_clean":"2024-04-26T11:16:34.849691+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:16:34.849691+0000","last_undegraded":"2024-04-26T11:16:34.849691+0000","last_fullsized":"2024-04-26T11:16:34.849691+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.869304+0000","last_change":"2024-04-26T11:16:36.865308+0000","last_active":"2024-04-26T11:16:36.869304+0000","last_peered":"2024-04-26T11:16:36.869304+0000","last_clean":"2024-04-26T11:16:36.869304+0000","last_became_active":"2024-04-26T11:16:36.864119+0000","last_became_peered":"2024-04-26T11:16:36.864119+0000","last_unstale":"2024-04-26T11:16:36.869304+0000","last_undegraded":"2024-04-26T11:16:36.869304+0000","last_fullsized":"2024-04-26T11:16:36.869304+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:29.265536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":2,"reported_epoch":69,"state":"peering","last_fresh":"2024-04-26T11:13:43.317311+0000","last_change":"2024-04-26T11:13:42.309392+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:43.317311+0000","last_undegraded":"2024-04-26T11:13:43.317311+0000","last_fullsized":"2024-04-26T11:13:43.317311+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:45.107551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871462+0000","last_change":"2024-04-26T11:16:36.868941+0000","last_active":"2024-04-26T11:16:36.871462+0000","last_peered":"2024-04-26T11:16:36.871462+0000","last_clean":"2024-04-26T11:16:36.871462+0000","last_became_active":"2024-04-26T11:16:36.864605+0000","last_became_peered":"2024-04-26T11:16:36.864605+0000","last_unstale":"2024-04-26T11:16:36.871462+0000","last_undegraded":"2024-04-26T11:16:36.871462+0000","last_fullsized":"2024-04-26T11:16:36.871462+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:26.687980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850921+0000","last_change":"2024-04-26T11:14:08.592349+0000","last_active":"2024-04-26T11:16:34.850921+0000","last_peered":"2024-04-26T11:16:34.850921+0000","last_clean":"2024-04-26T11:16:34.850921+0000","last_became_active":"2024-04-26T11:14:08.591886+0000","last_became_peered":"2024-04-26T11:14:08.591886+0000","last_unstale":"2024-04-26T11:16:34.850921+0000","last_undegraded":"2024-04-26T11:16:34.850921+0000","last_fullsized":"2024-04-26T11:16:34.850921+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:29.835852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850742+0000","last_change":"2024-04-26T11:13:12.918759+0000","last_active":"2024-04-26T11:16:34.850742+0000","last_peered":"2024-04-26T11:16:34.850742+0000","last_clean":"2024-04-26T11:16:34.850742+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:16:34.850742+0000","last_undegraded":"2024-04-26T11:16:34.850742+0000","last_fullsized":"2024-04-26T11:16:34.850742+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:55.002972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850968+0000","last_change":"2024-04-26T11:14:08.591804+0000","last_active":"2024-04-26T11:16:34.850968+0000","last_peered":"2024-04-26T11:16:34.850968+0000","last_clean":"2024-04-26T11:16:34.850968+0000","last_became_active":"2024-04-26T11:14:08.591519+0000","last_became_peered":"2024-04-26T11:14:08.591519+0000","last_unstale":"2024-04-26T11:16:34.850968+0000","last_undegraded":"2024-04-26T11:16:34.850968+0000","last_fullsized":"2024-04-26T11:16:34.850968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:00:27.447921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871384+0000","last_change":"2024-04-26T11:16:36.868357+0000","last_active":"2024-04-26T11:16:36.871384+0000","last_peered":"2024-04-26T11:16:36.871384+0000","last_clean":"2024-04-26T11:16:36.871384+0000","last_became_active":"2024-04-26T11:16:36.866698+0000","last_became_peered":"2024-04-26T11:16:36.866698+0000","last_unstale":"2024-04-26T11:16:36.871384+0000","last_undegraded":"2024-04-26T11:16:36.871384+0000","last_fullsized":"2024-04-26T11:16:36.871384+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:56.560147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.868372+0000","last_change":"2024-04-26T11:16:36.864212+0000","last_active":"2024-04-26T11:16:36.868372+0000","last_peered":"2024-04-26T11:16:36.868372+0000","last_clean":"2024-04-26T11:16:36.868372+0000","last_became_active":"2024-04-26T11:16:36.862787+0000","last_became_peered":"2024-04-26T11:16:36.862787+0000","last_unstale":"2024-04-26T11:16:36.868372+0000","last_undegraded":"2024-04-26T11:16:36.868372+0000","last_fullsized":"2024-04-26T11:16:36.868372+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:50.035179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.851719+0000","last_change":"2024-04-26T11:16:35.851923+0000","last_active":"2024-04-26T11:16:35.851719+0000","last_peered":"2024-04-26T11:16:34.849524+0000","last_clean":"2024-04-26T11:13:54.337507+0000","last_became_active":"2024-04-26T11:13:58.346333+0000","last_became_peered":"2024-04-26T11:13:58.346333+0000","last_unstale":"2024-04-26T11:16:35.851719+0000","last_undegraded":"2024-04-26T11:16:35.851719+0000","last_fullsized":"2024-04-26T11:16:35.851719+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:18:40.907075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862003+0000","last_change":"2024-04-26T11:16:36.865177+0000","last_active":"2024-04-26T11:16:38.862003+0000","last_peered":"2024-04-26T11:16:38.862003+0000","last_clean":"2024-04-26T11:16:38.862003+0000","last_became_active":"2024-04-26T11:16:36.864276+0000","last_became_peered":"2024-04-26T11:16:36.864276+0000","last_unstale":"2024-04-26T11:16:38.862003+0000","last_undegraded":"2024-04-26T11:16:38.862003+0000","last_fullsized":"2024-04-26T11:16:38.862003+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:21.982286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849609+0000","last_change":"2024-04-26T11:13:12.912756+0000","last_active":"2024-04-26T11:16:34.849609+0000","last_peered":"2024-04-26T11:16:34.849609+0000","last_clean":"2024-04-26T11:16:34.849609+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:16:34.849609+0000","last_undegraded":"2024-04-26T11:16:34.849609+0000","last_fullsized":"2024-04-26T11:16:34.849609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:04.177831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.856554+0000","last_change":"2024-04-26T11:16:35.857313+0000","last_active":"2024-04-26T11:16:35.856554+0000","last_peered":"2024-04-26T11:16:34.851220+0000","last_clean":"2024-04-26T11:13:54.340820+0000","last_became_active":"2024-04-26T11:13:58.351912+0000","last_became_peered":"2024-04-26T11:13:58.351912+0000","last_unstale":"2024-04-26T11:16:35.856554+0000","last_undegraded":"2024-04-26T11:16:35.856554+0000","last_fullsized":"2024-04-26T11:16:35.856554+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:00.997636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862718+0000","last_change":"2024-04-26T11:16:36.868960+0000","last_active":"2024-04-26T11:16:38.862718+0000","last_peered":"2024-04-26T11:16:38.862718+0000","last_clean":"2024-04-26T11:16:38.862718+0000","last_became_active":"2024-04-26T11:16:36.868050+0000","last_became_peered":"2024-04-26T11:16:36.868050+0000","last_unstale":"2024-04-26T11:16:38.862718+0000","last_undegraded":"2024-04-26T11:16:38.862718+0000","last_fullsized":"2024-04-26T11:16:38.862718+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:28.198210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.870640+0000","last_change":"2024-04-26T11:16:36.867664+0000","last_active":"2024-04-26T11:16:36.870640+0000","last_peered":"2024-04-26T11:16:36.870640+0000","last_clean":"2024-04-26T11:16:36.870640+0000","last_became_active":"2024-04-26T11:16:36.865582+0000","last_became_peered":"2024-04-26T11:16:36.865582+0000","last_unstale":"2024-04-26T11:16:36.870640+0000","last_undegraded":"2024-04-26T11:16:36.870640+0000","last_fullsized":"2024-04-26T11:16:36.870640+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:24.063678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":65,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849385+0000","last_change":"2024-04-26T11:13:12.493425+0000","last_active":"2024-04-26T11:16:34.849385+0000","last_peered":"2024-04-26T11:16:34.849385+0000","last_clean":"2024-04-26T11:16:34.849385+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:16:34.849385+0000","last_undegraded":"2024-04-26T11:16:34.849385+0000","last_fullsized":"2024-04-26T11:16:34.849385+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:23.279580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.858633+0000","last_change":"2024-04-26T11:16:35.858771+0000","last_active":"2024-04-26T11:16:35.858633+0000","last_peered":"2024-04-26T11:16:34.850851+0000","last_clean":"2024-04-26T11:13:54.340499+0000","last_became_active":"2024-04-26T11:13:58.349652+0000","last_became_peered":"2024-04-26T11:13:58.349652+0000","last_unstale":"2024-04-26T11:16:35.858633+0000","last_undegraded":"2024-04-26T11:16:35.858633+0000","last_fullsized":"2024-04-26T11:16:35.858633+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:28.176115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":2,"reported_epoch":69,"state":"peering","last_fresh":"2024-04-26T11:14:08.582802+0000","last_change":"2024-04-26T11:13:42.306227+0000","last_active":"2024-04-26T11:13:42.306070+0000","last_peered":"2024-04-26T11:13:39.301410+0000","last_clean":"2024-04-26T11:13:39.301410+0000","last_became_active":"2024-04-26T11:13:12.488819+0000","last_became_peered":"2024-04-26T11:13:12.488819+0000","last_unstale":"2024-04-26T11:14:08.582802+0000","last_undegraded":"2024-04-26T11:14:08.582802+0000","last_fullsized":"2024-04-26T11:14:08.582802+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:48.191394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862478+0000","last_change":"2024-04-26T11:16:36.866812+0000","last_active":"2024-04-26T11:16:38.862478+0000","last_peered":"2024-04-26T11:16:38.862478+0000","last_clean":"2024-04-26T11:16:38.862478+0000","last_became_active":"2024-04-26T11:16:36.865841+0000","last_became_peered":"2024-04-26T11:16:36.865841+0000","last_unstale":"2024-04-26T11:16:38.862478+0000","last_undegraded":"2024-04-26T11:16:38.862478+0000","last_fullsized":"2024-04-26T11:16:38.862478+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:20.948589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T11:16:35.852313+0000","last_change":"2024-04-26T11:14:08.589659+0000","last_active":"2024-04-26T11:16:35.852313+0000","last_peered":"2024-04-26T11:16:35.852313+0000","last_clean":"2024-04-26T11:16:35.852313+0000","last_became_active":"2024-04-26T11:14:08.589404+0000","last_became_peered":"2024-04-26T11:14:08.589404+0000","last_unstale":"2024-04-26T11:16:35.852313+0000","last_undegraded":"2024-04-26T11:16:35.852313+0000","last_fullsized":"2024-04-26T11:16:35.852313+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:29.354141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.856412+0000","last_change":"2024-04-26T11:16:35.856596+0000","last_active":"2024-04-26T11:16:35.856412+0000","last_peered":"2024-04-26T11:16:34.851133+0000","last_clean":"2024-04-26T11:13:54.340778+0000","last_became_active":"2024-04-26T11:13:58.351797+0000","last_became_peered":"2024-04-26T11:13:58.351797+0000","last_unstale":"2024-04-26T11:16:35.856412+0000","last_undegraded":"2024-04-26T11:16:35.856412+0000","last_fullsized":"2024-04-26T11:16:35.856412+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:56.030721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862900+0000","last_change":"2024-04-26T11:16:36.870740+0000","last_active":"2024-04-26T11:16:38.862900+0000","last_peered":"2024-04-26T11:16:38.862900+0000","last_clean":"2024-04-26T11:16:38.862900+0000","last_became_active":"2024-04-26T11:16:36.865334+0000","last_became_peered":"2024-04-26T11:16:36.865334+0000","last_unstale":"2024-04-26T11:16:38.862900+0000","last_undegraded":"2024-04-26T11:16:38.862900+0000","last_fullsized":"2024-04-26T11:16:38.862900+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:46.263242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849390+0000","last_change":"2024-04-26T11:14:08.588941+0000","last_active":"2024-04-26T11:16:34.849390+0000","last_peered":"2024-04-26T11:16:34.849390+0000","last_clean":"2024-04-26T11:16:34.849390+0000","last_became_active":"2024-04-26T11:14:08.588699+0000","last_became_peered":"2024-04-26T11:14:08.588699+0000","last_unstale":"2024-04-26T11:16:34.849390+0000","last_undegraded":"2024-04-26T11:16:34.849390+0000","last_fullsized":"2024-04-26T11:16:34.849390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:05.957122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.864080+0000","last_change":"2024-04-26T11:16:36.861341+0000","last_active":"2024-04-26T11:16:36.864080+0000","last_peered":"2024-04-26T11:16:36.864080+0000","last_clean":"2024-04-26T11:16:36.864080+0000","last_became_active":"2024-04-26T11:16:36.860498+0000","last_became_peered":"2024-04-26T11:16:36.860498+0000","last_unstale":"2024-04-26T11:16:36.864080+0000","last_undegraded":"2024-04-26T11:16:36.864080+0000","last_fullsized":"2024-04-26T11:16:36.864080+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:12.295055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.861846+0000","last_change":"2024-04-26T11:16:36.861607+0000","last_active":"2024-04-26T11:16:38.861846+0000","last_peered":"2024-04-26T11:16:38.861846+0000","last_clean":"2024-04-26T11:16:38.861846+0000","last_became_active":"2024-04-26T11:16:36.860624+0000","last_became_peered":"2024-04-26T11:16:36.860624+0000","last_unstale":"2024-04-26T11:16:38.861846+0000","last_undegraded":"2024-04-26T11:16:38.861846+0000","last_fullsized":"2024-04-26T11:16:38.861846+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:52.246126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":73,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.857757+0000","last_change":"2024-04-26T11:16:35.857926+0000","last_active":"2024-04-26T11:16:35.857757+0000","last_peered":"2024-04-26T11:16:34.850584+0000","last_clean":"2024-04-26T11:13:54.340344+0000","last_became_active":"2024-04-26T11:13:58.349342+0000","last_became_peered":"2024-04-26T11:13:58.349342+0000","last_unstale":"2024-04-26T11:16:35.857757+0000","last_undegraded":"2024-04-26T11:16:35.857757+0000","last_fullsized":"2024-04-26T11:16:35.857757+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:25.155273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850289+0000","last_change":"2024-04-26T11:14:08.590078+0000","last_active":"2024-04-26T11:16:34.850289+0000","last_peered":"2024-04-26T11:16:34.850289+0000","last_clean":"2024-04-26T11:16:34.850289+0000","last_became_active":"2024-04-26T11:14:08.589497+0000","last_became_peered":"2024-04-26T11:14:08.589497+0000","last_unstale":"2024-04-26T11:16:34.850289+0000","last_undegraded":"2024-04-26T11:16:34.850289+0000","last_fullsized":"2024-04-26T11:16:34.850289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:21.955581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":28,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.869351+0000","last_change":"2024-04-26T11:16:36.863969+0000","last_active":"2024-04-26T11:16:36.869351+0000","last_peered":"2024-04-26T11:16:36.869351+0000","last_clean":"2024-04-26T11:16:36.869351+0000","last_became_active":"2024-04-26T11:16:36.863038+0000","last_became_peered":"2024-04-26T11:16:36.863038+0000","last_unstale":"2024-04-26T11:16:36.869351+0000","last_undegraded":"2024-04-26T11:16:36.869351+0000","last_fullsized":"2024-04-26T11:16:36.869351+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:18.680458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.868352+0000","last_change":"2024-04-26T11:16:36.863400+0000","last_active":"2024-04-26T11:16:36.868352+0000","last_peered":"2024-04-26T11:16:36.868352+0000","last_clean":"2024-04-26T11:16:36.868352+0000","last_became_active":"2024-04-26T11:16:36.861887+0000","last_became_peered":"2024-04-26T11:16:36.861887+0000","last_unstale":"2024-04-26T11:16:36.868352+0000","last_undegraded":"2024-04-26T11:16:36.868352+0000","last_fullsized":"2024-04-26T11:16:36.868352+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:58.091135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":23,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.868328+0000","last_change":"2024-04-26T11:16:36.863160+0000","last_active":"2024-04-26T11:16:36.868328+0000","last_peered":"2024-04-26T11:16:36.868328+0000","last_clean":"2024-04-26T11:16:36.868328+0000","last_became_active":"2024-04-26T11:16:36.861563+0000","last_became_peered":"2024-04-26T11:16:36.861563+0000","last_unstale":"2024-04-26T11:16:36.868328+0000","last_undegraded":"2024-04-26T11:16:36.868328+0000","last_fullsized":"2024-04-26T11:16:36.868328+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:32.284607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850537+0000","last_change":"2024-04-26T11:13:12.916685+0000","last_active":"2024-04-26T11:16:34.850537+0000","last_peered":"2024-04-26T11:16:34.850537+0000","last_clean":"2024-04-26T11:16:34.850537+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:16:34.850537+0000","last_undegraded":"2024-04-26T11:16:34.850537+0000","last_fullsized":"2024-04-26T11:16:34.850537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.861955+0000","last_change":"2024-04-26T11:16:36.862068+0000","last_active":"2024-04-26T11:16:38.861955+0000","last_peered":"2024-04-26T11:16:38.861955+0000","last_clean":"2024-04-26T11:16:38.861955+0000","last_became_active":"2024-04-26T11:16:36.860845+0000","last_became_peered":"2024-04-26T11:16:36.860845+0000","last_unstale":"2024-04-26T11:16:38.861955+0000","last_undegraded":"2024-04-26T11:16:38.861955+0000","last_fullsized":"2024-04-26T11:16:38.861955+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:54.740487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850748+0000","last_change":"2024-04-26T11:13:12.915238+0000","last_active":"2024-04-26T11:16:34.850748+0000","last_peered":"2024-04-26T11:16:34.850748+0000","last_clean":"2024-04-26T11:16:34.850748+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:16:34.850748+0000","last_undegraded":"2024-04-26T11:16:34.850748+0000","last_fullsized":"2024-04-26T11:16:34.850748+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:48.068465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":70,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.851874+0000","last_change":"2024-04-26T11:16:35.852036+0000","last_active":"2024-04-26T11:16:35.851874+0000","last_peered":"2024-04-26T11:16:34.849749+0000","last_clean":"2024-04-26T11:13:54.337541+0000","last_became_active":"2024-04-26T11:13:58.348978+0000","last_became_peered":"2024-04-26T11:13:58.348978+0000","last_unstale":"2024-04-26T11:16:35.851874+0000","last_undegraded":"2024-04-26T11:16:35.851874+0000","last_fullsized":"2024-04-26T11:16:35.851874+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:09.159278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862619+0000","last_change":"2024-04-26T11:16:36.869499+0000","last_active":"2024-04-26T11:16:38.862619+0000","last_peered":"2024-04-26T11:16:38.862619+0000","last_clean":"2024-04-26T11:16:38.862619+0000","last_became_active":"2024-04-26T11:16:36.868256+0000","last_became_peered":"2024-04-26T11:16:36.868256+0000","last_unstale":"2024-04-26T11:16:38.862619+0000","last_undegraded":"2024-04-26T11:16:38.862619+0000","last_fullsized":"2024-04-26T11:16:38.862619+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:02.923235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":24,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871953+0000","last_change":"2024-04-26T11:16:36.870080+0000","last_active":"2024-04-26T11:16:36.871953+0000","last_peered":"2024-04-26T11:16:36.871953+0000","last_clean":"2024-04-26T11:16:36.871953+0000","last_became_active":"2024-04-26T11:16:36.867077+0000","last_became_peered":"2024-04-26T11:16:36.867077+0000","last_unstale":"2024-04-26T11:16:36.871953+0000","last_undegraded":"2024-04-26T11:16:36.871953+0000","last_fullsized":"2024-04-26T11:16:36.871953+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:25.497636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862804+0000","last_change":"2024-04-26T11:16:36.862068+0000","last_active":"2024-04-26T11:16:38.862804+0000","last_peered":"2024-04-26T11:16:38.862804+0000","last_clean":"2024-04-26T11:16:38.862804+0000","last_became_active":"2024-04-26T11:16:36.860565+0000","last_became_peered":"2024-04-26T11:16:36.860565+0000","last_unstale":"2024-04-26T11:16:38.862804+0000","last_undegraded":"2024-04-26T11:16:38.862804+0000","last_fullsized":"2024-04-26T11:16:38.862804+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:38:14.430827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":23,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.866965+0000","last_change":"2024-04-26T11:16:36.861810+0000","last_active":"2024-04-26T11:16:36.866965+0000","last_peered":"2024-04-26T11:16:36.866965+0000","last_clean":"2024-04-26T11:16:36.866965+0000","last_became_active":"2024-04-26T11:16:36.860299+0000","last_became_peered":"2024-04-26T11:16:36.860299+0000","last_unstale":"2024-04-26T11:16:36.866965+0000","last_undegraded":"2024-04-26T11:16:36.866965+0000","last_fullsized":"2024-04-26T11:16:36.866965+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:13.262452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.851523+0000","last_change":"2024-04-26T11:16:35.851691+0000","last_active":"2024-04-26T11:16:35.851523+0000","last_peered":"2024-04-26T11:16:34.849205+0000","last_clean":"2024-04-26T11:13:54.338893+0000","last_became_active":"2024-04-26T11:13:58.345004+0000","last_became_peered":"2024-04-26T11:13:58.345004+0000","last_unstale":"2024-04-26T11:16:35.851523+0000","last_undegraded":"2024-04-26T11:16:35.851523+0000","last_fullsized":"2024-04-26T11:16:35.851523+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:13.889611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":72,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.854828+0000","last_change":"2024-04-26T11:16:35.856366+0000","last_active":"2024-04-26T11:16:35.854828+0000","last_peered":"2024-04-26T11:16:34.850489+0000","last_clean":"2024-04-26T11:13:54.341218+0000","last_became_active":"2024-04-26T11:13:58.349390+0000","last_became_peered":"2024-04-26T11:13:58.349390+0000","last_unstale":"2024-04-26T11:16:35.854828+0000","last_undegraded":"2024-04-26T11:16:35.854828+0000","last_fullsized":"2024-04-26T11:16:35.854828+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:00.368944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850144+0000","last_change":"2024-04-26T11:13:12.912207+0000","last_active":"2024-04-26T11:16:34.850144+0000","last_peered":"2024-04-26T11:16:34.850144+0000","last_clean":"2024-04-26T11:16:34.850144+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:16:34.850144+0000","last_undegraded":"2024-04-26T11:16:34.850144+0000","last_fullsized":"2024-04-26T11:16:34.850144+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":23,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.868015+0000","last_change":"2024-04-26T11:16:36.861887+0000","last_active":"2024-04-26T11:16:36.868015+0000","last_peered":"2024-04-26T11:16:36.868015+0000","last_clean":"2024-04-26T11:16:36.868015+0000","last_became_active":"2024-04-26T11:16:36.861385+0000","last_became_peered":"2024-04-26T11:16:36.861385+0000","last_unstale":"2024-04-26T11:16:36.868015+0000","last_undegraded":"2024-04-26T11:16:36.868015+0000","last_fullsized":"2024-04-26T11:16:36.868015+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:59.045795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.870155+0000","last_change":"2024-04-26T11:16:36.866558+0000","last_active":"2024-04-26T11:16:36.870155+0000","last_peered":"2024-04-26T11:16:36.870155+0000","last_clean":"2024-04-26T11:16:36.870155+0000","last_became_active":"2024-04-26T11:16:36.865645+0000","last_became_peered":"2024-04-26T11:16:36.865645+0000","last_unstale":"2024-04-26T11:16:36.870155+0000","last_undegraded":"2024-04-26T11:16:36.870155+0000","last_fullsized":"2024-04-26T11:16:36.870155+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:26.653256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871699+0000","last_change":"2024-04-26T11:16:36.869527+0000","last_active":"2024-04-26T11:16:36.871699+0000","last_peered":"2024-04-26T11:16:36.871699+0000","last_clean":"2024-04-26T11:16:36.871699+0000","last_became_active":"2024-04-26T11:16:36.869081+0000","last_became_peered":"2024-04-26T11:16:36.869081+0000","last_unstale":"2024-04-26T11:16:36.871699+0000","last_undegraded":"2024-04-26T11:16:36.871699+0000","last_fullsized":"2024-04-26T11:16:36.871699+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:25.536503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862609+0000","last_change":"2024-04-26T11:16:36.867197+0000","last_active":"2024-04-26T11:16:38.862609+0000","last_peered":"2024-04-26T11:16:38.862609+0000","last_clean":"2024-04-26T11:16:38.862609+0000","last_became_active":"2024-04-26T11:16:36.866699+0000","last_became_peered":"2024-04-26T11:16:36.866699+0000","last_unstale":"2024-04-26T11:16:38.862609+0000","last_undegraded":"2024-04-26T11:16:38.862609+0000","last_fullsized":"2024-04-26T11:16:38.862609+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:10.074682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":22,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862680+0000","last_change":"2024-04-26T11:16:36.866905+0000","last_active":"2024-04-26T11:16:38.862680+0000","last_peered":"2024-04-26T11:16:38.862680+0000","last_clean":"2024-04-26T11:16:38.862680+0000","last_became_active":"2024-04-26T11:16:36.865531+0000","last_became_peered":"2024-04-26T11:16:36.865531+0000","last_unstale":"2024-04-26T11:16:38.862680+0000","last_undegraded":"2024-04-26T11:16:38.862680+0000","last_fullsized":"2024-04-26T11:16:38.862680+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:16.961092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871146+0000","last_change":"2024-04-26T11:16:36.867822+0000","last_active":"2024-04-26T11:16:36.871146+0000","last_peered":"2024-04-26T11:16:36.871146+0000","last_clean":"2024-04-26T11:16:36.871146+0000","last_became_active":"2024-04-26T11:16:36.865633+0000","last_became_peered":"2024-04-26T11:16:36.865633+0000","last_unstale":"2024-04-26T11:16:36.871146+0000","last_undegraded":"2024-04-26T11:16:36.871146+0000","last_fullsized":"2024-04-26T11:16:36.871146+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:07.461066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.867886+0000","last_change":"2024-04-26T11:16:36.861799+0000","last_active":"2024-04-26T11:16:36.867886+0000","last_peered":"2024-04-26T11:16:36.867886+0000","last_clean":"2024-04-26T11:16:36.867886+0000","last_became_active":"2024-04-26T11:16:36.860707+0000","last_became_peered":"2024-04-26T11:16:36.860707+0000","last_unstale":"2024-04-26T11:16:36.867886+0000","last_undegraded":"2024-04-26T11:16:36.867886+0000","last_fullsized":"2024-04-26T11:16:36.867886+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:04.733669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.870621+0000","last_change":"2024-04-26T11:16:36.866866+0000","last_active":"2024-04-26T11:16:36.870621+0000","last_peered":"2024-04-26T11:16:36.870621+0000","last_clean":"2024-04-26T11:16:36.870621+0000","last_became_active":"2024-04-26T11:16:36.865663+0000","last_became_peered":"2024-04-26T11:16:36.865663+0000","last_unstale":"2024-04-26T11:16:36.870621+0000","last_undegraded":"2024-04-26T11:16:36.870621+0000","last_fullsized":"2024-04-26T11:16:36.870621+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:40:33.235331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":70,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.851540+0000","last_change":"2024-04-26T11:16:35.851691+0000","last_active":"2024-04-26T11:16:35.851540+0000","last_peered":"2024-04-26T11:16:34.849424+0000","last_clean":"2024-04-26T11:13:54.337409+0000","last_became_active":"2024-04-26T11:13:58.346295+0000","last_became_peered":"2024-04-26T11:13:58.346295+0000","last_unstale":"2024-04-26T11:16:35.851540+0000","last_undegraded":"2024-04-26T11:16:35.851540+0000","last_fullsized":"2024-04-26T11:16:35.851540+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:58.190995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.864154+0000","last_change":"2024-04-26T11:16:36.861324+0000","last_active":"2024-04-26T11:16:36.864154+0000","last_peered":"2024-04-26T11:16:36.864154+0000","last_clean":"2024-04-26T11:16:36.864154+0000","last_became_active":"2024-04-26T11:16:36.859490+0000","last_became_peered":"2024-04-26T11:16:36.859490+0000","last_unstale":"2024-04-26T11:16:36.864154+0000","last_undegraded":"2024-04-26T11:16:36.864154+0000","last_fullsized":"2024-04-26T11:16:36.864154+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:08.842836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":64,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849544+0000","last_change":"2024-04-26T11:13:12.493217+0000","last_active":"2024-04-26T11:16:34.849544+0000","last_peered":"2024-04-26T11:16:34.849544+0000","last_clean":"2024-04-26T11:16:34.849544+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:16:34.849544+0000","last_undegraded":"2024-04-26T11:16:34.849544+0000","last_fullsized":"2024-04-26T11:16:34.849544+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:00.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.851035+0000","last_change":"2024-04-26T11:14:08.592365+0000","last_active":"2024-04-26T11:16:34.851035+0000","last_peered":"2024-04-26T11:16:34.851035+0000","last_clean":"2024-04-26T11:16:34.851035+0000","last_became_active":"2024-04-26T11:14:08.591926+0000","last_became_peered":"2024-04-26T11:14:08.591926+0000","last_unstale":"2024-04-26T11:16:34.851035+0000","last_undegraded":"2024-04-26T11:16:34.851035+0000","last_fullsized":"2024-04-26T11:16:34.851035+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:52.475134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850356+0000","last_change":"2024-04-26T11:14:08.590727+0000","last_active":"2024-04-26T11:16:34.850356+0000","last_peered":"2024-04-26T11:16:34.850356+0000","last_clean":"2024-04-26T11:16:34.850356+0000","last_became_active":"2024-04-26T11:14:08.590371+0000","last_became_peered":"2024-04-26T11:14:08.590371+0000","last_unstale":"2024-04-26T11:16:34.850356+0000","last_undegraded":"2024-04-26T11:16:34.850356+0000","last_fullsized":"2024-04-26T11:16:34.850356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:32.002629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871195+0000","last_change":"2024-04-26T11:16:36.867874+0000","last_active":"2024-04-26T11:16:36.871195+0000","last_peered":"2024-04-26T11:16:36.871195+0000","last_clean":"2024-04-26T11:16:36.871195+0000","last_became_active":"2024-04-26T11:16:36.866878+0000","last_became_peered":"2024-04-26T11:16:36.866878+0000","last_unstale":"2024-04-26T11:16:36.871195+0000","last_undegraded":"2024-04-26T11:16:36.871195+0000","last_fullsized":"2024-04-26T11:16:36.871195+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:14.516925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.852941+0000","last_change":"2024-04-26T11:16:35.853117+0000","last_active":"2024-04-26T11:16:35.852941+0000","last_peered":"2024-04-26T11:16:34.849651+0000","last_clean":"2024-04-26T11:13:54.337583+0000","last_became_active":"2024-04-26T11:13:58.346850+0000","last_became_peered":"2024-04-26T11:13:58.346850+0000","last_unstale":"2024-04-26T11:16:35.852941+0000","last_undegraded":"2024-04-26T11:16:35.852941+0000","last_fullsized":"2024-04-26T11:16:35.852941+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:36.627979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.864258+0000","last_change":"2024-04-26T11:16:36.861685+0000","last_active":"2024-04-26T11:16:36.864258+0000","last_peered":"2024-04-26T11:16:36.864258+0000","last_clean":"2024-04-26T11:16:36.864258+0000","last_became_active":"2024-04-26T11:16:36.859534+0000","last_became_peered":"2024-04-26T11:16:36.859534+0000","last_unstale":"2024-04-26T11:16:36.864258+0000","last_undegraded":"2024-04-26T11:16:36.864258+0000","last_fullsized":"2024-04-26T11:16:36.864258+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:53:17.183514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.868297+0000","last_change":"2024-04-26T11:16:36.862872+0000","last_active":"2024-04-26T11:16:36.868297+0000","last_peered":"2024-04-26T11:16:36.868297+0000","last_clean":"2024-04-26T11:16:36.868297+0000","last_became_active":"2024-04-26T11:16:36.860322+0000","last_became_peered":"2024-04-26T11:16:36.860322+0000","last_unstale":"2024-04-26T11:16:36.868297+0000","last_undegraded":"2024-04-26T11:16:36.868297+0000","last_fullsized":"2024-04-26T11:16:36.868297+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:37.186329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849889+0000","last_change":"2024-04-26T11:14:08.589823+0000","last_active":"2024-04-26T11:16:34.849889+0000","last_peered":"2024-04-26T11:16:34.849889+0000","last_clean":"2024-04-26T11:16:34.849889+0000","last_became_active":"2024-04-26T11:14:08.588808+0000","last_became_peered":"2024-04-26T11:14:08.588808+0000","last_unstale":"2024-04-26T11:16:34.849889+0000","last_undegraded":"2024-04-26T11:16:34.849889+0000","last_fullsized":"2024-04-26T11:16:34.849889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:31.499991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849872+0000","last_change":"2024-04-26T11:14:08.590654+0000","last_active":"2024-04-26T11:16:34.849872+0000","last_peered":"2024-04-26T11:16:34.849872+0000","last_clean":"2024-04-26T11:16:34.849872+0000","last_became_active":"2024-04-26T11:14:08.590089+0000","last_became_peered":"2024-04-26T11:14:08.590089+0000","last_unstale":"2024-04-26T11:16:34.849872+0000","last_undegraded":"2024-04-26T11:16:34.849872+0000","last_fullsized":"2024-04-26T11:16:34.849872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:56.592753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":70,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.852737+0000","last_change":"2024-04-26T11:16:35.852966+0000","last_active":"2024-04-26T11:16:35.852737+0000","last_peered":"2024-04-26T11:16:34.849450+0000","last_clean":"2024-04-26T11:13:54.339345+0000","last_became_active":"2024-04-26T11:13:58.349251+0000","last_became_peered":"2024-04-26T11:13:58.349251+0000","last_unstale":"2024-04-26T11:16:35.852737+0000","last_undegraded":"2024-04-26T11:16:35.852737+0000","last_fullsized":"2024-04-26T11:16:35.852737+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:45.123453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.851294+0000","last_change":"2024-04-26T11:14:08.592455+0000","last_active":"2024-04-26T11:16:34.851294+0000","last_peered":"2024-04-26T11:16:34.851294+0000","last_clean":"2024-04-26T11:16:34.851294+0000","last_became_active":"2024-04-26T11:14:08.592069+0000","last_became_peered":"2024-04-26T11:14:08.592069+0000","last_unstale":"2024-04-26T11:16:34.851294+0000","last_undegraded":"2024-04-26T11:16:34.851294+0000","last_fullsized":"2024-04-26T11:16:34.851294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:51:18.264318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.866327+0000","last_change":"2024-04-26T11:16:36.860776+0000","last_active":"2024-04-26T11:16:36.866327+0000","last_peered":"2024-04-26T11:16:36.866327+0000","last_clean":"2024-04-26T11:16:36.866327+0000","last_became_active":"2024-04-26T11:16:36.859301+0000","last_became_peered":"2024-04-26T11:16:36.859301+0000","last_unstale":"2024-04-26T11:16:36.866327+0000","last_undegraded":"2024-04-26T11:16:36.866327+0000","last_fullsized":"2024-04-26T11:16:36.866327+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:27.648935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":217,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.869995+0000","last_change":"2024-04-26T11:16:36.864256+0000","last_active":"2024-04-26T11:16:36.869995+0000","last_peered":"2024-04-26T11:16:36.869995+0000","last_clean":"2024-04-26T11:16:36.869995+0000","last_became_active":"2024-04-26T11:16:36.863058+0000","last_became_peered":"2024-04-26T11:16:36.863058+0000","last_unstale":"2024-04-26T11:16:36.869995+0000","last_undegraded":"2024-04-26T11:16:36.869995+0000","last_fullsized":"2024-04-26T11:16:36.869995+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:49.355165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850082+0000","last_change":"2024-04-26T11:14:08.589733+0000","last_active":"2024-04-26T11:16:34.850082+0000","last_peered":"2024-04-26T11:16:34.850082+0000","last_clean":"2024-04-26T11:16:34.850082+0000","last_became_active":"2024-04-26T11:14:08.589187+0000","last_became_peered":"2024-04-26T11:14:08.589187+0000","last_unstale":"2024-04-26T11:16:34.850082+0000","last_undegraded":"2024-04-26T11:16:34.850082+0000","last_fullsized":"2024-04-26T11:16:34.850082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:47.437503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.868046+0000","last_change":"2024-04-26T11:16:36.864249+0000","last_active":"2024-04-26T11:16:36.868046+0000","last_peered":"2024-04-26T11:16:36.868046+0000","last_clean":"2024-04-26T11:16:36.868046+0000","last_became_active":"2024-04-26T11:16:36.863279+0000","last_became_peered":"2024-04-26T11:16:36.863279+0000","last_unstale":"2024-04-26T11:16:36.868046+0000","last_undegraded":"2024-04-26T11:16:36.868046+0000","last_fullsized":"2024-04-26T11:16:36.868046+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:19.053419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871871+0000","last_change":"2024-04-26T11:16:36.869342+0000","last_active":"2024-04-26T11:16:36.871871+0000","last_peered":"2024-04-26T11:16:36.871871+0000","last_clean":"2024-04-26T11:16:36.871871+0000","last_became_active":"2024-04-26T11:16:36.866494+0000","last_became_peered":"2024-04-26T11:16:36.866494+0000","last_unstale":"2024-04-26T11:16:36.871871+0000","last_undegraded":"2024-04-26T11:16:36.871871+0000","last_fullsized":"2024-04-26T11:16:36.871871+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:19.386938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.861732+0000","last_change":"2024-04-26T11:16:36.863211+0000","last_active":"2024-04-26T11:16:38.861732+0000","last_peered":"2024-04-26T11:16:38.861732+0000","last_clean":"2024-04-26T11:16:38.861732+0000","last_became_active":"2024-04-26T11:16:36.862085+0000","last_became_peered":"2024-04-26T11:16:36.862085+0000","last_unstale":"2024-04-26T11:16:38.861732+0000","last_undegraded":"2024-04-26T11:16:38.861732+0000","last_fullsized":"2024-04-26T11:16:38.861732+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:55.260721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850676+0000","last_change":"2024-04-26T11:13:12.918648+0000","last_active":"2024-04-26T11:16:34.850676+0000","last_peered":"2024-04-26T11:16:34.850676+0000","last_clean":"2024-04-26T11:16:34.850676+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:16:34.850676+0000","last_undegraded":"2024-04-26T11:16:34.850676+0000","last_fullsized":"2024-04-26T11:16:34.850676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":67,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850886+0000","last_change":"2024-04-26T11:13:08.110433+0000","last_active":"2024-04-26T11:16:34.850886+0000","last_peered":"2024-04-26T11:16:34.850886+0000","last_clean":"2024-04-26T11:16:34.850886+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:16:34.850886+0000","last_undegraded":"2024-04-26T11:16:34.850886+0000","last_fullsized":"2024-04-26T11:16:34.850886+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850558+0000","last_change":"2024-04-26T11:14:08.590798+0000","last_active":"2024-04-26T11:16:34.850558+0000","last_peered":"2024-04-26T11:16:34.850558+0000","last_clean":"2024-04-26T11:16:34.850558+0000","last_became_active":"2024-04-26T11:14:08.590535+0000","last_became_peered":"2024-04-26T11:14:08.590535+0000","last_unstale":"2024-04-26T11:16:34.850558+0000","last_undegraded":"2024-04-26T11:16:34.850558+0000","last_fullsized":"2024-04-26T11:16:34.850558+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:04.692288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.851855+0000","last_change":"2024-04-26T11:16:35.852016+0000","last_active":"2024-04-26T11:16:35.851855+0000","last_peered":"2024-04-26T11:16:34.849514+0000","last_clean":"2024-04-26T11:13:54.339822+0000","last_became_active":"2024-04-26T11:13:58.346388+0000","last_became_peered":"2024-04-26T11:13:58.346388+0000","last_unstale":"2024-04-26T11:16:35.851855+0000","last_undegraded":"2024-04-26T11:16:35.851855+0000","last_fullsized":"2024-04-26T11:16:35.851855+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:37.633783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":55,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.851363+0000","last_change":"2024-04-26T11:14:08.592482+0000","last_active":"2024-04-26T11:16:34.851363+0000","last_peered":"2024-04-26T11:16:34.851363+0000","last_clean":"2024-04-26T11:16:34.851363+0000","last_became_active":"2024-04-26T11:14:08.592093+0000","last_became_peered":"2024-04-26T11:14:08.592093+0000","last_unstale":"2024-04-26T11:16:34.851363+0000","last_undegraded":"2024-04-26T11:16:34.851363+0000","last_fullsized":"2024-04-26T11:16:34.851363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:38.939541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850472+0000","last_change":"2024-04-26T11:14:08.589530+0000","last_active":"2024-04-26T11:16:34.850472+0000","last_peered":"2024-04-26T11:16:34.850472+0000","last_clean":"2024-04-26T11:16:34.850472+0000","last_became_active":"2024-04-26T11:14:08.589288+0000","last_became_peered":"2024-04-26T11:14:08.589288+0000","last_unstale":"2024-04-26T11:16:34.850472+0000","last_undegraded":"2024-04-26T11:16:34.850472+0000","last_fullsized":"2024-04-26T11:16:34.850472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:52.096175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":2,"reported_epoch":69,"state":"peering","last_fresh":"2024-04-26T11:14:08.582736+0000","last_change":"2024-04-26T11:13:42.307124+0000","last_active":"2024-04-26T11:13:42.305890+0000","last_peered":"2024-04-26T11:13:39.301215+0000","last_clean":"2024-04-26T11:13:39.301215+0000","last_became_active":"2024-04-26T11:13:12.918816+0000","last_became_peered":"2024-04-26T11:13:12.918816+0000","last_unstale":"2024-04-26T11:14:08.582736+0000","last_undegraded":"2024-04-26T11:14:08.582736+0000","last_fullsized":"2024-04-26T11:14:08.582736+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:02.747912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.863957+0000","last_change":"2024-04-26T11:16:36.860868+0000","last_active":"2024-04-26T11:16:36.863957+0000","last_peered":"2024-04-26T11:16:36.863957+0000","last_clean":"2024-04-26T11:16:36.863957+0000","last_became_active":"2024-04-26T11:16:36.858042+0000","last_became_peered":"2024-04-26T11:16:36.858042+0000","last_unstale":"2024-04-26T11:16:36.863957+0000","last_undegraded":"2024-04-26T11:16:36.863957+0000","last_fullsized":"2024-04-26T11:16:36.863957+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:57:35.285183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862568+0000","last_change":"2024-04-26T11:16:36.867856+0000","last_active":"2024-04-26T11:16:38.862568+0000","last_peered":"2024-04-26T11:16:38.862568+0000","last_clean":"2024-04-26T11:16:38.862568+0000","last_became_active":"2024-04-26T11:16:36.865816+0000","last_became_peered":"2024-04-26T11:16:36.865816+0000","last_unstale":"2024-04-26T11:16:38.862568+0000","last_undegraded":"2024-04-26T11:16:38.862568+0000","last_fullsized":"2024-04-26T11:16:38.862568+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:35.210355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.853363+0000","last_change":"2024-04-26T11:16:35.854139+0000","last_active":"2024-04-26T11:16:35.853363+0000","last_peered":"2024-04-26T11:16:34.850014+0000","last_clean":"2024-04-26T11:13:54.337565+0000","last_became_active":"2024-04-26T11:13:58.346538+0000","last_became_peered":"2024-04-26T11:13:58.346538+0000","last_unstale":"2024-04-26T11:16:35.853363+0000","last_undegraded":"2024-04-26T11:16:35.853363+0000","last_fullsized":"2024-04-26T11:16:35.853363+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:35.209914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":73,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849560+0000","last_change":"2024-04-26T11:13:43.321498+0000","last_active":"2024-04-26T11:16:34.849560+0000","last_peered":"2024-04-26T11:16:34.849560+0000","last_clean":"2024-04-26T11:16:34.849560+0000","last_became_active":"2024-04-26T11:13:43.320420+0000","last_became_peered":"2024-04-26T11:13:43.320420+0000","last_unstale":"2024-04-26T11:16:34.849560+0000","last_undegraded":"2024-04-26T11:16:34.849560+0000","last_fullsized":"2024-04-26T11:16:34.849560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:06.135274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850670+0000","last_change":"2024-04-26T11:13:12.917812+0000","last_active":"2024-04-26T11:16:34.850670+0000","last_peered":"2024-04-26T11:16:34.850670+0000","last_clean":"2024-04-26T11:16:34.850670+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:16:34.850670+0000","last_undegraded":"2024-04-26T11:16:34.850670+0000","last_fullsized":"2024-04-26T11:16:34.850670+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":2,"reported_epoch":69,"state":"peering","last_fresh":"2024-04-26T11:14:06.583168+0000","last_change":"2024-04-26T11:16:39.863541+0000","last_active":"2024-04-26T11:16:39.863541+0000","last_peered":"2024-04-26T11:14:06.583168+0000","last_clean":"2024-04-26T11:14:06.583168+0000","last_became_active":"2024-04-26T11:13:43.321846+0000","last_became_peered":"2024-04-26T11:13:43.321846+0000","last_unstale":"2024-04-26T11:14:06.583168+0000","last_undegraded":"2024-04-26T11:14:06.583168+0000","last_fullsized":"2024-04-26T11:14:06.583168+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:14.138907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.869411+0000","last_change":"2024-04-26T11:16:36.865623+0000","last_active":"2024-04-26T11:16:36.869411+0000","last_peered":"2024-04-26T11:16:36.869411+0000","last_clean":"2024-04-26T11:16:36.869411+0000","last_became_active":"2024-04-26T11:16:36.864187+0000","last_became_peered":"2024-04-26T11:16:36.864187+0000","last_unstale":"2024-04-26T11:16:36.869411+0000","last_undegraded":"2024-04-26T11:16:36.869411+0000","last_fullsized":"2024-04-26T11:16:36.869411+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:25.032691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":72,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.858100+0000","last_change":"2024-04-26T11:16:35.858284+0000","last_active":"2024-04-26T11:16:35.858100+0000","last_peered":"2024-04-26T11:16:34.850560+0000","last_clean":"2024-04-26T11:13:54.340365+0000","last_became_active":"2024-04-26T11:13:58.349479+0000","last_became_peered":"2024-04-26T11:13:58.349479+0000","last_unstale":"2024-04-26T11:16:35.858100+0000","last_undegraded":"2024-04-26T11:16:35.858100+0000","last_fullsized":"2024-04-26T11:16:35.858100+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:25:53.597934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.870137+0000","last_change":"2024-04-26T11:16:36.865772+0000","last_active":"2024-04-26T11:16:36.870137+0000","last_peered":"2024-04-26T11:16:36.870137+0000","last_clean":"2024-04-26T11:16:36.870137+0000","last_became_active":"2024-04-26T11:16:36.865213+0000","last_became_peered":"2024-04-26T11:16:36.865213+0000","last_unstale":"2024-04-26T11:16:36.870137+0000","last_undegraded":"2024-04-26T11:16:36.870137+0000","last_fullsized":"2024-04-26T11:16:36.870137+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:03.220593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850169+0000","last_change":"2024-04-26T11:14:08.589726+0000","last_active":"2024-04-26T11:16:34.850169+0000","last_peered":"2024-04-26T11:16:34.850169+0000","last_clean":"2024-04-26T11:16:34.850169+0000","last_became_active":"2024-04-26T11:14:08.588687+0000","last_became_peered":"2024-04-26T11:14:08.588687+0000","last_unstale":"2024-04-26T11:16:34.850169+0000","last_undegraded":"2024-04-26T11:16:34.850169+0000","last_fullsized":"2024-04-26T11:16:34.850169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:05.617266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":63,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850283+0000","last_change":"2024-04-26T11:13:12.917763+0000","last_active":"2024-04-26T11:16:34.850283+0000","last_peered":"2024-04-26T11:16:34.850283+0000","last_clean":"2024-04-26T11:16:34.850283+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:16:34.850283+0000","last_undegraded":"2024-04-26T11:16:34.850283+0000","last_fullsized":"2024-04-26T11:16:34.850283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":2,"reported_epoch":69,"state":"peering","last_fresh":"2024-04-26T11:14:06.582422+0000","last_change":"2024-04-26T11:16:39.863687+0000","last_active":"2024-04-26T11:16:39.863687+0000","last_peered":"2024-04-26T11:14:06.582422+0000","last_clean":"2024-04-26T11:14:06.582422+0000","last_became_active":"2024-04-26T11:13:43.321829+0000","last_became_peered":"2024-04-26T11:13:43.321829+0000","last_unstale":"2024-04-26T11:14:06.582422+0000","last_undegraded":"2024-04-26T11:14:06.582422+0000","last_fullsized":"2024-04-26T11:14:06.582422+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:56.385417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.872318+0000","last_change":"2024-04-26T11:16:36.870651+0000","last_active":"2024-04-26T11:16:36.872318+0000","last_peered":"2024-04-26T11:16:36.872318+0000","last_clean":"2024-04-26T11:16:36.872318+0000","last_became_active":"2024-04-26T11:16:36.869018+0000","last_became_peered":"2024-04-26T11:16:36.869018+0000","last_unstale":"2024-04-26T11:16:36.872318+0000","last_undegraded":"2024-04-26T11:16:36.872318+0000","last_fullsized":"2024-04-26T11:16:36.872318+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:59.337390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871964+0000","last_change":"2024-04-26T11:16:36.870356+0000","last_active":"2024-04-26T11:16:36.871964+0000","last_peered":"2024-04-26T11:16:36.871964+0000","last_clean":"2024-04-26T11:16:36.871964+0000","last_became_active":"2024-04-26T11:16:36.868029+0000","last_became_peered":"2024-04-26T11:16:36.868029+0000","last_unstale":"2024-04-26T11:16:36.871964+0000","last_undegraded":"2024-04-26T11:16:36.871964+0000","last_fullsized":"2024-04-26T11:16:36.871964+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:13:24.219419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.849594+0000","last_change":"2024-04-26T11:14:08.590838+0000","last_active":"2024-04-26T11:16:34.849594+0000","last_peered":"2024-04-26T11:16:34.849594+0000","last_clean":"2024-04-26T11:16:34.849594+0000","last_became_active":"2024-04-26T11:14:08.590386+0000","last_became_peered":"2024-04-26T11:14:08.590386+0000","last_unstale":"2024-04-26T11:16:34.849594+0000","last_undegraded":"2024-04-26T11:16:34.849594+0000","last_fullsized":"2024-04-26T11:16:34.849594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:50.791318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.854354+0000","last_change":"2024-04-26T11:16:35.854521+0000","last_active":"2024-04-26T11:16:35.854354+0000","last_peered":"2024-04-26T11:16:34.849726+0000","last_clean":"2024-04-26T11:13:54.337655+0000","last_became_active":"2024-04-26T11:13:58.349005+0000","last_became_peered":"2024-04-26T11:13:58.349005+0000","last_unstale":"2024-04-26T11:16:35.854354+0000","last_undegraded":"2024-04-26T11:16:35.854354+0000","last_fullsized":"2024-04-26T11:16:35.854354+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:25.369855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":47,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T11:16:34.850253+0000","last_change":"2024-04-26T11:14:08.589117+0000","last_active":"2024-04-26T11:16:34.850253+0000","last_peered":"2024-04-26T11:16:34.850253+0000","last_clean":"2024-04-26T11:16:34.850253+0000","last_became_active":"2024-04-26T11:14:08.588762+0000","last_became_peered":"2024-04-26T11:14:08.588762+0000","last_unstale":"2024-04-26T11:16:34.850253+0000","last_undegraded":"2024-04-26T11:16:34.850253+0000","last_fullsized":"2024-04-26T11:16:34.850253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:05.658069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":69,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-26T11:16:35.856451+0000","last_change":"2024-04-26T11:16:35.856628+0000","last_active":"2024-04-26T11:16:35.856451+0000","last_peered":"2024-04-26T11:16:34.850819+0000","last_clean":"2024-04-26T11:13:54.340822+0000","last_became_active":"2024-04-26T11:13:58.349129+0000","last_became_peered":"2024-04-26T11:13:58.349129+0000","last_unstale":"2024-04-26T11:16:35.856451+0000","last_undegraded":"2024-04-26T11:16:35.856451+0000","last_fullsized":"2024-04-26T11:16:35.856451+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:41.218246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":3,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5470,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738412,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281024,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94090816,"statfs":{"total":96636764160,"available":96348995584,"internally_reserved":0,"allocated":1363968,"data_stored":874145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":1,"last update":"Fri Apr 26 11:16:17 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40200000000000002,"15min":0.378},"min":{"1min":0.20000000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.96499999999999997,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.44400000000000001,"15min":0.44600000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.57599999999999996,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.621}]}]},{"osd":0,"up_from":67,"seq":287762808834,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40348,"kb_used_data":1360,"kb_used_omap":6,"kb_used_meta":38969,"kb_avail":94331492,"statfs":{"total":96636764160,"available":96595447808,"internally_reserved":0,"allocated":1392640,"data_stored":889273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7064,"internal_metadata":39904360},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738413,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401004,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":400254,"kb_avail":93970836,"statfs":{"total":96636764160,"available":96226136064,"internally_reserved":0,"allocated":753664,"data_stored":283176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":409860550},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23400000000000001}]},{"osd":2,"last update":"Fri Apr 26 11:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.40300000000000002,"15min":0.39300000000000002},"min":{"1min":0.14999999999999999,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.61299999999999999,"5min":2.056,"15min":2.056},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.47899999999999998,"15min":0.45700000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":3.9609999999999999,"5min":3.9609999999999999,"15min":3.9609999999999999},"last":0.47399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5470,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:16:45.492 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:16:45.852 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:16:45.854 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:16:45.864 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2024-04-26T11:16:44.508698+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":3,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":722448,"kb_used_data":3496,"kb_used_omap":10,"kb_used_meta":718901,"kb_avail":282393072,"statfs":{"total":289910292480,"available":289170505728,"internally_reserved":0,"allocated":3579904,"data_stored":2087870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10252,"internal_metadata":736155636},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":3,"num_objects_degraded":-16,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001729"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868334+0000","last_change":"2024-04-26T11:13:12.919196+0000","last_active":"2024-04-26T11:16:39.868334+0000","last_peered":"2024-04-26T11:16:39.868334+0000","last_clean":"2024-04-26T11:16:39.868334+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:16:39.868334+0000","last_undegraded":"2024-04-26T11:16:39.868334+0000","last_fullsized":"2024-04-26T11:16:39.868334+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867861+0000","last_change":"2024-04-26T11:13:12.917670+0000","last_active":"2024-04-26T11:16:39.867861+0000","last_peered":"2024-04-26T11:16:39.867861+0000","last_clean":"2024-04-26T11:16:39.867861+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:16:39.867861+0000","last_undegraded":"2024-04-26T11:16:39.867861+0000","last_fullsized":"2024-04-26T11:16:39.867861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.870181+0000","last_change":"2024-04-26T11:16:36.866575+0000","last_active":"2024-04-26T11:16:36.870181+0000","last_peered":"2024-04-26T11:16:36.870181+0000","last_clean":"2024-04-26T11:16:36.870181+0000","last_became_active":"2024-04-26T11:16:36.864565+0000","last_became_peered":"2024-04-26T11:16:36.864565+0000","last_unstale":"2024-04-26T11:16:36.870181+0000","last_undegraded":"2024-04-26T11:16:36.870181+0000","last_fullsized":"2024-04-26T11:16:36.870181+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:38.756428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871248+0000","last_change":"2024-04-26T11:16:36.868086+0000","last_active":"2024-04-26T11:16:36.871248+0000","last_peered":"2024-04-26T11:16:36.871248+0000","last_clean":"2024-04-26T11:16:36.871248+0000","last_became_active":"2024-04-26T11:16:36.865679+0000","last_became_peered":"2024-04-26T11:16:36.865679+0000","last_unstale":"2024-04-26T11:16:36.871248+0000","last_undegraded":"2024-04-26T11:16:36.871248+0000","last_fullsized":"2024-04-26T11:16:36.871248+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:22.051599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866980+0000","last_change":"2024-04-26T11:13:12.917403+0000","last_active":"2024-04-26T11:16:39.866980+0000","last_peered":"2024-04-26T11:16:39.866980+0000","last_clean":"2024-04-26T11:16:39.866980+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:16:39.866980+0000","last_undegraded":"2024-04-26T11:16:39.866980+0000","last_fullsized":"2024-04-26T11:16:39.866980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:42.014955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871352+0000","last_change":"2024-04-26T11:16:36.868338+0000","last_active":"2024-04-26T11:16:36.871352+0000","last_peered":"2024-04-26T11:16:36.871352+0000","last_clean":"2024-04-26T11:16:36.871352+0000","last_became_active":"2024-04-26T11:16:36.867049+0000","last_became_peered":"2024-04-26T11:16:36.867049+0000","last_unstale":"2024-04-26T11:16:36.871352+0000","last_undegraded":"2024-04-26T11:16:36.871352+0000","last_fullsized":"2024-04-26T11:16:36.871352+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:57.262622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.864496+0000","last_change":"2024-04-26T11:16:36.860337+0000","last_active":"2024-04-26T11:16:36.864496+0000","last_peered":"2024-04-26T11:16:36.864496+0000","last_clean":"2024-04-26T11:16:36.864496+0000","last_became_active":"2024-04-26T11:16:36.859342+0000","last_became_peered":"2024-04-26T11:16:36.859342+0000","last_unstale":"2024-04-26T11:16:36.864496+0000","last_undegraded":"2024-04-26T11:16:36.864496+0000","last_fullsized":"2024-04-26T11:16:36.864496+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:23.653811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.870476+0000","last_change":"2024-04-26T11:16:36.863996+0000","last_active":"2024-04-26T11:16:36.870476+0000","last_peered":"2024-04-26T11:16:36.870476+0000","last_clean":"2024-04-26T11:16:36.870476+0000","last_became_active":"2024-04-26T11:16:36.863048+0000","last_became_peered":"2024-04-26T11:16:36.863048+0000","last_unstale":"2024-04-26T11:16:36.870476+0000","last_undegraded":"2024-04-26T11:16:36.870476+0000","last_fullsized":"2024-04-26T11:16:36.870476+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:42.503116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867972+0000","last_change":"2024-04-26T11:14:08.592223+0000","last_active":"2024-04-26T11:16:39.867972+0000","last_peered":"2024-04-26T11:16:39.867972+0000","last_clean":"2024-04-26T11:16:39.867972+0000","last_became_active":"2024-04-26T11:14:08.591660+0000","last_became_peered":"2024-04-26T11:14:08.591660+0000","last_unstale":"2024-04-26T11:16:39.867972+0000","last_undegraded":"2024-04-26T11:16:39.867972+0000","last_fullsized":"2024-04-26T11:16:39.867972+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:06.208634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867975+0000","last_change":"2024-04-26T11:13:12.918521+0000","last_active":"2024-04-26T11:16:39.867975+0000","last_peered":"2024-04-26T11:16:39.867975+0000","last_clean":"2024-04-26T11:16:39.867975+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:16:39.867975+0000","last_undegraded":"2024-04-26T11:16:39.867975+0000","last_fullsized":"2024-04-26T11:16:39.867975+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":2,"reported_epoch":69,"state":"peering","last_fresh":"2024-04-26T11:14:08.583071+0000","last_change":"2024-04-26T11:13:42.306377+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:14:08.583071+0000","last_undegraded":"2024-04-26T11:14:08.583071+0000","last_fullsized":"2024-04-26T11:14:08.583071+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:54.379763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867243+0000","last_change":"2024-04-26T11:16:36.865797+0000","last_active":"2024-04-26T11:16:39.867243+0000","last_peered":"2024-04-26T11:16:39.867243+0000","last_clean":"2024-04-26T11:16:39.867243+0000","last_became_active":"2024-04-26T11:16:36.865360+0000","last_became_peered":"2024-04-26T11:16:36.865360+0000","last_unstale":"2024-04-26T11:16:39.867243+0000","last_undegraded":"2024-04-26T11:16:39.867243+0000","last_fullsized":"2024-04-26T11:16:39.867243+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:14.393010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867206+0000","last_change":"2024-04-26T11:13:12.915484+0000","last_active":"2024-04-26T11:16:39.867206+0000","last_peered":"2024-04-26T11:16:39.867206+0000","last_clean":"2024-04-26T11:16:39.867206+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:16:39.867206+0000","last_undegraded":"2024-04-26T11:16:39.867206+0000","last_fullsized":"2024-04-26T11:16:39.867206+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.869304+0000","last_change":"2024-04-26T11:16:36.865308+0000","last_active":"2024-04-26T11:16:36.869304+0000","last_peered":"2024-04-26T11:16:36.869304+0000","last_clean":"2024-04-26T11:16:36.869304+0000","last_became_active":"2024-04-26T11:16:36.864119+0000","last_became_peered":"2024-04-26T11:16:36.864119+0000","last_unstale":"2024-04-26T11:16:36.869304+0000","last_undegraded":"2024-04-26T11:16:36.869304+0000","last_fullsized":"2024-04-26T11:16:36.869304+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:29.265536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":2,"reported_epoch":69,"state":"peering","last_fresh":"2024-04-26T11:13:43.317311+0000","last_change":"2024-04-26T11:13:42.309392+0000","last_active":"2024-04-26T11:13:12.471344+0000","last_peered":"2024-04-26T11:13:12.471344+0000","last_clean":"2024-04-26T11:13:12.471344+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:13:43.317311+0000","last_undegraded":"2024-04-26T11:13:43.317311+0000","last_fullsized":"2024-04-26T11:13:43.317311+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:45.107551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871462+0000","last_change":"2024-04-26T11:16:36.868941+0000","last_active":"2024-04-26T11:16:36.871462+0000","last_peered":"2024-04-26T11:16:36.871462+0000","last_clean":"2024-04-26T11:16:36.871462+0000","last_became_active":"2024-04-26T11:16:36.864605+0000","last_became_peered":"2024-04-26T11:16:36.864605+0000","last_unstale":"2024-04-26T11:16:36.871462+0000","last_undegraded":"2024-04-26T11:16:36.871462+0000","last_fullsized":"2024-04-26T11:16:36.871462+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:26.687980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867966+0000","last_change":"2024-04-26T11:14:08.592349+0000","last_active":"2024-04-26T11:16:39.867966+0000","last_peered":"2024-04-26T11:16:39.867966+0000","last_clean":"2024-04-26T11:16:39.867966+0000","last_became_active":"2024-04-26T11:14:08.591886+0000","last_became_peered":"2024-04-26T11:14:08.591886+0000","last_unstale":"2024-04-26T11:16:39.867966+0000","last_undegraded":"2024-04-26T11:16:39.867966+0000","last_fullsized":"2024-04-26T11:16:39.867966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:29.835852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868076+0000","last_change":"2024-04-26T11:13:12.918759+0000","last_active":"2024-04-26T11:16:39.868076+0000","last_peered":"2024-04-26T11:16:39.868076+0000","last_clean":"2024-04-26T11:16:39.868076+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:16:39.868076+0000","last_undegraded":"2024-04-26T11:16:39.868076+0000","last_fullsized":"2024-04-26T11:16:39.868076+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:55.002972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868331+0000","last_change":"2024-04-26T11:14:08.591804+0000","last_active":"2024-04-26T11:16:39.868331+0000","last_peered":"2024-04-26T11:16:39.868331+0000","last_clean":"2024-04-26T11:16:39.868331+0000","last_became_active":"2024-04-26T11:14:08.591519+0000","last_became_peered":"2024-04-26T11:14:08.591519+0000","last_unstale":"2024-04-26T11:16:39.868331+0000","last_undegraded":"2024-04-26T11:16:39.868331+0000","last_fullsized":"2024-04-26T11:16:39.868331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:00:27.447921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871384+0000","last_change":"2024-04-26T11:16:36.868357+0000","last_active":"2024-04-26T11:16:36.871384+0000","last_peered":"2024-04-26T11:16:36.871384+0000","last_clean":"2024-04-26T11:16:36.871384+0000","last_became_active":"2024-04-26T11:16:36.866698+0000","last_became_peered":"2024-04-26T11:16:36.866698+0000","last_unstale":"2024-04-26T11:16:36.871384+0000","last_undegraded":"2024-04-26T11:16:36.871384+0000","last_fullsized":"2024-04-26T11:16:36.871384+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:56.560147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.868372+0000","last_change":"2024-04-26T11:16:36.864212+0000","last_active":"2024-04-26T11:16:36.868372+0000","last_peered":"2024-04-26T11:16:36.868372+0000","last_clean":"2024-04-26T11:16:36.868372+0000","last_became_active":"2024-04-26T11:16:36.862787+0000","last_became_peered":"2024-04-26T11:16:36.862787+0000","last_unstale":"2024-04-26T11:16:36.868372+0000","last_undegraded":"2024-04-26T11:16:36.868372+0000","last_fullsized":"2024-04-26T11:16:36.868372+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:50.035179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867171+0000","last_change":"2024-04-26T11:16:36.865777+0000","last_active":"2024-04-26T11:16:39.867171+0000","last_peered":"2024-04-26T11:16:39.867171+0000","last_clean":"2024-04-26T11:16:39.867171+0000","last_became_active":"2024-04-26T11:16:36.865251+0000","last_became_peered":"2024-04-26T11:16:36.865251+0000","last_unstale":"2024-04-26T11:16:39.867171+0000","last_undegraded":"2024-04-26T11:16:39.867171+0000","last_fullsized":"2024-04-26T11:16:39.867171+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:58.402967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862003+0000","last_change":"2024-04-26T11:16:36.865177+0000","last_active":"2024-04-26T11:16:38.862003+0000","last_peered":"2024-04-26T11:16:38.862003+0000","last_clean":"2024-04-26T11:16:38.862003+0000","last_became_active":"2024-04-26T11:16:36.864276+0000","last_became_peered":"2024-04-26T11:16:36.864276+0000","last_unstale":"2024-04-26T11:16:38.862003+0000","last_undegraded":"2024-04-26T11:16:38.862003+0000","last_fullsized":"2024-04-26T11:16:38.862003+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:21.982286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867123+0000","last_change":"2024-04-26T11:13:12.912756+0000","last_active":"2024-04-26T11:16:39.867123+0000","last_peered":"2024-04-26T11:16:39.867123+0000","last_clean":"2024-04-26T11:16:39.867123+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:16:39.867123+0000","last_undegraded":"2024-04-26T11:16:39.867123+0000","last_fullsized":"2024-04-26T11:16:39.867123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:04.177831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868332+0000","last_change":"2024-04-26T11:16:36.866893+0000","last_active":"2024-04-26T11:16:39.868332+0000","last_peered":"2024-04-26T11:16:39.868332+0000","last_clean":"2024-04-26T11:16:39.868332+0000","last_became_active":"2024-04-26T11:16:36.866247+0000","last_became_peered":"2024-04-26T11:16:36.866247+0000","last_unstale":"2024-04-26T11:16:39.868332+0000","last_undegraded":"2024-04-26T11:16:39.868332+0000","last_fullsized":"2024-04-26T11:16:39.868332+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:29:00.392204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862718+0000","last_change":"2024-04-26T11:16:36.868960+0000","last_active":"2024-04-26T11:16:38.862718+0000","last_peered":"2024-04-26T11:16:38.862718+0000","last_clean":"2024-04-26T11:16:38.862718+0000","last_became_active":"2024-04-26T11:16:36.868050+0000","last_became_peered":"2024-04-26T11:16:36.868050+0000","last_unstale":"2024-04-26T11:16:38.862718+0000","last_undegraded":"2024-04-26T11:16:38.862718+0000","last_fullsized":"2024-04-26T11:16:38.862718+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:28.198210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.870640+0000","last_change":"2024-04-26T11:16:36.867664+0000","last_active":"2024-04-26T11:16:36.870640+0000","last_peered":"2024-04-26T11:16:36.870640+0000","last_clean":"2024-04-26T11:16:36.870640+0000","last_became_active":"2024-04-26T11:16:36.865582+0000","last_became_peered":"2024-04-26T11:16:36.865582+0000","last_unstale":"2024-04-26T11:16:36.870640+0000","last_undegraded":"2024-04-26T11:16:36.870640+0000","last_fullsized":"2024-04-26T11:16:36.870640+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:24.063678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":69,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867110+0000","last_change":"2024-04-26T11:13:12.493425+0000","last_active":"2024-04-26T11:16:39.867110+0000","last_peered":"2024-04-26T11:16:39.867110+0000","last_clean":"2024-04-26T11:16:39.867110+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:16:39.867110+0000","last_undegraded":"2024-04-26T11:16:39.867110+0000","last_fullsized":"2024-04-26T11:16:39.867110+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:23.279580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868220+0000","last_change":"2024-04-26T11:16:36.867629+0000","last_active":"2024-04-26T11:16:39.868220+0000","last_peered":"2024-04-26T11:16:39.868220+0000","last_clean":"2024-04-26T11:16:39.868220+0000","last_became_active":"2024-04-26T11:16:36.867445+0000","last_became_peered":"2024-04-26T11:16:36.867445+0000","last_unstale":"2024-04-26T11:16:39.868220+0000","last_undegraded":"2024-04-26T11:16:39.868220+0000","last_fullsized":"2024-04-26T11:16:39.868220+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:12.072442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":2,"reported_epoch":69,"state":"peering","last_fresh":"2024-04-26T11:14:08.582802+0000","last_change":"2024-04-26T11:13:42.306227+0000","last_active":"2024-04-26T11:13:42.306070+0000","last_peered":"2024-04-26T11:13:39.301410+0000","last_clean":"2024-04-26T11:13:39.301410+0000","last_became_active":"2024-04-26T11:13:12.488819+0000","last_became_peered":"2024-04-26T11:13:12.488819+0000","last_unstale":"2024-04-26T11:14:08.582802+0000","last_undegraded":"2024-04-26T11:14:08.582802+0000","last_fullsized":"2024-04-26T11:14:08.582802+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:48.191394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862478+0000","last_change":"2024-04-26T11:16:36.866812+0000","last_active":"2024-04-26T11:16:38.862478+0000","last_peered":"2024-04-26T11:16:38.862478+0000","last_clean":"2024-04-26T11:16:38.862478+0000","last_became_active":"2024-04-26T11:16:36.865841+0000","last_became_peered":"2024-04-26T11:16:36.865841+0000","last_unstale":"2024-04-26T11:16:38.862478+0000","last_undegraded":"2024-04-26T11:16:38.862478+0000","last_fullsized":"2024-04-26T11:16:38.862478+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:20.948589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867194+0000","last_change":"2024-04-26T11:14:08.589659+0000","last_active":"2024-04-26T11:16:39.867194+0000","last_peered":"2024-04-26T11:16:39.867194+0000","last_clean":"2024-04-26T11:16:39.867194+0000","last_became_active":"2024-04-26T11:14:08.589404+0000","last_became_peered":"2024-04-26T11:14:08.589404+0000","last_unstale":"2024-04-26T11:16:39.867194+0000","last_undegraded":"2024-04-26T11:16:39.867194+0000","last_fullsized":"2024-04-26T11:16:39.867194+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:29.354141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868240+0000","last_change":"2024-04-26T11:16:36.867191+0000","last_active":"2024-04-26T11:16:39.868240+0000","last_peered":"2024-04-26T11:16:39.868240+0000","last_clean":"2024-04-26T11:16:39.868240+0000","last_became_active":"2024-04-26T11:16:36.866876+0000","last_became_peered":"2024-04-26T11:16:36.866876+0000","last_unstale":"2024-04-26T11:16:39.868240+0000","last_undegraded":"2024-04-26T11:16:39.868240+0000","last_fullsized":"2024-04-26T11:16:39.868240+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:39.750259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862900+0000","last_change":"2024-04-26T11:16:36.870740+0000","last_active":"2024-04-26T11:16:38.862900+0000","last_peered":"2024-04-26T11:16:38.862900+0000","last_clean":"2024-04-26T11:16:38.862900+0000","last_became_active":"2024-04-26T11:16:36.865334+0000","last_became_peered":"2024-04-26T11:16:36.865334+0000","last_unstale":"2024-04-26T11:16:38.862900+0000","last_undegraded":"2024-04-26T11:16:38.862900+0000","last_fullsized":"2024-04-26T11:16:38.862900+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:46.263242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866977+0000","last_change":"2024-04-26T11:14:08.588941+0000","last_active":"2024-04-26T11:16:39.866977+0000","last_peered":"2024-04-26T11:16:39.866977+0000","last_clean":"2024-04-26T11:16:39.866977+0000","last_became_active":"2024-04-26T11:14:08.588699+0000","last_became_peered":"2024-04-26T11:14:08.588699+0000","last_unstale":"2024-04-26T11:16:39.866977+0000","last_undegraded":"2024-04-26T11:16:39.866977+0000","last_fullsized":"2024-04-26T11:16:39.866977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:05.957122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.864080+0000","last_change":"2024-04-26T11:16:36.861341+0000","last_active":"2024-04-26T11:16:36.864080+0000","last_peered":"2024-04-26T11:16:36.864080+0000","last_clean":"2024-04-26T11:16:36.864080+0000","last_became_active":"2024-04-26T11:16:36.860498+0000","last_became_peered":"2024-04-26T11:16:36.860498+0000","last_unstale":"2024-04-26T11:16:36.864080+0000","last_undegraded":"2024-04-26T11:16:36.864080+0000","last_fullsized":"2024-04-26T11:16:36.864080+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:12.295055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.861846+0000","last_change":"2024-04-26T11:16:36.861607+0000","last_active":"2024-04-26T11:16:38.861846+0000","last_peered":"2024-04-26T11:16:38.861846+0000","last_clean":"2024-04-26T11:16:38.861846+0000","last_became_active":"2024-04-26T11:16:36.860624+0000","last_became_peered":"2024-04-26T11:16:36.860624+0000","last_unstale":"2024-04-26T11:16:38.861846+0000","last_undegraded":"2024-04-26T11:16:38.861846+0000","last_fullsized":"2024-04-26T11:16:38.861846+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:52.246126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":84,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868150+0000","last_change":"2024-04-26T11:16:36.866102+0000","last_active":"2024-04-26T11:16:39.868150+0000","last_peered":"2024-04-26T11:16:39.868150+0000","last_clean":"2024-04-26T11:16:39.868150+0000","last_became_active":"2024-04-26T11:16:36.865517+0000","last_became_peered":"2024-04-26T11:16:36.865517+0000","last_unstale":"2024-04-26T11:16:39.868150+0000","last_undegraded":"2024-04-26T11:16:39.868150+0000","last_fullsized":"2024-04-26T11:16:39.868150+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:16.006886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867498+0000","last_change":"2024-04-26T11:14:08.590078+0000","last_active":"2024-04-26T11:16:39.867498+0000","last_peered":"2024-04-26T11:16:39.867498+0000","last_clean":"2024-04-26T11:16:39.867498+0000","last_became_active":"2024-04-26T11:14:08.589497+0000","last_became_peered":"2024-04-26T11:14:08.589497+0000","last_unstale":"2024-04-26T11:16:39.867498+0000","last_undegraded":"2024-04-26T11:16:39.867498+0000","last_fullsized":"2024-04-26T11:16:39.867498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:21.955581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":28,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.869351+0000","last_change":"2024-04-26T11:16:36.863969+0000","last_active":"2024-04-26T11:16:36.869351+0000","last_peered":"2024-04-26T11:16:36.869351+0000","last_clean":"2024-04-26T11:16:36.869351+0000","last_became_active":"2024-04-26T11:16:36.863038+0000","last_became_peered":"2024-04-26T11:16:36.863038+0000","last_unstale":"2024-04-26T11:16:36.869351+0000","last_undegraded":"2024-04-26T11:16:36.869351+0000","last_fullsized":"2024-04-26T11:16:36.869351+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:18.680458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.868352+0000","last_change":"2024-04-26T11:16:36.863400+0000","last_active":"2024-04-26T11:16:36.868352+0000","last_peered":"2024-04-26T11:16:36.868352+0000","last_clean":"2024-04-26T11:16:36.868352+0000","last_became_active":"2024-04-26T11:16:36.861887+0000","last_became_peered":"2024-04-26T11:16:36.861887+0000","last_unstale":"2024-04-26T11:16:36.868352+0000","last_undegraded":"2024-04-26T11:16:36.868352+0000","last_fullsized":"2024-04-26T11:16:36.868352+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:58.091135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":23,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.868328+0000","last_change":"2024-04-26T11:16:36.863160+0000","last_active":"2024-04-26T11:16:36.868328+0000","last_peered":"2024-04-26T11:16:36.868328+0000","last_clean":"2024-04-26T11:16:36.868328+0000","last_became_active":"2024-04-26T11:16:36.861563+0000","last_became_peered":"2024-04-26T11:16:36.861563+0000","last_unstale":"2024-04-26T11:16:36.868328+0000","last_undegraded":"2024-04-26T11:16:36.868328+0000","last_fullsized":"2024-04-26T11:16:36.868328+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:32.284607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867521+0000","last_change":"2024-04-26T11:13:12.916685+0000","last_active":"2024-04-26T11:16:39.867521+0000","last_peered":"2024-04-26T11:16:39.867521+0000","last_clean":"2024-04-26T11:16:39.867521+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:16:39.867521+0000","last_undegraded":"2024-04-26T11:16:39.867521+0000","last_fullsized":"2024-04-26T11:16:39.867521+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.861955+0000","last_change":"2024-04-26T11:16:36.862068+0000","last_active":"2024-04-26T11:16:38.861955+0000","last_peered":"2024-04-26T11:16:38.861955+0000","last_clean":"2024-04-26T11:16:38.861955+0000","last_became_active":"2024-04-26T11:16:36.860845+0000","last_became_peered":"2024-04-26T11:16:36.860845+0000","last_unstale":"2024-04-26T11:16:38.861955+0000","last_undegraded":"2024-04-26T11:16:38.861955+0000","last_fullsized":"2024-04-26T11:16:38.861955+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:54.740487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868110+0000","last_change":"2024-04-26T11:13:12.915238+0000","last_active":"2024-04-26T11:16:39.868110+0000","last_peered":"2024-04-26T11:16:39.868110+0000","last_clean":"2024-04-26T11:16:39.868110+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:16:39.868110+0000","last_undegraded":"2024-04-26T11:16:39.868110+0000","last_fullsized":"2024-04-26T11:16:39.868110+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:48.068465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":81,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867233+0000","last_change":"2024-04-26T11:16:36.859741+0000","last_active":"2024-04-26T11:16:39.867233+0000","last_peered":"2024-04-26T11:16:39.867233+0000","last_clean":"2024-04-26T11:16:39.867233+0000","last_became_active":"2024-04-26T11:16:36.859257+0000","last_became_peered":"2024-04-26T11:16:36.859257+0000","last_unstale":"2024-04-26T11:16:39.867233+0000","last_undegraded":"2024-04-26T11:16:39.867233+0000","last_fullsized":"2024-04-26T11:16:39.867233+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:44.680191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862619+0000","last_change":"2024-04-26T11:16:36.869499+0000","last_active":"2024-04-26T11:16:38.862619+0000","last_peered":"2024-04-26T11:16:38.862619+0000","last_clean":"2024-04-26T11:16:38.862619+0000","last_became_active":"2024-04-26T11:16:36.868256+0000","last_became_peered":"2024-04-26T11:16:36.868256+0000","last_unstale":"2024-04-26T11:16:38.862619+0000","last_undegraded":"2024-04-26T11:16:38.862619+0000","last_fullsized":"2024-04-26T11:16:38.862619+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:02.923235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":24,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871953+0000","last_change":"2024-04-26T11:16:36.870080+0000","last_active":"2024-04-26T11:16:36.871953+0000","last_peered":"2024-04-26T11:16:36.871953+0000","last_clean":"2024-04-26T11:16:36.871953+0000","last_became_active":"2024-04-26T11:16:36.867077+0000","last_became_peered":"2024-04-26T11:16:36.867077+0000","last_unstale":"2024-04-26T11:16:36.871953+0000","last_undegraded":"2024-04-26T11:16:36.871953+0000","last_fullsized":"2024-04-26T11:16:36.871953+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:25.497636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862804+0000","last_change":"2024-04-26T11:16:36.862068+0000","last_active":"2024-04-26T11:16:38.862804+0000","last_peered":"2024-04-26T11:16:38.862804+0000","last_clean":"2024-04-26T11:16:38.862804+0000","last_became_active":"2024-04-26T11:16:36.860565+0000","last_became_peered":"2024-04-26T11:16:36.860565+0000","last_unstale":"2024-04-26T11:16:38.862804+0000","last_undegraded":"2024-04-26T11:16:38.862804+0000","last_fullsized":"2024-04-26T11:16:38.862804+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:38:14.430827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":23,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.866965+0000","last_change":"2024-04-26T11:16:36.861810+0000","last_active":"2024-04-26T11:16:36.866965+0000","last_peered":"2024-04-26T11:16:36.866965+0000","last_clean":"2024-04-26T11:16:36.866965+0000","last_became_active":"2024-04-26T11:16:36.860299+0000","last_became_peered":"2024-04-26T11:16:36.860299+0000","last_unstale":"2024-04-26T11:16:36.866965+0000","last_undegraded":"2024-04-26T11:16:36.866965+0000","last_fullsized":"2024-04-26T11:16:36.866965+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:13.262452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866753+0000","last_change":"2024-04-26T11:16:36.871465+0000","last_active":"2024-04-26T11:16:39.866753+0000","last_peered":"2024-04-26T11:16:39.866753+0000","last_clean":"2024-04-26T11:16:39.866753+0000","last_became_active":"2024-04-26T11:16:36.871072+0000","last_became_peered":"2024-04-26T11:16:36.871072+0000","last_unstale":"2024-04-26T11:16:39.866753+0000","last_undegraded":"2024-04-26T11:16:39.866753+0000","last_fullsized":"2024-04-26T11:16:39.866753+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:13.048577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":83,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867855+0000","last_change":"2024-04-26T11:16:36.865905+0000","last_active":"2024-04-26T11:16:39.867855+0000","last_peered":"2024-04-26T11:16:39.867855+0000","last_clean":"2024-04-26T11:16:39.867855+0000","last_became_active":"2024-04-26T11:16:36.865374+0000","last_became_peered":"2024-04-26T11:16:36.865374+0000","last_unstale":"2024-04-26T11:16:39.867855+0000","last_undegraded":"2024-04-26T11:16:39.867855+0000","last_fullsized":"2024-04-26T11:16:39.867855+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:08:59.199058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867522+0000","last_change":"2024-04-26T11:13:12.912207+0000","last_active":"2024-04-26T11:16:39.867522+0000","last_peered":"2024-04-26T11:16:39.867522+0000","last_clean":"2024-04-26T11:16:39.867522+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:16:39.867522+0000","last_undegraded":"2024-04-26T11:16:39.867522+0000","last_fullsized":"2024-04-26T11:16:39.867522+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":23,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.868015+0000","last_change":"2024-04-26T11:16:36.861887+0000","last_active":"2024-04-26T11:16:36.868015+0000","last_peered":"2024-04-26T11:16:36.868015+0000","last_clean":"2024-04-26T11:16:36.868015+0000","last_became_active":"2024-04-26T11:16:36.861385+0000","last_became_peered":"2024-04-26T11:16:36.861385+0000","last_unstale":"2024-04-26T11:16:36.868015+0000","last_undegraded":"2024-04-26T11:16:36.868015+0000","last_fullsized":"2024-04-26T11:16:36.868015+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:59.045795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.870155+0000","last_change":"2024-04-26T11:16:36.866558+0000","last_active":"2024-04-26T11:16:36.870155+0000","last_peered":"2024-04-26T11:16:36.870155+0000","last_clean":"2024-04-26T11:16:36.870155+0000","last_became_active":"2024-04-26T11:16:36.865645+0000","last_became_peered":"2024-04-26T11:16:36.865645+0000","last_unstale":"2024-04-26T11:16:36.870155+0000","last_undegraded":"2024-04-26T11:16:36.870155+0000","last_fullsized":"2024-04-26T11:16:36.870155+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:26.653256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871699+0000","last_change":"2024-04-26T11:16:36.869527+0000","last_active":"2024-04-26T11:16:36.871699+0000","last_peered":"2024-04-26T11:16:36.871699+0000","last_clean":"2024-04-26T11:16:36.871699+0000","last_became_active":"2024-04-26T11:16:36.869081+0000","last_became_peered":"2024-04-26T11:16:36.869081+0000","last_unstale":"2024-04-26T11:16:36.871699+0000","last_undegraded":"2024-04-26T11:16:36.871699+0000","last_fullsized":"2024-04-26T11:16:36.871699+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:25.536503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862609+0000","last_change":"2024-04-26T11:16:36.867197+0000","last_active":"2024-04-26T11:16:38.862609+0000","last_peered":"2024-04-26T11:16:38.862609+0000","last_clean":"2024-04-26T11:16:38.862609+0000","last_became_active":"2024-04-26T11:16:36.866699+0000","last_became_peered":"2024-04-26T11:16:36.866699+0000","last_unstale":"2024-04-26T11:16:38.862609+0000","last_undegraded":"2024-04-26T11:16:38.862609+0000","last_fullsized":"2024-04-26T11:16:38.862609+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:10.074682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":22,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862680+0000","last_change":"2024-04-26T11:16:36.866905+0000","last_active":"2024-04-26T11:16:38.862680+0000","last_peered":"2024-04-26T11:16:38.862680+0000","last_clean":"2024-04-26T11:16:38.862680+0000","last_became_active":"2024-04-26T11:16:36.865531+0000","last_became_peered":"2024-04-26T11:16:36.865531+0000","last_unstale":"2024-04-26T11:16:38.862680+0000","last_undegraded":"2024-04-26T11:16:38.862680+0000","last_fullsized":"2024-04-26T11:16:38.862680+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:16.961092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871146+0000","last_change":"2024-04-26T11:16:36.867822+0000","last_active":"2024-04-26T11:16:36.871146+0000","last_peered":"2024-04-26T11:16:36.871146+0000","last_clean":"2024-04-26T11:16:36.871146+0000","last_became_active":"2024-04-26T11:16:36.865633+0000","last_became_peered":"2024-04-26T11:16:36.865633+0000","last_unstale":"2024-04-26T11:16:36.871146+0000","last_undegraded":"2024-04-26T11:16:36.871146+0000","last_fullsized":"2024-04-26T11:16:36.871146+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:07.461066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.867886+0000","last_change":"2024-04-26T11:16:36.861799+0000","last_active":"2024-04-26T11:16:36.867886+0000","last_peered":"2024-04-26T11:16:36.867886+0000","last_clean":"2024-04-26T11:16:36.867886+0000","last_became_active":"2024-04-26T11:16:36.860707+0000","last_became_peered":"2024-04-26T11:16:36.860707+0000","last_unstale":"2024-04-26T11:16:36.867886+0000","last_undegraded":"2024-04-26T11:16:36.867886+0000","last_fullsized":"2024-04-26T11:16:36.867886+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:04.733669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.870621+0000","last_change":"2024-04-26T11:16:36.866866+0000","last_active":"2024-04-26T11:16:36.870621+0000","last_peered":"2024-04-26T11:16:36.870621+0000","last_clean":"2024-04-26T11:16:36.870621+0000","last_became_active":"2024-04-26T11:16:36.865663+0000","last_became_peered":"2024-04-26T11:16:36.865663+0000","last_unstale":"2024-04-26T11:16:36.870621+0000","last_undegraded":"2024-04-26T11:16:36.870621+0000","last_fullsized":"2024-04-26T11:16:36.870621+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:40:33.235331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":81,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867244+0000","last_change":"2024-04-26T11:16:36.859551+0000","last_active":"2024-04-26T11:16:39.867244+0000","last_peered":"2024-04-26T11:16:39.867244+0000","last_clean":"2024-04-26T11:16:39.867244+0000","last_became_active":"2024-04-26T11:16:36.859140+0000","last_became_peered":"2024-04-26T11:16:36.859140+0000","last_unstale":"2024-04-26T11:16:39.867244+0000","last_undegraded":"2024-04-26T11:16:39.867244+0000","last_fullsized":"2024-04-26T11:16:39.867244+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:12.288869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.864154+0000","last_change":"2024-04-26T11:16:36.861324+0000","last_active":"2024-04-26T11:16:36.864154+0000","last_peered":"2024-04-26T11:16:36.864154+0000","last_clean":"2024-04-26T11:16:36.864154+0000","last_became_active":"2024-04-26T11:16:36.859490+0000","last_became_peered":"2024-04-26T11:16:36.859490+0000","last_unstale":"2024-04-26T11:16:36.864154+0000","last_undegraded":"2024-04-26T11:16:36.864154+0000","last_fullsized":"2024-04-26T11:16:36.864154+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:08.842836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":68,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867074+0000","last_change":"2024-04-26T11:13:12.493217+0000","last_active":"2024-04-26T11:16:39.867074+0000","last_peered":"2024-04-26T11:16:39.867074+0000","last_clean":"2024-04-26T11:16:39.867074+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:16:39.867074+0000","last_undegraded":"2024-04-26T11:16:39.867074+0000","last_fullsized":"2024-04-26T11:16:39.867074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:00.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868134+0000","last_change":"2024-04-26T11:14:08.592365+0000","last_active":"2024-04-26T11:16:39.868134+0000","last_peered":"2024-04-26T11:16:39.868134+0000","last_clean":"2024-04-26T11:16:39.868134+0000","last_became_active":"2024-04-26T11:14:08.591926+0000","last_became_peered":"2024-04-26T11:14:08.591926+0000","last_unstale":"2024-04-26T11:16:39.868134+0000","last_undegraded":"2024-04-26T11:16:39.868134+0000","last_fullsized":"2024-04-26T11:16:39.868134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:52.475134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867490+0000","last_change":"2024-04-26T11:14:08.590727+0000","last_active":"2024-04-26T11:16:39.867490+0000","last_peered":"2024-04-26T11:16:39.867490+0000","last_clean":"2024-04-26T11:16:39.867490+0000","last_became_active":"2024-04-26T11:14:08.590371+0000","last_became_peered":"2024-04-26T11:14:08.590371+0000","last_unstale":"2024-04-26T11:16:39.867490+0000","last_undegraded":"2024-04-26T11:16:39.867490+0000","last_fullsized":"2024-04-26T11:16:39.867490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:32.002629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871195+0000","last_change":"2024-04-26T11:16:36.867874+0000","last_active":"2024-04-26T11:16:36.871195+0000","last_peered":"2024-04-26T11:16:36.871195+0000","last_clean":"2024-04-26T11:16:36.871195+0000","last_became_active":"2024-04-26T11:16:36.866878+0000","last_became_peered":"2024-04-26T11:16:36.866878+0000","last_unstale":"2024-04-26T11:16:36.871195+0000","last_undegraded":"2024-04-26T11:16:36.871195+0000","last_fullsized":"2024-04-26T11:16:36.871195+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:14.516925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867232+0000","last_change":"2024-04-26T11:16:36.866017+0000","last_active":"2024-04-26T11:16:39.867232+0000","last_peered":"2024-04-26T11:16:39.867232+0000","last_clean":"2024-04-26T11:16:39.867232+0000","last_became_active":"2024-04-26T11:16:36.865328+0000","last_became_peered":"2024-04-26T11:16:36.865328+0000","last_unstale":"2024-04-26T11:16:39.867232+0000","last_undegraded":"2024-04-26T11:16:39.867232+0000","last_fullsized":"2024-04-26T11:16:39.867232+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:11.301479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.864258+0000","last_change":"2024-04-26T11:16:36.861685+0000","last_active":"2024-04-26T11:16:36.864258+0000","last_peered":"2024-04-26T11:16:36.864258+0000","last_clean":"2024-04-26T11:16:36.864258+0000","last_became_active":"2024-04-26T11:16:36.859534+0000","last_became_peered":"2024-04-26T11:16:36.859534+0000","last_unstale":"2024-04-26T11:16:36.864258+0000","last_undegraded":"2024-04-26T11:16:36.864258+0000","last_fullsized":"2024-04-26T11:16:36.864258+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:53:17.183514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.868297+0000","last_change":"2024-04-26T11:16:36.862872+0000","last_active":"2024-04-26T11:16:36.868297+0000","last_peered":"2024-04-26T11:16:36.868297+0000","last_clean":"2024-04-26T11:16:36.868297+0000","last_became_active":"2024-04-26T11:16:36.860322+0000","last_became_peered":"2024-04-26T11:16:36.860322+0000","last_unstale":"2024-04-26T11:16:36.868297+0000","last_undegraded":"2024-04-26T11:16:36.868297+0000","last_fullsized":"2024-04-26T11:16:36.868297+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:37.186329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866979+0000","last_change":"2024-04-26T11:14:08.589823+0000","last_active":"2024-04-26T11:16:39.866979+0000","last_peered":"2024-04-26T11:16:39.866979+0000","last_clean":"2024-04-26T11:16:39.866979+0000","last_became_active":"2024-04-26T11:14:08.588808+0000","last_became_peered":"2024-04-26T11:14:08.588808+0000","last_unstale":"2024-04-26T11:16:39.866979+0000","last_undegraded":"2024-04-26T11:16:39.866979+0000","last_fullsized":"2024-04-26T11:16:39.866979+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:31.499991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867107+0000","last_change":"2024-04-26T11:14:08.590654+0000","last_active":"2024-04-26T11:16:39.867107+0000","last_peered":"2024-04-26T11:16:39.867107+0000","last_clean":"2024-04-26T11:16:39.867107+0000","last_became_active":"2024-04-26T11:14:08.590089+0000","last_became_peered":"2024-04-26T11:14:08.590089+0000","last_unstale":"2024-04-26T11:16:39.867107+0000","last_undegraded":"2024-04-26T11:16:39.867107+0000","last_fullsized":"2024-04-26T11:16:39.867107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:56.592753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":81,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867006+0000","last_change":"2024-04-26T11:16:36.871527+0000","last_active":"2024-04-26T11:16:39.867006+0000","last_peered":"2024-04-26T11:16:39.867006+0000","last_clean":"2024-04-26T11:16:39.867006+0000","last_became_active":"2024-04-26T11:16:36.871175+0000","last_became_peered":"2024-04-26T11:16:36.871175+0000","last_unstale":"2024-04-26T11:16:39.867006+0000","last_undegraded":"2024-04-26T11:16:39.867006+0000","last_fullsized":"2024-04-26T11:16:39.867006+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:39.731275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868396+0000","last_change":"2024-04-26T11:14:08.592455+0000","last_active":"2024-04-26T11:16:39.868396+0000","last_peered":"2024-04-26T11:16:39.868396+0000","last_clean":"2024-04-26T11:16:39.868396+0000","last_became_active":"2024-04-26T11:14:08.592069+0000","last_became_peered":"2024-04-26T11:14:08.592069+0000","last_unstale":"2024-04-26T11:16:39.868396+0000","last_undegraded":"2024-04-26T11:16:39.868396+0000","last_fullsized":"2024-04-26T11:16:39.868396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:51:18.264318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.866327+0000","last_change":"2024-04-26T11:16:36.860776+0000","last_active":"2024-04-26T11:16:36.866327+0000","last_peered":"2024-04-26T11:16:36.866327+0000","last_clean":"2024-04-26T11:16:36.866327+0000","last_became_active":"2024-04-26T11:16:36.859301+0000","last_became_peered":"2024-04-26T11:16:36.859301+0000","last_unstale":"2024-04-26T11:16:36.866327+0000","last_undegraded":"2024-04-26T11:16:36.866327+0000","last_fullsized":"2024-04-26T11:16:36.866327+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:27.648935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":217,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.869995+0000","last_change":"2024-04-26T11:16:36.864256+0000","last_active":"2024-04-26T11:16:36.869995+0000","last_peered":"2024-04-26T11:16:36.869995+0000","last_clean":"2024-04-26T11:16:36.869995+0000","last_became_active":"2024-04-26T11:16:36.863058+0000","last_became_peered":"2024-04-26T11:16:36.863058+0000","last_unstale":"2024-04-26T11:16:36.869995+0000","last_undegraded":"2024-04-26T11:16:36.869995+0000","last_fullsized":"2024-04-26T11:16:36.869995+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:49.355165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867374+0000","last_change":"2024-04-26T11:14:08.589733+0000","last_active":"2024-04-26T11:16:39.867374+0000","last_peered":"2024-04-26T11:16:39.867374+0000","last_clean":"2024-04-26T11:16:39.867374+0000","last_became_active":"2024-04-26T11:14:08.589187+0000","last_became_peered":"2024-04-26T11:14:08.589187+0000","last_unstale":"2024-04-26T11:16:39.867374+0000","last_undegraded":"2024-04-26T11:16:39.867374+0000","last_fullsized":"2024-04-26T11:16:39.867374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:47.437503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.868046+0000","last_change":"2024-04-26T11:16:36.864249+0000","last_active":"2024-04-26T11:16:36.868046+0000","last_peered":"2024-04-26T11:16:36.868046+0000","last_clean":"2024-04-26T11:16:36.868046+0000","last_became_active":"2024-04-26T11:16:36.863279+0000","last_became_peered":"2024-04-26T11:16:36.863279+0000","last_unstale":"2024-04-26T11:16:36.868046+0000","last_undegraded":"2024-04-26T11:16:36.868046+0000","last_fullsized":"2024-04-26T11:16:36.868046+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:19.053419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871871+0000","last_change":"2024-04-26T11:16:36.869342+0000","last_active":"2024-04-26T11:16:36.871871+0000","last_peered":"2024-04-26T11:16:36.871871+0000","last_clean":"2024-04-26T11:16:36.871871+0000","last_became_active":"2024-04-26T11:16:36.866494+0000","last_became_peered":"2024-04-26T11:16:36.866494+0000","last_unstale":"2024-04-26T11:16:36.871871+0000","last_undegraded":"2024-04-26T11:16:36.871871+0000","last_fullsized":"2024-04-26T11:16:36.871871+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:19.386938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.861732+0000","last_change":"2024-04-26T11:16:36.863211+0000","last_active":"2024-04-26T11:16:38.861732+0000","last_peered":"2024-04-26T11:16:38.861732+0000","last_clean":"2024-04-26T11:16:38.861732+0000","last_became_active":"2024-04-26T11:16:36.862085+0000","last_became_peered":"2024-04-26T11:16:36.862085+0000","last_unstale":"2024-04-26T11:16:38.861732+0000","last_undegraded":"2024-04-26T11:16:38.861732+0000","last_fullsized":"2024-04-26T11:16:38.861732+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:55.260721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868073+0000","last_change":"2024-04-26T11:13:12.918648+0000","last_active":"2024-04-26T11:16:39.868073+0000","last_peered":"2024-04-26T11:16:39.868073+0000","last_clean":"2024-04-26T11:16:39.868073+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:16:39.868073+0000","last_undegraded":"2024-04-26T11:16:39.868073+0000","last_fullsized":"2024-04-26T11:16:39.868073+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":71,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868260+0000","last_change":"2024-04-26T11:13:08.110433+0000","last_active":"2024-04-26T11:16:39.868260+0000","last_peered":"2024-04-26T11:16:39.868260+0000","last_clean":"2024-04-26T11:16:39.868260+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:16:39.868260+0000","last_undegraded":"2024-04-26T11:16:39.868260+0000","last_fullsized":"2024-04-26T11:16:39.868260+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867596+0000","last_change":"2024-04-26T11:14:08.590798+0000","last_active":"2024-04-26T11:16:39.867596+0000","last_peered":"2024-04-26T11:16:39.867596+0000","last_clean":"2024-04-26T11:16:39.867596+0000","last_became_active":"2024-04-26T11:14:08.590535+0000","last_became_peered":"2024-04-26T11:14:08.590535+0000","last_unstale":"2024-04-26T11:16:39.867596+0000","last_undegraded":"2024-04-26T11:16:39.867596+0000","last_fullsized":"2024-04-26T11:16:39.867596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:04.692288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867073+0000","last_change":"2024-04-26T11:16:36.866253+0000","last_active":"2024-04-26T11:16:39.867073+0000","last_peered":"2024-04-26T11:16:39.867073+0000","last_clean":"2024-04-26T11:16:39.867073+0000","last_became_active":"2024-04-26T11:16:36.865560+0000","last_became_peered":"2024-04-26T11:16:36.865560+0000","last_unstale":"2024-04-26T11:16:39.867073+0000","last_undegraded":"2024-04-26T11:16:39.867073+0000","last_fullsized":"2024-04-26T11:16:39.867073+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:52.517359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":59,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868432+0000","last_change":"2024-04-26T11:14:08.592482+0000","last_active":"2024-04-26T11:16:39.868432+0000","last_peered":"2024-04-26T11:16:39.868432+0000","last_clean":"2024-04-26T11:16:39.868432+0000","last_became_active":"2024-04-26T11:14:08.592093+0000","last_became_peered":"2024-04-26T11:14:08.592093+0000","last_unstale":"2024-04-26T11:16:39.868432+0000","last_undegraded":"2024-04-26T11:16:39.868432+0000","last_fullsized":"2024-04-26T11:16:39.868432+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:38.939541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867975+0000","last_change":"2024-04-26T11:14:08.589530+0000","last_active":"2024-04-26T11:16:39.867975+0000","last_peered":"2024-04-26T11:16:39.867975+0000","last_clean":"2024-04-26T11:16:39.867975+0000","last_became_active":"2024-04-26T11:14:08.589288+0000","last_became_peered":"2024-04-26T11:14:08.589288+0000","last_unstale":"2024-04-26T11:16:39.867975+0000","last_undegraded":"2024-04-26T11:16:39.867975+0000","last_fullsized":"2024-04-26T11:16:39.867975+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:52.096175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":2,"reported_epoch":69,"state":"peering","last_fresh":"2024-04-26T11:14:08.582736+0000","last_change":"2024-04-26T11:13:42.307124+0000","last_active":"2024-04-26T11:13:42.305890+0000","last_peered":"2024-04-26T11:13:39.301215+0000","last_clean":"2024-04-26T11:13:39.301215+0000","last_became_active":"2024-04-26T11:13:12.918816+0000","last_became_peered":"2024-04-26T11:13:12.918816+0000","last_unstale":"2024-04-26T11:14:08.582736+0000","last_undegraded":"2024-04-26T11:14:08.582736+0000","last_fullsized":"2024-04-26T11:14:08.582736+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:02.747912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.863957+0000","last_change":"2024-04-26T11:16:36.860868+0000","last_active":"2024-04-26T11:16:36.863957+0000","last_peered":"2024-04-26T11:16:36.863957+0000","last_clean":"2024-04-26T11:16:36.863957+0000","last_became_active":"2024-04-26T11:16:36.858042+0000","last_became_peered":"2024-04-26T11:16:36.858042+0000","last_unstale":"2024-04-26T11:16:36.863957+0000","last_undegraded":"2024-04-26T11:16:36.863957+0000","last_fullsized":"2024-04-26T11:16:36.863957+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:57:35.285183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":24,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T11:16:38.862568+0000","last_change":"2024-04-26T11:16:36.867856+0000","last_active":"2024-04-26T11:16:38.862568+0000","last_peered":"2024-04-26T11:16:38.862568+0000","last_clean":"2024-04-26T11:16:38.862568+0000","last_became_active":"2024-04-26T11:16:36.865816+0000","last_became_peered":"2024-04-26T11:16:36.865816+0000","last_unstale":"2024-04-26T11:16:38.862568+0000","last_undegraded":"2024-04-26T11:16:38.862568+0000","last_fullsized":"2024-04-26T11:16:38.862568+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:35.210355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867366+0000","last_change":"2024-04-26T11:16:36.859796+0000","last_active":"2024-04-26T11:16:39.867366+0000","last_peered":"2024-04-26T11:16:39.867366+0000","last_clean":"2024-04-26T11:16:39.867366+0000","last_became_active":"2024-04-26T11:16:36.859544+0000","last_became_peered":"2024-04-26T11:16:36.859544+0000","last_unstale":"2024-04-26T11:16:39.867366+0000","last_undegraded":"2024-04-26T11:16:39.867366+0000","last_fullsized":"2024-04-26T11:16:39.867366+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:54.365229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":85,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.872196+0000","last_change":"2024-04-26T11:16:39.870923+0000","last_active":"2024-04-26T11:16:39.872196+0000","last_peered":"2024-04-26T11:16:39.872196+0000","last_clean":"2024-04-26T11:16:39.872196+0000","last_became_active":"2024-04-26T11:16:39.870633+0000","last_became_peered":"2024-04-26T11:16:39.870633+0000","last_unstale":"2024-04-26T11:16:39.872196+0000","last_undegraded":"2024-04-26T11:16:39.872196+0000","last_fullsized":"2024-04-26T11:16:39.872196+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:52.853443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867633+0000","last_change":"2024-04-26T11:13:12.917812+0000","last_active":"2024-04-26T11:16:39.867633+0000","last_peered":"2024-04-26T11:16:39.867633+0000","last_clean":"2024-04-26T11:16:39.867633+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:16:39.867633+0000","last_undegraded":"2024-04-26T11:16:39.867633+0000","last_fullsized":"2024-04-26T11:16:39.867633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":2,"reported_epoch":69,"state":"peering","last_fresh":"2024-04-26T11:14:06.583168+0000","last_change":"2024-04-26T11:16:39.863541+0000","last_active":"2024-04-26T11:16:39.863541+0000","last_peered":"2024-04-26T11:14:06.583168+0000","last_clean":"2024-04-26T11:14:06.583168+0000","last_became_active":"2024-04-26T11:13:43.321846+0000","last_became_peered":"2024-04-26T11:13:43.321846+0000","last_unstale":"2024-04-26T11:14:06.583168+0000","last_undegraded":"2024-04-26T11:14:06.583168+0000","last_fullsized":"2024-04-26T11:14:06.583168+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:14.138907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.869411+0000","last_change":"2024-04-26T11:16:36.865623+0000","last_active":"2024-04-26T11:16:36.869411+0000","last_peered":"2024-04-26T11:16:36.869411+0000","last_clean":"2024-04-26T11:16:36.869411+0000","last_became_active":"2024-04-26T11:16:36.864187+0000","last_became_peered":"2024-04-26T11:16:36.864187+0000","last_unstale":"2024-04-26T11:16:36.869411+0000","last_undegraded":"2024-04-26T11:16:36.869411+0000","last_fullsized":"2024-04-26T11:16:36.869411+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:25.032691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":83,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867982+0000","last_change":"2024-04-26T11:16:36.867034+0000","last_active":"2024-04-26T11:16:39.867982+0000","last_peered":"2024-04-26T11:16:39.867982+0000","last_clean":"2024-04-26T11:16:39.867982+0000","last_became_active":"2024-04-26T11:16:36.866529+0000","last_became_peered":"2024-04-26T11:16:36.866529+0000","last_unstale":"2024-04-26T11:16:39.867982+0000","last_undegraded":"2024-04-26T11:16:39.867982+0000","last_fullsized":"2024-04-26T11:16:39.867982+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:36.200369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.870137+0000","last_change":"2024-04-26T11:16:36.865772+0000","last_active":"2024-04-26T11:16:36.870137+0000","last_peered":"2024-04-26T11:16:36.870137+0000","last_clean":"2024-04-26T11:16:36.870137+0000","last_became_active":"2024-04-26T11:16:36.865213+0000","last_became_peered":"2024-04-26T11:16:36.865213+0000","last_unstale":"2024-04-26T11:16:36.870137+0000","last_undegraded":"2024-04-26T11:16:36.870137+0000","last_fullsized":"2024-04-26T11:16:36.870137+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:03.220593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867741+0000","last_change":"2024-04-26T11:14:08.589726+0000","last_active":"2024-04-26T11:16:39.867741+0000","last_peered":"2024-04-26T11:16:39.867741+0000","last_clean":"2024-04-26T11:16:39.867741+0000","last_became_active":"2024-04-26T11:14:08.588687+0000","last_became_peered":"2024-04-26T11:14:08.588687+0000","last_unstale":"2024-04-26T11:16:39.867741+0000","last_undegraded":"2024-04-26T11:16:39.867741+0000","last_fullsized":"2024-04-26T11:16:39.867741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:05.617266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867685+0000","last_change":"2024-04-26T11:13:12.917763+0000","last_active":"2024-04-26T11:16:39.867685+0000","last_peered":"2024-04-26T11:16:39.867685+0000","last_clean":"2024-04-26T11:16:39.867685+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:16:39.867685+0000","last_undegraded":"2024-04-26T11:16:39.867685+0000","last_fullsized":"2024-04-26T11:16:39.867685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":2,"reported_epoch":69,"state":"peering","last_fresh":"2024-04-26T11:14:06.582422+0000","last_change":"2024-04-26T11:16:39.863687+0000","last_active":"2024-04-26T11:16:39.863687+0000","last_peered":"2024-04-26T11:14:06.582422+0000","last_clean":"2024-04-26T11:14:06.582422+0000","last_became_active":"2024-04-26T11:13:43.321829+0000","last_became_peered":"2024-04-26T11:13:43.321829+0000","last_unstale":"2024-04-26T11:14:06.582422+0000","last_undegraded":"2024-04-26T11:14:06.582422+0000","last_fullsized":"2024-04-26T11:14:06.582422+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:56.385417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.872318+0000","last_change":"2024-04-26T11:16:36.870651+0000","last_active":"2024-04-26T11:16:36.872318+0000","last_peered":"2024-04-26T11:16:36.872318+0000","last_clean":"2024-04-26T11:16:36.872318+0000","last_became_active":"2024-04-26T11:16:36.869018+0000","last_became_peered":"2024-04-26T11:16:36.869018+0000","last_unstale":"2024-04-26T11:16:36.872318+0000","last_undegraded":"2024-04-26T11:16:36.872318+0000","last_fullsized":"2024-04-26T11:16:36.872318+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:59.337390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T11:16:36.871964+0000","last_change":"2024-04-26T11:16:36.870356+0000","last_active":"2024-04-26T11:16:36.871964+0000","last_peered":"2024-04-26T11:16:36.871964+0000","last_clean":"2024-04-26T11:16:36.871964+0000","last_became_active":"2024-04-26T11:16:36.868029+0000","last_became_peered":"2024-04-26T11:16:36.868029+0000","last_unstale":"2024-04-26T11:16:36.871964+0000","last_undegraded":"2024-04-26T11:16:36.871964+0000","last_fullsized":"2024-04-26T11:16:36.871964+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:13:24.219419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867005+0000","last_change":"2024-04-26T11:14:08.590838+0000","last_active":"2024-04-26T11:16:39.867005+0000","last_peered":"2024-04-26T11:16:39.867005+0000","last_clean":"2024-04-26T11:16:39.867005+0000","last_became_active":"2024-04-26T11:14:08.590386+0000","last_became_peered":"2024-04-26T11:14:08.590386+0000","last_unstale":"2024-04-26T11:16:39.867005+0000","last_undegraded":"2024-04-26T11:16:39.867005+0000","last_fullsized":"2024-04-26T11:16:39.867005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:50.791318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867454+0000","last_change":"2024-04-26T11:16:36.866359+0000","last_active":"2024-04-26T11:16:39.867454+0000","last_peered":"2024-04-26T11:16:39.867454+0000","last_clean":"2024-04-26T11:16:39.867454+0000","last_became_active":"2024-04-26T11:16:36.865724+0000","last_became_peered":"2024-04-26T11:16:36.865724+0000","last_unstale":"2024-04-26T11:16:39.867454+0000","last_undegraded":"2024-04-26T11:16:39.867454+0000","last_fullsized":"2024-04-26T11:16:39.867454+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:27.869054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867323+0000","last_change":"2024-04-26T11:14:08.589117+0000","last_active":"2024-04-26T11:16:39.867323+0000","last_peered":"2024-04-26T11:16:39.867323+0000","last_clean":"2024-04-26T11:16:39.867323+0000","last_became_active":"2024-04-26T11:14:08.588762+0000","last_became_peered":"2024-04-26T11:14:08.588762+0000","last_unstale":"2024-04-26T11:16:39.867323+0000","last_undegraded":"2024-04-26T11:16:39.867323+0000","last_fullsized":"2024-04-26T11:16:39.867323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:05.658069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867704+0000","last_change":"2024-04-26T11:16:36.866641+0000","last_active":"2024-04-26T11:16:39.867704+0000","last_peered":"2024-04-26T11:16:39.867704+0000","last_clean":"2024-04-26T11:16:39.867704+0000","last_became_active":"2024-04-26T11:16:36.866112+0000","last_became_peered":"2024-04-26T11:16:36.866112+0000","last_unstale":"2024-04-26T11:16:39.867704+0000","last_undegraded":"2024-04-26T11:16:39.867704+0000","last_fullsized":"2024-04-26T11:16:39.867704+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:31.034151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":3,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5470,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738413,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281052,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94090788,"statfs":{"total":96636764160,"available":96348966912,"internally_reserved":0,"allocated":1392640,"data_stored":892376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Fri Apr 26 11:16:17 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40200000000000002,"15min":0.378},"min":{"1min":0.20000000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.96499999999999997,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.44400000000000001,"15min":0.44600000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.57599999999999996,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.40699999999999997}]}]},{"osd":0,"up_from":67,"seq":287762808834,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40348,"kb_used_data":1360,"kb_used_omap":6,"kb_used_meta":38969,"kb_avail":94331492,"statfs":{"total":96636764160,"available":96595447808,"internally_reserved":0,"allocated":1392640,"data_stored":889273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7064,"internal_metadata":39904360},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738414,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401048,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":400254,"kb_avail":93970792,"statfs":{"total":96636764160,"available":96226091008,"internally_reserved":0,"allocated":794624,"data_stored":306221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":409860550},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":2,"last update":"Fri Apr 26 11:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.40300000000000002,"15min":0.39300000000000002},"min":{"1min":0.14999999999999999,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.61299999999999999,"5min":2.056,"15min":2.056},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.47899999999999998,"15min":0.45700000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":3.9609999999999999,"5min":3.9609999999999999,"15min":3.9609999999999999},"last":0.435}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5470,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:16:45.871 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T11:16:46.323 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:16:46.324 INFO:teuthology.orchestra.run.smithi029.stdout:{"fsid":"2b52ce04-9559-478f-9787-c3cc3b261c15","health":{"status":"HEALTH_WARN","checks":{"PG_AVAILABILITY":{"severity":"HEALTH_WARN","summary":{"message":"Reduced data availability: 4 pgs inactive, 6 pgs peering","count":10},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":228,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":71,"num_osds":3,"num_up_osds":3,"osd_up_since":1714130195,"num_in_osds":3,"osd_in_since":1714129979,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":99},{"state_name":"peering","count":6}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592730,"bytes_used":739786752,"bytes_avail":289170505728,"bytes_total":289910292480,"inactive_pgs_ratio":0.05714285746216774,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":96,"recovering_keys_per_sec":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4193}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-04-26T11:14:18.463533+0000","services":{}},"progress_events":{}} 2024-04-26T11:16:46.338 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-26T11:16:46.338 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:16:46.684 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:16:46.686 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:16:46.694 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-04-26T11:16:46.509198+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":212,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":722468,"kb_used_data":3516,"kb_used_omap":10,"kb_used_meta":718901,"kb_avail":282393052,"statfs":{"total":289910292480,"available":289170485248,"internally_reserved":0,"allocated":3600384,"data_stored":2096932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10252,"internal_metadata":736155636},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-16,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.649198"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868334+0000","last_change":"2024-04-26T11:13:12.919196+0000","last_active":"2024-04-26T11:16:39.868334+0000","last_peered":"2024-04-26T11:16:39.868334+0000","last_clean":"2024-04-26T11:16:39.868334+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:16:39.868334+0000","last_undegraded":"2024-04-26T11:16:39.868334+0000","last_fullsized":"2024-04-26T11:16:39.868334+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867861+0000","last_change":"2024-04-26T11:13:12.917670+0000","last_active":"2024-04-26T11:16:39.867861+0000","last_peered":"2024-04-26T11:16:39.867861+0000","last_clean":"2024-04-26T11:16:39.867861+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:16:39.867861+0000","last_undegraded":"2024-04-26T11:16:39.867861+0000","last_fullsized":"2024-04-26T11:16:39.867861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868069+0000","last_change":"2024-04-26T11:16:36.866575+0000","last_active":"2024-04-26T11:16:39.868069+0000","last_peered":"2024-04-26T11:16:39.868069+0000","last_clean":"2024-04-26T11:16:39.868069+0000","last_became_active":"2024-04-26T11:16:36.864565+0000","last_became_peered":"2024-04-26T11:16:36.864565+0000","last_unstale":"2024-04-26T11:16:39.868069+0000","last_undegraded":"2024-04-26T11:16:39.868069+0000","last_fullsized":"2024-04-26T11:16:39.868069+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:38.756428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868188+0000","last_change":"2024-04-26T11:16:36.868086+0000","last_active":"2024-04-26T11:16:39.868188+0000","last_peered":"2024-04-26T11:16:39.868188+0000","last_clean":"2024-04-26T11:16:39.868188+0000","last_became_active":"2024-04-26T11:16:36.865679+0000","last_became_peered":"2024-04-26T11:16:36.865679+0000","last_unstale":"2024-04-26T11:16:39.868188+0000","last_undegraded":"2024-04-26T11:16:39.868188+0000","last_fullsized":"2024-04-26T11:16:39.868188+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:22.051599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866980+0000","last_change":"2024-04-26T11:13:12.917403+0000","last_active":"2024-04-26T11:16:39.866980+0000","last_peered":"2024-04-26T11:16:39.866980+0000","last_clean":"2024-04-26T11:16:39.866980+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:16:39.866980+0000","last_undegraded":"2024-04-26T11:16:39.866980+0000","last_fullsized":"2024-04-26T11:16:39.866980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:42.014955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867786+0000","last_change":"2024-04-26T11:16:36.868338+0000","last_active":"2024-04-26T11:16:39.867786+0000","last_peered":"2024-04-26T11:16:39.867786+0000","last_clean":"2024-04-26T11:16:39.867786+0000","last_became_active":"2024-04-26T11:16:36.867049+0000","last_became_peered":"2024-04-26T11:16:36.867049+0000","last_unstale":"2024-04-26T11:16:39.867786+0000","last_undegraded":"2024-04-26T11:16:39.867786+0000","last_fullsized":"2024-04-26T11:16:39.867786+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:57.262622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867261+0000","last_change":"2024-04-26T11:16:36.860337+0000","last_active":"2024-04-26T11:16:39.867261+0000","last_peered":"2024-04-26T11:16:39.867261+0000","last_clean":"2024-04-26T11:16:39.867261+0000","last_became_active":"2024-04-26T11:16:36.859342+0000","last_became_peered":"2024-04-26T11:16:36.859342+0000","last_unstale":"2024-04-26T11:16:39.867261+0000","last_undegraded":"2024-04-26T11:16:39.867261+0000","last_fullsized":"2024-04-26T11:16:39.867261+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:23.653811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866407+0000","last_change":"2024-04-26T11:16:36.863996+0000","last_active":"2024-04-26T11:16:39.866407+0000","last_peered":"2024-04-26T11:16:39.866407+0000","last_clean":"2024-04-26T11:16:39.866407+0000","last_became_active":"2024-04-26T11:16:36.863048+0000","last_became_peered":"2024-04-26T11:16:36.863048+0000","last_unstale":"2024-04-26T11:16:39.866407+0000","last_undegraded":"2024-04-26T11:16:39.866407+0000","last_fullsized":"2024-04-26T11:16:39.866407+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:42.503116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867972+0000","last_change":"2024-04-26T11:14:08.592223+0000","last_active":"2024-04-26T11:16:39.867972+0000","last_peered":"2024-04-26T11:16:39.867972+0000","last_clean":"2024-04-26T11:16:39.867972+0000","last_became_active":"2024-04-26T11:14:08.591660+0000","last_became_peered":"2024-04-26T11:14:08.591660+0000","last_unstale":"2024-04-26T11:16:39.867972+0000","last_undegraded":"2024-04-26T11:16:39.867972+0000","last_fullsized":"2024-04-26T11:16:39.867972+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:06.208634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867975+0000","last_change":"2024-04-26T11:13:12.918521+0000","last_active":"2024-04-26T11:16:39.867975+0000","last_peered":"2024-04-26T11:16:39.867975+0000","last_clean":"2024-04-26T11:16:39.867975+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:16:39.867975+0000","last_undegraded":"2024-04-26T11:16:39.867975+0000","last_fullsized":"2024-04-26T11:16:39.867975+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.871059+0000","last_change":"2024-04-26T11:16:39.869878+0000","last_active":"2024-04-26T11:16:39.871059+0000","last_peered":"2024-04-26T11:16:39.871059+0000","last_clean":"2024-04-26T11:16:39.871059+0000","last_became_active":"2024-04-26T11:16:39.869512+0000","last_became_peered":"2024-04-26T11:16:39.869512+0000","last_unstale":"2024-04-26T11:16:39.871059+0000","last_undegraded":"2024-04-26T11:16:39.871059+0000","last_fullsized":"2024-04-26T11:16:39.871059+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:54.379763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867243+0000","last_change":"2024-04-26T11:16:36.865797+0000","last_active":"2024-04-26T11:16:39.867243+0000","last_peered":"2024-04-26T11:16:39.867243+0000","last_clean":"2024-04-26T11:16:39.867243+0000","last_became_active":"2024-04-26T11:16:36.865360+0000","last_became_peered":"2024-04-26T11:16:36.865360+0000","last_unstale":"2024-04-26T11:16:39.867243+0000","last_undegraded":"2024-04-26T11:16:39.867243+0000","last_fullsized":"2024-04-26T11:16:39.867243+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:14.393010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867206+0000","last_change":"2024-04-26T11:13:12.915484+0000","last_active":"2024-04-26T11:16:39.867206+0000","last_peered":"2024-04-26T11:16:39.867206+0000","last_clean":"2024-04-26T11:16:39.867206+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:16:39.867206+0000","last_undegraded":"2024-04-26T11:16:39.867206+0000","last_fullsized":"2024-04-26T11:16:39.867206+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867420+0000","last_change":"2024-04-26T11:16:36.865308+0000","last_active":"2024-04-26T11:16:39.867420+0000","last_peered":"2024-04-26T11:16:39.867420+0000","last_clean":"2024-04-26T11:16:39.867420+0000","last_became_active":"2024-04-26T11:16:36.864119+0000","last_became_peered":"2024-04-26T11:16:36.864119+0000","last_unstale":"2024-04-26T11:16:39.867420+0000","last_undegraded":"2024-04-26T11:16:39.867420+0000","last_fullsized":"2024-04-26T11:16:39.867420+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:29.265536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.871380+0000","last_change":"2024-04-26T11:16:39.870234+0000","last_active":"2024-04-26T11:16:39.871380+0000","last_peered":"2024-04-26T11:16:39.871380+0000","last_clean":"2024-04-26T11:16:39.871380+0000","last_became_active":"2024-04-26T11:16:39.869644+0000","last_became_peered":"2024-04-26T11:16:39.869644+0000","last_unstale":"2024-04-26T11:16:39.871380+0000","last_undegraded":"2024-04-26T11:16:39.871380+0000","last_fullsized":"2024-04-26T11:16:39.871380+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:45.107551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866744+0000","last_change":"2024-04-26T11:16:36.868941+0000","last_active":"2024-04-26T11:16:39.866744+0000","last_peered":"2024-04-26T11:16:39.866744+0000","last_clean":"2024-04-26T11:16:39.866744+0000","last_became_active":"2024-04-26T11:16:36.864605+0000","last_became_peered":"2024-04-26T11:16:36.864605+0000","last_unstale":"2024-04-26T11:16:39.866744+0000","last_undegraded":"2024-04-26T11:16:39.866744+0000","last_fullsized":"2024-04-26T11:16:39.866744+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:26.687980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867966+0000","last_change":"2024-04-26T11:14:08.592349+0000","last_active":"2024-04-26T11:16:39.867966+0000","last_peered":"2024-04-26T11:16:39.867966+0000","last_clean":"2024-04-26T11:16:39.867966+0000","last_became_active":"2024-04-26T11:14:08.591886+0000","last_became_peered":"2024-04-26T11:14:08.591886+0000","last_unstale":"2024-04-26T11:16:39.867966+0000","last_undegraded":"2024-04-26T11:16:39.867966+0000","last_fullsized":"2024-04-26T11:16:39.867966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:29.835852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868076+0000","last_change":"2024-04-26T11:13:12.918759+0000","last_active":"2024-04-26T11:16:39.868076+0000","last_peered":"2024-04-26T11:16:39.868076+0000","last_clean":"2024-04-26T11:16:39.868076+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:16:39.868076+0000","last_undegraded":"2024-04-26T11:16:39.868076+0000","last_fullsized":"2024-04-26T11:16:39.868076+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:55.002972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868331+0000","last_change":"2024-04-26T11:14:08.591804+0000","last_active":"2024-04-26T11:16:39.868331+0000","last_peered":"2024-04-26T11:16:39.868331+0000","last_clean":"2024-04-26T11:16:39.868331+0000","last_became_active":"2024-04-26T11:14:08.591519+0000","last_became_peered":"2024-04-26T11:14:08.591519+0000","last_unstale":"2024-04-26T11:16:39.868331+0000","last_undegraded":"2024-04-26T11:16:39.868331+0000","last_fullsized":"2024-04-26T11:16:39.868331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:00:27.447921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868357+0000","last_change":"2024-04-26T11:16:36.868357+0000","last_active":"2024-04-26T11:16:39.868357+0000","last_peered":"2024-04-26T11:16:39.868357+0000","last_clean":"2024-04-26T11:16:39.868357+0000","last_became_active":"2024-04-26T11:16:36.866698+0000","last_became_peered":"2024-04-26T11:16:36.866698+0000","last_unstale":"2024-04-26T11:16:39.868357+0000","last_undegraded":"2024-04-26T11:16:39.868357+0000","last_fullsized":"2024-04-26T11:16:39.868357+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:56.560147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866874+0000","last_change":"2024-04-26T11:16:36.864212+0000","last_active":"2024-04-26T11:16:39.866874+0000","last_peered":"2024-04-26T11:16:39.866874+0000","last_clean":"2024-04-26T11:16:39.866874+0000","last_became_active":"2024-04-26T11:16:36.862787+0000","last_became_peered":"2024-04-26T11:16:36.862787+0000","last_unstale":"2024-04-26T11:16:39.866874+0000","last_undegraded":"2024-04-26T11:16:39.866874+0000","last_fullsized":"2024-04-26T11:16:39.866874+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:50.035179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867171+0000","last_change":"2024-04-26T11:16:36.865777+0000","last_active":"2024-04-26T11:16:39.867171+0000","last_peered":"2024-04-26T11:16:39.867171+0000","last_clean":"2024-04-26T11:16:39.867171+0000","last_became_active":"2024-04-26T11:16:36.865251+0000","last_became_peered":"2024-04-26T11:16:36.865251+0000","last_unstale":"2024-04-26T11:16:39.867171+0000","last_undegraded":"2024-04-26T11:16:39.867171+0000","last_fullsized":"2024-04-26T11:16:39.867171+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:58.402967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867448+0000","last_change":"2024-04-26T11:16:36.865177+0000","last_active":"2024-04-26T11:16:39.867448+0000","last_peered":"2024-04-26T11:16:39.867448+0000","last_clean":"2024-04-26T11:16:39.867448+0000","last_became_active":"2024-04-26T11:16:36.864276+0000","last_became_peered":"2024-04-26T11:16:36.864276+0000","last_unstale":"2024-04-26T11:16:39.867448+0000","last_undegraded":"2024-04-26T11:16:39.867448+0000","last_fullsized":"2024-04-26T11:16:39.867448+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:21.982286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867123+0000","last_change":"2024-04-26T11:13:12.912756+0000","last_active":"2024-04-26T11:16:39.867123+0000","last_peered":"2024-04-26T11:16:39.867123+0000","last_clean":"2024-04-26T11:16:39.867123+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:16:39.867123+0000","last_undegraded":"2024-04-26T11:16:39.867123+0000","last_fullsized":"2024-04-26T11:16:39.867123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:04.177831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868332+0000","last_change":"2024-04-26T11:16:36.866893+0000","last_active":"2024-04-26T11:16:39.868332+0000","last_peered":"2024-04-26T11:16:39.868332+0000","last_clean":"2024-04-26T11:16:39.868332+0000","last_became_active":"2024-04-26T11:16:36.866247+0000","last_became_peered":"2024-04-26T11:16:36.866247+0000","last_unstale":"2024-04-26T11:16:39.868332+0000","last_undegraded":"2024-04-26T11:16:39.868332+0000","last_fullsized":"2024-04-26T11:16:39.868332+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:29:00.392204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867806+0000","last_change":"2024-04-26T11:16:36.868960+0000","last_active":"2024-04-26T11:16:39.867806+0000","last_peered":"2024-04-26T11:16:39.867806+0000","last_clean":"2024-04-26T11:16:39.867806+0000","last_became_active":"2024-04-26T11:16:36.868050+0000","last_became_peered":"2024-04-26T11:16:36.868050+0000","last_unstale":"2024-04-26T11:16:39.867806+0000","last_undegraded":"2024-04-26T11:16:39.867806+0000","last_fullsized":"2024-04-26T11:16:39.867806+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:28.198210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868184+0000","last_change":"2024-04-26T11:16:36.867664+0000","last_active":"2024-04-26T11:16:39.868184+0000","last_peered":"2024-04-26T11:16:39.868184+0000","last_clean":"2024-04-26T11:16:39.868184+0000","last_became_active":"2024-04-26T11:16:36.865582+0000","last_became_peered":"2024-04-26T11:16:36.865582+0000","last_unstale":"2024-04-26T11:16:39.868184+0000","last_undegraded":"2024-04-26T11:16:39.868184+0000","last_fullsized":"2024-04-26T11:16:39.868184+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:24.063678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":69,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867110+0000","last_change":"2024-04-26T11:13:12.493425+0000","last_active":"2024-04-26T11:16:39.867110+0000","last_peered":"2024-04-26T11:16:39.867110+0000","last_clean":"2024-04-26T11:16:39.867110+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:16:39.867110+0000","last_undegraded":"2024-04-26T11:16:39.867110+0000","last_fullsized":"2024-04-26T11:16:39.867110+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:23.279580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868220+0000","last_change":"2024-04-26T11:16:36.867629+0000","last_active":"2024-04-26T11:16:39.868220+0000","last_peered":"2024-04-26T11:16:39.868220+0000","last_clean":"2024-04-26T11:16:39.868220+0000","last_became_active":"2024-04-26T11:16:36.867445+0000","last_became_peered":"2024-04-26T11:16:36.867445+0000","last_unstale":"2024-04-26T11:16:39.868220+0000","last_undegraded":"2024-04-26T11:16:39.868220+0000","last_fullsized":"2024-04-26T11:16:39.868220+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:12.072442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.870371+0000","last_change":"2024-04-26T11:16:39.868907+0000","last_active":"2024-04-26T11:16:39.870371+0000","last_peered":"2024-04-26T11:16:39.870371+0000","last_clean":"2024-04-26T11:16:39.870371+0000","last_became_active":"2024-04-26T11:16:39.868569+0000","last_became_peered":"2024-04-26T11:16:39.868569+0000","last_unstale":"2024-04-26T11:16:39.870371+0000","last_undegraded":"2024-04-26T11:16:39.870371+0000","last_fullsized":"2024-04-26T11:16:39.870371+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:48.191394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867319+0000","last_change":"2024-04-26T11:16:36.866812+0000","last_active":"2024-04-26T11:16:39.867319+0000","last_peered":"2024-04-26T11:16:39.867319+0000","last_clean":"2024-04-26T11:16:39.867319+0000","last_became_active":"2024-04-26T11:16:36.865841+0000","last_became_peered":"2024-04-26T11:16:36.865841+0000","last_unstale":"2024-04-26T11:16:39.867319+0000","last_undegraded":"2024-04-26T11:16:39.867319+0000","last_fullsized":"2024-04-26T11:16:39.867319+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:20.948589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867194+0000","last_change":"2024-04-26T11:14:08.589659+0000","last_active":"2024-04-26T11:16:39.867194+0000","last_peered":"2024-04-26T11:16:39.867194+0000","last_clean":"2024-04-26T11:16:39.867194+0000","last_became_active":"2024-04-26T11:14:08.589404+0000","last_became_peered":"2024-04-26T11:14:08.589404+0000","last_unstale":"2024-04-26T11:16:39.867194+0000","last_undegraded":"2024-04-26T11:16:39.867194+0000","last_fullsized":"2024-04-26T11:16:39.867194+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:29.354141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868240+0000","last_change":"2024-04-26T11:16:36.867191+0000","last_active":"2024-04-26T11:16:39.868240+0000","last_peered":"2024-04-26T11:16:39.868240+0000","last_clean":"2024-04-26T11:16:39.868240+0000","last_became_active":"2024-04-26T11:16:36.866876+0000","last_became_peered":"2024-04-26T11:16:36.866876+0000","last_unstale":"2024-04-26T11:16:39.868240+0000","last_undegraded":"2024-04-26T11:16:39.868240+0000","last_fullsized":"2024-04-26T11:16:39.868240+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:39.750259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868395+0000","last_change":"2024-04-26T11:16:36.870740+0000","last_active":"2024-04-26T11:16:39.868395+0000","last_peered":"2024-04-26T11:16:39.868395+0000","last_clean":"2024-04-26T11:16:39.868395+0000","last_became_active":"2024-04-26T11:16:36.865334+0000","last_became_peered":"2024-04-26T11:16:36.865334+0000","last_unstale":"2024-04-26T11:16:39.868395+0000","last_undegraded":"2024-04-26T11:16:39.868395+0000","last_fullsized":"2024-04-26T11:16:39.868395+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:46.263242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866977+0000","last_change":"2024-04-26T11:14:08.588941+0000","last_active":"2024-04-26T11:16:39.866977+0000","last_peered":"2024-04-26T11:16:39.866977+0000","last_clean":"2024-04-26T11:16:39.866977+0000","last_became_active":"2024-04-26T11:14:08.588699+0000","last_became_peered":"2024-04-26T11:14:08.588699+0000","last_unstale":"2024-04-26T11:16:39.866977+0000","last_undegraded":"2024-04-26T11:16:39.866977+0000","last_fullsized":"2024-04-26T11:16:39.866977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:05.957122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867266+0000","last_change":"2024-04-26T11:16:36.861341+0000","last_active":"2024-04-26T11:16:39.867266+0000","last_peered":"2024-04-26T11:16:39.867266+0000","last_clean":"2024-04-26T11:16:39.867266+0000","last_became_active":"2024-04-26T11:16:36.860498+0000","last_became_peered":"2024-04-26T11:16:36.860498+0000","last_unstale":"2024-04-26T11:16:39.867266+0000","last_undegraded":"2024-04-26T11:16:39.867266+0000","last_fullsized":"2024-04-26T11:16:39.867266+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:12.295055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867322+0000","last_change":"2024-04-26T11:16:36.861607+0000","last_active":"2024-04-26T11:16:39.867322+0000","last_peered":"2024-04-26T11:16:39.867322+0000","last_clean":"2024-04-26T11:16:39.867322+0000","last_became_active":"2024-04-26T11:16:36.860624+0000","last_became_peered":"2024-04-26T11:16:36.860624+0000","last_unstale":"2024-04-26T11:16:39.867322+0000","last_undegraded":"2024-04-26T11:16:39.867322+0000","last_fullsized":"2024-04-26T11:16:39.867322+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:52.246126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":84,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868150+0000","last_change":"2024-04-26T11:16:36.866102+0000","last_active":"2024-04-26T11:16:39.868150+0000","last_peered":"2024-04-26T11:16:39.868150+0000","last_clean":"2024-04-26T11:16:39.868150+0000","last_became_active":"2024-04-26T11:16:36.865517+0000","last_became_peered":"2024-04-26T11:16:36.865517+0000","last_unstale":"2024-04-26T11:16:39.868150+0000","last_undegraded":"2024-04-26T11:16:39.868150+0000","last_fullsized":"2024-04-26T11:16:39.868150+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:16.006886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867498+0000","last_change":"2024-04-26T11:14:08.590078+0000","last_active":"2024-04-26T11:16:39.867498+0000","last_peered":"2024-04-26T11:16:39.867498+0000","last_clean":"2024-04-26T11:16:39.867498+0000","last_became_active":"2024-04-26T11:14:08.589497+0000","last_became_peered":"2024-04-26T11:14:08.589497+0000","last_unstale":"2024-04-26T11:16:39.867498+0000","last_undegraded":"2024-04-26T11:16:39.867498+0000","last_fullsized":"2024-04-26T11:16:39.867498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:21.955581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":30,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868022+0000","last_change":"2024-04-26T11:16:36.863969+0000","last_active":"2024-04-26T11:16:39.868022+0000","last_peered":"2024-04-26T11:16:39.868022+0000","last_clean":"2024-04-26T11:16:39.868022+0000","last_became_active":"2024-04-26T11:16:36.863038+0000","last_became_peered":"2024-04-26T11:16:36.863038+0000","last_unstale":"2024-04-26T11:16:39.868022+0000","last_undegraded":"2024-04-26T11:16:39.868022+0000","last_fullsized":"2024-04-26T11:16:39.868022+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:18.680458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867117+0000","last_change":"2024-04-26T11:16:36.863400+0000","last_active":"2024-04-26T11:16:39.867117+0000","last_peered":"2024-04-26T11:16:39.867117+0000","last_clean":"2024-04-26T11:16:39.867117+0000","last_became_active":"2024-04-26T11:16:36.861887+0000","last_became_peered":"2024-04-26T11:16:36.861887+0000","last_unstale":"2024-04-26T11:16:39.867117+0000","last_undegraded":"2024-04-26T11:16:39.867117+0000","last_fullsized":"2024-04-26T11:16:39.867117+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:58.091135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":25,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866753+0000","last_change":"2024-04-26T11:16:36.863160+0000","last_active":"2024-04-26T11:16:39.866753+0000","last_peered":"2024-04-26T11:16:39.866753+0000","last_clean":"2024-04-26T11:16:39.866753+0000","last_became_active":"2024-04-26T11:16:36.861563+0000","last_became_peered":"2024-04-26T11:16:36.861563+0000","last_unstale":"2024-04-26T11:16:39.866753+0000","last_undegraded":"2024-04-26T11:16:39.866753+0000","last_fullsized":"2024-04-26T11:16:39.866753+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:32.284607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867521+0000","last_change":"2024-04-26T11:13:12.916685+0000","last_active":"2024-04-26T11:16:39.867521+0000","last_peered":"2024-04-26T11:16:39.867521+0000","last_clean":"2024-04-26T11:16:39.867521+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:16:39.867521+0000","last_undegraded":"2024-04-26T11:16:39.867521+0000","last_fullsized":"2024-04-26T11:16:39.867521+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866772+0000","last_change":"2024-04-26T11:16:36.862068+0000","last_active":"2024-04-26T11:16:39.866772+0000","last_peered":"2024-04-26T11:16:39.866772+0000","last_clean":"2024-04-26T11:16:39.866772+0000","last_became_active":"2024-04-26T11:16:36.860845+0000","last_became_peered":"2024-04-26T11:16:36.860845+0000","last_unstale":"2024-04-26T11:16:39.866772+0000","last_undegraded":"2024-04-26T11:16:39.866772+0000","last_fullsized":"2024-04-26T11:16:39.866772+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:54.740487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868110+0000","last_change":"2024-04-26T11:13:12.915238+0000","last_active":"2024-04-26T11:16:39.868110+0000","last_peered":"2024-04-26T11:16:39.868110+0000","last_clean":"2024-04-26T11:16:39.868110+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:16:39.868110+0000","last_undegraded":"2024-04-26T11:16:39.868110+0000","last_fullsized":"2024-04-26T11:16:39.868110+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:48.068465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":81,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867233+0000","last_change":"2024-04-26T11:16:36.859741+0000","last_active":"2024-04-26T11:16:39.867233+0000","last_peered":"2024-04-26T11:16:39.867233+0000","last_clean":"2024-04-26T11:16:39.867233+0000","last_became_active":"2024-04-26T11:16:36.859257+0000","last_became_peered":"2024-04-26T11:16:36.859257+0000","last_unstale":"2024-04-26T11:16:39.867233+0000","last_undegraded":"2024-04-26T11:16:39.867233+0000","last_fullsized":"2024-04-26T11:16:39.867233+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:44.680191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867569+0000","last_change":"2024-04-26T11:16:36.869499+0000","last_active":"2024-04-26T11:16:39.867569+0000","last_peered":"2024-04-26T11:16:39.867569+0000","last_clean":"2024-04-26T11:16:39.867569+0000","last_became_active":"2024-04-26T11:16:36.868256+0000","last_became_peered":"2024-04-26T11:16:36.868256+0000","last_unstale":"2024-04-26T11:16:39.867569+0000","last_undegraded":"2024-04-26T11:16:39.867569+0000","last_fullsized":"2024-04-26T11:16:39.867569+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:02.923235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866874+0000","last_change":"2024-04-26T11:16:36.870080+0000","last_active":"2024-04-26T11:16:39.866874+0000","last_peered":"2024-04-26T11:16:39.866874+0000","last_clean":"2024-04-26T11:16:39.866874+0000","last_became_active":"2024-04-26T11:16:36.867077+0000","last_became_peered":"2024-04-26T11:16:36.867077+0000","last_unstale":"2024-04-26T11:16:39.866874+0000","last_undegraded":"2024-04-26T11:16:39.866874+0000","last_fullsized":"2024-04-26T11:16:39.866874+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:25.497636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868006+0000","last_change":"2024-04-26T11:16:36.862068+0000","last_active":"2024-04-26T11:16:39.868006+0000","last_peered":"2024-04-26T11:16:39.868006+0000","last_clean":"2024-04-26T11:16:39.868006+0000","last_became_active":"2024-04-26T11:16:36.860565+0000","last_became_peered":"2024-04-26T11:16:36.860565+0000","last_unstale":"2024-04-26T11:16:39.868006+0000","last_undegraded":"2024-04-26T11:16:39.868006+0000","last_fullsized":"2024-04-26T11:16:39.868006+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:38:14.430827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":25,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868225+0000","last_change":"2024-04-26T11:16:36.861810+0000","last_active":"2024-04-26T11:16:39.868225+0000","last_peered":"2024-04-26T11:16:39.868225+0000","last_clean":"2024-04-26T11:16:39.868225+0000","last_became_active":"2024-04-26T11:16:36.860299+0000","last_became_peered":"2024-04-26T11:16:36.860299+0000","last_unstale":"2024-04-26T11:16:39.868225+0000","last_undegraded":"2024-04-26T11:16:39.868225+0000","last_fullsized":"2024-04-26T11:16:39.868225+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:13.262452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866753+0000","last_change":"2024-04-26T11:16:36.871465+0000","last_active":"2024-04-26T11:16:39.866753+0000","last_peered":"2024-04-26T11:16:39.866753+0000","last_clean":"2024-04-26T11:16:39.866753+0000","last_became_active":"2024-04-26T11:16:36.871072+0000","last_became_peered":"2024-04-26T11:16:36.871072+0000","last_unstale":"2024-04-26T11:16:39.866753+0000","last_undegraded":"2024-04-26T11:16:39.866753+0000","last_fullsized":"2024-04-26T11:16:39.866753+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:13.048577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":83,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867855+0000","last_change":"2024-04-26T11:16:36.865905+0000","last_active":"2024-04-26T11:16:39.867855+0000","last_peered":"2024-04-26T11:16:39.867855+0000","last_clean":"2024-04-26T11:16:39.867855+0000","last_became_active":"2024-04-26T11:16:36.865374+0000","last_became_peered":"2024-04-26T11:16:36.865374+0000","last_unstale":"2024-04-26T11:16:39.867855+0000","last_undegraded":"2024-04-26T11:16:39.867855+0000","last_fullsized":"2024-04-26T11:16:39.867855+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:08:59.199058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867522+0000","last_change":"2024-04-26T11:13:12.912207+0000","last_active":"2024-04-26T11:16:39.867522+0000","last_peered":"2024-04-26T11:16:39.867522+0000","last_clean":"2024-04-26T11:16:39.867522+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:16:39.867522+0000","last_undegraded":"2024-04-26T11:16:39.867522+0000","last_fullsized":"2024-04-26T11:16:39.867522+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":25,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867185+0000","last_change":"2024-04-26T11:16:36.861887+0000","last_active":"2024-04-26T11:16:39.867185+0000","last_peered":"2024-04-26T11:16:39.867185+0000","last_clean":"2024-04-26T11:16:39.867185+0000","last_became_active":"2024-04-26T11:16:36.861385+0000","last_became_peered":"2024-04-26T11:16:36.861385+0000","last_unstale":"2024-04-26T11:16:39.867185+0000","last_undegraded":"2024-04-26T11:16:39.867185+0000","last_fullsized":"2024-04-26T11:16:39.867185+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:59.045795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866938+0000","last_change":"2024-04-26T11:16:36.866558+0000","last_active":"2024-04-26T11:16:39.866938+0000","last_peered":"2024-04-26T11:16:39.866938+0000","last_clean":"2024-04-26T11:16:39.866938+0000","last_became_active":"2024-04-26T11:16:36.865645+0000","last_became_peered":"2024-04-26T11:16:36.865645+0000","last_unstale":"2024-04-26T11:16:39.866938+0000","last_undegraded":"2024-04-26T11:16:39.866938+0000","last_fullsized":"2024-04-26T11:16:39.866938+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:26.653256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868622+0000","last_change":"2024-04-26T11:16:36.869527+0000","last_active":"2024-04-26T11:16:39.868622+0000","last_peered":"2024-04-26T11:16:39.868622+0000","last_clean":"2024-04-26T11:16:39.868622+0000","last_became_active":"2024-04-26T11:16:36.869081+0000","last_became_peered":"2024-04-26T11:16:36.869081+0000","last_unstale":"2024-04-26T11:16:39.868622+0000","last_undegraded":"2024-04-26T11:16:39.868622+0000","last_fullsized":"2024-04-26T11:16:39.868622+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:25.536503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867403+0000","last_change":"2024-04-26T11:16:36.867197+0000","last_active":"2024-04-26T11:16:39.867403+0000","last_peered":"2024-04-26T11:16:39.867403+0000","last_clean":"2024-04-26T11:16:39.867403+0000","last_became_active":"2024-04-26T11:16:36.866699+0000","last_became_peered":"2024-04-26T11:16:36.866699+0000","last_unstale":"2024-04-26T11:16:39.867403+0000","last_undegraded":"2024-04-26T11:16:39.867403+0000","last_fullsized":"2024-04-26T11:16:39.867403+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:10.074682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":24,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867218+0000","last_change":"2024-04-26T11:16:36.866905+0000","last_active":"2024-04-26T11:16:39.867218+0000","last_peered":"2024-04-26T11:16:39.867218+0000","last_clean":"2024-04-26T11:16:39.867218+0000","last_became_active":"2024-04-26T11:16:36.865531+0000","last_became_peered":"2024-04-26T11:16:36.865531+0000","last_unstale":"2024-04-26T11:16:39.867218+0000","last_undegraded":"2024-04-26T11:16:39.867218+0000","last_fullsized":"2024-04-26T11:16:39.867218+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:16.961092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867486+0000","last_change":"2024-04-26T11:16:36.867822+0000","last_active":"2024-04-26T11:16:39.867486+0000","last_peered":"2024-04-26T11:16:39.867486+0000","last_clean":"2024-04-26T11:16:39.867486+0000","last_became_active":"2024-04-26T11:16:36.865633+0000","last_became_peered":"2024-04-26T11:16:36.865633+0000","last_unstale":"2024-04-26T11:16:39.867486+0000","last_undegraded":"2024-04-26T11:16:39.867486+0000","last_fullsized":"2024-04-26T11:16:39.867486+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:07.461066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866683+0000","last_change":"2024-04-26T11:16:36.861799+0000","last_active":"2024-04-26T11:16:39.866683+0000","last_peered":"2024-04-26T11:16:39.866683+0000","last_clean":"2024-04-26T11:16:39.866683+0000","last_became_active":"2024-04-26T11:16:36.860707+0000","last_became_peered":"2024-04-26T11:16:36.860707+0000","last_unstale":"2024-04-26T11:16:39.866683+0000","last_undegraded":"2024-04-26T11:16:39.866683+0000","last_fullsized":"2024-04-26T11:16:39.866683+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:04.733669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868222+0000","last_change":"2024-04-26T11:16:36.866866+0000","last_active":"2024-04-26T11:16:39.868222+0000","last_peered":"2024-04-26T11:16:39.868222+0000","last_clean":"2024-04-26T11:16:39.868222+0000","last_became_active":"2024-04-26T11:16:36.865663+0000","last_became_peered":"2024-04-26T11:16:36.865663+0000","last_unstale":"2024-04-26T11:16:39.868222+0000","last_undegraded":"2024-04-26T11:16:39.868222+0000","last_fullsized":"2024-04-26T11:16:39.868222+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:40:33.235331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":81,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867244+0000","last_change":"2024-04-26T11:16:36.859551+0000","last_active":"2024-04-26T11:16:39.867244+0000","last_peered":"2024-04-26T11:16:39.867244+0000","last_clean":"2024-04-26T11:16:39.867244+0000","last_became_active":"2024-04-26T11:16:36.859140+0000","last_became_peered":"2024-04-26T11:16:36.859140+0000","last_unstale":"2024-04-26T11:16:39.867244+0000","last_undegraded":"2024-04-26T11:16:39.867244+0000","last_fullsized":"2024-04-26T11:16:39.867244+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:12.288869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867145+0000","last_change":"2024-04-26T11:16:36.861324+0000","last_active":"2024-04-26T11:16:39.867145+0000","last_peered":"2024-04-26T11:16:39.867145+0000","last_clean":"2024-04-26T11:16:39.867145+0000","last_became_active":"2024-04-26T11:16:36.859490+0000","last_became_peered":"2024-04-26T11:16:36.859490+0000","last_unstale":"2024-04-26T11:16:39.867145+0000","last_undegraded":"2024-04-26T11:16:39.867145+0000","last_fullsized":"2024-04-26T11:16:39.867145+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:08.842836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":68,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867074+0000","last_change":"2024-04-26T11:13:12.493217+0000","last_active":"2024-04-26T11:16:39.867074+0000","last_peered":"2024-04-26T11:16:39.867074+0000","last_clean":"2024-04-26T11:16:39.867074+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:16:39.867074+0000","last_undegraded":"2024-04-26T11:16:39.867074+0000","last_fullsized":"2024-04-26T11:16:39.867074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:00.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868134+0000","last_change":"2024-04-26T11:14:08.592365+0000","last_active":"2024-04-26T11:16:39.868134+0000","last_peered":"2024-04-26T11:16:39.868134+0000","last_clean":"2024-04-26T11:16:39.868134+0000","last_became_active":"2024-04-26T11:14:08.591926+0000","last_became_peered":"2024-04-26T11:14:08.591926+0000","last_unstale":"2024-04-26T11:16:39.868134+0000","last_undegraded":"2024-04-26T11:16:39.868134+0000","last_fullsized":"2024-04-26T11:16:39.868134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:52.475134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867490+0000","last_change":"2024-04-26T11:14:08.590727+0000","last_active":"2024-04-26T11:16:39.867490+0000","last_peered":"2024-04-26T11:16:39.867490+0000","last_clean":"2024-04-26T11:16:39.867490+0000","last_became_active":"2024-04-26T11:14:08.590371+0000","last_became_peered":"2024-04-26T11:14:08.590371+0000","last_unstale":"2024-04-26T11:16:39.867490+0000","last_undegraded":"2024-04-26T11:16:39.867490+0000","last_fullsized":"2024-04-26T11:16:39.867490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:32.002629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868050+0000","last_change":"2024-04-26T11:16:36.867874+0000","last_active":"2024-04-26T11:16:39.868050+0000","last_peered":"2024-04-26T11:16:39.868050+0000","last_clean":"2024-04-26T11:16:39.868050+0000","last_became_active":"2024-04-26T11:16:36.866878+0000","last_became_peered":"2024-04-26T11:16:36.866878+0000","last_unstale":"2024-04-26T11:16:39.868050+0000","last_undegraded":"2024-04-26T11:16:39.868050+0000","last_fullsized":"2024-04-26T11:16:39.868050+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:14.516925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867232+0000","last_change":"2024-04-26T11:16:36.866017+0000","last_active":"2024-04-26T11:16:39.867232+0000","last_peered":"2024-04-26T11:16:39.867232+0000","last_clean":"2024-04-26T11:16:39.867232+0000","last_became_active":"2024-04-26T11:16:36.865328+0000","last_became_peered":"2024-04-26T11:16:36.865328+0000","last_unstale":"2024-04-26T11:16:39.867232+0000","last_undegraded":"2024-04-26T11:16:39.867232+0000","last_fullsized":"2024-04-26T11:16:39.867232+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:11.301479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866536+0000","last_change":"2024-04-26T11:16:36.861685+0000","last_active":"2024-04-26T11:16:39.866536+0000","last_peered":"2024-04-26T11:16:39.866536+0000","last_clean":"2024-04-26T11:16:39.866536+0000","last_became_active":"2024-04-26T11:16:36.859534+0000","last_became_peered":"2024-04-26T11:16:36.859534+0000","last_unstale":"2024-04-26T11:16:39.866536+0000","last_undegraded":"2024-04-26T11:16:39.866536+0000","last_fullsized":"2024-04-26T11:16:39.866536+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:53:17.183514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866840+0000","last_change":"2024-04-26T11:16:36.862872+0000","last_active":"2024-04-26T11:16:39.866840+0000","last_peered":"2024-04-26T11:16:39.866840+0000","last_clean":"2024-04-26T11:16:39.866840+0000","last_became_active":"2024-04-26T11:16:36.860322+0000","last_became_peered":"2024-04-26T11:16:36.860322+0000","last_unstale":"2024-04-26T11:16:39.866840+0000","last_undegraded":"2024-04-26T11:16:39.866840+0000","last_fullsized":"2024-04-26T11:16:39.866840+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:37.186329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866979+0000","last_change":"2024-04-26T11:14:08.589823+0000","last_active":"2024-04-26T11:16:39.866979+0000","last_peered":"2024-04-26T11:16:39.866979+0000","last_clean":"2024-04-26T11:16:39.866979+0000","last_became_active":"2024-04-26T11:14:08.588808+0000","last_became_peered":"2024-04-26T11:14:08.588808+0000","last_unstale":"2024-04-26T11:16:39.866979+0000","last_undegraded":"2024-04-26T11:16:39.866979+0000","last_fullsized":"2024-04-26T11:16:39.866979+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:31.499991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867107+0000","last_change":"2024-04-26T11:14:08.590654+0000","last_active":"2024-04-26T11:16:39.867107+0000","last_peered":"2024-04-26T11:16:39.867107+0000","last_clean":"2024-04-26T11:16:39.867107+0000","last_became_active":"2024-04-26T11:14:08.590089+0000","last_became_peered":"2024-04-26T11:14:08.590089+0000","last_unstale":"2024-04-26T11:16:39.867107+0000","last_undegraded":"2024-04-26T11:16:39.867107+0000","last_fullsized":"2024-04-26T11:16:39.867107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:56.592753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":81,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867006+0000","last_change":"2024-04-26T11:16:36.871527+0000","last_active":"2024-04-26T11:16:39.867006+0000","last_peered":"2024-04-26T11:16:39.867006+0000","last_clean":"2024-04-26T11:16:39.867006+0000","last_became_active":"2024-04-26T11:16:36.871175+0000","last_became_peered":"2024-04-26T11:16:36.871175+0000","last_unstale":"2024-04-26T11:16:39.867006+0000","last_undegraded":"2024-04-26T11:16:39.867006+0000","last_fullsized":"2024-04-26T11:16:39.867006+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:39.731275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868396+0000","last_change":"2024-04-26T11:14:08.592455+0000","last_active":"2024-04-26T11:16:39.868396+0000","last_peered":"2024-04-26T11:16:39.868396+0000","last_clean":"2024-04-26T11:16:39.868396+0000","last_became_active":"2024-04-26T11:14:08.592069+0000","last_became_peered":"2024-04-26T11:14:08.592069+0000","last_unstale":"2024-04-26T11:16:39.868396+0000","last_undegraded":"2024-04-26T11:16:39.868396+0000","last_fullsized":"2024-04-26T11:16:39.868396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:51:18.264318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866629+0000","last_change":"2024-04-26T11:16:36.860776+0000","last_active":"2024-04-26T11:16:39.866629+0000","last_peered":"2024-04-26T11:16:39.866629+0000","last_clean":"2024-04-26T11:16:39.866629+0000","last_became_active":"2024-04-26T11:16:36.859301+0000","last_became_peered":"2024-04-26T11:16:36.859301+0000","last_unstale":"2024-04-26T11:16:39.866629+0000","last_undegraded":"2024-04-26T11:16:39.866629+0000","last_fullsized":"2024-04-26T11:16:39.866629+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:27.648935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":219,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866594+0000","last_change":"2024-04-26T11:16:36.864256+0000","last_active":"2024-04-26T11:16:39.866594+0000","last_peered":"2024-04-26T11:16:39.866594+0000","last_clean":"2024-04-26T11:16:39.866594+0000","last_became_active":"2024-04-26T11:16:36.863058+0000","last_became_peered":"2024-04-26T11:16:36.863058+0000","last_unstale":"2024-04-26T11:16:39.866594+0000","last_undegraded":"2024-04-26T11:16:39.866594+0000","last_fullsized":"2024-04-26T11:16:39.866594+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:49.355165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867374+0000","last_change":"2024-04-26T11:14:08.589733+0000","last_active":"2024-04-26T11:16:39.867374+0000","last_peered":"2024-04-26T11:16:39.867374+0000","last_clean":"2024-04-26T11:16:39.867374+0000","last_became_active":"2024-04-26T11:14:08.589187+0000","last_became_peered":"2024-04-26T11:14:08.589187+0000","last_unstale":"2024-04-26T11:16:39.867374+0000","last_undegraded":"2024-04-26T11:16:39.867374+0000","last_fullsized":"2024-04-26T11:16:39.867374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:47.437503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867905+0000","last_change":"2024-04-26T11:16:36.864249+0000","last_active":"2024-04-26T11:16:39.867905+0000","last_peered":"2024-04-26T11:16:39.867905+0000","last_clean":"2024-04-26T11:16:39.867905+0000","last_became_active":"2024-04-26T11:16:36.863279+0000","last_became_peered":"2024-04-26T11:16:36.863279+0000","last_unstale":"2024-04-26T11:16:39.867905+0000","last_undegraded":"2024-04-26T11:16:39.867905+0000","last_fullsized":"2024-04-26T11:16:39.867905+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:19.053419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866815+0000","last_change":"2024-04-26T11:16:36.869342+0000","last_active":"2024-04-26T11:16:39.866815+0000","last_peered":"2024-04-26T11:16:39.866815+0000","last_clean":"2024-04-26T11:16:39.866815+0000","last_became_active":"2024-04-26T11:16:36.866494+0000","last_became_peered":"2024-04-26T11:16:36.866494+0000","last_unstale":"2024-04-26T11:16:39.866815+0000","last_undegraded":"2024-04-26T11:16:39.866815+0000","last_fullsized":"2024-04-26T11:16:39.866815+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:19.386938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866970+0000","last_change":"2024-04-26T11:16:36.863211+0000","last_active":"2024-04-26T11:16:39.866970+0000","last_peered":"2024-04-26T11:16:39.866970+0000","last_clean":"2024-04-26T11:16:39.866970+0000","last_became_active":"2024-04-26T11:16:36.862085+0000","last_became_peered":"2024-04-26T11:16:36.862085+0000","last_unstale":"2024-04-26T11:16:39.866970+0000","last_undegraded":"2024-04-26T11:16:39.866970+0000","last_fullsized":"2024-04-26T11:16:39.866970+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:55.260721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868073+0000","last_change":"2024-04-26T11:13:12.918648+0000","last_active":"2024-04-26T11:16:39.868073+0000","last_peered":"2024-04-26T11:16:39.868073+0000","last_clean":"2024-04-26T11:16:39.868073+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:16:39.868073+0000","last_undegraded":"2024-04-26T11:16:39.868073+0000","last_fullsized":"2024-04-26T11:16:39.868073+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":71,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868260+0000","last_change":"2024-04-26T11:13:08.110433+0000","last_active":"2024-04-26T11:16:39.868260+0000","last_peered":"2024-04-26T11:16:39.868260+0000","last_clean":"2024-04-26T11:16:39.868260+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:16:39.868260+0000","last_undegraded":"2024-04-26T11:16:39.868260+0000","last_fullsized":"2024-04-26T11:16:39.868260+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867596+0000","last_change":"2024-04-26T11:14:08.590798+0000","last_active":"2024-04-26T11:16:39.867596+0000","last_peered":"2024-04-26T11:16:39.867596+0000","last_clean":"2024-04-26T11:16:39.867596+0000","last_became_active":"2024-04-26T11:14:08.590535+0000","last_became_peered":"2024-04-26T11:14:08.590535+0000","last_unstale":"2024-04-26T11:16:39.867596+0000","last_undegraded":"2024-04-26T11:16:39.867596+0000","last_fullsized":"2024-04-26T11:16:39.867596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:04.692288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867073+0000","last_change":"2024-04-26T11:16:36.866253+0000","last_active":"2024-04-26T11:16:39.867073+0000","last_peered":"2024-04-26T11:16:39.867073+0000","last_clean":"2024-04-26T11:16:39.867073+0000","last_became_active":"2024-04-26T11:16:36.865560+0000","last_became_peered":"2024-04-26T11:16:36.865560+0000","last_unstale":"2024-04-26T11:16:39.867073+0000","last_undegraded":"2024-04-26T11:16:39.867073+0000","last_fullsized":"2024-04-26T11:16:39.867073+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:52.517359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":59,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868432+0000","last_change":"2024-04-26T11:14:08.592482+0000","last_active":"2024-04-26T11:16:39.868432+0000","last_peered":"2024-04-26T11:16:39.868432+0000","last_clean":"2024-04-26T11:16:39.868432+0000","last_became_active":"2024-04-26T11:14:08.592093+0000","last_became_peered":"2024-04-26T11:14:08.592093+0000","last_unstale":"2024-04-26T11:16:39.868432+0000","last_undegraded":"2024-04-26T11:16:39.868432+0000","last_fullsized":"2024-04-26T11:16:39.868432+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:38.939541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867975+0000","last_change":"2024-04-26T11:14:08.589530+0000","last_active":"2024-04-26T11:16:39.867975+0000","last_peered":"2024-04-26T11:16:39.867975+0000","last_clean":"2024-04-26T11:16:39.867975+0000","last_became_active":"2024-04-26T11:14:08.589288+0000","last_became_peered":"2024-04-26T11:14:08.589288+0000","last_unstale":"2024-04-26T11:16:39.867975+0000","last_undegraded":"2024-04-26T11:16:39.867975+0000","last_fullsized":"2024-04-26T11:16:39.867975+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:52.096175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.869934+0000","last_change":"2024-04-26T11:16:39.868742+0000","last_active":"2024-04-26T11:16:39.869934+0000","last_peered":"2024-04-26T11:16:39.869934+0000","last_clean":"2024-04-26T11:16:39.869934+0000","last_became_active":"2024-04-26T11:16:39.868240+0000","last_became_peered":"2024-04-26T11:16:39.868240+0000","last_unstale":"2024-04-26T11:16:39.869934+0000","last_undegraded":"2024-04-26T11:16:39.869934+0000","last_fullsized":"2024-04-26T11:16:39.869934+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:02.747912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867868+0000","last_change":"2024-04-26T11:16:36.860868+0000","last_active":"2024-04-26T11:16:39.867868+0000","last_peered":"2024-04-26T11:16:39.867868+0000","last_clean":"2024-04-26T11:16:39.867868+0000","last_became_active":"2024-04-26T11:16:36.858042+0000","last_became_peered":"2024-04-26T11:16:36.858042+0000","last_unstale":"2024-04-26T11:16:39.867868+0000","last_undegraded":"2024-04-26T11:16:39.867868+0000","last_fullsized":"2024-04-26T11:16:39.867868+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:57:35.285183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867381+0000","last_change":"2024-04-26T11:16:36.867856+0000","last_active":"2024-04-26T11:16:39.867381+0000","last_peered":"2024-04-26T11:16:39.867381+0000","last_clean":"2024-04-26T11:16:39.867381+0000","last_became_active":"2024-04-26T11:16:36.865816+0000","last_became_peered":"2024-04-26T11:16:36.865816+0000","last_unstale":"2024-04-26T11:16:39.867381+0000","last_undegraded":"2024-04-26T11:16:39.867381+0000","last_fullsized":"2024-04-26T11:16:39.867381+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:35.210355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867366+0000","last_change":"2024-04-26T11:16:36.859796+0000","last_active":"2024-04-26T11:16:39.867366+0000","last_peered":"2024-04-26T11:16:39.867366+0000","last_clean":"2024-04-26T11:16:39.867366+0000","last_became_active":"2024-04-26T11:16:36.859544+0000","last_became_peered":"2024-04-26T11:16:36.859544+0000","last_unstale":"2024-04-26T11:16:39.867366+0000","last_undegraded":"2024-04-26T11:16:39.867366+0000","last_fullsized":"2024-04-26T11:16:39.867366+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:54.365229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":85,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.872196+0000","last_change":"2024-04-26T11:16:39.870923+0000","last_active":"2024-04-26T11:16:39.872196+0000","last_peered":"2024-04-26T11:16:39.872196+0000","last_clean":"2024-04-26T11:16:39.872196+0000","last_became_active":"2024-04-26T11:16:39.870633+0000","last_became_peered":"2024-04-26T11:16:39.870633+0000","last_unstale":"2024-04-26T11:16:39.872196+0000","last_undegraded":"2024-04-26T11:16:39.872196+0000","last_fullsized":"2024-04-26T11:16:39.872196+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:52.853443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867633+0000","last_change":"2024-04-26T11:13:12.917812+0000","last_active":"2024-04-26T11:16:39.867633+0000","last_peered":"2024-04-26T11:16:39.867633+0000","last_clean":"2024-04-26T11:16:39.867633+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:16:39.867633+0000","last_undegraded":"2024-04-26T11:16:39.867633+0000","last_fullsized":"2024-04-26T11:16:39.867633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.875417+0000","last_change":"2024-04-26T11:16:39.872736+0000","last_active":"2024-04-26T11:16:39.875417+0000","last_peered":"2024-04-26T11:16:39.875417+0000","last_clean":"2024-04-26T11:16:39.875417+0000","last_became_active":"2024-04-26T11:16:39.869693+0000","last_became_peered":"2024-04-26T11:16:39.869693+0000","last_unstale":"2024-04-26T11:16:39.875417+0000","last_undegraded":"2024-04-26T11:16:39.875417+0000","last_fullsized":"2024-04-26T11:16:39.875417+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:14.138907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867000+0000","last_change":"2024-04-26T11:16:36.865623+0000","last_active":"2024-04-26T11:16:39.867000+0000","last_peered":"2024-04-26T11:16:39.867000+0000","last_clean":"2024-04-26T11:16:39.867000+0000","last_became_active":"2024-04-26T11:16:36.864187+0000","last_became_peered":"2024-04-26T11:16:36.864187+0000","last_unstale":"2024-04-26T11:16:39.867000+0000","last_undegraded":"2024-04-26T11:16:39.867000+0000","last_fullsized":"2024-04-26T11:16:39.867000+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:25.032691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":83,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867982+0000","last_change":"2024-04-26T11:16:36.867034+0000","last_active":"2024-04-26T11:16:39.867982+0000","last_peered":"2024-04-26T11:16:39.867982+0000","last_clean":"2024-04-26T11:16:39.867982+0000","last_became_active":"2024-04-26T11:16:36.866529+0000","last_became_peered":"2024-04-26T11:16:36.866529+0000","last_unstale":"2024-04-26T11:16:39.867982+0000","last_undegraded":"2024-04-26T11:16:39.867982+0000","last_fullsized":"2024-04-26T11:16:39.867982+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:36.200369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867069+0000","last_change":"2024-04-26T11:16:36.865772+0000","last_active":"2024-04-26T11:16:39.867069+0000","last_peered":"2024-04-26T11:16:39.867069+0000","last_clean":"2024-04-26T11:16:39.867069+0000","last_became_active":"2024-04-26T11:16:36.865213+0000","last_became_peered":"2024-04-26T11:16:36.865213+0000","last_unstale":"2024-04-26T11:16:39.867069+0000","last_undegraded":"2024-04-26T11:16:39.867069+0000","last_fullsized":"2024-04-26T11:16:39.867069+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:03.220593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867741+0000","last_change":"2024-04-26T11:14:08.589726+0000","last_active":"2024-04-26T11:16:39.867741+0000","last_peered":"2024-04-26T11:16:39.867741+0000","last_clean":"2024-04-26T11:16:39.867741+0000","last_became_active":"2024-04-26T11:14:08.588687+0000","last_became_peered":"2024-04-26T11:14:08.588687+0000","last_unstale":"2024-04-26T11:16:39.867741+0000","last_undegraded":"2024-04-26T11:16:39.867741+0000","last_fullsized":"2024-04-26T11:16:39.867741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:05.617266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867685+0000","last_change":"2024-04-26T11:13:12.917763+0000","last_active":"2024-04-26T11:16:39.867685+0000","last_peered":"2024-04-26T11:16:39.867685+0000","last_clean":"2024-04-26T11:16:39.867685+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:16:39.867685+0000","last_undegraded":"2024-04-26T11:16:39.867685+0000","last_fullsized":"2024-04-26T11:16:39.867685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.879785+0000","last_change":"2024-04-26T11:16:39.879362+0000","last_active":"2024-04-26T11:16:39.879785+0000","last_peered":"2024-04-26T11:16:39.879785+0000","last_clean":"2024-04-26T11:16:39.879785+0000","last_became_active":"2024-04-26T11:16:39.870185+0000","last_became_peered":"2024-04-26T11:16:39.870185+0000","last_unstale":"2024-04-26T11:16:39.879785+0000","last_undegraded":"2024-04-26T11:16:39.879785+0000","last_fullsized":"2024-04-26T11:16:39.879785+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:56.385417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867083+0000","last_change":"2024-04-26T11:16:36.870651+0000","last_active":"2024-04-26T11:16:39.867083+0000","last_peered":"2024-04-26T11:16:39.867083+0000","last_clean":"2024-04-26T11:16:39.867083+0000","last_became_active":"2024-04-26T11:16:36.869018+0000","last_became_peered":"2024-04-26T11:16:36.869018+0000","last_unstale":"2024-04-26T11:16:39.867083+0000","last_undegraded":"2024-04-26T11:16:39.867083+0000","last_fullsized":"2024-04-26T11:16:39.867083+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:59.337390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866983+0000","last_change":"2024-04-26T11:16:36.870356+0000","last_active":"2024-04-26T11:16:39.866983+0000","last_peered":"2024-04-26T11:16:39.866983+0000","last_clean":"2024-04-26T11:16:39.866983+0000","last_became_active":"2024-04-26T11:16:36.868029+0000","last_became_peered":"2024-04-26T11:16:36.868029+0000","last_unstale":"2024-04-26T11:16:39.866983+0000","last_undegraded":"2024-04-26T11:16:39.866983+0000","last_fullsized":"2024-04-26T11:16:39.866983+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:13:24.219419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867005+0000","last_change":"2024-04-26T11:14:08.590838+0000","last_active":"2024-04-26T11:16:39.867005+0000","last_peered":"2024-04-26T11:16:39.867005+0000","last_clean":"2024-04-26T11:16:39.867005+0000","last_became_active":"2024-04-26T11:14:08.590386+0000","last_became_peered":"2024-04-26T11:14:08.590386+0000","last_unstale":"2024-04-26T11:16:39.867005+0000","last_undegraded":"2024-04-26T11:16:39.867005+0000","last_fullsized":"2024-04-26T11:16:39.867005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:50.791318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867454+0000","last_change":"2024-04-26T11:16:36.866359+0000","last_active":"2024-04-26T11:16:39.867454+0000","last_peered":"2024-04-26T11:16:39.867454+0000","last_clean":"2024-04-26T11:16:39.867454+0000","last_became_active":"2024-04-26T11:16:36.865724+0000","last_became_peered":"2024-04-26T11:16:36.865724+0000","last_unstale":"2024-04-26T11:16:39.867454+0000","last_undegraded":"2024-04-26T11:16:39.867454+0000","last_fullsized":"2024-04-26T11:16:39.867454+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:27.869054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867323+0000","last_change":"2024-04-26T11:14:08.589117+0000","last_active":"2024-04-26T11:16:39.867323+0000","last_peered":"2024-04-26T11:16:39.867323+0000","last_clean":"2024-04-26T11:16:39.867323+0000","last_became_active":"2024-04-26T11:14:08.588762+0000","last_became_peered":"2024-04-26T11:14:08.588762+0000","last_unstale":"2024-04-26T11:16:39.867323+0000","last_undegraded":"2024-04-26T11:16:39.867323+0000","last_fullsized":"2024-04-26T11:16:39.867323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:05.658069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867704+0000","last_change":"2024-04-26T11:16:36.866641+0000","last_active":"2024-04-26T11:16:39.867704+0000","last_peered":"2024-04-26T11:16:39.867704+0000","last_clean":"2024-04-26T11:16:39.867704+0000","last_became_active":"2024-04-26T11:16:36.866112+0000","last_became_peered":"2024-04-26T11:16:36.866112+0000","last_unstale":"2024-04-26T11:16:39.867704+0000","last_undegraded":"2024-04-26T11:16:39.867704+0000","last_fullsized":"2024-04-26T11:16:39.867704+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:31.034151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5470,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738413,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281052,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94090788,"statfs":{"total":96636764160,"available":96348966912,"internally_reserved":0,"allocated":1392640,"data_stored":892376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Fri Apr 26 11:16:17 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40200000000000002,"15min":0.378},"min":{"1min":0.20000000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.96499999999999997,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.44400000000000001,"15min":0.44600000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.57599999999999996,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.40699999999999997}]}]},{"osd":0,"up_from":67,"seq":287762808835,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40368,"kb_used_data":1380,"kb_used_omap":6,"kb_used_meta":38969,"kb_avail":94331472,"statfs":{"total":96636764160,"available":96595427328,"internally_reserved":0,"allocated":1413120,"data_stored":898335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7064,"internal_metadata":39904360},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":1,"up_from":8,"seq":34359738414,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401048,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":400254,"kb_avail":93970792,"statfs":{"total":96636764160,"available":96226091008,"internally_reserved":0,"allocated":794624,"data_stored":306221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":409860550},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":2,"last update":"Fri Apr 26 11:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.40300000000000002,"15min":0.39300000000000002},"min":{"1min":0.14999999999999999,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.61299999999999999,"5min":2.056,"15min":2.056},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.47899999999999998,"15min":0.45700000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":3.9609999999999999,"5min":3.9609999999999999,"15min":3.9609999999999999},"last":0.435}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5470,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:16:49.700 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:16:50.061 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:16:50.063 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:16:50.072 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2024-04-26T11:16:48.509666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":722480,"kb_used_data":3524,"kb_used_omap":10,"kb_used_meta":718901,"kb_avail":282393040,"statfs":{"total":289910292480,"available":289170472960,"internally_reserved":0,"allocated":3608576,"data_stored":2101164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10252,"internal_metadata":736155636},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":-3,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.644724"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868334+0000","last_change":"2024-04-26T11:13:12.919196+0000","last_active":"2024-04-26T11:16:39.868334+0000","last_peered":"2024-04-26T11:16:39.868334+0000","last_clean":"2024-04-26T11:16:39.868334+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:16:39.868334+0000","last_undegraded":"2024-04-26T11:16:39.868334+0000","last_fullsized":"2024-04-26T11:16:39.868334+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867861+0000","last_change":"2024-04-26T11:13:12.917670+0000","last_active":"2024-04-26T11:16:39.867861+0000","last_peered":"2024-04-26T11:16:39.867861+0000","last_clean":"2024-04-26T11:16:39.867861+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:16:39.867861+0000","last_undegraded":"2024-04-26T11:16:39.867861+0000","last_fullsized":"2024-04-26T11:16:39.867861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868069+0000","last_change":"2024-04-26T11:16:36.866575+0000","last_active":"2024-04-26T11:16:39.868069+0000","last_peered":"2024-04-26T11:16:39.868069+0000","last_clean":"2024-04-26T11:16:39.868069+0000","last_became_active":"2024-04-26T11:16:36.864565+0000","last_became_peered":"2024-04-26T11:16:36.864565+0000","last_unstale":"2024-04-26T11:16:39.868069+0000","last_undegraded":"2024-04-26T11:16:39.868069+0000","last_fullsized":"2024-04-26T11:16:39.868069+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:38.756428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868188+0000","last_change":"2024-04-26T11:16:36.868086+0000","last_active":"2024-04-26T11:16:39.868188+0000","last_peered":"2024-04-26T11:16:39.868188+0000","last_clean":"2024-04-26T11:16:39.868188+0000","last_became_active":"2024-04-26T11:16:36.865679+0000","last_became_peered":"2024-04-26T11:16:36.865679+0000","last_unstale":"2024-04-26T11:16:39.868188+0000","last_undegraded":"2024-04-26T11:16:39.868188+0000","last_fullsized":"2024-04-26T11:16:39.868188+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:00:22.051599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866980+0000","last_change":"2024-04-26T11:13:12.917403+0000","last_active":"2024-04-26T11:16:39.866980+0000","last_peered":"2024-04-26T11:16:39.866980+0000","last_clean":"2024-04-26T11:16:39.866980+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:16:39.866980+0000","last_undegraded":"2024-04-26T11:16:39.866980+0000","last_fullsized":"2024-04-26T11:16:39.866980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:42.014955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867786+0000","last_change":"2024-04-26T11:16:36.868338+0000","last_active":"2024-04-26T11:16:39.867786+0000","last_peered":"2024-04-26T11:16:39.867786+0000","last_clean":"2024-04-26T11:16:39.867786+0000","last_became_active":"2024-04-26T11:16:36.867049+0000","last_became_peered":"2024-04-26T11:16:36.867049+0000","last_unstale":"2024-04-26T11:16:39.867786+0000","last_undegraded":"2024-04-26T11:16:39.867786+0000","last_fullsized":"2024-04-26T11:16:39.867786+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:57.262622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867261+0000","last_change":"2024-04-26T11:16:36.860337+0000","last_active":"2024-04-26T11:16:39.867261+0000","last_peered":"2024-04-26T11:16:39.867261+0000","last_clean":"2024-04-26T11:16:39.867261+0000","last_became_active":"2024-04-26T11:16:36.859342+0000","last_became_peered":"2024-04-26T11:16:36.859342+0000","last_unstale":"2024-04-26T11:16:39.867261+0000","last_undegraded":"2024-04-26T11:16:39.867261+0000","last_fullsized":"2024-04-26T11:16:39.867261+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:23.653811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866407+0000","last_change":"2024-04-26T11:16:36.863996+0000","last_active":"2024-04-26T11:16:39.866407+0000","last_peered":"2024-04-26T11:16:39.866407+0000","last_clean":"2024-04-26T11:16:39.866407+0000","last_became_active":"2024-04-26T11:16:36.863048+0000","last_became_peered":"2024-04-26T11:16:36.863048+0000","last_unstale":"2024-04-26T11:16:39.866407+0000","last_undegraded":"2024-04-26T11:16:39.866407+0000","last_fullsized":"2024-04-26T11:16:39.866407+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:29:42.503116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867972+0000","last_change":"2024-04-26T11:14:08.592223+0000","last_active":"2024-04-26T11:16:39.867972+0000","last_peered":"2024-04-26T11:16:39.867972+0000","last_clean":"2024-04-26T11:16:39.867972+0000","last_became_active":"2024-04-26T11:14:08.591660+0000","last_became_peered":"2024-04-26T11:14:08.591660+0000","last_unstale":"2024-04-26T11:16:39.867972+0000","last_undegraded":"2024-04-26T11:16:39.867972+0000","last_fullsized":"2024-04-26T11:16:39.867972+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:06.208634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867975+0000","last_change":"2024-04-26T11:13:12.918521+0000","last_active":"2024-04-26T11:16:39.867975+0000","last_peered":"2024-04-26T11:16:39.867975+0000","last_clean":"2024-04-26T11:16:39.867975+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:16:39.867975+0000","last_undegraded":"2024-04-26T11:16:39.867975+0000","last_fullsized":"2024-04-26T11:16:39.867975+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.871059+0000","last_change":"2024-04-26T11:16:39.869878+0000","last_active":"2024-04-26T11:16:39.871059+0000","last_peered":"2024-04-26T11:16:39.871059+0000","last_clean":"2024-04-26T11:16:39.871059+0000","last_became_active":"2024-04-26T11:16:39.869512+0000","last_became_peered":"2024-04-26T11:16:39.869512+0000","last_unstale":"2024-04-26T11:16:39.871059+0000","last_undegraded":"2024-04-26T11:16:39.871059+0000","last_fullsized":"2024-04-26T11:16:39.871059+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:54.379763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867243+0000","last_change":"2024-04-26T11:16:36.865797+0000","last_active":"2024-04-26T11:16:39.867243+0000","last_peered":"2024-04-26T11:16:39.867243+0000","last_clean":"2024-04-26T11:16:39.867243+0000","last_became_active":"2024-04-26T11:16:36.865360+0000","last_became_peered":"2024-04-26T11:16:36.865360+0000","last_unstale":"2024-04-26T11:16:39.867243+0000","last_undegraded":"2024-04-26T11:16:39.867243+0000","last_fullsized":"2024-04-26T11:16:39.867243+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:14.393010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867206+0000","last_change":"2024-04-26T11:13:12.915484+0000","last_active":"2024-04-26T11:16:39.867206+0000","last_peered":"2024-04-26T11:16:39.867206+0000","last_clean":"2024-04-26T11:16:39.867206+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:16:39.867206+0000","last_undegraded":"2024-04-26T11:16:39.867206+0000","last_fullsized":"2024-04-26T11:16:39.867206+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867420+0000","last_change":"2024-04-26T11:16:36.865308+0000","last_active":"2024-04-26T11:16:39.867420+0000","last_peered":"2024-04-26T11:16:39.867420+0000","last_clean":"2024-04-26T11:16:39.867420+0000","last_became_active":"2024-04-26T11:16:36.864119+0000","last_became_peered":"2024-04-26T11:16:36.864119+0000","last_unstale":"2024-04-26T11:16:39.867420+0000","last_undegraded":"2024-04-26T11:16:39.867420+0000","last_fullsized":"2024-04-26T11:16:39.867420+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:29.265536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.871380+0000","last_change":"2024-04-26T11:16:39.870234+0000","last_active":"2024-04-26T11:16:39.871380+0000","last_peered":"2024-04-26T11:16:39.871380+0000","last_clean":"2024-04-26T11:16:39.871380+0000","last_became_active":"2024-04-26T11:16:39.869644+0000","last_became_peered":"2024-04-26T11:16:39.869644+0000","last_unstale":"2024-04-26T11:16:39.871380+0000","last_undegraded":"2024-04-26T11:16:39.871380+0000","last_fullsized":"2024-04-26T11:16:39.871380+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:45.107551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866744+0000","last_change":"2024-04-26T11:16:36.868941+0000","last_active":"2024-04-26T11:16:39.866744+0000","last_peered":"2024-04-26T11:16:39.866744+0000","last_clean":"2024-04-26T11:16:39.866744+0000","last_became_active":"2024-04-26T11:16:36.864605+0000","last_became_peered":"2024-04-26T11:16:36.864605+0000","last_unstale":"2024-04-26T11:16:39.866744+0000","last_undegraded":"2024-04-26T11:16:39.866744+0000","last_fullsized":"2024-04-26T11:16:39.866744+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:26.687980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867966+0000","last_change":"2024-04-26T11:14:08.592349+0000","last_active":"2024-04-26T11:16:39.867966+0000","last_peered":"2024-04-26T11:16:39.867966+0000","last_clean":"2024-04-26T11:16:39.867966+0000","last_became_active":"2024-04-26T11:14:08.591886+0000","last_became_peered":"2024-04-26T11:14:08.591886+0000","last_unstale":"2024-04-26T11:16:39.867966+0000","last_undegraded":"2024-04-26T11:16:39.867966+0000","last_fullsized":"2024-04-26T11:16:39.867966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:29.835852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868076+0000","last_change":"2024-04-26T11:13:12.918759+0000","last_active":"2024-04-26T11:16:39.868076+0000","last_peered":"2024-04-26T11:16:39.868076+0000","last_clean":"2024-04-26T11:16:39.868076+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:16:39.868076+0000","last_undegraded":"2024-04-26T11:16:39.868076+0000","last_fullsized":"2024-04-26T11:16:39.868076+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:55.002972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868331+0000","last_change":"2024-04-26T11:14:08.591804+0000","last_active":"2024-04-26T11:16:39.868331+0000","last_peered":"2024-04-26T11:16:39.868331+0000","last_clean":"2024-04-26T11:16:39.868331+0000","last_became_active":"2024-04-26T11:14:08.591519+0000","last_became_peered":"2024-04-26T11:14:08.591519+0000","last_unstale":"2024-04-26T11:16:39.868331+0000","last_undegraded":"2024-04-26T11:16:39.868331+0000","last_fullsized":"2024-04-26T11:16:39.868331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:00:27.447921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868357+0000","last_change":"2024-04-26T11:16:36.868357+0000","last_active":"2024-04-26T11:16:39.868357+0000","last_peered":"2024-04-26T11:16:39.868357+0000","last_clean":"2024-04-26T11:16:39.868357+0000","last_became_active":"2024-04-26T11:16:36.866698+0000","last_became_peered":"2024-04-26T11:16:36.866698+0000","last_unstale":"2024-04-26T11:16:39.868357+0000","last_undegraded":"2024-04-26T11:16:39.868357+0000","last_fullsized":"2024-04-26T11:16:39.868357+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:56.560147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866874+0000","last_change":"2024-04-26T11:16:36.864212+0000","last_active":"2024-04-26T11:16:39.866874+0000","last_peered":"2024-04-26T11:16:39.866874+0000","last_clean":"2024-04-26T11:16:39.866874+0000","last_became_active":"2024-04-26T11:16:36.862787+0000","last_became_peered":"2024-04-26T11:16:36.862787+0000","last_unstale":"2024-04-26T11:16:39.866874+0000","last_undegraded":"2024-04-26T11:16:39.866874+0000","last_fullsized":"2024-04-26T11:16:39.866874+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:50.035179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867171+0000","last_change":"2024-04-26T11:16:36.865777+0000","last_active":"2024-04-26T11:16:39.867171+0000","last_peered":"2024-04-26T11:16:39.867171+0000","last_clean":"2024-04-26T11:16:39.867171+0000","last_became_active":"2024-04-26T11:16:36.865251+0000","last_became_peered":"2024-04-26T11:16:36.865251+0000","last_unstale":"2024-04-26T11:16:39.867171+0000","last_undegraded":"2024-04-26T11:16:39.867171+0000","last_fullsized":"2024-04-26T11:16:39.867171+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:51:58.402967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867448+0000","last_change":"2024-04-26T11:16:36.865177+0000","last_active":"2024-04-26T11:16:39.867448+0000","last_peered":"2024-04-26T11:16:39.867448+0000","last_clean":"2024-04-26T11:16:39.867448+0000","last_became_active":"2024-04-26T11:16:36.864276+0000","last_became_peered":"2024-04-26T11:16:36.864276+0000","last_unstale":"2024-04-26T11:16:39.867448+0000","last_undegraded":"2024-04-26T11:16:39.867448+0000","last_fullsized":"2024-04-26T11:16:39.867448+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:21.982286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867123+0000","last_change":"2024-04-26T11:13:12.912756+0000","last_active":"2024-04-26T11:16:39.867123+0000","last_peered":"2024-04-26T11:16:39.867123+0000","last_clean":"2024-04-26T11:16:39.867123+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:16:39.867123+0000","last_undegraded":"2024-04-26T11:16:39.867123+0000","last_fullsized":"2024-04-26T11:16:39.867123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:04.177831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868332+0000","last_change":"2024-04-26T11:16:36.866893+0000","last_active":"2024-04-26T11:16:39.868332+0000","last_peered":"2024-04-26T11:16:39.868332+0000","last_clean":"2024-04-26T11:16:39.868332+0000","last_became_active":"2024-04-26T11:16:36.866247+0000","last_became_peered":"2024-04-26T11:16:36.866247+0000","last_unstale":"2024-04-26T11:16:39.868332+0000","last_undegraded":"2024-04-26T11:16:39.868332+0000","last_fullsized":"2024-04-26T11:16:39.868332+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:29:00.392204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867806+0000","last_change":"2024-04-26T11:16:36.868960+0000","last_active":"2024-04-26T11:16:39.867806+0000","last_peered":"2024-04-26T11:16:39.867806+0000","last_clean":"2024-04-26T11:16:39.867806+0000","last_became_active":"2024-04-26T11:16:36.868050+0000","last_became_peered":"2024-04-26T11:16:36.868050+0000","last_unstale":"2024-04-26T11:16:39.867806+0000","last_undegraded":"2024-04-26T11:16:39.867806+0000","last_fullsized":"2024-04-26T11:16:39.867806+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:36:28.198210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868184+0000","last_change":"2024-04-26T11:16:36.867664+0000","last_active":"2024-04-26T11:16:39.868184+0000","last_peered":"2024-04-26T11:16:39.868184+0000","last_clean":"2024-04-26T11:16:39.868184+0000","last_became_active":"2024-04-26T11:16:36.865582+0000","last_became_peered":"2024-04-26T11:16:36.865582+0000","last_unstale":"2024-04-26T11:16:39.868184+0000","last_undegraded":"2024-04-26T11:16:39.868184+0000","last_fullsized":"2024-04-26T11:16:39.868184+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:24.063678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":69,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867110+0000","last_change":"2024-04-26T11:13:12.493425+0000","last_active":"2024-04-26T11:16:39.867110+0000","last_peered":"2024-04-26T11:16:39.867110+0000","last_clean":"2024-04-26T11:16:39.867110+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:16:39.867110+0000","last_undegraded":"2024-04-26T11:16:39.867110+0000","last_fullsized":"2024-04-26T11:16:39.867110+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:23.279580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868220+0000","last_change":"2024-04-26T11:16:36.867629+0000","last_active":"2024-04-26T11:16:39.868220+0000","last_peered":"2024-04-26T11:16:39.868220+0000","last_clean":"2024-04-26T11:16:39.868220+0000","last_became_active":"2024-04-26T11:16:36.867445+0000","last_became_peered":"2024-04-26T11:16:36.867445+0000","last_unstale":"2024-04-26T11:16:39.868220+0000","last_undegraded":"2024-04-26T11:16:39.868220+0000","last_fullsized":"2024-04-26T11:16:39.868220+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:12.072442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.870371+0000","last_change":"2024-04-26T11:16:39.868907+0000","last_active":"2024-04-26T11:16:39.870371+0000","last_peered":"2024-04-26T11:16:39.870371+0000","last_clean":"2024-04-26T11:16:39.870371+0000","last_became_active":"2024-04-26T11:16:39.868569+0000","last_became_peered":"2024-04-26T11:16:39.868569+0000","last_unstale":"2024-04-26T11:16:39.870371+0000","last_undegraded":"2024-04-26T11:16:39.870371+0000","last_fullsized":"2024-04-26T11:16:39.870371+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:48.191394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867319+0000","last_change":"2024-04-26T11:16:36.866812+0000","last_active":"2024-04-26T11:16:39.867319+0000","last_peered":"2024-04-26T11:16:39.867319+0000","last_clean":"2024-04-26T11:16:39.867319+0000","last_became_active":"2024-04-26T11:16:36.865841+0000","last_became_peered":"2024-04-26T11:16:36.865841+0000","last_unstale":"2024-04-26T11:16:39.867319+0000","last_undegraded":"2024-04-26T11:16:39.867319+0000","last_fullsized":"2024-04-26T11:16:39.867319+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:23:20.948589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867194+0000","last_change":"2024-04-26T11:14:08.589659+0000","last_active":"2024-04-26T11:16:39.867194+0000","last_peered":"2024-04-26T11:16:39.867194+0000","last_clean":"2024-04-26T11:16:39.867194+0000","last_became_active":"2024-04-26T11:14:08.589404+0000","last_became_peered":"2024-04-26T11:14:08.589404+0000","last_unstale":"2024-04-26T11:16:39.867194+0000","last_undegraded":"2024-04-26T11:16:39.867194+0000","last_fullsized":"2024-04-26T11:16:39.867194+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:20:29.354141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868240+0000","last_change":"2024-04-26T11:16:36.867191+0000","last_active":"2024-04-26T11:16:39.868240+0000","last_peered":"2024-04-26T11:16:39.868240+0000","last_clean":"2024-04-26T11:16:39.868240+0000","last_became_active":"2024-04-26T11:16:36.866876+0000","last_became_peered":"2024-04-26T11:16:36.866876+0000","last_unstale":"2024-04-26T11:16:39.868240+0000","last_undegraded":"2024-04-26T11:16:39.868240+0000","last_fullsized":"2024-04-26T11:16:39.868240+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:39.750259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868395+0000","last_change":"2024-04-26T11:16:36.870740+0000","last_active":"2024-04-26T11:16:39.868395+0000","last_peered":"2024-04-26T11:16:39.868395+0000","last_clean":"2024-04-26T11:16:39.868395+0000","last_became_active":"2024-04-26T11:16:36.865334+0000","last_became_peered":"2024-04-26T11:16:36.865334+0000","last_unstale":"2024-04-26T11:16:39.868395+0000","last_undegraded":"2024-04-26T11:16:39.868395+0000","last_fullsized":"2024-04-26T11:16:39.868395+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:46.263242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866977+0000","last_change":"2024-04-26T11:14:08.588941+0000","last_active":"2024-04-26T11:16:39.866977+0000","last_peered":"2024-04-26T11:16:39.866977+0000","last_clean":"2024-04-26T11:16:39.866977+0000","last_became_active":"2024-04-26T11:14:08.588699+0000","last_became_peered":"2024-04-26T11:14:08.588699+0000","last_unstale":"2024-04-26T11:16:39.866977+0000","last_undegraded":"2024-04-26T11:16:39.866977+0000","last_fullsized":"2024-04-26T11:16:39.866977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:05.957122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867266+0000","last_change":"2024-04-26T11:16:36.861341+0000","last_active":"2024-04-26T11:16:39.867266+0000","last_peered":"2024-04-26T11:16:39.867266+0000","last_clean":"2024-04-26T11:16:39.867266+0000","last_became_active":"2024-04-26T11:16:36.860498+0000","last_became_peered":"2024-04-26T11:16:36.860498+0000","last_unstale":"2024-04-26T11:16:39.867266+0000","last_undegraded":"2024-04-26T11:16:39.867266+0000","last_fullsized":"2024-04-26T11:16:39.867266+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:12.295055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867322+0000","last_change":"2024-04-26T11:16:36.861607+0000","last_active":"2024-04-26T11:16:39.867322+0000","last_peered":"2024-04-26T11:16:39.867322+0000","last_clean":"2024-04-26T11:16:39.867322+0000","last_became_active":"2024-04-26T11:16:36.860624+0000","last_became_peered":"2024-04-26T11:16:36.860624+0000","last_unstale":"2024-04-26T11:16:39.867322+0000","last_undegraded":"2024-04-26T11:16:39.867322+0000","last_fullsized":"2024-04-26T11:16:39.867322+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:52.246126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":84,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868150+0000","last_change":"2024-04-26T11:16:36.866102+0000","last_active":"2024-04-26T11:16:39.868150+0000","last_peered":"2024-04-26T11:16:39.868150+0000","last_clean":"2024-04-26T11:16:39.868150+0000","last_became_active":"2024-04-26T11:16:36.865517+0000","last_became_peered":"2024-04-26T11:16:36.865517+0000","last_unstale":"2024-04-26T11:16:39.868150+0000","last_undegraded":"2024-04-26T11:16:39.868150+0000","last_fullsized":"2024-04-26T11:16:39.868150+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:16.006886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867498+0000","last_change":"2024-04-26T11:14:08.590078+0000","last_active":"2024-04-26T11:16:39.867498+0000","last_peered":"2024-04-26T11:16:39.867498+0000","last_clean":"2024-04-26T11:16:39.867498+0000","last_became_active":"2024-04-26T11:14:08.589497+0000","last_became_peered":"2024-04-26T11:14:08.589497+0000","last_unstale":"2024-04-26T11:16:39.867498+0000","last_undegraded":"2024-04-26T11:16:39.867498+0000","last_fullsized":"2024-04-26T11:16:39.867498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:21.955581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":30,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868022+0000","last_change":"2024-04-26T11:16:36.863969+0000","last_active":"2024-04-26T11:16:39.868022+0000","last_peered":"2024-04-26T11:16:39.868022+0000","last_clean":"2024-04-26T11:16:39.868022+0000","last_became_active":"2024-04-26T11:16:36.863038+0000","last_became_peered":"2024-04-26T11:16:36.863038+0000","last_unstale":"2024-04-26T11:16:39.868022+0000","last_undegraded":"2024-04-26T11:16:39.868022+0000","last_fullsized":"2024-04-26T11:16:39.868022+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:18.680458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867117+0000","last_change":"2024-04-26T11:16:36.863400+0000","last_active":"2024-04-26T11:16:39.867117+0000","last_peered":"2024-04-26T11:16:39.867117+0000","last_clean":"2024-04-26T11:16:39.867117+0000","last_became_active":"2024-04-26T11:16:36.861887+0000","last_became_peered":"2024-04-26T11:16:36.861887+0000","last_unstale":"2024-04-26T11:16:39.867117+0000","last_undegraded":"2024-04-26T11:16:39.867117+0000","last_fullsized":"2024-04-26T11:16:39.867117+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:58.091135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":25,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866753+0000","last_change":"2024-04-26T11:16:36.863160+0000","last_active":"2024-04-26T11:16:39.866753+0000","last_peered":"2024-04-26T11:16:39.866753+0000","last_clean":"2024-04-26T11:16:39.866753+0000","last_became_active":"2024-04-26T11:16:36.861563+0000","last_became_peered":"2024-04-26T11:16:36.861563+0000","last_unstale":"2024-04-26T11:16:39.866753+0000","last_undegraded":"2024-04-26T11:16:39.866753+0000","last_fullsized":"2024-04-26T11:16:39.866753+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:32.284607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867521+0000","last_change":"2024-04-26T11:13:12.916685+0000","last_active":"2024-04-26T11:16:39.867521+0000","last_peered":"2024-04-26T11:16:39.867521+0000","last_clean":"2024-04-26T11:16:39.867521+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:16:39.867521+0000","last_undegraded":"2024-04-26T11:16:39.867521+0000","last_fullsized":"2024-04-26T11:16:39.867521+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866772+0000","last_change":"2024-04-26T11:16:36.862068+0000","last_active":"2024-04-26T11:16:39.866772+0000","last_peered":"2024-04-26T11:16:39.866772+0000","last_clean":"2024-04-26T11:16:39.866772+0000","last_became_active":"2024-04-26T11:16:36.860845+0000","last_became_peered":"2024-04-26T11:16:36.860845+0000","last_unstale":"2024-04-26T11:16:39.866772+0000","last_undegraded":"2024-04-26T11:16:39.866772+0000","last_fullsized":"2024-04-26T11:16:39.866772+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:54.740487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868110+0000","last_change":"2024-04-26T11:13:12.915238+0000","last_active":"2024-04-26T11:16:39.868110+0000","last_peered":"2024-04-26T11:16:39.868110+0000","last_clean":"2024-04-26T11:16:39.868110+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:16:39.868110+0000","last_undegraded":"2024-04-26T11:16:39.868110+0000","last_fullsized":"2024-04-26T11:16:39.868110+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:48.068465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":81,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867233+0000","last_change":"2024-04-26T11:16:36.859741+0000","last_active":"2024-04-26T11:16:39.867233+0000","last_peered":"2024-04-26T11:16:39.867233+0000","last_clean":"2024-04-26T11:16:39.867233+0000","last_became_active":"2024-04-26T11:16:36.859257+0000","last_became_peered":"2024-04-26T11:16:36.859257+0000","last_unstale":"2024-04-26T11:16:39.867233+0000","last_undegraded":"2024-04-26T11:16:39.867233+0000","last_fullsized":"2024-04-26T11:16:39.867233+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:22:44.680191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867569+0000","last_change":"2024-04-26T11:16:36.869499+0000","last_active":"2024-04-26T11:16:39.867569+0000","last_peered":"2024-04-26T11:16:39.867569+0000","last_clean":"2024-04-26T11:16:39.867569+0000","last_became_active":"2024-04-26T11:16:36.868256+0000","last_became_peered":"2024-04-26T11:16:36.868256+0000","last_unstale":"2024-04-26T11:16:39.867569+0000","last_undegraded":"2024-04-26T11:16:39.867569+0000","last_fullsized":"2024-04-26T11:16:39.867569+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:11:02.923235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866874+0000","last_change":"2024-04-26T11:16:36.870080+0000","last_active":"2024-04-26T11:16:39.866874+0000","last_peered":"2024-04-26T11:16:39.866874+0000","last_clean":"2024-04-26T11:16:39.866874+0000","last_became_active":"2024-04-26T11:16:36.867077+0000","last_became_peered":"2024-04-26T11:16:36.867077+0000","last_unstale":"2024-04-26T11:16:39.866874+0000","last_undegraded":"2024-04-26T11:16:39.866874+0000","last_fullsized":"2024-04-26T11:16:39.866874+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:25.497636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868006+0000","last_change":"2024-04-26T11:16:36.862068+0000","last_active":"2024-04-26T11:16:39.868006+0000","last_peered":"2024-04-26T11:16:39.868006+0000","last_clean":"2024-04-26T11:16:39.868006+0000","last_became_active":"2024-04-26T11:16:36.860565+0000","last_became_peered":"2024-04-26T11:16:36.860565+0000","last_unstale":"2024-04-26T11:16:39.868006+0000","last_undegraded":"2024-04-26T11:16:39.868006+0000","last_fullsized":"2024-04-26T11:16:39.868006+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:38:14.430827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":25,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868225+0000","last_change":"2024-04-26T11:16:36.861810+0000","last_active":"2024-04-26T11:16:39.868225+0000","last_peered":"2024-04-26T11:16:39.868225+0000","last_clean":"2024-04-26T11:16:39.868225+0000","last_became_active":"2024-04-26T11:16:36.860299+0000","last_became_peered":"2024-04-26T11:16:36.860299+0000","last_unstale":"2024-04-26T11:16:39.868225+0000","last_undegraded":"2024-04-26T11:16:39.868225+0000","last_fullsized":"2024-04-26T11:16:39.868225+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:13.262452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866753+0000","last_change":"2024-04-26T11:16:36.871465+0000","last_active":"2024-04-26T11:16:39.866753+0000","last_peered":"2024-04-26T11:16:39.866753+0000","last_clean":"2024-04-26T11:16:39.866753+0000","last_became_active":"2024-04-26T11:16:36.871072+0000","last_became_peered":"2024-04-26T11:16:36.871072+0000","last_unstale":"2024-04-26T11:16:39.866753+0000","last_undegraded":"2024-04-26T11:16:39.866753+0000","last_fullsized":"2024-04-26T11:16:39.866753+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:13.048577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":83,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867855+0000","last_change":"2024-04-26T11:16:36.865905+0000","last_active":"2024-04-26T11:16:39.867855+0000","last_peered":"2024-04-26T11:16:39.867855+0000","last_clean":"2024-04-26T11:16:39.867855+0000","last_became_active":"2024-04-26T11:16:36.865374+0000","last_became_peered":"2024-04-26T11:16:36.865374+0000","last_unstale":"2024-04-26T11:16:39.867855+0000","last_undegraded":"2024-04-26T11:16:39.867855+0000","last_fullsized":"2024-04-26T11:16:39.867855+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:08:59.199058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867522+0000","last_change":"2024-04-26T11:13:12.912207+0000","last_active":"2024-04-26T11:16:39.867522+0000","last_peered":"2024-04-26T11:16:39.867522+0000","last_clean":"2024-04-26T11:16:39.867522+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:16:39.867522+0000","last_undegraded":"2024-04-26T11:16:39.867522+0000","last_fullsized":"2024-04-26T11:16:39.867522+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":25,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867185+0000","last_change":"2024-04-26T11:16:36.861887+0000","last_active":"2024-04-26T11:16:39.867185+0000","last_peered":"2024-04-26T11:16:39.867185+0000","last_clean":"2024-04-26T11:16:39.867185+0000","last_became_active":"2024-04-26T11:16:36.861385+0000","last_became_peered":"2024-04-26T11:16:36.861385+0000","last_unstale":"2024-04-26T11:16:39.867185+0000","last_undegraded":"2024-04-26T11:16:39.867185+0000","last_fullsized":"2024-04-26T11:16:39.867185+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:59.045795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866938+0000","last_change":"2024-04-26T11:16:36.866558+0000","last_active":"2024-04-26T11:16:39.866938+0000","last_peered":"2024-04-26T11:16:39.866938+0000","last_clean":"2024-04-26T11:16:39.866938+0000","last_became_active":"2024-04-26T11:16:36.865645+0000","last_became_peered":"2024-04-26T11:16:36.865645+0000","last_unstale":"2024-04-26T11:16:39.866938+0000","last_undegraded":"2024-04-26T11:16:39.866938+0000","last_fullsized":"2024-04-26T11:16:39.866938+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:26.653256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868622+0000","last_change":"2024-04-26T11:16:36.869527+0000","last_active":"2024-04-26T11:16:39.868622+0000","last_peered":"2024-04-26T11:16:39.868622+0000","last_clean":"2024-04-26T11:16:39.868622+0000","last_became_active":"2024-04-26T11:16:36.869081+0000","last_became_peered":"2024-04-26T11:16:36.869081+0000","last_unstale":"2024-04-26T11:16:39.868622+0000","last_undegraded":"2024-04-26T11:16:39.868622+0000","last_fullsized":"2024-04-26T11:16:39.868622+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:25.536503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867403+0000","last_change":"2024-04-26T11:16:36.867197+0000","last_active":"2024-04-26T11:16:39.867403+0000","last_peered":"2024-04-26T11:16:39.867403+0000","last_clean":"2024-04-26T11:16:39.867403+0000","last_became_active":"2024-04-26T11:16:36.866699+0000","last_became_peered":"2024-04-26T11:16:36.866699+0000","last_unstale":"2024-04-26T11:16:39.867403+0000","last_undegraded":"2024-04-26T11:16:39.867403+0000","last_fullsized":"2024-04-26T11:16:39.867403+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:10.074682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":24,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867218+0000","last_change":"2024-04-26T11:16:36.866905+0000","last_active":"2024-04-26T11:16:39.867218+0000","last_peered":"2024-04-26T11:16:39.867218+0000","last_clean":"2024-04-26T11:16:39.867218+0000","last_became_active":"2024-04-26T11:16:36.865531+0000","last_became_peered":"2024-04-26T11:16:36.865531+0000","last_unstale":"2024-04-26T11:16:39.867218+0000","last_undegraded":"2024-04-26T11:16:39.867218+0000","last_fullsized":"2024-04-26T11:16:39.867218+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:46:16.961092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867486+0000","last_change":"2024-04-26T11:16:36.867822+0000","last_active":"2024-04-26T11:16:39.867486+0000","last_peered":"2024-04-26T11:16:39.867486+0000","last_clean":"2024-04-26T11:16:39.867486+0000","last_became_active":"2024-04-26T11:16:36.865633+0000","last_became_peered":"2024-04-26T11:16:36.865633+0000","last_unstale":"2024-04-26T11:16:39.867486+0000","last_undegraded":"2024-04-26T11:16:39.867486+0000","last_fullsized":"2024-04-26T11:16:39.867486+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:07.461066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866683+0000","last_change":"2024-04-26T11:16:36.861799+0000","last_active":"2024-04-26T11:16:39.866683+0000","last_peered":"2024-04-26T11:16:39.866683+0000","last_clean":"2024-04-26T11:16:39.866683+0000","last_became_active":"2024-04-26T11:16:36.860707+0000","last_became_peered":"2024-04-26T11:16:36.860707+0000","last_unstale":"2024-04-26T11:16:39.866683+0000","last_undegraded":"2024-04-26T11:16:39.866683+0000","last_fullsized":"2024-04-26T11:16:39.866683+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:04.733669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868222+0000","last_change":"2024-04-26T11:16:36.866866+0000","last_active":"2024-04-26T11:16:39.868222+0000","last_peered":"2024-04-26T11:16:39.868222+0000","last_clean":"2024-04-26T11:16:39.868222+0000","last_became_active":"2024-04-26T11:16:36.865663+0000","last_became_peered":"2024-04-26T11:16:36.865663+0000","last_unstale":"2024-04-26T11:16:39.868222+0000","last_undegraded":"2024-04-26T11:16:39.868222+0000","last_fullsized":"2024-04-26T11:16:39.868222+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:40:33.235331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":81,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867244+0000","last_change":"2024-04-26T11:16:36.859551+0000","last_active":"2024-04-26T11:16:39.867244+0000","last_peered":"2024-04-26T11:16:39.867244+0000","last_clean":"2024-04-26T11:16:39.867244+0000","last_became_active":"2024-04-26T11:16:36.859140+0000","last_became_peered":"2024-04-26T11:16:36.859140+0000","last_unstale":"2024-04-26T11:16:39.867244+0000","last_undegraded":"2024-04-26T11:16:39.867244+0000","last_fullsized":"2024-04-26T11:16:39.867244+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:12.288869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867145+0000","last_change":"2024-04-26T11:16:36.861324+0000","last_active":"2024-04-26T11:16:39.867145+0000","last_peered":"2024-04-26T11:16:39.867145+0000","last_clean":"2024-04-26T11:16:39.867145+0000","last_became_active":"2024-04-26T11:16:36.859490+0000","last_became_peered":"2024-04-26T11:16:36.859490+0000","last_unstale":"2024-04-26T11:16:39.867145+0000","last_undegraded":"2024-04-26T11:16:39.867145+0000","last_fullsized":"2024-04-26T11:16:39.867145+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:08.842836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":68,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867074+0000","last_change":"2024-04-26T11:13:12.493217+0000","last_active":"2024-04-26T11:16:39.867074+0000","last_peered":"2024-04-26T11:16:39.867074+0000","last_clean":"2024-04-26T11:16:39.867074+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:16:39.867074+0000","last_undegraded":"2024-04-26T11:16:39.867074+0000","last_fullsized":"2024-04-26T11:16:39.867074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:00.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868134+0000","last_change":"2024-04-26T11:14:08.592365+0000","last_active":"2024-04-26T11:16:39.868134+0000","last_peered":"2024-04-26T11:16:39.868134+0000","last_clean":"2024-04-26T11:16:39.868134+0000","last_became_active":"2024-04-26T11:14:08.591926+0000","last_became_peered":"2024-04-26T11:14:08.591926+0000","last_unstale":"2024-04-26T11:16:39.868134+0000","last_undegraded":"2024-04-26T11:16:39.868134+0000","last_fullsized":"2024-04-26T11:16:39.868134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:52.475134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867490+0000","last_change":"2024-04-26T11:14:08.590727+0000","last_active":"2024-04-26T11:16:39.867490+0000","last_peered":"2024-04-26T11:16:39.867490+0000","last_clean":"2024-04-26T11:16:39.867490+0000","last_became_active":"2024-04-26T11:14:08.590371+0000","last_became_peered":"2024-04-26T11:14:08.590371+0000","last_unstale":"2024-04-26T11:16:39.867490+0000","last_undegraded":"2024-04-26T11:16:39.867490+0000","last_fullsized":"2024-04-26T11:16:39.867490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:07:32.002629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868050+0000","last_change":"2024-04-26T11:16:36.867874+0000","last_active":"2024-04-26T11:16:39.868050+0000","last_peered":"2024-04-26T11:16:39.868050+0000","last_clean":"2024-04-26T11:16:39.868050+0000","last_became_active":"2024-04-26T11:16:36.866878+0000","last_became_peered":"2024-04-26T11:16:36.866878+0000","last_unstale":"2024-04-26T11:16:39.868050+0000","last_undegraded":"2024-04-26T11:16:39.868050+0000","last_fullsized":"2024-04-26T11:16:39.868050+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:14.516925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867232+0000","last_change":"2024-04-26T11:16:36.866017+0000","last_active":"2024-04-26T11:16:39.867232+0000","last_peered":"2024-04-26T11:16:39.867232+0000","last_clean":"2024-04-26T11:16:39.867232+0000","last_became_active":"2024-04-26T11:16:36.865328+0000","last_became_peered":"2024-04-26T11:16:36.865328+0000","last_unstale":"2024-04-26T11:16:39.867232+0000","last_undegraded":"2024-04-26T11:16:39.867232+0000","last_fullsized":"2024-04-26T11:16:39.867232+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:11.301479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866536+0000","last_change":"2024-04-26T11:16:36.861685+0000","last_active":"2024-04-26T11:16:39.866536+0000","last_peered":"2024-04-26T11:16:39.866536+0000","last_clean":"2024-04-26T11:16:39.866536+0000","last_became_active":"2024-04-26T11:16:36.859534+0000","last_became_peered":"2024-04-26T11:16:36.859534+0000","last_unstale":"2024-04-26T11:16:39.866536+0000","last_undegraded":"2024-04-26T11:16:39.866536+0000","last_fullsized":"2024-04-26T11:16:39.866536+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:53:17.183514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866840+0000","last_change":"2024-04-26T11:16:36.862872+0000","last_active":"2024-04-26T11:16:39.866840+0000","last_peered":"2024-04-26T11:16:39.866840+0000","last_clean":"2024-04-26T11:16:39.866840+0000","last_became_active":"2024-04-26T11:16:36.860322+0000","last_became_peered":"2024-04-26T11:16:36.860322+0000","last_unstale":"2024-04-26T11:16:39.866840+0000","last_undegraded":"2024-04-26T11:16:39.866840+0000","last_fullsized":"2024-04-26T11:16:39.866840+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:37.186329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866979+0000","last_change":"2024-04-26T11:14:08.589823+0000","last_active":"2024-04-26T11:16:39.866979+0000","last_peered":"2024-04-26T11:16:39.866979+0000","last_clean":"2024-04-26T11:16:39.866979+0000","last_became_active":"2024-04-26T11:14:08.588808+0000","last_became_peered":"2024-04-26T11:14:08.588808+0000","last_unstale":"2024-04-26T11:16:39.866979+0000","last_undegraded":"2024-04-26T11:16:39.866979+0000","last_fullsized":"2024-04-26T11:16:39.866979+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:31.499991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867107+0000","last_change":"2024-04-26T11:14:08.590654+0000","last_active":"2024-04-26T11:16:39.867107+0000","last_peered":"2024-04-26T11:16:39.867107+0000","last_clean":"2024-04-26T11:16:39.867107+0000","last_became_active":"2024-04-26T11:14:08.590089+0000","last_became_peered":"2024-04-26T11:14:08.590089+0000","last_unstale":"2024-04-26T11:16:39.867107+0000","last_undegraded":"2024-04-26T11:16:39.867107+0000","last_fullsized":"2024-04-26T11:16:39.867107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:56.592753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":81,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867006+0000","last_change":"2024-04-26T11:16:36.871527+0000","last_active":"2024-04-26T11:16:39.867006+0000","last_peered":"2024-04-26T11:16:39.867006+0000","last_clean":"2024-04-26T11:16:39.867006+0000","last_became_active":"2024-04-26T11:16:36.871175+0000","last_became_peered":"2024-04-26T11:16:36.871175+0000","last_unstale":"2024-04-26T11:16:39.867006+0000","last_undegraded":"2024-04-26T11:16:39.867006+0000","last_fullsized":"2024-04-26T11:16:39.867006+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:39.731275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868396+0000","last_change":"2024-04-26T11:14:08.592455+0000","last_active":"2024-04-26T11:16:39.868396+0000","last_peered":"2024-04-26T11:16:39.868396+0000","last_clean":"2024-04-26T11:16:39.868396+0000","last_became_active":"2024-04-26T11:14:08.592069+0000","last_became_peered":"2024-04-26T11:14:08.592069+0000","last_unstale":"2024-04-26T11:16:39.868396+0000","last_undegraded":"2024-04-26T11:16:39.868396+0000","last_fullsized":"2024-04-26T11:16:39.868396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:51:18.264318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866629+0000","last_change":"2024-04-26T11:16:36.860776+0000","last_active":"2024-04-26T11:16:39.866629+0000","last_peered":"2024-04-26T11:16:39.866629+0000","last_clean":"2024-04-26T11:16:39.866629+0000","last_became_active":"2024-04-26T11:16:36.859301+0000","last_became_peered":"2024-04-26T11:16:36.859301+0000","last_unstale":"2024-04-26T11:16:39.866629+0000","last_undegraded":"2024-04-26T11:16:39.866629+0000","last_fullsized":"2024-04-26T11:16:39.866629+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:27.648935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":219,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866594+0000","last_change":"2024-04-26T11:16:36.864256+0000","last_active":"2024-04-26T11:16:39.866594+0000","last_peered":"2024-04-26T11:16:39.866594+0000","last_clean":"2024-04-26T11:16:39.866594+0000","last_became_active":"2024-04-26T11:16:36.863058+0000","last_became_peered":"2024-04-26T11:16:36.863058+0000","last_unstale":"2024-04-26T11:16:39.866594+0000","last_undegraded":"2024-04-26T11:16:39.866594+0000","last_fullsized":"2024-04-26T11:16:39.866594+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:49.355165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867374+0000","last_change":"2024-04-26T11:14:08.589733+0000","last_active":"2024-04-26T11:16:39.867374+0000","last_peered":"2024-04-26T11:16:39.867374+0000","last_clean":"2024-04-26T11:16:39.867374+0000","last_became_active":"2024-04-26T11:14:08.589187+0000","last_became_peered":"2024-04-26T11:14:08.589187+0000","last_unstale":"2024-04-26T11:16:39.867374+0000","last_undegraded":"2024-04-26T11:16:39.867374+0000","last_fullsized":"2024-04-26T11:16:39.867374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:47.437503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867905+0000","last_change":"2024-04-26T11:16:36.864249+0000","last_active":"2024-04-26T11:16:39.867905+0000","last_peered":"2024-04-26T11:16:39.867905+0000","last_clean":"2024-04-26T11:16:39.867905+0000","last_became_active":"2024-04-26T11:16:36.863279+0000","last_became_peered":"2024-04-26T11:16:36.863279+0000","last_unstale":"2024-04-26T11:16:39.867905+0000","last_undegraded":"2024-04-26T11:16:39.867905+0000","last_fullsized":"2024-04-26T11:16:39.867905+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:19.053419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866815+0000","last_change":"2024-04-26T11:16:36.869342+0000","last_active":"2024-04-26T11:16:39.866815+0000","last_peered":"2024-04-26T11:16:39.866815+0000","last_clean":"2024-04-26T11:16:39.866815+0000","last_became_active":"2024-04-26T11:16:36.866494+0000","last_became_peered":"2024-04-26T11:16:36.866494+0000","last_unstale":"2024-04-26T11:16:39.866815+0000","last_undegraded":"2024-04-26T11:16:39.866815+0000","last_fullsized":"2024-04-26T11:16:39.866815+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:47:19.386938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866970+0000","last_change":"2024-04-26T11:16:36.863211+0000","last_active":"2024-04-26T11:16:39.866970+0000","last_peered":"2024-04-26T11:16:39.866970+0000","last_clean":"2024-04-26T11:16:39.866970+0000","last_became_active":"2024-04-26T11:16:36.862085+0000","last_became_peered":"2024-04-26T11:16:36.862085+0000","last_unstale":"2024-04-26T11:16:39.866970+0000","last_undegraded":"2024-04-26T11:16:39.866970+0000","last_fullsized":"2024-04-26T11:16:39.866970+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:55.260721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868073+0000","last_change":"2024-04-26T11:13:12.918648+0000","last_active":"2024-04-26T11:16:39.868073+0000","last_peered":"2024-04-26T11:16:39.868073+0000","last_clean":"2024-04-26T11:16:39.868073+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:16:39.868073+0000","last_undegraded":"2024-04-26T11:16:39.868073+0000","last_fullsized":"2024-04-26T11:16:39.868073+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":71,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868260+0000","last_change":"2024-04-26T11:13:08.110433+0000","last_active":"2024-04-26T11:16:39.868260+0000","last_peered":"2024-04-26T11:16:39.868260+0000","last_clean":"2024-04-26T11:16:39.868260+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:16:39.868260+0000","last_undegraded":"2024-04-26T11:16:39.868260+0000","last_fullsized":"2024-04-26T11:16:39.868260+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867596+0000","last_change":"2024-04-26T11:14:08.590798+0000","last_active":"2024-04-26T11:16:39.867596+0000","last_peered":"2024-04-26T11:16:39.867596+0000","last_clean":"2024-04-26T11:16:39.867596+0000","last_became_active":"2024-04-26T11:14:08.590535+0000","last_became_peered":"2024-04-26T11:14:08.590535+0000","last_unstale":"2024-04-26T11:16:39.867596+0000","last_undegraded":"2024-04-26T11:16:39.867596+0000","last_fullsized":"2024-04-26T11:16:39.867596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:04.692288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867073+0000","last_change":"2024-04-26T11:16:36.866253+0000","last_active":"2024-04-26T11:16:39.867073+0000","last_peered":"2024-04-26T11:16:39.867073+0000","last_clean":"2024-04-26T11:16:39.867073+0000","last_became_active":"2024-04-26T11:16:36.865560+0000","last_became_peered":"2024-04-26T11:16:36.865560+0000","last_unstale":"2024-04-26T11:16:39.867073+0000","last_undegraded":"2024-04-26T11:16:39.867073+0000","last_fullsized":"2024-04-26T11:16:39.867073+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:52.517359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":59,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.868432+0000","last_change":"2024-04-26T11:14:08.592482+0000","last_active":"2024-04-26T11:16:39.868432+0000","last_peered":"2024-04-26T11:16:39.868432+0000","last_clean":"2024-04-26T11:16:39.868432+0000","last_became_active":"2024-04-26T11:14:08.592093+0000","last_became_peered":"2024-04-26T11:14:08.592093+0000","last_unstale":"2024-04-26T11:16:39.868432+0000","last_undegraded":"2024-04-26T11:16:39.868432+0000","last_fullsized":"2024-04-26T11:16:39.868432+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:38.939541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867975+0000","last_change":"2024-04-26T11:14:08.589530+0000","last_active":"2024-04-26T11:16:39.867975+0000","last_peered":"2024-04-26T11:16:39.867975+0000","last_clean":"2024-04-26T11:16:39.867975+0000","last_became_active":"2024-04-26T11:14:08.589288+0000","last_became_peered":"2024-04-26T11:14:08.589288+0000","last_unstale":"2024-04-26T11:16:39.867975+0000","last_undegraded":"2024-04-26T11:16:39.867975+0000","last_fullsized":"2024-04-26T11:16:39.867975+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:52.096175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.869934+0000","last_change":"2024-04-26T11:16:39.868742+0000","last_active":"2024-04-26T11:16:39.869934+0000","last_peered":"2024-04-26T11:16:39.869934+0000","last_clean":"2024-04-26T11:16:39.869934+0000","last_became_active":"2024-04-26T11:16:39.868240+0000","last_became_peered":"2024-04-26T11:16:39.868240+0000","last_unstale":"2024-04-26T11:16:39.869934+0000","last_undegraded":"2024-04-26T11:16:39.869934+0000","last_fullsized":"2024-04-26T11:16:39.869934+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:02.747912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867868+0000","last_change":"2024-04-26T11:16:36.860868+0000","last_active":"2024-04-26T11:16:39.867868+0000","last_peered":"2024-04-26T11:16:39.867868+0000","last_clean":"2024-04-26T11:16:39.867868+0000","last_became_active":"2024-04-26T11:16:36.858042+0000","last_became_peered":"2024-04-26T11:16:36.858042+0000","last_unstale":"2024-04-26T11:16:39.867868+0000","last_undegraded":"2024-04-26T11:16:39.867868+0000","last_fullsized":"2024-04-26T11:16:39.867868+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:57:35.285183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867381+0000","last_change":"2024-04-26T11:16:36.867856+0000","last_active":"2024-04-26T11:16:39.867381+0000","last_peered":"2024-04-26T11:16:39.867381+0000","last_clean":"2024-04-26T11:16:39.867381+0000","last_became_active":"2024-04-26T11:16:36.865816+0000","last_became_peered":"2024-04-26T11:16:36.865816+0000","last_unstale":"2024-04-26T11:16:39.867381+0000","last_undegraded":"2024-04-26T11:16:39.867381+0000","last_fullsized":"2024-04-26T11:16:39.867381+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:35.210355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867366+0000","last_change":"2024-04-26T11:16:36.859796+0000","last_active":"2024-04-26T11:16:39.867366+0000","last_peered":"2024-04-26T11:16:39.867366+0000","last_clean":"2024-04-26T11:16:39.867366+0000","last_became_active":"2024-04-26T11:16:36.859544+0000","last_became_peered":"2024-04-26T11:16:36.859544+0000","last_unstale":"2024-04-26T11:16:39.867366+0000","last_undegraded":"2024-04-26T11:16:39.867366+0000","last_fullsized":"2024-04-26T11:16:39.867366+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:54.365229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":85,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.872196+0000","last_change":"2024-04-26T11:16:39.870923+0000","last_active":"2024-04-26T11:16:39.872196+0000","last_peered":"2024-04-26T11:16:39.872196+0000","last_clean":"2024-04-26T11:16:39.872196+0000","last_became_active":"2024-04-26T11:16:39.870633+0000","last_became_peered":"2024-04-26T11:16:39.870633+0000","last_unstale":"2024-04-26T11:16:39.872196+0000","last_undegraded":"2024-04-26T11:16:39.872196+0000","last_fullsized":"2024-04-26T11:16:39.872196+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:52.853443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867633+0000","last_change":"2024-04-26T11:13:12.917812+0000","last_active":"2024-04-26T11:16:39.867633+0000","last_peered":"2024-04-26T11:16:39.867633+0000","last_clean":"2024-04-26T11:16:39.867633+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:16:39.867633+0000","last_undegraded":"2024-04-26T11:16:39.867633+0000","last_fullsized":"2024-04-26T11:16:39.867633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.875417+0000","last_change":"2024-04-26T11:16:39.872736+0000","last_active":"2024-04-26T11:16:39.875417+0000","last_peered":"2024-04-26T11:16:39.875417+0000","last_clean":"2024-04-26T11:16:39.875417+0000","last_became_active":"2024-04-26T11:16:39.869693+0000","last_became_peered":"2024-04-26T11:16:39.869693+0000","last_unstale":"2024-04-26T11:16:39.875417+0000","last_undegraded":"2024-04-26T11:16:39.875417+0000","last_fullsized":"2024-04-26T11:16:39.875417+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:14.138907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867000+0000","last_change":"2024-04-26T11:16:36.865623+0000","last_active":"2024-04-26T11:16:39.867000+0000","last_peered":"2024-04-26T11:16:39.867000+0000","last_clean":"2024-04-26T11:16:39.867000+0000","last_became_active":"2024-04-26T11:16:36.864187+0000","last_became_peered":"2024-04-26T11:16:36.864187+0000","last_unstale":"2024-04-26T11:16:39.867000+0000","last_undegraded":"2024-04-26T11:16:39.867000+0000","last_fullsized":"2024-04-26T11:16:39.867000+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:25.032691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":83,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867982+0000","last_change":"2024-04-26T11:16:36.867034+0000","last_active":"2024-04-26T11:16:39.867982+0000","last_peered":"2024-04-26T11:16:39.867982+0000","last_clean":"2024-04-26T11:16:39.867982+0000","last_became_active":"2024-04-26T11:16:36.866529+0000","last_became_peered":"2024-04-26T11:16:36.866529+0000","last_unstale":"2024-04-26T11:16:39.867982+0000","last_undegraded":"2024-04-26T11:16:39.867982+0000","last_fullsized":"2024-04-26T11:16:39.867982+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:36.200369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867069+0000","last_change":"2024-04-26T11:16:36.865772+0000","last_active":"2024-04-26T11:16:39.867069+0000","last_peered":"2024-04-26T11:16:39.867069+0000","last_clean":"2024-04-26T11:16:39.867069+0000","last_became_active":"2024-04-26T11:16:36.865213+0000","last_became_peered":"2024-04-26T11:16:36.865213+0000","last_unstale":"2024-04-26T11:16:39.867069+0000","last_undegraded":"2024-04-26T11:16:39.867069+0000","last_fullsized":"2024-04-26T11:16:39.867069+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:03.220593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867741+0000","last_change":"2024-04-26T11:14:08.589726+0000","last_active":"2024-04-26T11:16:39.867741+0000","last_peered":"2024-04-26T11:16:39.867741+0000","last_clean":"2024-04-26T11:16:39.867741+0000","last_became_active":"2024-04-26T11:14:08.588687+0000","last_became_peered":"2024-04-26T11:14:08.588687+0000","last_unstale":"2024-04-26T11:16:39.867741+0000","last_undegraded":"2024-04-26T11:16:39.867741+0000","last_fullsized":"2024-04-26T11:16:39.867741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:05.617266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":67,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867685+0000","last_change":"2024-04-26T11:13:12.917763+0000","last_active":"2024-04-26T11:16:39.867685+0000","last_peered":"2024-04-26T11:16:39.867685+0000","last_clean":"2024-04-26T11:16:39.867685+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:16:39.867685+0000","last_undegraded":"2024-04-26T11:16:39.867685+0000","last_fullsized":"2024-04-26T11:16:39.867685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.879785+0000","last_change":"2024-04-26T11:16:39.879362+0000","last_active":"2024-04-26T11:16:39.879785+0000","last_peered":"2024-04-26T11:16:39.879785+0000","last_clean":"2024-04-26T11:16:39.879785+0000","last_became_active":"2024-04-26T11:16:39.870185+0000","last_became_peered":"2024-04-26T11:16:39.870185+0000","last_unstale":"2024-04-26T11:16:39.879785+0000","last_undegraded":"2024-04-26T11:16:39.879785+0000","last_fullsized":"2024-04-26T11:16:39.879785+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:56.385417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867083+0000","last_change":"2024-04-26T11:16:36.870651+0000","last_active":"2024-04-26T11:16:39.867083+0000","last_peered":"2024-04-26T11:16:39.867083+0000","last_clean":"2024-04-26T11:16:39.867083+0000","last_became_active":"2024-04-26T11:16:36.869018+0000","last_became_peered":"2024-04-26T11:16:36.869018+0000","last_unstale":"2024-04-26T11:16:39.867083+0000","last_undegraded":"2024-04-26T11:16:39.867083+0000","last_fullsized":"2024-04-26T11:16:39.867083+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:52:59.337390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.866983+0000","last_change":"2024-04-26T11:16:36.870356+0000","last_active":"2024-04-26T11:16:39.866983+0000","last_peered":"2024-04-26T11:16:39.866983+0000","last_clean":"2024-04-26T11:16:39.866983+0000","last_became_active":"2024-04-26T11:16:36.868029+0000","last_became_peered":"2024-04-26T11:16:36.868029+0000","last_unstale":"2024-04-26T11:16:39.866983+0000","last_undegraded":"2024-04-26T11:16:39.866983+0000","last_fullsized":"2024-04-26T11:16:39.866983+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:13:24.219419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867005+0000","last_change":"2024-04-26T11:14:08.590838+0000","last_active":"2024-04-26T11:16:39.867005+0000","last_peered":"2024-04-26T11:16:39.867005+0000","last_clean":"2024-04-26T11:16:39.867005+0000","last_became_active":"2024-04-26T11:14:08.590386+0000","last_became_peered":"2024-04-26T11:14:08.590386+0000","last_unstale":"2024-04-26T11:16:39.867005+0000","last_undegraded":"2024-04-26T11:16:39.867005+0000","last_fullsized":"2024-04-26T11:16:39.867005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:50.791318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867454+0000","last_change":"2024-04-26T11:16:36.866359+0000","last_active":"2024-04-26T11:16:39.867454+0000","last_peered":"2024-04-26T11:16:39.867454+0000","last_clean":"2024-04-26T11:16:39.867454+0000","last_became_active":"2024-04-26T11:16:36.865724+0000","last_became_peered":"2024-04-26T11:16:36.865724+0000","last_unstale":"2024-04-26T11:16:39.867454+0000","last_undegraded":"2024-04-26T11:16:39.867454+0000","last_fullsized":"2024-04-26T11:16:39.867454+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:27.869054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867323+0000","last_change":"2024-04-26T11:14:08.589117+0000","last_active":"2024-04-26T11:16:39.867323+0000","last_peered":"2024-04-26T11:16:39.867323+0000","last_clean":"2024-04-26T11:16:39.867323+0000","last_became_active":"2024-04-26T11:14:08.588762+0000","last_became_peered":"2024-04-26T11:14:08.588762+0000","last_unstale":"2024-04-26T11:16:39.867323+0000","last_undegraded":"2024-04-26T11:16:39.867323+0000","last_fullsized":"2024-04-26T11:16:39.867323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:56:05.658069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-26T11:16:39.867704+0000","last_change":"2024-04-26T11:16:36.866641+0000","last_active":"2024-04-26T11:16:39.867704+0000","last_peered":"2024-04-26T11:16:39.867704+0000","last_clean":"2024-04-26T11:16:39.867704+0000","last_became_active":"2024-04-26T11:16:36.866112+0000","last_became_peered":"2024-04-26T11:16:36.866112+0000","last_unstale":"2024-04-26T11:16:39.867704+0000","last_undegraded":"2024-04-26T11:16:39.867704+0000","last_fullsized":"2024-04-26T11:16:39.867704+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:31.034151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1164,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5470,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738414,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281064,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94090776,"statfs":{"total":96636764160,"available":96348954624,"internally_reserved":0,"allocated":1400832,"data_stored":896608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":1,"last update":"Fri Apr 26 11:16:17 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40200000000000002,"15min":0.378},"min":{"1min":0.20000000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.96499999999999997,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.44400000000000001,"15min":0.44600000000000001},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.57599999999999996,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.61199999999999999}]}]},{"osd":0,"up_from":67,"seq":287762808835,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40368,"kb_used_data":1380,"kb_used_omap":6,"kb_used_meta":38969,"kb_avail":94331472,"statfs":{"total":96636764160,"available":96595427328,"internally_reserved":0,"allocated":1413120,"data_stored":898335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7064,"internal_metadata":39904360},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":1,"up_from":8,"seq":34359738415,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401048,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":400254,"kb_avail":93970792,"statfs":{"total":96636764160,"available":96226091008,"internally_reserved":0,"allocated":794624,"data_stored":306221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":409860550},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":2,"last update":"Fri Apr 26 11:16:10 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.40300000000000002,"15min":0.39300000000000002},"min":{"1min":0.14999999999999999,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.61299999999999999,"5min":2.056,"15min":2.056},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.47899999999999998,"15min":0.45700000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":3.9609999999999999,"5min":3.9609999999999999,"15min":3.9609999999999999},"last":0.38900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5470,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:16:50.078 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T11:16:50.078 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:16:50.078 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [1, 2, 0] 2024-04-26T11:16:50.078 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T11:16:50.079 INFO:teuthology.orchestra.console.smithi072:Power off 2024-04-26T11:16:50.079 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T11:16:50.103 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2024-04-26T11:16:50.103 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:16:50.128 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2024-04-26T11:16:54.129 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:16:54.239 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2024-04-26T11:16:54.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-26T11:16:58.240 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:16:58.350 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2024-04-26T11:17:00.144 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~6s 2024-04-26T11:17:02.351 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:17:02.462 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2024-04-26T11:17:02.563 INFO:teuthology.orchestra.console.smithi072:Power off completed 2024-04-26T11:17:05.952 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~12s 2024-04-26T11:17:07.665 INFO:tasks.thrashosds.thrasher:reviving osd 2024-04-26T11:17:07.665 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-04-26T11:17:07.666 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T11:17:07.666 INFO:teuthology.orchestra.console.smithi072:Power on 2024-04-26T11:17:07.666 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-26T11:17:07.689 DEBUG:teuthology.orchestra.console.smithi072:power on output: Chassis Power Control: Up/On 2024-04-26T11:17:07.690 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:17:07.712 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2024-04-26T11:17:11.713 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:17:11.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~17s 2024-04-26T11:17:11.824 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2024-04-26T11:17:15.825 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:17:15.949 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2024-04-26T11:17:16.050 INFO:teuthology.orchestra.console.smithi072:Power on completed 2024-04-26T11:17:16.151 DEBUG:teuthology.orchestra.console.smithi072:Waiting for login prompt 2024-04-26T11:17:16.151 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi072 2024-04-26T11:17:17.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~23s 2024-04-26T11:17:23.373 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~29s 2024-04-26T11:17:29.181 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~35s 2024-04-26T11:17:34.988 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~41s 2024-04-26T11:17:40.796 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~46s 2024-04-26T11:17:46.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~52s 2024-04-26T11:17:52.412 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~58s 2024-04-26T11:17:58.219 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~64s 2024-04-26T11:18:04.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~70s 2024-04-26T11:18:09.832 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~75s 2024-04-26T11:18:15.639 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~81s 2024-04-26T11:18:21.445 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~87s 2024-04-26T11:18:27.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~93s 2024-04-26T11:18:33.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~99s 2024-04-26T11:18:38.867 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~105s 2024-04-26T11:18:44.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~110s 2024-04-26T11:18:50.479 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~116s 2024-04-26T11:18:56.286 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~122s 2024-04-26T11:19:02.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~128s 2024-04-26T11:19:07.898 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~134s 2024-04-26T11:19:08.406 DEBUG:teuthology.orchestra.console.smithi072:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el(R) Boot t GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Initializing Intel(R) Boot Agent GE v1.5.13 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F B7 65 GUID: 00000000 0000 0000 0000 0CC47AD8DAF4 DHCP.\                    DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\  21.15.72 MAS 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.72 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:b7:65)... Configuring (net0 0c:c4:7a:8f:b7:65).... Configuring (net0 0c:c4:7a:8f:b7:65)..... Configuring (net0 0c:c4:7a:8f:b7:65)...... ok .   [?25lUse the ^ and v keys to change the selection. edit the selecta command prompt4;1H CentOS Stream (4.18.0-552.el8.x86_64) 8  CentOS Stream (4.18.0-489.el8.x86_64) 8  CentOS Stream (4.18.0-348.el8.x86_64) 8  CentOS Stream (0-rescue-a1b29d6c289747bdb22930598d39874a) 8              The selected entry will be started automatically in 5s.  CentOS Stream (4.18.0-552.el8.x86_64) 8   CentOS Stream (4.18.0-489.el8.x86_64) 8  CentOS Stream (4.18.0-348.el8.x86_64) 8  CentOS Stream (0-rescue-a1b29d6c289747bdb22930598d39874a) 8          The selected entry will be started automatically in 4s.    Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.   The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 4.18.0-552.el8.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-21) (GCC)) #1 SMP Sun Apr 7 19:39:51 UTC 2024 [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-552.el8.x86_64 root=UUID=c5236ddf-553d-41ea-8bce-5708f99a0430 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078e70fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f23000-0x00000000798acfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ad000-0x0000000079d49fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4a000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.713 MHz processor [ 0.000000] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0x78e71 max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.000000] Using GB pages for direct mapping [ 0.000000] RAMDISK: [mem 0x34b91000-0x365c0fff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.000000] ACPI: XSDT 0x00000000798AD098 0000B4 (v01 01072009 AMI 00010013) [ 0.000000] ACPI: FACP 0x00000000798E05B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: DSDT 0x00000000798AD1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.000000] ACPI: FACS 0x0000000079D48F80 000040 [ 0.000000] ACPI: APIC 0x00000000798E06C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FPDT 0x00000000798E0788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FIDT 0x00000000798E07D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: SPMI 0x00000000798E0870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.000000] ACPI: MCFG 0x00000000798E08B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.000000] ACPI: UEFI 0x00000000798E08F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.000000] ACPI: HPET 0x00000000798E0938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: WDDT 0x00000000798E0970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.000000] ACPI: SSDT 0x00000000798E09B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798F7B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798FA180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.000000] ACPI: PRAD 0x00000000798FA1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.000000] ACPI: DMAR 0x00000000798FA2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: HEST 0x00000000798FA3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 0x00000000798FA630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 0x00000000798FA660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 0x00000000798FA890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0x798e05b0-0x798e06bb] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0x798ad1e8-0x798e05ab] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0x79d48f80-0x79d48fbf] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0x798e06c0-0x798e0787] [ 0.000000] ACPI: Reserving FPDT table memory at [mem 0x798e0788-0x798e07cb] [ 0.000000] ACPI: Reserving FIDT table memory at [mem 0x798e07d0-0x798e086b] [ 0.000000] ACPI: Reserving SPMI table memory at [mem 0x798e0870-0x798e08af] [ 0.000000] ACPI: Reserving MCFG table memory at [mem 0x798e08b0-0x798e08eb] [ 0.000000] ACPI: Reserving UEFI table memory at [mem 0x798e08f0-0x798e0931] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0x798e0938-0x798e096f] [ 0.000000] ACPI: Reserving WDDT table memory at [mem 0x798e0970-0x798e09af] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798e09b0-0x798f7b2e] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798f7b30-0x798fa17b] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798fa180-0x798fa1e3] [ 0.000000] ACPI: Reserving PRAD table memory at [mem 0x798fa1e8-0x798fa2e9] [ 0.000000] ACPI: Reserving DMAR table memory at [mem 0x798fa2f0-0x798fa3ab] [ 0.000000] ACPI: Reserving HEST table memory at [mem 0x798fa3b0-0x798fa62b] [ 0.000000] ACPI: Reserving BERT table memory at [mem 0x798fa630-0x798fa65f] [ 0.000000] ACPI: Reserving ERST table memory at [mem 0x798fa660-0x798fa88f] [ 0.000000] ACPI: Reserving EINJ table memory at [mem 0x798fa890-0x798fa9bf] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.000000] Using crashkernel=auto, the size chosen is a best effort estimation. [ 0.000000] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32653MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.000000] node 0: [mem 0x0000000000100000-0x0000000078e70fff] [ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Zeroed struct page in unavailable ranges: 29189 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.000000] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78e71000-0x78f22fff] [ 0.000000] PM: Registered nosave memory: [mem 0x78f23000-0x798acfff] [ 0.000000] PM: Registered nosave memory: [mem 0x798ad000-0x79d49fff] [ 0.000000] PM: Registered nosave memory: [mem 0x79d4a000-0x8fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.000000] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 8228663 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-552.el8.x86_64 root=UUID=c5236ddf-553d-41ea-8bce-5708f99a0430 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] software IO TLB: area num 8. [ 0.000000] Memory: 1756420K/33437676K available (14339K kernel code, 5957K rwdata, 8568K rodata, 2820K init, 13792K bss, 935740K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.000000] Kernel/User page tables isolation: enabled [ 0.000000] ftrace: allocating 41053 entries in 161 pages [ 0.000000] ftrace: allocated 161 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.000000] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.000000] random: crng done (trusting CPU's manufacturer) [ 0.001000] Console: colour VGA+ 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 0.001000] APIC: Switch to symmetric I/O mode setup [ 0.001003] DMAR: Host address width 46 [ 0.002001] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 0.003004] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 0.004001] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 0.005002] DMAR: ATSR flags: 0x0 [ 0.006001] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 0.007002] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 0.008001] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 0.009001] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 0.010001] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 0.010002] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 0.013035] DMAR-IR: Enabled IRQ remapping in xapic mode [ 0.014000] x2apic: IRQ remapping doesn't support X2APIC mode [ 0.014482] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.019001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327241f2b7c, max_idle_ns: 440795226326 ns [ 0.020001] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.42 BogoMIPS (lpj=3499713) [ 0.021000] pid_max: default: 32768 minimum: 301 [ 0.022022] LSM: Security Framework initializing [ 0.023008] Yama: becoming mindful. [ 0.024004] SELinux: Initializing. [ 0.025021] LSM support for eBPF active [ 0.030413] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, vmalloc) [ 0.033672] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, vmalloc) [ 0.034076] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.035071] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.036204] CPU0: Thermal monitoring enabled (TM1) [ 0.037055] process: using mwait in idle threads [ 0.038001] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 0.039000] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 0.040002] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.041001] Spectre V2 : Mitigation: Retpolines [ 0.042000] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.043000] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 0.044000] Speculative Store Bypass: Vulnerable [ 0.045004] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.046000] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.047000] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.058813] Freeing SMP alternatives memory: 36K [ 0.059188] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 0.162558] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 0.164094] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 0.165001] ... version: 3 [ 0.166000] ... bit width: 48 [ 0.167000] ... generic registers: 4 [ 0.168000] ... value mask: 0000ffffffffffff [ 0.169000] ... max period: 00007fffffffffff [ 0.170000] ... fixed-purpose events: 3 [ 0.171000] ... event mask: 000000070000000f [ 0.172028] rcu: Hierarchical SRCU implementation. [ 0.174042] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 0.176009] smp: Bringing up secondary CPUs ... [ 0.177067] x86: Booting SMP configuration: [ 0.178002] .... node #0, CPUs: #1 #2 #3 #4 [ 0.181097] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 0.183000] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 0.184001] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 0.185089] #5 #6 #7 [ 0.186539] smp: Brought up 1 node, 8 CPUs [ 0.188000] smpboot: Max logical packages: 1 [ 0.189001] smpboot: Total of 8 processors activated (55995.40 BogoMIPS) [ 0.225169] node 0 deferred pages initialised in 34ms [ 0.231500] devtmpfs: initialized [ 0.232040] x86/mm: Memory block size: 128MB [ 0.235018] ACPI: PM: Registering ACPI NVS region [mem 0x798ad000-0x79d49fff] (4837376 bytes) [ 0.243082] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.253007] futex hash table entries: 2048 (order: 5, 131072 bytes, vmalloc) [ 0.260058] pinctrl core: initialized pinctrl subsystem [ 0.265115] NET: Registered protocol family 16 [ 0.270076] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 0.277012] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.285009] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.293018] audit: initializing netlink subsys (disabled) [ 0.298009] audit: type=2000 audit(1714130318.298:1): state=initialized audit_enabled=0 res=1 [ 0.307002] cpuidle: using governor menu [ 0.311028] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.318002] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.325049] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 0.334001] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 0.341013] PCI: Using configuration type 1 for base access [ 0.348011] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.355001] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.361023] cryptd: max_cpu_qlen set to 1000 [ 0.366053] ACPI: Added _OSI(Module Device) [ 0.367002] ACPI: Added _OSI(Processor Device) [ 0.371001] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.376000] ACPI: Added _OSI(Processor Aggregator Device) [ 0.406851] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 0.415760] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 0.425088] ACPI: Dynamic OEM Table Load: [ 0.442976] ACPI: Interpreter enabled [ 0.447010] ACPI: PM: (supports S0 S4 S5) [ 0.451000] ACPI: Using IOAPIC for interrupt routing [ 0.457892] HEST: Enabling Firmware First mode for corrected errors. [ 0.464073] HEST: Table parsing has been initialized. [ 0.469115] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 0.477002] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.486311] ACPI: Enabled 5 GPEs in block 00 to 3F [ 0.514770] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 0.521004] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.532563] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.541532] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.549000] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.557027] PCI host bridge to bus 0000:ff [ 0.561001] pci_bus 0000:ff: root bus resource [bus ff] [ 0.566010] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 0.572044] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 0.578032] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 0.584032] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 0.591027] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 0.597032] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 0.603030] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 0.609030] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 0.615031] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 0.621031] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 0.627031] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 0.633038] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 0.639035] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 0.645032] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 0.651031] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 0.657031] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 0.663030] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 0.669030] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 0.675031] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 0.681023] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 0.687037] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 0.693059] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 0.699043] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 0.705039] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 0.711043] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 0.717041] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 0.723040] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 0.729033] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 0.735035] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 0.741043] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 0.747042] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 0.754046] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 0.760041] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 0.766034] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 0.772033] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 0.778032] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 0.784033] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 0.790043] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 0.796041] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 0.802043] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 0.808044] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 0.814037] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 0.820024] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 0.826034] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 0.832036] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 0.838032] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 0.844032] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 0.850032] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 0.856035] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 0.862032] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 0.868032] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 0.874032] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 0.880023] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 0.886025] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 0.892032] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 0.900595] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 0.907002] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.916137] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.924288] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.932001] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.941505] PCI host bridge to bus 0000:00 [ 0.945001] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.952000] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 0.959000] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.966000] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 0.974000] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 0.981000] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 0.989001] pci_bus 0000:00: root bus resource [bus 00-fe] [ 0.994025] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 1.000096] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 1.006042] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.012086] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 1.018041] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.025086] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 1.031041] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.037079] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 1.043005] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.050079] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 1.056007] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 1.063076] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 1.069008] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 1.075079] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 1.081007] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 1.088076] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 1.094007] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.101074] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 1.107008] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 1.114080] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 1.120007] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 1.127078] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 1.133007] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 1.140075] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 1.146064] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 1.152082] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 1.158057] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 1.164004] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 1.170061] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 1.176160] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 1.182011] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 1.188006] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 1.194006] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 1.199006] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 1.205007] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 1.210006] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 1.217028] pci 0000:00:11.4: PME# supported from D3hot [ 1.222074] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 1.228013] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 1.235050] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.241091] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 1.247014] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 1.254051] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.260057] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 1.266013] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 1.272051] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.279069] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 1.285013] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 1.291043] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.297072] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 1.303065] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.309076] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 1.315066] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.322076] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 1.328066] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.334093] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 1.340014] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 1.346074] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.352050] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 1.358157] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 1.365009] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 1.370005] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 1.376005] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 1.381005] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 1.387005] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 1.392005] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 1.399029] pci 0000:00:1f.2: PME# supported from D3hot [ 1.404064] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 1.410014] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 1.417016] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 1.422162] acpiphp: Slot [1] registered [ 1.427013] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.431111] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 1.438009] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 1.444016] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 1.451003] pci 0000:02:00.0: enabling Extended Tags [ 1.456091] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.461003] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.468061] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 1.474009] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.481004] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 1.487009] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.494004] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 1.501036] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.507016] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.514000] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.524008] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.532000] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.542082] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 1.548010] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.555004] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 1.561009] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.568004] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 1.575037] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.581013] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.588001] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.599009] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.606000] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.616080] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.621002] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.627001] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.634002] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.642030] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.647060] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 1.653044] pci 0000:05:00.0: enabling Extended Tags [ 1.658069] pci 0000:05:00.0: supports D1 D2 [ 1.662000] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.669054] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.674002] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.680002] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.687042] pci_bus 0000:06: extended config space not accessible [ 1.693030] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 1.699022] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 1.705012] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 1.712012] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 1.717096] pci 0000:06:00.0: supports D1 D2 [ 1.722000] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.728110] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.733006] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.739003] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.746082] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 1.752017] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 1.759018] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 1.764009] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 1.770076] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.777035] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.784000] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.794021] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.801001] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.812098] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 1.818018] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 1.824018] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 1.830009] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 1.836115] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.842034] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.849000] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.860021] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.867000] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.877152] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.882002] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.888002] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.895003] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.902515] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.908033] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.914031] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.920030] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.926030] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.932000] ACPI: PCI: Interrupt link LNKE disabled [ 1.937030] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.943000] ACPI: PCI: Interrupt link LNKF disabled [ 1.948030] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.954000] ACPI: PCI: Interrupt link LNKG disabled [ 1.959024] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.965001] ACPI: PCI: Interrupt link LNKH disabled [ 1.970224] iommu: Default domain type: Passthrough [ 1.975075] SCSI subsystem initialized [ 1.979017] ACPI: bus type USB registered [ 1.983011] usbcore: registered new interface driver usbfs [ 1.988005] usbcore: registered new interface driver hub [ 1.993007] usbcore: registered new device driver usb [ 1.999018] pps_core: LinuxPPS API ver. 1 registered [ 2.004000] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.013002] PTP clock support registered [ 2.017014] EDAC MC: Ver: 3.0.0 [ 2.020108] PCI: Using ACPI for IRQ routing [ 2.028989] NetLabel: Initializing [ 2.033000] NetLabel: domain hash size = 128 [ 2.037000] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.043010] NetLabel: unlabeled traffic allowed by default [ 2.048016] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.053000] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.063001] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.069000] vgaarb: loaded [ 2.071038] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.078001] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.085030] clocksource: Switched to clocksource tsc-early [ 2.100569] VFS: Disk quotas dquot_6.6.0 [ 2.104498] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.111422] pnp: PnP ACPI init [ 2.114811] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.120723] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.126635] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.132546] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.138456] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.144373] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.150288] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.156891] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.163496] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.170100] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.176706] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.183311] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.189917] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.196690] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.202605] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.208516] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.214427] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.220338] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.226924] pnp: PnP ACPI: found 5 devices [ 2.236385] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 2.245290] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 2.256760] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 2.264579] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.269539] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.274502] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.281285] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.288848] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.296753] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.304395] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.312389] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.319946] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.327852] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.335496] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.343487] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.351046] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.358952] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.366595] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.374588] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.382145] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.390049] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.397693] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.405686] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.410645] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.416730] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.423506] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.431240] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.436204] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.441163] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.447252] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.454043] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.459262] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.465347] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.472128] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 2.479865] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 2.487685] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 2.495425] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 2.503253] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.508215] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.514301] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.521079] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 2.528813] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 2.537848] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 2.544019] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 2.550190] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 2.557055] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 2.563920] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 2.570785] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 2.577651] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 2.583910] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 2.589473] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 2.595731] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.602942] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 2.608506] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.614765] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 2.620330] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.626588] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 2.632151] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 2.638410] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 2.645722] NET: Registered protocol family 2 [ 2.650277] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.659535] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, vmalloc) [ 2.668398] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.676801] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc) [ 2.684376] TCP: Hash tables configured (established 262144 bind 65536) [ 2.691087] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, vmalloc) [ 2.698832] UDP hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.705846] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.713314] NET: Registered protocol family 1 [ 2.717668] NET: Registered protocol family 44 [ 2.722189] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 2.746124] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x627 took 16343 usecs [ 2.765121] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x627 took 11314 usecs [ 2.772526] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 2.778977] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.787359] Unpacking initramfs... [ 3.061116] Freeing initrd memory: 26816K [ 3.065202] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.071636] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 3.079554] ACPI: bus type thunderbolt registered [ 3.085860] Initialise system trusted keyrings [ 3.090317] Key type blacklist registered [ 3.094355] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.102339] zbud: loaded [ 3.105151] pstore: using deflate compression [ 3.109678] Platform Keyring initialized [ 3.151755] NET: Registered protocol family 38 [ 3.156200] Key type asymmetric registered [ 3.160314] Asymmetric key parser 'x509' registered [ 3.165193] Running certificate verification selftests [ 3.195519] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 3.206394] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.213812] io scheduler mq-deadline registered [ 3.218344] io scheduler kyber registered [ 3.222389] io scheduler bfq registered [ 3.226294] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.233504] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.239406] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.245301] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.251168] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.257045] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.262907] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.268781] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.276069] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.284433] ACPI: Power Button [PWRB] [ 3.288119] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.295530] ACPI: Power Button [PWRF] [ 3.300346] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.307854] pstore: Registered erst as persistent store backend [ 3.313865] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.340710] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.368628] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.376291] Non-volatile memory driver v1.3 [ 3.380871] rdac: device handler registered [ 3.385100] hp_sw: device handler registered [ 3.389371] emc: device handler registered [ 3.393547] alua: device handler registered [ 3.397791] libphy: Fixed MDIO Bus: probed [ 3.402044] usbcore: registered new interface driver usbserial_generic [ 3.402166] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.408571] usbserial: USB Serial support registered for generic [ 3.413815] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 3.419809] i8042: PNP: No PS/2 controller found. [ 3.427185] ehci-pci 0000:00:1d.0: debug port 2 [ 3.431917] mousedev: PS/2 mouse device common for all mice [ 3.440303] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.442055] rtc_cmos 00:00: RTC can wake from S4 [ 3.452413] rtc_cmos 00:00: registered as rtc0 [ 3.455031] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.456869] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 3.462628] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.478489] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.485700] usb usb1: Product: EHCI Host Controller [ 3.490572] usb usb1: Manufacturer: Linux 4.18.0-552.el8.x86_64 ehci_hcd [ 3.497263] usb usb1: SerialNumber: 0000:00:1d.0 [ 3.501961] intel_pstate: Intel P-state driver initializing [ 3.501991] hub 1-0:1.0: USB hub found [ 3.511300] hub 1-0:1.0: 2 ports detected [ 3.515476] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.515826] hid: raw HID events driver (C) Jiri Kosina [ 3.520773] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 3.525896] usbcore: registered new interface driver usbhid [ 3.534360] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 3.538833] usbhid: USB HID core driver [ 3.548193] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.548195] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.548228] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 3 [ 3.548241] ehci-pci 0000:00:1a.0: debug port 2 [ 3.551926] drop_monitor: Initializing network drop monitor service [ 3.552156] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.557113] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 3.558036] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.558063] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.558065] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.558066] usb usb3: Product: EHCI Host Controller [ 3.558067] usb usb3: Manufacturer: Linux 4.18.0-552.el8.x86_64 ehci_hcd [ 3.558068] usb usb3: SerialNumber: 0000:00:1a.0 [ 3.558148] hub 3-0:1.0: USB hub found [ 3.558151] hub 3-0:1.0: 2 ports detected [ 3.562370] Initializing XFRM netlink socket [ 3.569708] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 3.574328] NET: Registered protocol family 10 [ 3.580543] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.586375] Segment Routing with IPv6 [ 3.593561] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.593562] usb usb2: Product: xHCI Host Controller [ 3.599343] NET: Registered protocol family 17 [ 3.607567] usb usb2: Manufacturer: Linux 4.18.0-552.el8.x86_64 xhci-hcd [ 3.607568] usb usb2: SerialNumber: 0000:00:14.0 [ 3.607701] hub 2-0:1.0: USB hub found [ 3.614858] mpls_gso: MPLS GSO support [ 3.619733] hub 2-0:1.0: 15 ports detected [ 3.705555] microcode: Microcode Update Driver: v2.2. [ 3.705613] resctrl: L3 allocation detected [ 3.708216] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 4.18 [ 3.710662] resctrl: L3 monitoring detected [ 3.714835] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.723095] AVX2 version of gcm_enc/dec engaged. [ 3.727266] usb usb4: Product: xHCI Host Controller [ 3.734477] AES CTR mode by8 optimization enabled [ 3.744460] sched_clock: Marking stable (3744457368, 0)->(5612176579, -1867719211) [ 3.748656] usb usb4: Manufacturer: Linux 4.18.0-552.el8.x86_64 xhci-hcd [ 3.754048] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 3.769436] usb usb4: SerialNumber: 0000:00:14.0 [ 3.774104] registered taskstats version 1 [ 3.774176] hub 4-0:1.0: USB hub found [ 3.781954] hub 4-0:1.0: 6 ports detected [ 3.786072] Loading compiled-in X.509 certificates [ 3.791171] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: b8c8c7a1297a11ed2e36e7913cdfd6f59248d125' [ 3.802045] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 3.813852] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 3.824472] zswap: loaded using pool lzo/zbud [ 3.826035] usb 3-1: new high-speed USB device number 2 using ehci-pci [ 3.835390] page_owner is disabled [ 3.842440] Key type big_key registered [ 3.847963] Key type encrypted registered [ 3.851972] ima: No TPM chip found, activating TPM-bypass! [ 3.857456] ima: Allocated hash algorithm: sha256 [ 3.862167] ima: No architecture policies found [ 3.866699] evm: Initialising EVM extended attributes: [ 3.871836] evm: security.selinux [ 3.875155] evm: security.ima [ 3.878129] evm: security.capability [ 3.881702] evm: HMAC attrs: 0x1 [ 3.885192] rtc_cmos 00:00: setting system clock to 2024-04-26 11:18:43 UTC (1714130323) [ 3.893555] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 3.901730] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.909098] hub 1-1:1.0: USB hub found [ 3.909199] Freeing unused decrypted memory: 2028K [ 3.917638] hub 1-1:1.0: 8 ports detected [ 3.922058] Freeing unused kernel image (initmem) memory: 2820K [ 3.938114] Write protecting the kernel read-only data: 26624k [ 3.944340] Freeing unused kernel image (text/rodata gap) memory: 2016K [ 3.951202] Freeing unused kernel image (rodata/data gap) memory: 1672K [ 3.967167] systemd[1]: systemd 239 (239-75.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.989812] usb 3-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 3.997983] usb 3-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.001063] systemd[1]: Detected architecture x86-64. [ 4.005117] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 4.010172] systemd[1]: Running in initial RAM disk. [ 4.021834] hub 3-1:1.0: USB hub found [ 4.025690] hub 3-1:1.0: 6 ports detected Welcome to CentOS Stream 8 dracut-049-224.git20230330.el8 (Initramfs)! [ 4.051144] systemd[1]: Set hostname to . [ 4.087703] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 4.100095] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ 4.110251] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 4.122132] systemd[1]: Reached target Timers. [ OK ] Reached targ[ 4.128052] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 4.135554] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 4.143241] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 4.153813] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 et Timers. [ 4.161064] clocksource: Switched to clocksource tsc [ 4.161547] hub 2-12:1.0: USB hub found [ 4.167052] systemd[1]: Reached target Slices. [ 4.170932] hub 2-12:1.0: 4 ports detected [ OK ] Reached target Slices. [ 4.185120] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ OK ] Listening on udev Kernel Socket. [ OK ] Listening on Journal Socket. Starting Setup Virtual Console... [ OK ] Reached target Sockets. Starting Load Kernel Modules... Starting Journal Service... [ 4.234659] fuse: init (API version 7.34) Starting Create list of required st…ce nodes for the current kernel... Starting Create Volatile Files and Directories... [ OK ] Started Memstrack Anylazing Service. [ OK ] Started Load Kernel Modules. [ OK ] Started Journal Service. [ OK ] Started Setup Virtual Console. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... Starting Apply Kernel Variables... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Apply Kernel Variables. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ OK [. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ 4.468034] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... [ OK ] Reached target System Initialization. Starting Show Plymouth Boot Screen... [ 4.540760] dca service started, version 1.12.1 [ OK ] Started Show Plymouth Boot Screen. [ OK ] Started Forward Password Requests t[ 4.565164] igb: Intel(R) Gigabit Ethernet Network Driver o Plymouth Direc[ 4.572038] igb: Copyright (c) tion. tory Watch. [[ 4.579245] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [0;32m OK [ 4.588815] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 ] Reached target[ 4.597823] nvme nvme0: pci function 0000:02:00.0 Paths. [[0;3[ 4.597973] ixgbe: Intel(Rit PCI Express Network Driver [ 4.605676] nvme nvme0: 8/0/0 default/read/poll queues 2m OK ] Re[ 4.606623] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 4.611152] ixgbe: Copyright (c) 1999-2016 Intel Corporation. ached target Bas[ 4.617008] nvme0n1: detected capacity change from 0 to 400088457216 ic System. [ 4.643017] ACPI: bus type drm_connector registered [ 4.648650] igb 0000:07:00.0: added PHC on eth0 [ 4.653326] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network C [ 4.658148] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 4.660198] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:da:f4 [ 4.660790] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 4.660853] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 4.672125] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 4.679127] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 4.690683] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.702139] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.739481] scsi host0: ahci [ 4.742548] scsi host1: ahci [ 4.745619] scsi host2: ahci [ 4.748612] scsi host3: ahci [ 4.751553] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 53 [ 4.751713] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 4.756514] igb 0000:07:00.1: added PHC on eth1 [ 4.756541] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 4.756542] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:da:f5 [ 4.756618] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 4.756619] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.758944] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 53 [ 4.759972] igb 0000:07:00.0 eno1: renamed from eth0 [ 4.765464] ast 0000:06:00.0: [drm] AST 2400 detected [ 4.769994] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 53 [ 4.769996] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 53 [ 4.776882] ast 0000:06:00.0: [drm] Using analog VGA [ 4.784207] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 4.789129] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 4.796684] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.804216] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 4.825317] scsi host4: ahci [ 4.830286] igb 0000:07:00.1 eno2: renamed from eth1 [ 4.833938] scsi host5: ahci [ 4.874081] fbcon: astdrmfb (fb0) is primary device [ 4.874198] scsi host6: ahci [ 4.874320] scsi host7: ahci [ 4.874429] scsi host8: ahci [ 4.874554] scsi host9: ahci [ 4.874611] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 63 [ 4.874616] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 63 [ 4.874617] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 63 [ 4.874619] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 63 [ 4.874621] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 63 [ 4.874623] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 63 [ 4.923300] Console: switching to colour frame buffer device 128x48 [ 5.026481] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 5.093305] ata1: SATA link down (SStatus 0 SControl 300) [ 5.098719] ata4: SATA link down (SStatus 0 SControl 300) [ 5.104134] ata2: SATA link down (SStatus 0 SControl 300) [ 5.104165] ata3: SATA link down (S[ 5.181081] ata5: SATA link up 3.0 Gbps (SStatus 123 SControl 300) [ 5.187272] ata10: SATA link down (SStatus 0 SControl 300) [ 5.192766] ata9: SATA link down (SStatus 0 SControl 300) [ 5.198172] ata8: SATA link down (SStatus 0 SControl 300) [ 5.203581] ata6: SATA link down (SStatus 0 SControl 300) [ 5.208989] ata7: SATA link down (SStatus 0 SControl 300) [ 5.214736] ata5.00: ATA-7: HUA721010KLA330, GKAOA94A, max UDMA/133 [ 5.220999] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.229197] ata5.00: confi[ 5.233607] st-Access ATA HUA721010KLA330 A94A PQ: 0 ANSI: 5 [ 5.247281] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.256242] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.263902] sd 4:0:0:0: [sda] Write Protect is off [ 5.268698] sd 4:0:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA [ 5.286660] sda: sda1 [ 5.289242] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device HUA721010KLA330 1. [ OK ] Reached target Initrd Root Device. [ 5.781347] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.791627] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 5.800140] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 5.806317] ixgbe 0000:03:00.0: 0c:c4:7a:8f:b7:64 [ 5.814345] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 5.820971] libphy: ixgbe-mdio: probed [ 5.981123] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.991395] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 5.999900] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.006945] ixgbe 0000:03:00.1: 0c:c4:7a:8f:b7:65 [ 6.014922] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.021502] libphy: ixgbe-mdio: probed [ 6.026133] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 6.037240] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting File System Check on /dev/…ddf-553d-41ea-8bce-5708f99a0430... [ OK ] Started File System Check on /dev/d…36ddf-553d-41ea-8bce-5708f99a0430. Mounting /sysroot... [ 6.219593] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Starting Setup Virtual Console... Starting Plymouth switch root service... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Basic System. [ OK ] Stopped target System Initialization. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Paths. Stopping udev Kernel Device Manager... [ OK ] Stopped target Sockets. [ OK ] Stopped target Slices. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped target Swap. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Started Setup Virtual Console. [ OK ] Reached target Switch Root. [ OK ] Started Plymouth switch root service. Starting Switch Root... [ 6.687502] printk: systemd: 11 output lines suppressed due to ratelimiting [ 7.691245] SELinux: policy capability network_peer_controls=1 [ 7.697169] SELinux: policy capability open_perms=1 [ 7.702132] SELinux: policy capability extended_socket_class=1 [ 7.708040] SELinux: policy capability always_check_network=0 [ 7.713867] SELinux: policy capability cgroup_seclabel=1 [ 7.719258] SELinux: policy capability nnp_nosuid_transition=1 [ 7.746132] audit: type=1403 audit(1714130327.359:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 7.747923] systemd[1]: Successfully loaded SELinux policy in 303.166ms. [ 7.857846] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 19.795ms. [ 7.888641] systemd[1]: systemd 239 (239-75.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 7.923161] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 8! [ 7.947226] systemd[1]: Set hostname to . [ 9.571335] systemd[1]: initrd-switch-root.service: Succeeded. [ 9.577408] systemd[1]: Stopped Switch Root. [ OK [[ 9.582090] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. 0m] Stopped Swit[ 9.593712] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. ch Root. [ 9.603971] systemd[1]: Stopped Journal Service. [ OK [[ 9.610511] systemd[1]: Starting Journal Service... 0m] Stopped Jour[ 9.616128] systemd[1]: Listening on initctl Compatibility Named Pipe. nal Service. Starting Journal Service... [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on Process Core Dump Socket. [ OK ] Stopped Plymouth switch root service. [ OK ] Reached target ceph target allowing…mirror@.service instances at once. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Created slice system-sshd\x2dkeygen.slice. Mounting Huge Pages File System... Mounting Kernel Debug File System... Starting Create list of required st…ce nodes for the current kernel... Mounting POSIX Message Queue File System... [ OK ] Created slice system-getty.slice. [ OK ] Reached target Swap. Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Reached target ceph target allowing…ph-mon@.service instances at once. [ OK ] Reached target ceph target allowing…ph-osd@.service instances at once. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Created slice User and Session Slice. [ OK ] Set up automount Arbitrary Executab…rmats File System Automount Point. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Reached target ceph target allowing…ph-mgr@.service instances at once. [ OK ] Reached targ[ 9.789803] EXT4-fs (sda1): re-mounted. Opts: (null) et Slices. [ OK ] Reached target ceph target allowing…ph-mds@.service instances at once. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Paths. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd Root File System. [ OK ] Stopped target Initrd File Systems. Starting Setup Virtual Console... Starting Remount Root and Kernel File Systems... [ OK ] Listening on udev Kernel Socket. [ OK ] Listening on udev Control Socket. Starting Load Kernel Modules... Starting Monitoring of LVM2 mirrors…ng dmeventd or progress polling... [ OK ] Reached target ceph target allowing…adosgw@.service instances at once. Starting udev Coldplug all Devices... [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Started Remount Root and Kernel File Systems. Starting Load/Save Random Seed... Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Load/Save Random Seed. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Load Kernel Modules. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ 10.331023] device-mapper: uevent: version 1.0.3 [ 10.335744] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started Monitoring of LVM2 mirrors,…sing dmeventd or progress polling. [ OK ] Started Apply Kernel Variables. [ OK ] Started Setup Virtual Console. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Import network configuration from initramfs... Starting Tell Plymouth To Write Out Runtime Data... [ OK ] Started Tell Plymouth To Write Out Runtime Data. [ 10.978441] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 10.984443] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ OK ] Started Import network configuration from in[ 10.995360] igb 0000:07:00.0: DCA enabled itramfs. [ 11.000787] igb 0000:07:00.1: DCA enabled Starting Cre[ 11.006300] IPMI message handler: version 39.2 ate Volatile Files and Directories... [ 11.023926] ipmi device interface [ 11.049192] power_meter ACPI000D:00: Found ACPI power meter. [ 11.054985] ipmi_si: IPMI System Interface driver [ 11.055035] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 11.059741] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 11.072811] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 11.080041] ipmi_si: Adding SMBIOS-specified kcs state machine [ 11.085925] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 11.091870] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 11.100601] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 11.109338] ipmi_si: Adding ACPI-specified kcs state machine [ 11.115087] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 11.199838] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 11.202005] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 11.217374] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 11.246659] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ OK ] Created slice system-lvm2\x2dpvscan.slice. Starting LVM event activation on device 259:0... [ 11.301156] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 11.335004] ipmi_ssif: IPMI SSIF Interface driver [ 11.342103] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 11.342105] RAPL PMU: hw unit of domain package 2^-14 Joules [ 11.342106] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 11.383880] iTCO_vendor_support: vendor-support=0 [ 11.406196] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 [ 11.411815] iTCO_wdt: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 11.420141] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ OK ] Started LVM event activation on device 259:0. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Mounting RPC Pipe File System... Starting Security Auditing Service... [ 11.919286] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 11.930230] EDAC sbridge: Ver: 1.1.2 [ 11.953966] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 11.961861] XFS (dm-4): Mounting V4 Filesystem [ 11.971536] XFS (dm-4): Ending clean mount [ OK ] Mounted /var/lib/ceph. [ 12.059626] RPC: Registered named UNIX socket transport module. [ 12.065549] RPC: Registered udp transport module. [ 12.070253] RPC: Registered tcp transport module. [ 12.074955] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ 12.160143] intel_rapl_common: Found RAPL domain package [ 12.165476] intel_rapl_common: Found RAPL domain dram [ 12.170528] intel_rapl_common: DRAM domain energy unit 15300pj [ OK ] Started Security Auditing Service. Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Reached target System Initialization. [ OK ] Started Updates mlocate database every day. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting Self Monitoring and Reporting Technology (SMART) Daemon... [ OK ] Started Machine Check Exception Logging Daemon. [ OK ] Started D-Bus System Message Bus. Starting VDO volume services... Starting Kernel Samepage Merging... Starting Restore /run/initramfs on shutdown... Starting Resets System Activity Logs... Starting Authorization Manager... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. Starting NTP client/server... [ OK ] Reached target User and Group Name Lookups. [ OK ] Reached target sshd-keygen.target. Starting Login Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowing… ceph*@.service instances at once. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Reached target Timers. Starting Network Manager... [ OK ] Started Kernel Samepage Merging. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Resets System Activity Logs. Starting Kernel Samepage Merging (KSM) Tuning Daemon... [ OK ] Started Login Service. [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Started Kernel Samepage Merging (KSM) Tuning Daemon. [ OK ] Started NTP client/server. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... Starting GSSAPI Proxy Daemon... Starting Network Manager Wait Online... Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Started OpenSSH server daemon. [ OK ] Started Authorization Manager. Starting Network Manager Script Dispatcher Service... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Permit User Sessions. [ OK ] Started Command Scheduler. [ OK ] Started Job spooling tools. [ 17.286186] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 17.343191] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 17.351211] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 17.407992] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 17.415782] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 17.458948] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 17.569145] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 17.577478] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 17.618970] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 17.729264] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 17.840216] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ 17.936172] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 17.944011] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started VDO volume services. [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting /etc/rc.d/rc.local Compatibility... Starting System Logging Service... Starting Notify NFS peers of a restart... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Started Nagios Remote Plugin Executor. Starting Crash recovery kernel arming... [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.72 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. + '[' 172.21.15.72 '!=' '' ']' + set -e + '[' -n 172.21.15.72 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.72 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.72 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi072.front.sepia.ceph.com + '[' -n smithi072.front.sepia.ceph.com ']' + hostname smithi072.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi072 + echo smithi072 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.72 smithi072.front.sepia.ceph.com smithi072/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... Starting SETroubleshoot daemon for …cessing new SELinux denial logs... CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T11:19:08.407 DEBUG:teuthology.orchestra.console.smithi072:expect after: smithi072 login: 2024-04-26T11:19:08.459 DEBUG:teuthology.orchestra.console.smithi072:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el(R) Boot t GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Initializing Intel(R) Boot Agent GE v1.5.13 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F B7 65 GUID: 00000000 0000 0000 0000 0CC47AD8DAF4 DHCP.\                    DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\  21.15.72 MAS 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.72 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:b7:65)... Configuring (net0 0c:c4:7a:8f:b7:65).... Configuring (net0 0c:c4:7a:8f:b7:65)..... Configuring (net0 0c:c4:7a:8f:b7:65)...... ok .   [?25lUse the ^ and v keys to change the selection. edit the selecta command prompt4;1H CentOS Stream (4.18.0-552.el8.x86_64) 8  CentOS Stream (4.18.0-489.el8.x86_64) 8  CentOS Stream (4.18.0-348.el8.x86_64) 8  CentOS Stream (0-rescue-a1b29d6c289747bdb22930598d39874a) 8              The selected entry will be started automatically in 5s.  CentOS Stream (4.18.0-552.el8.x86_64) 8   CentOS Stream (4.18.0-489.el8.x86_64) 8  CentOS Stream (4.18.0-348.el8.x86_64) 8  CentOS Stream (0-rescue-a1b29d6c289747bdb22930598d39874a) 8          The selected entry will be started automatically in 4s.    Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.   The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 4.18.0-552.el8.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-21) (GCC)) #1 SMP Sun Apr 7 19:39:51 UTC 2024 [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-552.el8.x86_64 root=UUID=c5236ddf-553d-41ea-8bce-5708f99a0430 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078e70fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f23000-0x00000000798acfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ad000-0x0000000079d49fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4a000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.713 MHz processor [ 0.000000] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0x78e71 max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.000000] Using GB pages for direct mapping [ 0.000000] RAMDISK: [mem 0x34b91000-0x365c0fff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.000000] ACPI: XSDT 0x00000000798AD098 0000B4 (v01 01072009 AMI 00010013) [ 0.000000] ACPI: FACP 0x00000000798E05B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: DSDT 0x00000000798AD1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.000000] ACPI: FACS 0x0000000079D48F80 000040 [ 0.000000] ACPI: APIC 0x00000000798E06C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FPDT 0x00000000798E0788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FIDT 0x00000000798E07D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: SPMI 0x00000000798E0870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.000000] ACPI: MCFG 0x00000000798E08B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.000000] ACPI: UEFI 0x00000000798E08F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.000000] ACPI: HPET 0x00000000798E0938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: WDDT 0x00000000798E0970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.000000] ACPI: SSDT 0x00000000798E09B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798F7B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798FA180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.000000] ACPI: PRAD 0x00000000798FA1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.000000] ACPI: DMAR 0x00000000798FA2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: HEST 0x00000000798FA3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 0x00000000798FA630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 0x00000000798FA660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 0x00000000798FA890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0x798e05b0-0x798e06bb] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0x798ad1e8-0x798e05ab] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0x79d48f80-0x79d48fbf] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0x798e06c0-0x798e0787] [ 0.000000] ACPI: Reserving FPDT table memory at [mem 0x798e0788-0x798e07cb] [ 0.000000] ACPI: Reserving FIDT table memory at [mem 0x798e07d0-0x798e086b] [ 0.000000] ACPI: Reserving SPMI table memory at [mem 0x798e0870-0x798e08af] [ 0.000000] ACPI: Reserving MCFG table memory at [mem 0x798e08b0-0x798e08eb] [ 0.000000] ACPI: Reserving UEFI table memory at [mem 0x798e08f0-0x798e0931] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0x798e0938-0x798e096f] [ 0.000000] ACPI: Reserving WDDT table memory at [mem 0x798e0970-0x798e09af] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798e09b0-0x798f7b2e] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798f7b30-0x798fa17b] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798fa180-0x798fa1e3] [ 0.000000] ACPI: Reserving PRAD table memory at [mem 0x798fa1e8-0x798fa2e9] [ 0.000000] ACPI: Reserving DMAR table memory at [mem 0x798fa2f0-0x798fa3ab] [ 0.000000] ACPI: Reserving HEST table memory at [mem 0x798fa3b0-0x798fa62b] [ 0.000000] ACPI: Reserving BERT table memory at [mem 0x798fa630-0x798fa65f] [ 0.000000] ACPI: Reserving ERST table memory at [mem 0x798fa660-0x798fa88f] [ 0.000000] ACPI: Reserving EINJ table memory at [mem 0x798fa890-0x798fa9bf] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.000000] Using crashkernel=auto, the size chosen is a best effort estimation. [ 0.000000] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32653MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.000000] node 0: [mem 0x0000000000100000-0x0000000078e70fff] [ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Zeroed struct page in unavailable ranges: 29189 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.000000] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78e71000-0x78f22fff] [ 0.000000] PM: Registered nosave memory: [mem 0x78f23000-0x798acfff] [ 0.000000] PM: Registered nosave memory: [mem 0x798ad000-0x79d49fff] [ 0.000000] PM: Registered nosave memory: [mem 0x79d4a000-0x8fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.000000] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 8228663 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-552.el8.x86_64 root=UUID=c5236ddf-553d-41ea-8bce-5708f99a0430 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] software IO TLB: area num 8. [ 0.000000] Memory: 1756420K/33437676K available (14339K kernel code, 5957K rwdata, 8568K rodata, 2820K init, 13792K bss, 935740K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.000000] Kernel/User page tables isolation: enabled [ 0.000000] ftrace: allocating 41053 entries in 161 pages [ 0.000000] ftrace: allocated 161 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.000000] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.000000] random: crng done (trusting CPU's manufacturer) [ 0.001000] Console: colour VGA+ 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 0.001000] APIC: Switch to symmetric I/O mode setup [ 0.001003] DMAR: Host address width 46 [ 0.002001] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 0.003004] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 0.004001] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 0.005002] DMAR: ATSR flags: 0x0 [ 0.006001] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 0.007002] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 0.008001] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 0.009001] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 0.010001] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 0.010002] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 0.013035] DMAR-IR: Enabled IRQ remapping in xapic mode [ 0.014000] x2apic: IRQ remapping doesn't support X2APIC mode [ 0.014482] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.019001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327241f2b7c, max_idle_ns: 440795226326 ns [ 0.020001] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.42 BogoMIPS (lpj=3499713) [ 0.021000] pid_max: default: 32768 minimum: 301 [ 0.022022] LSM: Security Framework initializing [ 0.023008] Yama: becoming mindful. [ 0.024004] SELinux: Initializing. [ 0.025021] LSM support for eBPF active [ 0.030413] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, vmalloc) [ 0.033672] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, vmalloc) [ 0.034076] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.035071] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.036204] CPU0: Thermal monitoring enabled (TM1) [ 0.037055] process: using mwait in idle threads [ 0.038001] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 0.039000] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 0.040002] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.041001] Spectre V2 : Mitigation: Retpolines [ 0.042000] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.043000] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 0.044000] Speculative Store Bypass: Vulnerable [ 0.045004] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.046000] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.047000] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.058813] Freeing SMP alternatives memory: 36K [ 0.059188] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 0.162558] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 0.164094] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 0.165001] ... version: 3 [ 0.166000] ... bit width: 48 [ 0.167000] ... generic registers: 4 [ 0.168000] ... value mask: 0000ffffffffffff [ 0.169000] ... max period: 00007fffffffffff [ 0.170000] ... fixed-purpose events: 3 [ 0.171000] ... event mask: 000000070000000f [ 0.172028] rcu: Hierarchical SRCU implementation. [ 0.174042] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 0.176009] smp: Bringing up secondary CPUs ... [ 0.177067] x86: Booting SMP configuration: [ 0.178002] .... node #0, CPUs: #1 #2 #3 #4 [ 0.181097] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 0.183000] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 0.184001] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 0.185089] #5 #6 #7 [ 0.186539] smp: Brought up 1 node, 8 CPUs [ 0.188000] smpboot: Max logical packages: 1 [ 0.189001] smpboot: Total of 8 processors activated (55995.40 BogoMIPS) [ 0.225169] node 0 deferred pages initialised in 34ms [ 0.231500] devtmpfs: initialized [ 0.232040] x86/mm: Memory block size: 128MB [ 0.235018] ACPI: PM: Registering ACPI NVS region [mem 0x798ad000-0x79d49fff] (4837376 bytes) [ 0.243082] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.253007] futex hash table entries: 2048 (order: 5, 131072 bytes, vmalloc) [ 0.260058] pinctrl core: initialized pinctrl subsystem [ 0.265115] NET: Registered protocol family 16 [ 0.270076] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 0.277012] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.285009] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.293018] audit: initializing netlink subsys (disabled) [ 0.298009] audit: type=2000 audit(1714130318.298:1): state=initialized audit_enabled=0 res=1 [ 0.307002] cpuidle: using governor menu [ 0.311028] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.318002] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.325049] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 0.334001] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 0.341013] PCI: Using configuration type 1 for base access [ 0.348011] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.355001] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.361023] cryptd: max_cpu_qlen set to 1000 [ 0.366053] ACPI: Added _OSI(Module Device) [ 0.367002] ACPI: Added _OSI(Processor Device) [ 0.371001] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.376000] ACPI: Added _OSI(Processor Aggregator Device) [ 0.406851] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 0.415760] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 0.425088] ACPI: Dynamic OEM Table Load: [ 0.442976] ACPI: Interpreter enabled [ 0.447010] ACPI: PM: (supports S0 S4 S5) [ 0.451000] ACPI: Using IOAPIC for interrupt routing [ 0.457892] HEST: Enabling Firmware First mode for corrected errors. [ 0.464073] HEST: Table parsing has been initialized. [ 0.469115] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 0.477002] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.486311] ACPI: Enabled 5 GPEs in block 00 to 3F [ 0.514770] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 0.521004] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.532563] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.541532] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.549000] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.557027] PCI host bridge to bus 0000:ff [ 0.561001] pci_bus 0000:ff: root bus resource [bus ff] [ 0.566010] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 0.572044] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 0.578032] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 0.584032] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 0.591027] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 0.597032] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 0.603030] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 0.609030] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 0.615031] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 0.621031] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 0.627031] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 0.633038] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 0.639035] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 0.645032] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 0.651031] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 0.657031] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 0.663030] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 0.669030] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 0.675031] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 0.681023] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 0.687037] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 0.693059] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 0.699043] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 0.705039] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 0.711043] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 0.717041] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 0.723040] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 0.729033] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 0.735035] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 0.741043] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 0.747042] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 0.754046] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 0.760041] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 0.766034] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 0.772033] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 0.778032] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 0.784033] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 0.790043] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 0.796041] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 0.802043] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 0.808044] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 0.814037] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 0.820024] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 0.826034] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 0.832036] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 0.838032] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 0.844032] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 0.850032] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 0.856035] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 0.862032] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 0.868032] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 0.874032] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 0.880023] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 0.886025] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 0.892032] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 0.900595] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 0.907002] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.916137] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.924288] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.932001] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.941505] PCI host bridge to bus 0000:00 [ 0.945001] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.952000] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 0.959000] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.966000] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 0.974000] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 0.981000] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 0.989001] pci_bus 0000:00: root bus resource [bus 00-fe] [ 0.994025] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 1.000096] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 1.006042] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.012086] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 1.018041] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.025086] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 1.031041] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.037079] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 1.043005] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.050079] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 1.056007] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 1.063076] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 1.069008] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 1.075079] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 1.081007] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 1.088076] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 1.094007] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.101074] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 1.107008] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 1.114080] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 1.120007] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 1.127078] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 1.133007] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 1.140075] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 1.146064] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 1.152082] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 1.158057] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 1.164004] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 1.170061] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 1.176160] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 1.182011] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 1.188006] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 1.194006] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 1.199006] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 1.205007] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 1.210006] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 1.217028] pci 0000:00:11.4: PME# supported from D3hot [ 1.222074] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 1.228013] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 1.235050] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.241091] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 1.247014] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 1.254051] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.260057] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 1.266013] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 1.272051] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.279069] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 1.285013] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 1.291043] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.297072] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 1.303065] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.309076] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 1.315066] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.322076] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 1.328066] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.334093] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 1.340014] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 1.346074] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.352050] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 1.358157] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 1.365009] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 1.370005] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 1.376005] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 1.381005] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 1.387005] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 1.392005] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 1.399029] pci 0000:00:1f.2: PME# supported from D3hot [ 1.404064] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 1.410014] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 1.417016] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 1.422162] acpiphp: Slot [1] registered [ 1.427013] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.431111] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 1.438009] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 1.444016] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 1.451003] pci 0000:02:00.0: enabling Extended Tags [ 1.456091] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.461003] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.468061] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 1.474009] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.481004] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 1.487009] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.494004] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 1.501036] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.507016] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.514000] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.524008] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.532000] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.542082] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 1.548010] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.555004] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 1.561009] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.568004] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 1.575037] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.581013] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.588001] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.599009] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.606000] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.616080] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.621002] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.627001] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.634002] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.642030] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.647060] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 1.653044] pci 0000:05:00.0: enabling Extended Tags [ 1.658069] pci 0000:05:00.0: supports D1 D2 [ 1.662000] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.669054] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.674002] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.680002] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.687042] pci_bus 0000:06: extended config space not accessible [ 1.693030] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 1.699022] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 1.705012] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 1.712012] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 1.717096] pci 0000:06:00.0: supports D1 D2 [ 1.722000] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.728110] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.733006] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.739003] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.746082] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 1.752017] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 1.759018] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 1.764009] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 1.770076] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.777035] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.784000] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.794021] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.801001] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.812098] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 1.818018] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 1.824018] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 1.830009] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 1.836115] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.842034] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.849000] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.860021] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.867000] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.877152] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.882002] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.888002] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.895003] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.902515] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.908033] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.914031] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.920030] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.926030] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.932000] ACPI: PCI: Interrupt link LNKE disabled [ 1.937030] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.943000] ACPI: PCI: Interrupt link LNKF disabled [ 1.948030] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.954000] ACPI: PCI: Interrupt link LNKG disabled [ 1.959024] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.965001] ACPI: PCI: Interrupt link LNKH disabled [ 1.970224] iommu: Default domain type: Passthrough [ 1.975075] SCSI subsystem initialized [ 1.979017] ACPI: bus type USB registered [ 1.983011] usbcore: registered new interface driver usbfs [ 1.988005] usbcore: registered new interface driver hub [ 1.993007] usbcore: registered new device driver usb [ 1.999018] pps_core: LinuxPPS API ver. 1 registered [ 2.004000] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.013002] PTP clock support registered [ 2.017014] EDAC MC: Ver: 3.0.0 [ 2.020108] PCI: Using ACPI for IRQ routing [ 2.028989] NetLabel: Initializing [ 2.033000] NetLabel: domain hash size = 128 [ 2.037000] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.043010] NetLabel: unlabeled traffic allowed by default [ 2.048016] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.053000] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.063001] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.069000] vgaarb: loaded [ 2.071038] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.078001] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.085030] clocksource: Switched to clocksource tsc-early [ 2.100569] VFS: Disk quotas dquot_6.6.0 [ 2.104498] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.111422] pnp: PnP ACPI init [ 2.114811] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.120723] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.126635] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.132546] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.138456] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.144373] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.150288] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.156891] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.163496] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.170100] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.176706] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.183311] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.189917] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.196690] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.202605] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.208516] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.214427] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.220338] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.226924] pnp: PnP ACPI: found 5 devices [ 2.236385] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 2.245290] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 2.256760] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 2.264579] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.269539] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.274502] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.281285] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.288848] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.296753] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.304395] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.312389] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.319946] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.327852] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.335496] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.343487] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.351046] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.358952] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.366595] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.374588] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.382145] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.390049] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.397693] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.405686] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.410645] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.416730] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.423506] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.431240] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.436204] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.441163] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.447252] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.454043] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.459262] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.465347] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.472128] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 2.479865] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 2.487685] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 2.495425] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 2.503253] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.508215] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.514301] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.521079] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 2.528813] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 2.537848] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 2.544019] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 2.550190] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 2.557055] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 2.563920] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 2.570785] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 2.577651] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 2.583910] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 2.589473] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 2.595731] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.602942] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 2.608506] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.614765] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 2.620330] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.626588] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 2.632151] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 2.638410] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 2.645722] NET: Registered protocol family 2 [ 2.650277] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.659535] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, vmalloc) [ 2.668398] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.676801] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc) [ 2.684376] TCP: Hash tables configured (established 262144 bind 65536) [ 2.691087] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, vmalloc) [ 2.698832] UDP hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.705846] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.713314] NET: Registered protocol family 1 [ 2.717668] NET: Registered protocol family 44 [ 2.722189] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 2.746124] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x627 took 16343 usecs [ 2.765121] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x627 took 11314 usecs [ 2.772526] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 2.778977] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.787359] Unpacking initramfs... [ 3.061116] Freeing initrd memory: 26816K [ 3.065202] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.071636] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 3.079554] ACPI: bus type thunderbolt registered [ 3.085860] Initialise system trusted keyrings [ 3.090317] Key type blacklist registered [ 3.094355] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.102339] zbud: loaded [ 3.105151] pstore: using deflate compression [ 3.109678] Platform Keyring initialized [ 3.151755] NET: Registered protocol family 38 [ 3.156200] Key type asymmetric registered [ 3.160314] Asymmetric key parser 'x509' registered [ 3.165193] Running certificate verification selftests [ 3.195519] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 3.206394] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.213812] io scheduler mq-deadline registered [ 3.218344] io scheduler kyber registered [ 3.222389] io scheduler bfq registered [ 3.226294] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.233504] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.239406] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.245301] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.251168] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.257045] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.262907] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.268781] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.276069] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.284433] ACPI: Power Button [PWRB] [ 3.288119] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.295530] ACPI: Power Button [PWRF] [ 3.300346] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.307854] pstore: Registered erst as persistent store backend [ 3.313865] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.340710] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.368628] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.376291] Non-volatile memory driver v1.3 [ 3.380871] rdac: device handler registered [ 3.385100] hp_sw: device handler registered [ 3.389371] emc: device handler registered [ 3.393547] alua: device handler registered [ 3.397791] libphy: Fixed MDIO Bus: probed [ 3.402044] usbcore: registered new interface driver usbserial_generic [ 3.402166] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.408571] usbserial: USB Serial support registered for generic [ 3.413815] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 3.419809] i8042: PNP: No PS/2 controller found. [ 3.427185] ehci-pci 0000:00:1d.0: debug port 2 [ 3.431917] mousedev: PS/2 mouse device common for all mice [ 3.440303] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.442055] rtc_cmos 00:00: RTC can wake from S4 [ 3.452413] rtc_cmos 00:00: registered as rtc0 [ 3.455031] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.456869] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 3.462628] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.478489] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.485700] usb usb1: Product: EHCI Host Controller [ 3.490572] usb usb1: Manufacturer: Linux 4.18.0-552.el8.x86_64 ehci_hcd [ 3.497263] usb usb1: SerialNumber: 0000:00:1d.0 [ 3.501961] intel_pstate: Intel P-state driver initializing [ 3.501991] hub 1-0:1.0: USB hub found [ 3.511300] hub 1-0:1.0: 2 ports detected [ 3.515476] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.515826] hid: raw HID events driver (C) Jiri Kosina [ 3.520773] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 3.525896] usbcore: registered new interface driver usbhid [ 3.534360] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 3.538833] usbhid: USB HID core driver [ 3.548193] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.548195] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.548228] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 3 [ 3.548241] ehci-pci 0000:00:1a.0: debug port 2 [ 3.551926] drop_monitor: Initializing network drop monitor service [ 3.552156] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.557113] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 3.558036] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.558063] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.558065] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.558066] usb usb3: Product: EHCI Host Controller [ 3.558067] usb usb3: Manufacturer: Linux 4.18.0-552.el8.x86_64 ehci_hcd [ 3.558068] usb usb3: SerialNumber: 0000:00:1a.0 [ 3.558148] hub 3-0:1.0: USB hub found [ 3.558151] hub 3-0:1.0: 2 ports detected [ 3.562370] Initializing XFRM netlink socket [ 3.569708] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 3.574328] NET: Registered protocol family 10 [ 3.580543] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.586375] Segment Routing with IPv6 [ 3.593561] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.593562] usb usb2: Product: xHCI Host Controller [ 3.599343] NET: Registered protocol family 17 [ 3.607567] usb usb2: Manufacturer: Linux 4.18.0-552.el8.x86_64 xhci-hcd [ 3.607568] usb usb2: SerialNumber: 0000:00:14.0 [ 3.607701] hub 2-0:1.0: USB hub found [ 3.614858] mpls_gso: MPLS GSO support [ 3.619733] hub 2-0:1.0: 15 ports detected [ 3.705555] microcode: Microcode Update Driver: v2.2. [ 3.705613] resctrl: L3 allocation detected [ 3.708216] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 4.18 [ 3.710662] resctrl: L3 monitoring detected [ 3.714835] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.723095] AVX2 version of gcm_enc/dec engaged. [ 3.727266] usb usb4: Product: xHCI Host Controller [ 3.734477] AES CTR mode by8 optimization enabled [ 3.744460] sched_clock: Marking stable (3744457368, 0)->(5612176579, -1867719211) [ 3.748656] usb usb4: Manufacturer: Linux 4.18.0-552.el8.x86_64 xhci-hcd [ 3.754048] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 3.769436] usb usb4: SerialNumber: 0000:00:14.0 [ 3.774104] registered taskstats version 1 [ 3.774176] hub 4-0:1.0: USB hub found [ 3.781954] hub 4-0:1.0: 6 ports detected [ 3.786072] Loading compiled-in X.509 certificates [ 3.791171] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: b8c8c7a1297a11ed2e36e7913cdfd6f59248d125' [ 3.802045] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 3.813852] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 3.824472] zswap: loaded using pool lzo/zbud [ 3.826035] usb 3-1: new high-speed USB device number 2 using ehci-pci [ 3.835390] page_owner is disabled [ 3.842440] Key type big_key registered [ 3.847963] Key type encrypted registered [ 3.851972] ima: No TPM chip found, activating TPM-bypass! [ 3.857456] ima: Allocated hash algorithm: sha256 [ 3.862167] ima: No architecture policies found [ 3.866699] evm: Initialising EVM extended attributes: [ 3.871836] evm: security.selinux [ 3.875155] evm: security.ima [ 3.878129] evm: security.capability [ 3.881702] evm: HMAC attrs: 0x1 [ 3.885192] rtc_cmos 00:00: setting system clock to 2024-04-26 11:18:43 UTC (1714130323) [ 3.893555] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 3.901730] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 3.909098] hub 1-1:1.0: USB hub found [ 3.909199] Freeing unused decrypted memory: 2028K [ 3.917638] hub 1-1:1.0: 8 ports detected [ 3.922058] Freeing unused kernel image (initmem) memory: 2820K [ 3.938114] Write protecting the kernel read-only data: 26624k [ 3.944340] Freeing unused kernel image (text/rodata gap) memory: 2016K [ 3.951202] Freeing unused kernel image (rodata/data gap) memory: 1672K [ 3.967167] systemd[1]: systemd 239 (239-75.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.989812] usb 3-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 3.997983] usb 3-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.001063] systemd[1]: Detected architecture x86-64. [ 4.005117] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 4.010172] systemd[1]: Running in initial RAM disk. [ 4.021834] hub 3-1:1.0: USB hub found [ 4.025690] hub 3-1:1.0: 6 ports detected Welcome to CentOS Stream 8 dracut-049-224.git20230330.el8 (Initramfs)! [ 4.051144] systemd[1]: Set hostname to . [ 4.087703] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 4.100095] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ 4.110251] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 4.122132] systemd[1]: Reached target Timers. [ OK ] Reached targ[ 4.128052] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 4.135554] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 4.143241] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 4.153813] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 et Timers. [ 4.161064] clocksource: Switched to clocksource tsc [ 4.161547] hub 2-12:1.0: USB hub found [ 4.167052] systemd[1]: Reached target Slices. [ 4.170932] hub 2-12:1.0: 4 ports detected [ OK ] Reached target Slices. [ 4.185120] systemd[1]: Reached target Local File Systems. [ OK ] Reached target Local File Systems. [ OK ] Listening on udev Kernel Socket. [ OK ] Listening on Journal Socket. Starting Setup Virtual Console... [ OK ] Reached target Sockets. Starting Load Kernel Modules... Starting Journal Service... [ 4.234659] fuse: init (API version 7.34) Starting Create list of required st…ce nodes for the current kernel... Starting Create Volatile Files and Directories... [ OK ] Started Memstrack Anylazing Service. [ OK ] Started Load Kernel Modules. [ OK ] Started Journal Service. [ OK ] Started Setup Virtual Console. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... Starting Apply Kernel Variables... [ OK ] Started Create Static Device Nodes in /dev. [ OK ] Started Apply Kernel Variables. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ OK [. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ 4.468034] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ OK ] Started udev Coldplug all Devices. Starting dracut initqueue hook... [ OK ] Reached target System Initialization. Starting Show Plymouth Boot Screen... [ 4.540760] dca service started, version 1.12.1 [ OK ] Started Show Plymouth Boot Screen. [ OK ] Started Forward Password Requests t[ 4.565164] igb: Intel(R) Gigabit Ethernet Network Driver o Plymouth Direc[ 4.572038] igb: Copyright (c) tion. tory Watch. [[ 4.579245] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [0;32m OK [ 4.588815] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 ] Reached target[ 4.597823] nvme nvme0: pci function 0000:02:00.0 Paths. [[0;3[ 4.597973] ixgbe: Intel(Rit PCI Express Network Driver [ 4.605676] nvme nvme0: 8/0/0 default/read/poll queues 2m OK ] Re[ 4.606623] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 4.611152] ixgbe: Copyright (c) 1999-2016 Intel Corporation. ached target Bas[ 4.617008] nvme0n1: detected capacity change from 0 to 400088457216 ic System. [ 4.643017] ACPI: bus type drm_connector registered [ 4.648650] igb 0000:07:00.0: added PHC on eth0 [ 4.653326] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network C [ 4.658148] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 4.660198] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:da:f4 [ 4.660790] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 4.660853] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 4.672125] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 4.679127] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 4.690683] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.702139] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.739481] scsi host0: ahci [ 4.742548] scsi host1: ahci [ 4.745619] scsi host2: ahci [ 4.748612] scsi host3: ahci [ 4.751553] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 53 [ 4.751713] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 4.756514] igb 0000:07:00.1: added PHC on eth1 [ 4.756541] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 4.756542] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:da:f5 [ 4.756618] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 4.756619] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.758944] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 53 [ 4.759972] igb 0000:07:00.0 eno1: renamed from eth0 [ 4.765464] ast 0000:06:00.0: [drm] AST 2400 detected [ 4.769994] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 53 [ 4.769996] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 53 [ 4.776882] ast 0000:06:00.0: [drm] Using analog VGA [ 4.784207] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 4.789129] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 4.796684] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.804216] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 4.825317] scsi host4: ahci [ 4.830286] igb 0000:07:00.1 eno2: renamed from eth1 [ 4.833938] scsi host5: ahci [ 4.874081] fbcon: astdrmfb (fb0) is primary device [ 4.874198] scsi host6: ahci [ 4.874320] scsi host7: ahci [ 4.874429] scsi host8: ahci [ 4.874554] scsi host9: ahci [ 4.874611] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 63 [ 4.874616] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 63 [ 4.874617] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 63 [ 4.874619] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 63 [ 4.874621] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 63 [ 4.874623] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 63 [ 4.923300] Console: switching to colour frame buffer device 128x48 [ 5.026481] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 5.093305] ata1: SATA link down (SStatus 0 SControl 300) [ 5.098719] ata4: SATA link down (SStatus 0 SControl 300) [ 5.104134] ata2: SATA link down (SStatus 0 SControl 300) [ 5.104165] ata3: SATA link down (S[ 5.181081] ata5: SATA link up 3.0 Gbps (SStatus 123 SControl 300) [ 5.187272] ata10: SATA link down (SStatus 0 SControl 300) [ 5.192766] ata9: SATA link down (SStatus 0 SControl 300) [ 5.198172] ata8: SATA link down (SStatus 0 SControl 300) [ 5.203581] ata6: SATA link down (SStatus 0 SControl 300) [ 5.208989] ata7: SATA link down (SStatus 0 SControl 300) [ 5.214736] ata5.00: ATA-7: HUA721010KLA330, GKAOA94A, max UDMA/133 [ 5.220999] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.229197] ata5.00: confi[ 5.233607] st-Access ATA HUA721010KLA330 A94A PQ: 0 ANSI: 5 [ 5.247281] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.256242] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.263902] sd 4:0:0:0: [sda] Write Protect is off [ 5.268698] sd 4:0:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA [ 5.286660] sda: sda1 [ 5.289242] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device HUA721010KLA330 1. [ OK ] Reached target Initrd Root Device. [ 5.781347] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.791627] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 5.800140] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 5.806317] ixgbe 0000:03:00.0: 0c:c4:7a:8f:b7:64 [ 5.814345] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 5.820971] libphy: ixgbe-mdio: probed [ 5.981123] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.991395] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 5.999900] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.006945] ixgbe 0000:03:00.1: 0c:c4:7a:8f:b7:65 [ 6.014922] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.021502] libphy: ixgbe-mdio: probed [ 6.026133] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 6.037240] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting File System Check on /dev/…ddf-553d-41ea-8bce-5708f99a0430... [ OK ] Started File System Check on /dev/d…36ddf-553d-41ea-8bce-5708f99a0430. Mounting /sysroot... [ 6.219593] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Starting Setup Virtual Console... Starting Plymouth switch root service... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Basic System. [ OK ] Stopped target System Initialization. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Paths. Stopping udev Kernel Device Manager... [ OK ] Stopped target Sockets. [ OK ] Stopped target Slices. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped target Swap. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Started Setup Virtual Console. [ OK ] Reached target Switch Root. [ OK ] Started Plymouth switch root service. Starting Switch Root... [ 6.687502] printk: systemd: 11 output lines suppressed due to ratelimiting [ 7.691245] SELinux: policy capability network_peer_controls=1 [ 7.697169] SELinux: policy capability open_perms=1 [ 7.702132] SELinux: policy capability extended_socket_class=1 [ 7.708040] SELinux: policy capability always_check_network=0 [ 7.713867] SELinux: policy capability cgroup_seclabel=1 [ 7.719258] SELinux: policy capability nnp_nosuid_transition=1 [ 7.746132] audit: type=1403 audit(1714130327.359:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 7.747923] systemd[1]: Successfully loaded SELinux policy in 303.166ms. [ 7.857846] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 19.795ms. [ 7.888641] systemd[1]: systemd 239 (239-75.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 7.923161] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 8! [ 7.947226] systemd[1]: Set hostname to . [ 9.571335] systemd[1]: initrd-switch-root.service: Succeeded. [ 9.577408] systemd[1]: Stopped Switch Root. [ OK [[ 9.582090] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. 0m] Stopped Swit[ 9.593712] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. ch Root. [ 9.603971] systemd[1]: Stopped Journal Service. [ OK [[ 9.610511] systemd[1]: Starting Journal Service... 0m] Stopped Jour[ 9.616128] systemd[1]: Listening on initctl Compatibility Named Pipe. nal Service. Starting Journal Service... [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on Process Core Dump Socket. [ OK ] Stopped Plymouth switch root service. [ OK ] Reached target ceph target allowing…mirror@.service instances at once. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Created slice system-sshd\x2dkeygen.slice. Mounting Huge Pages File System... Mounting Kernel Debug File System... Starting Create list of required st…ce nodes for the current kernel... Mounting POSIX Message Queue File System... [ OK ] Created slice system-getty.slice. [ OK ] Reached target Swap. Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Reached target ceph target allowing…ph-mon@.service instances at once. [ OK ] Reached target ceph target allowing…ph-osd@.service instances at once. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Created slice User and Session Slice. [ OK ] Set up automount Arbitrary Executab…rmats File System Automount Point. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Reached target ceph target allowing…ph-mgr@.service instances at once. [ OK ] Reached targ[ 9.789803] EXT4-fs (sda1): re-mounted. Opts: (null) et Slices. [ OK ] Reached target ceph target allowing…ph-mds@.service instances at once. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Paths. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd Root File System. [ OK ] Stopped target Initrd File Systems. Starting Setup Virtual Console... Starting Remount Root and Kernel File Systems... [ OK ] Listening on udev Kernel Socket. [ OK ] Listening on udev Control Socket. Starting Load Kernel Modules... Starting Monitoring of LVM2 mirrors…ng dmeventd or progress polling... [ OK ] Reached target ceph target allowing…adosgw@.service instances at once. Starting udev Coldplug all Devices... [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Started Remount Root and Kernel File Systems. Starting Load/Save Random Seed... Starting Create Static Device Nodes in /dev... Starting Flush Journal to Persistent Storage... [ OK ] Started Load/Save Random Seed. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Load Kernel Modules. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ 10.331023] device-mapper: uevent: version 1.0.3 [ 10.335744] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started Monitoring of LVM2 mirrors,…sing dmeventd or progress polling. [ OK ] Started Apply Kernel Variables. [ OK ] Started Setup Virtual Console. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Import network configuration from initramfs... Starting Tell Plymouth To Write Out Runtime Data... [ OK ] Started Tell Plymouth To Write Out Runtime Data. [ 10.978441] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 10.984443] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ OK ] Started Import network configuration from in[ 10.995360] igb 0000:07:00.0: DCA enabled itramfs. [ 11.000787] igb 0000:07:00.1: DCA enabled Starting Cre[ 11.006300] IPMI message handler: version 39.2 ate Volatile Files and Directories... [ 11.023926] ipmi device interface [ 11.049192] power_meter ACPI000D:00: Found ACPI power meter. [ 11.054985] ipmi_si: IPMI System Interface driver [ 11.055035] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 11.059741] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 11.072811] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 11.080041] ipmi_si: Adding SMBIOS-specified kcs state machine [ 11.085925] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 11.091870] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 11.100601] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 11.109338] ipmi_si: Adding ACPI-specified kcs state machine [ 11.115087] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 11.199838] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 11.202005] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 11.217374] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 11.246659] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ OK ] Created slice system-lvm2\x2dpvscan.slice. Starting LVM event activation on device 259:0... [ 11.301156] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 11.335004] ipmi_ssif: IPMI SSIF Interface driver [ 11.342103] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 11.342105] RAPL PMU: hw unit of domain package 2^-14 Joules [ 11.342106] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 11.383880] iTCO_vendor_support: vendor-support=0 [ 11.406196] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 [ 11.411815] iTCO_wdt: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 11.420141] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ OK ] Started LVM event activation on device 259:0. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Mounting RPC Pipe File System... Starting Security Auditing Service... [ 11.919286] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 11.930230] EDAC sbridge: Ver: 1.1.2 [ 11.953966] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 11.961861] XFS (dm-4): Mounting V4 Filesystem [ 11.971536] XFS (dm-4): Ending clean mount [ OK ] Mounted /var/lib/ceph. [ 12.059626] RPC: Registered named UNIX socket transport module. [ 12.065549] RPC: Registered udp transport module. [ 12.070253] RPC: Registered tcp transport module. [ 12.074955] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ 12.160143] intel_rapl_common: Found RAPL domain package [ 12.165476] intel_rapl_common: Found RAPL domain dram [ 12.170528] intel_rapl_common: DRAM domain energy unit 15300pj [ OK ] Started Security Auditing Service. Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Reached target System Initialization. [ OK ] Started Updates mlocate database every day. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting Self Monitoring and Reporting Technology (SMART) Daemon... [ OK ] Started Machine Check Exception Logging Daemon. [ OK ] Started D-Bus System Message Bus. Starting VDO volume services... Starting Kernel Samepage Merging... Starting Restore /run/initramfs on shutdown... Starting Resets System Activity Logs... Starting Authorization Manager... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. Starting NTP client/server... [ OK ] Reached target User and Group Name Lookups. [ OK ] Reached target sshd-keygen.target. Starting Login Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowing… ceph*@.service instances at once. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Reached target Timers. Starting Network Manager... [ OK ] Started Kernel Samepage Merging. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Resets System Activity Logs. Starting Kernel Samepage Merging (KSM) Tuning Daemon... [ OK ] Started Login Service. [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Started Kernel Samepage Merging (KSM) Tuning Daemon. [ OK ] Started NTP client/server. [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... Starting GSSAPI Proxy Daemon... Starting Network Manager Wait Online... Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Started OpenSSH server daemon. [ OK ] Started Authorization Manager. Starting Network Manager Script Dispatcher Service... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Started Network Manager Script Dispatcher Service. [ OK ] Started Permit User Sessions. [ OK ] Started Command Scheduler. [ OK ] Started Job spooling tools. [ 17.286186] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 17.343191] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 17.351211] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 17.407992] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 17.415782] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 17.458948] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 17.569145] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 17.577478] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 17.618970] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 17.729264] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 17.840216] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ 17.936172] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 17.944011] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started VDO volume services. [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting /etc/rc.d/rc.local Compatibility... Starting System Logging Service... Starting Notify NFS peers of a restart... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Started Nagios Remote Plugin Executor. Starting Crash recovery kernel arming... [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.72 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. + '[' 172.21.15.72 '!=' '' ']' + set -e + '[' -n 172.21.15.72 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.72 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.72 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi072.front.sepia.ceph.com + '[' -n smithi072.front.sepia.ceph.com ']' + hostname smithi072.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi072 + echo smithi072 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.72 smithi072.front.sepia.ceph.com smithi072/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... Starting SETroubleshoot daemon for …cessing new SELinux denial logs... CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi072 login: [disconnect] 2024-04-26T11:19:08.560 INFO:teuthology.misc:Re-opening connections... 2024-04-26T11:19:08.561 INFO:teuthology.misc:trying to connect to ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T11:19:08.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-26T11:19:08.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:19:08.942 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-04-26T11:19:09.361 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-26T11:19:09.361 DEBUG:teuthology.misc:waited 0.8007335662841797 2024-04-26T11:19:10.362 DEBUG:tasks.ceph_manager:Mounting data for osd.0 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T11:19:10.362 INFO:tasks.ceph_manager:Mounting osd.0: dev: ubuntu@smithi072.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-0, type: xfs, options: ['noatime'] 2024-04-26T11:19:10.363 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T11:19:10.492 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T11:19:10.526 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T11:19:10.527 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T11:19:10.569 INFO:tasks.ceph.osd.0:Started 2024-04-26T11:19:10.569 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:19:10.695 INFO:teuthology.orchestra.run.smithi072.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-26T11:19:10.697 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T11:19:10.697 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-04-26T11:19:11.670 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:19:11.669+0000 7fcba6392800 -1 Falling back to public interface 2024-04-26T11:19:13.807 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-26T11:19:15.425 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:19:15.424+0000 7fcba6392800 -1 osd.0 71 log_to_monitors true 2024-04-26T11:19:15.698 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:19:15.820 INFO:teuthology.orchestra.run.smithi072.stderr:no valid command found; 10 closest matches: 2024-04-26T11:19:15.820 INFO:teuthology.orchestra.run.smithi072.stderr:0 2024-04-26T11:19:15.821 INFO:teuthology.orchestra.run.smithi072.stderr:1 2024-04-26T11:19:15.821 INFO:teuthology.orchestra.run.smithi072.stderr:2 2024-04-26T11:19:15.821 INFO:teuthology.orchestra.run.smithi072.stderr:abort 2024-04-26T11:19:15.821 INFO:teuthology.orchestra.run.smithi072.stderr:assert 2024-04-26T11:19:15.821 INFO:teuthology.orchestra.run.smithi072.stderr:bluefs debug_inject_read_zeros 2024-04-26T11:19:15.821 INFO:teuthology.orchestra.run.smithi072.stderr:bluefs files list 2024-04-26T11:19:15.821 INFO:teuthology.orchestra.run.smithi072.stderr:bluefs stats 2024-04-26T11:19:15.821 INFO:teuthology.orchestra.run.smithi072.stderr:bluestore allocator dump block 2024-04-26T11:19:15.821 INFO:teuthology.orchestra.run.smithi072.stderr:bluestore allocator fragmentation block 2024-04-26T11:19:15.821 INFO:teuthology.orchestra.run.smithi072.stderr:admin_socket: invalid command 2024-04-26T11:19:15.822 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T11:19:15.823 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-04-26T11:19:16.173 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-04-26T11:19:16.172+0000 7fcb9230d700 -1 osd.0 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T11:19:20.823 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:19:20.958 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-04-26T11:19:20.958 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2024-04-26T11:19:20.958 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2024-04-26T11:19:20.958 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-04-26T11:19:20.969 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-26T11:19:21.125 INFO:teuthology.orchestra.run.smithi029.stdout:mon.a: {} 2024-04-26T11:19:21.134 INFO:teuthology.orchestra.run.smithi029.stdout:mon.b: {} 2024-04-26T11:19:21.144 INFO:teuthology.orchestra.run.smithi029.stdout:mon.c: {} 2024-04-26T11:19:21.145 INFO:teuthology.orchestra.run.smithi029.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T11:19:21.145 INFO:teuthology.orchestra.run.smithi029.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T11:19:21.145 INFO:teuthology.orchestra.run.smithi029.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T11:19:21.156 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T11:19:22.189 INFO:teuthology.orchestra.run.smithi029.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T11:19:22.203 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-26T11:19:23.194 INFO:teuthology.orchestra.run.smithi029.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-26T11:19:23.208 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T11:19:24.198 INFO:teuthology.orchestra.run.smithi029.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T11:19:24.212 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-26T11:19:25.205 INFO:teuthology.orchestra.run.smithi029.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-26T11:19:25.219 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T11:19:26.211 INFO:teuthology.orchestra.run.smithi029.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T11:19:26.225 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-26T11:19:27.216 INFO:teuthology.orchestra.run.smithi029.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-26T11:19:27.229 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-26T11:19:27.229 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-26T11:19:27.229 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-26T11:19:27.229 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-26T11:19:27.229 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T11:19:27.229 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:19:27.578 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:19:27.578 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":82,"fsid":"2b52ce04-9559-478f-9787-c3cc3b261c15","created":"2024-04-26T11:12:58.193418+0000","modified":"2024-04-26T11:19:27.206561+0000","last_up_change":"2024-04-26T11:19:17.158398+0000","last_in_change":"2024-04-26T11:12:59.116286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:13:06.502266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:13:06.913870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:13:11.430854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:13:11.859264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3496b3f-5972-47ff-a449-832f5055beac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":67,"last_clean_end":71,"up_from":75,"up_thru":75,"down_at":72,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1813},{"type":"v1","addr":"172.21.15.72:6801","nonce":1813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1813},{"type":"v1","addr":"172.21.15.72:6803","nonce":1813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1813},{"type":"v1","addr":"172.21.15.72:6807","nonce":1813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1813},{"type":"v1","addr":"172.21.15.72:6805","nonce":1813}]},"public_addr":"172.21.15.72:6801/1813","cluster_addr":"172.21.15.72:6803/1813","heartbeat_back_addr":"172.21.15.72:6807/1813","heartbeat_front_addr":"172.21.15.72:6805/1813","state":["exists","up"]},{"osd":1,"uuid":"4842abe1-e7b4-480f-85b3-11c8fa2123f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":41442},{"type":"v1","addr":"172.21.15.82:6801","nonce":41442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":41442},{"type":"v1","addr":"172.21.15.82:6803","nonce":41442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":41442},{"type":"v1","addr":"172.21.15.82:6807","nonce":41442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":41442},{"type":"v1","addr":"172.21.15.82:6805","nonce":41442}]},"public_addr":"172.21.15.82:6801/41442","cluster_addr":"172.21.15.82:6803/41442","heartbeat_back_addr":"172.21.15.82:6807/41442","heartbeat_front_addr":"172.21.15.82:6805/41442","state":["exists","up"]},{"osd":2,"uuid":"57b4a874-e4ce-42a9-a7fd-f9e0acf03cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":41571},{"type":"v1","addr":"172.21.15.122:6801","nonce":41571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":41571},{"type":"v1","addr":"172.21.15.122:6803","nonce":41571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":41571},{"type":"v1","addr":"172.21.15.122:6807","nonce":41571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":41571},{"type":"v1","addr":"172.21.15.122:6805","nonce":41571}]},"public_addr":"172.21.15.122:6801/41571","cluster_addr":"172.21.15.122:6803/41571","heartbeat_back_addr":"172.21.15.122:6807/41571","heartbeat_front_addr":"172.21.15.122:6805/41571","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.123925+0000","dead_epoch":71},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.145646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:05.101494+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:19:27.592 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T11:19:27.592 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:19:27.931 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:19:27.931 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":82,"fsid":"2b52ce04-9559-478f-9787-c3cc3b261c15","created":"2024-04-26T11:12:58.193418+0000","modified":"2024-04-26T11:19:27.206561+0000","last_up_change":"2024-04-26T11:19:17.158398+0000","last_in_change":"2024-04-26T11:12:59.116286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:13:06.502266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:13:06.913870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:13:11.430854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:13:11.859264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3496b3f-5972-47ff-a449-832f5055beac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":67,"last_clean_end":71,"up_from":75,"up_thru":75,"down_at":72,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1813},{"type":"v1","addr":"172.21.15.72:6801","nonce":1813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1813},{"type":"v1","addr":"172.21.15.72:6803","nonce":1813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1813},{"type":"v1","addr":"172.21.15.72:6807","nonce":1813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1813},{"type":"v1","addr":"172.21.15.72:6805","nonce":1813}]},"public_addr":"172.21.15.72:6801/1813","cluster_addr":"172.21.15.72:6803/1813","heartbeat_back_addr":"172.21.15.72:6807/1813","heartbeat_front_addr":"172.21.15.72:6805/1813","state":["exists","up"]},{"osd":1,"uuid":"4842abe1-e7b4-480f-85b3-11c8fa2123f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":41442},{"type":"v1","addr":"172.21.15.82:6801","nonce":41442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":41442},{"type":"v1","addr":"172.21.15.82:6803","nonce":41442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":41442},{"type":"v1","addr":"172.21.15.82:6807","nonce":41442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":41442},{"type":"v1","addr":"172.21.15.82:6805","nonce":41442}]},"public_addr":"172.21.15.82:6801/41442","cluster_addr":"172.21.15.82:6803/41442","heartbeat_back_addr":"172.21.15.82:6807/41442","heartbeat_front_addr":"172.21.15.82:6805/41442","state":["exists","up"]},{"osd":2,"uuid":"57b4a874-e4ce-42a9-a7fd-f9e0acf03cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":41571},{"type":"v1","addr":"172.21.15.122:6801","nonce":41571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":41571},{"type":"v1","addr":"172.21.15.122:6803","nonce":41571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":41571},{"type":"v1","addr":"172.21.15.122:6807","nonce":41571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":41571},{"type":"v1","addr":"172.21.15.122:6805","nonce":41571}]},"public_addr":"172.21.15.122:6801/41571","cluster_addr":"172.21.15.122:6803/41571","heartbeat_back_addr":"172.21.15.122:6807/41571","heartbeat_front_addr":"172.21.15.122:6805/41571","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.123925+0000","dead_epoch":71},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.145646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:05.101494+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:19:27.945 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T11:19:27.945 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T11:19:27.946 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T11:19:28.120 INFO:teuthology.orchestra.run.smithi029.stdout:322122547204 2024-04-26T11:19:28.120 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T11:19:28.127 INFO:teuthology.orchestra.run.smithi029.stdout:34359738447 2024-04-26T11:19:28.127 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T11:19:28.129 INFO:teuthology.orchestra.run.smithi029.stdout:34359738448 2024-04-26T11:19:28.130 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T11:19:28.473 INFO:teuthology.orchestra.run.smithi029.stdout:322122547203 2024-04-26T11:19:28.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 322122547204 got 322122547203 for osd.0 2024-04-26T11:19:28.523 INFO:teuthology.orchestra.run.smithi029.stdout:34359738445 2024-04-26T11:19:28.528 INFO:teuthology.orchestra.run.smithi029.stdout:34359738446 2024-04-26T11:19:28.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738447 got 34359738445 for osd.2 2024-04-26T11:19:28.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738448 got 34359738446 for osd.1 2024-04-26T11:19:29.490 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T11:19:29.540 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T11:19:29.543 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T11:19:29.879 INFO:teuthology.orchestra.run.smithi029.stdout:322122547204 2024-04-26T11:19:29.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 322122547204 got 322122547204 for osd.0 2024-04-26T11:19:29.893 DEBUG:teuthology.parallel:result is None 2024-04-26T11:19:29.918 INFO:teuthology.orchestra.run.smithi029.stdout:34359738447 2024-04-26T11:19:29.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738447 got 34359738447 for osd.2 2024-04-26T11:19:29.933 DEBUG:teuthology.parallel:result is None 2024-04-26T11:19:29.937 INFO:teuthology.orchestra.run.smithi029.stdout:34359738448 2024-04-26T11:19:29.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738448 got 34359738448 for osd.1 2024-04-26T11:19:29.952 DEBUG:teuthology.parallel:result is None 2024-04-26T11:19:29.952 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T11:19:29.952 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:19:30.340 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:19:30.343 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:19:30.351 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2024-04-26T11:19:28.560925+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":720452,"kb_used_data":3788,"kb_used_omap":14,"kb_used_meta":716593,"kb_avail":282395068,"statfs":{"total":289910292480,"available":289172549632,"internally_reserved":0,"allocated":3878912,"data_stored":2253663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14416,"internal_metadata":733792176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.369061"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205605+0000","last_change":"2024-04-26T11:13:12.919196+0000","last_active":"2024-04-26T11:19:26.205605+0000","last_peered":"2024-04-26T11:19:26.205605+0000","last_clean":"2024-04-26T11:19:26.205605+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:19:26.205605+0000","last_undegraded":"2024-04-26T11:19:26.205605+0000","last_fullsized":"2024-04-26T11:19:26.205605+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205354+0000","last_change":"2024-04-26T11:13:12.917670+0000","last_active":"2024-04-26T11:19:26.205354+0000","last_peered":"2024-04-26T11:19:26.205354+0000","last_clean":"2024-04-26T11:19:26.205354+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:19:26.205354+0000","last_undegraded":"2024-04-26T11:19:26.205354+0000","last_fullsized":"2024-04-26T11:19:26.205354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205142+0000","last_change":"2024-04-26T11:19:18.185209+0000","last_active":"2024-04-26T11:19:26.205142+0000","last_peered":"2024-04-26T11:19:26.205142+0000","last_clean":"2024-04-26T11:19:26.205142+0000","last_became_active":"2024-04-26T11:19:18.182972+0000","last_became_peered":"2024-04-26T11:19:18.182972+0000","last_unstale":"2024-04-26T11:19:26.205142+0000","last_undegraded":"2024-04-26T11:19:26.205142+0000","last_fullsized":"2024-04-26T11:19:26.205142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:57.755970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204499+0000","last_change":"2024-04-26T11:19:18.183286+0000","last_active":"2024-04-26T11:19:26.204499+0000","last_peered":"2024-04-26T11:19:26.204499+0000","last_clean":"2024-04-26T11:19:26.204499+0000","last_became_active":"2024-04-26T11:19:18.182942+0000","last_became_peered":"2024-04-26T11:19:18.182942+0000","last_unstale":"2024-04-26T11:19:26.204499+0000","last_undegraded":"2024-04-26T11:19:26.204499+0000","last_fullsized":"2024-04-26T11:19:26.204499+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:58.370599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205030+0000","last_change":"2024-04-26T11:13:12.917403+0000","last_active":"2024-04-26T11:19:26.205030+0000","last_peered":"2024-04-26T11:19:26.205030+0000","last_clean":"2024-04-26T11:19:26.205030+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:19:26.205030+0000","last_undegraded":"2024-04-26T11:19:26.205030+0000","last_fullsized":"2024-04-26T11:19:26.205030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:42.014955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204622+0000","last_change":"2024-04-26T11:19:18.189355+0000","last_active":"2024-04-26T11:19:26.204622+0000","last_peered":"2024-04-26T11:19:26.204622+0000","last_clean":"2024-04-26T11:19:26.204622+0000","last_became_active":"2024-04-26T11:19:18.188990+0000","last_became_peered":"2024-04-26T11:19:18.188990+0000","last_unstale":"2024-04-26T11:19:26.204622+0000","last_undegraded":"2024-04-26T11:19:26.204622+0000","last_fullsized":"2024-04-26T11:19:26.204622+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:29.030847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204397+0000","last_change":"2024-04-26T11:19:18.187953+0000","last_active":"2024-04-26T11:19:26.204397+0000","last_peered":"2024-04-26T11:19:26.204397+0000","last_clean":"2024-04-26T11:19:26.204397+0000","last_became_active":"2024-04-26T11:19:18.186638+0000","last_became_peered":"2024-04-26T11:19:18.186638+0000","last_unstale":"2024-04-26T11:19:26.204397+0000","last_undegraded":"2024-04-26T11:19:26.204397+0000","last_fullsized":"2024-04-26T11:19:26.204397+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:18.483074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204062+0000","last_change":"2024-04-26T11:19:18.183968+0000","last_active":"2024-04-26T11:19:26.204062+0000","last_peered":"2024-04-26T11:19:26.204062+0000","last_clean":"2024-04-26T11:19:26.204062+0000","last_became_active":"2024-04-26T11:19:18.182111+0000","last_became_peered":"2024-04-26T11:19:18.182111+0000","last_unstale":"2024-04-26T11:19:26.204062+0000","last_undegraded":"2024-04-26T11:19:26.204062+0000","last_fullsized":"2024-04-26T11:19:26.204062+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:08.529468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684517+0000","last_change":"2024-04-26T11:19:24.202861+0000","last_active":"2024-04-26T11:19:26.684517+0000","last_peered":"2024-04-26T11:19:26.684517+0000","last_clean":"2024-04-26T11:19:26.684517+0000","last_became_active":"2024-04-26T11:19:24.202146+0000","last_became_peered":"2024-04-26T11:19:24.202146+0000","last_unstale":"2024-04-26T11:19:26.684517+0000","last_undegraded":"2024-04-26T11:19:26.684517+0000","last_fullsized":"2024-04-26T11:19:26.684517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:33.234821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205553+0000","last_change":"2024-04-26T11:13:12.918521+0000","last_active":"2024-04-26T11:19:26.205553+0000","last_peered":"2024-04-26T11:19:26.205553+0000","last_clean":"2024-04-26T11:19:26.205553+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:19:26.205553+0000","last_undegraded":"2024-04-26T11:19:26.205553+0000","last_fullsized":"2024-04-26T11:19:26.205553+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204805+0000","last_change":"2024-04-26T11:19:18.187027+0000","last_active":"2024-04-26T11:19:26.204805+0000","last_peered":"2024-04-26T11:19:26.204805+0000","last_clean":"2024-04-26T11:19:26.204805+0000","last_became_active":"2024-04-26T11:19:18.185543+0000","last_became_peered":"2024-04-26T11:19:18.185543+0000","last_unstale":"2024-04-26T11:19:26.204805+0000","last_undegraded":"2024-04-26T11:19:26.204805+0000","last_fullsized":"2024-04-26T11:19:26.204805+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:38.365806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205142+0000","last_change":"2024-04-26T11:19:18.183459+0000","last_active":"2024-04-26T11:19:26.205142+0000","last_peered":"2024-04-26T11:19:26.205142+0000","last_clean":"2024-04-26T11:19:26.205142+0000","last_became_active":"2024-04-26T11:19:18.182827+0000","last_became_peered":"2024-04-26T11:19:18.182827+0000","last_unstale":"2024-04-26T11:19:26.205142+0000","last_undegraded":"2024-04-26T11:19:26.205142+0000","last_fullsized":"2024-04-26T11:19:26.205142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:28.182922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205400+0000","last_change":"2024-04-26T11:13:12.915484+0000","last_active":"2024-04-26T11:19:26.205400+0000","last_peered":"2024-04-26T11:19:26.205400+0000","last_clean":"2024-04-26T11:19:26.205400+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:19:26.205400+0000","last_undegraded":"2024-04-26T11:19:26.205400+0000","last_fullsized":"2024-04-26T11:19:26.205400+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204505+0000","last_change":"2024-04-26T11:19:18.181800+0000","last_active":"2024-04-26T11:19:26.204505+0000","last_peered":"2024-04-26T11:19:26.204505+0000","last_clean":"2024-04-26T11:19:26.204505+0000","last_became_active":"2024-04-26T11:19:18.180865+0000","last_became_peered":"2024-04-26T11:19:18.180865+0000","last_unstale":"2024-04-26T11:19:26.204505+0000","last_undegraded":"2024-04-26T11:19:26.204505+0000","last_fullsized":"2024-04-26T11:19:26.204505+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:36.948796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204335+0000","last_change":"2024-04-26T11:19:18.181625+0000","last_active":"2024-04-26T11:19:26.204335+0000","last_peered":"2024-04-26T11:19:26.204335+0000","last_clean":"2024-04-26T11:19:26.204335+0000","last_became_active":"2024-04-26T11:19:18.180763+0000","last_became_peered":"2024-04-26T11:19:18.180763+0000","last_unstale":"2024-04-26T11:19:26.204335+0000","last_undegraded":"2024-04-26T11:19:26.204335+0000","last_fullsized":"2024-04-26T11:19:26.204335+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:27.138589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204271+0000","last_change":"2024-04-26T11:19:18.185161+0000","last_active":"2024-04-26T11:19:26.204271+0000","last_peered":"2024-04-26T11:19:26.204271+0000","last_clean":"2024-04-26T11:19:26.204271+0000","last_became_active":"2024-04-26T11:19:18.184331+0000","last_became_peered":"2024-04-26T11:19:18.184331+0000","last_unstale":"2024-04-26T11:19:26.204271+0000","last_undegraded":"2024-04-26T11:19:26.204271+0000","last_fullsized":"2024-04-26T11:19:26.204271+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:29.254144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684526+0000","last_change":"2024-04-26T11:19:24.204827+0000","last_active":"2024-04-26T11:19:26.684526+0000","last_peered":"2024-04-26T11:19:26.684526+0000","last_clean":"2024-04-26T11:19:26.684526+0000","last_became_active":"2024-04-26T11:19:24.203764+0000","last_became_peered":"2024-04-26T11:19:24.203764+0000","last_unstale":"2024-04-26T11:19:26.684526+0000","last_undegraded":"2024-04-26T11:19:26.684526+0000","last_fullsized":"2024-04-26T11:19:26.684526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:29.263130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205647+0000","last_change":"2024-04-26T11:13:12.918759+0000","last_active":"2024-04-26T11:19:26.205647+0000","last_peered":"2024-04-26T11:19:26.205647+0000","last_clean":"2024-04-26T11:19:26.205647+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:19:26.205647+0000","last_undegraded":"2024-04-26T11:19:26.205647+0000","last_fullsized":"2024-04-26T11:19:26.205647+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:55.002972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684440+0000","last_change":"2024-04-26T11:19:24.200114+0000","last_active":"2024-04-26T11:19:26.684440+0000","last_peered":"2024-04-26T11:19:26.684440+0000","last_clean":"2024-04-26T11:19:26.684440+0000","last_became_active":"2024-04-26T11:19:24.199142+0000","last_became_peered":"2024-04-26T11:19:24.199142+0000","last_unstale":"2024-04-26T11:19:26.684440+0000","last_undegraded":"2024-04-26T11:19:26.684440+0000","last_fullsized":"2024-04-26T11:19:26.684440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:04.789203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205065+0000","last_change":"2024-04-26T11:19:18.186823+0000","last_active":"2024-04-26T11:19:26.205065+0000","last_peered":"2024-04-26T11:19:26.205065+0000","last_clean":"2024-04-26T11:19:26.205065+0000","last_became_active":"2024-04-26T11:19:18.184282+0000","last_became_peered":"2024-04-26T11:19:18.184282+0000","last_unstale":"2024-04-26T11:19:26.205065+0000","last_undegraded":"2024-04-26T11:19:26.205065+0000","last_fullsized":"2024-04-26T11:19:26.205065+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:11.581601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204671+0000","last_change":"2024-04-26T11:19:18.187937+0000","last_active":"2024-04-26T11:19:26.204671+0000","last_peered":"2024-04-26T11:19:26.204671+0000","last_clean":"2024-04-26T11:19:26.204671+0000","last_became_active":"2024-04-26T11:19:18.186605+0000","last_became_peered":"2024-04-26T11:19:18.186605+0000","last_unstale":"2024-04-26T11:19:26.204671+0000","last_undegraded":"2024-04-26T11:19:26.204671+0000","last_fullsized":"2024-04-26T11:19:26.204671+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:49.737640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204850+0000","last_change":"2024-04-26T11:19:18.182666+0000","last_active":"2024-04-26T11:19:26.204850+0000","last_peered":"2024-04-26T11:19:26.204850+0000","last_clean":"2024-04-26T11:19:26.204850+0000","last_became_active":"2024-04-26T11:19:18.181728+0000","last_became_peered":"2024-04-26T11:19:18.181728+0000","last_unstale":"2024-04-26T11:19:26.204850+0000","last_undegraded":"2024-04-26T11:19:26.204850+0000","last_fullsized":"2024-04-26T11:19:26.204850+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:07.719581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.203921+0000","last_change":"2024-04-26T11:19:24.198562+0000","last_active":"2024-04-26T11:19:26.203921+0000","last_peered":"2024-04-26T11:19:26.203921+0000","last_clean":"2024-04-26T11:19:26.203921+0000","last_became_active":"2024-04-26T11:19:24.197487+0000","last_became_peered":"2024-04-26T11:19:24.197487+0000","last_unstale":"2024-04-26T11:19:26.203921+0000","last_undegraded":"2024-04-26T11:19:26.203921+0000","last_fullsized":"2024-04-26T11:19:26.203921+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:31.790885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204840+0000","last_change":"2024-04-26T11:13:12.912756+0000","last_active":"2024-04-26T11:19:26.204840+0000","last_peered":"2024-04-26T11:19:26.204840+0000","last_clean":"2024-04-26T11:19:26.204840+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:19:26.204840+0000","last_undegraded":"2024-04-26T11:19:26.204840+0000","last_fullsized":"2024-04-26T11:19:26.204840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:04.177831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205614+0000","last_change":"2024-04-26T11:19:18.184692+0000","last_active":"2024-04-26T11:19:26.205614+0000","last_peered":"2024-04-26T11:19:26.205614+0000","last_clean":"2024-04-26T11:19:26.205614+0000","last_became_active":"2024-04-26T11:19:18.184451+0000","last_became_peered":"2024-04-26T11:19:18.184451+0000","last_unstale":"2024-04-26T11:19:26.205614+0000","last_undegraded":"2024-04-26T11:19:26.205614+0000","last_fullsized":"2024-04-26T11:19:26.205614+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:08.485754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204759+0000","last_change":"2024-04-26T11:19:24.199954+0000","last_active":"2024-04-26T11:19:26.204759+0000","last_peered":"2024-04-26T11:19:26.204759+0000","last_clean":"2024-04-26T11:19:26.204759+0000","last_became_active":"2024-04-26T11:19:24.198479+0000","last_became_peered":"2024-04-26T11:19:24.198479+0000","last_unstale":"2024-04-26T11:19:26.204759+0000","last_undegraded":"2024-04-26T11:19:26.204759+0000","last_fullsized":"2024-04-26T11:19:26.204759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:14.221425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204917+0000","last_change":"2024-04-26T11:19:18.185709+0000","last_active":"2024-04-26T11:19:26.204917+0000","last_peered":"2024-04-26T11:19:26.204917+0000","last_clean":"2024-04-26T11:19:26.204917+0000","last_became_active":"2024-04-26T11:19:18.185105+0000","last_became_peered":"2024-04-26T11:19:18.185105+0000","last_unstale":"2024-04-26T11:19:26.204917+0000","last_undegraded":"2024-04-26T11:19:26.204917+0000","last_fullsized":"2024-04-26T11:19:26.204917+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:43.626259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204813+0000","last_change":"2024-04-26T11:13:12.493425+0000","last_active":"2024-04-26T11:19:26.204813+0000","last_peered":"2024-04-26T11:19:26.204813+0000","last_clean":"2024-04-26T11:19:26.204813+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:19:26.204813+0000","last_undegraded":"2024-04-26T11:19:26.204813+0000","last_fullsized":"2024-04-26T11:19:26.204813+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:23.279580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205712+0000","last_change":"2024-04-26T11:19:18.191042+0000","last_active":"2024-04-26T11:19:26.205712+0000","last_peered":"2024-04-26T11:19:26.205712+0000","last_clean":"2024-04-26T11:19:26.205712+0000","last_became_active":"2024-04-26T11:19:18.190792+0000","last_became_peered":"2024-04-26T11:19:18.190792+0000","last_unstale":"2024-04-26T11:19:26.205712+0000","last_undegraded":"2024-04-26T11:19:26.205712+0000","last_fullsized":"2024-04-26T11:19:26.205712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:45.726211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684337+0000","last_change":"2024-04-26T11:19:24.203467+0000","last_active":"2024-04-26T11:19:26.684337+0000","last_peered":"2024-04-26T11:19:26.684337+0000","last_clean":"2024-04-26T11:19:26.684337+0000","last_became_active":"2024-04-26T11:19:24.202348+0000","last_became_peered":"2024-04-26T11:19:24.202348+0000","last_unstale":"2024-04-26T11:19:26.684337+0000","last_undegraded":"2024-04-26T11:19:26.684337+0000","last_fullsized":"2024-04-26T11:19:26.684337+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:55.157485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204840+0000","last_change":"2024-04-26T11:19:24.200292+0000","last_active":"2024-04-26T11:19:26.204840+0000","last_peered":"2024-04-26T11:19:26.204840+0000","last_clean":"2024-04-26T11:19:26.204840+0000","last_became_active":"2024-04-26T11:19:24.198920+0000","last_became_peered":"2024-04-26T11:19:24.198920+0000","last_unstale":"2024-04-26T11:19:26.204840+0000","last_undegraded":"2024-04-26T11:19:26.204840+0000","last_fullsized":"2024-04-26T11:19:26.204840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:45.950568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684279+0000","last_change":"2024-04-26T11:19:24.199051+0000","last_active":"2024-04-26T11:19:26.684279+0000","last_peered":"2024-04-26T11:19:26.684279+0000","last_clean":"2024-04-26T11:19:26.684279+0000","last_became_active":"2024-04-26T11:19:24.197698+0000","last_became_peered":"2024-04-26T11:19:24.197698+0000","last_unstale":"2024-04-26T11:19:26.684279+0000","last_undegraded":"2024-04-26T11:19:26.684279+0000","last_fullsized":"2024-04-26T11:19:26.684279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:21.891894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211316+0000","last_change":"2024-04-26T11:19:18.190418+0000","last_active":"2024-04-26T11:19:27.211316+0000","last_peered":"2024-04-26T11:19:27.211316+0000","last_clean":"2024-04-26T11:19:27.211316+0000","last_became_active":"2024-04-26T11:19:18.190127+0000","last_became_peered":"2024-04-26T11:19:18.190127+0000","last_unstale":"2024-04-26T11:19:27.211316+0000","last_undegraded":"2024-04-26T11:19:27.211316+0000","last_fullsized":"2024-04-26T11:19:27.211316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:11:25.515683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205003+0000","last_change":"2024-04-26T11:19:24.205086+0000","last_active":"2024-04-26T11:19:26.205003+0000","last_peered":"2024-04-26T11:19:26.205003+0000","last_clean":"2024-04-26T11:19:26.205003+0000","last_became_active":"2024-04-26T11:19:24.204122+0000","last_became_peered":"2024-04-26T11:19:24.204122+0000","last_unstale":"2024-04-26T11:19:26.205003+0000","last_undegraded":"2024-04-26T11:19:26.205003+0000","last_fullsized":"2024-04-26T11:19:26.205003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:56:23.239851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684262+0000","last_change":"2024-04-26T11:19:24.198434+0000","last_active":"2024-04-26T11:19:26.684262+0000","last_peered":"2024-04-26T11:19:26.684262+0000","last_clean":"2024-04-26T11:19:26.684262+0000","last_became_active":"2024-04-26T11:19:24.197247+0000","last_became_peered":"2024-04-26T11:19:24.197247+0000","last_unstale":"2024-04-26T11:19:26.684262+0000","last_undegraded":"2024-04-26T11:19:26.684262+0000","last_fullsized":"2024-04-26T11:19:26.684262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:23.769249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204777+0000","last_change":"2024-04-26T11:19:18.187720+0000","last_active":"2024-04-26T11:19:26.204777+0000","last_peered":"2024-04-26T11:19:26.204777+0000","last_clean":"2024-04-26T11:19:26.204777+0000","last_became_active":"2024-04-26T11:19:18.185578+0000","last_became_peered":"2024-04-26T11:19:18.185578+0000","last_unstale":"2024-04-26T11:19:26.204777+0000","last_undegraded":"2024-04-26T11:19:26.204777+0000","last_fullsized":"2024-04-26T11:19:26.204777+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:38.482108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204346+0000","last_change":"2024-04-26T11:19:24.201728+0000","last_active":"2024-04-26T11:19:26.204346+0000","last_peered":"2024-04-26T11:19:26.204346+0000","last_clean":"2024-04-26T11:19:26.204346+0000","last_became_active":"2024-04-26T11:19:24.200992+0000","last_became_peered":"2024-04-26T11:19:24.200992+0000","last_unstale":"2024-04-26T11:19:26.204346+0000","last_undegraded":"2024-04-26T11:19:26.204346+0000","last_fullsized":"2024-04-26T11:19:26.204346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:59.859744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":109,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205523+0000","last_change":"2024-04-26T11:19:18.190998+0000","last_active":"2024-04-26T11:19:26.205523+0000","last_peered":"2024-04-26T11:19:26.205523+0000","last_clean":"2024-04-26T11:19:26.205523+0000","last_became_active":"2024-04-26T11:19:18.190381+0000","last_became_peered":"2024-04-26T11:19:18.190381+0000","last_unstale":"2024-04-26T11:19:26.205523+0000","last_undegraded":"2024-04-26T11:19:26.205523+0000","last_fullsized":"2024-04-26T11:19:26.205523+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:31.159104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684360+0000","last_change":"2024-04-26T11:19:24.200037+0000","last_active":"2024-04-26T11:19:26.684360+0000","last_peered":"2024-04-26T11:19:26.684360+0000","last_clean":"2024-04-26T11:19:26.684360+0000","last_became_active":"2024-04-26T11:19:24.199659+0000","last_became_peered":"2024-04-26T11:19:24.199659+0000","last_unstale":"2024-04-26T11:19:26.684360+0000","last_undegraded":"2024-04-26T11:19:26.684360+0000","last_fullsized":"2024-04-26T11:19:26.684360+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:49.275857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":45,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204850+0000","last_change":"2024-04-26T11:19:18.181316+0000","last_active":"2024-04-26T11:19:26.204850+0000","last_peered":"2024-04-26T11:19:26.204850+0000","last_clean":"2024-04-26T11:19:26.204850+0000","last_became_active":"2024-04-26T11:19:18.180711+0000","last_became_peered":"2024-04-26T11:19:18.180711+0000","last_unstale":"2024-04-26T11:19:26.204850+0000","last_undegraded":"2024-04-26T11:19:26.204850+0000","last_fullsized":"2024-04-26T11:19:26.204850+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:27.837108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204705+0000","last_change":"2024-04-26T11:19:18.182026+0000","last_active":"2024-04-26T11:19:26.204705+0000","last_peered":"2024-04-26T11:19:26.204705+0000","last_clean":"2024-04-26T11:19:26.204705+0000","last_became_active":"2024-04-26T11:19:18.181615+0000","last_became_peered":"2024-04-26T11:19:18.181615+0000","last_unstale":"2024-04-26T11:19:26.204705+0000","last_undegraded":"2024-04-26T11:19:26.204705+0000","last_fullsized":"2024-04-26T11:19:26.204705+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:56.083479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204459+0000","last_change":"2024-04-26T11:19:18.185625+0000","last_active":"2024-04-26T11:19:26.204459+0000","last_peered":"2024-04-26T11:19:26.204459+0000","last_clean":"2024-04-26T11:19:26.204459+0000","last_became_active":"2024-04-26T11:19:18.183103+0000","last_became_peered":"2024-04-26T11:19:18.183103+0000","last_unstale":"2024-04-26T11:19:26.204459+0000","last_undegraded":"2024-04-26T11:19:26.204459+0000","last_fullsized":"2024-04-26T11:19:26.204459+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:42.309969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205241+0000","last_change":"2024-04-26T11:13:12.916685+0000","last_active":"2024-04-26T11:19:26.205241+0000","last_peered":"2024-04-26T11:19:26.205241+0000","last_clean":"2024-04-26T11:19:26.205241+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:19:26.205241+0000","last_undegraded":"2024-04-26T11:19:26.205241+0000","last_fullsized":"2024-04-26T11:19:26.205241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204255+0000","last_change":"2024-04-26T11:19:24.199114+0000","last_active":"2024-04-26T11:19:26.204255+0000","last_peered":"2024-04-26T11:19:26.204255+0000","last_clean":"2024-04-26T11:19:26.204255+0000","last_became_active":"2024-04-26T11:19:24.197647+0000","last_became_peered":"2024-04-26T11:19:24.197647+0000","last_unstale":"2024-04-26T11:19:26.204255+0000","last_undegraded":"2024-04-26T11:19:26.204255+0000","last_fullsized":"2024-04-26T11:19:26.204255+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:23.938536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205618+0000","last_change":"2024-04-26T11:13:12.915238+0000","last_active":"2024-04-26T11:19:26.205618+0000","last_peered":"2024-04-26T11:19:26.205618+0000","last_clean":"2024-04-26T11:19:26.205618+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:19:26.205618+0000","last_undegraded":"2024-04-26T11:19:26.205618+0000","last_fullsized":"2024-04-26T11:19:26.205618+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:48.068465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":106,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204835+0000","last_change":"2024-04-26T11:19:18.182547+0000","last_active":"2024-04-26T11:19:26.204835+0000","last_peered":"2024-04-26T11:19:26.204835+0000","last_clean":"2024-04-26T11:19:26.204835+0000","last_became_active":"2024-04-26T11:19:18.181907+0000","last_became_peered":"2024-04-26T11:19:18.181907+0000","last_unstale":"2024-04-26T11:19:26.204835+0000","last_undegraded":"2024-04-26T11:19:26.204835+0000","last_fullsized":"2024-04-26T11:19:26.204835+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.076863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204980+0000","last_change":"2024-04-26T11:19:24.201756+0000","last_active":"2024-04-26T11:19:26.204980+0000","last_peered":"2024-04-26T11:19:26.204980+0000","last_clean":"2024-04-26T11:19:26.204980+0000","last_became_active":"2024-04-26T11:19:24.201114+0000","last_became_peered":"2024-04-26T11:19:24.201114+0000","last_unstale":"2024-04-26T11:19:26.204980+0000","last_undegraded":"2024-04-26T11:19:26.204980+0000","last_fullsized":"2024-04-26T11:19:26.204980+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:34.095066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204443+0000","last_change":"2024-04-26T11:19:18.182797+0000","last_active":"2024-04-26T11:19:26.204443+0000","last_peered":"2024-04-26T11:19:26.204443+0000","last_clean":"2024-04-26T11:19:26.204443+0000","last_became_active":"2024-04-26T11:19:18.182017+0000","last_became_peered":"2024-04-26T11:19:18.182017+0000","last_unstale":"2024-04-26T11:19:26.204443+0000","last_undegraded":"2024-04-26T11:19:26.204443+0000","last_fullsized":"2024-04-26T11:19:26.204443+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:41.531437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205077+0000","last_change":"2024-04-26T11:19:24.205310+0000","last_active":"2024-04-26T11:19:26.205077+0000","last_peered":"2024-04-26T11:19:26.205077+0000","last_clean":"2024-04-26T11:19:26.205077+0000","last_became_active":"2024-04-26T11:19:24.204476+0000","last_became_peered":"2024-04-26T11:19:24.204476+0000","last_unstale":"2024-04-26T11:19:26.205077+0000","last_undegraded":"2024-04-26T11:19:26.205077+0000","last_fullsized":"2024-04-26T11:19:26.205077+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:14.932094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205069+0000","last_change":"2024-04-26T11:19:18.181966+0000","last_active":"2024-04-26T11:19:26.205069+0000","last_peered":"2024-04-26T11:19:26.205069+0000","last_clean":"2024-04-26T11:19:26.205069+0000","last_became_active":"2024-04-26T11:19:18.181604+0000","last_became_peered":"2024-04-26T11:19:18.181604+0000","last_unstale":"2024-04-26T11:19:26.205069+0000","last_undegraded":"2024-04-26T11:19:26.205069+0000","last_fullsized":"2024-04-26T11:19:26.205069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:57.405893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204571+0000","last_change":"2024-04-26T11:19:18.181723+0000","last_active":"2024-04-26T11:19:26.204571+0000","last_peered":"2024-04-26T11:19:26.204571+0000","last_clean":"2024-04-26T11:19:26.204571+0000","last_became_active":"2024-04-26T11:19:18.181462+0000","last_became_peered":"2024-04-26T11:19:18.181462+0000","last_unstale":"2024-04-26T11:19:26.204571+0000","last_undegraded":"2024-04-26T11:19:26.204571+0000","last_fullsized":"2024-04-26T11:19:26.204571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:23.824505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205502+0000","last_change":"2024-04-26T11:19:18.183263+0000","last_active":"2024-04-26T11:19:26.205502+0000","last_peered":"2024-04-26T11:19:26.205502+0000","last_clean":"2024-04-26T11:19:26.205502+0000","last_became_active":"2024-04-26T11:19:18.182242+0000","last_became_peered":"2024-04-26T11:19:18.182242+0000","last_unstale":"2024-04-26T11:19:26.205502+0000","last_undegraded":"2024-04-26T11:19:26.205502+0000","last_fullsized":"2024-04-26T11:19:26.205502+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:25.716967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204977+0000","last_change":"2024-04-26T11:13:12.912207+0000","last_active":"2024-04-26T11:19:26.204977+0000","last_peered":"2024-04-26T11:19:26.204977+0000","last_clean":"2024-04-26T11:19:26.204977+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:19:26.204977+0000","last_undegraded":"2024-04-26T11:19:26.204977+0000","last_fullsized":"2024-04-26T11:19:26.204977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204780+0000","last_change":"2024-04-26T11:19:18.181652+0000","last_active":"2024-04-26T11:19:26.204780+0000","last_peered":"2024-04-26T11:19:26.204780+0000","last_clean":"2024-04-26T11:19:26.204780+0000","last_became_active":"2024-04-26T11:19:18.180506+0000","last_became_peered":"2024-04-26T11:19:18.180506+0000","last_unstale":"2024-04-26T11:19:26.204780+0000","last_undegraded":"2024-04-26T11:19:26.204780+0000","last_fullsized":"2024-04-26T11:19:26.204780+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:52.115128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204377+0000","last_change":"2024-04-26T11:19:18.186849+0000","last_active":"2024-04-26T11:19:26.204377+0000","last_peered":"2024-04-26T11:19:26.204377+0000","last_clean":"2024-04-26T11:19:26.204377+0000","last_became_active":"2024-04-26T11:19:18.185355+0000","last_became_peered":"2024-04-26T11:19:18.185355+0000","last_unstale":"2024-04-26T11:19:26.204377+0000","last_undegraded":"2024-04-26T11:19:26.204377+0000","last_fullsized":"2024-04-26T11:19:26.204377+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:21.536805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205106+0000","last_change":"2024-04-26T11:19:18.188150+0000","last_active":"2024-04-26T11:19:26.205106+0000","last_peered":"2024-04-26T11:19:26.205106+0000","last_clean":"2024-04-26T11:19:26.205106+0000","last_became_active":"2024-04-26T11:19:18.186342+0000","last_became_peered":"2024-04-26T11:19:18.186342+0000","last_unstale":"2024-04-26T11:19:26.205106+0000","last_undegraded":"2024-04-26T11:19:26.205106+0000","last_fullsized":"2024-04-26T11:19:26.205106+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:49.270374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204487+0000","last_change":"2024-04-26T11:19:24.201645+0000","last_active":"2024-04-26T11:19:26.204487+0000","last_peered":"2024-04-26T11:19:26.204487+0000","last_clean":"2024-04-26T11:19:26.204487+0000","last_became_active":"2024-04-26T11:19:24.201330+0000","last_became_peered":"2024-04-26T11:19:24.201330+0000","last_unstale":"2024-04-26T11:19:26.204487+0000","last_undegraded":"2024-04-26T11:19:26.204487+0000","last_fullsized":"2024-04-26T11:19:26.204487+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:29.326197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204383+0000","last_change":"2024-04-26T11:19:24.201672+0000","last_active":"2024-04-26T11:19:26.204383+0000","last_peered":"2024-04-26T11:19:26.204383+0000","last_clean":"2024-04-26T11:19:26.204383+0000","last_became_active":"2024-04-26T11:19:24.201077+0000","last_became_peered":"2024-04-26T11:19:24.201077+0000","last_unstale":"2024-04-26T11:19:26.204383+0000","last_undegraded":"2024-04-26T11:19:26.204383+0000","last_fullsized":"2024-04-26T11:19:26.204383+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:42.500892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204910+0000","last_change":"2024-04-26T11:19:18.187865+0000","last_active":"2024-04-26T11:19:26.204910+0000","last_peered":"2024-04-26T11:19:26.204910+0000","last_clean":"2024-04-26T11:19:26.204910+0000","last_became_active":"2024-04-26T11:19:18.185768+0000","last_became_peered":"2024-04-26T11:19:18.185768+0000","last_unstale":"2024-04-26T11:19:26.204910+0000","last_undegraded":"2024-04-26T11:19:26.204910+0000","last_fullsized":"2024-04-26T11:19:26.204910+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:22.710616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204221+0000","last_change":"2024-04-26T11:19:18.186275+0000","last_active":"2024-04-26T11:19:26.204221+0000","last_peered":"2024-04-26T11:19:26.204221+0000","last_clean":"2024-04-26T11:19:26.204221+0000","last_became_active":"2024-04-26T11:19:18.184149+0000","last_became_peered":"2024-04-26T11:19:18.184149+0000","last_unstale":"2024-04-26T11:19:26.204221+0000","last_undegraded":"2024-04-26T11:19:26.204221+0000","last_fullsized":"2024-04-26T11:19:26.204221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:26.309810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205022+0000","last_change":"2024-04-26T11:19:18.184312+0000","last_active":"2024-04-26T11:19:26.205022+0000","last_peered":"2024-04-26T11:19:26.205022+0000","last_clean":"2024-04-26T11:19:26.205022+0000","last_became_active":"2024-04-26T11:19:18.181951+0000","last_became_peered":"2024-04-26T11:19:18.181951+0000","last_unstale":"2024-04-26T11:19:26.205022+0000","last_undegraded":"2024-04-26T11:19:26.205022+0000","last_fullsized":"2024-04-26T11:19:26.205022+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:45.284225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":106,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204701+0000","last_change":"2024-04-26T11:19:18.182240+0000","last_active":"2024-04-26T11:19:26.204701+0000","last_peered":"2024-04-26T11:19:26.204701+0000","last_clean":"2024-04-26T11:19:26.204701+0000","last_became_active":"2024-04-26T11:19:18.181767+0000","last_became_peered":"2024-04-26T11:19:18.181767+0000","last_unstale":"2024-04-26T11:19:26.204701+0000","last_undegraded":"2024-04-26T11:19:26.204701+0000","last_fullsized":"2024-04-26T11:19:26.204701+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:37:45.829872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205175+0000","last_change":"2024-04-26T11:19:18.183033+0000","last_active":"2024-04-26T11:19:26.205175+0000","last_peered":"2024-04-26T11:19:26.205175+0000","last_clean":"2024-04-26T11:19:26.205175+0000","last_became_active":"2024-04-26T11:19:18.182060+0000","last_became_peered":"2024-04-26T11:19:18.182060+0000","last_unstale":"2024-04-26T11:19:26.205175+0000","last_undegraded":"2024-04-26T11:19:26.205175+0000","last_fullsized":"2024-04-26T11:19:26.205175+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:27.875590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204716+0000","last_change":"2024-04-26T11:13:12.493217+0000","last_active":"2024-04-26T11:19:26.204716+0000","last_peered":"2024-04-26T11:19:26.204716+0000","last_clean":"2024-04-26T11:19:26.204716+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:19:26.204716+0000","last_undegraded":"2024-04-26T11:19:26.204716+0000","last_fullsized":"2024-04-26T11:19:26.204716+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:00.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684546+0000","last_change":"2024-04-26T11:19:24.204856+0000","last_active":"2024-04-26T11:19:26.684546+0000","last_peered":"2024-04-26T11:19:26.684546+0000","last_clean":"2024-04-26T11:19:26.684546+0000","last_became_active":"2024-04-26T11:19:24.203758+0000","last_became_peered":"2024-04-26T11:19:24.203758+0000","last_unstale":"2024-04-26T11:19:26.684546+0000","last_undegraded":"2024-04-26T11:19:26.684546+0000","last_fullsized":"2024-04-26T11:19:26.684546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:33.131784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684419+0000","last_change":"2024-04-26T11:19:24.201687+0000","last_active":"2024-04-26T11:19:26.684419+0000","last_peered":"2024-04-26T11:19:26.684419+0000","last_clean":"2024-04-26T11:19:26.684419+0000","last_became_active":"2024-04-26T11:19:24.200963+0000","last_became_peered":"2024-04-26T11:19:24.200963+0000","last_unstale":"2024-04-26T11:19:26.684419+0000","last_undegraded":"2024-04-26T11:19:26.684419+0000","last_fullsized":"2024-04-26T11:19:26.684419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:30:42.125098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205206+0000","last_change":"2024-04-26T11:19:18.189488+0000","last_active":"2024-04-26T11:19:26.205206+0000","last_peered":"2024-04-26T11:19:26.205206+0000","last_clean":"2024-04-26T11:19:26.205206+0000","last_became_active":"2024-04-26T11:19:18.189086+0000","last_became_peered":"2024-04-26T11:19:18.189086+0000","last_unstale":"2024-04-26T11:19:26.205206+0000","last_undegraded":"2024-04-26T11:19:26.205206+0000","last_fullsized":"2024-04-26T11:19:26.205206+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:00.540494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204973+0000","last_change":"2024-04-26T11:19:18.182582+0000","last_active":"2024-04-26T11:19:26.204973+0000","last_peered":"2024-04-26T11:19:26.204973+0000","last_clean":"2024-04-26T11:19:26.204973+0000","last_became_active":"2024-04-26T11:19:18.181791+0000","last_became_peered":"2024-04-26T11:19:18.181791+0000","last_unstale":"2024-04-26T11:19:26.204973+0000","last_undegraded":"2024-04-26T11:19:26.204973+0000","last_fullsized":"2024-04-26T11:19:26.204973+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:59.312651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204228+0000","last_change":"2024-04-26T11:19:18.185313+0000","last_active":"2024-04-26T11:19:26.204228+0000","last_peered":"2024-04-26T11:19:26.204228+0000","last_clean":"2024-04-26T11:19:26.204228+0000","last_became_active":"2024-04-26T11:19:18.183292+0000","last_became_peered":"2024-04-26T11:19:18.183292+0000","last_unstale":"2024-04-26T11:19:26.204228+0000","last_undegraded":"2024-04-26T11:19:26.204228+0000","last_fullsized":"2024-04-26T11:19:26.204228+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:05.860349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204969+0000","last_change":"2024-04-26T11:19:18.190450+0000","last_active":"2024-04-26T11:19:26.204969+0000","last_peered":"2024-04-26T11:19:26.204969+0000","last_clean":"2024-04-26T11:19:26.204969+0000","last_became_active":"2024-04-26T11:19:18.190096+0000","last_became_peered":"2024-04-26T11:19:18.190096+0000","last_unstale":"2024-04-26T11:19:26.204969+0000","last_undegraded":"2024-04-26T11:19:26.204969+0000","last_fullsized":"2024-04-26T11:19:26.204969+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:26.905702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684402+0000","last_change":"2024-04-26T11:19:24.200305+0000","last_active":"2024-04-26T11:19:26.684402+0000","last_peered":"2024-04-26T11:19:26.684402+0000","last_clean":"2024-04-26T11:19:26.684402+0000","last_became_active":"2024-04-26T11:19:24.199834+0000","last_became_peered":"2024-04-26T11:19:24.199834+0000","last_unstale":"2024-04-26T11:19:26.684402+0000","last_undegraded":"2024-04-26T11:19:26.684402+0000","last_fullsized":"2024-04-26T11:19:26.684402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:47.203614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684327+0000","last_change":"2024-04-26T11:19:24.197329+0000","last_active":"2024-04-26T11:19:26.684327+0000","last_peered":"2024-04-26T11:19:26.684327+0000","last_clean":"2024-04-26T11:19:26.684327+0000","last_became_active":"2024-04-26T11:19:24.196561+0000","last_became_peered":"2024-04-26T11:19:24.196561+0000","last_unstale":"2024-04-26T11:19:26.684327+0000","last_undegraded":"2024-04-26T11:19:26.684327+0000","last_fullsized":"2024-04-26T11:19:26.684327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:06.140967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":107,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204709+0000","last_change":"2024-04-26T11:19:18.182680+0000","last_active":"2024-04-26T11:19:26.204709+0000","last_peered":"2024-04-26T11:19:26.204709+0000","last_clean":"2024-04-26T11:19:26.204709+0000","last_became_active":"2024-04-26T11:19:18.182077+0000","last_became_peered":"2024-04-26T11:19:18.182077+0000","last_unstale":"2024-04-26T11:19:26.204709+0000","last_undegraded":"2024-04-26T11:19:26.204709+0000","last_fullsized":"2024-04-26T11:19:26.204709+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:48.832886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684566+0000","last_change":"2024-04-26T11:19:24.205473+0000","last_active":"2024-04-26T11:19:26.684566+0000","last_peered":"2024-04-26T11:19:26.684566+0000","last_clean":"2024-04-26T11:19:26.684566+0000","last_became_active":"2024-04-26T11:19:24.204538+0000","last_became_peered":"2024-04-26T11:19:24.204538+0000","last_unstale":"2024-04-26T11:19:26.684566+0000","last_undegraded":"2024-04-26T11:19:26.684566+0000","last_fullsized":"2024-04-26T11:19:26.684566+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:55.279045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204413+0000","last_change":"2024-04-26T11:19:18.186884+0000","last_active":"2024-04-26T11:19:26.204413+0000","last_peered":"2024-04-26T11:19:26.204413+0000","last_clean":"2024-04-26T11:19:26.204413+0000","last_became_active":"2024-04-26T11:19:18.184460+0000","last_became_peered":"2024-04-26T11:19:18.184460+0000","last_unstale":"2024-04-26T11:19:26.204413+0000","last_undegraded":"2024-04-26T11:19:26.204413+0000","last_fullsized":"2024-04-26T11:19:26.204413+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:12.901543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":234,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204187+0000","last_change":"2024-04-26T11:19:18.181070+0000","last_active":"2024-04-26T11:19:26.204187+0000","last_peered":"2024-04-26T11:19:26.204187+0000","last_clean":"2024-04-26T11:19:26.204187+0000","last_became_active":"2024-04-26T11:19:18.180577+0000","last_became_peered":"2024-04-26T11:19:18.180577+0000","last_unstale":"2024-04-26T11:19:26.204187+0000","last_undegraded":"2024-04-26T11:19:26.204187+0000","last_fullsized":"2024-04-26T11:19:26.204187+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:34:03.095255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684351+0000","last_change":"2024-04-26T11:19:24.197315+0000","last_active":"2024-04-26T11:19:26.684351+0000","last_peered":"2024-04-26T11:19:26.684351+0000","last_clean":"2024-04-26T11:19:26.684351+0000","last_became_active":"2024-04-26T11:19:24.196404+0000","last_became_peered":"2024-04-26T11:19:24.196404+0000","last_unstale":"2024-04-26T11:19:26.684351+0000","last_undegraded":"2024-04-26T11:19:26.684351+0000","last_fullsized":"2024-04-26T11:19:26.684351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:21:58.513393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204960+0000","last_change":"2024-04-26T11:19:18.184063+0000","last_active":"2024-04-26T11:19:26.204960+0000","last_peered":"2024-04-26T11:19:26.204960+0000","last_clean":"2024-04-26T11:19:26.204960+0000","last_became_active":"2024-04-26T11:19:18.181863+0000","last_became_peered":"2024-04-26T11:19:18.181863+0000","last_unstale":"2024-04-26T11:19:26.204960+0000","last_undegraded":"2024-04-26T11:19:26.204960+0000","last_fullsized":"2024-04-26T11:19:26.204960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:53.865511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204315+0000","last_change":"2024-04-26T11:19:18.181362+0000","last_active":"2024-04-26T11:19:26.204315+0000","last_peered":"2024-04-26T11:19:26.204315+0000","last_clean":"2024-04-26T11:19:26.204315+0000","last_became_active":"2024-04-26T11:19:18.180792+0000","last_became_peered":"2024-04-26T11:19:18.180792+0000","last_unstale":"2024-04-26T11:19:26.204315+0000","last_undegraded":"2024-04-26T11:19:26.204315+0000","last_fullsized":"2024-04-26T11:19:26.204315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:16.215932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.209802+0000","last_change":"2024-04-26T11:19:24.199071+0000","last_active":"2024-04-26T11:19:27.209802+0000","last_peered":"2024-04-26T11:19:27.209802+0000","last_clean":"2024-04-26T11:19:27.209802+0000","last_became_active":"2024-04-26T11:19:24.197711+0000","last_became_peered":"2024-04-26T11:19:24.197711+0000","last_unstale":"2024-04-26T11:19:27.209802+0000","last_undegraded":"2024-04-26T11:19:27.209802+0000","last_fullsized":"2024-04-26T11:19:27.209802+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:34.664546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205609+0000","last_change":"2024-04-26T11:13:12.918648+0000","last_active":"2024-04-26T11:19:26.205609+0000","last_peered":"2024-04-26T11:19:26.205609+0000","last_clean":"2024-04-26T11:19:26.205609+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:19:26.205609+0000","last_undegraded":"2024-04-26T11:19:26.205609+0000","last_fullsized":"2024-04-26T11:19:26.205609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.631673+0000","last_change":"2024-04-26T11:13:08.110433+0000","last_active":"2024-04-26T11:19:26.631673+0000","last_peered":"2024-04-26T11:19:26.631673+0000","last_clean":"2024-04-26T11:19:26.631673+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:19:26.631673+0000","last_undegraded":"2024-04-26T11:19:26.631673+0000","last_fullsized":"2024-04-26T11:19:26.631673+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684429+0000","last_change":"2024-04-26T11:19:24.203404+0000","last_active":"2024-04-26T11:19:26.684429+0000","last_peered":"2024-04-26T11:19:26.684429+0000","last_clean":"2024-04-26T11:19:26.684429+0000","last_became_active":"2024-04-26T11:19:24.202550+0000","last_became_peered":"2024-04-26T11:19:24.202550+0000","last_unstale":"2024-04-26T11:19:26.684429+0000","last_undegraded":"2024-04-26T11:19:26.684429+0000","last_fullsized":"2024-04-26T11:19:26.684429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:22.115008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204932+0000","last_change":"2024-04-26T11:19:18.182788+0000","last_active":"2024-04-26T11:19:26.204932+0000","last_peered":"2024-04-26T11:19:26.204932+0000","last_clean":"2024-04-26T11:19:26.204932+0000","last_became_active":"2024-04-26T11:19:18.182186+0000","last_became_peered":"2024-04-26T11:19:18.182186+0000","last_unstale":"2024-04-26T11:19:26.204932+0000","last_undegraded":"2024-04-26T11:19:26.204932+0000","last_fullsized":"2024-04-26T11:19:26.204932+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:26.933717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684536+0000","last_change":"2024-04-26T11:19:24.203482+0000","last_active":"2024-04-26T11:19:26.684536+0000","last_peered":"2024-04-26T11:19:26.684536+0000","last_clean":"2024-04-26T11:19:26.684536+0000","last_became_active":"2024-04-26T11:19:24.202310+0000","last_became_peered":"2024-04-26T11:19:24.202310+0000","last_unstale":"2024-04-26T11:19:26.684536+0000","last_undegraded":"2024-04-26T11:19:26.684536+0000","last_fullsized":"2024-04-26T11:19:26.684536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:57:50.731804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684477+0000","last_change":"2024-04-26T11:19:24.202951+0000","last_active":"2024-04-26T11:19:26.684477+0000","last_peered":"2024-04-26T11:19:26.684477+0000","last_clean":"2024-04-26T11:19:26.684477+0000","last_became_active":"2024-04-26T11:19:24.202566+0000","last_became_peered":"2024-04-26T11:19:24.202566+0000","last_unstale":"2024-04-26T11:19:26.684477+0000","last_undegraded":"2024-04-26T11:19:26.684477+0000","last_fullsized":"2024-04-26T11:19:26.684477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:55.762840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204185+0000","last_change":"2024-04-26T11:19:24.198685+0000","last_active":"2024-04-26T11:19:26.204185+0000","last_peered":"2024-04-26T11:19:26.204185+0000","last_clean":"2024-04-26T11:19:26.204185+0000","last_became_active":"2024-04-26T11:19:24.197383+0000","last_became_peered":"2024-04-26T11:19:24.197383+0000","last_unstale":"2024-04-26T11:19:26.204185+0000","last_undegraded":"2024-04-26T11:19:26.204185+0000","last_fullsized":"2024-04-26T11:19:26.204185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:08:32.146962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204870+0000","last_change":"2024-04-26T11:19:18.181795+0000","last_active":"2024-04-26T11:19:26.204870+0000","last_peered":"2024-04-26T11:19:26.204870+0000","last_clean":"2024-04-26T11:19:26.204870+0000","last_became_active":"2024-04-26T11:19:18.180871+0000","last_became_peered":"2024-04-26T11:19:18.180871+0000","last_unstale":"2024-04-26T11:19:26.204870+0000","last_undegraded":"2024-04-26T11:19:26.204870+0000","last_fullsized":"2024-04-26T11:19:26.204870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:23.698612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204826+0000","last_change":"2024-04-26T11:19:24.200015+0000","last_active":"2024-04-26T11:19:26.204826+0000","last_peered":"2024-04-26T11:19:26.204826+0000","last_clean":"2024-04-26T11:19:26.204826+0000","last_became_active":"2024-04-26T11:19:24.198853+0000","last_became_peered":"2024-04-26T11:19:24.198853+0000","last_unstale":"2024-04-26T11:19:26.204826+0000","last_undegraded":"2024-04-26T11:19:26.204826+0000","last_fullsized":"2024-04-26T11:19:26.204826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:17.832954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210690+0000","last_change":"2024-04-26T11:19:18.182878+0000","last_active":"2024-04-26T11:19:27.210690+0000","last_peered":"2024-04-26T11:19:27.210690+0000","last_clean":"2024-04-26T11:19:27.210690+0000","last_became_active":"2024-04-26T11:19:18.182228+0000","last_became_peered":"2024-04-26T11:19:18.182228+0000","last_unstale":"2024-04-26T11:19:27.210690+0000","last_undegraded":"2024-04-26T11:19:27.210690+0000","last_fullsized":"2024-04-26T11:19:27.210690+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:34.672880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205075+0000","last_change":"2024-04-26T11:19:18.183238+0000","last_active":"2024-04-26T11:19:26.205075+0000","last_peered":"2024-04-26T11:19:26.205075+0000","last_clean":"2024-04-26T11:19:26.205075+0000","last_became_active":"2024-04-26T11:19:18.182671+0000","last_became_peered":"2024-04-26T11:19:18.182671+0000","last_unstale":"2024-04-26T11:19:26.205075+0000","last_undegraded":"2024-04-26T11:19:26.205075+0000","last_fullsized":"2024-04-26T11:19:26.205075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:49.368568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205360+0000","last_change":"2024-04-26T11:13:12.917812+0000","last_active":"2024-04-26T11:19:26.205360+0000","last_peered":"2024-04-26T11:19:26.205360+0000","last_clean":"2024-04-26T11:19:26.205360+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:19:26.205360+0000","last_undegraded":"2024-04-26T11:19:26.205360+0000","last_fullsized":"2024-04-26T11:19:26.205360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205222+0000","last_change":"2024-04-26T11:19:18.188983+0000","last_active":"2024-04-26T11:19:26.205222+0000","last_peered":"2024-04-26T11:19:26.205222+0000","last_clean":"2024-04-26T11:19:26.205222+0000","last_became_active":"2024-04-26T11:19:18.188177+0000","last_became_peered":"2024-04-26T11:19:18.188177+0000","last_unstale":"2024-04-26T11:19:26.205222+0000","last_undegraded":"2024-04-26T11:19:26.205222+0000","last_fullsized":"2024-04-26T11:19:26.205222+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:31.255327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204597+0000","last_change":"2024-04-26T11:19:18.188002+0000","last_active":"2024-04-26T11:19:26.204597+0000","last_peered":"2024-04-26T11:19:26.204597+0000","last_clean":"2024-04-26T11:19:26.204597+0000","last_became_active":"2024-04-26T11:19:18.185372+0000","last_became_peered":"2024-04-26T11:19:18.185372+0000","last_unstale":"2024-04-26T11:19:26.204597+0000","last_undegraded":"2024-04-26T11:19:26.204597+0000","last_fullsized":"2024-04-26T11:19:26.204597+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:04.942442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205645+0000","last_change":"2024-04-26T11:19:18.190885+0000","last_active":"2024-04-26T11:19:26.205645+0000","last_peered":"2024-04-26T11:19:26.205645+0000","last_clean":"2024-04-26T11:19:26.205645+0000","last_became_active":"2024-04-26T11:19:18.190374+0000","last_became_peered":"2024-04-26T11:19:18.190374+0000","last_unstale":"2024-04-26T11:19:26.205645+0000","last_undegraded":"2024-04-26T11:19:26.205645+0000","last_fullsized":"2024-04-26T11:19:26.205645+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:53.646080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204769+0000","last_change":"2024-04-26T11:19:18.189666+0000","last_active":"2024-04-26T11:19:26.204769+0000","last_peered":"2024-04-26T11:19:26.204769+0000","last_clean":"2024-04-26T11:19:26.204769+0000","last_became_active":"2024-04-26T11:19:18.189341+0000","last_became_peered":"2024-04-26T11:19:18.189341+0000","last_unstale":"2024-04-26T11:19:26.204769+0000","last_undegraded":"2024-04-26T11:19:26.204769+0000","last_fullsized":"2024-04-26T11:19:26.204769+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:52.141583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684494+0000","last_change":"2024-04-26T11:19:24.202866+0000","last_active":"2024-04-26T11:19:26.684494+0000","last_peered":"2024-04-26T11:19:26.684494+0000","last_clean":"2024-04-26T11:19:26.684494+0000","last_became_active":"2024-04-26T11:19:24.202422+0000","last_became_peered":"2024-04-26T11:19:24.202422+0000","last_unstale":"2024-04-26T11:19:26.684494+0000","last_undegraded":"2024-04-26T11:19:26.684494+0000","last_fullsized":"2024-04-26T11:19:26.684494+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.564374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205080+0000","last_change":"2024-04-26T11:13:12.917763+0000","last_active":"2024-04-26T11:19:26.205080+0000","last_peered":"2024-04-26T11:19:26.205080+0000","last_clean":"2024-04-26T11:19:26.205080+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:19:26.205080+0000","last_undegraded":"2024-04-26T11:19:26.205080+0000","last_fullsized":"2024-04-26T11:19:26.205080+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204913+0000","last_change":"2024-04-26T11:19:24.205087+0000","last_active":"2024-04-26T11:19:26.204913+0000","last_peered":"2024-04-26T11:19:26.204913+0000","last_clean":"2024-04-26T11:19:26.204913+0000","last_became_active":"2024-04-26T11:19:24.204129+0000","last_became_peered":"2024-04-26T11:19:24.204129+0000","last_unstale":"2024-04-26T11:19:26.204913+0000","last_undegraded":"2024-04-26T11:19:26.204913+0000","last_fullsized":"2024-04-26T11:19:26.204913+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:15.916622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204637+0000","last_change":"2024-04-26T11:19:18.189530+0000","last_active":"2024-04-26T11:19:26.204637+0000","last_peered":"2024-04-26T11:19:26.204637+0000","last_clean":"2024-04-26T11:19:26.204637+0000","last_became_active":"2024-04-26T11:19:18.189179+0000","last_became_peered":"2024-04-26T11:19:18.189179+0000","last_unstale":"2024-04-26T11:19:26.204637+0000","last_undegraded":"2024-04-26T11:19:26.204637+0000","last_fullsized":"2024-04-26T11:19:26.204637+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.132608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204517+0000","last_change":"2024-04-26T11:19:18.189257+0000","last_active":"2024-04-26T11:19:26.204517+0000","last_peered":"2024-04-26T11:19:26.204517+0000","last_clean":"2024-04-26T11:19:26.204517+0000","last_became_active":"2024-04-26T11:19:18.188963+0000","last_became_peered":"2024-04-26T11:19:18.188963+0000","last_unstale":"2024-04-26T11:19:26.204517+0000","last_undegraded":"2024-04-26T11:19:26.204517+0000","last_fullsized":"2024-04-26T11:19:26.204517+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:37.907392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684318+0000","last_change":"2024-04-26T11:19:24.200217+0000","last_active":"2024-04-26T11:19:26.684318+0000","last_peered":"2024-04-26T11:19:26.684318+0000","last_clean":"2024-04-26T11:19:26.684318+0000","last_became_active":"2024-04-26T11:19:24.198397+0000","last_became_peered":"2024-04-26T11:19:24.198397+0000","last_unstale":"2024-04-26T11:19:26.684318+0000","last_undegraded":"2024-04-26T11:19:26.684318+0000","last_fullsized":"2024-04-26T11:19:26.684318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:44.576230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205025+0000","last_change":"2024-04-26T11:19:18.183441+0000","last_active":"2024-04-26T11:19:26.205025+0000","last_peered":"2024-04-26T11:19:26.205025+0000","last_clean":"2024-04-26T11:19:26.205025+0000","last_became_active":"2024-04-26T11:19:18.183037+0000","last_became_peered":"2024-04-26T11:19:18.183037+0000","last_unstale":"2024-04-26T11:19:26.205025+0000","last_undegraded":"2024-04-26T11:19:26.205025+0000","last_fullsized":"2024-04-26T11:19:26.205025+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:32.597584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684386+0000","last_change":"2024-04-26T11:19:24.203647+0000","last_active":"2024-04-26T11:19:26.684386+0000","last_peered":"2024-04-26T11:19:26.684386+0000","last_clean":"2024-04-26T11:19:26.684386+0000","last_became_active":"2024-04-26T11:19:24.202442+0000","last_became_peered":"2024-04-26T11:19:24.202442+0000","last_unstale":"2024-04-26T11:19:26.684386+0000","last_undegraded":"2024-04-26T11:19:26.684386+0000","last_fullsized":"2024-04-26T11:19:26.684386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:21.883832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205445+0000","last_change":"2024-04-26T11:19:18.184719+0000","last_active":"2024-04-26T11:19:26.205445+0000","last_peered":"2024-04-26T11:19:26.205445+0000","last_clean":"2024-04-26T11:19:26.205445+0000","last_became_active":"2024-04-26T11:19:18.184384+0000","last_became_peered":"2024-04-26T11:19:18.184384+0000","last_unstale":"2024-04-26T11:19:26.205445+0000","last_undegraded":"2024-04-26T11:19:26.205445+0000","last_fullsized":"2024-04-26T11:19:26.205445+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:37.130545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7958,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738447,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281152,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94090688,"statfs":{"total":96636764160,"available":96348864512,"internally_reserved":0,"allocated":1490944,"data_stored":947441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Fri Apr 26 11:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45800000000000002,"15min":0.39600000000000002},"min":{"1min":0.34399999999999997,"5min":0.17999999999999999,"15min":0.17199999999999999},"max":{"1min":0.68100000000000005,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.316,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.66400000000000003,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.60699999999999998}]}]},{"osd":0,"up_from":75,"seq":322122547204,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38160,"kb_used_data":1468,"kb_used_omap":10,"kb_used_meta":36661,"kb_avail":94333680,"statfs":{"total":96636764160,"available":96597688320,"internally_reserved":0,"allocated":1503232,"data_stored":949168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11228,"internal_metadata":37540900},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738448,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401140,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":400254,"kb_avail":93970700,"statfs":{"total":96636764160,"available":96225996800,"internally_reserved":0,"allocated":884736,"data_stored":357054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":409860550},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Fri Apr 26 11:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.44700000000000001,"15min":0.40699999999999997},"min":{"1min":0.34999999999999998,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.69199999999999995,"5min":2.056,"15min":2.056},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.499,"15min":0.46400000000000002},"min":{"1min":0.376,"5min":0.193,"15min":0.193},"max":{"1min":0.67600000000000005,"5min":3.9609999999999999,"15min":3.9609999999999999},"last":0.46000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7958,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:19:30.357 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:19:30.740 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:19:30.742 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:19:30.752 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":270,"stamp":"2024-04-26T11:19:30.561406+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":720452,"kb_used_data":3788,"kb_used_omap":14,"kb_used_meta":716593,"kb_avail":282395068,"statfs":{"total":289910292480,"available":289172549632,"internally_reserved":0,"allocated":3878912,"data_stored":2253663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14416,"internal_metadata":733792176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001090"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205605+0000","last_change":"2024-04-26T11:13:12.919196+0000","last_active":"2024-04-26T11:19:26.205605+0000","last_peered":"2024-04-26T11:19:26.205605+0000","last_clean":"2024-04-26T11:19:26.205605+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:19:26.205605+0000","last_undegraded":"2024-04-26T11:19:26.205605+0000","last_fullsized":"2024-04-26T11:19:26.205605+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205354+0000","last_change":"2024-04-26T11:13:12.917670+0000","last_active":"2024-04-26T11:19:26.205354+0000","last_peered":"2024-04-26T11:19:26.205354+0000","last_clean":"2024-04-26T11:19:26.205354+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:19:26.205354+0000","last_undegraded":"2024-04-26T11:19:26.205354+0000","last_fullsized":"2024-04-26T11:19:26.205354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205142+0000","last_change":"2024-04-26T11:19:18.185209+0000","last_active":"2024-04-26T11:19:26.205142+0000","last_peered":"2024-04-26T11:19:26.205142+0000","last_clean":"2024-04-26T11:19:26.205142+0000","last_became_active":"2024-04-26T11:19:18.182972+0000","last_became_peered":"2024-04-26T11:19:18.182972+0000","last_unstale":"2024-04-26T11:19:26.205142+0000","last_undegraded":"2024-04-26T11:19:26.205142+0000","last_fullsized":"2024-04-26T11:19:26.205142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:57.755970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204499+0000","last_change":"2024-04-26T11:19:18.183286+0000","last_active":"2024-04-26T11:19:26.204499+0000","last_peered":"2024-04-26T11:19:26.204499+0000","last_clean":"2024-04-26T11:19:26.204499+0000","last_became_active":"2024-04-26T11:19:18.182942+0000","last_became_peered":"2024-04-26T11:19:18.182942+0000","last_unstale":"2024-04-26T11:19:26.204499+0000","last_undegraded":"2024-04-26T11:19:26.204499+0000","last_fullsized":"2024-04-26T11:19:26.204499+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:58.370599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205030+0000","last_change":"2024-04-26T11:13:12.917403+0000","last_active":"2024-04-26T11:19:26.205030+0000","last_peered":"2024-04-26T11:19:26.205030+0000","last_clean":"2024-04-26T11:19:26.205030+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:19:26.205030+0000","last_undegraded":"2024-04-26T11:19:26.205030+0000","last_fullsized":"2024-04-26T11:19:26.205030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:42.014955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204622+0000","last_change":"2024-04-26T11:19:18.189355+0000","last_active":"2024-04-26T11:19:26.204622+0000","last_peered":"2024-04-26T11:19:26.204622+0000","last_clean":"2024-04-26T11:19:26.204622+0000","last_became_active":"2024-04-26T11:19:18.188990+0000","last_became_peered":"2024-04-26T11:19:18.188990+0000","last_unstale":"2024-04-26T11:19:26.204622+0000","last_undegraded":"2024-04-26T11:19:26.204622+0000","last_fullsized":"2024-04-26T11:19:26.204622+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:29.030847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204397+0000","last_change":"2024-04-26T11:19:18.187953+0000","last_active":"2024-04-26T11:19:26.204397+0000","last_peered":"2024-04-26T11:19:26.204397+0000","last_clean":"2024-04-26T11:19:26.204397+0000","last_became_active":"2024-04-26T11:19:18.186638+0000","last_became_peered":"2024-04-26T11:19:18.186638+0000","last_unstale":"2024-04-26T11:19:26.204397+0000","last_undegraded":"2024-04-26T11:19:26.204397+0000","last_fullsized":"2024-04-26T11:19:26.204397+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:18.483074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204062+0000","last_change":"2024-04-26T11:19:18.183968+0000","last_active":"2024-04-26T11:19:26.204062+0000","last_peered":"2024-04-26T11:19:26.204062+0000","last_clean":"2024-04-26T11:19:26.204062+0000","last_became_active":"2024-04-26T11:19:18.182111+0000","last_became_peered":"2024-04-26T11:19:18.182111+0000","last_unstale":"2024-04-26T11:19:26.204062+0000","last_undegraded":"2024-04-26T11:19:26.204062+0000","last_fullsized":"2024-04-26T11:19:26.204062+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:08.529468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684517+0000","last_change":"2024-04-26T11:19:24.202861+0000","last_active":"2024-04-26T11:19:26.684517+0000","last_peered":"2024-04-26T11:19:26.684517+0000","last_clean":"2024-04-26T11:19:26.684517+0000","last_became_active":"2024-04-26T11:19:24.202146+0000","last_became_peered":"2024-04-26T11:19:24.202146+0000","last_unstale":"2024-04-26T11:19:26.684517+0000","last_undegraded":"2024-04-26T11:19:26.684517+0000","last_fullsized":"2024-04-26T11:19:26.684517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:33.234821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205553+0000","last_change":"2024-04-26T11:13:12.918521+0000","last_active":"2024-04-26T11:19:26.205553+0000","last_peered":"2024-04-26T11:19:26.205553+0000","last_clean":"2024-04-26T11:19:26.205553+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:19:26.205553+0000","last_undegraded":"2024-04-26T11:19:26.205553+0000","last_fullsized":"2024-04-26T11:19:26.205553+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204805+0000","last_change":"2024-04-26T11:19:18.187027+0000","last_active":"2024-04-26T11:19:26.204805+0000","last_peered":"2024-04-26T11:19:26.204805+0000","last_clean":"2024-04-26T11:19:26.204805+0000","last_became_active":"2024-04-26T11:19:18.185543+0000","last_became_peered":"2024-04-26T11:19:18.185543+0000","last_unstale":"2024-04-26T11:19:26.204805+0000","last_undegraded":"2024-04-26T11:19:26.204805+0000","last_fullsized":"2024-04-26T11:19:26.204805+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:38.365806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205142+0000","last_change":"2024-04-26T11:19:18.183459+0000","last_active":"2024-04-26T11:19:26.205142+0000","last_peered":"2024-04-26T11:19:26.205142+0000","last_clean":"2024-04-26T11:19:26.205142+0000","last_became_active":"2024-04-26T11:19:18.182827+0000","last_became_peered":"2024-04-26T11:19:18.182827+0000","last_unstale":"2024-04-26T11:19:26.205142+0000","last_undegraded":"2024-04-26T11:19:26.205142+0000","last_fullsized":"2024-04-26T11:19:26.205142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:28.182922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205400+0000","last_change":"2024-04-26T11:13:12.915484+0000","last_active":"2024-04-26T11:19:26.205400+0000","last_peered":"2024-04-26T11:19:26.205400+0000","last_clean":"2024-04-26T11:19:26.205400+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:19:26.205400+0000","last_undegraded":"2024-04-26T11:19:26.205400+0000","last_fullsized":"2024-04-26T11:19:26.205400+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204505+0000","last_change":"2024-04-26T11:19:18.181800+0000","last_active":"2024-04-26T11:19:26.204505+0000","last_peered":"2024-04-26T11:19:26.204505+0000","last_clean":"2024-04-26T11:19:26.204505+0000","last_became_active":"2024-04-26T11:19:18.180865+0000","last_became_peered":"2024-04-26T11:19:18.180865+0000","last_unstale":"2024-04-26T11:19:26.204505+0000","last_undegraded":"2024-04-26T11:19:26.204505+0000","last_fullsized":"2024-04-26T11:19:26.204505+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:36.948796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204335+0000","last_change":"2024-04-26T11:19:18.181625+0000","last_active":"2024-04-26T11:19:26.204335+0000","last_peered":"2024-04-26T11:19:26.204335+0000","last_clean":"2024-04-26T11:19:26.204335+0000","last_became_active":"2024-04-26T11:19:18.180763+0000","last_became_peered":"2024-04-26T11:19:18.180763+0000","last_unstale":"2024-04-26T11:19:26.204335+0000","last_undegraded":"2024-04-26T11:19:26.204335+0000","last_fullsized":"2024-04-26T11:19:26.204335+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:27.138589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204271+0000","last_change":"2024-04-26T11:19:18.185161+0000","last_active":"2024-04-26T11:19:26.204271+0000","last_peered":"2024-04-26T11:19:26.204271+0000","last_clean":"2024-04-26T11:19:26.204271+0000","last_became_active":"2024-04-26T11:19:18.184331+0000","last_became_peered":"2024-04-26T11:19:18.184331+0000","last_unstale":"2024-04-26T11:19:26.204271+0000","last_undegraded":"2024-04-26T11:19:26.204271+0000","last_fullsized":"2024-04-26T11:19:26.204271+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:29.254144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684526+0000","last_change":"2024-04-26T11:19:24.204827+0000","last_active":"2024-04-26T11:19:26.684526+0000","last_peered":"2024-04-26T11:19:26.684526+0000","last_clean":"2024-04-26T11:19:26.684526+0000","last_became_active":"2024-04-26T11:19:24.203764+0000","last_became_peered":"2024-04-26T11:19:24.203764+0000","last_unstale":"2024-04-26T11:19:26.684526+0000","last_undegraded":"2024-04-26T11:19:26.684526+0000","last_fullsized":"2024-04-26T11:19:26.684526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:29.263130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205647+0000","last_change":"2024-04-26T11:13:12.918759+0000","last_active":"2024-04-26T11:19:26.205647+0000","last_peered":"2024-04-26T11:19:26.205647+0000","last_clean":"2024-04-26T11:19:26.205647+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:19:26.205647+0000","last_undegraded":"2024-04-26T11:19:26.205647+0000","last_fullsized":"2024-04-26T11:19:26.205647+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:55.002972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684440+0000","last_change":"2024-04-26T11:19:24.200114+0000","last_active":"2024-04-26T11:19:26.684440+0000","last_peered":"2024-04-26T11:19:26.684440+0000","last_clean":"2024-04-26T11:19:26.684440+0000","last_became_active":"2024-04-26T11:19:24.199142+0000","last_became_peered":"2024-04-26T11:19:24.199142+0000","last_unstale":"2024-04-26T11:19:26.684440+0000","last_undegraded":"2024-04-26T11:19:26.684440+0000","last_fullsized":"2024-04-26T11:19:26.684440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:04.789203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205065+0000","last_change":"2024-04-26T11:19:18.186823+0000","last_active":"2024-04-26T11:19:26.205065+0000","last_peered":"2024-04-26T11:19:26.205065+0000","last_clean":"2024-04-26T11:19:26.205065+0000","last_became_active":"2024-04-26T11:19:18.184282+0000","last_became_peered":"2024-04-26T11:19:18.184282+0000","last_unstale":"2024-04-26T11:19:26.205065+0000","last_undegraded":"2024-04-26T11:19:26.205065+0000","last_fullsized":"2024-04-26T11:19:26.205065+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:11.581601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204671+0000","last_change":"2024-04-26T11:19:18.187937+0000","last_active":"2024-04-26T11:19:26.204671+0000","last_peered":"2024-04-26T11:19:26.204671+0000","last_clean":"2024-04-26T11:19:26.204671+0000","last_became_active":"2024-04-26T11:19:18.186605+0000","last_became_peered":"2024-04-26T11:19:18.186605+0000","last_unstale":"2024-04-26T11:19:26.204671+0000","last_undegraded":"2024-04-26T11:19:26.204671+0000","last_fullsized":"2024-04-26T11:19:26.204671+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:49.737640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204850+0000","last_change":"2024-04-26T11:19:18.182666+0000","last_active":"2024-04-26T11:19:26.204850+0000","last_peered":"2024-04-26T11:19:26.204850+0000","last_clean":"2024-04-26T11:19:26.204850+0000","last_became_active":"2024-04-26T11:19:18.181728+0000","last_became_peered":"2024-04-26T11:19:18.181728+0000","last_unstale":"2024-04-26T11:19:26.204850+0000","last_undegraded":"2024-04-26T11:19:26.204850+0000","last_fullsized":"2024-04-26T11:19:26.204850+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:07.719581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.203921+0000","last_change":"2024-04-26T11:19:24.198562+0000","last_active":"2024-04-26T11:19:26.203921+0000","last_peered":"2024-04-26T11:19:26.203921+0000","last_clean":"2024-04-26T11:19:26.203921+0000","last_became_active":"2024-04-26T11:19:24.197487+0000","last_became_peered":"2024-04-26T11:19:24.197487+0000","last_unstale":"2024-04-26T11:19:26.203921+0000","last_undegraded":"2024-04-26T11:19:26.203921+0000","last_fullsized":"2024-04-26T11:19:26.203921+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:31.790885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204840+0000","last_change":"2024-04-26T11:13:12.912756+0000","last_active":"2024-04-26T11:19:26.204840+0000","last_peered":"2024-04-26T11:19:26.204840+0000","last_clean":"2024-04-26T11:19:26.204840+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:19:26.204840+0000","last_undegraded":"2024-04-26T11:19:26.204840+0000","last_fullsized":"2024-04-26T11:19:26.204840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:04.177831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205614+0000","last_change":"2024-04-26T11:19:18.184692+0000","last_active":"2024-04-26T11:19:26.205614+0000","last_peered":"2024-04-26T11:19:26.205614+0000","last_clean":"2024-04-26T11:19:26.205614+0000","last_became_active":"2024-04-26T11:19:18.184451+0000","last_became_peered":"2024-04-26T11:19:18.184451+0000","last_unstale":"2024-04-26T11:19:26.205614+0000","last_undegraded":"2024-04-26T11:19:26.205614+0000","last_fullsized":"2024-04-26T11:19:26.205614+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:08.485754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204759+0000","last_change":"2024-04-26T11:19:24.199954+0000","last_active":"2024-04-26T11:19:26.204759+0000","last_peered":"2024-04-26T11:19:26.204759+0000","last_clean":"2024-04-26T11:19:26.204759+0000","last_became_active":"2024-04-26T11:19:24.198479+0000","last_became_peered":"2024-04-26T11:19:24.198479+0000","last_unstale":"2024-04-26T11:19:26.204759+0000","last_undegraded":"2024-04-26T11:19:26.204759+0000","last_fullsized":"2024-04-26T11:19:26.204759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:14.221425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204917+0000","last_change":"2024-04-26T11:19:18.185709+0000","last_active":"2024-04-26T11:19:26.204917+0000","last_peered":"2024-04-26T11:19:26.204917+0000","last_clean":"2024-04-26T11:19:26.204917+0000","last_became_active":"2024-04-26T11:19:18.185105+0000","last_became_peered":"2024-04-26T11:19:18.185105+0000","last_unstale":"2024-04-26T11:19:26.204917+0000","last_undegraded":"2024-04-26T11:19:26.204917+0000","last_fullsized":"2024-04-26T11:19:26.204917+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:43.626259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204813+0000","last_change":"2024-04-26T11:13:12.493425+0000","last_active":"2024-04-26T11:19:26.204813+0000","last_peered":"2024-04-26T11:19:26.204813+0000","last_clean":"2024-04-26T11:19:26.204813+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:19:26.204813+0000","last_undegraded":"2024-04-26T11:19:26.204813+0000","last_fullsized":"2024-04-26T11:19:26.204813+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:23.279580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205712+0000","last_change":"2024-04-26T11:19:18.191042+0000","last_active":"2024-04-26T11:19:26.205712+0000","last_peered":"2024-04-26T11:19:26.205712+0000","last_clean":"2024-04-26T11:19:26.205712+0000","last_became_active":"2024-04-26T11:19:18.190792+0000","last_became_peered":"2024-04-26T11:19:18.190792+0000","last_unstale":"2024-04-26T11:19:26.205712+0000","last_undegraded":"2024-04-26T11:19:26.205712+0000","last_fullsized":"2024-04-26T11:19:26.205712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:45.726211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684337+0000","last_change":"2024-04-26T11:19:24.203467+0000","last_active":"2024-04-26T11:19:26.684337+0000","last_peered":"2024-04-26T11:19:26.684337+0000","last_clean":"2024-04-26T11:19:26.684337+0000","last_became_active":"2024-04-26T11:19:24.202348+0000","last_became_peered":"2024-04-26T11:19:24.202348+0000","last_unstale":"2024-04-26T11:19:26.684337+0000","last_undegraded":"2024-04-26T11:19:26.684337+0000","last_fullsized":"2024-04-26T11:19:26.684337+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:55.157485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204840+0000","last_change":"2024-04-26T11:19:24.200292+0000","last_active":"2024-04-26T11:19:26.204840+0000","last_peered":"2024-04-26T11:19:26.204840+0000","last_clean":"2024-04-26T11:19:26.204840+0000","last_became_active":"2024-04-26T11:19:24.198920+0000","last_became_peered":"2024-04-26T11:19:24.198920+0000","last_unstale":"2024-04-26T11:19:26.204840+0000","last_undegraded":"2024-04-26T11:19:26.204840+0000","last_fullsized":"2024-04-26T11:19:26.204840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:45.950568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684279+0000","last_change":"2024-04-26T11:19:24.199051+0000","last_active":"2024-04-26T11:19:26.684279+0000","last_peered":"2024-04-26T11:19:26.684279+0000","last_clean":"2024-04-26T11:19:26.684279+0000","last_became_active":"2024-04-26T11:19:24.197698+0000","last_became_peered":"2024-04-26T11:19:24.197698+0000","last_unstale":"2024-04-26T11:19:26.684279+0000","last_undegraded":"2024-04-26T11:19:26.684279+0000","last_fullsized":"2024-04-26T11:19:26.684279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:21.891894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211316+0000","last_change":"2024-04-26T11:19:18.190418+0000","last_active":"2024-04-26T11:19:27.211316+0000","last_peered":"2024-04-26T11:19:27.211316+0000","last_clean":"2024-04-26T11:19:27.211316+0000","last_became_active":"2024-04-26T11:19:18.190127+0000","last_became_peered":"2024-04-26T11:19:18.190127+0000","last_unstale":"2024-04-26T11:19:27.211316+0000","last_undegraded":"2024-04-26T11:19:27.211316+0000","last_fullsized":"2024-04-26T11:19:27.211316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:11:25.515683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205003+0000","last_change":"2024-04-26T11:19:24.205086+0000","last_active":"2024-04-26T11:19:26.205003+0000","last_peered":"2024-04-26T11:19:26.205003+0000","last_clean":"2024-04-26T11:19:26.205003+0000","last_became_active":"2024-04-26T11:19:24.204122+0000","last_became_peered":"2024-04-26T11:19:24.204122+0000","last_unstale":"2024-04-26T11:19:26.205003+0000","last_undegraded":"2024-04-26T11:19:26.205003+0000","last_fullsized":"2024-04-26T11:19:26.205003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:56:23.239851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684262+0000","last_change":"2024-04-26T11:19:24.198434+0000","last_active":"2024-04-26T11:19:26.684262+0000","last_peered":"2024-04-26T11:19:26.684262+0000","last_clean":"2024-04-26T11:19:26.684262+0000","last_became_active":"2024-04-26T11:19:24.197247+0000","last_became_peered":"2024-04-26T11:19:24.197247+0000","last_unstale":"2024-04-26T11:19:26.684262+0000","last_undegraded":"2024-04-26T11:19:26.684262+0000","last_fullsized":"2024-04-26T11:19:26.684262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:23.769249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204777+0000","last_change":"2024-04-26T11:19:18.187720+0000","last_active":"2024-04-26T11:19:26.204777+0000","last_peered":"2024-04-26T11:19:26.204777+0000","last_clean":"2024-04-26T11:19:26.204777+0000","last_became_active":"2024-04-26T11:19:18.185578+0000","last_became_peered":"2024-04-26T11:19:18.185578+0000","last_unstale":"2024-04-26T11:19:26.204777+0000","last_undegraded":"2024-04-26T11:19:26.204777+0000","last_fullsized":"2024-04-26T11:19:26.204777+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:38.482108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204346+0000","last_change":"2024-04-26T11:19:24.201728+0000","last_active":"2024-04-26T11:19:26.204346+0000","last_peered":"2024-04-26T11:19:26.204346+0000","last_clean":"2024-04-26T11:19:26.204346+0000","last_became_active":"2024-04-26T11:19:24.200992+0000","last_became_peered":"2024-04-26T11:19:24.200992+0000","last_unstale":"2024-04-26T11:19:26.204346+0000","last_undegraded":"2024-04-26T11:19:26.204346+0000","last_fullsized":"2024-04-26T11:19:26.204346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:59.859744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":109,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205523+0000","last_change":"2024-04-26T11:19:18.190998+0000","last_active":"2024-04-26T11:19:26.205523+0000","last_peered":"2024-04-26T11:19:26.205523+0000","last_clean":"2024-04-26T11:19:26.205523+0000","last_became_active":"2024-04-26T11:19:18.190381+0000","last_became_peered":"2024-04-26T11:19:18.190381+0000","last_unstale":"2024-04-26T11:19:26.205523+0000","last_undegraded":"2024-04-26T11:19:26.205523+0000","last_fullsized":"2024-04-26T11:19:26.205523+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:31.159104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684360+0000","last_change":"2024-04-26T11:19:24.200037+0000","last_active":"2024-04-26T11:19:26.684360+0000","last_peered":"2024-04-26T11:19:26.684360+0000","last_clean":"2024-04-26T11:19:26.684360+0000","last_became_active":"2024-04-26T11:19:24.199659+0000","last_became_peered":"2024-04-26T11:19:24.199659+0000","last_unstale":"2024-04-26T11:19:26.684360+0000","last_undegraded":"2024-04-26T11:19:26.684360+0000","last_fullsized":"2024-04-26T11:19:26.684360+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:49.275857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":45,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204850+0000","last_change":"2024-04-26T11:19:18.181316+0000","last_active":"2024-04-26T11:19:26.204850+0000","last_peered":"2024-04-26T11:19:26.204850+0000","last_clean":"2024-04-26T11:19:26.204850+0000","last_became_active":"2024-04-26T11:19:18.180711+0000","last_became_peered":"2024-04-26T11:19:18.180711+0000","last_unstale":"2024-04-26T11:19:26.204850+0000","last_undegraded":"2024-04-26T11:19:26.204850+0000","last_fullsized":"2024-04-26T11:19:26.204850+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:27.837108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204705+0000","last_change":"2024-04-26T11:19:18.182026+0000","last_active":"2024-04-26T11:19:26.204705+0000","last_peered":"2024-04-26T11:19:26.204705+0000","last_clean":"2024-04-26T11:19:26.204705+0000","last_became_active":"2024-04-26T11:19:18.181615+0000","last_became_peered":"2024-04-26T11:19:18.181615+0000","last_unstale":"2024-04-26T11:19:26.204705+0000","last_undegraded":"2024-04-26T11:19:26.204705+0000","last_fullsized":"2024-04-26T11:19:26.204705+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:56.083479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204459+0000","last_change":"2024-04-26T11:19:18.185625+0000","last_active":"2024-04-26T11:19:26.204459+0000","last_peered":"2024-04-26T11:19:26.204459+0000","last_clean":"2024-04-26T11:19:26.204459+0000","last_became_active":"2024-04-26T11:19:18.183103+0000","last_became_peered":"2024-04-26T11:19:18.183103+0000","last_unstale":"2024-04-26T11:19:26.204459+0000","last_undegraded":"2024-04-26T11:19:26.204459+0000","last_fullsized":"2024-04-26T11:19:26.204459+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:42.309969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205241+0000","last_change":"2024-04-26T11:13:12.916685+0000","last_active":"2024-04-26T11:19:26.205241+0000","last_peered":"2024-04-26T11:19:26.205241+0000","last_clean":"2024-04-26T11:19:26.205241+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:19:26.205241+0000","last_undegraded":"2024-04-26T11:19:26.205241+0000","last_fullsized":"2024-04-26T11:19:26.205241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204255+0000","last_change":"2024-04-26T11:19:24.199114+0000","last_active":"2024-04-26T11:19:26.204255+0000","last_peered":"2024-04-26T11:19:26.204255+0000","last_clean":"2024-04-26T11:19:26.204255+0000","last_became_active":"2024-04-26T11:19:24.197647+0000","last_became_peered":"2024-04-26T11:19:24.197647+0000","last_unstale":"2024-04-26T11:19:26.204255+0000","last_undegraded":"2024-04-26T11:19:26.204255+0000","last_fullsized":"2024-04-26T11:19:26.204255+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:23.938536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205618+0000","last_change":"2024-04-26T11:13:12.915238+0000","last_active":"2024-04-26T11:19:26.205618+0000","last_peered":"2024-04-26T11:19:26.205618+0000","last_clean":"2024-04-26T11:19:26.205618+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:19:26.205618+0000","last_undegraded":"2024-04-26T11:19:26.205618+0000","last_fullsized":"2024-04-26T11:19:26.205618+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:48.068465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":106,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204835+0000","last_change":"2024-04-26T11:19:18.182547+0000","last_active":"2024-04-26T11:19:26.204835+0000","last_peered":"2024-04-26T11:19:26.204835+0000","last_clean":"2024-04-26T11:19:26.204835+0000","last_became_active":"2024-04-26T11:19:18.181907+0000","last_became_peered":"2024-04-26T11:19:18.181907+0000","last_unstale":"2024-04-26T11:19:26.204835+0000","last_undegraded":"2024-04-26T11:19:26.204835+0000","last_fullsized":"2024-04-26T11:19:26.204835+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.076863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204980+0000","last_change":"2024-04-26T11:19:24.201756+0000","last_active":"2024-04-26T11:19:26.204980+0000","last_peered":"2024-04-26T11:19:26.204980+0000","last_clean":"2024-04-26T11:19:26.204980+0000","last_became_active":"2024-04-26T11:19:24.201114+0000","last_became_peered":"2024-04-26T11:19:24.201114+0000","last_unstale":"2024-04-26T11:19:26.204980+0000","last_undegraded":"2024-04-26T11:19:26.204980+0000","last_fullsized":"2024-04-26T11:19:26.204980+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:34.095066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204443+0000","last_change":"2024-04-26T11:19:18.182797+0000","last_active":"2024-04-26T11:19:26.204443+0000","last_peered":"2024-04-26T11:19:26.204443+0000","last_clean":"2024-04-26T11:19:26.204443+0000","last_became_active":"2024-04-26T11:19:18.182017+0000","last_became_peered":"2024-04-26T11:19:18.182017+0000","last_unstale":"2024-04-26T11:19:26.204443+0000","last_undegraded":"2024-04-26T11:19:26.204443+0000","last_fullsized":"2024-04-26T11:19:26.204443+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:41.531437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205077+0000","last_change":"2024-04-26T11:19:24.205310+0000","last_active":"2024-04-26T11:19:26.205077+0000","last_peered":"2024-04-26T11:19:26.205077+0000","last_clean":"2024-04-26T11:19:26.205077+0000","last_became_active":"2024-04-26T11:19:24.204476+0000","last_became_peered":"2024-04-26T11:19:24.204476+0000","last_unstale":"2024-04-26T11:19:26.205077+0000","last_undegraded":"2024-04-26T11:19:26.205077+0000","last_fullsized":"2024-04-26T11:19:26.205077+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:14.932094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205069+0000","last_change":"2024-04-26T11:19:18.181966+0000","last_active":"2024-04-26T11:19:26.205069+0000","last_peered":"2024-04-26T11:19:26.205069+0000","last_clean":"2024-04-26T11:19:26.205069+0000","last_became_active":"2024-04-26T11:19:18.181604+0000","last_became_peered":"2024-04-26T11:19:18.181604+0000","last_unstale":"2024-04-26T11:19:26.205069+0000","last_undegraded":"2024-04-26T11:19:26.205069+0000","last_fullsized":"2024-04-26T11:19:26.205069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:57.405893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204571+0000","last_change":"2024-04-26T11:19:18.181723+0000","last_active":"2024-04-26T11:19:26.204571+0000","last_peered":"2024-04-26T11:19:26.204571+0000","last_clean":"2024-04-26T11:19:26.204571+0000","last_became_active":"2024-04-26T11:19:18.181462+0000","last_became_peered":"2024-04-26T11:19:18.181462+0000","last_unstale":"2024-04-26T11:19:26.204571+0000","last_undegraded":"2024-04-26T11:19:26.204571+0000","last_fullsized":"2024-04-26T11:19:26.204571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:23.824505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205502+0000","last_change":"2024-04-26T11:19:18.183263+0000","last_active":"2024-04-26T11:19:26.205502+0000","last_peered":"2024-04-26T11:19:26.205502+0000","last_clean":"2024-04-26T11:19:26.205502+0000","last_became_active":"2024-04-26T11:19:18.182242+0000","last_became_peered":"2024-04-26T11:19:18.182242+0000","last_unstale":"2024-04-26T11:19:26.205502+0000","last_undegraded":"2024-04-26T11:19:26.205502+0000","last_fullsized":"2024-04-26T11:19:26.205502+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:25.716967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204977+0000","last_change":"2024-04-26T11:13:12.912207+0000","last_active":"2024-04-26T11:19:26.204977+0000","last_peered":"2024-04-26T11:19:26.204977+0000","last_clean":"2024-04-26T11:19:26.204977+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:19:26.204977+0000","last_undegraded":"2024-04-26T11:19:26.204977+0000","last_fullsized":"2024-04-26T11:19:26.204977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204780+0000","last_change":"2024-04-26T11:19:18.181652+0000","last_active":"2024-04-26T11:19:26.204780+0000","last_peered":"2024-04-26T11:19:26.204780+0000","last_clean":"2024-04-26T11:19:26.204780+0000","last_became_active":"2024-04-26T11:19:18.180506+0000","last_became_peered":"2024-04-26T11:19:18.180506+0000","last_unstale":"2024-04-26T11:19:26.204780+0000","last_undegraded":"2024-04-26T11:19:26.204780+0000","last_fullsized":"2024-04-26T11:19:26.204780+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:52.115128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204377+0000","last_change":"2024-04-26T11:19:18.186849+0000","last_active":"2024-04-26T11:19:26.204377+0000","last_peered":"2024-04-26T11:19:26.204377+0000","last_clean":"2024-04-26T11:19:26.204377+0000","last_became_active":"2024-04-26T11:19:18.185355+0000","last_became_peered":"2024-04-26T11:19:18.185355+0000","last_unstale":"2024-04-26T11:19:26.204377+0000","last_undegraded":"2024-04-26T11:19:26.204377+0000","last_fullsized":"2024-04-26T11:19:26.204377+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:21.536805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205106+0000","last_change":"2024-04-26T11:19:18.188150+0000","last_active":"2024-04-26T11:19:26.205106+0000","last_peered":"2024-04-26T11:19:26.205106+0000","last_clean":"2024-04-26T11:19:26.205106+0000","last_became_active":"2024-04-26T11:19:18.186342+0000","last_became_peered":"2024-04-26T11:19:18.186342+0000","last_unstale":"2024-04-26T11:19:26.205106+0000","last_undegraded":"2024-04-26T11:19:26.205106+0000","last_fullsized":"2024-04-26T11:19:26.205106+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:49.270374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204487+0000","last_change":"2024-04-26T11:19:24.201645+0000","last_active":"2024-04-26T11:19:26.204487+0000","last_peered":"2024-04-26T11:19:26.204487+0000","last_clean":"2024-04-26T11:19:26.204487+0000","last_became_active":"2024-04-26T11:19:24.201330+0000","last_became_peered":"2024-04-26T11:19:24.201330+0000","last_unstale":"2024-04-26T11:19:26.204487+0000","last_undegraded":"2024-04-26T11:19:26.204487+0000","last_fullsized":"2024-04-26T11:19:26.204487+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:29.326197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204383+0000","last_change":"2024-04-26T11:19:24.201672+0000","last_active":"2024-04-26T11:19:26.204383+0000","last_peered":"2024-04-26T11:19:26.204383+0000","last_clean":"2024-04-26T11:19:26.204383+0000","last_became_active":"2024-04-26T11:19:24.201077+0000","last_became_peered":"2024-04-26T11:19:24.201077+0000","last_unstale":"2024-04-26T11:19:26.204383+0000","last_undegraded":"2024-04-26T11:19:26.204383+0000","last_fullsized":"2024-04-26T11:19:26.204383+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:42.500892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204910+0000","last_change":"2024-04-26T11:19:18.187865+0000","last_active":"2024-04-26T11:19:26.204910+0000","last_peered":"2024-04-26T11:19:26.204910+0000","last_clean":"2024-04-26T11:19:26.204910+0000","last_became_active":"2024-04-26T11:19:18.185768+0000","last_became_peered":"2024-04-26T11:19:18.185768+0000","last_unstale":"2024-04-26T11:19:26.204910+0000","last_undegraded":"2024-04-26T11:19:26.204910+0000","last_fullsized":"2024-04-26T11:19:26.204910+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:22.710616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204221+0000","last_change":"2024-04-26T11:19:18.186275+0000","last_active":"2024-04-26T11:19:26.204221+0000","last_peered":"2024-04-26T11:19:26.204221+0000","last_clean":"2024-04-26T11:19:26.204221+0000","last_became_active":"2024-04-26T11:19:18.184149+0000","last_became_peered":"2024-04-26T11:19:18.184149+0000","last_unstale":"2024-04-26T11:19:26.204221+0000","last_undegraded":"2024-04-26T11:19:26.204221+0000","last_fullsized":"2024-04-26T11:19:26.204221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:26.309810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205022+0000","last_change":"2024-04-26T11:19:18.184312+0000","last_active":"2024-04-26T11:19:26.205022+0000","last_peered":"2024-04-26T11:19:26.205022+0000","last_clean":"2024-04-26T11:19:26.205022+0000","last_became_active":"2024-04-26T11:19:18.181951+0000","last_became_peered":"2024-04-26T11:19:18.181951+0000","last_unstale":"2024-04-26T11:19:26.205022+0000","last_undegraded":"2024-04-26T11:19:26.205022+0000","last_fullsized":"2024-04-26T11:19:26.205022+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:45.284225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":106,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204701+0000","last_change":"2024-04-26T11:19:18.182240+0000","last_active":"2024-04-26T11:19:26.204701+0000","last_peered":"2024-04-26T11:19:26.204701+0000","last_clean":"2024-04-26T11:19:26.204701+0000","last_became_active":"2024-04-26T11:19:18.181767+0000","last_became_peered":"2024-04-26T11:19:18.181767+0000","last_unstale":"2024-04-26T11:19:26.204701+0000","last_undegraded":"2024-04-26T11:19:26.204701+0000","last_fullsized":"2024-04-26T11:19:26.204701+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:37:45.829872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205175+0000","last_change":"2024-04-26T11:19:18.183033+0000","last_active":"2024-04-26T11:19:26.205175+0000","last_peered":"2024-04-26T11:19:26.205175+0000","last_clean":"2024-04-26T11:19:26.205175+0000","last_became_active":"2024-04-26T11:19:18.182060+0000","last_became_peered":"2024-04-26T11:19:18.182060+0000","last_unstale":"2024-04-26T11:19:26.205175+0000","last_undegraded":"2024-04-26T11:19:26.205175+0000","last_fullsized":"2024-04-26T11:19:26.205175+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:27.875590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204716+0000","last_change":"2024-04-26T11:13:12.493217+0000","last_active":"2024-04-26T11:19:26.204716+0000","last_peered":"2024-04-26T11:19:26.204716+0000","last_clean":"2024-04-26T11:19:26.204716+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:19:26.204716+0000","last_undegraded":"2024-04-26T11:19:26.204716+0000","last_fullsized":"2024-04-26T11:19:26.204716+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:00.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684546+0000","last_change":"2024-04-26T11:19:24.204856+0000","last_active":"2024-04-26T11:19:26.684546+0000","last_peered":"2024-04-26T11:19:26.684546+0000","last_clean":"2024-04-26T11:19:26.684546+0000","last_became_active":"2024-04-26T11:19:24.203758+0000","last_became_peered":"2024-04-26T11:19:24.203758+0000","last_unstale":"2024-04-26T11:19:26.684546+0000","last_undegraded":"2024-04-26T11:19:26.684546+0000","last_fullsized":"2024-04-26T11:19:26.684546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:33.131784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684419+0000","last_change":"2024-04-26T11:19:24.201687+0000","last_active":"2024-04-26T11:19:26.684419+0000","last_peered":"2024-04-26T11:19:26.684419+0000","last_clean":"2024-04-26T11:19:26.684419+0000","last_became_active":"2024-04-26T11:19:24.200963+0000","last_became_peered":"2024-04-26T11:19:24.200963+0000","last_unstale":"2024-04-26T11:19:26.684419+0000","last_undegraded":"2024-04-26T11:19:26.684419+0000","last_fullsized":"2024-04-26T11:19:26.684419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:30:42.125098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205206+0000","last_change":"2024-04-26T11:19:18.189488+0000","last_active":"2024-04-26T11:19:26.205206+0000","last_peered":"2024-04-26T11:19:26.205206+0000","last_clean":"2024-04-26T11:19:26.205206+0000","last_became_active":"2024-04-26T11:19:18.189086+0000","last_became_peered":"2024-04-26T11:19:18.189086+0000","last_unstale":"2024-04-26T11:19:26.205206+0000","last_undegraded":"2024-04-26T11:19:26.205206+0000","last_fullsized":"2024-04-26T11:19:26.205206+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:00.540494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204973+0000","last_change":"2024-04-26T11:19:18.182582+0000","last_active":"2024-04-26T11:19:26.204973+0000","last_peered":"2024-04-26T11:19:26.204973+0000","last_clean":"2024-04-26T11:19:26.204973+0000","last_became_active":"2024-04-26T11:19:18.181791+0000","last_became_peered":"2024-04-26T11:19:18.181791+0000","last_unstale":"2024-04-26T11:19:26.204973+0000","last_undegraded":"2024-04-26T11:19:26.204973+0000","last_fullsized":"2024-04-26T11:19:26.204973+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:59.312651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204228+0000","last_change":"2024-04-26T11:19:18.185313+0000","last_active":"2024-04-26T11:19:26.204228+0000","last_peered":"2024-04-26T11:19:26.204228+0000","last_clean":"2024-04-26T11:19:26.204228+0000","last_became_active":"2024-04-26T11:19:18.183292+0000","last_became_peered":"2024-04-26T11:19:18.183292+0000","last_unstale":"2024-04-26T11:19:26.204228+0000","last_undegraded":"2024-04-26T11:19:26.204228+0000","last_fullsized":"2024-04-26T11:19:26.204228+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:05.860349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204969+0000","last_change":"2024-04-26T11:19:18.190450+0000","last_active":"2024-04-26T11:19:26.204969+0000","last_peered":"2024-04-26T11:19:26.204969+0000","last_clean":"2024-04-26T11:19:26.204969+0000","last_became_active":"2024-04-26T11:19:18.190096+0000","last_became_peered":"2024-04-26T11:19:18.190096+0000","last_unstale":"2024-04-26T11:19:26.204969+0000","last_undegraded":"2024-04-26T11:19:26.204969+0000","last_fullsized":"2024-04-26T11:19:26.204969+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:26.905702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684402+0000","last_change":"2024-04-26T11:19:24.200305+0000","last_active":"2024-04-26T11:19:26.684402+0000","last_peered":"2024-04-26T11:19:26.684402+0000","last_clean":"2024-04-26T11:19:26.684402+0000","last_became_active":"2024-04-26T11:19:24.199834+0000","last_became_peered":"2024-04-26T11:19:24.199834+0000","last_unstale":"2024-04-26T11:19:26.684402+0000","last_undegraded":"2024-04-26T11:19:26.684402+0000","last_fullsized":"2024-04-26T11:19:26.684402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:47.203614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684327+0000","last_change":"2024-04-26T11:19:24.197329+0000","last_active":"2024-04-26T11:19:26.684327+0000","last_peered":"2024-04-26T11:19:26.684327+0000","last_clean":"2024-04-26T11:19:26.684327+0000","last_became_active":"2024-04-26T11:19:24.196561+0000","last_became_peered":"2024-04-26T11:19:24.196561+0000","last_unstale":"2024-04-26T11:19:26.684327+0000","last_undegraded":"2024-04-26T11:19:26.684327+0000","last_fullsized":"2024-04-26T11:19:26.684327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:06.140967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":107,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204709+0000","last_change":"2024-04-26T11:19:18.182680+0000","last_active":"2024-04-26T11:19:26.204709+0000","last_peered":"2024-04-26T11:19:26.204709+0000","last_clean":"2024-04-26T11:19:26.204709+0000","last_became_active":"2024-04-26T11:19:18.182077+0000","last_became_peered":"2024-04-26T11:19:18.182077+0000","last_unstale":"2024-04-26T11:19:26.204709+0000","last_undegraded":"2024-04-26T11:19:26.204709+0000","last_fullsized":"2024-04-26T11:19:26.204709+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:48.832886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684566+0000","last_change":"2024-04-26T11:19:24.205473+0000","last_active":"2024-04-26T11:19:26.684566+0000","last_peered":"2024-04-26T11:19:26.684566+0000","last_clean":"2024-04-26T11:19:26.684566+0000","last_became_active":"2024-04-26T11:19:24.204538+0000","last_became_peered":"2024-04-26T11:19:24.204538+0000","last_unstale":"2024-04-26T11:19:26.684566+0000","last_undegraded":"2024-04-26T11:19:26.684566+0000","last_fullsized":"2024-04-26T11:19:26.684566+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:55.279045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204413+0000","last_change":"2024-04-26T11:19:18.186884+0000","last_active":"2024-04-26T11:19:26.204413+0000","last_peered":"2024-04-26T11:19:26.204413+0000","last_clean":"2024-04-26T11:19:26.204413+0000","last_became_active":"2024-04-26T11:19:18.184460+0000","last_became_peered":"2024-04-26T11:19:18.184460+0000","last_unstale":"2024-04-26T11:19:26.204413+0000","last_undegraded":"2024-04-26T11:19:26.204413+0000","last_fullsized":"2024-04-26T11:19:26.204413+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:12.901543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":234,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204187+0000","last_change":"2024-04-26T11:19:18.181070+0000","last_active":"2024-04-26T11:19:26.204187+0000","last_peered":"2024-04-26T11:19:26.204187+0000","last_clean":"2024-04-26T11:19:26.204187+0000","last_became_active":"2024-04-26T11:19:18.180577+0000","last_became_peered":"2024-04-26T11:19:18.180577+0000","last_unstale":"2024-04-26T11:19:26.204187+0000","last_undegraded":"2024-04-26T11:19:26.204187+0000","last_fullsized":"2024-04-26T11:19:26.204187+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:34:03.095255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684351+0000","last_change":"2024-04-26T11:19:24.197315+0000","last_active":"2024-04-26T11:19:26.684351+0000","last_peered":"2024-04-26T11:19:26.684351+0000","last_clean":"2024-04-26T11:19:26.684351+0000","last_became_active":"2024-04-26T11:19:24.196404+0000","last_became_peered":"2024-04-26T11:19:24.196404+0000","last_unstale":"2024-04-26T11:19:26.684351+0000","last_undegraded":"2024-04-26T11:19:26.684351+0000","last_fullsized":"2024-04-26T11:19:26.684351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:21:58.513393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204960+0000","last_change":"2024-04-26T11:19:18.184063+0000","last_active":"2024-04-26T11:19:26.204960+0000","last_peered":"2024-04-26T11:19:26.204960+0000","last_clean":"2024-04-26T11:19:26.204960+0000","last_became_active":"2024-04-26T11:19:18.181863+0000","last_became_peered":"2024-04-26T11:19:18.181863+0000","last_unstale":"2024-04-26T11:19:26.204960+0000","last_undegraded":"2024-04-26T11:19:26.204960+0000","last_fullsized":"2024-04-26T11:19:26.204960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:53.865511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204315+0000","last_change":"2024-04-26T11:19:18.181362+0000","last_active":"2024-04-26T11:19:26.204315+0000","last_peered":"2024-04-26T11:19:26.204315+0000","last_clean":"2024-04-26T11:19:26.204315+0000","last_became_active":"2024-04-26T11:19:18.180792+0000","last_became_peered":"2024-04-26T11:19:18.180792+0000","last_unstale":"2024-04-26T11:19:26.204315+0000","last_undegraded":"2024-04-26T11:19:26.204315+0000","last_fullsized":"2024-04-26T11:19:26.204315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:16.215932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.209802+0000","last_change":"2024-04-26T11:19:24.199071+0000","last_active":"2024-04-26T11:19:27.209802+0000","last_peered":"2024-04-26T11:19:27.209802+0000","last_clean":"2024-04-26T11:19:27.209802+0000","last_became_active":"2024-04-26T11:19:24.197711+0000","last_became_peered":"2024-04-26T11:19:24.197711+0000","last_unstale":"2024-04-26T11:19:27.209802+0000","last_undegraded":"2024-04-26T11:19:27.209802+0000","last_fullsized":"2024-04-26T11:19:27.209802+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:34.664546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205609+0000","last_change":"2024-04-26T11:13:12.918648+0000","last_active":"2024-04-26T11:19:26.205609+0000","last_peered":"2024-04-26T11:19:26.205609+0000","last_clean":"2024-04-26T11:19:26.205609+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:19:26.205609+0000","last_undegraded":"2024-04-26T11:19:26.205609+0000","last_fullsized":"2024-04-26T11:19:26.205609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.631673+0000","last_change":"2024-04-26T11:13:08.110433+0000","last_active":"2024-04-26T11:19:26.631673+0000","last_peered":"2024-04-26T11:19:26.631673+0000","last_clean":"2024-04-26T11:19:26.631673+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:19:26.631673+0000","last_undegraded":"2024-04-26T11:19:26.631673+0000","last_fullsized":"2024-04-26T11:19:26.631673+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684429+0000","last_change":"2024-04-26T11:19:24.203404+0000","last_active":"2024-04-26T11:19:26.684429+0000","last_peered":"2024-04-26T11:19:26.684429+0000","last_clean":"2024-04-26T11:19:26.684429+0000","last_became_active":"2024-04-26T11:19:24.202550+0000","last_became_peered":"2024-04-26T11:19:24.202550+0000","last_unstale":"2024-04-26T11:19:26.684429+0000","last_undegraded":"2024-04-26T11:19:26.684429+0000","last_fullsized":"2024-04-26T11:19:26.684429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:22.115008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204932+0000","last_change":"2024-04-26T11:19:18.182788+0000","last_active":"2024-04-26T11:19:26.204932+0000","last_peered":"2024-04-26T11:19:26.204932+0000","last_clean":"2024-04-26T11:19:26.204932+0000","last_became_active":"2024-04-26T11:19:18.182186+0000","last_became_peered":"2024-04-26T11:19:18.182186+0000","last_unstale":"2024-04-26T11:19:26.204932+0000","last_undegraded":"2024-04-26T11:19:26.204932+0000","last_fullsized":"2024-04-26T11:19:26.204932+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:26.933717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684536+0000","last_change":"2024-04-26T11:19:24.203482+0000","last_active":"2024-04-26T11:19:26.684536+0000","last_peered":"2024-04-26T11:19:26.684536+0000","last_clean":"2024-04-26T11:19:26.684536+0000","last_became_active":"2024-04-26T11:19:24.202310+0000","last_became_peered":"2024-04-26T11:19:24.202310+0000","last_unstale":"2024-04-26T11:19:26.684536+0000","last_undegraded":"2024-04-26T11:19:26.684536+0000","last_fullsized":"2024-04-26T11:19:26.684536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:57:50.731804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684477+0000","last_change":"2024-04-26T11:19:24.202951+0000","last_active":"2024-04-26T11:19:26.684477+0000","last_peered":"2024-04-26T11:19:26.684477+0000","last_clean":"2024-04-26T11:19:26.684477+0000","last_became_active":"2024-04-26T11:19:24.202566+0000","last_became_peered":"2024-04-26T11:19:24.202566+0000","last_unstale":"2024-04-26T11:19:26.684477+0000","last_undegraded":"2024-04-26T11:19:26.684477+0000","last_fullsized":"2024-04-26T11:19:26.684477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:55.762840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204185+0000","last_change":"2024-04-26T11:19:24.198685+0000","last_active":"2024-04-26T11:19:26.204185+0000","last_peered":"2024-04-26T11:19:26.204185+0000","last_clean":"2024-04-26T11:19:26.204185+0000","last_became_active":"2024-04-26T11:19:24.197383+0000","last_became_peered":"2024-04-26T11:19:24.197383+0000","last_unstale":"2024-04-26T11:19:26.204185+0000","last_undegraded":"2024-04-26T11:19:26.204185+0000","last_fullsized":"2024-04-26T11:19:26.204185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:08:32.146962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204870+0000","last_change":"2024-04-26T11:19:18.181795+0000","last_active":"2024-04-26T11:19:26.204870+0000","last_peered":"2024-04-26T11:19:26.204870+0000","last_clean":"2024-04-26T11:19:26.204870+0000","last_became_active":"2024-04-26T11:19:18.180871+0000","last_became_peered":"2024-04-26T11:19:18.180871+0000","last_unstale":"2024-04-26T11:19:26.204870+0000","last_undegraded":"2024-04-26T11:19:26.204870+0000","last_fullsized":"2024-04-26T11:19:26.204870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:23.698612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204826+0000","last_change":"2024-04-26T11:19:24.200015+0000","last_active":"2024-04-26T11:19:26.204826+0000","last_peered":"2024-04-26T11:19:26.204826+0000","last_clean":"2024-04-26T11:19:26.204826+0000","last_became_active":"2024-04-26T11:19:24.198853+0000","last_became_peered":"2024-04-26T11:19:24.198853+0000","last_unstale":"2024-04-26T11:19:26.204826+0000","last_undegraded":"2024-04-26T11:19:26.204826+0000","last_fullsized":"2024-04-26T11:19:26.204826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:17.832954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210690+0000","last_change":"2024-04-26T11:19:18.182878+0000","last_active":"2024-04-26T11:19:27.210690+0000","last_peered":"2024-04-26T11:19:27.210690+0000","last_clean":"2024-04-26T11:19:27.210690+0000","last_became_active":"2024-04-26T11:19:18.182228+0000","last_became_peered":"2024-04-26T11:19:18.182228+0000","last_unstale":"2024-04-26T11:19:27.210690+0000","last_undegraded":"2024-04-26T11:19:27.210690+0000","last_fullsized":"2024-04-26T11:19:27.210690+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:34.672880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205075+0000","last_change":"2024-04-26T11:19:18.183238+0000","last_active":"2024-04-26T11:19:26.205075+0000","last_peered":"2024-04-26T11:19:26.205075+0000","last_clean":"2024-04-26T11:19:26.205075+0000","last_became_active":"2024-04-26T11:19:18.182671+0000","last_became_peered":"2024-04-26T11:19:18.182671+0000","last_unstale":"2024-04-26T11:19:26.205075+0000","last_undegraded":"2024-04-26T11:19:26.205075+0000","last_fullsized":"2024-04-26T11:19:26.205075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:49.368568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205360+0000","last_change":"2024-04-26T11:13:12.917812+0000","last_active":"2024-04-26T11:19:26.205360+0000","last_peered":"2024-04-26T11:19:26.205360+0000","last_clean":"2024-04-26T11:19:26.205360+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:19:26.205360+0000","last_undegraded":"2024-04-26T11:19:26.205360+0000","last_fullsized":"2024-04-26T11:19:26.205360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205222+0000","last_change":"2024-04-26T11:19:18.188983+0000","last_active":"2024-04-26T11:19:26.205222+0000","last_peered":"2024-04-26T11:19:26.205222+0000","last_clean":"2024-04-26T11:19:26.205222+0000","last_became_active":"2024-04-26T11:19:18.188177+0000","last_became_peered":"2024-04-26T11:19:18.188177+0000","last_unstale":"2024-04-26T11:19:26.205222+0000","last_undegraded":"2024-04-26T11:19:26.205222+0000","last_fullsized":"2024-04-26T11:19:26.205222+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:31.255327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204597+0000","last_change":"2024-04-26T11:19:18.188002+0000","last_active":"2024-04-26T11:19:26.204597+0000","last_peered":"2024-04-26T11:19:26.204597+0000","last_clean":"2024-04-26T11:19:26.204597+0000","last_became_active":"2024-04-26T11:19:18.185372+0000","last_became_peered":"2024-04-26T11:19:18.185372+0000","last_unstale":"2024-04-26T11:19:26.204597+0000","last_undegraded":"2024-04-26T11:19:26.204597+0000","last_fullsized":"2024-04-26T11:19:26.204597+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:04.942442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205645+0000","last_change":"2024-04-26T11:19:18.190885+0000","last_active":"2024-04-26T11:19:26.205645+0000","last_peered":"2024-04-26T11:19:26.205645+0000","last_clean":"2024-04-26T11:19:26.205645+0000","last_became_active":"2024-04-26T11:19:18.190374+0000","last_became_peered":"2024-04-26T11:19:18.190374+0000","last_unstale":"2024-04-26T11:19:26.205645+0000","last_undegraded":"2024-04-26T11:19:26.205645+0000","last_fullsized":"2024-04-26T11:19:26.205645+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:53.646080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204769+0000","last_change":"2024-04-26T11:19:18.189666+0000","last_active":"2024-04-26T11:19:26.204769+0000","last_peered":"2024-04-26T11:19:26.204769+0000","last_clean":"2024-04-26T11:19:26.204769+0000","last_became_active":"2024-04-26T11:19:18.189341+0000","last_became_peered":"2024-04-26T11:19:18.189341+0000","last_unstale":"2024-04-26T11:19:26.204769+0000","last_undegraded":"2024-04-26T11:19:26.204769+0000","last_fullsized":"2024-04-26T11:19:26.204769+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:52.141583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684494+0000","last_change":"2024-04-26T11:19:24.202866+0000","last_active":"2024-04-26T11:19:26.684494+0000","last_peered":"2024-04-26T11:19:26.684494+0000","last_clean":"2024-04-26T11:19:26.684494+0000","last_became_active":"2024-04-26T11:19:24.202422+0000","last_became_peered":"2024-04-26T11:19:24.202422+0000","last_unstale":"2024-04-26T11:19:26.684494+0000","last_undegraded":"2024-04-26T11:19:26.684494+0000","last_fullsized":"2024-04-26T11:19:26.684494+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.564374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205080+0000","last_change":"2024-04-26T11:13:12.917763+0000","last_active":"2024-04-26T11:19:26.205080+0000","last_peered":"2024-04-26T11:19:26.205080+0000","last_clean":"2024-04-26T11:19:26.205080+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:19:26.205080+0000","last_undegraded":"2024-04-26T11:19:26.205080+0000","last_fullsized":"2024-04-26T11:19:26.205080+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204913+0000","last_change":"2024-04-26T11:19:24.205087+0000","last_active":"2024-04-26T11:19:26.204913+0000","last_peered":"2024-04-26T11:19:26.204913+0000","last_clean":"2024-04-26T11:19:26.204913+0000","last_became_active":"2024-04-26T11:19:24.204129+0000","last_became_peered":"2024-04-26T11:19:24.204129+0000","last_unstale":"2024-04-26T11:19:26.204913+0000","last_undegraded":"2024-04-26T11:19:26.204913+0000","last_fullsized":"2024-04-26T11:19:26.204913+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:15.916622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204637+0000","last_change":"2024-04-26T11:19:18.189530+0000","last_active":"2024-04-26T11:19:26.204637+0000","last_peered":"2024-04-26T11:19:26.204637+0000","last_clean":"2024-04-26T11:19:26.204637+0000","last_became_active":"2024-04-26T11:19:18.189179+0000","last_became_peered":"2024-04-26T11:19:18.189179+0000","last_unstale":"2024-04-26T11:19:26.204637+0000","last_undegraded":"2024-04-26T11:19:26.204637+0000","last_fullsized":"2024-04-26T11:19:26.204637+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.132608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204517+0000","last_change":"2024-04-26T11:19:18.189257+0000","last_active":"2024-04-26T11:19:26.204517+0000","last_peered":"2024-04-26T11:19:26.204517+0000","last_clean":"2024-04-26T11:19:26.204517+0000","last_became_active":"2024-04-26T11:19:18.188963+0000","last_became_peered":"2024-04-26T11:19:18.188963+0000","last_unstale":"2024-04-26T11:19:26.204517+0000","last_undegraded":"2024-04-26T11:19:26.204517+0000","last_fullsized":"2024-04-26T11:19:26.204517+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:37.907392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684318+0000","last_change":"2024-04-26T11:19:24.200217+0000","last_active":"2024-04-26T11:19:26.684318+0000","last_peered":"2024-04-26T11:19:26.684318+0000","last_clean":"2024-04-26T11:19:26.684318+0000","last_became_active":"2024-04-26T11:19:24.198397+0000","last_became_peered":"2024-04-26T11:19:24.198397+0000","last_unstale":"2024-04-26T11:19:26.684318+0000","last_undegraded":"2024-04-26T11:19:26.684318+0000","last_fullsized":"2024-04-26T11:19:26.684318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:44.576230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205025+0000","last_change":"2024-04-26T11:19:18.183441+0000","last_active":"2024-04-26T11:19:26.205025+0000","last_peered":"2024-04-26T11:19:26.205025+0000","last_clean":"2024-04-26T11:19:26.205025+0000","last_became_active":"2024-04-26T11:19:18.183037+0000","last_became_peered":"2024-04-26T11:19:18.183037+0000","last_unstale":"2024-04-26T11:19:26.205025+0000","last_undegraded":"2024-04-26T11:19:26.205025+0000","last_fullsized":"2024-04-26T11:19:26.205025+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:32.597584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684386+0000","last_change":"2024-04-26T11:19:24.203647+0000","last_active":"2024-04-26T11:19:26.684386+0000","last_peered":"2024-04-26T11:19:26.684386+0000","last_clean":"2024-04-26T11:19:26.684386+0000","last_became_active":"2024-04-26T11:19:24.202442+0000","last_became_peered":"2024-04-26T11:19:24.202442+0000","last_unstale":"2024-04-26T11:19:26.684386+0000","last_undegraded":"2024-04-26T11:19:26.684386+0000","last_fullsized":"2024-04-26T11:19:26.684386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:21.883832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205445+0000","last_change":"2024-04-26T11:19:18.184719+0000","last_active":"2024-04-26T11:19:26.205445+0000","last_peered":"2024-04-26T11:19:26.205445+0000","last_clean":"2024-04-26T11:19:26.205445+0000","last_became_active":"2024-04-26T11:19:18.184384+0000","last_became_peered":"2024-04-26T11:19:18.184384+0000","last_unstale":"2024-04-26T11:19:26.205445+0000","last_undegraded":"2024-04-26T11:19:26.205445+0000","last_fullsized":"2024-04-26T11:19:26.205445+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:37.130545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7958,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738447,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281152,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94090688,"statfs":{"total":96636764160,"available":96348864512,"internally_reserved":0,"allocated":1490944,"data_stored":947441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Fri Apr 26 11:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45800000000000002,"15min":0.39600000000000002},"min":{"1min":0.34399999999999997,"5min":0.17999999999999999,"15min":0.17199999999999999},"max":{"1min":0.68100000000000005,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.316,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.66400000000000003,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.60699999999999998}]}]},{"osd":0,"up_from":75,"seq":322122547204,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38160,"kb_used_data":1468,"kb_used_omap":10,"kb_used_meta":36661,"kb_avail":94333680,"statfs":{"total":96636764160,"available":96597688320,"internally_reserved":0,"allocated":1503232,"data_stored":949168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11228,"internal_metadata":37540900},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738448,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401140,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":400254,"kb_avail":93970700,"statfs":{"total":96636764160,"available":96225996800,"internally_reserved":0,"allocated":884736,"data_stored":357054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":409860550},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Fri Apr 26 11:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.44700000000000001,"15min":0.40699999999999997},"min":{"1min":0.34999999999999998,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.69199999999999995,"5min":2.056,"15min":2.056},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.499,"15min":0.46400000000000002},"min":{"1min":0.376,"5min":0.193,"15min":0.193},"max":{"1min":0.67600000000000005,"5min":3.9609999999999999,"15min":3.9609999999999999},"last":0.46000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7958,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:19:30.756 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T11:19:30.756 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-26T11:19:31.153 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T11:19:31.164 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T11:19:31.164 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:19:31.509 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:19:31.511 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:19:31.521 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":270,"stamp":"2024-04-26T11:19:30.561406+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":720452,"kb_used_data":3788,"kb_used_omap":14,"kb_used_meta":716593,"kb_avail":282395068,"statfs":{"total":289910292480,"available":289172549632,"internally_reserved":0,"allocated":3878912,"data_stored":2253663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14416,"internal_metadata":733792176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001090"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205605+0000","last_change":"2024-04-26T11:13:12.919196+0000","last_active":"2024-04-26T11:19:26.205605+0000","last_peered":"2024-04-26T11:19:26.205605+0000","last_clean":"2024-04-26T11:19:26.205605+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:19:26.205605+0000","last_undegraded":"2024-04-26T11:19:26.205605+0000","last_fullsized":"2024-04-26T11:19:26.205605+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205354+0000","last_change":"2024-04-26T11:13:12.917670+0000","last_active":"2024-04-26T11:19:26.205354+0000","last_peered":"2024-04-26T11:19:26.205354+0000","last_clean":"2024-04-26T11:19:26.205354+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:19:26.205354+0000","last_undegraded":"2024-04-26T11:19:26.205354+0000","last_fullsized":"2024-04-26T11:19:26.205354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205142+0000","last_change":"2024-04-26T11:19:18.185209+0000","last_active":"2024-04-26T11:19:26.205142+0000","last_peered":"2024-04-26T11:19:26.205142+0000","last_clean":"2024-04-26T11:19:26.205142+0000","last_became_active":"2024-04-26T11:19:18.182972+0000","last_became_peered":"2024-04-26T11:19:18.182972+0000","last_unstale":"2024-04-26T11:19:26.205142+0000","last_undegraded":"2024-04-26T11:19:26.205142+0000","last_fullsized":"2024-04-26T11:19:26.205142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:57.755970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204499+0000","last_change":"2024-04-26T11:19:18.183286+0000","last_active":"2024-04-26T11:19:26.204499+0000","last_peered":"2024-04-26T11:19:26.204499+0000","last_clean":"2024-04-26T11:19:26.204499+0000","last_became_active":"2024-04-26T11:19:18.182942+0000","last_became_peered":"2024-04-26T11:19:18.182942+0000","last_unstale":"2024-04-26T11:19:26.204499+0000","last_undegraded":"2024-04-26T11:19:26.204499+0000","last_fullsized":"2024-04-26T11:19:26.204499+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:58.370599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205030+0000","last_change":"2024-04-26T11:13:12.917403+0000","last_active":"2024-04-26T11:19:26.205030+0000","last_peered":"2024-04-26T11:19:26.205030+0000","last_clean":"2024-04-26T11:19:26.205030+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:19:26.205030+0000","last_undegraded":"2024-04-26T11:19:26.205030+0000","last_fullsized":"2024-04-26T11:19:26.205030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:42.014955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204622+0000","last_change":"2024-04-26T11:19:18.189355+0000","last_active":"2024-04-26T11:19:26.204622+0000","last_peered":"2024-04-26T11:19:26.204622+0000","last_clean":"2024-04-26T11:19:26.204622+0000","last_became_active":"2024-04-26T11:19:18.188990+0000","last_became_peered":"2024-04-26T11:19:18.188990+0000","last_unstale":"2024-04-26T11:19:26.204622+0000","last_undegraded":"2024-04-26T11:19:26.204622+0000","last_fullsized":"2024-04-26T11:19:26.204622+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:29.030847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204397+0000","last_change":"2024-04-26T11:19:18.187953+0000","last_active":"2024-04-26T11:19:26.204397+0000","last_peered":"2024-04-26T11:19:26.204397+0000","last_clean":"2024-04-26T11:19:26.204397+0000","last_became_active":"2024-04-26T11:19:18.186638+0000","last_became_peered":"2024-04-26T11:19:18.186638+0000","last_unstale":"2024-04-26T11:19:26.204397+0000","last_undegraded":"2024-04-26T11:19:26.204397+0000","last_fullsized":"2024-04-26T11:19:26.204397+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:18.483074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204062+0000","last_change":"2024-04-26T11:19:18.183968+0000","last_active":"2024-04-26T11:19:26.204062+0000","last_peered":"2024-04-26T11:19:26.204062+0000","last_clean":"2024-04-26T11:19:26.204062+0000","last_became_active":"2024-04-26T11:19:18.182111+0000","last_became_peered":"2024-04-26T11:19:18.182111+0000","last_unstale":"2024-04-26T11:19:26.204062+0000","last_undegraded":"2024-04-26T11:19:26.204062+0000","last_fullsized":"2024-04-26T11:19:26.204062+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:08.529468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684517+0000","last_change":"2024-04-26T11:19:24.202861+0000","last_active":"2024-04-26T11:19:26.684517+0000","last_peered":"2024-04-26T11:19:26.684517+0000","last_clean":"2024-04-26T11:19:26.684517+0000","last_became_active":"2024-04-26T11:19:24.202146+0000","last_became_peered":"2024-04-26T11:19:24.202146+0000","last_unstale":"2024-04-26T11:19:26.684517+0000","last_undegraded":"2024-04-26T11:19:26.684517+0000","last_fullsized":"2024-04-26T11:19:26.684517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:33.234821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205553+0000","last_change":"2024-04-26T11:13:12.918521+0000","last_active":"2024-04-26T11:19:26.205553+0000","last_peered":"2024-04-26T11:19:26.205553+0000","last_clean":"2024-04-26T11:19:26.205553+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:19:26.205553+0000","last_undegraded":"2024-04-26T11:19:26.205553+0000","last_fullsized":"2024-04-26T11:19:26.205553+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204805+0000","last_change":"2024-04-26T11:19:18.187027+0000","last_active":"2024-04-26T11:19:26.204805+0000","last_peered":"2024-04-26T11:19:26.204805+0000","last_clean":"2024-04-26T11:19:26.204805+0000","last_became_active":"2024-04-26T11:19:18.185543+0000","last_became_peered":"2024-04-26T11:19:18.185543+0000","last_unstale":"2024-04-26T11:19:26.204805+0000","last_undegraded":"2024-04-26T11:19:26.204805+0000","last_fullsized":"2024-04-26T11:19:26.204805+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:38.365806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205142+0000","last_change":"2024-04-26T11:19:18.183459+0000","last_active":"2024-04-26T11:19:26.205142+0000","last_peered":"2024-04-26T11:19:26.205142+0000","last_clean":"2024-04-26T11:19:26.205142+0000","last_became_active":"2024-04-26T11:19:18.182827+0000","last_became_peered":"2024-04-26T11:19:18.182827+0000","last_unstale":"2024-04-26T11:19:26.205142+0000","last_undegraded":"2024-04-26T11:19:26.205142+0000","last_fullsized":"2024-04-26T11:19:26.205142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:28.182922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205400+0000","last_change":"2024-04-26T11:13:12.915484+0000","last_active":"2024-04-26T11:19:26.205400+0000","last_peered":"2024-04-26T11:19:26.205400+0000","last_clean":"2024-04-26T11:19:26.205400+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:19:26.205400+0000","last_undegraded":"2024-04-26T11:19:26.205400+0000","last_fullsized":"2024-04-26T11:19:26.205400+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204505+0000","last_change":"2024-04-26T11:19:18.181800+0000","last_active":"2024-04-26T11:19:26.204505+0000","last_peered":"2024-04-26T11:19:26.204505+0000","last_clean":"2024-04-26T11:19:26.204505+0000","last_became_active":"2024-04-26T11:19:18.180865+0000","last_became_peered":"2024-04-26T11:19:18.180865+0000","last_unstale":"2024-04-26T11:19:26.204505+0000","last_undegraded":"2024-04-26T11:19:26.204505+0000","last_fullsized":"2024-04-26T11:19:26.204505+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:36.948796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204335+0000","last_change":"2024-04-26T11:19:18.181625+0000","last_active":"2024-04-26T11:19:26.204335+0000","last_peered":"2024-04-26T11:19:26.204335+0000","last_clean":"2024-04-26T11:19:26.204335+0000","last_became_active":"2024-04-26T11:19:18.180763+0000","last_became_peered":"2024-04-26T11:19:18.180763+0000","last_unstale":"2024-04-26T11:19:26.204335+0000","last_undegraded":"2024-04-26T11:19:26.204335+0000","last_fullsized":"2024-04-26T11:19:26.204335+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:27.138589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204271+0000","last_change":"2024-04-26T11:19:18.185161+0000","last_active":"2024-04-26T11:19:26.204271+0000","last_peered":"2024-04-26T11:19:26.204271+0000","last_clean":"2024-04-26T11:19:26.204271+0000","last_became_active":"2024-04-26T11:19:18.184331+0000","last_became_peered":"2024-04-26T11:19:18.184331+0000","last_unstale":"2024-04-26T11:19:26.204271+0000","last_undegraded":"2024-04-26T11:19:26.204271+0000","last_fullsized":"2024-04-26T11:19:26.204271+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:29.254144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684526+0000","last_change":"2024-04-26T11:19:24.204827+0000","last_active":"2024-04-26T11:19:26.684526+0000","last_peered":"2024-04-26T11:19:26.684526+0000","last_clean":"2024-04-26T11:19:26.684526+0000","last_became_active":"2024-04-26T11:19:24.203764+0000","last_became_peered":"2024-04-26T11:19:24.203764+0000","last_unstale":"2024-04-26T11:19:26.684526+0000","last_undegraded":"2024-04-26T11:19:26.684526+0000","last_fullsized":"2024-04-26T11:19:26.684526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:29.263130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205647+0000","last_change":"2024-04-26T11:13:12.918759+0000","last_active":"2024-04-26T11:19:26.205647+0000","last_peered":"2024-04-26T11:19:26.205647+0000","last_clean":"2024-04-26T11:19:26.205647+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:19:26.205647+0000","last_undegraded":"2024-04-26T11:19:26.205647+0000","last_fullsized":"2024-04-26T11:19:26.205647+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:55.002972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684440+0000","last_change":"2024-04-26T11:19:24.200114+0000","last_active":"2024-04-26T11:19:26.684440+0000","last_peered":"2024-04-26T11:19:26.684440+0000","last_clean":"2024-04-26T11:19:26.684440+0000","last_became_active":"2024-04-26T11:19:24.199142+0000","last_became_peered":"2024-04-26T11:19:24.199142+0000","last_unstale":"2024-04-26T11:19:26.684440+0000","last_undegraded":"2024-04-26T11:19:26.684440+0000","last_fullsized":"2024-04-26T11:19:26.684440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:04.789203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205065+0000","last_change":"2024-04-26T11:19:18.186823+0000","last_active":"2024-04-26T11:19:26.205065+0000","last_peered":"2024-04-26T11:19:26.205065+0000","last_clean":"2024-04-26T11:19:26.205065+0000","last_became_active":"2024-04-26T11:19:18.184282+0000","last_became_peered":"2024-04-26T11:19:18.184282+0000","last_unstale":"2024-04-26T11:19:26.205065+0000","last_undegraded":"2024-04-26T11:19:26.205065+0000","last_fullsized":"2024-04-26T11:19:26.205065+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:11.581601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204671+0000","last_change":"2024-04-26T11:19:18.187937+0000","last_active":"2024-04-26T11:19:26.204671+0000","last_peered":"2024-04-26T11:19:26.204671+0000","last_clean":"2024-04-26T11:19:26.204671+0000","last_became_active":"2024-04-26T11:19:18.186605+0000","last_became_peered":"2024-04-26T11:19:18.186605+0000","last_unstale":"2024-04-26T11:19:26.204671+0000","last_undegraded":"2024-04-26T11:19:26.204671+0000","last_fullsized":"2024-04-26T11:19:26.204671+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:49.737640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204850+0000","last_change":"2024-04-26T11:19:18.182666+0000","last_active":"2024-04-26T11:19:26.204850+0000","last_peered":"2024-04-26T11:19:26.204850+0000","last_clean":"2024-04-26T11:19:26.204850+0000","last_became_active":"2024-04-26T11:19:18.181728+0000","last_became_peered":"2024-04-26T11:19:18.181728+0000","last_unstale":"2024-04-26T11:19:26.204850+0000","last_undegraded":"2024-04-26T11:19:26.204850+0000","last_fullsized":"2024-04-26T11:19:26.204850+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:07.719581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.203921+0000","last_change":"2024-04-26T11:19:24.198562+0000","last_active":"2024-04-26T11:19:26.203921+0000","last_peered":"2024-04-26T11:19:26.203921+0000","last_clean":"2024-04-26T11:19:26.203921+0000","last_became_active":"2024-04-26T11:19:24.197487+0000","last_became_peered":"2024-04-26T11:19:24.197487+0000","last_unstale":"2024-04-26T11:19:26.203921+0000","last_undegraded":"2024-04-26T11:19:26.203921+0000","last_fullsized":"2024-04-26T11:19:26.203921+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:31.790885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204840+0000","last_change":"2024-04-26T11:13:12.912756+0000","last_active":"2024-04-26T11:19:26.204840+0000","last_peered":"2024-04-26T11:19:26.204840+0000","last_clean":"2024-04-26T11:19:26.204840+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:19:26.204840+0000","last_undegraded":"2024-04-26T11:19:26.204840+0000","last_fullsized":"2024-04-26T11:19:26.204840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:04.177831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205614+0000","last_change":"2024-04-26T11:19:18.184692+0000","last_active":"2024-04-26T11:19:26.205614+0000","last_peered":"2024-04-26T11:19:26.205614+0000","last_clean":"2024-04-26T11:19:26.205614+0000","last_became_active":"2024-04-26T11:19:18.184451+0000","last_became_peered":"2024-04-26T11:19:18.184451+0000","last_unstale":"2024-04-26T11:19:26.205614+0000","last_undegraded":"2024-04-26T11:19:26.205614+0000","last_fullsized":"2024-04-26T11:19:26.205614+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:08.485754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204759+0000","last_change":"2024-04-26T11:19:24.199954+0000","last_active":"2024-04-26T11:19:26.204759+0000","last_peered":"2024-04-26T11:19:26.204759+0000","last_clean":"2024-04-26T11:19:26.204759+0000","last_became_active":"2024-04-26T11:19:24.198479+0000","last_became_peered":"2024-04-26T11:19:24.198479+0000","last_unstale":"2024-04-26T11:19:26.204759+0000","last_undegraded":"2024-04-26T11:19:26.204759+0000","last_fullsized":"2024-04-26T11:19:26.204759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:14.221425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204917+0000","last_change":"2024-04-26T11:19:18.185709+0000","last_active":"2024-04-26T11:19:26.204917+0000","last_peered":"2024-04-26T11:19:26.204917+0000","last_clean":"2024-04-26T11:19:26.204917+0000","last_became_active":"2024-04-26T11:19:18.185105+0000","last_became_peered":"2024-04-26T11:19:18.185105+0000","last_unstale":"2024-04-26T11:19:26.204917+0000","last_undegraded":"2024-04-26T11:19:26.204917+0000","last_fullsized":"2024-04-26T11:19:26.204917+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:43.626259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204813+0000","last_change":"2024-04-26T11:13:12.493425+0000","last_active":"2024-04-26T11:19:26.204813+0000","last_peered":"2024-04-26T11:19:26.204813+0000","last_clean":"2024-04-26T11:19:26.204813+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:19:26.204813+0000","last_undegraded":"2024-04-26T11:19:26.204813+0000","last_fullsized":"2024-04-26T11:19:26.204813+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:23.279580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205712+0000","last_change":"2024-04-26T11:19:18.191042+0000","last_active":"2024-04-26T11:19:26.205712+0000","last_peered":"2024-04-26T11:19:26.205712+0000","last_clean":"2024-04-26T11:19:26.205712+0000","last_became_active":"2024-04-26T11:19:18.190792+0000","last_became_peered":"2024-04-26T11:19:18.190792+0000","last_unstale":"2024-04-26T11:19:26.205712+0000","last_undegraded":"2024-04-26T11:19:26.205712+0000","last_fullsized":"2024-04-26T11:19:26.205712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:45.726211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684337+0000","last_change":"2024-04-26T11:19:24.203467+0000","last_active":"2024-04-26T11:19:26.684337+0000","last_peered":"2024-04-26T11:19:26.684337+0000","last_clean":"2024-04-26T11:19:26.684337+0000","last_became_active":"2024-04-26T11:19:24.202348+0000","last_became_peered":"2024-04-26T11:19:24.202348+0000","last_unstale":"2024-04-26T11:19:26.684337+0000","last_undegraded":"2024-04-26T11:19:26.684337+0000","last_fullsized":"2024-04-26T11:19:26.684337+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:55.157485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204840+0000","last_change":"2024-04-26T11:19:24.200292+0000","last_active":"2024-04-26T11:19:26.204840+0000","last_peered":"2024-04-26T11:19:26.204840+0000","last_clean":"2024-04-26T11:19:26.204840+0000","last_became_active":"2024-04-26T11:19:24.198920+0000","last_became_peered":"2024-04-26T11:19:24.198920+0000","last_unstale":"2024-04-26T11:19:26.204840+0000","last_undegraded":"2024-04-26T11:19:26.204840+0000","last_fullsized":"2024-04-26T11:19:26.204840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:45.950568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684279+0000","last_change":"2024-04-26T11:19:24.199051+0000","last_active":"2024-04-26T11:19:26.684279+0000","last_peered":"2024-04-26T11:19:26.684279+0000","last_clean":"2024-04-26T11:19:26.684279+0000","last_became_active":"2024-04-26T11:19:24.197698+0000","last_became_peered":"2024-04-26T11:19:24.197698+0000","last_unstale":"2024-04-26T11:19:26.684279+0000","last_undegraded":"2024-04-26T11:19:26.684279+0000","last_fullsized":"2024-04-26T11:19:26.684279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:21.891894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211316+0000","last_change":"2024-04-26T11:19:18.190418+0000","last_active":"2024-04-26T11:19:27.211316+0000","last_peered":"2024-04-26T11:19:27.211316+0000","last_clean":"2024-04-26T11:19:27.211316+0000","last_became_active":"2024-04-26T11:19:18.190127+0000","last_became_peered":"2024-04-26T11:19:18.190127+0000","last_unstale":"2024-04-26T11:19:27.211316+0000","last_undegraded":"2024-04-26T11:19:27.211316+0000","last_fullsized":"2024-04-26T11:19:27.211316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:11:25.515683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205003+0000","last_change":"2024-04-26T11:19:24.205086+0000","last_active":"2024-04-26T11:19:26.205003+0000","last_peered":"2024-04-26T11:19:26.205003+0000","last_clean":"2024-04-26T11:19:26.205003+0000","last_became_active":"2024-04-26T11:19:24.204122+0000","last_became_peered":"2024-04-26T11:19:24.204122+0000","last_unstale":"2024-04-26T11:19:26.205003+0000","last_undegraded":"2024-04-26T11:19:26.205003+0000","last_fullsized":"2024-04-26T11:19:26.205003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:56:23.239851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684262+0000","last_change":"2024-04-26T11:19:24.198434+0000","last_active":"2024-04-26T11:19:26.684262+0000","last_peered":"2024-04-26T11:19:26.684262+0000","last_clean":"2024-04-26T11:19:26.684262+0000","last_became_active":"2024-04-26T11:19:24.197247+0000","last_became_peered":"2024-04-26T11:19:24.197247+0000","last_unstale":"2024-04-26T11:19:26.684262+0000","last_undegraded":"2024-04-26T11:19:26.684262+0000","last_fullsized":"2024-04-26T11:19:26.684262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:23.769249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204777+0000","last_change":"2024-04-26T11:19:18.187720+0000","last_active":"2024-04-26T11:19:26.204777+0000","last_peered":"2024-04-26T11:19:26.204777+0000","last_clean":"2024-04-26T11:19:26.204777+0000","last_became_active":"2024-04-26T11:19:18.185578+0000","last_became_peered":"2024-04-26T11:19:18.185578+0000","last_unstale":"2024-04-26T11:19:26.204777+0000","last_undegraded":"2024-04-26T11:19:26.204777+0000","last_fullsized":"2024-04-26T11:19:26.204777+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:38.482108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204346+0000","last_change":"2024-04-26T11:19:24.201728+0000","last_active":"2024-04-26T11:19:26.204346+0000","last_peered":"2024-04-26T11:19:26.204346+0000","last_clean":"2024-04-26T11:19:26.204346+0000","last_became_active":"2024-04-26T11:19:24.200992+0000","last_became_peered":"2024-04-26T11:19:24.200992+0000","last_unstale":"2024-04-26T11:19:26.204346+0000","last_undegraded":"2024-04-26T11:19:26.204346+0000","last_fullsized":"2024-04-26T11:19:26.204346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:59.859744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":109,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205523+0000","last_change":"2024-04-26T11:19:18.190998+0000","last_active":"2024-04-26T11:19:26.205523+0000","last_peered":"2024-04-26T11:19:26.205523+0000","last_clean":"2024-04-26T11:19:26.205523+0000","last_became_active":"2024-04-26T11:19:18.190381+0000","last_became_peered":"2024-04-26T11:19:18.190381+0000","last_unstale":"2024-04-26T11:19:26.205523+0000","last_undegraded":"2024-04-26T11:19:26.205523+0000","last_fullsized":"2024-04-26T11:19:26.205523+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:31.159104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684360+0000","last_change":"2024-04-26T11:19:24.200037+0000","last_active":"2024-04-26T11:19:26.684360+0000","last_peered":"2024-04-26T11:19:26.684360+0000","last_clean":"2024-04-26T11:19:26.684360+0000","last_became_active":"2024-04-26T11:19:24.199659+0000","last_became_peered":"2024-04-26T11:19:24.199659+0000","last_unstale":"2024-04-26T11:19:26.684360+0000","last_undegraded":"2024-04-26T11:19:26.684360+0000","last_fullsized":"2024-04-26T11:19:26.684360+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:49.275857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":45,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204850+0000","last_change":"2024-04-26T11:19:18.181316+0000","last_active":"2024-04-26T11:19:26.204850+0000","last_peered":"2024-04-26T11:19:26.204850+0000","last_clean":"2024-04-26T11:19:26.204850+0000","last_became_active":"2024-04-26T11:19:18.180711+0000","last_became_peered":"2024-04-26T11:19:18.180711+0000","last_unstale":"2024-04-26T11:19:26.204850+0000","last_undegraded":"2024-04-26T11:19:26.204850+0000","last_fullsized":"2024-04-26T11:19:26.204850+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:27.837108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204705+0000","last_change":"2024-04-26T11:19:18.182026+0000","last_active":"2024-04-26T11:19:26.204705+0000","last_peered":"2024-04-26T11:19:26.204705+0000","last_clean":"2024-04-26T11:19:26.204705+0000","last_became_active":"2024-04-26T11:19:18.181615+0000","last_became_peered":"2024-04-26T11:19:18.181615+0000","last_unstale":"2024-04-26T11:19:26.204705+0000","last_undegraded":"2024-04-26T11:19:26.204705+0000","last_fullsized":"2024-04-26T11:19:26.204705+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:56.083479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204459+0000","last_change":"2024-04-26T11:19:18.185625+0000","last_active":"2024-04-26T11:19:26.204459+0000","last_peered":"2024-04-26T11:19:26.204459+0000","last_clean":"2024-04-26T11:19:26.204459+0000","last_became_active":"2024-04-26T11:19:18.183103+0000","last_became_peered":"2024-04-26T11:19:18.183103+0000","last_unstale":"2024-04-26T11:19:26.204459+0000","last_undegraded":"2024-04-26T11:19:26.204459+0000","last_fullsized":"2024-04-26T11:19:26.204459+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:42.309969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205241+0000","last_change":"2024-04-26T11:13:12.916685+0000","last_active":"2024-04-26T11:19:26.205241+0000","last_peered":"2024-04-26T11:19:26.205241+0000","last_clean":"2024-04-26T11:19:26.205241+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:19:26.205241+0000","last_undegraded":"2024-04-26T11:19:26.205241+0000","last_fullsized":"2024-04-26T11:19:26.205241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204255+0000","last_change":"2024-04-26T11:19:24.199114+0000","last_active":"2024-04-26T11:19:26.204255+0000","last_peered":"2024-04-26T11:19:26.204255+0000","last_clean":"2024-04-26T11:19:26.204255+0000","last_became_active":"2024-04-26T11:19:24.197647+0000","last_became_peered":"2024-04-26T11:19:24.197647+0000","last_unstale":"2024-04-26T11:19:26.204255+0000","last_undegraded":"2024-04-26T11:19:26.204255+0000","last_fullsized":"2024-04-26T11:19:26.204255+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:23.938536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205618+0000","last_change":"2024-04-26T11:13:12.915238+0000","last_active":"2024-04-26T11:19:26.205618+0000","last_peered":"2024-04-26T11:19:26.205618+0000","last_clean":"2024-04-26T11:19:26.205618+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:19:26.205618+0000","last_undegraded":"2024-04-26T11:19:26.205618+0000","last_fullsized":"2024-04-26T11:19:26.205618+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:48.068465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":106,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204835+0000","last_change":"2024-04-26T11:19:18.182547+0000","last_active":"2024-04-26T11:19:26.204835+0000","last_peered":"2024-04-26T11:19:26.204835+0000","last_clean":"2024-04-26T11:19:26.204835+0000","last_became_active":"2024-04-26T11:19:18.181907+0000","last_became_peered":"2024-04-26T11:19:18.181907+0000","last_unstale":"2024-04-26T11:19:26.204835+0000","last_undegraded":"2024-04-26T11:19:26.204835+0000","last_fullsized":"2024-04-26T11:19:26.204835+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.076863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204980+0000","last_change":"2024-04-26T11:19:24.201756+0000","last_active":"2024-04-26T11:19:26.204980+0000","last_peered":"2024-04-26T11:19:26.204980+0000","last_clean":"2024-04-26T11:19:26.204980+0000","last_became_active":"2024-04-26T11:19:24.201114+0000","last_became_peered":"2024-04-26T11:19:24.201114+0000","last_unstale":"2024-04-26T11:19:26.204980+0000","last_undegraded":"2024-04-26T11:19:26.204980+0000","last_fullsized":"2024-04-26T11:19:26.204980+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:34.095066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204443+0000","last_change":"2024-04-26T11:19:18.182797+0000","last_active":"2024-04-26T11:19:26.204443+0000","last_peered":"2024-04-26T11:19:26.204443+0000","last_clean":"2024-04-26T11:19:26.204443+0000","last_became_active":"2024-04-26T11:19:18.182017+0000","last_became_peered":"2024-04-26T11:19:18.182017+0000","last_unstale":"2024-04-26T11:19:26.204443+0000","last_undegraded":"2024-04-26T11:19:26.204443+0000","last_fullsized":"2024-04-26T11:19:26.204443+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:41.531437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205077+0000","last_change":"2024-04-26T11:19:24.205310+0000","last_active":"2024-04-26T11:19:26.205077+0000","last_peered":"2024-04-26T11:19:26.205077+0000","last_clean":"2024-04-26T11:19:26.205077+0000","last_became_active":"2024-04-26T11:19:24.204476+0000","last_became_peered":"2024-04-26T11:19:24.204476+0000","last_unstale":"2024-04-26T11:19:26.205077+0000","last_undegraded":"2024-04-26T11:19:26.205077+0000","last_fullsized":"2024-04-26T11:19:26.205077+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:14.932094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205069+0000","last_change":"2024-04-26T11:19:18.181966+0000","last_active":"2024-04-26T11:19:26.205069+0000","last_peered":"2024-04-26T11:19:26.205069+0000","last_clean":"2024-04-26T11:19:26.205069+0000","last_became_active":"2024-04-26T11:19:18.181604+0000","last_became_peered":"2024-04-26T11:19:18.181604+0000","last_unstale":"2024-04-26T11:19:26.205069+0000","last_undegraded":"2024-04-26T11:19:26.205069+0000","last_fullsized":"2024-04-26T11:19:26.205069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:57.405893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204571+0000","last_change":"2024-04-26T11:19:18.181723+0000","last_active":"2024-04-26T11:19:26.204571+0000","last_peered":"2024-04-26T11:19:26.204571+0000","last_clean":"2024-04-26T11:19:26.204571+0000","last_became_active":"2024-04-26T11:19:18.181462+0000","last_became_peered":"2024-04-26T11:19:18.181462+0000","last_unstale":"2024-04-26T11:19:26.204571+0000","last_undegraded":"2024-04-26T11:19:26.204571+0000","last_fullsized":"2024-04-26T11:19:26.204571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:23.824505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205502+0000","last_change":"2024-04-26T11:19:18.183263+0000","last_active":"2024-04-26T11:19:26.205502+0000","last_peered":"2024-04-26T11:19:26.205502+0000","last_clean":"2024-04-26T11:19:26.205502+0000","last_became_active":"2024-04-26T11:19:18.182242+0000","last_became_peered":"2024-04-26T11:19:18.182242+0000","last_unstale":"2024-04-26T11:19:26.205502+0000","last_undegraded":"2024-04-26T11:19:26.205502+0000","last_fullsized":"2024-04-26T11:19:26.205502+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:25.716967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204977+0000","last_change":"2024-04-26T11:13:12.912207+0000","last_active":"2024-04-26T11:19:26.204977+0000","last_peered":"2024-04-26T11:19:26.204977+0000","last_clean":"2024-04-26T11:19:26.204977+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:19:26.204977+0000","last_undegraded":"2024-04-26T11:19:26.204977+0000","last_fullsized":"2024-04-26T11:19:26.204977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204780+0000","last_change":"2024-04-26T11:19:18.181652+0000","last_active":"2024-04-26T11:19:26.204780+0000","last_peered":"2024-04-26T11:19:26.204780+0000","last_clean":"2024-04-26T11:19:26.204780+0000","last_became_active":"2024-04-26T11:19:18.180506+0000","last_became_peered":"2024-04-26T11:19:18.180506+0000","last_unstale":"2024-04-26T11:19:26.204780+0000","last_undegraded":"2024-04-26T11:19:26.204780+0000","last_fullsized":"2024-04-26T11:19:26.204780+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:52.115128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204377+0000","last_change":"2024-04-26T11:19:18.186849+0000","last_active":"2024-04-26T11:19:26.204377+0000","last_peered":"2024-04-26T11:19:26.204377+0000","last_clean":"2024-04-26T11:19:26.204377+0000","last_became_active":"2024-04-26T11:19:18.185355+0000","last_became_peered":"2024-04-26T11:19:18.185355+0000","last_unstale":"2024-04-26T11:19:26.204377+0000","last_undegraded":"2024-04-26T11:19:26.204377+0000","last_fullsized":"2024-04-26T11:19:26.204377+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:21.536805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205106+0000","last_change":"2024-04-26T11:19:18.188150+0000","last_active":"2024-04-26T11:19:26.205106+0000","last_peered":"2024-04-26T11:19:26.205106+0000","last_clean":"2024-04-26T11:19:26.205106+0000","last_became_active":"2024-04-26T11:19:18.186342+0000","last_became_peered":"2024-04-26T11:19:18.186342+0000","last_unstale":"2024-04-26T11:19:26.205106+0000","last_undegraded":"2024-04-26T11:19:26.205106+0000","last_fullsized":"2024-04-26T11:19:26.205106+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:49.270374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204487+0000","last_change":"2024-04-26T11:19:24.201645+0000","last_active":"2024-04-26T11:19:26.204487+0000","last_peered":"2024-04-26T11:19:26.204487+0000","last_clean":"2024-04-26T11:19:26.204487+0000","last_became_active":"2024-04-26T11:19:24.201330+0000","last_became_peered":"2024-04-26T11:19:24.201330+0000","last_unstale":"2024-04-26T11:19:26.204487+0000","last_undegraded":"2024-04-26T11:19:26.204487+0000","last_fullsized":"2024-04-26T11:19:26.204487+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:29.326197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204383+0000","last_change":"2024-04-26T11:19:24.201672+0000","last_active":"2024-04-26T11:19:26.204383+0000","last_peered":"2024-04-26T11:19:26.204383+0000","last_clean":"2024-04-26T11:19:26.204383+0000","last_became_active":"2024-04-26T11:19:24.201077+0000","last_became_peered":"2024-04-26T11:19:24.201077+0000","last_unstale":"2024-04-26T11:19:26.204383+0000","last_undegraded":"2024-04-26T11:19:26.204383+0000","last_fullsized":"2024-04-26T11:19:26.204383+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:42.500892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204910+0000","last_change":"2024-04-26T11:19:18.187865+0000","last_active":"2024-04-26T11:19:26.204910+0000","last_peered":"2024-04-26T11:19:26.204910+0000","last_clean":"2024-04-26T11:19:26.204910+0000","last_became_active":"2024-04-26T11:19:18.185768+0000","last_became_peered":"2024-04-26T11:19:18.185768+0000","last_unstale":"2024-04-26T11:19:26.204910+0000","last_undegraded":"2024-04-26T11:19:26.204910+0000","last_fullsized":"2024-04-26T11:19:26.204910+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:22.710616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204221+0000","last_change":"2024-04-26T11:19:18.186275+0000","last_active":"2024-04-26T11:19:26.204221+0000","last_peered":"2024-04-26T11:19:26.204221+0000","last_clean":"2024-04-26T11:19:26.204221+0000","last_became_active":"2024-04-26T11:19:18.184149+0000","last_became_peered":"2024-04-26T11:19:18.184149+0000","last_unstale":"2024-04-26T11:19:26.204221+0000","last_undegraded":"2024-04-26T11:19:26.204221+0000","last_fullsized":"2024-04-26T11:19:26.204221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:26.309810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205022+0000","last_change":"2024-04-26T11:19:18.184312+0000","last_active":"2024-04-26T11:19:26.205022+0000","last_peered":"2024-04-26T11:19:26.205022+0000","last_clean":"2024-04-26T11:19:26.205022+0000","last_became_active":"2024-04-26T11:19:18.181951+0000","last_became_peered":"2024-04-26T11:19:18.181951+0000","last_unstale":"2024-04-26T11:19:26.205022+0000","last_undegraded":"2024-04-26T11:19:26.205022+0000","last_fullsized":"2024-04-26T11:19:26.205022+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:45.284225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":106,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204701+0000","last_change":"2024-04-26T11:19:18.182240+0000","last_active":"2024-04-26T11:19:26.204701+0000","last_peered":"2024-04-26T11:19:26.204701+0000","last_clean":"2024-04-26T11:19:26.204701+0000","last_became_active":"2024-04-26T11:19:18.181767+0000","last_became_peered":"2024-04-26T11:19:18.181767+0000","last_unstale":"2024-04-26T11:19:26.204701+0000","last_undegraded":"2024-04-26T11:19:26.204701+0000","last_fullsized":"2024-04-26T11:19:26.204701+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:37:45.829872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205175+0000","last_change":"2024-04-26T11:19:18.183033+0000","last_active":"2024-04-26T11:19:26.205175+0000","last_peered":"2024-04-26T11:19:26.205175+0000","last_clean":"2024-04-26T11:19:26.205175+0000","last_became_active":"2024-04-26T11:19:18.182060+0000","last_became_peered":"2024-04-26T11:19:18.182060+0000","last_unstale":"2024-04-26T11:19:26.205175+0000","last_undegraded":"2024-04-26T11:19:26.205175+0000","last_fullsized":"2024-04-26T11:19:26.205175+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:27.875590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204716+0000","last_change":"2024-04-26T11:13:12.493217+0000","last_active":"2024-04-26T11:19:26.204716+0000","last_peered":"2024-04-26T11:19:26.204716+0000","last_clean":"2024-04-26T11:19:26.204716+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:19:26.204716+0000","last_undegraded":"2024-04-26T11:19:26.204716+0000","last_fullsized":"2024-04-26T11:19:26.204716+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:00.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684546+0000","last_change":"2024-04-26T11:19:24.204856+0000","last_active":"2024-04-26T11:19:26.684546+0000","last_peered":"2024-04-26T11:19:26.684546+0000","last_clean":"2024-04-26T11:19:26.684546+0000","last_became_active":"2024-04-26T11:19:24.203758+0000","last_became_peered":"2024-04-26T11:19:24.203758+0000","last_unstale":"2024-04-26T11:19:26.684546+0000","last_undegraded":"2024-04-26T11:19:26.684546+0000","last_fullsized":"2024-04-26T11:19:26.684546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:33.131784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684419+0000","last_change":"2024-04-26T11:19:24.201687+0000","last_active":"2024-04-26T11:19:26.684419+0000","last_peered":"2024-04-26T11:19:26.684419+0000","last_clean":"2024-04-26T11:19:26.684419+0000","last_became_active":"2024-04-26T11:19:24.200963+0000","last_became_peered":"2024-04-26T11:19:24.200963+0000","last_unstale":"2024-04-26T11:19:26.684419+0000","last_undegraded":"2024-04-26T11:19:26.684419+0000","last_fullsized":"2024-04-26T11:19:26.684419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:30:42.125098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205206+0000","last_change":"2024-04-26T11:19:18.189488+0000","last_active":"2024-04-26T11:19:26.205206+0000","last_peered":"2024-04-26T11:19:26.205206+0000","last_clean":"2024-04-26T11:19:26.205206+0000","last_became_active":"2024-04-26T11:19:18.189086+0000","last_became_peered":"2024-04-26T11:19:18.189086+0000","last_unstale":"2024-04-26T11:19:26.205206+0000","last_undegraded":"2024-04-26T11:19:26.205206+0000","last_fullsized":"2024-04-26T11:19:26.205206+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:00.540494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204973+0000","last_change":"2024-04-26T11:19:18.182582+0000","last_active":"2024-04-26T11:19:26.204973+0000","last_peered":"2024-04-26T11:19:26.204973+0000","last_clean":"2024-04-26T11:19:26.204973+0000","last_became_active":"2024-04-26T11:19:18.181791+0000","last_became_peered":"2024-04-26T11:19:18.181791+0000","last_unstale":"2024-04-26T11:19:26.204973+0000","last_undegraded":"2024-04-26T11:19:26.204973+0000","last_fullsized":"2024-04-26T11:19:26.204973+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:59.312651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204228+0000","last_change":"2024-04-26T11:19:18.185313+0000","last_active":"2024-04-26T11:19:26.204228+0000","last_peered":"2024-04-26T11:19:26.204228+0000","last_clean":"2024-04-26T11:19:26.204228+0000","last_became_active":"2024-04-26T11:19:18.183292+0000","last_became_peered":"2024-04-26T11:19:18.183292+0000","last_unstale":"2024-04-26T11:19:26.204228+0000","last_undegraded":"2024-04-26T11:19:26.204228+0000","last_fullsized":"2024-04-26T11:19:26.204228+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:05.860349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204969+0000","last_change":"2024-04-26T11:19:18.190450+0000","last_active":"2024-04-26T11:19:26.204969+0000","last_peered":"2024-04-26T11:19:26.204969+0000","last_clean":"2024-04-26T11:19:26.204969+0000","last_became_active":"2024-04-26T11:19:18.190096+0000","last_became_peered":"2024-04-26T11:19:18.190096+0000","last_unstale":"2024-04-26T11:19:26.204969+0000","last_undegraded":"2024-04-26T11:19:26.204969+0000","last_fullsized":"2024-04-26T11:19:26.204969+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:26.905702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684402+0000","last_change":"2024-04-26T11:19:24.200305+0000","last_active":"2024-04-26T11:19:26.684402+0000","last_peered":"2024-04-26T11:19:26.684402+0000","last_clean":"2024-04-26T11:19:26.684402+0000","last_became_active":"2024-04-26T11:19:24.199834+0000","last_became_peered":"2024-04-26T11:19:24.199834+0000","last_unstale":"2024-04-26T11:19:26.684402+0000","last_undegraded":"2024-04-26T11:19:26.684402+0000","last_fullsized":"2024-04-26T11:19:26.684402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:47.203614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684327+0000","last_change":"2024-04-26T11:19:24.197329+0000","last_active":"2024-04-26T11:19:26.684327+0000","last_peered":"2024-04-26T11:19:26.684327+0000","last_clean":"2024-04-26T11:19:26.684327+0000","last_became_active":"2024-04-26T11:19:24.196561+0000","last_became_peered":"2024-04-26T11:19:24.196561+0000","last_unstale":"2024-04-26T11:19:26.684327+0000","last_undegraded":"2024-04-26T11:19:26.684327+0000","last_fullsized":"2024-04-26T11:19:26.684327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:06.140967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":107,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204709+0000","last_change":"2024-04-26T11:19:18.182680+0000","last_active":"2024-04-26T11:19:26.204709+0000","last_peered":"2024-04-26T11:19:26.204709+0000","last_clean":"2024-04-26T11:19:26.204709+0000","last_became_active":"2024-04-26T11:19:18.182077+0000","last_became_peered":"2024-04-26T11:19:18.182077+0000","last_unstale":"2024-04-26T11:19:26.204709+0000","last_undegraded":"2024-04-26T11:19:26.204709+0000","last_fullsized":"2024-04-26T11:19:26.204709+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:48.832886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684566+0000","last_change":"2024-04-26T11:19:24.205473+0000","last_active":"2024-04-26T11:19:26.684566+0000","last_peered":"2024-04-26T11:19:26.684566+0000","last_clean":"2024-04-26T11:19:26.684566+0000","last_became_active":"2024-04-26T11:19:24.204538+0000","last_became_peered":"2024-04-26T11:19:24.204538+0000","last_unstale":"2024-04-26T11:19:26.684566+0000","last_undegraded":"2024-04-26T11:19:26.684566+0000","last_fullsized":"2024-04-26T11:19:26.684566+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:55.279045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204413+0000","last_change":"2024-04-26T11:19:18.186884+0000","last_active":"2024-04-26T11:19:26.204413+0000","last_peered":"2024-04-26T11:19:26.204413+0000","last_clean":"2024-04-26T11:19:26.204413+0000","last_became_active":"2024-04-26T11:19:18.184460+0000","last_became_peered":"2024-04-26T11:19:18.184460+0000","last_unstale":"2024-04-26T11:19:26.204413+0000","last_undegraded":"2024-04-26T11:19:26.204413+0000","last_fullsized":"2024-04-26T11:19:26.204413+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:12.901543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":234,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204187+0000","last_change":"2024-04-26T11:19:18.181070+0000","last_active":"2024-04-26T11:19:26.204187+0000","last_peered":"2024-04-26T11:19:26.204187+0000","last_clean":"2024-04-26T11:19:26.204187+0000","last_became_active":"2024-04-26T11:19:18.180577+0000","last_became_peered":"2024-04-26T11:19:18.180577+0000","last_unstale":"2024-04-26T11:19:26.204187+0000","last_undegraded":"2024-04-26T11:19:26.204187+0000","last_fullsized":"2024-04-26T11:19:26.204187+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:34:03.095255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684351+0000","last_change":"2024-04-26T11:19:24.197315+0000","last_active":"2024-04-26T11:19:26.684351+0000","last_peered":"2024-04-26T11:19:26.684351+0000","last_clean":"2024-04-26T11:19:26.684351+0000","last_became_active":"2024-04-26T11:19:24.196404+0000","last_became_peered":"2024-04-26T11:19:24.196404+0000","last_unstale":"2024-04-26T11:19:26.684351+0000","last_undegraded":"2024-04-26T11:19:26.684351+0000","last_fullsized":"2024-04-26T11:19:26.684351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:21:58.513393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204960+0000","last_change":"2024-04-26T11:19:18.184063+0000","last_active":"2024-04-26T11:19:26.204960+0000","last_peered":"2024-04-26T11:19:26.204960+0000","last_clean":"2024-04-26T11:19:26.204960+0000","last_became_active":"2024-04-26T11:19:18.181863+0000","last_became_peered":"2024-04-26T11:19:18.181863+0000","last_unstale":"2024-04-26T11:19:26.204960+0000","last_undegraded":"2024-04-26T11:19:26.204960+0000","last_fullsized":"2024-04-26T11:19:26.204960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:53.865511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204315+0000","last_change":"2024-04-26T11:19:18.181362+0000","last_active":"2024-04-26T11:19:26.204315+0000","last_peered":"2024-04-26T11:19:26.204315+0000","last_clean":"2024-04-26T11:19:26.204315+0000","last_became_active":"2024-04-26T11:19:18.180792+0000","last_became_peered":"2024-04-26T11:19:18.180792+0000","last_unstale":"2024-04-26T11:19:26.204315+0000","last_undegraded":"2024-04-26T11:19:26.204315+0000","last_fullsized":"2024-04-26T11:19:26.204315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:16.215932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.209802+0000","last_change":"2024-04-26T11:19:24.199071+0000","last_active":"2024-04-26T11:19:27.209802+0000","last_peered":"2024-04-26T11:19:27.209802+0000","last_clean":"2024-04-26T11:19:27.209802+0000","last_became_active":"2024-04-26T11:19:24.197711+0000","last_became_peered":"2024-04-26T11:19:24.197711+0000","last_unstale":"2024-04-26T11:19:27.209802+0000","last_undegraded":"2024-04-26T11:19:27.209802+0000","last_fullsized":"2024-04-26T11:19:27.209802+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:34.664546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205609+0000","last_change":"2024-04-26T11:13:12.918648+0000","last_active":"2024-04-26T11:19:26.205609+0000","last_peered":"2024-04-26T11:19:26.205609+0000","last_clean":"2024-04-26T11:19:26.205609+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:19:26.205609+0000","last_undegraded":"2024-04-26T11:19:26.205609+0000","last_fullsized":"2024-04-26T11:19:26.205609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.631673+0000","last_change":"2024-04-26T11:13:08.110433+0000","last_active":"2024-04-26T11:19:26.631673+0000","last_peered":"2024-04-26T11:19:26.631673+0000","last_clean":"2024-04-26T11:19:26.631673+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:19:26.631673+0000","last_undegraded":"2024-04-26T11:19:26.631673+0000","last_fullsized":"2024-04-26T11:19:26.631673+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684429+0000","last_change":"2024-04-26T11:19:24.203404+0000","last_active":"2024-04-26T11:19:26.684429+0000","last_peered":"2024-04-26T11:19:26.684429+0000","last_clean":"2024-04-26T11:19:26.684429+0000","last_became_active":"2024-04-26T11:19:24.202550+0000","last_became_peered":"2024-04-26T11:19:24.202550+0000","last_unstale":"2024-04-26T11:19:26.684429+0000","last_undegraded":"2024-04-26T11:19:26.684429+0000","last_fullsized":"2024-04-26T11:19:26.684429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:22.115008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204932+0000","last_change":"2024-04-26T11:19:18.182788+0000","last_active":"2024-04-26T11:19:26.204932+0000","last_peered":"2024-04-26T11:19:26.204932+0000","last_clean":"2024-04-26T11:19:26.204932+0000","last_became_active":"2024-04-26T11:19:18.182186+0000","last_became_peered":"2024-04-26T11:19:18.182186+0000","last_unstale":"2024-04-26T11:19:26.204932+0000","last_undegraded":"2024-04-26T11:19:26.204932+0000","last_fullsized":"2024-04-26T11:19:26.204932+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:26.933717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684536+0000","last_change":"2024-04-26T11:19:24.203482+0000","last_active":"2024-04-26T11:19:26.684536+0000","last_peered":"2024-04-26T11:19:26.684536+0000","last_clean":"2024-04-26T11:19:26.684536+0000","last_became_active":"2024-04-26T11:19:24.202310+0000","last_became_peered":"2024-04-26T11:19:24.202310+0000","last_unstale":"2024-04-26T11:19:26.684536+0000","last_undegraded":"2024-04-26T11:19:26.684536+0000","last_fullsized":"2024-04-26T11:19:26.684536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:57:50.731804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684477+0000","last_change":"2024-04-26T11:19:24.202951+0000","last_active":"2024-04-26T11:19:26.684477+0000","last_peered":"2024-04-26T11:19:26.684477+0000","last_clean":"2024-04-26T11:19:26.684477+0000","last_became_active":"2024-04-26T11:19:24.202566+0000","last_became_peered":"2024-04-26T11:19:24.202566+0000","last_unstale":"2024-04-26T11:19:26.684477+0000","last_undegraded":"2024-04-26T11:19:26.684477+0000","last_fullsized":"2024-04-26T11:19:26.684477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:55.762840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204185+0000","last_change":"2024-04-26T11:19:24.198685+0000","last_active":"2024-04-26T11:19:26.204185+0000","last_peered":"2024-04-26T11:19:26.204185+0000","last_clean":"2024-04-26T11:19:26.204185+0000","last_became_active":"2024-04-26T11:19:24.197383+0000","last_became_peered":"2024-04-26T11:19:24.197383+0000","last_unstale":"2024-04-26T11:19:26.204185+0000","last_undegraded":"2024-04-26T11:19:26.204185+0000","last_fullsized":"2024-04-26T11:19:26.204185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:08:32.146962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204870+0000","last_change":"2024-04-26T11:19:18.181795+0000","last_active":"2024-04-26T11:19:26.204870+0000","last_peered":"2024-04-26T11:19:26.204870+0000","last_clean":"2024-04-26T11:19:26.204870+0000","last_became_active":"2024-04-26T11:19:18.180871+0000","last_became_peered":"2024-04-26T11:19:18.180871+0000","last_unstale":"2024-04-26T11:19:26.204870+0000","last_undegraded":"2024-04-26T11:19:26.204870+0000","last_fullsized":"2024-04-26T11:19:26.204870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:23.698612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204826+0000","last_change":"2024-04-26T11:19:24.200015+0000","last_active":"2024-04-26T11:19:26.204826+0000","last_peered":"2024-04-26T11:19:26.204826+0000","last_clean":"2024-04-26T11:19:26.204826+0000","last_became_active":"2024-04-26T11:19:24.198853+0000","last_became_peered":"2024-04-26T11:19:24.198853+0000","last_unstale":"2024-04-26T11:19:26.204826+0000","last_undegraded":"2024-04-26T11:19:26.204826+0000","last_fullsized":"2024-04-26T11:19:26.204826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:17.832954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210690+0000","last_change":"2024-04-26T11:19:18.182878+0000","last_active":"2024-04-26T11:19:27.210690+0000","last_peered":"2024-04-26T11:19:27.210690+0000","last_clean":"2024-04-26T11:19:27.210690+0000","last_became_active":"2024-04-26T11:19:18.182228+0000","last_became_peered":"2024-04-26T11:19:18.182228+0000","last_unstale":"2024-04-26T11:19:27.210690+0000","last_undegraded":"2024-04-26T11:19:27.210690+0000","last_fullsized":"2024-04-26T11:19:27.210690+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:34.672880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205075+0000","last_change":"2024-04-26T11:19:18.183238+0000","last_active":"2024-04-26T11:19:26.205075+0000","last_peered":"2024-04-26T11:19:26.205075+0000","last_clean":"2024-04-26T11:19:26.205075+0000","last_became_active":"2024-04-26T11:19:18.182671+0000","last_became_peered":"2024-04-26T11:19:18.182671+0000","last_unstale":"2024-04-26T11:19:26.205075+0000","last_undegraded":"2024-04-26T11:19:26.205075+0000","last_fullsized":"2024-04-26T11:19:26.205075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:49.368568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205360+0000","last_change":"2024-04-26T11:13:12.917812+0000","last_active":"2024-04-26T11:19:26.205360+0000","last_peered":"2024-04-26T11:19:26.205360+0000","last_clean":"2024-04-26T11:19:26.205360+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:19:26.205360+0000","last_undegraded":"2024-04-26T11:19:26.205360+0000","last_fullsized":"2024-04-26T11:19:26.205360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205222+0000","last_change":"2024-04-26T11:19:18.188983+0000","last_active":"2024-04-26T11:19:26.205222+0000","last_peered":"2024-04-26T11:19:26.205222+0000","last_clean":"2024-04-26T11:19:26.205222+0000","last_became_active":"2024-04-26T11:19:18.188177+0000","last_became_peered":"2024-04-26T11:19:18.188177+0000","last_unstale":"2024-04-26T11:19:26.205222+0000","last_undegraded":"2024-04-26T11:19:26.205222+0000","last_fullsized":"2024-04-26T11:19:26.205222+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:31.255327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204597+0000","last_change":"2024-04-26T11:19:18.188002+0000","last_active":"2024-04-26T11:19:26.204597+0000","last_peered":"2024-04-26T11:19:26.204597+0000","last_clean":"2024-04-26T11:19:26.204597+0000","last_became_active":"2024-04-26T11:19:18.185372+0000","last_became_peered":"2024-04-26T11:19:18.185372+0000","last_unstale":"2024-04-26T11:19:26.204597+0000","last_undegraded":"2024-04-26T11:19:26.204597+0000","last_fullsized":"2024-04-26T11:19:26.204597+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:04.942442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205645+0000","last_change":"2024-04-26T11:19:18.190885+0000","last_active":"2024-04-26T11:19:26.205645+0000","last_peered":"2024-04-26T11:19:26.205645+0000","last_clean":"2024-04-26T11:19:26.205645+0000","last_became_active":"2024-04-26T11:19:18.190374+0000","last_became_peered":"2024-04-26T11:19:18.190374+0000","last_unstale":"2024-04-26T11:19:26.205645+0000","last_undegraded":"2024-04-26T11:19:26.205645+0000","last_fullsized":"2024-04-26T11:19:26.205645+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:53.646080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204769+0000","last_change":"2024-04-26T11:19:18.189666+0000","last_active":"2024-04-26T11:19:26.204769+0000","last_peered":"2024-04-26T11:19:26.204769+0000","last_clean":"2024-04-26T11:19:26.204769+0000","last_became_active":"2024-04-26T11:19:18.189341+0000","last_became_peered":"2024-04-26T11:19:18.189341+0000","last_unstale":"2024-04-26T11:19:26.204769+0000","last_undegraded":"2024-04-26T11:19:26.204769+0000","last_fullsized":"2024-04-26T11:19:26.204769+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:52.141583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684494+0000","last_change":"2024-04-26T11:19:24.202866+0000","last_active":"2024-04-26T11:19:26.684494+0000","last_peered":"2024-04-26T11:19:26.684494+0000","last_clean":"2024-04-26T11:19:26.684494+0000","last_became_active":"2024-04-26T11:19:24.202422+0000","last_became_peered":"2024-04-26T11:19:24.202422+0000","last_unstale":"2024-04-26T11:19:26.684494+0000","last_undegraded":"2024-04-26T11:19:26.684494+0000","last_fullsized":"2024-04-26T11:19:26.684494+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.564374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205080+0000","last_change":"2024-04-26T11:13:12.917763+0000","last_active":"2024-04-26T11:19:26.205080+0000","last_peered":"2024-04-26T11:19:26.205080+0000","last_clean":"2024-04-26T11:19:26.205080+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:19:26.205080+0000","last_undegraded":"2024-04-26T11:19:26.205080+0000","last_fullsized":"2024-04-26T11:19:26.205080+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204913+0000","last_change":"2024-04-26T11:19:24.205087+0000","last_active":"2024-04-26T11:19:26.204913+0000","last_peered":"2024-04-26T11:19:26.204913+0000","last_clean":"2024-04-26T11:19:26.204913+0000","last_became_active":"2024-04-26T11:19:24.204129+0000","last_became_peered":"2024-04-26T11:19:24.204129+0000","last_unstale":"2024-04-26T11:19:26.204913+0000","last_undegraded":"2024-04-26T11:19:26.204913+0000","last_fullsized":"2024-04-26T11:19:26.204913+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:15.916622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204637+0000","last_change":"2024-04-26T11:19:18.189530+0000","last_active":"2024-04-26T11:19:26.204637+0000","last_peered":"2024-04-26T11:19:26.204637+0000","last_clean":"2024-04-26T11:19:26.204637+0000","last_became_active":"2024-04-26T11:19:18.189179+0000","last_became_peered":"2024-04-26T11:19:18.189179+0000","last_unstale":"2024-04-26T11:19:26.204637+0000","last_undegraded":"2024-04-26T11:19:26.204637+0000","last_fullsized":"2024-04-26T11:19:26.204637+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.132608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204517+0000","last_change":"2024-04-26T11:19:18.189257+0000","last_active":"2024-04-26T11:19:26.204517+0000","last_peered":"2024-04-26T11:19:26.204517+0000","last_clean":"2024-04-26T11:19:26.204517+0000","last_became_active":"2024-04-26T11:19:18.188963+0000","last_became_peered":"2024-04-26T11:19:18.188963+0000","last_unstale":"2024-04-26T11:19:26.204517+0000","last_undegraded":"2024-04-26T11:19:26.204517+0000","last_fullsized":"2024-04-26T11:19:26.204517+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:37.907392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684318+0000","last_change":"2024-04-26T11:19:24.200217+0000","last_active":"2024-04-26T11:19:26.684318+0000","last_peered":"2024-04-26T11:19:26.684318+0000","last_clean":"2024-04-26T11:19:26.684318+0000","last_became_active":"2024-04-26T11:19:24.198397+0000","last_became_peered":"2024-04-26T11:19:24.198397+0000","last_unstale":"2024-04-26T11:19:26.684318+0000","last_undegraded":"2024-04-26T11:19:26.684318+0000","last_fullsized":"2024-04-26T11:19:26.684318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:44.576230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205025+0000","last_change":"2024-04-26T11:19:18.183441+0000","last_active":"2024-04-26T11:19:26.205025+0000","last_peered":"2024-04-26T11:19:26.205025+0000","last_clean":"2024-04-26T11:19:26.205025+0000","last_became_active":"2024-04-26T11:19:18.183037+0000","last_became_peered":"2024-04-26T11:19:18.183037+0000","last_unstale":"2024-04-26T11:19:26.205025+0000","last_undegraded":"2024-04-26T11:19:26.205025+0000","last_fullsized":"2024-04-26T11:19:26.205025+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:32.597584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684386+0000","last_change":"2024-04-26T11:19:24.203647+0000","last_active":"2024-04-26T11:19:26.684386+0000","last_peered":"2024-04-26T11:19:26.684386+0000","last_clean":"2024-04-26T11:19:26.684386+0000","last_became_active":"2024-04-26T11:19:24.202442+0000","last_became_peered":"2024-04-26T11:19:24.202442+0000","last_unstale":"2024-04-26T11:19:26.684386+0000","last_undegraded":"2024-04-26T11:19:26.684386+0000","last_fullsized":"2024-04-26T11:19:26.684386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:21.883832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205445+0000","last_change":"2024-04-26T11:19:18.184719+0000","last_active":"2024-04-26T11:19:26.205445+0000","last_peered":"2024-04-26T11:19:26.205445+0000","last_clean":"2024-04-26T11:19:26.205445+0000","last_became_active":"2024-04-26T11:19:18.184384+0000","last_became_peered":"2024-04-26T11:19:18.184384+0000","last_unstale":"2024-04-26T11:19:26.205445+0000","last_undegraded":"2024-04-26T11:19:26.205445+0000","last_fullsized":"2024-04-26T11:19:26.205445+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:37.130545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7958,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738447,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281152,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94090688,"statfs":{"total":96636764160,"available":96348864512,"internally_reserved":0,"allocated":1490944,"data_stored":947441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Fri Apr 26 11:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45800000000000002,"15min":0.39600000000000002},"min":{"1min":0.34399999999999997,"5min":0.17999999999999999,"15min":0.17199999999999999},"max":{"1min":0.68100000000000005,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.316,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.66400000000000003,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.60699999999999998}]}]},{"osd":0,"up_from":75,"seq":322122547204,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38160,"kb_used_data":1468,"kb_used_omap":10,"kb_used_meta":36661,"kb_avail":94333680,"statfs":{"total":96636764160,"available":96597688320,"internally_reserved":0,"allocated":1503232,"data_stored":949168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11228,"internal_metadata":37540900},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738448,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401140,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":400254,"kb_avail":93970700,"statfs":{"total":96636764160,"available":96225996800,"internally_reserved":0,"allocated":884736,"data_stored":357054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":409860550},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Fri Apr 26 11:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.44700000000000001,"15min":0.40699999999999997},"min":{"1min":0.34999999999999998,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.69199999999999995,"5min":2.056,"15min":2.056},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.499,"15min":0.46400000000000002},"min":{"1min":0.376,"5min":0.193,"15min":0.193},"max":{"1min":0.67600000000000005,"5min":3.9609999999999999,"15min":3.9609999999999999},"last":0.46000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7958,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:19:31.526 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:19:31.906 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:19:31.907 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:19:31.917 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":270,"stamp":"2024-04-26T11:19:30.561406+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":720452,"kb_used_data":3788,"kb_used_omap":14,"kb_used_meta":716593,"kb_avail":282395068,"statfs":{"total":289910292480,"available":289172549632,"internally_reserved":0,"allocated":3878912,"data_stored":2253663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14416,"internal_metadata":733792176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001090"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205605+0000","last_change":"2024-04-26T11:13:12.919196+0000","last_active":"2024-04-26T11:19:26.205605+0000","last_peered":"2024-04-26T11:19:26.205605+0000","last_clean":"2024-04-26T11:19:26.205605+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:19:26.205605+0000","last_undegraded":"2024-04-26T11:19:26.205605+0000","last_fullsized":"2024-04-26T11:19:26.205605+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205354+0000","last_change":"2024-04-26T11:13:12.917670+0000","last_active":"2024-04-26T11:19:26.205354+0000","last_peered":"2024-04-26T11:19:26.205354+0000","last_clean":"2024-04-26T11:19:26.205354+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:19:26.205354+0000","last_undegraded":"2024-04-26T11:19:26.205354+0000","last_fullsized":"2024-04-26T11:19:26.205354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205142+0000","last_change":"2024-04-26T11:19:18.185209+0000","last_active":"2024-04-26T11:19:26.205142+0000","last_peered":"2024-04-26T11:19:26.205142+0000","last_clean":"2024-04-26T11:19:26.205142+0000","last_became_active":"2024-04-26T11:19:18.182972+0000","last_became_peered":"2024-04-26T11:19:18.182972+0000","last_unstale":"2024-04-26T11:19:26.205142+0000","last_undegraded":"2024-04-26T11:19:26.205142+0000","last_fullsized":"2024-04-26T11:19:26.205142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:57.755970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204499+0000","last_change":"2024-04-26T11:19:18.183286+0000","last_active":"2024-04-26T11:19:26.204499+0000","last_peered":"2024-04-26T11:19:26.204499+0000","last_clean":"2024-04-26T11:19:26.204499+0000","last_became_active":"2024-04-26T11:19:18.182942+0000","last_became_peered":"2024-04-26T11:19:18.182942+0000","last_unstale":"2024-04-26T11:19:26.204499+0000","last_undegraded":"2024-04-26T11:19:26.204499+0000","last_fullsized":"2024-04-26T11:19:26.204499+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:58.370599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205030+0000","last_change":"2024-04-26T11:13:12.917403+0000","last_active":"2024-04-26T11:19:26.205030+0000","last_peered":"2024-04-26T11:19:26.205030+0000","last_clean":"2024-04-26T11:19:26.205030+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:19:26.205030+0000","last_undegraded":"2024-04-26T11:19:26.205030+0000","last_fullsized":"2024-04-26T11:19:26.205030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:42.014955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204622+0000","last_change":"2024-04-26T11:19:18.189355+0000","last_active":"2024-04-26T11:19:26.204622+0000","last_peered":"2024-04-26T11:19:26.204622+0000","last_clean":"2024-04-26T11:19:26.204622+0000","last_became_active":"2024-04-26T11:19:18.188990+0000","last_became_peered":"2024-04-26T11:19:18.188990+0000","last_unstale":"2024-04-26T11:19:26.204622+0000","last_undegraded":"2024-04-26T11:19:26.204622+0000","last_fullsized":"2024-04-26T11:19:26.204622+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:29.030847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204397+0000","last_change":"2024-04-26T11:19:18.187953+0000","last_active":"2024-04-26T11:19:26.204397+0000","last_peered":"2024-04-26T11:19:26.204397+0000","last_clean":"2024-04-26T11:19:26.204397+0000","last_became_active":"2024-04-26T11:19:18.186638+0000","last_became_peered":"2024-04-26T11:19:18.186638+0000","last_unstale":"2024-04-26T11:19:26.204397+0000","last_undegraded":"2024-04-26T11:19:26.204397+0000","last_fullsized":"2024-04-26T11:19:26.204397+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:18.483074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204062+0000","last_change":"2024-04-26T11:19:18.183968+0000","last_active":"2024-04-26T11:19:26.204062+0000","last_peered":"2024-04-26T11:19:26.204062+0000","last_clean":"2024-04-26T11:19:26.204062+0000","last_became_active":"2024-04-26T11:19:18.182111+0000","last_became_peered":"2024-04-26T11:19:18.182111+0000","last_unstale":"2024-04-26T11:19:26.204062+0000","last_undegraded":"2024-04-26T11:19:26.204062+0000","last_fullsized":"2024-04-26T11:19:26.204062+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:08.529468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684517+0000","last_change":"2024-04-26T11:19:24.202861+0000","last_active":"2024-04-26T11:19:26.684517+0000","last_peered":"2024-04-26T11:19:26.684517+0000","last_clean":"2024-04-26T11:19:26.684517+0000","last_became_active":"2024-04-26T11:19:24.202146+0000","last_became_peered":"2024-04-26T11:19:24.202146+0000","last_unstale":"2024-04-26T11:19:26.684517+0000","last_undegraded":"2024-04-26T11:19:26.684517+0000","last_fullsized":"2024-04-26T11:19:26.684517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:33.234821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205553+0000","last_change":"2024-04-26T11:13:12.918521+0000","last_active":"2024-04-26T11:19:26.205553+0000","last_peered":"2024-04-26T11:19:26.205553+0000","last_clean":"2024-04-26T11:19:26.205553+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:19:26.205553+0000","last_undegraded":"2024-04-26T11:19:26.205553+0000","last_fullsized":"2024-04-26T11:19:26.205553+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204805+0000","last_change":"2024-04-26T11:19:18.187027+0000","last_active":"2024-04-26T11:19:26.204805+0000","last_peered":"2024-04-26T11:19:26.204805+0000","last_clean":"2024-04-26T11:19:26.204805+0000","last_became_active":"2024-04-26T11:19:18.185543+0000","last_became_peered":"2024-04-26T11:19:18.185543+0000","last_unstale":"2024-04-26T11:19:26.204805+0000","last_undegraded":"2024-04-26T11:19:26.204805+0000","last_fullsized":"2024-04-26T11:19:26.204805+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:38.365806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205142+0000","last_change":"2024-04-26T11:19:18.183459+0000","last_active":"2024-04-26T11:19:26.205142+0000","last_peered":"2024-04-26T11:19:26.205142+0000","last_clean":"2024-04-26T11:19:26.205142+0000","last_became_active":"2024-04-26T11:19:18.182827+0000","last_became_peered":"2024-04-26T11:19:18.182827+0000","last_unstale":"2024-04-26T11:19:26.205142+0000","last_undegraded":"2024-04-26T11:19:26.205142+0000","last_fullsized":"2024-04-26T11:19:26.205142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:28.182922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205400+0000","last_change":"2024-04-26T11:13:12.915484+0000","last_active":"2024-04-26T11:19:26.205400+0000","last_peered":"2024-04-26T11:19:26.205400+0000","last_clean":"2024-04-26T11:19:26.205400+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:19:26.205400+0000","last_undegraded":"2024-04-26T11:19:26.205400+0000","last_fullsized":"2024-04-26T11:19:26.205400+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204505+0000","last_change":"2024-04-26T11:19:18.181800+0000","last_active":"2024-04-26T11:19:26.204505+0000","last_peered":"2024-04-26T11:19:26.204505+0000","last_clean":"2024-04-26T11:19:26.204505+0000","last_became_active":"2024-04-26T11:19:18.180865+0000","last_became_peered":"2024-04-26T11:19:18.180865+0000","last_unstale":"2024-04-26T11:19:26.204505+0000","last_undegraded":"2024-04-26T11:19:26.204505+0000","last_fullsized":"2024-04-26T11:19:26.204505+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:36.948796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204335+0000","last_change":"2024-04-26T11:19:18.181625+0000","last_active":"2024-04-26T11:19:26.204335+0000","last_peered":"2024-04-26T11:19:26.204335+0000","last_clean":"2024-04-26T11:19:26.204335+0000","last_became_active":"2024-04-26T11:19:18.180763+0000","last_became_peered":"2024-04-26T11:19:18.180763+0000","last_unstale":"2024-04-26T11:19:26.204335+0000","last_undegraded":"2024-04-26T11:19:26.204335+0000","last_fullsized":"2024-04-26T11:19:26.204335+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:27.138589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204271+0000","last_change":"2024-04-26T11:19:18.185161+0000","last_active":"2024-04-26T11:19:26.204271+0000","last_peered":"2024-04-26T11:19:26.204271+0000","last_clean":"2024-04-26T11:19:26.204271+0000","last_became_active":"2024-04-26T11:19:18.184331+0000","last_became_peered":"2024-04-26T11:19:18.184331+0000","last_unstale":"2024-04-26T11:19:26.204271+0000","last_undegraded":"2024-04-26T11:19:26.204271+0000","last_fullsized":"2024-04-26T11:19:26.204271+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:29.254144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684526+0000","last_change":"2024-04-26T11:19:24.204827+0000","last_active":"2024-04-26T11:19:26.684526+0000","last_peered":"2024-04-26T11:19:26.684526+0000","last_clean":"2024-04-26T11:19:26.684526+0000","last_became_active":"2024-04-26T11:19:24.203764+0000","last_became_peered":"2024-04-26T11:19:24.203764+0000","last_unstale":"2024-04-26T11:19:26.684526+0000","last_undegraded":"2024-04-26T11:19:26.684526+0000","last_fullsized":"2024-04-26T11:19:26.684526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:29.263130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205647+0000","last_change":"2024-04-26T11:13:12.918759+0000","last_active":"2024-04-26T11:19:26.205647+0000","last_peered":"2024-04-26T11:19:26.205647+0000","last_clean":"2024-04-26T11:19:26.205647+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:19:26.205647+0000","last_undegraded":"2024-04-26T11:19:26.205647+0000","last_fullsized":"2024-04-26T11:19:26.205647+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:55.002972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684440+0000","last_change":"2024-04-26T11:19:24.200114+0000","last_active":"2024-04-26T11:19:26.684440+0000","last_peered":"2024-04-26T11:19:26.684440+0000","last_clean":"2024-04-26T11:19:26.684440+0000","last_became_active":"2024-04-26T11:19:24.199142+0000","last_became_peered":"2024-04-26T11:19:24.199142+0000","last_unstale":"2024-04-26T11:19:26.684440+0000","last_undegraded":"2024-04-26T11:19:26.684440+0000","last_fullsized":"2024-04-26T11:19:26.684440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:04.789203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205065+0000","last_change":"2024-04-26T11:19:18.186823+0000","last_active":"2024-04-26T11:19:26.205065+0000","last_peered":"2024-04-26T11:19:26.205065+0000","last_clean":"2024-04-26T11:19:26.205065+0000","last_became_active":"2024-04-26T11:19:18.184282+0000","last_became_peered":"2024-04-26T11:19:18.184282+0000","last_unstale":"2024-04-26T11:19:26.205065+0000","last_undegraded":"2024-04-26T11:19:26.205065+0000","last_fullsized":"2024-04-26T11:19:26.205065+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:11.581601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204671+0000","last_change":"2024-04-26T11:19:18.187937+0000","last_active":"2024-04-26T11:19:26.204671+0000","last_peered":"2024-04-26T11:19:26.204671+0000","last_clean":"2024-04-26T11:19:26.204671+0000","last_became_active":"2024-04-26T11:19:18.186605+0000","last_became_peered":"2024-04-26T11:19:18.186605+0000","last_unstale":"2024-04-26T11:19:26.204671+0000","last_undegraded":"2024-04-26T11:19:26.204671+0000","last_fullsized":"2024-04-26T11:19:26.204671+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:49.737640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204850+0000","last_change":"2024-04-26T11:19:18.182666+0000","last_active":"2024-04-26T11:19:26.204850+0000","last_peered":"2024-04-26T11:19:26.204850+0000","last_clean":"2024-04-26T11:19:26.204850+0000","last_became_active":"2024-04-26T11:19:18.181728+0000","last_became_peered":"2024-04-26T11:19:18.181728+0000","last_unstale":"2024-04-26T11:19:26.204850+0000","last_undegraded":"2024-04-26T11:19:26.204850+0000","last_fullsized":"2024-04-26T11:19:26.204850+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:07.719581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.203921+0000","last_change":"2024-04-26T11:19:24.198562+0000","last_active":"2024-04-26T11:19:26.203921+0000","last_peered":"2024-04-26T11:19:26.203921+0000","last_clean":"2024-04-26T11:19:26.203921+0000","last_became_active":"2024-04-26T11:19:24.197487+0000","last_became_peered":"2024-04-26T11:19:24.197487+0000","last_unstale":"2024-04-26T11:19:26.203921+0000","last_undegraded":"2024-04-26T11:19:26.203921+0000","last_fullsized":"2024-04-26T11:19:26.203921+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:31.790885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204840+0000","last_change":"2024-04-26T11:13:12.912756+0000","last_active":"2024-04-26T11:19:26.204840+0000","last_peered":"2024-04-26T11:19:26.204840+0000","last_clean":"2024-04-26T11:19:26.204840+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:19:26.204840+0000","last_undegraded":"2024-04-26T11:19:26.204840+0000","last_fullsized":"2024-04-26T11:19:26.204840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:04.177831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205614+0000","last_change":"2024-04-26T11:19:18.184692+0000","last_active":"2024-04-26T11:19:26.205614+0000","last_peered":"2024-04-26T11:19:26.205614+0000","last_clean":"2024-04-26T11:19:26.205614+0000","last_became_active":"2024-04-26T11:19:18.184451+0000","last_became_peered":"2024-04-26T11:19:18.184451+0000","last_unstale":"2024-04-26T11:19:26.205614+0000","last_undegraded":"2024-04-26T11:19:26.205614+0000","last_fullsized":"2024-04-26T11:19:26.205614+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:08.485754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204759+0000","last_change":"2024-04-26T11:19:24.199954+0000","last_active":"2024-04-26T11:19:26.204759+0000","last_peered":"2024-04-26T11:19:26.204759+0000","last_clean":"2024-04-26T11:19:26.204759+0000","last_became_active":"2024-04-26T11:19:24.198479+0000","last_became_peered":"2024-04-26T11:19:24.198479+0000","last_unstale":"2024-04-26T11:19:26.204759+0000","last_undegraded":"2024-04-26T11:19:26.204759+0000","last_fullsized":"2024-04-26T11:19:26.204759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:14.221425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204917+0000","last_change":"2024-04-26T11:19:18.185709+0000","last_active":"2024-04-26T11:19:26.204917+0000","last_peered":"2024-04-26T11:19:26.204917+0000","last_clean":"2024-04-26T11:19:26.204917+0000","last_became_active":"2024-04-26T11:19:18.185105+0000","last_became_peered":"2024-04-26T11:19:18.185105+0000","last_unstale":"2024-04-26T11:19:26.204917+0000","last_undegraded":"2024-04-26T11:19:26.204917+0000","last_fullsized":"2024-04-26T11:19:26.204917+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:43.626259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204813+0000","last_change":"2024-04-26T11:13:12.493425+0000","last_active":"2024-04-26T11:19:26.204813+0000","last_peered":"2024-04-26T11:19:26.204813+0000","last_clean":"2024-04-26T11:19:26.204813+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:19:26.204813+0000","last_undegraded":"2024-04-26T11:19:26.204813+0000","last_fullsized":"2024-04-26T11:19:26.204813+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:23.279580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205712+0000","last_change":"2024-04-26T11:19:18.191042+0000","last_active":"2024-04-26T11:19:26.205712+0000","last_peered":"2024-04-26T11:19:26.205712+0000","last_clean":"2024-04-26T11:19:26.205712+0000","last_became_active":"2024-04-26T11:19:18.190792+0000","last_became_peered":"2024-04-26T11:19:18.190792+0000","last_unstale":"2024-04-26T11:19:26.205712+0000","last_undegraded":"2024-04-26T11:19:26.205712+0000","last_fullsized":"2024-04-26T11:19:26.205712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:45.726211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684337+0000","last_change":"2024-04-26T11:19:24.203467+0000","last_active":"2024-04-26T11:19:26.684337+0000","last_peered":"2024-04-26T11:19:26.684337+0000","last_clean":"2024-04-26T11:19:26.684337+0000","last_became_active":"2024-04-26T11:19:24.202348+0000","last_became_peered":"2024-04-26T11:19:24.202348+0000","last_unstale":"2024-04-26T11:19:26.684337+0000","last_undegraded":"2024-04-26T11:19:26.684337+0000","last_fullsized":"2024-04-26T11:19:26.684337+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:55.157485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204840+0000","last_change":"2024-04-26T11:19:24.200292+0000","last_active":"2024-04-26T11:19:26.204840+0000","last_peered":"2024-04-26T11:19:26.204840+0000","last_clean":"2024-04-26T11:19:26.204840+0000","last_became_active":"2024-04-26T11:19:24.198920+0000","last_became_peered":"2024-04-26T11:19:24.198920+0000","last_unstale":"2024-04-26T11:19:26.204840+0000","last_undegraded":"2024-04-26T11:19:26.204840+0000","last_fullsized":"2024-04-26T11:19:26.204840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:45.950568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684279+0000","last_change":"2024-04-26T11:19:24.199051+0000","last_active":"2024-04-26T11:19:26.684279+0000","last_peered":"2024-04-26T11:19:26.684279+0000","last_clean":"2024-04-26T11:19:26.684279+0000","last_became_active":"2024-04-26T11:19:24.197698+0000","last_became_peered":"2024-04-26T11:19:24.197698+0000","last_unstale":"2024-04-26T11:19:26.684279+0000","last_undegraded":"2024-04-26T11:19:26.684279+0000","last_fullsized":"2024-04-26T11:19:26.684279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:21.891894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211316+0000","last_change":"2024-04-26T11:19:18.190418+0000","last_active":"2024-04-26T11:19:27.211316+0000","last_peered":"2024-04-26T11:19:27.211316+0000","last_clean":"2024-04-26T11:19:27.211316+0000","last_became_active":"2024-04-26T11:19:18.190127+0000","last_became_peered":"2024-04-26T11:19:18.190127+0000","last_unstale":"2024-04-26T11:19:27.211316+0000","last_undegraded":"2024-04-26T11:19:27.211316+0000","last_fullsized":"2024-04-26T11:19:27.211316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:11:25.515683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205003+0000","last_change":"2024-04-26T11:19:24.205086+0000","last_active":"2024-04-26T11:19:26.205003+0000","last_peered":"2024-04-26T11:19:26.205003+0000","last_clean":"2024-04-26T11:19:26.205003+0000","last_became_active":"2024-04-26T11:19:24.204122+0000","last_became_peered":"2024-04-26T11:19:24.204122+0000","last_unstale":"2024-04-26T11:19:26.205003+0000","last_undegraded":"2024-04-26T11:19:26.205003+0000","last_fullsized":"2024-04-26T11:19:26.205003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:56:23.239851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684262+0000","last_change":"2024-04-26T11:19:24.198434+0000","last_active":"2024-04-26T11:19:26.684262+0000","last_peered":"2024-04-26T11:19:26.684262+0000","last_clean":"2024-04-26T11:19:26.684262+0000","last_became_active":"2024-04-26T11:19:24.197247+0000","last_became_peered":"2024-04-26T11:19:24.197247+0000","last_unstale":"2024-04-26T11:19:26.684262+0000","last_undegraded":"2024-04-26T11:19:26.684262+0000","last_fullsized":"2024-04-26T11:19:26.684262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:23.769249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204777+0000","last_change":"2024-04-26T11:19:18.187720+0000","last_active":"2024-04-26T11:19:26.204777+0000","last_peered":"2024-04-26T11:19:26.204777+0000","last_clean":"2024-04-26T11:19:26.204777+0000","last_became_active":"2024-04-26T11:19:18.185578+0000","last_became_peered":"2024-04-26T11:19:18.185578+0000","last_unstale":"2024-04-26T11:19:26.204777+0000","last_undegraded":"2024-04-26T11:19:26.204777+0000","last_fullsized":"2024-04-26T11:19:26.204777+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:38.482108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204346+0000","last_change":"2024-04-26T11:19:24.201728+0000","last_active":"2024-04-26T11:19:26.204346+0000","last_peered":"2024-04-26T11:19:26.204346+0000","last_clean":"2024-04-26T11:19:26.204346+0000","last_became_active":"2024-04-26T11:19:24.200992+0000","last_became_peered":"2024-04-26T11:19:24.200992+0000","last_unstale":"2024-04-26T11:19:26.204346+0000","last_undegraded":"2024-04-26T11:19:26.204346+0000","last_fullsized":"2024-04-26T11:19:26.204346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:59.859744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":109,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205523+0000","last_change":"2024-04-26T11:19:18.190998+0000","last_active":"2024-04-26T11:19:26.205523+0000","last_peered":"2024-04-26T11:19:26.205523+0000","last_clean":"2024-04-26T11:19:26.205523+0000","last_became_active":"2024-04-26T11:19:18.190381+0000","last_became_peered":"2024-04-26T11:19:18.190381+0000","last_unstale":"2024-04-26T11:19:26.205523+0000","last_undegraded":"2024-04-26T11:19:26.205523+0000","last_fullsized":"2024-04-26T11:19:26.205523+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:31.159104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684360+0000","last_change":"2024-04-26T11:19:24.200037+0000","last_active":"2024-04-26T11:19:26.684360+0000","last_peered":"2024-04-26T11:19:26.684360+0000","last_clean":"2024-04-26T11:19:26.684360+0000","last_became_active":"2024-04-26T11:19:24.199659+0000","last_became_peered":"2024-04-26T11:19:24.199659+0000","last_unstale":"2024-04-26T11:19:26.684360+0000","last_undegraded":"2024-04-26T11:19:26.684360+0000","last_fullsized":"2024-04-26T11:19:26.684360+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:49.275857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":45,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204850+0000","last_change":"2024-04-26T11:19:18.181316+0000","last_active":"2024-04-26T11:19:26.204850+0000","last_peered":"2024-04-26T11:19:26.204850+0000","last_clean":"2024-04-26T11:19:26.204850+0000","last_became_active":"2024-04-26T11:19:18.180711+0000","last_became_peered":"2024-04-26T11:19:18.180711+0000","last_unstale":"2024-04-26T11:19:26.204850+0000","last_undegraded":"2024-04-26T11:19:26.204850+0000","last_fullsized":"2024-04-26T11:19:26.204850+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:27.837108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204705+0000","last_change":"2024-04-26T11:19:18.182026+0000","last_active":"2024-04-26T11:19:26.204705+0000","last_peered":"2024-04-26T11:19:26.204705+0000","last_clean":"2024-04-26T11:19:26.204705+0000","last_became_active":"2024-04-26T11:19:18.181615+0000","last_became_peered":"2024-04-26T11:19:18.181615+0000","last_unstale":"2024-04-26T11:19:26.204705+0000","last_undegraded":"2024-04-26T11:19:26.204705+0000","last_fullsized":"2024-04-26T11:19:26.204705+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:56.083479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204459+0000","last_change":"2024-04-26T11:19:18.185625+0000","last_active":"2024-04-26T11:19:26.204459+0000","last_peered":"2024-04-26T11:19:26.204459+0000","last_clean":"2024-04-26T11:19:26.204459+0000","last_became_active":"2024-04-26T11:19:18.183103+0000","last_became_peered":"2024-04-26T11:19:18.183103+0000","last_unstale":"2024-04-26T11:19:26.204459+0000","last_undegraded":"2024-04-26T11:19:26.204459+0000","last_fullsized":"2024-04-26T11:19:26.204459+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:42.309969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205241+0000","last_change":"2024-04-26T11:13:12.916685+0000","last_active":"2024-04-26T11:19:26.205241+0000","last_peered":"2024-04-26T11:19:26.205241+0000","last_clean":"2024-04-26T11:19:26.205241+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:19:26.205241+0000","last_undegraded":"2024-04-26T11:19:26.205241+0000","last_fullsized":"2024-04-26T11:19:26.205241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204255+0000","last_change":"2024-04-26T11:19:24.199114+0000","last_active":"2024-04-26T11:19:26.204255+0000","last_peered":"2024-04-26T11:19:26.204255+0000","last_clean":"2024-04-26T11:19:26.204255+0000","last_became_active":"2024-04-26T11:19:24.197647+0000","last_became_peered":"2024-04-26T11:19:24.197647+0000","last_unstale":"2024-04-26T11:19:26.204255+0000","last_undegraded":"2024-04-26T11:19:26.204255+0000","last_fullsized":"2024-04-26T11:19:26.204255+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:23.938536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205618+0000","last_change":"2024-04-26T11:13:12.915238+0000","last_active":"2024-04-26T11:19:26.205618+0000","last_peered":"2024-04-26T11:19:26.205618+0000","last_clean":"2024-04-26T11:19:26.205618+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:19:26.205618+0000","last_undegraded":"2024-04-26T11:19:26.205618+0000","last_fullsized":"2024-04-26T11:19:26.205618+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:48.068465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":106,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204835+0000","last_change":"2024-04-26T11:19:18.182547+0000","last_active":"2024-04-26T11:19:26.204835+0000","last_peered":"2024-04-26T11:19:26.204835+0000","last_clean":"2024-04-26T11:19:26.204835+0000","last_became_active":"2024-04-26T11:19:18.181907+0000","last_became_peered":"2024-04-26T11:19:18.181907+0000","last_unstale":"2024-04-26T11:19:26.204835+0000","last_undegraded":"2024-04-26T11:19:26.204835+0000","last_fullsized":"2024-04-26T11:19:26.204835+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.076863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204980+0000","last_change":"2024-04-26T11:19:24.201756+0000","last_active":"2024-04-26T11:19:26.204980+0000","last_peered":"2024-04-26T11:19:26.204980+0000","last_clean":"2024-04-26T11:19:26.204980+0000","last_became_active":"2024-04-26T11:19:24.201114+0000","last_became_peered":"2024-04-26T11:19:24.201114+0000","last_unstale":"2024-04-26T11:19:26.204980+0000","last_undegraded":"2024-04-26T11:19:26.204980+0000","last_fullsized":"2024-04-26T11:19:26.204980+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:34.095066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204443+0000","last_change":"2024-04-26T11:19:18.182797+0000","last_active":"2024-04-26T11:19:26.204443+0000","last_peered":"2024-04-26T11:19:26.204443+0000","last_clean":"2024-04-26T11:19:26.204443+0000","last_became_active":"2024-04-26T11:19:18.182017+0000","last_became_peered":"2024-04-26T11:19:18.182017+0000","last_unstale":"2024-04-26T11:19:26.204443+0000","last_undegraded":"2024-04-26T11:19:26.204443+0000","last_fullsized":"2024-04-26T11:19:26.204443+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:41.531437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205077+0000","last_change":"2024-04-26T11:19:24.205310+0000","last_active":"2024-04-26T11:19:26.205077+0000","last_peered":"2024-04-26T11:19:26.205077+0000","last_clean":"2024-04-26T11:19:26.205077+0000","last_became_active":"2024-04-26T11:19:24.204476+0000","last_became_peered":"2024-04-26T11:19:24.204476+0000","last_unstale":"2024-04-26T11:19:26.205077+0000","last_undegraded":"2024-04-26T11:19:26.205077+0000","last_fullsized":"2024-04-26T11:19:26.205077+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:14.932094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205069+0000","last_change":"2024-04-26T11:19:18.181966+0000","last_active":"2024-04-26T11:19:26.205069+0000","last_peered":"2024-04-26T11:19:26.205069+0000","last_clean":"2024-04-26T11:19:26.205069+0000","last_became_active":"2024-04-26T11:19:18.181604+0000","last_became_peered":"2024-04-26T11:19:18.181604+0000","last_unstale":"2024-04-26T11:19:26.205069+0000","last_undegraded":"2024-04-26T11:19:26.205069+0000","last_fullsized":"2024-04-26T11:19:26.205069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:57.405893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204571+0000","last_change":"2024-04-26T11:19:18.181723+0000","last_active":"2024-04-26T11:19:26.204571+0000","last_peered":"2024-04-26T11:19:26.204571+0000","last_clean":"2024-04-26T11:19:26.204571+0000","last_became_active":"2024-04-26T11:19:18.181462+0000","last_became_peered":"2024-04-26T11:19:18.181462+0000","last_unstale":"2024-04-26T11:19:26.204571+0000","last_undegraded":"2024-04-26T11:19:26.204571+0000","last_fullsized":"2024-04-26T11:19:26.204571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:23.824505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205502+0000","last_change":"2024-04-26T11:19:18.183263+0000","last_active":"2024-04-26T11:19:26.205502+0000","last_peered":"2024-04-26T11:19:26.205502+0000","last_clean":"2024-04-26T11:19:26.205502+0000","last_became_active":"2024-04-26T11:19:18.182242+0000","last_became_peered":"2024-04-26T11:19:18.182242+0000","last_unstale":"2024-04-26T11:19:26.205502+0000","last_undegraded":"2024-04-26T11:19:26.205502+0000","last_fullsized":"2024-04-26T11:19:26.205502+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:25.716967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204977+0000","last_change":"2024-04-26T11:13:12.912207+0000","last_active":"2024-04-26T11:19:26.204977+0000","last_peered":"2024-04-26T11:19:26.204977+0000","last_clean":"2024-04-26T11:19:26.204977+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:19:26.204977+0000","last_undegraded":"2024-04-26T11:19:26.204977+0000","last_fullsized":"2024-04-26T11:19:26.204977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204780+0000","last_change":"2024-04-26T11:19:18.181652+0000","last_active":"2024-04-26T11:19:26.204780+0000","last_peered":"2024-04-26T11:19:26.204780+0000","last_clean":"2024-04-26T11:19:26.204780+0000","last_became_active":"2024-04-26T11:19:18.180506+0000","last_became_peered":"2024-04-26T11:19:18.180506+0000","last_unstale":"2024-04-26T11:19:26.204780+0000","last_undegraded":"2024-04-26T11:19:26.204780+0000","last_fullsized":"2024-04-26T11:19:26.204780+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:52.115128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204377+0000","last_change":"2024-04-26T11:19:18.186849+0000","last_active":"2024-04-26T11:19:26.204377+0000","last_peered":"2024-04-26T11:19:26.204377+0000","last_clean":"2024-04-26T11:19:26.204377+0000","last_became_active":"2024-04-26T11:19:18.185355+0000","last_became_peered":"2024-04-26T11:19:18.185355+0000","last_unstale":"2024-04-26T11:19:26.204377+0000","last_undegraded":"2024-04-26T11:19:26.204377+0000","last_fullsized":"2024-04-26T11:19:26.204377+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:21.536805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205106+0000","last_change":"2024-04-26T11:19:18.188150+0000","last_active":"2024-04-26T11:19:26.205106+0000","last_peered":"2024-04-26T11:19:26.205106+0000","last_clean":"2024-04-26T11:19:26.205106+0000","last_became_active":"2024-04-26T11:19:18.186342+0000","last_became_peered":"2024-04-26T11:19:18.186342+0000","last_unstale":"2024-04-26T11:19:26.205106+0000","last_undegraded":"2024-04-26T11:19:26.205106+0000","last_fullsized":"2024-04-26T11:19:26.205106+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:49.270374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204487+0000","last_change":"2024-04-26T11:19:24.201645+0000","last_active":"2024-04-26T11:19:26.204487+0000","last_peered":"2024-04-26T11:19:26.204487+0000","last_clean":"2024-04-26T11:19:26.204487+0000","last_became_active":"2024-04-26T11:19:24.201330+0000","last_became_peered":"2024-04-26T11:19:24.201330+0000","last_unstale":"2024-04-26T11:19:26.204487+0000","last_undegraded":"2024-04-26T11:19:26.204487+0000","last_fullsized":"2024-04-26T11:19:26.204487+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:29.326197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204383+0000","last_change":"2024-04-26T11:19:24.201672+0000","last_active":"2024-04-26T11:19:26.204383+0000","last_peered":"2024-04-26T11:19:26.204383+0000","last_clean":"2024-04-26T11:19:26.204383+0000","last_became_active":"2024-04-26T11:19:24.201077+0000","last_became_peered":"2024-04-26T11:19:24.201077+0000","last_unstale":"2024-04-26T11:19:26.204383+0000","last_undegraded":"2024-04-26T11:19:26.204383+0000","last_fullsized":"2024-04-26T11:19:26.204383+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:42.500892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204910+0000","last_change":"2024-04-26T11:19:18.187865+0000","last_active":"2024-04-26T11:19:26.204910+0000","last_peered":"2024-04-26T11:19:26.204910+0000","last_clean":"2024-04-26T11:19:26.204910+0000","last_became_active":"2024-04-26T11:19:18.185768+0000","last_became_peered":"2024-04-26T11:19:18.185768+0000","last_unstale":"2024-04-26T11:19:26.204910+0000","last_undegraded":"2024-04-26T11:19:26.204910+0000","last_fullsized":"2024-04-26T11:19:26.204910+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:22.710616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204221+0000","last_change":"2024-04-26T11:19:18.186275+0000","last_active":"2024-04-26T11:19:26.204221+0000","last_peered":"2024-04-26T11:19:26.204221+0000","last_clean":"2024-04-26T11:19:26.204221+0000","last_became_active":"2024-04-26T11:19:18.184149+0000","last_became_peered":"2024-04-26T11:19:18.184149+0000","last_unstale":"2024-04-26T11:19:26.204221+0000","last_undegraded":"2024-04-26T11:19:26.204221+0000","last_fullsized":"2024-04-26T11:19:26.204221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:26.309810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205022+0000","last_change":"2024-04-26T11:19:18.184312+0000","last_active":"2024-04-26T11:19:26.205022+0000","last_peered":"2024-04-26T11:19:26.205022+0000","last_clean":"2024-04-26T11:19:26.205022+0000","last_became_active":"2024-04-26T11:19:18.181951+0000","last_became_peered":"2024-04-26T11:19:18.181951+0000","last_unstale":"2024-04-26T11:19:26.205022+0000","last_undegraded":"2024-04-26T11:19:26.205022+0000","last_fullsized":"2024-04-26T11:19:26.205022+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:45.284225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":106,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204701+0000","last_change":"2024-04-26T11:19:18.182240+0000","last_active":"2024-04-26T11:19:26.204701+0000","last_peered":"2024-04-26T11:19:26.204701+0000","last_clean":"2024-04-26T11:19:26.204701+0000","last_became_active":"2024-04-26T11:19:18.181767+0000","last_became_peered":"2024-04-26T11:19:18.181767+0000","last_unstale":"2024-04-26T11:19:26.204701+0000","last_undegraded":"2024-04-26T11:19:26.204701+0000","last_fullsized":"2024-04-26T11:19:26.204701+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:37:45.829872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205175+0000","last_change":"2024-04-26T11:19:18.183033+0000","last_active":"2024-04-26T11:19:26.205175+0000","last_peered":"2024-04-26T11:19:26.205175+0000","last_clean":"2024-04-26T11:19:26.205175+0000","last_became_active":"2024-04-26T11:19:18.182060+0000","last_became_peered":"2024-04-26T11:19:18.182060+0000","last_unstale":"2024-04-26T11:19:26.205175+0000","last_undegraded":"2024-04-26T11:19:26.205175+0000","last_fullsized":"2024-04-26T11:19:26.205175+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:27.875590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204716+0000","last_change":"2024-04-26T11:13:12.493217+0000","last_active":"2024-04-26T11:19:26.204716+0000","last_peered":"2024-04-26T11:19:26.204716+0000","last_clean":"2024-04-26T11:19:26.204716+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:19:26.204716+0000","last_undegraded":"2024-04-26T11:19:26.204716+0000","last_fullsized":"2024-04-26T11:19:26.204716+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:00.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684546+0000","last_change":"2024-04-26T11:19:24.204856+0000","last_active":"2024-04-26T11:19:26.684546+0000","last_peered":"2024-04-26T11:19:26.684546+0000","last_clean":"2024-04-26T11:19:26.684546+0000","last_became_active":"2024-04-26T11:19:24.203758+0000","last_became_peered":"2024-04-26T11:19:24.203758+0000","last_unstale":"2024-04-26T11:19:26.684546+0000","last_undegraded":"2024-04-26T11:19:26.684546+0000","last_fullsized":"2024-04-26T11:19:26.684546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:33.131784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684419+0000","last_change":"2024-04-26T11:19:24.201687+0000","last_active":"2024-04-26T11:19:26.684419+0000","last_peered":"2024-04-26T11:19:26.684419+0000","last_clean":"2024-04-26T11:19:26.684419+0000","last_became_active":"2024-04-26T11:19:24.200963+0000","last_became_peered":"2024-04-26T11:19:24.200963+0000","last_unstale":"2024-04-26T11:19:26.684419+0000","last_undegraded":"2024-04-26T11:19:26.684419+0000","last_fullsized":"2024-04-26T11:19:26.684419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:30:42.125098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205206+0000","last_change":"2024-04-26T11:19:18.189488+0000","last_active":"2024-04-26T11:19:26.205206+0000","last_peered":"2024-04-26T11:19:26.205206+0000","last_clean":"2024-04-26T11:19:26.205206+0000","last_became_active":"2024-04-26T11:19:18.189086+0000","last_became_peered":"2024-04-26T11:19:18.189086+0000","last_unstale":"2024-04-26T11:19:26.205206+0000","last_undegraded":"2024-04-26T11:19:26.205206+0000","last_fullsized":"2024-04-26T11:19:26.205206+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:00.540494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204973+0000","last_change":"2024-04-26T11:19:18.182582+0000","last_active":"2024-04-26T11:19:26.204973+0000","last_peered":"2024-04-26T11:19:26.204973+0000","last_clean":"2024-04-26T11:19:26.204973+0000","last_became_active":"2024-04-26T11:19:18.181791+0000","last_became_peered":"2024-04-26T11:19:18.181791+0000","last_unstale":"2024-04-26T11:19:26.204973+0000","last_undegraded":"2024-04-26T11:19:26.204973+0000","last_fullsized":"2024-04-26T11:19:26.204973+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:59.312651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204228+0000","last_change":"2024-04-26T11:19:18.185313+0000","last_active":"2024-04-26T11:19:26.204228+0000","last_peered":"2024-04-26T11:19:26.204228+0000","last_clean":"2024-04-26T11:19:26.204228+0000","last_became_active":"2024-04-26T11:19:18.183292+0000","last_became_peered":"2024-04-26T11:19:18.183292+0000","last_unstale":"2024-04-26T11:19:26.204228+0000","last_undegraded":"2024-04-26T11:19:26.204228+0000","last_fullsized":"2024-04-26T11:19:26.204228+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:05.860349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204969+0000","last_change":"2024-04-26T11:19:18.190450+0000","last_active":"2024-04-26T11:19:26.204969+0000","last_peered":"2024-04-26T11:19:26.204969+0000","last_clean":"2024-04-26T11:19:26.204969+0000","last_became_active":"2024-04-26T11:19:18.190096+0000","last_became_peered":"2024-04-26T11:19:18.190096+0000","last_unstale":"2024-04-26T11:19:26.204969+0000","last_undegraded":"2024-04-26T11:19:26.204969+0000","last_fullsized":"2024-04-26T11:19:26.204969+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:26.905702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684402+0000","last_change":"2024-04-26T11:19:24.200305+0000","last_active":"2024-04-26T11:19:26.684402+0000","last_peered":"2024-04-26T11:19:26.684402+0000","last_clean":"2024-04-26T11:19:26.684402+0000","last_became_active":"2024-04-26T11:19:24.199834+0000","last_became_peered":"2024-04-26T11:19:24.199834+0000","last_unstale":"2024-04-26T11:19:26.684402+0000","last_undegraded":"2024-04-26T11:19:26.684402+0000","last_fullsized":"2024-04-26T11:19:26.684402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:47.203614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684327+0000","last_change":"2024-04-26T11:19:24.197329+0000","last_active":"2024-04-26T11:19:26.684327+0000","last_peered":"2024-04-26T11:19:26.684327+0000","last_clean":"2024-04-26T11:19:26.684327+0000","last_became_active":"2024-04-26T11:19:24.196561+0000","last_became_peered":"2024-04-26T11:19:24.196561+0000","last_unstale":"2024-04-26T11:19:26.684327+0000","last_undegraded":"2024-04-26T11:19:26.684327+0000","last_fullsized":"2024-04-26T11:19:26.684327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:06.140967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":107,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204709+0000","last_change":"2024-04-26T11:19:18.182680+0000","last_active":"2024-04-26T11:19:26.204709+0000","last_peered":"2024-04-26T11:19:26.204709+0000","last_clean":"2024-04-26T11:19:26.204709+0000","last_became_active":"2024-04-26T11:19:18.182077+0000","last_became_peered":"2024-04-26T11:19:18.182077+0000","last_unstale":"2024-04-26T11:19:26.204709+0000","last_undegraded":"2024-04-26T11:19:26.204709+0000","last_fullsized":"2024-04-26T11:19:26.204709+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:48.832886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684566+0000","last_change":"2024-04-26T11:19:24.205473+0000","last_active":"2024-04-26T11:19:26.684566+0000","last_peered":"2024-04-26T11:19:26.684566+0000","last_clean":"2024-04-26T11:19:26.684566+0000","last_became_active":"2024-04-26T11:19:24.204538+0000","last_became_peered":"2024-04-26T11:19:24.204538+0000","last_unstale":"2024-04-26T11:19:26.684566+0000","last_undegraded":"2024-04-26T11:19:26.684566+0000","last_fullsized":"2024-04-26T11:19:26.684566+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:55.279045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204413+0000","last_change":"2024-04-26T11:19:18.186884+0000","last_active":"2024-04-26T11:19:26.204413+0000","last_peered":"2024-04-26T11:19:26.204413+0000","last_clean":"2024-04-26T11:19:26.204413+0000","last_became_active":"2024-04-26T11:19:18.184460+0000","last_became_peered":"2024-04-26T11:19:18.184460+0000","last_unstale":"2024-04-26T11:19:26.204413+0000","last_undegraded":"2024-04-26T11:19:26.204413+0000","last_fullsized":"2024-04-26T11:19:26.204413+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:12.901543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":234,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204187+0000","last_change":"2024-04-26T11:19:18.181070+0000","last_active":"2024-04-26T11:19:26.204187+0000","last_peered":"2024-04-26T11:19:26.204187+0000","last_clean":"2024-04-26T11:19:26.204187+0000","last_became_active":"2024-04-26T11:19:18.180577+0000","last_became_peered":"2024-04-26T11:19:18.180577+0000","last_unstale":"2024-04-26T11:19:26.204187+0000","last_undegraded":"2024-04-26T11:19:26.204187+0000","last_fullsized":"2024-04-26T11:19:26.204187+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:34:03.095255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684351+0000","last_change":"2024-04-26T11:19:24.197315+0000","last_active":"2024-04-26T11:19:26.684351+0000","last_peered":"2024-04-26T11:19:26.684351+0000","last_clean":"2024-04-26T11:19:26.684351+0000","last_became_active":"2024-04-26T11:19:24.196404+0000","last_became_peered":"2024-04-26T11:19:24.196404+0000","last_unstale":"2024-04-26T11:19:26.684351+0000","last_undegraded":"2024-04-26T11:19:26.684351+0000","last_fullsized":"2024-04-26T11:19:26.684351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:21:58.513393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204960+0000","last_change":"2024-04-26T11:19:18.184063+0000","last_active":"2024-04-26T11:19:26.204960+0000","last_peered":"2024-04-26T11:19:26.204960+0000","last_clean":"2024-04-26T11:19:26.204960+0000","last_became_active":"2024-04-26T11:19:18.181863+0000","last_became_peered":"2024-04-26T11:19:18.181863+0000","last_unstale":"2024-04-26T11:19:26.204960+0000","last_undegraded":"2024-04-26T11:19:26.204960+0000","last_fullsized":"2024-04-26T11:19:26.204960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:53.865511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204315+0000","last_change":"2024-04-26T11:19:18.181362+0000","last_active":"2024-04-26T11:19:26.204315+0000","last_peered":"2024-04-26T11:19:26.204315+0000","last_clean":"2024-04-26T11:19:26.204315+0000","last_became_active":"2024-04-26T11:19:18.180792+0000","last_became_peered":"2024-04-26T11:19:18.180792+0000","last_unstale":"2024-04-26T11:19:26.204315+0000","last_undegraded":"2024-04-26T11:19:26.204315+0000","last_fullsized":"2024-04-26T11:19:26.204315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:16.215932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.209802+0000","last_change":"2024-04-26T11:19:24.199071+0000","last_active":"2024-04-26T11:19:27.209802+0000","last_peered":"2024-04-26T11:19:27.209802+0000","last_clean":"2024-04-26T11:19:27.209802+0000","last_became_active":"2024-04-26T11:19:24.197711+0000","last_became_peered":"2024-04-26T11:19:24.197711+0000","last_unstale":"2024-04-26T11:19:27.209802+0000","last_undegraded":"2024-04-26T11:19:27.209802+0000","last_fullsized":"2024-04-26T11:19:27.209802+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:34.664546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205609+0000","last_change":"2024-04-26T11:13:12.918648+0000","last_active":"2024-04-26T11:19:26.205609+0000","last_peered":"2024-04-26T11:19:26.205609+0000","last_clean":"2024-04-26T11:19:26.205609+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:19:26.205609+0000","last_undegraded":"2024-04-26T11:19:26.205609+0000","last_fullsized":"2024-04-26T11:19:26.205609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.631673+0000","last_change":"2024-04-26T11:13:08.110433+0000","last_active":"2024-04-26T11:19:26.631673+0000","last_peered":"2024-04-26T11:19:26.631673+0000","last_clean":"2024-04-26T11:19:26.631673+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:19:26.631673+0000","last_undegraded":"2024-04-26T11:19:26.631673+0000","last_fullsized":"2024-04-26T11:19:26.631673+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684429+0000","last_change":"2024-04-26T11:19:24.203404+0000","last_active":"2024-04-26T11:19:26.684429+0000","last_peered":"2024-04-26T11:19:26.684429+0000","last_clean":"2024-04-26T11:19:26.684429+0000","last_became_active":"2024-04-26T11:19:24.202550+0000","last_became_peered":"2024-04-26T11:19:24.202550+0000","last_unstale":"2024-04-26T11:19:26.684429+0000","last_undegraded":"2024-04-26T11:19:26.684429+0000","last_fullsized":"2024-04-26T11:19:26.684429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:22.115008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204932+0000","last_change":"2024-04-26T11:19:18.182788+0000","last_active":"2024-04-26T11:19:26.204932+0000","last_peered":"2024-04-26T11:19:26.204932+0000","last_clean":"2024-04-26T11:19:26.204932+0000","last_became_active":"2024-04-26T11:19:18.182186+0000","last_became_peered":"2024-04-26T11:19:18.182186+0000","last_unstale":"2024-04-26T11:19:26.204932+0000","last_undegraded":"2024-04-26T11:19:26.204932+0000","last_fullsized":"2024-04-26T11:19:26.204932+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:26.933717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684536+0000","last_change":"2024-04-26T11:19:24.203482+0000","last_active":"2024-04-26T11:19:26.684536+0000","last_peered":"2024-04-26T11:19:26.684536+0000","last_clean":"2024-04-26T11:19:26.684536+0000","last_became_active":"2024-04-26T11:19:24.202310+0000","last_became_peered":"2024-04-26T11:19:24.202310+0000","last_unstale":"2024-04-26T11:19:26.684536+0000","last_undegraded":"2024-04-26T11:19:26.684536+0000","last_fullsized":"2024-04-26T11:19:26.684536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:57:50.731804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684477+0000","last_change":"2024-04-26T11:19:24.202951+0000","last_active":"2024-04-26T11:19:26.684477+0000","last_peered":"2024-04-26T11:19:26.684477+0000","last_clean":"2024-04-26T11:19:26.684477+0000","last_became_active":"2024-04-26T11:19:24.202566+0000","last_became_peered":"2024-04-26T11:19:24.202566+0000","last_unstale":"2024-04-26T11:19:26.684477+0000","last_undegraded":"2024-04-26T11:19:26.684477+0000","last_fullsized":"2024-04-26T11:19:26.684477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:55.762840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204185+0000","last_change":"2024-04-26T11:19:24.198685+0000","last_active":"2024-04-26T11:19:26.204185+0000","last_peered":"2024-04-26T11:19:26.204185+0000","last_clean":"2024-04-26T11:19:26.204185+0000","last_became_active":"2024-04-26T11:19:24.197383+0000","last_became_peered":"2024-04-26T11:19:24.197383+0000","last_unstale":"2024-04-26T11:19:26.204185+0000","last_undegraded":"2024-04-26T11:19:26.204185+0000","last_fullsized":"2024-04-26T11:19:26.204185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:08:32.146962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204870+0000","last_change":"2024-04-26T11:19:18.181795+0000","last_active":"2024-04-26T11:19:26.204870+0000","last_peered":"2024-04-26T11:19:26.204870+0000","last_clean":"2024-04-26T11:19:26.204870+0000","last_became_active":"2024-04-26T11:19:18.180871+0000","last_became_peered":"2024-04-26T11:19:18.180871+0000","last_unstale":"2024-04-26T11:19:26.204870+0000","last_undegraded":"2024-04-26T11:19:26.204870+0000","last_fullsized":"2024-04-26T11:19:26.204870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:23.698612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204826+0000","last_change":"2024-04-26T11:19:24.200015+0000","last_active":"2024-04-26T11:19:26.204826+0000","last_peered":"2024-04-26T11:19:26.204826+0000","last_clean":"2024-04-26T11:19:26.204826+0000","last_became_active":"2024-04-26T11:19:24.198853+0000","last_became_peered":"2024-04-26T11:19:24.198853+0000","last_unstale":"2024-04-26T11:19:26.204826+0000","last_undegraded":"2024-04-26T11:19:26.204826+0000","last_fullsized":"2024-04-26T11:19:26.204826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:17.832954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210690+0000","last_change":"2024-04-26T11:19:18.182878+0000","last_active":"2024-04-26T11:19:27.210690+0000","last_peered":"2024-04-26T11:19:27.210690+0000","last_clean":"2024-04-26T11:19:27.210690+0000","last_became_active":"2024-04-26T11:19:18.182228+0000","last_became_peered":"2024-04-26T11:19:18.182228+0000","last_unstale":"2024-04-26T11:19:27.210690+0000","last_undegraded":"2024-04-26T11:19:27.210690+0000","last_fullsized":"2024-04-26T11:19:27.210690+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:34.672880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205075+0000","last_change":"2024-04-26T11:19:18.183238+0000","last_active":"2024-04-26T11:19:26.205075+0000","last_peered":"2024-04-26T11:19:26.205075+0000","last_clean":"2024-04-26T11:19:26.205075+0000","last_became_active":"2024-04-26T11:19:18.182671+0000","last_became_peered":"2024-04-26T11:19:18.182671+0000","last_unstale":"2024-04-26T11:19:26.205075+0000","last_undegraded":"2024-04-26T11:19:26.205075+0000","last_fullsized":"2024-04-26T11:19:26.205075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:49.368568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205360+0000","last_change":"2024-04-26T11:13:12.917812+0000","last_active":"2024-04-26T11:19:26.205360+0000","last_peered":"2024-04-26T11:19:26.205360+0000","last_clean":"2024-04-26T11:19:26.205360+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:19:26.205360+0000","last_undegraded":"2024-04-26T11:19:26.205360+0000","last_fullsized":"2024-04-26T11:19:26.205360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205222+0000","last_change":"2024-04-26T11:19:18.188983+0000","last_active":"2024-04-26T11:19:26.205222+0000","last_peered":"2024-04-26T11:19:26.205222+0000","last_clean":"2024-04-26T11:19:26.205222+0000","last_became_active":"2024-04-26T11:19:18.188177+0000","last_became_peered":"2024-04-26T11:19:18.188177+0000","last_unstale":"2024-04-26T11:19:26.205222+0000","last_undegraded":"2024-04-26T11:19:26.205222+0000","last_fullsized":"2024-04-26T11:19:26.205222+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:31.255327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204597+0000","last_change":"2024-04-26T11:19:18.188002+0000","last_active":"2024-04-26T11:19:26.204597+0000","last_peered":"2024-04-26T11:19:26.204597+0000","last_clean":"2024-04-26T11:19:26.204597+0000","last_became_active":"2024-04-26T11:19:18.185372+0000","last_became_peered":"2024-04-26T11:19:18.185372+0000","last_unstale":"2024-04-26T11:19:26.204597+0000","last_undegraded":"2024-04-26T11:19:26.204597+0000","last_fullsized":"2024-04-26T11:19:26.204597+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:04.942442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205645+0000","last_change":"2024-04-26T11:19:18.190885+0000","last_active":"2024-04-26T11:19:26.205645+0000","last_peered":"2024-04-26T11:19:26.205645+0000","last_clean":"2024-04-26T11:19:26.205645+0000","last_became_active":"2024-04-26T11:19:18.190374+0000","last_became_peered":"2024-04-26T11:19:18.190374+0000","last_unstale":"2024-04-26T11:19:26.205645+0000","last_undegraded":"2024-04-26T11:19:26.205645+0000","last_fullsized":"2024-04-26T11:19:26.205645+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:53.646080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204769+0000","last_change":"2024-04-26T11:19:18.189666+0000","last_active":"2024-04-26T11:19:26.204769+0000","last_peered":"2024-04-26T11:19:26.204769+0000","last_clean":"2024-04-26T11:19:26.204769+0000","last_became_active":"2024-04-26T11:19:18.189341+0000","last_became_peered":"2024-04-26T11:19:18.189341+0000","last_unstale":"2024-04-26T11:19:26.204769+0000","last_undegraded":"2024-04-26T11:19:26.204769+0000","last_fullsized":"2024-04-26T11:19:26.204769+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:52.141583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684494+0000","last_change":"2024-04-26T11:19:24.202866+0000","last_active":"2024-04-26T11:19:26.684494+0000","last_peered":"2024-04-26T11:19:26.684494+0000","last_clean":"2024-04-26T11:19:26.684494+0000","last_became_active":"2024-04-26T11:19:24.202422+0000","last_became_peered":"2024-04-26T11:19:24.202422+0000","last_unstale":"2024-04-26T11:19:26.684494+0000","last_undegraded":"2024-04-26T11:19:26.684494+0000","last_fullsized":"2024-04-26T11:19:26.684494+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.564374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205080+0000","last_change":"2024-04-26T11:13:12.917763+0000","last_active":"2024-04-26T11:19:26.205080+0000","last_peered":"2024-04-26T11:19:26.205080+0000","last_clean":"2024-04-26T11:19:26.205080+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:19:26.205080+0000","last_undegraded":"2024-04-26T11:19:26.205080+0000","last_fullsized":"2024-04-26T11:19:26.205080+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204913+0000","last_change":"2024-04-26T11:19:24.205087+0000","last_active":"2024-04-26T11:19:26.204913+0000","last_peered":"2024-04-26T11:19:26.204913+0000","last_clean":"2024-04-26T11:19:26.204913+0000","last_became_active":"2024-04-26T11:19:24.204129+0000","last_became_peered":"2024-04-26T11:19:24.204129+0000","last_unstale":"2024-04-26T11:19:26.204913+0000","last_undegraded":"2024-04-26T11:19:26.204913+0000","last_fullsized":"2024-04-26T11:19:26.204913+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:15.916622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204637+0000","last_change":"2024-04-26T11:19:18.189530+0000","last_active":"2024-04-26T11:19:26.204637+0000","last_peered":"2024-04-26T11:19:26.204637+0000","last_clean":"2024-04-26T11:19:26.204637+0000","last_became_active":"2024-04-26T11:19:18.189179+0000","last_became_peered":"2024-04-26T11:19:18.189179+0000","last_unstale":"2024-04-26T11:19:26.204637+0000","last_undegraded":"2024-04-26T11:19:26.204637+0000","last_fullsized":"2024-04-26T11:19:26.204637+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.132608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204517+0000","last_change":"2024-04-26T11:19:18.189257+0000","last_active":"2024-04-26T11:19:26.204517+0000","last_peered":"2024-04-26T11:19:26.204517+0000","last_clean":"2024-04-26T11:19:26.204517+0000","last_became_active":"2024-04-26T11:19:18.188963+0000","last_became_peered":"2024-04-26T11:19:18.188963+0000","last_unstale":"2024-04-26T11:19:26.204517+0000","last_undegraded":"2024-04-26T11:19:26.204517+0000","last_fullsized":"2024-04-26T11:19:26.204517+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:37.907392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684318+0000","last_change":"2024-04-26T11:19:24.200217+0000","last_active":"2024-04-26T11:19:26.684318+0000","last_peered":"2024-04-26T11:19:26.684318+0000","last_clean":"2024-04-26T11:19:26.684318+0000","last_became_active":"2024-04-26T11:19:24.198397+0000","last_became_peered":"2024-04-26T11:19:24.198397+0000","last_unstale":"2024-04-26T11:19:26.684318+0000","last_undegraded":"2024-04-26T11:19:26.684318+0000","last_fullsized":"2024-04-26T11:19:26.684318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:44.576230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205025+0000","last_change":"2024-04-26T11:19:18.183441+0000","last_active":"2024-04-26T11:19:26.205025+0000","last_peered":"2024-04-26T11:19:26.205025+0000","last_clean":"2024-04-26T11:19:26.205025+0000","last_became_active":"2024-04-26T11:19:18.183037+0000","last_became_peered":"2024-04-26T11:19:18.183037+0000","last_unstale":"2024-04-26T11:19:26.205025+0000","last_undegraded":"2024-04-26T11:19:26.205025+0000","last_fullsized":"2024-04-26T11:19:26.205025+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:32.597584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684386+0000","last_change":"2024-04-26T11:19:24.203647+0000","last_active":"2024-04-26T11:19:26.684386+0000","last_peered":"2024-04-26T11:19:26.684386+0000","last_clean":"2024-04-26T11:19:26.684386+0000","last_became_active":"2024-04-26T11:19:24.202442+0000","last_became_peered":"2024-04-26T11:19:24.202442+0000","last_unstale":"2024-04-26T11:19:26.684386+0000","last_undegraded":"2024-04-26T11:19:26.684386+0000","last_fullsized":"2024-04-26T11:19:26.684386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:21.883832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205445+0000","last_change":"2024-04-26T11:19:18.184719+0000","last_active":"2024-04-26T11:19:26.205445+0000","last_peered":"2024-04-26T11:19:26.205445+0000","last_clean":"2024-04-26T11:19:26.205445+0000","last_became_active":"2024-04-26T11:19:18.184384+0000","last_became_peered":"2024-04-26T11:19:18.184384+0000","last_unstale":"2024-04-26T11:19:26.205445+0000","last_undegraded":"2024-04-26T11:19:26.205445+0000","last_fullsized":"2024-04-26T11:19:26.205445+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:37.130545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7958,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738447,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281152,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94090688,"statfs":{"total":96636764160,"available":96348864512,"internally_reserved":0,"allocated":1490944,"data_stored":947441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Fri Apr 26 11:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45800000000000002,"15min":0.39600000000000002},"min":{"1min":0.34399999999999997,"5min":0.17999999999999999,"15min":0.17199999999999999},"max":{"1min":0.68100000000000005,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.316,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.66400000000000003,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.60699999999999998}]}]},{"osd":0,"up_from":75,"seq":322122547204,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38160,"kb_used_data":1468,"kb_used_omap":10,"kb_used_meta":36661,"kb_avail":94333680,"statfs":{"total":96636764160,"available":96597688320,"internally_reserved":0,"allocated":1503232,"data_stored":949168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11228,"internal_metadata":37540900},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738448,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401140,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":400254,"kb_avail":93970700,"statfs":{"total":96636764160,"available":96225996800,"internally_reserved":0,"allocated":884736,"data_stored":357054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":409860550},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Fri Apr 26 11:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.44700000000000001,"15min":0.40699999999999997},"min":{"1min":0.34999999999999998,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.69199999999999995,"5min":2.056,"15min":2.056},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.499,"15min":0.46400000000000002},"min":{"1min":0.376,"5min":0.193,"15min":0.193},"max":{"1min":0.67600000000000005,"5min":3.9609999999999999,"15min":3.9609999999999999},"last":0.46000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7958,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:19:31.921 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T11:19:31.921 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:19:32.300 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:19:32.302 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:19:32.311 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":270,"stamp":"2024-04-26T11:19:30.561406+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":720452,"kb_used_data":3788,"kb_used_omap":14,"kb_used_meta":716593,"kb_avail":282395068,"statfs":{"total":289910292480,"available":289172549632,"internally_reserved":0,"allocated":3878912,"data_stored":2253663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14416,"internal_metadata":733792176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001090"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205605+0000","last_change":"2024-04-26T11:13:12.919196+0000","last_active":"2024-04-26T11:19:26.205605+0000","last_peered":"2024-04-26T11:19:26.205605+0000","last_clean":"2024-04-26T11:19:26.205605+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:19:26.205605+0000","last_undegraded":"2024-04-26T11:19:26.205605+0000","last_fullsized":"2024-04-26T11:19:26.205605+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205354+0000","last_change":"2024-04-26T11:13:12.917670+0000","last_active":"2024-04-26T11:19:26.205354+0000","last_peered":"2024-04-26T11:19:26.205354+0000","last_clean":"2024-04-26T11:19:26.205354+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:19:26.205354+0000","last_undegraded":"2024-04-26T11:19:26.205354+0000","last_fullsized":"2024-04-26T11:19:26.205354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205142+0000","last_change":"2024-04-26T11:19:18.185209+0000","last_active":"2024-04-26T11:19:26.205142+0000","last_peered":"2024-04-26T11:19:26.205142+0000","last_clean":"2024-04-26T11:19:26.205142+0000","last_became_active":"2024-04-26T11:19:18.182972+0000","last_became_peered":"2024-04-26T11:19:18.182972+0000","last_unstale":"2024-04-26T11:19:26.205142+0000","last_undegraded":"2024-04-26T11:19:26.205142+0000","last_fullsized":"2024-04-26T11:19:26.205142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:57.755970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204499+0000","last_change":"2024-04-26T11:19:18.183286+0000","last_active":"2024-04-26T11:19:26.204499+0000","last_peered":"2024-04-26T11:19:26.204499+0000","last_clean":"2024-04-26T11:19:26.204499+0000","last_became_active":"2024-04-26T11:19:18.182942+0000","last_became_peered":"2024-04-26T11:19:18.182942+0000","last_unstale":"2024-04-26T11:19:26.204499+0000","last_undegraded":"2024-04-26T11:19:26.204499+0000","last_fullsized":"2024-04-26T11:19:26.204499+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:58.370599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205030+0000","last_change":"2024-04-26T11:13:12.917403+0000","last_active":"2024-04-26T11:19:26.205030+0000","last_peered":"2024-04-26T11:19:26.205030+0000","last_clean":"2024-04-26T11:19:26.205030+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:19:26.205030+0000","last_undegraded":"2024-04-26T11:19:26.205030+0000","last_fullsized":"2024-04-26T11:19:26.205030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:42.014955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204622+0000","last_change":"2024-04-26T11:19:18.189355+0000","last_active":"2024-04-26T11:19:26.204622+0000","last_peered":"2024-04-26T11:19:26.204622+0000","last_clean":"2024-04-26T11:19:26.204622+0000","last_became_active":"2024-04-26T11:19:18.188990+0000","last_became_peered":"2024-04-26T11:19:18.188990+0000","last_unstale":"2024-04-26T11:19:26.204622+0000","last_undegraded":"2024-04-26T11:19:26.204622+0000","last_fullsized":"2024-04-26T11:19:26.204622+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:29.030847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204397+0000","last_change":"2024-04-26T11:19:18.187953+0000","last_active":"2024-04-26T11:19:26.204397+0000","last_peered":"2024-04-26T11:19:26.204397+0000","last_clean":"2024-04-26T11:19:26.204397+0000","last_became_active":"2024-04-26T11:19:18.186638+0000","last_became_peered":"2024-04-26T11:19:18.186638+0000","last_unstale":"2024-04-26T11:19:26.204397+0000","last_undegraded":"2024-04-26T11:19:26.204397+0000","last_fullsized":"2024-04-26T11:19:26.204397+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:18.483074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204062+0000","last_change":"2024-04-26T11:19:18.183968+0000","last_active":"2024-04-26T11:19:26.204062+0000","last_peered":"2024-04-26T11:19:26.204062+0000","last_clean":"2024-04-26T11:19:26.204062+0000","last_became_active":"2024-04-26T11:19:18.182111+0000","last_became_peered":"2024-04-26T11:19:18.182111+0000","last_unstale":"2024-04-26T11:19:26.204062+0000","last_undegraded":"2024-04-26T11:19:26.204062+0000","last_fullsized":"2024-04-26T11:19:26.204062+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:08.529468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684517+0000","last_change":"2024-04-26T11:19:24.202861+0000","last_active":"2024-04-26T11:19:26.684517+0000","last_peered":"2024-04-26T11:19:26.684517+0000","last_clean":"2024-04-26T11:19:26.684517+0000","last_became_active":"2024-04-26T11:19:24.202146+0000","last_became_peered":"2024-04-26T11:19:24.202146+0000","last_unstale":"2024-04-26T11:19:26.684517+0000","last_undegraded":"2024-04-26T11:19:26.684517+0000","last_fullsized":"2024-04-26T11:19:26.684517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:33.234821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205553+0000","last_change":"2024-04-26T11:13:12.918521+0000","last_active":"2024-04-26T11:19:26.205553+0000","last_peered":"2024-04-26T11:19:26.205553+0000","last_clean":"2024-04-26T11:19:26.205553+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:19:26.205553+0000","last_undegraded":"2024-04-26T11:19:26.205553+0000","last_fullsized":"2024-04-26T11:19:26.205553+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204805+0000","last_change":"2024-04-26T11:19:18.187027+0000","last_active":"2024-04-26T11:19:26.204805+0000","last_peered":"2024-04-26T11:19:26.204805+0000","last_clean":"2024-04-26T11:19:26.204805+0000","last_became_active":"2024-04-26T11:19:18.185543+0000","last_became_peered":"2024-04-26T11:19:18.185543+0000","last_unstale":"2024-04-26T11:19:26.204805+0000","last_undegraded":"2024-04-26T11:19:26.204805+0000","last_fullsized":"2024-04-26T11:19:26.204805+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:38.365806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205142+0000","last_change":"2024-04-26T11:19:18.183459+0000","last_active":"2024-04-26T11:19:26.205142+0000","last_peered":"2024-04-26T11:19:26.205142+0000","last_clean":"2024-04-26T11:19:26.205142+0000","last_became_active":"2024-04-26T11:19:18.182827+0000","last_became_peered":"2024-04-26T11:19:18.182827+0000","last_unstale":"2024-04-26T11:19:26.205142+0000","last_undegraded":"2024-04-26T11:19:26.205142+0000","last_fullsized":"2024-04-26T11:19:26.205142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:28.182922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205400+0000","last_change":"2024-04-26T11:13:12.915484+0000","last_active":"2024-04-26T11:19:26.205400+0000","last_peered":"2024-04-26T11:19:26.205400+0000","last_clean":"2024-04-26T11:19:26.205400+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:19:26.205400+0000","last_undegraded":"2024-04-26T11:19:26.205400+0000","last_fullsized":"2024-04-26T11:19:26.205400+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204505+0000","last_change":"2024-04-26T11:19:18.181800+0000","last_active":"2024-04-26T11:19:26.204505+0000","last_peered":"2024-04-26T11:19:26.204505+0000","last_clean":"2024-04-26T11:19:26.204505+0000","last_became_active":"2024-04-26T11:19:18.180865+0000","last_became_peered":"2024-04-26T11:19:18.180865+0000","last_unstale":"2024-04-26T11:19:26.204505+0000","last_undegraded":"2024-04-26T11:19:26.204505+0000","last_fullsized":"2024-04-26T11:19:26.204505+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:36.948796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204335+0000","last_change":"2024-04-26T11:19:18.181625+0000","last_active":"2024-04-26T11:19:26.204335+0000","last_peered":"2024-04-26T11:19:26.204335+0000","last_clean":"2024-04-26T11:19:26.204335+0000","last_became_active":"2024-04-26T11:19:18.180763+0000","last_became_peered":"2024-04-26T11:19:18.180763+0000","last_unstale":"2024-04-26T11:19:26.204335+0000","last_undegraded":"2024-04-26T11:19:26.204335+0000","last_fullsized":"2024-04-26T11:19:26.204335+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:27.138589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204271+0000","last_change":"2024-04-26T11:19:18.185161+0000","last_active":"2024-04-26T11:19:26.204271+0000","last_peered":"2024-04-26T11:19:26.204271+0000","last_clean":"2024-04-26T11:19:26.204271+0000","last_became_active":"2024-04-26T11:19:18.184331+0000","last_became_peered":"2024-04-26T11:19:18.184331+0000","last_unstale":"2024-04-26T11:19:26.204271+0000","last_undegraded":"2024-04-26T11:19:26.204271+0000","last_fullsized":"2024-04-26T11:19:26.204271+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:29.254144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684526+0000","last_change":"2024-04-26T11:19:24.204827+0000","last_active":"2024-04-26T11:19:26.684526+0000","last_peered":"2024-04-26T11:19:26.684526+0000","last_clean":"2024-04-26T11:19:26.684526+0000","last_became_active":"2024-04-26T11:19:24.203764+0000","last_became_peered":"2024-04-26T11:19:24.203764+0000","last_unstale":"2024-04-26T11:19:26.684526+0000","last_undegraded":"2024-04-26T11:19:26.684526+0000","last_fullsized":"2024-04-26T11:19:26.684526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:29.263130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205647+0000","last_change":"2024-04-26T11:13:12.918759+0000","last_active":"2024-04-26T11:19:26.205647+0000","last_peered":"2024-04-26T11:19:26.205647+0000","last_clean":"2024-04-26T11:19:26.205647+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:19:26.205647+0000","last_undegraded":"2024-04-26T11:19:26.205647+0000","last_fullsized":"2024-04-26T11:19:26.205647+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:55.002972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684440+0000","last_change":"2024-04-26T11:19:24.200114+0000","last_active":"2024-04-26T11:19:26.684440+0000","last_peered":"2024-04-26T11:19:26.684440+0000","last_clean":"2024-04-26T11:19:26.684440+0000","last_became_active":"2024-04-26T11:19:24.199142+0000","last_became_peered":"2024-04-26T11:19:24.199142+0000","last_unstale":"2024-04-26T11:19:26.684440+0000","last_undegraded":"2024-04-26T11:19:26.684440+0000","last_fullsized":"2024-04-26T11:19:26.684440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:04.789203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205065+0000","last_change":"2024-04-26T11:19:18.186823+0000","last_active":"2024-04-26T11:19:26.205065+0000","last_peered":"2024-04-26T11:19:26.205065+0000","last_clean":"2024-04-26T11:19:26.205065+0000","last_became_active":"2024-04-26T11:19:18.184282+0000","last_became_peered":"2024-04-26T11:19:18.184282+0000","last_unstale":"2024-04-26T11:19:26.205065+0000","last_undegraded":"2024-04-26T11:19:26.205065+0000","last_fullsized":"2024-04-26T11:19:26.205065+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:11.581601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204671+0000","last_change":"2024-04-26T11:19:18.187937+0000","last_active":"2024-04-26T11:19:26.204671+0000","last_peered":"2024-04-26T11:19:26.204671+0000","last_clean":"2024-04-26T11:19:26.204671+0000","last_became_active":"2024-04-26T11:19:18.186605+0000","last_became_peered":"2024-04-26T11:19:18.186605+0000","last_unstale":"2024-04-26T11:19:26.204671+0000","last_undegraded":"2024-04-26T11:19:26.204671+0000","last_fullsized":"2024-04-26T11:19:26.204671+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:49.737640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204850+0000","last_change":"2024-04-26T11:19:18.182666+0000","last_active":"2024-04-26T11:19:26.204850+0000","last_peered":"2024-04-26T11:19:26.204850+0000","last_clean":"2024-04-26T11:19:26.204850+0000","last_became_active":"2024-04-26T11:19:18.181728+0000","last_became_peered":"2024-04-26T11:19:18.181728+0000","last_unstale":"2024-04-26T11:19:26.204850+0000","last_undegraded":"2024-04-26T11:19:26.204850+0000","last_fullsized":"2024-04-26T11:19:26.204850+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:07.719581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.203921+0000","last_change":"2024-04-26T11:19:24.198562+0000","last_active":"2024-04-26T11:19:26.203921+0000","last_peered":"2024-04-26T11:19:26.203921+0000","last_clean":"2024-04-26T11:19:26.203921+0000","last_became_active":"2024-04-26T11:19:24.197487+0000","last_became_peered":"2024-04-26T11:19:24.197487+0000","last_unstale":"2024-04-26T11:19:26.203921+0000","last_undegraded":"2024-04-26T11:19:26.203921+0000","last_fullsized":"2024-04-26T11:19:26.203921+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:31.790885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204840+0000","last_change":"2024-04-26T11:13:12.912756+0000","last_active":"2024-04-26T11:19:26.204840+0000","last_peered":"2024-04-26T11:19:26.204840+0000","last_clean":"2024-04-26T11:19:26.204840+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:19:26.204840+0000","last_undegraded":"2024-04-26T11:19:26.204840+0000","last_fullsized":"2024-04-26T11:19:26.204840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:04.177831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205614+0000","last_change":"2024-04-26T11:19:18.184692+0000","last_active":"2024-04-26T11:19:26.205614+0000","last_peered":"2024-04-26T11:19:26.205614+0000","last_clean":"2024-04-26T11:19:26.205614+0000","last_became_active":"2024-04-26T11:19:18.184451+0000","last_became_peered":"2024-04-26T11:19:18.184451+0000","last_unstale":"2024-04-26T11:19:26.205614+0000","last_undegraded":"2024-04-26T11:19:26.205614+0000","last_fullsized":"2024-04-26T11:19:26.205614+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:08.485754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204759+0000","last_change":"2024-04-26T11:19:24.199954+0000","last_active":"2024-04-26T11:19:26.204759+0000","last_peered":"2024-04-26T11:19:26.204759+0000","last_clean":"2024-04-26T11:19:26.204759+0000","last_became_active":"2024-04-26T11:19:24.198479+0000","last_became_peered":"2024-04-26T11:19:24.198479+0000","last_unstale":"2024-04-26T11:19:26.204759+0000","last_undegraded":"2024-04-26T11:19:26.204759+0000","last_fullsized":"2024-04-26T11:19:26.204759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:14.221425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204917+0000","last_change":"2024-04-26T11:19:18.185709+0000","last_active":"2024-04-26T11:19:26.204917+0000","last_peered":"2024-04-26T11:19:26.204917+0000","last_clean":"2024-04-26T11:19:26.204917+0000","last_became_active":"2024-04-26T11:19:18.185105+0000","last_became_peered":"2024-04-26T11:19:18.185105+0000","last_unstale":"2024-04-26T11:19:26.204917+0000","last_undegraded":"2024-04-26T11:19:26.204917+0000","last_fullsized":"2024-04-26T11:19:26.204917+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:43.626259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204813+0000","last_change":"2024-04-26T11:13:12.493425+0000","last_active":"2024-04-26T11:19:26.204813+0000","last_peered":"2024-04-26T11:19:26.204813+0000","last_clean":"2024-04-26T11:19:26.204813+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:19:26.204813+0000","last_undegraded":"2024-04-26T11:19:26.204813+0000","last_fullsized":"2024-04-26T11:19:26.204813+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:23.279580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205712+0000","last_change":"2024-04-26T11:19:18.191042+0000","last_active":"2024-04-26T11:19:26.205712+0000","last_peered":"2024-04-26T11:19:26.205712+0000","last_clean":"2024-04-26T11:19:26.205712+0000","last_became_active":"2024-04-26T11:19:18.190792+0000","last_became_peered":"2024-04-26T11:19:18.190792+0000","last_unstale":"2024-04-26T11:19:26.205712+0000","last_undegraded":"2024-04-26T11:19:26.205712+0000","last_fullsized":"2024-04-26T11:19:26.205712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:45.726211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684337+0000","last_change":"2024-04-26T11:19:24.203467+0000","last_active":"2024-04-26T11:19:26.684337+0000","last_peered":"2024-04-26T11:19:26.684337+0000","last_clean":"2024-04-26T11:19:26.684337+0000","last_became_active":"2024-04-26T11:19:24.202348+0000","last_became_peered":"2024-04-26T11:19:24.202348+0000","last_unstale":"2024-04-26T11:19:26.684337+0000","last_undegraded":"2024-04-26T11:19:26.684337+0000","last_fullsized":"2024-04-26T11:19:26.684337+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:55.157485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204840+0000","last_change":"2024-04-26T11:19:24.200292+0000","last_active":"2024-04-26T11:19:26.204840+0000","last_peered":"2024-04-26T11:19:26.204840+0000","last_clean":"2024-04-26T11:19:26.204840+0000","last_became_active":"2024-04-26T11:19:24.198920+0000","last_became_peered":"2024-04-26T11:19:24.198920+0000","last_unstale":"2024-04-26T11:19:26.204840+0000","last_undegraded":"2024-04-26T11:19:26.204840+0000","last_fullsized":"2024-04-26T11:19:26.204840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:45.950568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684279+0000","last_change":"2024-04-26T11:19:24.199051+0000","last_active":"2024-04-26T11:19:26.684279+0000","last_peered":"2024-04-26T11:19:26.684279+0000","last_clean":"2024-04-26T11:19:26.684279+0000","last_became_active":"2024-04-26T11:19:24.197698+0000","last_became_peered":"2024-04-26T11:19:24.197698+0000","last_unstale":"2024-04-26T11:19:26.684279+0000","last_undegraded":"2024-04-26T11:19:26.684279+0000","last_fullsized":"2024-04-26T11:19:26.684279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:21.891894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211316+0000","last_change":"2024-04-26T11:19:18.190418+0000","last_active":"2024-04-26T11:19:27.211316+0000","last_peered":"2024-04-26T11:19:27.211316+0000","last_clean":"2024-04-26T11:19:27.211316+0000","last_became_active":"2024-04-26T11:19:18.190127+0000","last_became_peered":"2024-04-26T11:19:18.190127+0000","last_unstale":"2024-04-26T11:19:27.211316+0000","last_undegraded":"2024-04-26T11:19:27.211316+0000","last_fullsized":"2024-04-26T11:19:27.211316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:11:25.515683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205003+0000","last_change":"2024-04-26T11:19:24.205086+0000","last_active":"2024-04-26T11:19:26.205003+0000","last_peered":"2024-04-26T11:19:26.205003+0000","last_clean":"2024-04-26T11:19:26.205003+0000","last_became_active":"2024-04-26T11:19:24.204122+0000","last_became_peered":"2024-04-26T11:19:24.204122+0000","last_unstale":"2024-04-26T11:19:26.205003+0000","last_undegraded":"2024-04-26T11:19:26.205003+0000","last_fullsized":"2024-04-26T11:19:26.205003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:56:23.239851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684262+0000","last_change":"2024-04-26T11:19:24.198434+0000","last_active":"2024-04-26T11:19:26.684262+0000","last_peered":"2024-04-26T11:19:26.684262+0000","last_clean":"2024-04-26T11:19:26.684262+0000","last_became_active":"2024-04-26T11:19:24.197247+0000","last_became_peered":"2024-04-26T11:19:24.197247+0000","last_unstale":"2024-04-26T11:19:26.684262+0000","last_undegraded":"2024-04-26T11:19:26.684262+0000","last_fullsized":"2024-04-26T11:19:26.684262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:23.769249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204777+0000","last_change":"2024-04-26T11:19:18.187720+0000","last_active":"2024-04-26T11:19:26.204777+0000","last_peered":"2024-04-26T11:19:26.204777+0000","last_clean":"2024-04-26T11:19:26.204777+0000","last_became_active":"2024-04-26T11:19:18.185578+0000","last_became_peered":"2024-04-26T11:19:18.185578+0000","last_unstale":"2024-04-26T11:19:26.204777+0000","last_undegraded":"2024-04-26T11:19:26.204777+0000","last_fullsized":"2024-04-26T11:19:26.204777+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:38.482108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204346+0000","last_change":"2024-04-26T11:19:24.201728+0000","last_active":"2024-04-26T11:19:26.204346+0000","last_peered":"2024-04-26T11:19:26.204346+0000","last_clean":"2024-04-26T11:19:26.204346+0000","last_became_active":"2024-04-26T11:19:24.200992+0000","last_became_peered":"2024-04-26T11:19:24.200992+0000","last_unstale":"2024-04-26T11:19:26.204346+0000","last_undegraded":"2024-04-26T11:19:26.204346+0000","last_fullsized":"2024-04-26T11:19:26.204346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:59.859744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":109,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205523+0000","last_change":"2024-04-26T11:19:18.190998+0000","last_active":"2024-04-26T11:19:26.205523+0000","last_peered":"2024-04-26T11:19:26.205523+0000","last_clean":"2024-04-26T11:19:26.205523+0000","last_became_active":"2024-04-26T11:19:18.190381+0000","last_became_peered":"2024-04-26T11:19:18.190381+0000","last_unstale":"2024-04-26T11:19:26.205523+0000","last_undegraded":"2024-04-26T11:19:26.205523+0000","last_fullsized":"2024-04-26T11:19:26.205523+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:31.159104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684360+0000","last_change":"2024-04-26T11:19:24.200037+0000","last_active":"2024-04-26T11:19:26.684360+0000","last_peered":"2024-04-26T11:19:26.684360+0000","last_clean":"2024-04-26T11:19:26.684360+0000","last_became_active":"2024-04-26T11:19:24.199659+0000","last_became_peered":"2024-04-26T11:19:24.199659+0000","last_unstale":"2024-04-26T11:19:26.684360+0000","last_undegraded":"2024-04-26T11:19:26.684360+0000","last_fullsized":"2024-04-26T11:19:26.684360+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:49.275857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":45,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204850+0000","last_change":"2024-04-26T11:19:18.181316+0000","last_active":"2024-04-26T11:19:26.204850+0000","last_peered":"2024-04-26T11:19:26.204850+0000","last_clean":"2024-04-26T11:19:26.204850+0000","last_became_active":"2024-04-26T11:19:18.180711+0000","last_became_peered":"2024-04-26T11:19:18.180711+0000","last_unstale":"2024-04-26T11:19:26.204850+0000","last_undegraded":"2024-04-26T11:19:26.204850+0000","last_fullsized":"2024-04-26T11:19:26.204850+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:27.837108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204705+0000","last_change":"2024-04-26T11:19:18.182026+0000","last_active":"2024-04-26T11:19:26.204705+0000","last_peered":"2024-04-26T11:19:26.204705+0000","last_clean":"2024-04-26T11:19:26.204705+0000","last_became_active":"2024-04-26T11:19:18.181615+0000","last_became_peered":"2024-04-26T11:19:18.181615+0000","last_unstale":"2024-04-26T11:19:26.204705+0000","last_undegraded":"2024-04-26T11:19:26.204705+0000","last_fullsized":"2024-04-26T11:19:26.204705+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:56.083479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204459+0000","last_change":"2024-04-26T11:19:18.185625+0000","last_active":"2024-04-26T11:19:26.204459+0000","last_peered":"2024-04-26T11:19:26.204459+0000","last_clean":"2024-04-26T11:19:26.204459+0000","last_became_active":"2024-04-26T11:19:18.183103+0000","last_became_peered":"2024-04-26T11:19:18.183103+0000","last_unstale":"2024-04-26T11:19:26.204459+0000","last_undegraded":"2024-04-26T11:19:26.204459+0000","last_fullsized":"2024-04-26T11:19:26.204459+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:42.309969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205241+0000","last_change":"2024-04-26T11:13:12.916685+0000","last_active":"2024-04-26T11:19:26.205241+0000","last_peered":"2024-04-26T11:19:26.205241+0000","last_clean":"2024-04-26T11:19:26.205241+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:19:26.205241+0000","last_undegraded":"2024-04-26T11:19:26.205241+0000","last_fullsized":"2024-04-26T11:19:26.205241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204255+0000","last_change":"2024-04-26T11:19:24.199114+0000","last_active":"2024-04-26T11:19:26.204255+0000","last_peered":"2024-04-26T11:19:26.204255+0000","last_clean":"2024-04-26T11:19:26.204255+0000","last_became_active":"2024-04-26T11:19:24.197647+0000","last_became_peered":"2024-04-26T11:19:24.197647+0000","last_unstale":"2024-04-26T11:19:26.204255+0000","last_undegraded":"2024-04-26T11:19:26.204255+0000","last_fullsized":"2024-04-26T11:19:26.204255+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:23.938536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205618+0000","last_change":"2024-04-26T11:13:12.915238+0000","last_active":"2024-04-26T11:19:26.205618+0000","last_peered":"2024-04-26T11:19:26.205618+0000","last_clean":"2024-04-26T11:19:26.205618+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:19:26.205618+0000","last_undegraded":"2024-04-26T11:19:26.205618+0000","last_fullsized":"2024-04-26T11:19:26.205618+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:48.068465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":106,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204835+0000","last_change":"2024-04-26T11:19:18.182547+0000","last_active":"2024-04-26T11:19:26.204835+0000","last_peered":"2024-04-26T11:19:26.204835+0000","last_clean":"2024-04-26T11:19:26.204835+0000","last_became_active":"2024-04-26T11:19:18.181907+0000","last_became_peered":"2024-04-26T11:19:18.181907+0000","last_unstale":"2024-04-26T11:19:26.204835+0000","last_undegraded":"2024-04-26T11:19:26.204835+0000","last_fullsized":"2024-04-26T11:19:26.204835+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.076863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204980+0000","last_change":"2024-04-26T11:19:24.201756+0000","last_active":"2024-04-26T11:19:26.204980+0000","last_peered":"2024-04-26T11:19:26.204980+0000","last_clean":"2024-04-26T11:19:26.204980+0000","last_became_active":"2024-04-26T11:19:24.201114+0000","last_became_peered":"2024-04-26T11:19:24.201114+0000","last_unstale":"2024-04-26T11:19:26.204980+0000","last_undegraded":"2024-04-26T11:19:26.204980+0000","last_fullsized":"2024-04-26T11:19:26.204980+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:34.095066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204443+0000","last_change":"2024-04-26T11:19:18.182797+0000","last_active":"2024-04-26T11:19:26.204443+0000","last_peered":"2024-04-26T11:19:26.204443+0000","last_clean":"2024-04-26T11:19:26.204443+0000","last_became_active":"2024-04-26T11:19:18.182017+0000","last_became_peered":"2024-04-26T11:19:18.182017+0000","last_unstale":"2024-04-26T11:19:26.204443+0000","last_undegraded":"2024-04-26T11:19:26.204443+0000","last_fullsized":"2024-04-26T11:19:26.204443+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:41.531437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205077+0000","last_change":"2024-04-26T11:19:24.205310+0000","last_active":"2024-04-26T11:19:26.205077+0000","last_peered":"2024-04-26T11:19:26.205077+0000","last_clean":"2024-04-26T11:19:26.205077+0000","last_became_active":"2024-04-26T11:19:24.204476+0000","last_became_peered":"2024-04-26T11:19:24.204476+0000","last_unstale":"2024-04-26T11:19:26.205077+0000","last_undegraded":"2024-04-26T11:19:26.205077+0000","last_fullsized":"2024-04-26T11:19:26.205077+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:14.932094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205069+0000","last_change":"2024-04-26T11:19:18.181966+0000","last_active":"2024-04-26T11:19:26.205069+0000","last_peered":"2024-04-26T11:19:26.205069+0000","last_clean":"2024-04-26T11:19:26.205069+0000","last_became_active":"2024-04-26T11:19:18.181604+0000","last_became_peered":"2024-04-26T11:19:18.181604+0000","last_unstale":"2024-04-26T11:19:26.205069+0000","last_undegraded":"2024-04-26T11:19:26.205069+0000","last_fullsized":"2024-04-26T11:19:26.205069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:57.405893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204571+0000","last_change":"2024-04-26T11:19:18.181723+0000","last_active":"2024-04-26T11:19:26.204571+0000","last_peered":"2024-04-26T11:19:26.204571+0000","last_clean":"2024-04-26T11:19:26.204571+0000","last_became_active":"2024-04-26T11:19:18.181462+0000","last_became_peered":"2024-04-26T11:19:18.181462+0000","last_unstale":"2024-04-26T11:19:26.204571+0000","last_undegraded":"2024-04-26T11:19:26.204571+0000","last_fullsized":"2024-04-26T11:19:26.204571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:23.824505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205502+0000","last_change":"2024-04-26T11:19:18.183263+0000","last_active":"2024-04-26T11:19:26.205502+0000","last_peered":"2024-04-26T11:19:26.205502+0000","last_clean":"2024-04-26T11:19:26.205502+0000","last_became_active":"2024-04-26T11:19:18.182242+0000","last_became_peered":"2024-04-26T11:19:18.182242+0000","last_unstale":"2024-04-26T11:19:26.205502+0000","last_undegraded":"2024-04-26T11:19:26.205502+0000","last_fullsized":"2024-04-26T11:19:26.205502+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:25.716967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204977+0000","last_change":"2024-04-26T11:13:12.912207+0000","last_active":"2024-04-26T11:19:26.204977+0000","last_peered":"2024-04-26T11:19:26.204977+0000","last_clean":"2024-04-26T11:19:26.204977+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:19:26.204977+0000","last_undegraded":"2024-04-26T11:19:26.204977+0000","last_fullsized":"2024-04-26T11:19:26.204977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204780+0000","last_change":"2024-04-26T11:19:18.181652+0000","last_active":"2024-04-26T11:19:26.204780+0000","last_peered":"2024-04-26T11:19:26.204780+0000","last_clean":"2024-04-26T11:19:26.204780+0000","last_became_active":"2024-04-26T11:19:18.180506+0000","last_became_peered":"2024-04-26T11:19:18.180506+0000","last_unstale":"2024-04-26T11:19:26.204780+0000","last_undegraded":"2024-04-26T11:19:26.204780+0000","last_fullsized":"2024-04-26T11:19:26.204780+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:52.115128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204377+0000","last_change":"2024-04-26T11:19:18.186849+0000","last_active":"2024-04-26T11:19:26.204377+0000","last_peered":"2024-04-26T11:19:26.204377+0000","last_clean":"2024-04-26T11:19:26.204377+0000","last_became_active":"2024-04-26T11:19:18.185355+0000","last_became_peered":"2024-04-26T11:19:18.185355+0000","last_unstale":"2024-04-26T11:19:26.204377+0000","last_undegraded":"2024-04-26T11:19:26.204377+0000","last_fullsized":"2024-04-26T11:19:26.204377+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:21.536805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205106+0000","last_change":"2024-04-26T11:19:18.188150+0000","last_active":"2024-04-26T11:19:26.205106+0000","last_peered":"2024-04-26T11:19:26.205106+0000","last_clean":"2024-04-26T11:19:26.205106+0000","last_became_active":"2024-04-26T11:19:18.186342+0000","last_became_peered":"2024-04-26T11:19:18.186342+0000","last_unstale":"2024-04-26T11:19:26.205106+0000","last_undegraded":"2024-04-26T11:19:26.205106+0000","last_fullsized":"2024-04-26T11:19:26.205106+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:49.270374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204487+0000","last_change":"2024-04-26T11:19:24.201645+0000","last_active":"2024-04-26T11:19:26.204487+0000","last_peered":"2024-04-26T11:19:26.204487+0000","last_clean":"2024-04-26T11:19:26.204487+0000","last_became_active":"2024-04-26T11:19:24.201330+0000","last_became_peered":"2024-04-26T11:19:24.201330+0000","last_unstale":"2024-04-26T11:19:26.204487+0000","last_undegraded":"2024-04-26T11:19:26.204487+0000","last_fullsized":"2024-04-26T11:19:26.204487+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:29.326197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204383+0000","last_change":"2024-04-26T11:19:24.201672+0000","last_active":"2024-04-26T11:19:26.204383+0000","last_peered":"2024-04-26T11:19:26.204383+0000","last_clean":"2024-04-26T11:19:26.204383+0000","last_became_active":"2024-04-26T11:19:24.201077+0000","last_became_peered":"2024-04-26T11:19:24.201077+0000","last_unstale":"2024-04-26T11:19:26.204383+0000","last_undegraded":"2024-04-26T11:19:26.204383+0000","last_fullsized":"2024-04-26T11:19:26.204383+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:42.500892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204910+0000","last_change":"2024-04-26T11:19:18.187865+0000","last_active":"2024-04-26T11:19:26.204910+0000","last_peered":"2024-04-26T11:19:26.204910+0000","last_clean":"2024-04-26T11:19:26.204910+0000","last_became_active":"2024-04-26T11:19:18.185768+0000","last_became_peered":"2024-04-26T11:19:18.185768+0000","last_unstale":"2024-04-26T11:19:26.204910+0000","last_undegraded":"2024-04-26T11:19:26.204910+0000","last_fullsized":"2024-04-26T11:19:26.204910+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:22.710616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204221+0000","last_change":"2024-04-26T11:19:18.186275+0000","last_active":"2024-04-26T11:19:26.204221+0000","last_peered":"2024-04-26T11:19:26.204221+0000","last_clean":"2024-04-26T11:19:26.204221+0000","last_became_active":"2024-04-26T11:19:18.184149+0000","last_became_peered":"2024-04-26T11:19:18.184149+0000","last_unstale":"2024-04-26T11:19:26.204221+0000","last_undegraded":"2024-04-26T11:19:26.204221+0000","last_fullsized":"2024-04-26T11:19:26.204221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:26.309810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205022+0000","last_change":"2024-04-26T11:19:18.184312+0000","last_active":"2024-04-26T11:19:26.205022+0000","last_peered":"2024-04-26T11:19:26.205022+0000","last_clean":"2024-04-26T11:19:26.205022+0000","last_became_active":"2024-04-26T11:19:18.181951+0000","last_became_peered":"2024-04-26T11:19:18.181951+0000","last_unstale":"2024-04-26T11:19:26.205022+0000","last_undegraded":"2024-04-26T11:19:26.205022+0000","last_fullsized":"2024-04-26T11:19:26.205022+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:45.284225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":106,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204701+0000","last_change":"2024-04-26T11:19:18.182240+0000","last_active":"2024-04-26T11:19:26.204701+0000","last_peered":"2024-04-26T11:19:26.204701+0000","last_clean":"2024-04-26T11:19:26.204701+0000","last_became_active":"2024-04-26T11:19:18.181767+0000","last_became_peered":"2024-04-26T11:19:18.181767+0000","last_unstale":"2024-04-26T11:19:26.204701+0000","last_undegraded":"2024-04-26T11:19:26.204701+0000","last_fullsized":"2024-04-26T11:19:26.204701+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:37:45.829872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205175+0000","last_change":"2024-04-26T11:19:18.183033+0000","last_active":"2024-04-26T11:19:26.205175+0000","last_peered":"2024-04-26T11:19:26.205175+0000","last_clean":"2024-04-26T11:19:26.205175+0000","last_became_active":"2024-04-26T11:19:18.182060+0000","last_became_peered":"2024-04-26T11:19:18.182060+0000","last_unstale":"2024-04-26T11:19:26.205175+0000","last_undegraded":"2024-04-26T11:19:26.205175+0000","last_fullsized":"2024-04-26T11:19:26.205175+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:27.875590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204716+0000","last_change":"2024-04-26T11:13:12.493217+0000","last_active":"2024-04-26T11:19:26.204716+0000","last_peered":"2024-04-26T11:19:26.204716+0000","last_clean":"2024-04-26T11:19:26.204716+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:19:26.204716+0000","last_undegraded":"2024-04-26T11:19:26.204716+0000","last_fullsized":"2024-04-26T11:19:26.204716+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:00.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684546+0000","last_change":"2024-04-26T11:19:24.204856+0000","last_active":"2024-04-26T11:19:26.684546+0000","last_peered":"2024-04-26T11:19:26.684546+0000","last_clean":"2024-04-26T11:19:26.684546+0000","last_became_active":"2024-04-26T11:19:24.203758+0000","last_became_peered":"2024-04-26T11:19:24.203758+0000","last_unstale":"2024-04-26T11:19:26.684546+0000","last_undegraded":"2024-04-26T11:19:26.684546+0000","last_fullsized":"2024-04-26T11:19:26.684546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:33.131784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684419+0000","last_change":"2024-04-26T11:19:24.201687+0000","last_active":"2024-04-26T11:19:26.684419+0000","last_peered":"2024-04-26T11:19:26.684419+0000","last_clean":"2024-04-26T11:19:26.684419+0000","last_became_active":"2024-04-26T11:19:24.200963+0000","last_became_peered":"2024-04-26T11:19:24.200963+0000","last_unstale":"2024-04-26T11:19:26.684419+0000","last_undegraded":"2024-04-26T11:19:26.684419+0000","last_fullsized":"2024-04-26T11:19:26.684419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:30:42.125098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205206+0000","last_change":"2024-04-26T11:19:18.189488+0000","last_active":"2024-04-26T11:19:26.205206+0000","last_peered":"2024-04-26T11:19:26.205206+0000","last_clean":"2024-04-26T11:19:26.205206+0000","last_became_active":"2024-04-26T11:19:18.189086+0000","last_became_peered":"2024-04-26T11:19:18.189086+0000","last_unstale":"2024-04-26T11:19:26.205206+0000","last_undegraded":"2024-04-26T11:19:26.205206+0000","last_fullsized":"2024-04-26T11:19:26.205206+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:00.540494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204973+0000","last_change":"2024-04-26T11:19:18.182582+0000","last_active":"2024-04-26T11:19:26.204973+0000","last_peered":"2024-04-26T11:19:26.204973+0000","last_clean":"2024-04-26T11:19:26.204973+0000","last_became_active":"2024-04-26T11:19:18.181791+0000","last_became_peered":"2024-04-26T11:19:18.181791+0000","last_unstale":"2024-04-26T11:19:26.204973+0000","last_undegraded":"2024-04-26T11:19:26.204973+0000","last_fullsized":"2024-04-26T11:19:26.204973+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:59.312651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204228+0000","last_change":"2024-04-26T11:19:18.185313+0000","last_active":"2024-04-26T11:19:26.204228+0000","last_peered":"2024-04-26T11:19:26.204228+0000","last_clean":"2024-04-26T11:19:26.204228+0000","last_became_active":"2024-04-26T11:19:18.183292+0000","last_became_peered":"2024-04-26T11:19:18.183292+0000","last_unstale":"2024-04-26T11:19:26.204228+0000","last_undegraded":"2024-04-26T11:19:26.204228+0000","last_fullsized":"2024-04-26T11:19:26.204228+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:05.860349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204969+0000","last_change":"2024-04-26T11:19:18.190450+0000","last_active":"2024-04-26T11:19:26.204969+0000","last_peered":"2024-04-26T11:19:26.204969+0000","last_clean":"2024-04-26T11:19:26.204969+0000","last_became_active":"2024-04-26T11:19:18.190096+0000","last_became_peered":"2024-04-26T11:19:18.190096+0000","last_unstale":"2024-04-26T11:19:26.204969+0000","last_undegraded":"2024-04-26T11:19:26.204969+0000","last_fullsized":"2024-04-26T11:19:26.204969+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:26.905702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684402+0000","last_change":"2024-04-26T11:19:24.200305+0000","last_active":"2024-04-26T11:19:26.684402+0000","last_peered":"2024-04-26T11:19:26.684402+0000","last_clean":"2024-04-26T11:19:26.684402+0000","last_became_active":"2024-04-26T11:19:24.199834+0000","last_became_peered":"2024-04-26T11:19:24.199834+0000","last_unstale":"2024-04-26T11:19:26.684402+0000","last_undegraded":"2024-04-26T11:19:26.684402+0000","last_fullsized":"2024-04-26T11:19:26.684402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:47.203614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684327+0000","last_change":"2024-04-26T11:19:24.197329+0000","last_active":"2024-04-26T11:19:26.684327+0000","last_peered":"2024-04-26T11:19:26.684327+0000","last_clean":"2024-04-26T11:19:26.684327+0000","last_became_active":"2024-04-26T11:19:24.196561+0000","last_became_peered":"2024-04-26T11:19:24.196561+0000","last_unstale":"2024-04-26T11:19:26.684327+0000","last_undegraded":"2024-04-26T11:19:26.684327+0000","last_fullsized":"2024-04-26T11:19:26.684327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:06.140967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":107,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204709+0000","last_change":"2024-04-26T11:19:18.182680+0000","last_active":"2024-04-26T11:19:26.204709+0000","last_peered":"2024-04-26T11:19:26.204709+0000","last_clean":"2024-04-26T11:19:26.204709+0000","last_became_active":"2024-04-26T11:19:18.182077+0000","last_became_peered":"2024-04-26T11:19:18.182077+0000","last_unstale":"2024-04-26T11:19:26.204709+0000","last_undegraded":"2024-04-26T11:19:26.204709+0000","last_fullsized":"2024-04-26T11:19:26.204709+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:48.832886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684566+0000","last_change":"2024-04-26T11:19:24.205473+0000","last_active":"2024-04-26T11:19:26.684566+0000","last_peered":"2024-04-26T11:19:26.684566+0000","last_clean":"2024-04-26T11:19:26.684566+0000","last_became_active":"2024-04-26T11:19:24.204538+0000","last_became_peered":"2024-04-26T11:19:24.204538+0000","last_unstale":"2024-04-26T11:19:26.684566+0000","last_undegraded":"2024-04-26T11:19:26.684566+0000","last_fullsized":"2024-04-26T11:19:26.684566+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:55.279045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204413+0000","last_change":"2024-04-26T11:19:18.186884+0000","last_active":"2024-04-26T11:19:26.204413+0000","last_peered":"2024-04-26T11:19:26.204413+0000","last_clean":"2024-04-26T11:19:26.204413+0000","last_became_active":"2024-04-26T11:19:18.184460+0000","last_became_peered":"2024-04-26T11:19:18.184460+0000","last_unstale":"2024-04-26T11:19:26.204413+0000","last_undegraded":"2024-04-26T11:19:26.204413+0000","last_fullsized":"2024-04-26T11:19:26.204413+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:12.901543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":234,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204187+0000","last_change":"2024-04-26T11:19:18.181070+0000","last_active":"2024-04-26T11:19:26.204187+0000","last_peered":"2024-04-26T11:19:26.204187+0000","last_clean":"2024-04-26T11:19:26.204187+0000","last_became_active":"2024-04-26T11:19:18.180577+0000","last_became_peered":"2024-04-26T11:19:18.180577+0000","last_unstale":"2024-04-26T11:19:26.204187+0000","last_undegraded":"2024-04-26T11:19:26.204187+0000","last_fullsized":"2024-04-26T11:19:26.204187+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:34:03.095255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684351+0000","last_change":"2024-04-26T11:19:24.197315+0000","last_active":"2024-04-26T11:19:26.684351+0000","last_peered":"2024-04-26T11:19:26.684351+0000","last_clean":"2024-04-26T11:19:26.684351+0000","last_became_active":"2024-04-26T11:19:24.196404+0000","last_became_peered":"2024-04-26T11:19:24.196404+0000","last_unstale":"2024-04-26T11:19:26.684351+0000","last_undegraded":"2024-04-26T11:19:26.684351+0000","last_fullsized":"2024-04-26T11:19:26.684351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:21:58.513393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204960+0000","last_change":"2024-04-26T11:19:18.184063+0000","last_active":"2024-04-26T11:19:26.204960+0000","last_peered":"2024-04-26T11:19:26.204960+0000","last_clean":"2024-04-26T11:19:26.204960+0000","last_became_active":"2024-04-26T11:19:18.181863+0000","last_became_peered":"2024-04-26T11:19:18.181863+0000","last_unstale":"2024-04-26T11:19:26.204960+0000","last_undegraded":"2024-04-26T11:19:26.204960+0000","last_fullsized":"2024-04-26T11:19:26.204960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:53.865511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204315+0000","last_change":"2024-04-26T11:19:18.181362+0000","last_active":"2024-04-26T11:19:26.204315+0000","last_peered":"2024-04-26T11:19:26.204315+0000","last_clean":"2024-04-26T11:19:26.204315+0000","last_became_active":"2024-04-26T11:19:18.180792+0000","last_became_peered":"2024-04-26T11:19:18.180792+0000","last_unstale":"2024-04-26T11:19:26.204315+0000","last_undegraded":"2024-04-26T11:19:26.204315+0000","last_fullsized":"2024-04-26T11:19:26.204315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:16.215932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.209802+0000","last_change":"2024-04-26T11:19:24.199071+0000","last_active":"2024-04-26T11:19:27.209802+0000","last_peered":"2024-04-26T11:19:27.209802+0000","last_clean":"2024-04-26T11:19:27.209802+0000","last_became_active":"2024-04-26T11:19:24.197711+0000","last_became_peered":"2024-04-26T11:19:24.197711+0000","last_unstale":"2024-04-26T11:19:27.209802+0000","last_undegraded":"2024-04-26T11:19:27.209802+0000","last_fullsized":"2024-04-26T11:19:27.209802+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:34.664546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205609+0000","last_change":"2024-04-26T11:13:12.918648+0000","last_active":"2024-04-26T11:19:26.205609+0000","last_peered":"2024-04-26T11:19:26.205609+0000","last_clean":"2024-04-26T11:19:26.205609+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:19:26.205609+0000","last_undegraded":"2024-04-26T11:19:26.205609+0000","last_fullsized":"2024-04-26T11:19:26.205609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.631673+0000","last_change":"2024-04-26T11:13:08.110433+0000","last_active":"2024-04-26T11:19:26.631673+0000","last_peered":"2024-04-26T11:19:26.631673+0000","last_clean":"2024-04-26T11:19:26.631673+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:19:26.631673+0000","last_undegraded":"2024-04-26T11:19:26.631673+0000","last_fullsized":"2024-04-26T11:19:26.631673+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684429+0000","last_change":"2024-04-26T11:19:24.203404+0000","last_active":"2024-04-26T11:19:26.684429+0000","last_peered":"2024-04-26T11:19:26.684429+0000","last_clean":"2024-04-26T11:19:26.684429+0000","last_became_active":"2024-04-26T11:19:24.202550+0000","last_became_peered":"2024-04-26T11:19:24.202550+0000","last_unstale":"2024-04-26T11:19:26.684429+0000","last_undegraded":"2024-04-26T11:19:26.684429+0000","last_fullsized":"2024-04-26T11:19:26.684429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:22.115008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204932+0000","last_change":"2024-04-26T11:19:18.182788+0000","last_active":"2024-04-26T11:19:26.204932+0000","last_peered":"2024-04-26T11:19:26.204932+0000","last_clean":"2024-04-26T11:19:26.204932+0000","last_became_active":"2024-04-26T11:19:18.182186+0000","last_became_peered":"2024-04-26T11:19:18.182186+0000","last_unstale":"2024-04-26T11:19:26.204932+0000","last_undegraded":"2024-04-26T11:19:26.204932+0000","last_fullsized":"2024-04-26T11:19:26.204932+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:26.933717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684536+0000","last_change":"2024-04-26T11:19:24.203482+0000","last_active":"2024-04-26T11:19:26.684536+0000","last_peered":"2024-04-26T11:19:26.684536+0000","last_clean":"2024-04-26T11:19:26.684536+0000","last_became_active":"2024-04-26T11:19:24.202310+0000","last_became_peered":"2024-04-26T11:19:24.202310+0000","last_unstale":"2024-04-26T11:19:26.684536+0000","last_undegraded":"2024-04-26T11:19:26.684536+0000","last_fullsized":"2024-04-26T11:19:26.684536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:57:50.731804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684477+0000","last_change":"2024-04-26T11:19:24.202951+0000","last_active":"2024-04-26T11:19:26.684477+0000","last_peered":"2024-04-26T11:19:26.684477+0000","last_clean":"2024-04-26T11:19:26.684477+0000","last_became_active":"2024-04-26T11:19:24.202566+0000","last_became_peered":"2024-04-26T11:19:24.202566+0000","last_unstale":"2024-04-26T11:19:26.684477+0000","last_undegraded":"2024-04-26T11:19:26.684477+0000","last_fullsized":"2024-04-26T11:19:26.684477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:55.762840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204185+0000","last_change":"2024-04-26T11:19:24.198685+0000","last_active":"2024-04-26T11:19:26.204185+0000","last_peered":"2024-04-26T11:19:26.204185+0000","last_clean":"2024-04-26T11:19:26.204185+0000","last_became_active":"2024-04-26T11:19:24.197383+0000","last_became_peered":"2024-04-26T11:19:24.197383+0000","last_unstale":"2024-04-26T11:19:26.204185+0000","last_undegraded":"2024-04-26T11:19:26.204185+0000","last_fullsized":"2024-04-26T11:19:26.204185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:08:32.146962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204870+0000","last_change":"2024-04-26T11:19:18.181795+0000","last_active":"2024-04-26T11:19:26.204870+0000","last_peered":"2024-04-26T11:19:26.204870+0000","last_clean":"2024-04-26T11:19:26.204870+0000","last_became_active":"2024-04-26T11:19:18.180871+0000","last_became_peered":"2024-04-26T11:19:18.180871+0000","last_unstale":"2024-04-26T11:19:26.204870+0000","last_undegraded":"2024-04-26T11:19:26.204870+0000","last_fullsized":"2024-04-26T11:19:26.204870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:23.698612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204826+0000","last_change":"2024-04-26T11:19:24.200015+0000","last_active":"2024-04-26T11:19:26.204826+0000","last_peered":"2024-04-26T11:19:26.204826+0000","last_clean":"2024-04-26T11:19:26.204826+0000","last_became_active":"2024-04-26T11:19:24.198853+0000","last_became_peered":"2024-04-26T11:19:24.198853+0000","last_unstale":"2024-04-26T11:19:26.204826+0000","last_undegraded":"2024-04-26T11:19:26.204826+0000","last_fullsized":"2024-04-26T11:19:26.204826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:17.832954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210690+0000","last_change":"2024-04-26T11:19:18.182878+0000","last_active":"2024-04-26T11:19:27.210690+0000","last_peered":"2024-04-26T11:19:27.210690+0000","last_clean":"2024-04-26T11:19:27.210690+0000","last_became_active":"2024-04-26T11:19:18.182228+0000","last_became_peered":"2024-04-26T11:19:18.182228+0000","last_unstale":"2024-04-26T11:19:27.210690+0000","last_undegraded":"2024-04-26T11:19:27.210690+0000","last_fullsized":"2024-04-26T11:19:27.210690+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:34.672880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205075+0000","last_change":"2024-04-26T11:19:18.183238+0000","last_active":"2024-04-26T11:19:26.205075+0000","last_peered":"2024-04-26T11:19:26.205075+0000","last_clean":"2024-04-26T11:19:26.205075+0000","last_became_active":"2024-04-26T11:19:18.182671+0000","last_became_peered":"2024-04-26T11:19:18.182671+0000","last_unstale":"2024-04-26T11:19:26.205075+0000","last_undegraded":"2024-04-26T11:19:26.205075+0000","last_fullsized":"2024-04-26T11:19:26.205075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:49.368568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205360+0000","last_change":"2024-04-26T11:13:12.917812+0000","last_active":"2024-04-26T11:19:26.205360+0000","last_peered":"2024-04-26T11:19:26.205360+0000","last_clean":"2024-04-26T11:19:26.205360+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:19:26.205360+0000","last_undegraded":"2024-04-26T11:19:26.205360+0000","last_fullsized":"2024-04-26T11:19:26.205360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205222+0000","last_change":"2024-04-26T11:19:18.188983+0000","last_active":"2024-04-26T11:19:26.205222+0000","last_peered":"2024-04-26T11:19:26.205222+0000","last_clean":"2024-04-26T11:19:26.205222+0000","last_became_active":"2024-04-26T11:19:18.188177+0000","last_became_peered":"2024-04-26T11:19:18.188177+0000","last_unstale":"2024-04-26T11:19:26.205222+0000","last_undegraded":"2024-04-26T11:19:26.205222+0000","last_fullsized":"2024-04-26T11:19:26.205222+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:31.255327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204597+0000","last_change":"2024-04-26T11:19:18.188002+0000","last_active":"2024-04-26T11:19:26.204597+0000","last_peered":"2024-04-26T11:19:26.204597+0000","last_clean":"2024-04-26T11:19:26.204597+0000","last_became_active":"2024-04-26T11:19:18.185372+0000","last_became_peered":"2024-04-26T11:19:18.185372+0000","last_unstale":"2024-04-26T11:19:26.204597+0000","last_undegraded":"2024-04-26T11:19:26.204597+0000","last_fullsized":"2024-04-26T11:19:26.204597+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:04.942442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205645+0000","last_change":"2024-04-26T11:19:18.190885+0000","last_active":"2024-04-26T11:19:26.205645+0000","last_peered":"2024-04-26T11:19:26.205645+0000","last_clean":"2024-04-26T11:19:26.205645+0000","last_became_active":"2024-04-26T11:19:18.190374+0000","last_became_peered":"2024-04-26T11:19:18.190374+0000","last_unstale":"2024-04-26T11:19:26.205645+0000","last_undegraded":"2024-04-26T11:19:26.205645+0000","last_fullsized":"2024-04-26T11:19:26.205645+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:53.646080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204769+0000","last_change":"2024-04-26T11:19:18.189666+0000","last_active":"2024-04-26T11:19:26.204769+0000","last_peered":"2024-04-26T11:19:26.204769+0000","last_clean":"2024-04-26T11:19:26.204769+0000","last_became_active":"2024-04-26T11:19:18.189341+0000","last_became_peered":"2024-04-26T11:19:18.189341+0000","last_unstale":"2024-04-26T11:19:26.204769+0000","last_undegraded":"2024-04-26T11:19:26.204769+0000","last_fullsized":"2024-04-26T11:19:26.204769+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:52.141583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684494+0000","last_change":"2024-04-26T11:19:24.202866+0000","last_active":"2024-04-26T11:19:26.684494+0000","last_peered":"2024-04-26T11:19:26.684494+0000","last_clean":"2024-04-26T11:19:26.684494+0000","last_became_active":"2024-04-26T11:19:24.202422+0000","last_became_peered":"2024-04-26T11:19:24.202422+0000","last_unstale":"2024-04-26T11:19:26.684494+0000","last_undegraded":"2024-04-26T11:19:26.684494+0000","last_fullsized":"2024-04-26T11:19:26.684494+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.564374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205080+0000","last_change":"2024-04-26T11:13:12.917763+0000","last_active":"2024-04-26T11:19:26.205080+0000","last_peered":"2024-04-26T11:19:26.205080+0000","last_clean":"2024-04-26T11:19:26.205080+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:19:26.205080+0000","last_undegraded":"2024-04-26T11:19:26.205080+0000","last_fullsized":"2024-04-26T11:19:26.205080+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204913+0000","last_change":"2024-04-26T11:19:24.205087+0000","last_active":"2024-04-26T11:19:26.204913+0000","last_peered":"2024-04-26T11:19:26.204913+0000","last_clean":"2024-04-26T11:19:26.204913+0000","last_became_active":"2024-04-26T11:19:24.204129+0000","last_became_peered":"2024-04-26T11:19:24.204129+0000","last_unstale":"2024-04-26T11:19:26.204913+0000","last_undegraded":"2024-04-26T11:19:26.204913+0000","last_fullsized":"2024-04-26T11:19:26.204913+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:15.916622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204637+0000","last_change":"2024-04-26T11:19:18.189530+0000","last_active":"2024-04-26T11:19:26.204637+0000","last_peered":"2024-04-26T11:19:26.204637+0000","last_clean":"2024-04-26T11:19:26.204637+0000","last_became_active":"2024-04-26T11:19:18.189179+0000","last_became_peered":"2024-04-26T11:19:18.189179+0000","last_unstale":"2024-04-26T11:19:26.204637+0000","last_undegraded":"2024-04-26T11:19:26.204637+0000","last_fullsized":"2024-04-26T11:19:26.204637+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.132608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204517+0000","last_change":"2024-04-26T11:19:18.189257+0000","last_active":"2024-04-26T11:19:26.204517+0000","last_peered":"2024-04-26T11:19:26.204517+0000","last_clean":"2024-04-26T11:19:26.204517+0000","last_became_active":"2024-04-26T11:19:18.188963+0000","last_became_peered":"2024-04-26T11:19:18.188963+0000","last_unstale":"2024-04-26T11:19:26.204517+0000","last_undegraded":"2024-04-26T11:19:26.204517+0000","last_fullsized":"2024-04-26T11:19:26.204517+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:37.907392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684318+0000","last_change":"2024-04-26T11:19:24.200217+0000","last_active":"2024-04-26T11:19:26.684318+0000","last_peered":"2024-04-26T11:19:26.684318+0000","last_clean":"2024-04-26T11:19:26.684318+0000","last_became_active":"2024-04-26T11:19:24.198397+0000","last_became_peered":"2024-04-26T11:19:24.198397+0000","last_unstale":"2024-04-26T11:19:26.684318+0000","last_undegraded":"2024-04-26T11:19:26.684318+0000","last_fullsized":"2024-04-26T11:19:26.684318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:44.576230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205025+0000","last_change":"2024-04-26T11:19:18.183441+0000","last_active":"2024-04-26T11:19:26.205025+0000","last_peered":"2024-04-26T11:19:26.205025+0000","last_clean":"2024-04-26T11:19:26.205025+0000","last_became_active":"2024-04-26T11:19:18.183037+0000","last_became_peered":"2024-04-26T11:19:18.183037+0000","last_unstale":"2024-04-26T11:19:26.205025+0000","last_undegraded":"2024-04-26T11:19:26.205025+0000","last_fullsized":"2024-04-26T11:19:26.205025+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:32.597584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684386+0000","last_change":"2024-04-26T11:19:24.203647+0000","last_active":"2024-04-26T11:19:26.684386+0000","last_peered":"2024-04-26T11:19:26.684386+0000","last_clean":"2024-04-26T11:19:26.684386+0000","last_became_active":"2024-04-26T11:19:24.202442+0000","last_became_peered":"2024-04-26T11:19:24.202442+0000","last_unstale":"2024-04-26T11:19:26.684386+0000","last_undegraded":"2024-04-26T11:19:26.684386+0000","last_fullsized":"2024-04-26T11:19:26.684386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:21.883832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205445+0000","last_change":"2024-04-26T11:19:18.184719+0000","last_active":"2024-04-26T11:19:26.205445+0000","last_peered":"2024-04-26T11:19:26.205445+0000","last_clean":"2024-04-26T11:19:26.205445+0000","last_became_active":"2024-04-26T11:19:18.184384+0000","last_became_peered":"2024-04-26T11:19:18.184384+0000","last_unstale":"2024-04-26T11:19:26.205445+0000","last_undegraded":"2024-04-26T11:19:26.205445+0000","last_fullsized":"2024-04-26T11:19:26.205445+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:37.130545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7958,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738447,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281152,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94090688,"statfs":{"total":96636764160,"available":96348864512,"internally_reserved":0,"allocated":1490944,"data_stored":947441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Fri Apr 26 11:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45800000000000002,"15min":0.39600000000000002},"min":{"1min":0.34399999999999997,"5min":0.17999999999999999,"15min":0.17199999999999999},"max":{"1min":0.68100000000000005,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.316,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.66400000000000003,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.60699999999999998}]}]},{"osd":0,"up_from":75,"seq":322122547204,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38160,"kb_used_data":1468,"kb_used_omap":10,"kb_used_meta":36661,"kb_avail":94333680,"statfs":{"total":96636764160,"available":96597688320,"internally_reserved":0,"allocated":1503232,"data_stored":949168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11228,"internal_metadata":37540900},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738448,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401140,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":400254,"kb_avail":93970700,"statfs":{"total":96636764160,"available":96225996800,"internally_reserved":0,"allocated":884736,"data_stored":357054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":409860550},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Fri Apr 26 11:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.44700000000000001,"15min":0.40699999999999997},"min":{"1min":0.34999999999999998,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.69199999999999995,"5min":2.056,"15min":2.056},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.499,"15min":0.46400000000000002},"min":{"1min":0.376,"5min":0.193,"15min":0.193},"max":{"1min":0.67600000000000005,"5min":3.9609999999999999,"15min":3.9609999999999999},"last":0.46000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7958,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:19:32.317 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:19:32.694 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:19:32.694 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":82,"fsid":"2b52ce04-9559-478f-9787-c3cc3b261c15","created":"2024-04-26T11:12:58.193418+0000","modified":"2024-04-26T11:19:27.206561+0000","last_up_change":"2024-04-26T11:19:17.158398+0000","last_in_change":"2024-04-26T11:12:59.116286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:13:06.502266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:13:06.913870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:13:11.430854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:13:11.859264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3496b3f-5972-47ff-a449-832f5055beac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":67,"last_clean_end":71,"up_from":75,"up_thru":75,"down_at":72,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1813},{"type":"v1","addr":"172.21.15.72:6801","nonce":1813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1813},{"type":"v1","addr":"172.21.15.72:6803","nonce":1813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1813},{"type":"v1","addr":"172.21.15.72:6807","nonce":1813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1813},{"type":"v1","addr":"172.21.15.72:6805","nonce":1813}]},"public_addr":"172.21.15.72:6801/1813","cluster_addr":"172.21.15.72:6803/1813","heartbeat_back_addr":"172.21.15.72:6807/1813","heartbeat_front_addr":"172.21.15.72:6805/1813","state":["exists","up"]},{"osd":1,"uuid":"4842abe1-e7b4-480f-85b3-11c8fa2123f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":41442},{"type":"v1","addr":"172.21.15.82:6801","nonce":41442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":41442},{"type":"v1","addr":"172.21.15.82:6803","nonce":41442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":41442},{"type":"v1","addr":"172.21.15.82:6807","nonce":41442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":41442},{"type":"v1","addr":"172.21.15.82:6805","nonce":41442}]},"public_addr":"172.21.15.82:6801/41442","cluster_addr":"172.21.15.82:6803/41442","heartbeat_back_addr":"172.21.15.82:6807/41442","heartbeat_front_addr":"172.21.15.82:6805/41442","state":["exists","up"]},{"osd":2,"uuid":"57b4a874-e4ce-42a9-a7fd-f9e0acf03cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":41571},{"type":"v1","addr":"172.21.15.122:6801","nonce":41571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":41571},{"type":"v1","addr":"172.21.15.122:6803","nonce":41571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":41571},{"type":"v1","addr":"172.21.15.122:6807","nonce":41571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":41571},{"type":"v1","addr":"172.21.15.122:6805","nonce":41571}]},"public_addr":"172.21.15.122:6801/41571","cluster_addr":"172.21.15.122:6803/41571","heartbeat_back_addr":"172.21.15.122:6807/41571","heartbeat_front_addr":"172.21.15.122:6805/41571","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.123925+0000","dead_epoch":71},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.145646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:05.101494+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:19:33.709 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T11:19:33.709 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T11:19:33.875 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-26T11:19:33.875 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-26T11:19:33.875 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-26T11:19:33.890 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T11:19:34.232 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T11:19:34.243 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T11:19:34.244 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T11:19:34.395 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-26T11:19:34.395 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T11:19:34.395 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-26T11:19:34.407 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T11:19:34.754 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T11:19:34.764 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T11:19:34.765 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T11:19:34.918 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-04-26T11:19:34.918 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T11:19:34.918 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-04-26T11:19:34.928 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T11:19:35.274 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T11:19:35.285 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:19:35.631 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:19:35.632 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:19:35.642 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-04-26T11:19:34.562114+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":720452,"kb_used_data":3788,"kb_used_omap":14,"kb_used_meta":716593,"kb_avail":282395068,"statfs":{"total":289910292480,"available":289172549632,"internally_reserved":0,"allocated":3878912,"data_stored":2253663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14416,"internal_metadata":733792176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.359196"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211376+0000","last_change":"2024-04-26T11:13:12.919196+0000","last_active":"2024-04-26T11:19:27.211376+0000","last_peered":"2024-04-26T11:19:27.211376+0000","last_clean":"2024-04-26T11:19:27.211376+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:19:27.211376+0000","last_undegraded":"2024-04-26T11:19:27.211376+0000","last_fullsized":"2024-04-26T11:19:27.211376+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:06.129750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211095+0000","last_change":"2024-04-26T11:13:12.917670+0000","last_active":"2024-04-26T11:19:27.211095+0000","last_peered":"2024-04-26T11:19:27.211095+0000","last_clean":"2024-04-26T11:19:27.211095+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:19:27.211095+0000","last_undegraded":"2024-04-26T11:19:27.211095+0000","last_fullsized":"2024-04-26T11:19:27.211095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:05.394769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205142+0000","last_change":"2024-04-26T11:19:18.185209+0000","last_active":"2024-04-26T11:19:26.205142+0000","last_peered":"2024-04-26T11:19:26.205142+0000","last_clean":"2024-04-26T11:19:26.205142+0000","last_became_active":"2024-04-26T11:19:18.182972+0000","last_became_peered":"2024-04-26T11:19:18.182972+0000","last_unstale":"2024-04-26T11:19:26.205142+0000","last_undegraded":"2024-04-26T11:19:26.205142+0000","last_fullsized":"2024-04-26T11:19:26.205142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:57.755970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204499+0000","last_change":"2024-04-26T11:19:18.183286+0000","last_active":"2024-04-26T11:19:26.204499+0000","last_peered":"2024-04-26T11:19:26.204499+0000","last_clean":"2024-04-26T11:19:26.204499+0000","last_became_active":"2024-04-26T11:19:18.182942+0000","last_became_peered":"2024-04-26T11:19:18.182942+0000","last_unstale":"2024-04-26T11:19:26.204499+0000","last_undegraded":"2024-04-26T11:19:26.204499+0000","last_fullsized":"2024-04-26T11:19:26.204499+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:58.370599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205030+0000","last_change":"2024-04-26T11:13:12.917403+0000","last_active":"2024-04-26T11:19:26.205030+0000","last_peered":"2024-04-26T11:19:26.205030+0000","last_clean":"2024-04-26T11:19:26.205030+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:19:26.205030+0000","last_undegraded":"2024-04-26T11:19:26.205030+0000","last_fullsized":"2024-04-26T11:19:26.205030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:42.014955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204622+0000","last_change":"2024-04-26T11:19:18.189355+0000","last_active":"2024-04-26T11:19:26.204622+0000","last_peered":"2024-04-26T11:19:26.204622+0000","last_clean":"2024-04-26T11:19:26.204622+0000","last_became_active":"2024-04-26T11:19:18.188990+0000","last_became_peered":"2024-04-26T11:19:18.188990+0000","last_unstale":"2024-04-26T11:19:26.204622+0000","last_undegraded":"2024-04-26T11:19:26.204622+0000","last_fullsized":"2024-04-26T11:19:26.204622+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:29.030847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204397+0000","last_change":"2024-04-26T11:19:18.187953+0000","last_active":"2024-04-26T11:19:26.204397+0000","last_peered":"2024-04-26T11:19:26.204397+0000","last_clean":"2024-04-26T11:19:26.204397+0000","last_became_active":"2024-04-26T11:19:18.186638+0000","last_became_peered":"2024-04-26T11:19:18.186638+0000","last_unstale":"2024-04-26T11:19:26.204397+0000","last_undegraded":"2024-04-26T11:19:26.204397+0000","last_fullsized":"2024-04-26T11:19:26.204397+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:18.483074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204062+0000","last_change":"2024-04-26T11:19:18.183968+0000","last_active":"2024-04-26T11:19:26.204062+0000","last_peered":"2024-04-26T11:19:26.204062+0000","last_clean":"2024-04-26T11:19:26.204062+0000","last_became_active":"2024-04-26T11:19:18.182111+0000","last_became_peered":"2024-04-26T11:19:18.182111+0000","last_unstale":"2024-04-26T11:19:26.204062+0000","last_undegraded":"2024-04-26T11:19:26.204062+0000","last_fullsized":"2024-04-26T11:19:26.204062+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:08.529468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684517+0000","last_change":"2024-04-26T11:19:24.202861+0000","last_active":"2024-04-26T11:19:26.684517+0000","last_peered":"2024-04-26T11:19:26.684517+0000","last_clean":"2024-04-26T11:19:26.684517+0000","last_became_active":"2024-04-26T11:19:24.202146+0000","last_became_peered":"2024-04-26T11:19:24.202146+0000","last_unstale":"2024-04-26T11:19:26.684517+0000","last_undegraded":"2024-04-26T11:19:26.684517+0000","last_fullsized":"2024-04-26T11:19:26.684517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:33.234821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205553+0000","last_change":"2024-04-26T11:13:12.918521+0000","last_active":"2024-04-26T11:19:26.205553+0000","last_peered":"2024-04-26T11:19:26.205553+0000","last_clean":"2024-04-26T11:19:26.205553+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:19:26.205553+0000","last_undegraded":"2024-04-26T11:19:26.205553+0000","last_fullsized":"2024-04-26T11:19:26.205553+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:10:50.725263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204805+0000","last_change":"2024-04-26T11:19:18.187027+0000","last_active":"2024-04-26T11:19:26.204805+0000","last_peered":"2024-04-26T11:19:26.204805+0000","last_clean":"2024-04-26T11:19:26.204805+0000","last_became_active":"2024-04-26T11:19:18.185543+0000","last_became_peered":"2024-04-26T11:19:18.185543+0000","last_unstale":"2024-04-26T11:19:26.204805+0000","last_undegraded":"2024-04-26T11:19:26.204805+0000","last_fullsized":"2024-04-26T11:19:26.204805+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:38.365806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205142+0000","last_change":"2024-04-26T11:19:18.183459+0000","last_active":"2024-04-26T11:19:26.205142+0000","last_peered":"2024-04-26T11:19:26.205142+0000","last_clean":"2024-04-26T11:19:26.205142+0000","last_became_active":"2024-04-26T11:19:18.182827+0000","last_became_peered":"2024-04-26T11:19:18.182827+0000","last_unstale":"2024-04-26T11:19:26.205142+0000","last_undegraded":"2024-04-26T11:19:26.205142+0000","last_fullsized":"2024-04-26T11:19:26.205142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:28.182922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205400+0000","last_change":"2024-04-26T11:13:12.915484+0000","last_active":"2024-04-26T11:19:26.205400+0000","last_peered":"2024-04-26T11:19:26.205400+0000","last_clean":"2024-04-26T11:19:26.205400+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:19:26.205400+0000","last_undegraded":"2024-04-26T11:19:26.205400+0000","last_fullsized":"2024-04-26T11:19:26.205400+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:21:50.303579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204505+0000","last_change":"2024-04-26T11:19:18.181800+0000","last_active":"2024-04-26T11:19:26.204505+0000","last_peered":"2024-04-26T11:19:26.204505+0000","last_clean":"2024-04-26T11:19:26.204505+0000","last_became_active":"2024-04-26T11:19:18.180865+0000","last_became_peered":"2024-04-26T11:19:18.180865+0000","last_unstale":"2024-04-26T11:19:26.204505+0000","last_undegraded":"2024-04-26T11:19:26.204505+0000","last_fullsized":"2024-04-26T11:19:26.204505+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:36.948796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204335+0000","last_change":"2024-04-26T11:19:18.181625+0000","last_active":"2024-04-26T11:19:26.204335+0000","last_peered":"2024-04-26T11:19:26.204335+0000","last_clean":"2024-04-26T11:19:26.204335+0000","last_became_active":"2024-04-26T11:19:18.180763+0000","last_became_peered":"2024-04-26T11:19:18.180763+0000","last_unstale":"2024-04-26T11:19:26.204335+0000","last_undegraded":"2024-04-26T11:19:26.204335+0000","last_fullsized":"2024-04-26T11:19:26.204335+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:27.138589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204271+0000","last_change":"2024-04-26T11:19:18.185161+0000","last_active":"2024-04-26T11:19:26.204271+0000","last_peered":"2024-04-26T11:19:26.204271+0000","last_clean":"2024-04-26T11:19:26.204271+0000","last_became_active":"2024-04-26T11:19:18.184331+0000","last_became_peered":"2024-04-26T11:19:18.184331+0000","last_unstale":"2024-04-26T11:19:26.204271+0000","last_undegraded":"2024-04-26T11:19:26.204271+0000","last_fullsized":"2024-04-26T11:19:26.204271+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:29.254144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684526+0000","last_change":"2024-04-26T11:19:24.204827+0000","last_active":"2024-04-26T11:19:26.684526+0000","last_peered":"2024-04-26T11:19:26.684526+0000","last_clean":"2024-04-26T11:19:26.684526+0000","last_became_active":"2024-04-26T11:19:24.203764+0000","last_became_peered":"2024-04-26T11:19:24.203764+0000","last_unstale":"2024-04-26T11:19:26.684526+0000","last_undegraded":"2024-04-26T11:19:26.684526+0000","last_fullsized":"2024-04-26T11:19:26.684526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:29.263130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205647+0000","last_change":"2024-04-26T11:13:12.918759+0000","last_active":"2024-04-26T11:19:26.205647+0000","last_peered":"2024-04-26T11:19:26.205647+0000","last_clean":"2024-04-26T11:19:26.205647+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:19:26.205647+0000","last_undegraded":"2024-04-26T11:19:26.205647+0000","last_fullsized":"2024-04-26T11:19:26.205647+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:55.002972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684440+0000","last_change":"2024-04-26T11:19:24.200114+0000","last_active":"2024-04-26T11:19:26.684440+0000","last_peered":"2024-04-26T11:19:26.684440+0000","last_clean":"2024-04-26T11:19:26.684440+0000","last_became_active":"2024-04-26T11:19:24.199142+0000","last_became_peered":"2024-04-26T11:19:24.199142+0000","last_unstale":"2024-04-26T11:19:26.684440+0000","last_undegraded":"2024-04-26T11:19:26.684440+0000","last_fullsized":"2024-04-26T11:19:26.684440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:07:04.789203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205065+0000","last_change":"2024-04-26T11:19:18.186823+0000","last_active":"2024-04-26T11:19:26.205065+0000","last_peered":"2024-04-26T11:19:26.205065+0000","last_clean":"2024-04-26T11:19:26.205065+0000","last_became_active":"2024-04-26T11:19:18.184282+0000","last_became_peered":"2024-04-26T11:19:18.184282+0000","last_unstale":"2024-04-26T11:19:26.205065+0000","last_undegraded":"2024-04-26T11:19:26.205065+0000","last_fullsized":"2024-04-26T11:19:26.205065+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:11.581601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204671+0000","last_change":"2024-04-26T11:19:18.187937+0000","last_active":"2024-04-26T11:19:26.204671+0000","last_peered":"2024-04-26T11:19:26.204671+0000","last_clean":"2024-04-26T11:19:26.204671+0000","last_became_active":"2024-04-26T11:19:18.186605+0000","last_became_peered":"2024-04-26T11:19:18.186605+0000","last_unstale":"2024-04-26T11:19:26.204671+0000","last_undegraded":"2024-04-26T11:19:26.204671+0000","last_fullsized":"2024-04-26T11:19:26.204671+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:49.737640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204850+0000","last_change":"2024-04-26T11:19:18.182666+0000","last_active":"2024-04-26T11:19:26.204850+0000","last_peered":"2024-04-26T11:19:26.204850+0000","last_clean":"2024-04-26T11:19:26.204850+0000","last_became_active":"2024-04-26T11:19:18.181728+0000","last_became_peered":"2024-04-26T11:19:18.181728+0000","last_unstale":"2024-04-26T11:19:26.204850+0000","last_undegraded":"2024-04-26T11:19:26.204850+0000","last_fullsized":"2024-04-26T11:19:26.204850+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:07.719581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.203921+0000","last_change":"2024-04-26T11:19:24.198562+0000","last_active":"2024-04-26T11:19:26.203921+0000","last_peered":"2024-04-26T11:19:26.203921+0000","last_clean":"2024-04-26T11:19:26.203921+0000","last_became_active":"2024-04-26T11:19:24.197487+0000","last_became_peered":"2024-04-26T11:19:24.197487+0000","last_unstale":"2024-04-26T11:19:26.203921+0000","last_undegraded":"2024-04-26T11:19:26.203921+0000","last_fullsized":"2024-04-26T11:19:26.203921+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:35:31.790885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204840+0000","last_change":"2024-04-26T11:13:12.912756+0000","last_active":"2024-04-26T11:19:26.204840+0000","last_peered":"2024-04-26T11:19:26.204840+0000","last_clean":"2024-04-26T11:19:26.204840+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:19:26.204840+0000","last_undegraded":"2024-04-26T11:19:26.204840+0000","last_fullsized":"2024-04-26T11:19:26.204840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:04.177831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205614+0000","last_change":"2024-04-26T11:19:18.184692+0000","last_active":"2024-04-26T11:19:26.205614+0000","last_peered":"2024-04-26T11:19:26.205614+0000","last_clean":"2024-04-26T11:19:26.205614+0000","last_became_active":"2024-04-26T11:19:18.184451+0000","last_became_peered":"2024-04-26T11:19:18.184451+0000","last_unstale":"2024-04-26T11:19:26.205614+0000","last_undegraded":"2024-04-26T11:19:26.205614+0000","last_fullsized":"2024-04-26T11:19:26.205614+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:08.485754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204759+0000","last_change":"2024-04-26T11:19:24.199954+0000","last_active":"2024-04-26T11:19:26.204759+0000","last_peered":"2024-04-26T11:19:26.204759+0000","last_clean":"2024-04-26T11:19:26.204759+0000","last_became_active":"2024-04-26T11:19:24.198479+0000","last_became_peered":"2024-04-26T11:19:24.198479+0000","last_unstale":"2024-04-26T11:19:26.204759+0000","last_undegraded":"2024-04-26T11:19:26.204759+0000","last_fullsized":"2024-04-26T11:19:26.204759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:14.221425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204917+0000","last_change":"2024-04-26T11:19:18.185709+0000","last_active":"2024-04-26T11:19:26.204917+0000","last_peered":"2024-04-26T11:19:26.204917+0000","last_clean":"2024-04-26T11:19:26.204917+0000","last_became_active":"2024-04-26T11:19:18.185105+0000","last_became_peered":"2024-04-26T11:19:18.185105+0000","last_unstale":"2024-04-26T11:19:26.204917+0000","last_undegraded":"2024-04-26T11:19:26.204917+0000","last_fullsized":"2024-04-26T11:19:26.204917+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:06:43.626259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204813+0000","last_change":"2024-04-26T11:13:12.493425+0000","last_active":"2024-04-26T11:19:26.204813+0000","last_peered":"2024-04-26T11:19:26.204813+0000","last_clean":"2024-04-26T11:19:26.204813+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:19:26.204813+0000","last_undegraded":"2024-04-26T11:19:26.204813+0000","last_fullsized":"2024-04-26T11:19:26.204813+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:23.279580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205712+0000","last_change":"2024-04-26T11:19:18.191042+0000","last_active":"2024-04-26T11:19:26.205712+0000","last_peered":"2024-04-26T11:19:26.205712+0000","last_clean":"2024-04-26T11:19:26.205712+0000","last_became_active":"2024-04-26T11:19:18.190792+0000","last_became_peered":"2024-04-26T11:19:18.190792+0000","last_unstale":"2024-04-26T11:19:26.205712+0000","last_undegraded":"2024-04-26T11:19:26.205712+0000","last_fullsized":"2024-04-26T11:19:26.205712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:45.726211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684337+0000","last_change":"2024-04-26T11:19:24.203467+0000","last_active":"2024-04-26T11:19:26.684337+0000","last_peered":"2024-04-26T11:19:26.684337+0000","last_clean":"2024-04-26T11:19:26.684337+0000","last_became_active":"2024-04-26T11:19:24.202348+0000","last_became_peered":"2024-04-26T11:19:24.202348+0000","last_unstale":"2024-04-26T11:19:26.684337+0000","last_undegraded":"2024-04-26T11:19:26.684337+0000","last_fullsized":"2024-04-26T11:19:26.684337+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:55.157485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204840+0000","last_change":"2024-04-26T11:19:24.200292+0000","last_active":"2024-04-26T11:19:26.204840+0000","last_peered":"2024-04-26T11:19:26.204840+0000","last_clean":"2024-04-26T11:19:26.204840+0000","last_became_active":"2024-04-26T11:19:24.198920+0000","last_became_peered":"2024-04-26T11:19:24.198920+0000","last_unstale":"2024-04-26T11:19:26.204840+0000","last_undegraded":"2024-04-26T11:19:26.204840+0000","last_fullsized":"2024-04-26T11:19:26.204840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:22:45.950568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684279+0000","last_change":"2024-04-26T11:19:24.199051+0000","last_active":"2024-04-26T11:19:26.684279+0000","last_peered":"2024-04-26T11:19:26.684279+0000","last_clean":"2024-04-26T11:19:26.684279+0000","last_became_active":"2024-04-26T11:19:24.197698+0000","last_became_peered":"2024-04-26T11:19:24.197698+0000","last_unstale":"2024-04-26T11:19:26.684279+0000","last_undegraded":"2024-04-26T11:19:26.684279+0000","last_fullsized":"2024-04-26T11:19:26.684279+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:21.891894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211316+0000","last_change":"2024-04-26T11:19:18.190418+0000","last_active":"2024-04-26T11:19:27.211316+0000","last_peered":"2024-04-26T11:19:27.211316+0000","last_clean":"2024-04-26T11:19:27.211316+0000","last_became_active":"2024-04-26T11:19:18.190127+0000","last_became_peered":"2024-04-26T11:19:18.190127+0000","last_unstale":"2024-04-26T11:19:27.211316+0000","last_undegraded":"2024-04-26T11:19:27.211316+0000","last_fullsized":"2024-04-26T11:19:27.211316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:11:25.515683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205003+0000","last_change":"2024-04-26T11:19:24.205086+0000","last_active":"2024-04-26T11:19:26.205003+0000","last_peered":"2024-04-26T11:19:26.205003+0000","last_clean":"2024-04-26T11:19:26.205003+0000","last_became_active":"2024-04-26T11:19:24.204122+0000","last_became_peered":"2024-04-26T11:19:24.204122+0000","last_unstale":"2024-04-26T11:19:26.205003+0000","last_undegraded":"2024-04-26T11:19:26.205003+0000","last_fullsized":"2024-04-26T11:19:26.205003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:56:23.239851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684262+0000","last_change":"2024-04-26T11:19:24.198434+0000","last_active":"2024-04-26T11:19:26.684262+0000","last_peered":"2024-04-26T11:19:26.684262+0000","last_clean":"2024-04-26T11:19:26.684262+0000","last_became_active":"2024-04-26T11:19:24.197247+0000","last_became_peered":"2024-04-26T11:19:24.197247+0000","last_unstale":"2024-04-26T11:19:26.684262+0000","last_undegraded":"2024-04-26T11:19:26.684262+0000","last_fullsized":"2024-04-26T11:19:26.684262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:31:23.769249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204777+0000","last_change":"2024-04-26T11:19:18.187720+0000","last_active":"2024-04-26T11:19:26.204777+0000","last_peered":"2024-04-26T11:19:26.204777+0000","last_clean":"2024-04-26T11:19:26.204777+0000","last_became_active":"2024-04-26T11:19:18.185578+0000","last_became_peered":"2024-04-26T11:19:18.185578+0000","last_unstale":"2024-04-26T11:19:26.204777+0000","last_undegraded":"2024-04-26T11:19:26.204777+0000","last_fullsized":"2024-04-26T11:19:26.204777+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:38.482108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204346+0000","last_change":"2024-04-26T11:19:24.201728+0000","last_active":"2024-04-26T11:19:26.204346+0000","last_peered":"2024-04-26T11:19:26.204346+0000","last_clean":"2024-04-26T11:19:26.204346+0000","last_became_active":"2024-04-26T11:19:24.200992+0000","last_became_peered":"2024-04-26T11:19:24.200992+0000","last_unstale":"2024-04-26T11:19:26.204346+0000","last_undegraded":"2024-04-26T11:19:26.204346+0000","last_fullsized":"2024-04-26T11:19:26.204346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:59.859744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":109,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205523+0000","last_change":"2024-04-26T11:19:18.190998+0000","last_active":"2024-04-26T11:19:26.205523+0000","last_peered":"2024-04-26T11:19:26.205523+0000","last_clean":"2024-04-26T11:19:26.205523+0000","last_became_active":"2024-04-26T11:19:18.190381+0000","last_became_peered":"2024-04-26T11:19:18.190381+0000","last_unstale":"2024-04-26T11:19:26.205523+0000","last_undegraded":"2024-04-26T11:19:26.205523+0000","last_fullsized":"2024-04-26T11:19:26.205523+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:31.159104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684360+0000","last_change":"2024-04-26T11:19:24.200037+0000","last_active":"2024-04-26T11:19:26.684360+0000","last_peered":"2024-04-26T11:19:26.684360+0000","last_clean":"2024-04-26T11:19:26.684360+0000","last_became_active":"2024-04-26T11:19:24.199659+0000","last_became_peered":"2024-04-26T11:19:24.199659+0000","last_unstale":"2024-04-26T11:19:26.684360+0000","last_undegraded":"2024-04-26T11:19:26.684360+0000","last_fullsized":"2024-04-26T11:19:26.684360+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:49.275857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":45,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204850+0000","last_change":"2024-04-26T11:19:18.181316+0000","last_active":"2024-04-26T11:19:26.204850+0000","last_peered":"2024-04-26T11:19:26.204850+0000","last_clean":"2024-04-26T11:19:26.204850+0000","last_became_active":"2024-04-26T11:19:18.180711+0000","last_became_peered":"2024-04-26T11:19:18.180711+0000","last_unstale":"2024-04-26T11:19:26.204850+0000","last_undegraded":"2024-04-26T11:19:26.204850+0000","last_fullsized":"2024-04-26T11:19:26.204850+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:59:27.837108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204705+0000","last_change":"2024-04-26T11:19:18.182026+0000","last_active":"2024-04-26T11:19:26.204705+0000","last_peered":"2024-04-26T11:19:26.204705+0000","last_clean":"2024-04-26T11:19:26.204705+0000","last_became_active":"2024-04-26T11:19:18.181615+0000","last_became_peered":"2024-04-26T11:19:18.181615+0000","last_unstale":"2024-04-26T11:19:26.204705+0000","last_undegraded":"2024-04-26T11:19:26.204705+0000","last_fullsized":"2024-04-26T11:19:26.204705+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:56.083479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204459+0000","last_change":"2024-04-26T11:19:18.185625+0000","last_active":"2024-04-26T11:19:26.204459+0000","last_peered":"2024-04-26T11:19:26.204459+0000","last_clean":"2024-04-26T11:19:26.204459+0000","last_became_active":"2024-04-26T11:19:18.183103+0000","last_became_peered":"2024-04-26T11:19:18.183103+0000","last_unstale":"2024-04-26T11:19:26.204459+0000","last_undegraded":"2024-04-26T11:19:26.204459+0000","last_fullsized":"2024-04-26T11:19:26.204459+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:42.309969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205241+0000","last_change":"2024-04-26T11:13:12.916685+0000","last_active":"2024-04-26T11:19:26.205241+0000","last_peered":"2024-04-26T11:19:26.205241+0000","last_clean":"2024-04-26T11:19:26.205241+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:19:26.205241+0000","last_undegraded":"2024-04-26T11:19:26.205241+0000","last_fullsized":"2024-04-26T11:19:26.205241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:30.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204255+0000","last_change":"2024-04-26T11:19:24.199114+0000","last_active":"2024-04-26T11:19:26.204255+0000","last_peered":"2024-04-26T11:19:26.204255+0000","last_clean":"2024-04-26T11:19:26.204255+0000","last_became_active":"2024-04-26T11:19:24.197647+0000","last_became_peered":"2024-04-26T11:19:24.197647+0000","last_unstale":"2024-04-26T11:19:26.204255+0000","last_undegraded":"2024-04-26T11:19:26.204255+0000","last_fullsized":"2024-04-26T11:19:26.204255+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:23.938536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205618+0000","last_change":"2024-04-26T11:13:12.915238+0000","last_active":"2024-04-26T11:19:26.205618+0000","last_peered":"2024-04-26T11:19:26.205618+0000","last_clean":"2024-04-26T11:19:26.205618+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:19:26.205618+0000","last_undegraded":"2024-04-26T11:19:26.205618+0000","last_fullsized":"2024-04-26T11:19:26.205618+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:48.068465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":106,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204835+0000","last_change":"2024-04-26T11:19:18.182547+0000","last_active":"2024-04-26T11:19:26.204835+0000","last_peered":"2024-04-26T11:19:26.204835+0000","last_clean":"2024-04-26T11:19:26.204835+0000","last_became_active":"2024-04-26T11:19:18.181907+0000","last_became_peered":"2024-04-26T11:19:18.181907+0000","last_unstale":"2024-04-26T11:19:26.204835+0000","last_undegraded":"2024-04-26T11:19:26.204835+0000","last_fullsized":"2024-04-26T11:19:26.204835+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:26.076863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204980+0000","last_change":"2024-04-26T11:19:24.201756+0000","last_active":"2024-04-26T11:19:26.204980+0000","last_peered":"2024-04-26T11:19:26.204980+0000","last_clean":"2024-04-26T11:19:26.204980+0000","last_became_active":"2024-04-26T11:19:24.201114+0000","last_became_peered":"2024-04-26T11:19:24.201114+0000","last_unstale":"2024-04-26T11:19:26.204980+0000","last_undegraded":"2024-04-26T11:19:26.204980+0000","last_fullsized":"2024-04-26T11:19:26.204980+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:34.095066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204443+0000","last_change":"2024-04-26T11:19:18.182797+0000","last_active":"2024-04-26T11:19:26.204443+0000","last_peered":"2024-04-26T11:19:26.204443+0000","last_clean":"2024-04-26T11:19:26.204443+0000","last_became_active":"2024-04-26T11:19:18.182017+0000","last_became_peered":"2024-04-26T11:19:18.182017+0000","last_unstale":"2024-04-26T11:19:26.204443+0000","last_undegraded":"2024-04-26T11:19:26.204443+0000","last_fullsized":"2024-04-26T11:19:26.204443+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:41.531437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205077+0000","last_change":"2024-04-26T11:19:24.205310+0000","last_active":"2024-04-26T11:19:26.205077+0000","last_peered":"2024-04-26T11:19:26.205077+0000","last_clean":"2024-04-26T11:19:26.205077+0000","last_became_active":"2024-04-26T11:19:24.204476+0000","last_became_peered":"2024-04-26T11:19:24.204476+0000","last_unstale":"2024-04-26T11:19:26.205077+0000","last_undegraded":"2024-04-26T11:19:26.205077+0000","last_fullsized":"2024-04-26T11:19:26.205077+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:14.932094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205069+0000","last_change":"2024-04-26T11:19:18.181966+0000","last_active":"2024-04-26T11:19:26.205069+0000","last_peered":"2024-04-26T11:19:26.205069+0000","last_clean":"2024-04-26T11:19:26.205069+0000","last_became_active":"2024-04-26T11:19:18.181604+0000","last_became_peered":"2024-04-26T11:19:18.181604+0000","last_unstale":"2024-04-26T11:19:26.205069+0000","last_undegraded":"2024-04-26T11:19:26.205069+0000","last_fullsized":"2024-04-26T11:19:26.205069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:57.405893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204571+0000","last_change":"2024-04-26T11:19:18.181723+0000","last_active":"2024-04-26T11:19:26.204571+0000","last_peered":"2024-04-26T11:19:26.204571+0000","last_clean":"2024-04-26T11:19:26.204571+0000","last_became_active":"2024-04-26T11:19:18.181462+0000","last_became_peered":"2024-04-26T11:19:18.181462+0000","last_unstale":"2024-04-26T11:19:26.204571+0000","last_undegraded":"2024-04-26T11:19:26.204571+0000","last_fullsized":"2024-04-26T11:19:26.204571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:23.824505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205502+0000","last_change":"2024-04-26T11:19:18.183263+0000","last_active":"2024-04-26T11:19:26.205502+0000","last_peered":"2024-04-26T11:19:26.205502+0000","last_clean":"2024-04-26T11:19:26.205502+0000","last_became_active":"2024-04-26T11:19:18.182242+0000","last_became_peered":"2024-04-26T11:19:18.182242+0000","last_unstale":"2024-04-26T11:19:26.205502+0000","last_undegraded":"2024-04-26T11:19:26.205502+0000","last_fullsized":"2024-04-26T11:19:26.205502+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:25.716967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204977+0000","last_change":"2024-04-26T11:13:12.912207+0000","last_active":"2024-04-26T11:19:26.204977+0000","last_peered":"2024-04-26T11:19:26.204977+0000","last_clean":"2024-04-26T11:19:26.204977+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:19:26.204977+0000","last_undegraded":"2024-04-26T11:19:26.204977+0000","last_fullsized":"2024-04-26T11:19:26.204977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:49.188332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204780+0000","last_change":"2024-04-26T11:19:18.181652+0000","last_active":"2024-04-26T11:19:26.204780+0000","last_peered":"2024-04-26T11:19:26.204780+0000","last_clean":"2024-04-26T11:19:26.204780+0000","last_became_active":"2024-04-26T11:19:18.180506+0000","last_became_peered":"2024-04-26T11:19:18.180506+0000","last_unstale":"2024-04-26T11:19:26.204780+0000","last_undegraded":"2024-04-26T11:19:26.204780+0000","last_fullsized":"2024-04-26T11:19:26.204780+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:52.115128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204377+0000","last_change":"2024-04-26T11:19:18.186849+0000","last_active":"2024-04-26T11:19:26.204377+0000","last_peered":"2024-04-26T11:19:26.204377+0000","last_clean":"2024-04-26T11:19:26.204377+0000","last_became_active":"2024-04-26T11:19:18.185355+0000","last_became_peered":"2024-04-26T11:19:18.185355+0000","last_unstale":"2024-04-26T11:19:26.204377+0000","last_undegraded":"2024-04-26T11:19:26.204377+0000","last_fullsized":"2024-04-26T11:19:26.204377+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:21.536805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205106+0000","last_change":"2024-04-26T11:19:18.188150+0000","last_active":"2024-04-26T11:19:26.205106+0000","last_peered":"2024-04-26T11:19:26.205106+0000","last_clean":"2024-04-26T11:19:26.205106+0000","last_became_active":"2024-04-26T11:19:18.186342+0000","last_became_peered":"2024-04-26T11:19:18.186342+0000","last_unstale":"2024-04-26T11:19:26.205106+0000","last_undegraded":"2024-04-26T11:19:26.205106+0000","last_fullsized":"2024-04-26T11:19:26.205106+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:49.270374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204487+0000","last_change":"2024-04-26T11:19:24.201645+0000","last_active":"2024-04-26T11:19:26.204487+0000","last_peered":"2024-04-26T11:19:26.204487+0000","last_clean":"2024-04-26T11:19:26.204487+0000","last_became_active":"2024-04-26T11:19:24.201330+0000","last_became_peered":"2024-04-26T11:19:24.201330+0000","last_unstale":"2024-04-26T11:19:26.204487+0000","last_undegraded":"2024-04-26T11:19:26.204487+0000","last_fullsized":"2024-04-26T11:19:26.204487+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:27:29.326197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204383+0000","last_change":"2024-04-26T11:19:24.201672+0000","last_active":"2024-04-26T11:19:26.204383+0000","last_peered":"2024-04-26T11:19:26.204383+0000","last_clean":"2024-04-26T11:19:26.204383+0000","last_became_active":"2024-04-26T11:19:24.201077+0000","last_became_peered":"2024-04-26T11:19:24.201077+0000","last_unstale":"2024-04-26T11:19:26.204383+0000","last_undegraded":"2024-04-26T11:19:26.204383+0000","last_fullsized":"2024-04-26T11:19:26.204383+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:43:42.500892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204910+0000","last_change":"2024-04-26T11:19:18.187865+0000","last_active":"2024-04-26T11:19:26.204910+0000","last_peered":"2024-04-26T11:19:26.204910+0000","last_clean":"2024-04-26T11:19:26.204910+0000","last_became_active":"2024-04-26T11:19:18.185768+0000","last_became_peered":"2024-04-26T11:19:18.185768+0000","last_unstale":"2024-04-26T11:19:26.204910+0000","last_undegraded":"2024-04-26T11:19:26.204910+0000","last_fullsized":"2024-04-26T11:19:26.204910+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:22.710616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204221+0000","last_change":"2024-04-26T11:19:18.186275+0000","last_active":"2024-04-26T11:19:26.204221+0000","last_peered":"2024-04-26T11:19:26.204221+0000","last_clean":"2024-04-26T11:19:26.204221+0000","last_became_active":"2024-04-26T11:19:18.184149+0000","last_became_peered":"2024-04-26T11:19:18.184149+0000","last_unstale":"2024-04-26T11:19:26.204221+0000","last_undegraded":"2024-04-26T11:19:26.204221+0000","last_fullsized":"2024-04-26T11:19:26.204221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:26.309810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205022+0000","last_change":"2024-04-26T11:19:18.184312+0000","last_active":"2024-04-26T11:19:26.205022+0000","last_peered":"2024-04-26T11:19:26.205022+0000","last_clean":"2024-04-26T11:19:26.205022+0000","last_became_active":"2024-04-26T11:19:18.181951+0000","last_became_peered":"2024-04-26T11:19:18.181951+0000","last_unstale":"2024-04-26T11:19:26.205022+0000","last_undegraded":"2024-04-26T11:19:26.205022+0000","last_fullsized":"2024-04-26T11:19:26.205022+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:45.284225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":106,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204701+0000","last_change":"2024-04-26T11:19:18.182240+0000","last_active":"2024-04-26T11:19:26.204701+0000","last_peered":"2024-04-26T11:19:26.204701+0000","last_clean":"2024-04-26T11:19:26.204701+0000","last_became_active":"2024-04-26T11:19:18.181767+0000","last_became_peered":"2024-04-26T11:19:18.181767+0000","last_unstale":"2024-04-26T11:19:26.204701+0000","last_undegraded":"2024-04-26T11:19:26.204701+0000","last_fullsized":"2024-04-26T11:19:26.204701+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:37:45.829872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205175+0000","last_change":"2024-04-26T11:19:18.183033+0000","last_active":"2024-04-26T11:19:26.205175+0000","last_peered":"2024-04-26T11:19:26.205175+0000","last_clean":"2024-04-26T11:19:26.205175+0000","last_became_active":"2024-04-26T11:19:18.182060+0000","last_became_peered":"2024-04-26T11:19:18.182060+0000","last_unstale":"2024-04-26T11:19:26.205175+0000","last_undegraded":"2024-04-26T11:19:26.205175+0000","last_fullsized":"2024-04-26T11:19:26.205175+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:27.875590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204716+0000","last_change":"2024-04-26T11:13:12.493217+0000","last_active":"2024-04-26T11:19:26.204716+0000","last_peered":"2024-04-26T11:19:26.204716+0000","last_clean":"2024-04-26T11:19:26.204716+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:19:26.204716+0000","last_undegraded":"2024-04-26T11:19:26.204716+0000","last_fullsized":"2024-04-26T11:19:26.204716+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:00.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684546+0000","last_change":"2024-04-26T11:19:24.204856+0000","last_active":"2024-04-26T11:19:26.684546+0000","last_peered":"2024-04-26T11:19:26.684546+0000","last_clean":"2024-04-26T11:19:26.684546+0000","last_became_active":"2024-04-26T11:19:24.203758+0000","last_became_peered":"2024-04-26T11:19:24.203758+0000","last_unstale":"2024-04-26T11:19:26.684546+0000","last_undegraded":"2024-04-26T11:19:26.684546+0000","last_fullsized":"2024-04-26T11:19:26.684546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:33.131784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684419+0000","last_change":"2024-04-26T11:19:24.201687+0000","last_active":"2024-04-26T11:19:26.684419+0000","last_peered":"2024-04-26T11:19:26.684419+0000","last_clean":"2024-04-26T11:19:26.684419+0000","last_became_active":"2024-04-26T11:19:24.200963+0000","last_became_peered":"2024-04-26T11:19:24.200963+0000","last_unstale":"2024-04-26T11:19:26.684419+0000","last_undegraded":"2024-04-26T11:19:26.684419+0000","last_fullsized":"2024-04-26T11:19:26.684419+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:30:42.125098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205206+0000","last_change":"2024-04-26T11:19:18.189488+0000","last_active":"2024-04-26T11:19:26.205206+0000","last_peered":"2024-04-26T11:19:26.205206+0000","last_clean":"2024-04-26T11:19:26.205206+0000","last_became_active":"2024-04-26T11:19:18.189086+0000","last_became_peered":"2024-04-26T11:19:18.189086+0000","last_unstale":"2024-04-26T11:19:26.205206+0000","last_undegraded":"2024-04-26T11:19:26.205206+0000","last_fullsized":"2024-04-26T11:19:26.205206+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:00.540494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210629+0000","last_change":"2024-04-26T11:19:18.182582+0000","last_active":"2024-04-26T11:19:27.210629+0000","last_peered":"2024-04-26T11:19:27.210629+0000","last_clean":"2024-04-26T11:19:27.210629+0000","last_became_active":"2024-04-26T11:19:18.181791+0000","last_became_peered":"2024-04-26T11:19:18.181791+0000","last_unstale":"2024-04-26T11:19:27.210629+0000","last_undegraded":"2024-04-26T11:19:27.210629+0000","last_fullsized":"2024-04-26T11:19:27.210629+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:59.312651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204228+0000","last_change":"2024-04-26T11:19:18.185313+0000","last_active":"2024-04-26T11:19:26.204228+0000","last_peered":"2024-04-26T11:19:26.204228+0000","last_clean":"2024-04-26T11:19:26.204228+0000","last_became_active":"2024-04-26T11:19:18.183292+0000","last_became_peered":"2024-04-26T11:19:18.183292+0000","last_unstale":"2024-04-26T11:19:26.204228+0000","last_undegraded":"2024-04-26T11:19:26.204228+0000","last_fullsized":"2024-04-26T11:19:26.204228+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:05.860349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204969+0000","last_change":"2024-04-26T11:19:18.190450+0000","last_active":"2024-04-26T11:19:26.204969+0000","last_peered":"2024-04-26T11:19:26.204969+0000","last_clean":"2024-04-26T11:19:26.204969+0000","last_became_active":"2024-04-26T11:19:18.190096+0000","last_became_peered":"2024-04-26T11:19:18.190096+0000","last_unstale":"2024-04-26T11:19:26.204969+0000","last_undegraded":"2024-04-26T11:19:26.204969+0000","last_fullsized":"2024-04-26T11:19:26.204969+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:26.905702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684402+0000","last_change":"2024-04-26T11:19:24.200305+0000","last_active":"2024-04-26T11:19:26.684402+0000","last_peered":"2024-04-26T11:19:26.684402+0000","last_clean":"2024-04-26T11:19:26.684402+0000","last_became_active":"2024-04-26T11:19:24.199834+0000","last_became_peered":"2024-04-26T11:19:24.199834+0000","last_unstale":"2024-04-26T11:19:26.684402+0000","last_undegraded":"2024-04-26T11:19:26.684402+0000","last_fullsized":"2024-04-26T11:19:26.684402+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:47.203614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684327+0000","last_change":"2024-04-26T11:19:24.197329+0000","last_active":"2024-04-26T11:19:26.684327+0000","last_peered":"2024-04-26T11:19:26.684327+0000","last_clean":"2024-04-26T11:19:26.684327+0000","last_became_active":"2024-04-26T11:19:24.196561+0000","last_became_peered":"2024-04-26T11:19:24.196561+0000","last_unstale":"2024-04-26T11:19:26.684327+0000","last_undegraded":"2024-04-26T11:19:26.684327+0000","last_fullsized":"2024-04-26T11:19:26.684327+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:06.140967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":107,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204709+0000","last_change":"2024-04-26T11:19:18.182680+0000","last_active":"2024-04-26T11:19:26.204709+0000","last_peered":"2024-04-26T11:19:26.204709+0000","last_clean":"2024-04-26T11:19:26.204709+0000","last_became_active":"2024-04-26T11:19:18.182077+0000","last_became_peered":"2024-04-26T11:19:18.182077+0000","last_unstale":"2024-04-26T11:19:26.204709+0000","last_undegraded":"2024-04-26T11:19:26.204709+0000","last_fullsized":"2024-04-26T11:19:26.204709+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:38:48.832886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684566+0000","last_change":"2024-04-26T11:19:24.205473+0000","last_active":"2024-04-26T11:19:26.684566+0000","last_peered":"2024-04-26T11:19:26.684566+0000","last_clean":"2024-04-26T11:19:26.684566+0000","last_became_active":"2024-04-26T11:19:24.204538+0000","last_became_peered":"2024-04-26T11:19:24.204538+0000","last_unstale":"2024-04-26T11:19:26.684566+0000","last_undegraded":"2024-04-26T11:19:26.684566+0000","last_fullsized":"2024-04-26T11:19:26.684566+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:55.279045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204413+0000","last_change":"2024-04-26T11:19:18.186884+0000","last_active":"2024-04-26T11:19:26.204413+0000","last_peered":"2024-04-26T11:19:26.204413+0000","last_clean":"2024-04-26T11:19:26.204413+0000","last_became_active":"2024-04-26T11:19:18.184460+0000","last_became_peered":"2024-04-26T11:19:18.184460+0000","last_unstale":"2024-04-26T11:19:26.204413+0000","last_undegraded":"2024-04-26T11:19:26.204413+0000","last_fullsized":"2024-04-26T11:19:26.204413+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:12.901543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":234,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204187+0000","last_change":"2024-04-26T11:19:18.181070+0000","last_active":"2024-04-26T11:19:26.204187+0000","last_peered":"2024-04-26T11:19:26.204187+0000","last_clean":"2024-04-26T11:19:26.204187+0000","last_became_active":"2024-04-26T11:19:18.180577+0000","last_became_peered":"2024-04-26T11:19:18.180577+0000","last_unstale":"2024-04-26T11:19:26.204187+0000","last_undegraded":"2024-04-26T11:19:26.204187+0000","last_fullsized":"2024-04-26T11:19:26.204187+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:34:03.095255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684351+0000","last_change":"2024-04-26T11:19:24.197315+0000","last_active":"2024-04-26T11:19:26.684351+0000","last_peered":"2024-04-26T11:19:26.684351+0000","last_clean":"2024-04-26T11:19:26.684351+0000","last_became_active":"2024-04-26T11:19:24.196404+0000","last_became_peered":"2024-04-26T11:19:24.196404+0000","last_unstale":"2024-04-26T11:19:26.684351+0000","last_undegraded":"2024-04-26T11:19:26.684351+0000","last_fullsized":"2024-04-26T11:19:26.684351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:21:58.513393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204960+0000","last_change":"2024-04-26T11:19:18.184063+0000","last_active":"2024-04-26T11:19:26.204960+0000","last_peered":"2024-04-26T11:19:26.204960+0000","last_clean":"2024-04-26T11:19:26.204960+0000","last_became_active":"2024-04-26T11:19:18.181863+0000","last_became_peered":"2024-04-26T11:19:18.181863+0000","last_unstale":"2024-04-26T11:19:26.204960+0000","last_undegraded":"2024-04-26T11:19:26.204960+0000","last_fullsized":"2024-04-26T11:19:26.204960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:53.865511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204315+0000","last_change":"2024-04-26T11:19:18.181362+0000","last_active":"2024-04-26T11:19:26.204315+0000","last_peered":"2024-04-26T11:19:26.204315+0000","last_clean":"2024-04-26T11:19:26.204315+0000","last_became_active":"2024-04-26T11:19:18.180792+0000","last_became_peered":"2024-04-26T11:19:18.180792+0000","last_unstale":"2024-04-26T11:19:26.204315+0000","last_undegraded":"2024-04-26T11:19:26.204315+0000","last_fullsized":"2024-04-26T11:19:26.204315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:16.215932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.209802+0000","last_change":"2024-04-26T11:19:24.199071+0000","last_active":"2024-04-26T11:19:27.209802+0000","last_peered":"2024-04-26T11:19:27.209802+0000","last_clean":"2024-04-26T11:19:27.209802+0000","last_became_active":"2024-04-26T11:19:24.197711+0000","last_became_peered":"2024-04-26T11:19:24.197711+0000","last_unstale":"2024-04-26T11:19:27.209802+0000","last_undegraded":"2024-04-26T11:19:27.209802+0000","last_fullsized":"2024-04-26T11:19:27.209802+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:34.664546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205609+0000","last_change":"2024-04-26T11:13:12.918648+0000","last_active":"2024-04-26T11:19:26.205609+0000","last_peered":"2024-04-26T11:19:26.205609+0000","last_clean":"2024-04-26T11:19:26.205609+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:19:26.205609+0000","last_undegraded":"2024-04-26T11:19:26.205609+0000","last_fullsized":"2024-04-26T11:19:26.205609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:28.911016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.631673+0000","last_change":"2024-04-26T11:13:08.110433+0000","last_active":"2024-04-26T11:19:26.631673+0000","last_peered":"2024-04-26T11:19:26.631673+0000","last_clean":"2024-04-26T11:19:26.631673+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:19:26.631673+0000","last_undegraded":"2024-04-26T11:19:26.631673+0000","last_fullsized":"2024-04-26T11:19:26.631673+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:36.522621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684429+0000","last_change":"2024-04-26T11:19:24.203404+0000","last_active":"2024-04-26T11:19:26.684429+0000","last_peered":"2024-04-26T11:19:26.684429+0000","last_clean":"2024-04-26T11:19:26.684429+0000","last_became_active":"2024-04-26T11:19:24.202550+0000","last_became_peered":"2024-04-26T11:19:24.202550+0000","last_unstale":"2024-04-26T11:19:26.684429+0000","last_undegraded":"2024-04-26T11:19:26.684429+0000","last_fullsized":"2024-04-26T11:19:26.684429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:22.115008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210535+0000","last_change":"2024-04-26T11:19:18.182788+0000","last_active":"2024-04-26T11:19:27.210535+0000","last_peered":"2024-04-26T11:19:27.210535+0000","last_clean":"2024-04-26T11:19:27.210535+0000","last_became_active":"2024-04-26T11:19:18.182186+0000","last_became_peered":"2024-04-26T11:19:18.182186+0000","last_unstale":"2024-04-26T11:19:27.210535+0000","last_undegraded":"2024-04-26T11:19:27.210535+0000","last_fullsized":"2024-04-26T11:19:27.210535+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:26.933717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684536+0000","last_change":"2024-04-26T11:19:24.203482+0000","last_active":"2024-04-26T11:19:26.684536+0000","last_peered":"2024-04-26T11:19:26.684536+0000","last_clean":"2024-04-26T11:19:26.684536+0000","last_became_active":"2024-04-26T11:19:24.202310+0000","last_became_peered":"2024-04-26T11:19:24.202310+0000","last_unstale":"2024-04-26T11:19:26.684536+0000","last_undegraded":"2024-04-26T11:19:26.684536+0000","last_fullsized":"2024-04-26T11:19:26.684536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:57:50.731804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684477+0000","last_change":"2024-04-26T11:19:24.202951+0000","last_active":"2024-04-26T11:19:26.684477+0000","last_peered":"2024-04-26T11:19:26.684477+0000","last_clean":"2024-04-26T11:19:26.684477+0000","last_became_active":"2024-04-26T11:19:24.202566+0000","last_became_peered":"2024-04-26T11:19:24.202566+0000","last_unstale":"2024-04-26T11:19:26.684477+0000","last_undegraded":"2024-04-26T11:19:26.684477+0000","last_fullsized":"2024-04-26T11:19:26.684477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:55.762840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204185+0000","last_change":"2024-04-26T11:19:24.198685+0000","last_active":"2024-04-26T11:19:26.204185+0000","last_peered":"2024-04-26T11:19:26.204185+0000","last_clean":"2024-04-26T11:19:26.204185+0000","last_became_active":"2024-04-26T11:19:24.197383+0000","last_became_peered":"2024-04-26T11:19:24.197383+0000","last_unstale":"2024-04-26T11:19:26.204185+0000","last_undegraded":"2024-04-26T11:19:26.204185+0000","last_fullsized":"2024-04-26T11:19:26.204185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:08:32.146962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204870+0000","last_change":"2024-04-26T11:19:18.181795+0000","last_active":"2024-04-26T11:19:26.204870+0000","last_peered":"2024-04-26T11:19:26.204870+0000","last_clean":"2024-04-26T11:19:26.204870+0000","last_became_active":"2024-04-26T11:19:18.180871+0000","last_became_peered":"2024-04-26T11:19:18.180871+0000","last_unstale":"2024-04-26T11:19:26.204870+0000","last_undegraded":"2024-04-26T11:19:26.204870+0000","last_fullsized":"2024-04-26T11:19:26.204870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:23.698612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204826+0000","last_change":"2024-04-26T11:19:24.200015+0000","last_active":"2024-04-26T11:19:26.204826+0000","last_peered":"2024-04-26T11:19:26.204826+0000","last_clean":"2024-04-26T11:19:26.204826+0000","last_became_active":"2024-04-26T11:19:24.198853+0000","last_became_peered":"2024-04-26T11:19:24.198853+0000","last_unstale":"2024-04-26T11:19:26.204826+0000","last_undegraded":"2024-04-26T11:19:26.204826+0000","last_fullsized":"2024-04-26T11:19:26.204826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:17.832954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210690+0000","last_change":"2024-04-26T11:19:18.182878+0000","last_active":"2024-04-26T11:19:27.210690+0000","last_peered":"2024-04-26T11:19:27.210690+0000","last_clean":"2024-04-26T11:19:27.210690+0000","last_became_active":"2024-04-26T11:19:18.182228+0000","last_became_peered":"2024-04-26T11:19:18.182228+0000","last_unstale":"2024-04-26T11:19:27.210690+0000","last_undegraded":"2024-04-26T11:19:27.210690+0000","last_fullsized":"2024-04-26T11:19:27.210690+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:34.672880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":110,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205075+0000","last_change":"2024-04-26T11:19:18.183238+0000","last_active":"2024-04-26T11:19:26.205075+0000","last_peered":"2024-04-26T11:19:26.205075+0000","last_clean":"2024-04-26T11:19:26.205075+0000","last_became_active":"2024-04-26T11:19:18.182671+0000","last_became_peered":"2024-04-26T11:19:18.182671+0000","last_unstale":"2024-04-26T11:19:26.205075+0000","last_undegraded":"2024-04-26T11:19:26.205075+0000","last_fullsized":"2024-04-26T11:19:26.205075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:49.368568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205360+0000","last_change":"2024-04-26T11:13:12.917812+0000","last_active":"2024-04-26T11:19:26.205360+0000","last_peered":"2024-04-26T11:19:26.205360+0000","last_clean":"2024-04-26T11:19:26.205360+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:19:26.205360+0000","last_undegraded":"2024-04-26T11:19:26.205360+0000","last_fullsized":"2024-04-26T11:19:26.205360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:11:24.951738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205222+0000","last_change":"2024-04-26T11:19:18.188983+0000","last_active":"2024-04-26T11:19:26.205222+0000","last_peered":"2024-04-26T11:19:26.205222+0000","last_clean":"2024-04-26T11:19:26.205222+0000","last_became_active":"2024-04-26T11:19:18.188177+0000","last_became_peered":"2024-04-26T11:19:18.188177+0000","last_unstale":"2024-04-26T11:19:26.205222+0000","last_undegraded":"2024-04-26T11:19:26.205222+0000","last_fullsized":"2024-04-26T11:19:26.205222+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:31.255327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204597+0000","last_change":"2024-04-26T11:19:18.188002+0000","last_active":"2024-04-26T11:19:26.204597+0000","last_peered":"2024-04-26T11:19:26.204597+0000","last_clean":"2024-04-26T11:19:26.204597+0000","last_became_active":"2024-04-26T11:19:18.185372+0000","last_became_peered":"2024-04-26T11:19:18.185372+0000","last_unstale":"2024-04-26T11:19:26.204597+0000","last_undegraded":"2024-04-26T11:19:26.204597+0000","last_fullsized":"2024-04-26T11:19:26.204597+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:04.942442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":108,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205645+0000","last_change":"2024-04-26T11:19:18.190885+0000","last_active":"2024-04-26T11:19:26.205645+0000","last_peered":"2024-04-26T11:19:26.205645+0000","last_clean":"2024-04-26T11:19:26.205645+0000","last_became_active":"2024-04-26T11:19:18.190374+0000","last_became_peered":"2024-04-26T11:19:18.190374+0000","last_unstale":"2024-04-26T11:19:26.205645+0000","last_undegraded":"2024-04-26T11:19:26.205645+0000","last_fullsized":"2024-04-26T11:19:26.205645+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:53.646080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204769+0000","last_change":"2024-04-26T11:19:18.189666+0000","last_active":"2024-04-26T11:19:26.204769+0000","last_peered":"2024-04-26T11:19:26.204769+0000","last_clean":"2024-04-26T11:19:26.204769+0000","last_became_active":"2024-04-26T11:19:18.189341+0000","last_became_peered":"2024-04-26T11:19:18.189341+0000","last_unstale":"2024-04-26T11:19:26.204769+0000","last_undegraded":"2024-04-26T11:19:26.204769+0000","last_fullsized":"2024-04-26T11:19:26.204769+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:52.141583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684494+0000","last_change":"2024-04-26T11:19:24.202866+0000","last_active":"2024-04-26T11:19:26.684494+0000","last_peered":"2024-04-26T11:19:26.684494+0000","last_clean":"2024-04-26T11:19:26.684494+0000","last_became_active":"2024-04-26T11:19:24.202422+0000","last_became_peered":"2024-04-26T11:19:24.202422+0000","last_unstale":"2024-04-26T11:19:26.684494+0000","last_undegraded":"2024-04-26T11:19:26.684494+0000","last_fullsized":"2024-04-26T11:19:26.684494+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:26.564374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205080+0000","last_change":"2024-04-26T11:13:12.917763+0000","last_active":"2024-04-26T11:19:26.205080+0000","last_peered":"2024-04-26T11:19:26.205080+0000","last_clean":"2024-04-26T11:19:26.205080+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:19:26.205080+0000","last_undegraded":"2024-04-26T11:19:26.205080+0000","last_fullsized":"2024-04-26T11:19:26.205080+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:30.764520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204913+0000","last_change":"2024-04-26T11:19:24.205087+0000","last_active":"2024-04-26T11:19:26.204913+0000","last_peered":"2024-04-26T11:19:26.204913+0000","last_clean":"2024-04-26T11:19:26.204913+0000","last_became_active":"2024-04-26T11:19:24.204129+0000","last_became_peered":"2024-04-26T11:19:24.204129+0000","last_unstale":"2024-04-26T11:19:26.204913+0000","last_undegraded":"2024-04-26T11:19:26.204913+0000","last_fullsized":"2024-04-26T11:19:26.204913+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:41:15.916622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204637+0000","last_change":"2024-04-26T11:19:18.189530+0000","last_active":"2024-04-26T11:19:26.204637+0000","last_peered":"2024-04-26T11:19:26.204637+0000","last_clean":"2024-04-26T11:19:26.204637+0000","last_became_active":"2024-04-26T11:19:18.189179+0000","last_became_peered":"2024-04-26T11:19:18.189179+0000","last_unstale":"2024-04-26T11:19:26.204637+0000","last_undegraded":"2024-04-26T11:19:26.204637+0000","last_fullsized":"2024-04-26T11:19:26.204637+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:07:48.132608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.204517+0000","last_change":"2024-04-26T11:19:18.189257+0000","last_active":"2024-04-26T11:19:26.204517+0000","last_peered":"2024-04-26T11:19:26.204517+0000","last_clean":"2024-04-26T11:19:26.204517+0000","last_became_active":"2024-04-26T11:19:18.188963+0000","last_became_peered":"2024-04-26T11:19:18.188963+0000","last_unstale":"2024-04-26T11:19:26.204517+0000","last_undegraded":"2024-04-26T11:19:26.204517+0000","last_fullsized":"2024-04-26T11:19:26.204517+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:25:37.907392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684318+0000","last_change":"2024-04-26T11:19:24.200217+0000","last_active":"2024-04-26T11:19:26.684318+0000","last_peered":"2024-04-26T11:19:26.684318+0000","last_clean":"2024-04-26T11:19:26.684318+0000","last_became_active":"2024-04-26T11:19:24.198397+0000","last_became_peered":"2024-04-26T11:19:24.198397+0000","last_unstale":"2024-04-26T11:19:26.684318+0000","last_undegraded":"2024-04-26T11:19:26.684318+0000","last_fullsized":"2024-04-26T11:19:26.684318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:18:44.576230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210764+0000","last_change":"2024-04-26T11:19:18.183441+0000","last_active":"2024-04-26T11:19:27.210764+0000","last_peered":"2024-04-26T11:19:27.210764+0000","last_clean":"2024-04-26T11:19:27.210764+0000","last_became_active":"2024-04-26T11:19:18.183037+0000","last_became_peered":"2024-04-26T11:19:18.183037+0000","last_unstale":"2024-04-26T11:19:27.210764+0000","last_undegraded":"2024-04-26T11:19:27.210764+0000","last_fullsized":"2024-04-26T11:19:27.210764+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:32.597584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.684386+0000","last_change":"2024-04-26T11:19:24.203647+0000","last_active":"2024-04-26T11:19:26.684386+0000","last_peered":"2024-04-26T11:19:26.684386+0000","last_clean":"2024-04-26T11:19:26.684386+0000","last_became_active":"2024-04-26T11:19:24.202442+0000","last_became_peered":"2024-04-26T11:19:24.202442+0000","last_unstale":"2024-04-26T11:19:26.684386+0000","last_undegraded":"2024-04-26T11:19:26.684386+0000","last_fullsized":"2024-04-26T11:19:26.684386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:07:21.883832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":105,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T11:19:26.205445+0000","last_change":"2024-04-26T11:19:18.184719+0000","last_active":"2024-04-26T11:19:26.205445+0000","last_peered":"2024-04-26T11:19:26.205445+0000","last_clean":"2024-04-26T11:19:26.205445+0000","last_became_active":"2024-04-26T11:19:18.184384+0000","last_became_peered":"2024-04-26T11:19:18.184384+0000","last_unstale":"2024-04-26T11:19:26.205445+0000","last_undegraded":"2024-04-26T11:19:26.205445+0000","last_fullsized":"2024-04-26T11:19:26.205445+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:37.130545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7958,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738448,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281152,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94090688,"statfs":{"total":96636764160,"available":96348864512,"internally_reserved":0,"allocated":1490944,"data_stored":947441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Fri Apr 26 11:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45800000000000002,"15min":0.39600000000000002},"min":{"1min":0.34399999999999997,"5min":0.17999999999999999,"15min":0.17199999999999999},"max":{"1min":0.68100000000000005,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.316,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.66400000000000003,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.55400000000000005}]}]},{"osd":0,"up_from":75,"seq":322122547205,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38160,"kb_used_data":1468,"kb_used_omap":10,"kb_used_meta":36661,"kb_avail":94333680,"statfs":{"total":96636764160,"available":96597688320,"internally_reserved":0,"allocated":1503232,"data_stored":949168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11228,"internal_metadata":37540900},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738449,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401140,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":400254,"kb_avail":93970700,"statfs":{"total":96636764160,"available":96225996800,"internally_reserved":0,"allocated":884736,"data_stored":357054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":409860550},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Apr 26 11:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.44700000000000001,"15min":0.40699999999999997},"min":{"1min":0.34999999999999998,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.69199999999999995,"5min":2.056,"15min":2.056},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.499,"15min":0.46400000000000002},"min":{"1min":0.376,"5min":0.193,"15min":0.193},"max":{"1min":0.67600000000000005,"5min":3.9609999999999999,"15min":3.9609999999999999},"last":0.33000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7958,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:19:35.653 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.654 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.654 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.654 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.654 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.654 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.654 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.654 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.654 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.654 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.655 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.655 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.655 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.655 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.655 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.655 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.655 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.655 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.655 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.656 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.656 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.656 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.656 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.656 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.656 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.656 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.656 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.656 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.656 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.657 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.657 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.657 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.657 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.657 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.657 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.657 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.657 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.657 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.657 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.658 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.658 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.658 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.658 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.658 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.658 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.658 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.658 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.658 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.658 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.659 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.659 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.659 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.659 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.659 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.659 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.659 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.659 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.659 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.659 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.660 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.660 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.660 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.660 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.660 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.660 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.660 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.660 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.660 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.660 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.661 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.661 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.661 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.661 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.661 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.661 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.661 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.661 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.661 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.662 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.662 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.662 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.662 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.662 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.662 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.662 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.662 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.663 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.663 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.663 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.663 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.663 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.663 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.663 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.663 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.663 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.663 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.664 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.664 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.664 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.664 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.664 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.664 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.664 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.664 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.664 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:35.665 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T11:19:55.666 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:19:56.028 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:19:56.030 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:19:56.039 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2024-04-26T11:19:54.567087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":198,"ondisk_log_size":198,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":720420,"kb_used_data":3788,"kb_used_omap":14,"kb_used_meta":716593,"kb_avail":282395100,"statfs":{"total":289910292480,"available":289172582400,"internally_reserved":0,"allocated":3878912,"data_stored":2253663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14416,"internal_metadata":733792176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003022"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:31.632644+0000","last_change":"2024-04-26T11:13:12.919196+0000","last_active":"2024-04-26T11:19:31.632644+0000","last_peered":"2024-04-26T11:19:31.632644+0000","last_clean":"2024-04-26T11:19:31.632644+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:19:31.632644+0000","last_undegraded":"2024-04-26T11:19:31.632644+0000","last_fullsized":"2024-04-26T11:19:31.632644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:31.632604+0000","last_change":"2024-04-26T11:13:12.917670+0000","last_active":"2024-04-26T11:19:31.632604+0000","last_peered":"2024-04-26T11:19:31.632604+0000","last_clean":"2024-04-26T11:19:31.632604+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:19:31.632604+0000","last_undegraded":"2024-04-26T11:19:31.632604+0000","last_fullsized":"2024-04-26T11:19:31.632604+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211220+0000","last_change":"2024-04-26T11:19:18.185209+0000","last_active":"2024-04-26T11:19:27.211220+0000","last_peered":"2024-04-26T11:19:27.211220+0000","last_clean":"2024-04-26T11:19:27.211220+0000","last_became_active":"2024-04-26T11:19:18.182972+0000","last_became_peered":"2024-04-26T11:19:18.182972+0000","last_unstale":"2024-04-26T11:19:27.211220+0000","last_undegraded":"2024-04-26T11:19:27.211220+0000","last_fullsized":"2024-04-26T11:19:27.211220+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210609+0000","last_change":"2024-04-26T11:19:18.183286+0000","last_active":"2024-04-26T11:19:27.210609+0000","last_peered":"2024-04-26T11:19:27.210609+0000","last_clean":"2024-04-26T11:19:27.210609+0000","last_became_active":"2024-04-26T11:19:18.182942+0000","last_became_peered":"2024-04-26T11:19:18.182942+0000","last_unstale":"2024-04-26T11:19:27.210609+0000","last_undegraded":"2024-04-26T11:19:27.210609+0000","last_fullsized":"2024-04-26T11:19:27.210609+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:50.417947+0000","last_change":"2024-04-26T11:19:50.418051+0000","last_active":"2024-04-26T11:19:50.417947+0000","last_peered":"2024-04-26T11:19:50.417947+0000","last_clean":"2024-04-26T11:19:50.417947+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:19:50.417947+0000","last_undegraded":"2024-04-26T11:19:50.417947+0000","last_fullsized":"2024-04-26T11:19:50.417947+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:50.417924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:50.417924+0000","last_clean_scrub_stamp":"2024-04-26T11:19:50.417924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:25.937563+0000","scrub_duration":0.016392371999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210596+0000","last_change":"2024-04-26T11:19:18.189355+0000","last_active":"2024-04-26T11:19:27.210596+0000","last_peered":"2024-04-26T11:19:27.210596+0000","last_clean":"2024-04-26T11:19:27.210596+0000","last_became_active":"2024-04-26T11:19:18.188990+0000","last_became_peered":"2024-04-26T11:19:18.188990+0000","last_unstale":"2024-04-26T11:19:27.210596+0000","last_undegraded":"2024-04-26T11:19:27.210596+0000","last_fullsized":"2024-04-26T11:19:27.210596+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:45.509116+0000","last_change":"2024-04-26T11:19:45.509220+0000","last_active":"2024-04-26T11:19:45.509116+0000","last_peered":"2024-04-26T11:19:45.509116+0000","last_clean":"2024-04-26T11:19:45.509116+0000","last_became_active":"2024-04-26T11:19:18.186638+0000","last_became_peered":"2024-04-26T11:19:18.186638+0000","last_unstale":"2024-04-26T11:19:45.509116+0000","last_undegraded":"2024-04-26T11:19:45.509116+0000","last_fullsized":"2024-04-26T11:19:45.509116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:45.509090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:45.509090+0000","last_clean_scrub_stamp":"2024-04-26T11:19:45.509090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:05.567613+0000","scrub_duration":0.017637363999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210059+0000","last_change":"2024-04-26T11:19:18.183968+0000","last_active":"2024-04-26T11:19:27.210059+0000","last_peered":"2024-04-26T11:19:27.210059+0000","last_clean":"2024-04-26T11:19:27.210059+0000","last_became_active":"2024-04-26T11:19:18.182111+0000","last_became_peered":"2024-04-26T11:19:18.182111+0000","last_unstale":"2024-04-26T11:19:27.210059+0000","last_undegraded":"2024-04-26T11:19:27.210059+0000","last_fullsized":"2024-04-26T11:19:27.210059+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210559+0000","last_change":"2024-04-26T11:19:24.202861+0000","last_active":"2024-04-26T11:19:27.210559+0000","last_peered":"2024-04-26T11:19:27.210559+0000","last_clean":"2024-04-26T11:19:27.210559+0000","last_became_active":"2024-04-26T11:19:24.202146+0000","last_became_peered":"2024-04-26T11:19:24.202146+0000","last_unstale":"2024-04-26T11:19:27.210559+0000","last_undegraded":"2024-04-26T11:19:27.210559+0000","last_fullsized":"2024-04-26T11:19:27.210559+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211285+0000","last_change":"2024-04-26T11:13:12.918521+0000","last_active":"2024-04-26T11:19:27.211285+0000","last_peered":"2024-04-26T11:19:27.211285+0000","last_clean":"2024-04-26T11:19:27.211285+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:19:27.211285+0000","last_undegraded":"2024-04-26T11:19:27.211285+0000","last_fullsized":"2024-04-26T11:19:27.211285+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210879+0000","last_change":"2024-04-26T11:19:18.187027+0000","last_active":"2024-04-26T11:19:27.210879+0000","last_peered":"2024-04-26T11:19:27.210879+0000","last_clean":"2024-04-26T11:19:27.210879+0000","last_became_active":"2024-04-26T11:19:18.185543+0000","last_became_peered":"2024-04-26T11:19:18.185543+0000","last_unstale":"2024-04-26T11:19:27.210879+0000","last_undegraded":"2024-04-26T11:19:27.210879+0000","last_fullsized":"2024-04-26T11:19:27.210879+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210717+0000","last_change":"2024-04-26T11:19:18.183459+0000","last_active":"2024-04-26T11:19:27.210717+0000","last_peered":"2024-04-26T11:19:27.210717+0000","last_clean":"2024-04-26T11:19:27.210717+0000","last_became_active":"2024-04-26T11:19:18.182827+0000","last_became_peered":"2024-04-26T11:19:18.182827+0000","last_unstale":"2024-04-26T11:19:27.210717+0000","last_undegraded":"2024-04-26T11:19:27.210717+0000","last_fullsized":"2024-04-26T11:19:27.210717+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.499056+0000","last_change":"2024-04-26T11:19:35.499190+0000","last_active":"2024-04-26T11:19:35.499056+0000","last_peered":"2024-04-26T11:19:35.499056+0000","last_clean":"2024-04-26T11:19:35.499056+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:19:35.499056+0000","last_undegraded":"2024-04-26T11:19:35.499056+0000","last_fullsized":"2024-04-26T11:19:35.499056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:35.499030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:35.499030+0000","last_clean_scrub_stamp":"2024-04-26T11:19:35.499030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:49.185477+0000","scrub_duration":0.018123878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:41.593903+0000","last_change":"2024-04-26T11:19:41.594000+0000","last_active":"2024-04-26T11:19:41.593903+0000","last_peered":"2024-04-26T11:19:41.593903+0000","last_clean":"2024-04-26T11:19:41.593903+0000","last_became_active":"2024-04-26T11:19:18.180865+0000","last_became_peered":"2024-04-26T11:19:18.180865+0000","last_unstale":"2024-04-26T11:19:41.593903+0000","last_undegraded":"2024-04-26T11:19:41.593903+0000","last_fullsized":"2024-04-26T11:19:41.593903+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:41.593880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:41.593880+0000","last_clean_scrub_stamp":"2024-04-26T11:19:41.593880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:56.201582+0000","scrub_duration":0.0019243019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210340+0000","last_change":"2024-04-26T11:19:18.181625+0000","last_active":"2024-04-26T11:19:27.210340+0000","last_peered":"2024-04-26T11:19:27.210340+0000","last_clean":"2024-04-26T11:19:27.210340+0000","last_became_active":"2024-04-26T11:19:18.180763+0000","last_became_peered":"2024-04-26T11:19:18.180763+0000","last_unstale":"2024-04-26T11:19:27.210340+0000","last_undegraded":"2024-04-26T11:19:27.210340+0000","last_fullsized":"2024-04-26T11:19:27.210340+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210344+0000","last_change":"2024-04-26T11:19:18.185161+0000","last_active":"2024-04-26T11:19:27.210344+0000","last_peered":"2024-04-26T11:19:27.210344+0000","last_clean":"2024-04-26T11:19:27.210344+0000","last_became_active":"2024-04-26T11:19:18.184331+0000","last_became_peered":"2024-04-26T11:19:18.184331+0000","last_unstale":"2024-04-26T11:19:27.210344+0000","last_undegraded":"2024-04-26T11:19:27.210344+0000","last_fullsized":"2024-04-26T11:19:27.210344+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210548+0000","last_change":"2024-04-26T11:19:24.204827+0000","last_active":"2024-04-26T11:19:27.210548+0000","last_peered":"2024-04-26T11:19:27.210548+0000","last_clean":"2024-04-26T11:19:27.210548+0000","last_became_active":"2024-04-26T11:19:24.203764+0000","last_became_peered":"2024-04-26T11:19:24.203764+0000","last_unstale":"2024-04-26T11:19:27.210548+0000","last_undegraded":"2024-04-26T11:19:27.210548+0000","last_fullsized":"2024-04-26T11:19:27.210548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:43.423642+0000","last_change":"2024-04-26T11:19:43.423762+0000","last_active":"2024-04-26T11:19:43.423642+0000","last_peered":"2024-04-26T11:19:43.423642+0000","last_clean":"2024-04-26T11:19:43.423642+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:19:43.423642+0000","last_undegraded":"2024-04-26T11:19:43.423642+0000","last_fullsized":"2024-04-26T11:19:43.423642+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:43.423617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:43.423617+0000","last_clean_scrub_stamp":"2024-04-26T11:19:43.423617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:58.420909+0000","scrub_duration":0.0017194790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210305+0000","last_change":"2024-04-26T11:19:24.200114+0000","last_active":"2024-04-26T11:19:27.210305+0000","last_peered":"2024-04-26T11:19:27.210305+0000","last_clean":"2024-04-26T11:19:27.210305+0000","last_became_active":"2024-04-26T11:19:24.199142+0000","last_became_peered":"2024-04-26T11:19:24.199142+0000","last_unstale":"2024-04-26T11:19:27.210305+0000","last_undegraded":"2024-04-26T11:19:27.210305+0000","last_fullsized":"2024-04-26T11:19:27.210305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:42.569786+0000","last_change":"2024-04-26T11:19:42.569936+0000","last_active":"2024-04-26T11:19:42.569786+0000","last_peered":"2024-04-26T11:19:42.569786+0000","last_clean":"2024-04-26T11:19:42.569786+0000","last_became_active":"2024-04-26T11:19:18.184282+0000","last_became_peered":"2024-04-26T11:19:18.184282+0000","last_unstale":"2024-04-26T11:19:42.569786+0000","last_undegraded":"2024-04-26T11:19:42.569786+0000","last_fullsized":"2024-04-26T11:19:42.569786+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:42.569760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:42.569760+0000","last_clean_scrub_stamp":"2024-04-26T11:19:42.569760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:17.239747+0000","scrub_duration":0.0018614059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210780+0000","last_change":"2024-04-26T11:19:18.187937+0000","last_active":"2024-04-26T11:19:27.210780+0000","last_peered":"2024-04-26T11:19:27.210780+0000","last_clean":"2024-04-26T11:19:27.210780+0000","last_became_active":"2024-04-26T11:19:18.186605+0000","last_became_peered":"2024-04-26T11:19:18.186605+0000","last_unstale":"2024-04-26T11:19:27.210780+0000","last_undegraded":"2024-04-26T11:19:27.210780+0000","last_fullsized":"2024-04-26T11:19:27.210780+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210637+0000","last_change":"2024-04-26T11:19:18.182666+0000","last_active":"2024-04-26T11:19:27.210637+0000","last_peered":"2024-04-26T11:19:27.210637+0000","last_clean":"2024-04-26T11:19:27.210637+0000","last_became_active":"2024-04-26T11:19:18.181728+0000","last_became_peered":"2024-04-26T11:19:18.181728+0000","last_unstale":"2024-04-26T11:19:27.210637+0000","last_undegraded":"2024-04-26T11:19:27.210637+0000","last_fullsized":"2024-04-26T11:19:27.210637+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.209739+0000","last_change":"2024-04-26T11:19:24.198562+0000","last_active":"2024-04-26T11:19:27.209739+0000","last_peered":"2024-04-26T11:19:27.209739+0000","last_clean":"2024-04-26T11:19:27.209739+0000","last_became_active":"2024-04-26T11:19:24.197487+0000","last_became_peered":"2024-04-26T11:19:24.197487+0000","last_unstale":"2024-04-26T11:19:27.209739+0000","last_undegraded":"2024-04-26T11:19:27.209739+0000","last_fullsized":"2024-04-26T11:19:27.209739+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:48.396499+0000","last_change":"2024-04-26T11:19:48.396656+0000","last_active":"2024-04-26T11:19:48.396499+0000","last_peered":"2024-04-26T11:19:48.396499+0000","last_clean":"2024-04-26T11:19:48.396499+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:19:48.396499+0000","last_undegraded":"2024-04-26T11:19:48.396499+0000","last_fullsized":"2024-04-26T11:19:48.396499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:48.396472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:48.396472+0000","last_clean_scrub_stamp":"2024-04-26T11:19:48.396472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:16.773782+0000","scrub_duration":0.0019312940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":107,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.271864+0000","last_change":"2024-04-26T11:19:18.184692+0000","last_active":"2024-04-26T11:19:35.271864+0000","last_peered":"2024-04-26T11:19:35.271864+0000","last_clean":"2024-04-26T11:19:35.271864+0000","last_became_active":"2024-04-26T11:19:18.184451+0000","last_became_peered":"2024-04-26T11:19:18.184451+0000","last_unstale":"2024-04-26T11:19:35.271864+0000","last_undegraded":"2024-04-26T11:19:35.271864+0000","last_fullsized":"2024-04-26T11:19:35.271864+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:34.751296+0000","last_change":"2024-04-26T11:19:24.199954+0000","last_active":"2024-04-26T11:19:34.751296+0000","last_peered":"2024-04-26T11:19:34.751296+0000","last_clean":"2024-04-26T11:19:34.751296+0000","last_became_active":"2024-04-26T11:19:24.198479+0000","last_became_peered":"2024-04-26T11:19:24.198479+0000","last_unstale":"2024-04-26T11:19:34.751296+0000","last_undegraded":"2024-04-26T11:19:34.751296+0000","last_fullsized":"2024-04-26T11:19:34.751296+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211020+0000","last_change":"2024-04-26T11:19:18.185709+0000","last_active":"2024-04-26T11:19:27.211020+0000","last_peered":"2024-04-26T11:19:27.211020+0000","last_clean":"2024-04-26T11:19:27.211020+0000","last_became_active":"2024-04-26T11:19:18.185105+0000","last_became_peered":"2024-04-26T11:19:18.185105+0000","last_unstale":"2024-04-26T11:19:27.211020+0000","last_undegraded":"2024-04-26T11:19:27.211020+0000","last_fullsized":"2024-04-26T11:19:27.211020+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210480+0000","last_change":"2024-04-26T11:13:12.493425+0000","last_active":"2024-04-26T11:19:27.210480+0000","last_peered":"2024-04-26T11:19:27.210480+0000","last_clean":"2024-04-26T11:19:27.210480+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:19:27.210480+0000","last_undegraded":"2024-04-26T11:19:27.210480+0000","last_fullsized":"2024-04-26T11:19:27.210480+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211182+0000","last_change":"2024-04-26T11:19:18.191042+0000","last_active":"2024-04-26T11:19:27.211182+0000","last_peered":"2024-04-26T11:19:27.211182+0000","last_clean":"2024-04-26T11:19:27.211182+0000","last_became_active":"2024-04-26T11:19:18.190792+0000","last_became_peered":"2024-04-26T11:19:18.190792+0000","last_unstale":"2024-04-26T11:19:27.211182+0000","last_undegraded":"2024-04-26T11:19:27.211182+0000","last_fullsized":"2024-04-26T11:19:27.211182+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":67,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.667261+0000","last_change":"2024-04-26T11:19:35.667355+0000","last_active":"2024-04-26T11:19:35.667261+0000","last_peered":"2024-04-26T11:19:35.667261+0000","last_clean":"2024-04-26T11:19:35.667261+0000","last_became_active":"2024-04-26T11:19:24.202348+0000","last_became_peered":"2024-04-26T11:19:24.202348+0000","last_unstale":"2024-04-26T11:19:35.667261+0000","last_undegraded":"2024-04-26T11:19:35.667261+0000","last_fullsized":"2024-04-26T11:19:35.667261+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:35.667237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:35.667237+0000","last_clean_scrub_stamp":"2024-04-26T11:19:35.667237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:38.776469+0000","scrub_duration":0.0019697669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:44.766975+0000","last_change":"2024-04-26T11:19:44.767086+0000","last_active":"2024-04-26T11:19:44.766975+0000","last_peered":"2024-04-26T11:19:44.766975+0000","last_clean":"2024-04-26T11:19:44.766975+0000","last_became_active":"2024-04-26T11:19:24.198920+0000","last_became_peered":"2024-04-26T11:19:24.198920+0000","last_unstale":"2024-04-26T11:19:44.766975+0000","last_undegraded":"2024-04-26T11:19:44.766975+0000","last_fullsized":"2024-04-26T11:19:44.766975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:44.766950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:44.766950+0000","last_clean_scrub_stamp":"2024-04-26T11:19:44.766950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:30.054801+0000","scrub_duration":0.0017451579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.209812+0000","last_change":"2024-04-26T11:19:24.199051+0000","last_active":"2024-04-26T11:19:27.209812+0000","last_peered":"2024-04-26T11:19:27.209812+0000","last_clean":"2024-04-26T11:19:27.209812+0000","last_became_active":"2024-04-26T11:19:24.197698+0000","last_became_peered":"2024-04-26T11:19:24.197698+0000","last_unstale":"2024-04-26T11:19:27.209812+0000","last_undegraded":"2024-04-26T11:19:27.209812+0000","last_fullsized":"2024-04-26T11:19:27.209812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:47.503571+0000","last_change":"2024-04-26T11:19:47.503709+0000","last_active":"2024-04-26T11:19:47.503571+0000","last_peered":"2024-04-26T11:19:47.503571+0000","last_clean":"2024-04-26T11:19:47.503571+0000","last_became_active":"2024-04-26T11:19:18.190127+0000","last_became_peered":"2024-04-26T11:19:18.190127+0000","last_unstale":"2024-04-26T11:19:47.503571+0000","last_undegraded":"2024-04-26T11:19:47.503571+0000","last_fullsized":"2024-04-26T11:19:47.503571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:47.503550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:47.503550+0000","last_clean_scrub_stamp":"2024-04-26T11:19:47.503550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:33.423364+0000","scrub_duration":0.064283446999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210736+0000","last_change":"2024-04-26T11:19:24.205086+0000","last_active":"2024-04-26T11:19:27.210736+0000","last_peered":"2024-04-26T11:19:27.210736+0000","last_clean":"2024-04-26T11:19:27.210736+0000","last_became_active":"2024-04-26T11:19:24.204122+0000","last_became_peered":"2024-04-26T11:19:24.204122+0000","last_unstale":"2024-04-26T11:19:27.210736+0000","last_undegraded":"2024-04-26T11:19:27.210736+0000","last_fullsized":"2024-04-26T11:19:27.210736+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.209673+0000","last_change":"2024-04-26T11:19:24.198434+0000","last_active":"2024-04-26T11:19:27.209673+0000","last_peered":"2024-04-26T11:19:27.209673+0000","last_clean":"2024-04-26T11:19:27.209673+0000","last_became_active":"2024-04-26T11:19:24.197247+0000","last_became_peered":"2024-04-26T11:19:24.197247+0000","last_unstale":"2024-04-26T11:19:27.209673+0000","last_undegraded":"2024-04-26T11:19:27.209673+0000","last_fullsized":"2024-04-26T11:19:27.209673+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211069+0000","last_change":"2024-04-26T11:19:18.187720+0000","last_active":"2024-04-26T11:19:27.211069+0000","last_peered":"2024-04-26T11:19:27.211069+0000","last_clean":"2024-04-26T11:19:27.211069+0000","last_became_active":"2024-04-26T11:19:18.185578+0000","last_became_peered":"2024-04-26T11:19:18.185578+0000","last_unstale":"2024-04-26T11:19:27.211069+0000","last_undegraded":"2024-04-26T11:19:27.211069+0000","last_fullsized":"2024-04-26T11:19:27.211069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210035+0000","last_change":"2024-04-26T11:19:24.201728+0000","last_active":"2024-04-26T11:19:27.210035+0000","last_peered":"2024-04-26T11:19:27.210035+0000","last_clean":"2024-04-26T11:19:27.210035+0000","last_became_active":"2024-04-26T11:19:24.200992+0000","last_became_peered":"2024-04-26T11:19:24.200992+0000","last_unstale":"2024-04-26T11:19:27.210035+0000","last_undegraded":"2024-04-26T11:19:27.210035+0000","last_fullsized":"2024-04-26T11:19:27.210035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":110,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211061+0000","last_change":"2024-04-26T11:19:18.190998+0000","last_active":"2024-04-26T11:19:27.211061+0000","last_peered":"2024-04-26T11:19:27.211061+0000","last_clean":"2024-04-26T11:19:27.211061+0000","last_became_active":"2024-04-26T11:19:18.190381+0000","last_became_peered":"2024-04-26T11:19:18.190381+0000","last_unstale":"2024-04-26T11:19:27.211061+0000","last_undegraded":"2024-04-26T11:19:27.211061+0000","last_fullsized":"2024-04-26T11:19:27.211061+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:51.669025+0000","last_change":"2024-04-26T11:19:51.669122+0000","last_active":"2024-04-26T11:19:51.669025+0000","last_peered":"2024-04-26T11:19:51.669025+0000","last_clean":"2024-04-26T11:19:51.669025+0000","last_became_active":"2024-04-26T11:19:24.199659+0000","last_became_peered":"2024-04-26T11:19:24.199659+0000","last_unstale":"2024-04-26T11:19:51.669025+0000","last_undegraded":"2024-04-26T11:19:51.669025+0000","last_fullsized":"2024-04-26T11:19:51.669025+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:51.668999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:51.668999+0000","last_clean_scrub_stamp":"2024-04-26T11:19:51.668999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:13.870535+0000","scrub_duration":0.001713553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210756+0000","last_change":"2024-04-26T11:19:18.181316+0000","last_active":"2024-04-26T11:19:27.210756+0000","last_peered":"2024-04-26T11:19:27.210756+0000","last_clean":"2024-04-26T11:19:27.210756+0000","last_became_active":"2024-04-26T11:19:18.180711+0000","last_became_peered":"2024-04-26T11:19:18.180711+0000","last_unstale":"2024-04-26T11:19:27.210756+0000","last_undegraded":"2024-04-26T11:19:27.210756+0000","last_fullsized":"2024-04-26T11:19:27.210756+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210856+0000","last_change":"2024-04-26T11:19:18.182026+0000","last_active":"2024-04-26T11:19:27.210856+0000","last_peered":"2024-04-26T11:19:27.210856+0000","last_clean":"2024-04-26T11:19:27.210856+0000","last_became_active":"2024-04-26T11:19:18.181615+0000","last_became_peered":"2024-04-26T11:19:18.181615+0000","last_unstale":"2024-04-26T11:19:27.210856+0000","last_undegraded":"2024-04-26T11:19:27.210856+0000","last_fullsized":"2024-04-26T11:19:27.210856+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210343+0000","last_change":"2024-04-26T11:19:18.185625+0000","last_active":"2024-04-26T11:19:27.210343+0000","last_peered":"2024-04-26T11:19:27.210343+0000","last_clean":"2024-04-26T11:19:27.210343+0000","last_became_active":"2024-04-26T11:19:18.183103+0000","last_became_peered":"2024-04-26T11:19:18.183103+0000","last_unstale":"2024-04-26T11:19:27.210343+0000","last_undegraded":"2024-04-26T11:19:27.210343+0000","last_fullsized":"2024-04-26T11:19:27.210343+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210858+0000","last_change":"2024-04-26T11:13:12.916685+0000","last_active":"2024-04-26T11:19:27.210858+0000","last_peered":"2024-04-26T11:19:27.210858+0000","last_clean":"2024-04-26T11:19:27.210858+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:19:27.210858+0000","last_undegraded":"2024-04-26T11:19:27.210858+0000","last_fullsized":"2024-04-26T11:19:27.210858+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210009+0000","last_change":"2024-04-26T11:19:24.199114+0000","last_active":"2024-04-26T11:19:27.210009+0000","last_peered":"2024-04-26T11:19:27.210009+0000","last_clean":"2024-04-26T11:19:27.210009+0000","last_became_active":"2024-04-26T11:19:24.197647+0000","last_became_peered":"2024-04-26T11:19:24.197647+0000","last_unstale":"2024-04-26T11:19:27.210009+0000","last_undegraded":"2024-04-26T11:19:27.210009+0000","last_fullsized":"2024-04-26T11:19:27.210009+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:49.457951+0000","last_change":"2024-04-26T11:19:49.458065+0000","last_active":"2024-04-26T11:19:49.457951+0000","last_peered":"2024-04-26T11:19:49.457951+0000","last_clean":"2024-04-26T11:19:49.457951+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:19:49.457951+0000","last_undegraded":"2024-04-26T11:19:49.457951+0000","last_fullsized":"2024-04-26T11:19:49.457951+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:49.457903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:49.457903+0000","last_clean_scrub_stamp":"2024-04-26T11:19:49.457903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:29.600094+0000","scrub_duration":0.017036468999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":107,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210490+0000","last_change":"2024-04-26T11:19:18.182547+0000","last_active":"2024-04-26T11:19:27.210490+0000","last_peered":"2024-04-26T11:19:27.210490+0000","last_clean":"2024-04-26T11:19:27.210490+0000","last_became_active":"2024-04-26T11:19:18.181907+0000","last_became_peered":"2024-04-26T11:19:18.181907+0000","last_unstale":"2024-04-26T11:19:27.210490+0000","last_undegraded":"2024-04-26T11:19:27.210490+0000","last_fullsized":"2024-04-26T11:19:27.210490+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210680+0000","last_change":"2024-04-26T11:19:24.201756+0000","last_active":"2024-04-26T11:19:27.210680+0000","last_peered":"2024-04-26T11:19:27.210680+0000","last_clean":"2024-04-26T11:19:27.210680+0000","last_became_active":"2024-04-26T11:19:24.201114+0000","last_became_peered":"2024-04-26T11:19:24.201114+0000","last_unstale":"2024-04-26T11:19:27.210680+0000","last_undegraded":"2024-04-26T11:19:27.210680+0000","last_fullsized":"2024-04-26T11:19:27.210680+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210463+0000","last_change":"2024-04-26T11:19:18.182797+0000","last_active":"2024-04-26T11:19:27.210463+0000","last_peered":"2024-04-26T11:19:27.210463+0000","last_clean":"2024-04-26T11:19:27.210463+0000","last_became_active":"2024-04-26T11:19:18.182017+0000","last_became_peered":"2024-04-26T11:19:18.182017+0000","last_unstale":"2024-04-26T11:19:27.210463+0000","last_undegraded":"2024-04-26T11:19:27.210463+0000","last_fullsized":"2024-04-26T11:19:27.210463+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210787+0000","last_change":"2024-04-26T11:19:24.205310+0000","last_active":"2024-04-26T11:19:27.210787+0000","last_peered":"2024-04-26T11:19:27.210787+0000","last_clean":"2024-04-26T11:19:27.210787+0000","last_became_active":"2024-04-26T11:19:24.204476+0000","last_became_peered":"2024-04-26T11:19:24.204476+0000","last_unstale":"2024-04-26T11:19:27.210787+0000","last_undegraded":"2024-04-26T11:19:27.210787+0000","last_fullsized":"2024-04-26T11:19:27.210787+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"82'2","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:44.505106+0000","last_change":"2024-04-26T11:19:44.505212+0000","last_active":"2024-04-26T11:19:44.505106+0000","last_peered":"2024-04-26T11:19:44.505106+0000","last_clean":"2024-04-26T11:19:44.505106+0000","last_became_active":"2024-04-26T11:19:18.181604+0000","last_became_peered":"2024-04-26T11:19:18.181604+0000","last_unstale":"2024-04-26T11:19:44.505106+0000","last_undegraded":"2024-04-26T11:19:44.505106+0000","last_fullsized":"2024-04-26T11:19:44.505106+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-26T11:19:44.505080+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-26T11:19:44.505080+0000","last_clean_scrub_stamp":"2024-04-26T11:19:44.505080+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:07.623145+0000","scrub_duration":0.0032804549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:36.457819+0000","last_change":"2024-04-26T11:19:36.457819+0000","last_active":"2024-04-26T11:19:36.457819+0000","last_peered":"2024-04-26T11:19:36.457819+0000","last_clean":"2024-04-26T11:19:36.457819+0000","last_became_active":"2024-04-26T11:19:18.181462+0000","last_became_peered":"2024-04-26T11:19:18.181462+0000","last_unstale":"2024-04-26T11:19:36.457819+0000","last_undegraded":"2024-04-26T11:19:36.457819+0000","last_fullsized":"2024-04-26T11:19:36.457819+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:36.457692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:36.457692+0000","last_clean_scrub_stamp":"2024-04-26T11:19:36.457692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:46.158550+0000","scrub_duration":0.0018253519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211151+0000","last_change":"2024-04-26T11:19:18.183263+0000","last_active":"2024-04-26T11:19:27.211151+0000","last_peered":"2024-04-26T11:19:27.211151+0000","last_clean":"2024-04-26T11:19:27.211151+0000","last_became_active":"2024-04-26T11:19:18.182242+0000","last_became_peered":"2024-04-26T11:19:18.182242+0000","last_unstale":"2024-04-26T11:19:27.211151+0000","last_undegraded":"2024-04-26T11:19:27.211151+0000","last_fullsized":"2024-04-26T11:19:27.211151+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.271811+0000","last_change":"2024-04-26T11:13:12.912207+0000","last_active":"2024-04-26T11:19:35.271811+0000","last_peered":"2024-04-26T11:19:35.271811+0000","last_clean":"2024-04-26T11:19:35.271811+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:19:35.271811+0000","last_undegraded":"2024-04-26T11:19:35.271811+0000","last_fullsized":"2024-04-26T11:19:35.271811+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210716+0000","last_change":"2024-04-26T11:19:18.181652+0000","last_active":"2024-04-26T11:19:27.210716+0000","last_peered":"2024-04-26T11:19:27.210716+0000","last_clean":"2024-04-26T11:19:27.210716+0000","last_became_active":"2024-04-26T11:19:18.180506+0000","last_became_peered":"2024-04-26T11:19:18.180506+0000","last_unstale":"2024-04-26T11:19:27.210716+0000","last_undegraded":"2024-04-26T11:19:27.210716+0000","last_fullsized":"2024-04-26T11:19:27.210716+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:50.503948+0000","last_change":"2024-04-26T11:19:50.504053+0000","last_active":"2024-04-26T11:19:50.503948+0000","last_peered":"2024-04-26T11:19:50.503948+0000","last_clean":"2024-04-26T11:19:50.503948+0000","last_became_active":"2024-04-26T11:19:18.185355+0000","last_became_peered":"2024-04-26T11:19:18.185355+0000","last_unstale":"2024-04-26T11:19:50.503948+0000","last_undegraded":"2024-04-26T11:19:50.503948+0000","last_fullsized":"2024-04-26T11:19:50.503948+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:50.503924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:50.503924+0000","last_clean_scrub_stamp":"2024-04-26T11:19:50.503924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:15.276373+0000","scrub_duration":0.001850661,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210867+0000","last_change":"2024-04-26T11:19:18.188150+0000","last_active":"2024-04-26T11:19:27.210867+0000","last_peered":"2024-04-26T11:19:27.210867+0000","last_clean":"2024-04-26T11:19:27.210867+0000","last_became_active":"2024-04-26T11:19:18.186342+0000","last_became_peered":"2024-04-26T11:19:18.186342+0000","last_unstale":"2024-04-26T11:19:27.210867+0000","last_undegraded":"2024-04-26T11:19:27.210867+0000","last_fullsized":"2024-04-26T11:19:27.210867+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210317+0000","last_change":"2024-04-26T11:19:24.201645+0000","last_active":"2024-04-26T11:19:27.210317+0000","last_peered":"2024-04-26T11:19:27.210317+0000","last_clean":"2024-04-26T11:19:27.210317+0000","last_became_active":"2024-04-26T11:19:24.201330+0000","last_became_peered":"2024-04-26T11:19:24.201330+0000","last_unstale":"2024-04-26T11:19:27.210317+0000","last_undegraded":"2024-04-26T11:19:27.210317+0000","last_fullsized":"2024-04-26T11:19:27.210317+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210197+0000","last_change":"2024-04-26T11:19:24.201672+0000","last_active":"2024-04-26T11:19:27.210197+0000","last_peered":"2024-04-26T11:19:27.210197+0000","last_clean":"2024-04-26T11:19:27.210197+0000","last_became_active":"2024-04-26T11:19:24.201077+0000","last_became_peered":"2024-04-26T11:19:24.201077+0000","last_unstale":"2024-04-26T11:19:27.210197+0000","last_undegraded":"2024-04-26T11:19:27.210197+0000","last_fullsized":"2024-04-26T11:19:27.210197+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210702+0000","last_change":"2024-04-26T11:19:18.187865+0000","last_active":"2024-04-26T11:19:27.210702+0000","last_peered":"2024-04-26T11:19:27.210702+0000","last_clean":"2024-04-26T11:19:27.210702+0000","last_became_active":"2024-04-26T11:19:18.185768+0000","last_became_peered":"2024-04-26T11:19:18.185768+0000","last_unstale":"2024-04-26T11:19:27.210702+0000","last_undegraded":"2024-04-26T11:19:27.210702+0000","last_fullsized":"2024-04-26T11:19:27.210702+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210211+0000","last_change":"2024-04-26T11:19:18.186275+0000","last_active":"2024-04-26T11:19:27.210211+0000","last_peered":"2024-04-26T11:19:27.210211+0000","last_clean":"2024-04-26T11:19:27.210211+0000","last_became_active":"2024-04-26T11:19:18.184149+0000","last_became_peered":"2024-04-26T11:19:18.184149+0000","last_unstale":"2024-04-26T11:19:27.210211+0000","last_undegraded":"2024-04-26T11:19:27.210211+0000","last_fullsized":"2024-04-26T11:19:27.210211+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:36.619910+0000","last_change":"2024-04-26T11:19:36.620064+0000","last_active":"2024-04-26T11:19:36.619910+0000","last_peered":"2024-04-26T11:19:36.619910+0000","last_clean":"2024-04-26T11:19:36.619910+0000","last_became_active":"2024-04-26T11:19:18.181951+0000","last_became_peered":"2024-04-26T11:19:18.181951+0000","last_unstale":"2024-04-26T11:19:36.619910+0000","last_undegraded":"2024-04-26T11:19:36.619910+0000","last_fullsized":"2024-04-26T11:19:36.619910+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:36.619885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:36.619885+0000","last_clean_scrub_stamp":"2024-04-26T11:19:36.619885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:06.660819+0000","scrub_duration":0.001669823,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.271533+0000","last_change":"2024-04-26T11:19:18.182240+0000","last_active":"2024-04-26T11:19:35.271533+0000","last_peered":"2024-04-26T11:19:35.271533+0000","last_clean":"2024-04-26T11:19:35.271533+0000","last_became_active":"2024-04-26T11:19:18.181767+0000","last_became_peered":"2024-04-26T11:19:18.181767+0000","last_unstale":"2024-04-26T11:19:35.271533+0000","last_undegraded":"2024-04-26T11:19:35.271533+0000","last_fullsized":"2024-04-26T11:19:35.271533+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:37.612117+0000","last_change":"2024-04-26T11:19:37.612253+0000","last_active":"2024-04-26T11:19:37.612117+0000","last_peered":"2024-04-26T11:19:37.612117+0000","last_clean":"2024-04-26T11:19:37.612117+0000","last_became_active":"2024-04-26T11:19:18.182060+0000","last_became_peered":"2024-04-26T11:19:18.182060+0000","last_unstale":"2024-04-26T11:19:37.612117+0000","last_undegraded":"2024-04-26T11:19:37.612117+0000","last_fullsized":"2024-04-26T11:19:37.612117+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:37.612061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:37.612061+0000","last_clean_scrub_stamp":"2024-04-26T11:19:37.612061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:24.175151+0000","scrub_duration":0.0016765459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.271558+0000","last_change":"2024-04-26T11:13:12.493217+0000","last_active":"2024-04-26T11:19:35.271558+0000","last_peered":"2024-04-26T11:19:35.271558+0000","last_clean":"2024-04-26T11:19:35.271558+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:19:35.271558+0000","last_undegraded":"2024-04-26T11:19:35.271558+0000","last_fullsized":"2024-04-26T11:19:35.271558+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:48.777587+0000","last_change":"2024-04-26T11:19:48.777713+0000","last_active":"2024-04-26T11:19:48.777587+0000","last_peered":"2024-04-26T11:19:48.777587+0000","last_clean":"2024-04-26T11:19:48.777587+0000","last_became_active":"2024-04-26T11:19:24.203758+0000","last_became_peered":"2024-04-26T11:19:24.203758+0000","last_unstale":"2024-04-26T11:19:48.777587+0000","last_undegraded":"2024-04-26T11:19:48.777587+0000","last_fullsized":"2024-04-26T11:19:48.777587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:48.777563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:48.777563+0000","last_clean_scrub_stamp":"2024-04-26T11:19:48.777563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:26.143928+0000","scrub_duration":0.058175359000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210353+0000","last_change":"2024-04-26T11:19:24.201687+0000","last_active":"2024-04-26T11:19:27.210353+0000","last_peered":"2024-04-26T11:19:27.210353+0000","last_clean":"2024-04-26T11:19:27.210353+0000","last_became_active":"2024-04-26T11:19:24.200963+0000","last_became_peered":"2024-04-26T11:19:24.200963+0000","last_unstale":"2024-04-26T11:19:27.210353+0000","last_undegraded":"2024-04-26T11:19:27.210353+0000","last_fullsized":"2024-04-26T11:19:27.210353+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211210+0000","last_change":"2024-04-26T11:19:18.189488+0000","last_active":"2024-04-26T11:19:27.211210+0000","last_peered":"2024-04-26T11:19:27.211210+0000","last_clean":"2024-04-26T11:19:27.211210+0000","last_became_active":"2024-04-26T11:19:18.189086+0000","last_became_peered":"2024-04-26T11:19:18.189086+0000","last_unstale":"2024-04-26T11:19:27.211210+0000","last_undegraded":"2024-04-26T11:19:27.211210+0000","last_fullsized":"2024-04-26T11:19:27.211210+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":107,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:31.632512+0000","last_change":"2024-04-26T11:19:18.182582+0000","last_active":"2024-04-26T11:19:31.632512+0000","last_peered":"2024-04-26T11:19:31.632512+0000","last_clean":"2024-04-26T11:19:31.632512+0000","last_became_active":"2024-04-26T11:19:18.181791+0000","last_became_peered":"2024-04-26T11:19:18.181791+0000","last_unstale":"2024-04-26T11:19:31.632512+0000","last_undegraded":"2024-04-26T11:19:31.632512+0000","last_fullsized":"2024-04-26T11:19:31.632512+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210246+0000","last_change":"2024-04-26T11:19:18.185313+0000","last_active":"2024-04-26T11:19:27.210246+0000","last_peered":"2024-04-26T11:19:27.210246+0000","last_clean":"2024-04-26T11:19:27.210246+0000","last_became_active":"2024-04-26T11:19:18.183292+0000","last_became_peered":"2024-04-26T11:19:18.183292+0000","last_unstale":"2024-04-26T11:19:27.210246+0000","last_undegraded":"2024-04-26T11:19:27.210246+0000","last_fullsized":"2024-04-26T11:19:27.210246+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210983+0000","last_change":"2024-04-26T11:19:18.190450+0000","last_active":"2024-04-26T11:19:27.210983+0000","last_peered":"2024-04-26T11:19:27.210983+0000","last_clean":"2024-04-26T11:19:27.210983+0000","last_became_active":"2024-04-26T11:19:18.190096+0000","last_became_peered":"2024-04-26T11:19:18.190096+0000","last_unstale":"2024-04-26T11:19:27.210983+0000","last_undegraded":"2024-04-26T11:19:27.210983+0000","last_fullsized":"2024-04-26T11:19:27.210983+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210232+0000","last_change":"2024-04-26T11:19:24.200305+0000","last_active":"2024-04-26T11:19:27.210232+0000","last_peered":"2024-04-26T11:19:27.210232+0000","last_clean":"2024-04-26T11:19:27.210232+0000","last_became_active":"2024-04-26T11:19:24.199834+0000","last_became_peered":"2024-04-26T11:19:24.199834+0000","last_unstale":"2024-04-26T11:19:27.210232+0000","last_undegraded":"2024-04-26T11:19:27.210232+0000","last_fullsized":"2024-04-26T11:19:27.210232+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.209924+0000","last_change":"2024-04-26T11:19:24.197329+0000","last_active":"2024-04-26T11:19:27.209924+0000","last_peered":"2024-04-26T11:19:27.209924+0000","last_clean":"2024-04-26T11:19:27.209924+0000","last_became_active":"2024-04-26T11:19:24.196561+0000","last_became_peered":"2024-04-26T11:19:24.196561+0000","last_unstale":"2024-04-26T11:19:27.209924+0000","last_undegraded":"2024-04-26T11:19:27.209924+0000","last_fullsized":"2024-04-26T11:19:27.209924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210331+0000","last_change":"2024-04-26T11:19:18.182680+0000","last_active":"2024-04-26T11:19:27.210331+0000","last_peered":"2024-04-26T11:19:27.210331+0000","last_clean":"2024-04-26T11:19:27.210331+0000","last_became_active":"2024-04-26T11:19:18.182077+0000","last_became_peered":"2024-04-26T11:19:18.182077+0000","last_unstale":"2024-04-26T11:19:27.210331+0000","last_undegraded":"2024-04-26T11:19:27.210331+0000","last_fullsized":"2024-04-26T11:19:27.210331+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210738+0000","last_change":"2024-04-26T11:19:24.205473+0000","last_active":"2024-04-26T11:19:27.210738+0000","last_peered":"2024-04-26T11:19:27.210738+0000","last_clean":"2024-04-26T11:19:27.210738+0000","last_became_active":"2024-04-26T11:19:24.204538+0000","last_became_peered":"2024-04-26T11:19:24.204538+0000","last_unstale":"2024-04-26T11:19:27.210738+0000","last_undegraded":"2024-04-26T11:19:27.210738+0000","last_fullsized":"2024-04-26T11:19:27.210738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210430+0000","last_change":"2024-04-26T11:19:18.186884+0000","last_active":"2024-04-26T11:19:27.210430+0000","last_peered":"2024-04-26T11:19:27.210430+0000","last_clean":"2024-04-26T11:19:27.210430+0000","last_became_active":"2024-04-26T11:19:18.184460+0000","last_became_peered":"2024-04-26T11:19:18.184460+0000","last_unstale":"2024-04-26T11:19:27.210430+0000","last_undegraded":"2024-04-26T11:19:27.210430+0000","last_fullsized":"2024-04-26T11:19:27.210430+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":235,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210220+0000","last_change":"2024-04-26T11:19:18.181070+0000","last_active":"2024-04-26T11:19:27.210220+0000","last_peered":"2024-04-26T11:19:27.210220+0000","last_clean":"2024-04-26T11:19:27.210220+0000","last_became_active":"2024-04-26T11:19:18.180577+0000","last_became_peered":"2024-04-26T11:19:18.180577+0000","last_unstale":"2024-04-26T11:19:27.210220+0000","last_undegraded":"2024-04-26T11:19:27.210220+0000","last_fullsized":"2024-04-26T11:19:27.210220+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.209868+0000","last_change":"2024-04-26T11:19:24.197315+0000","last_active":"2024-04-26T11:19:27.209868+0000","last_peered":"2024-04-26T11:19:27.209868+0000","last_clean":"2024-04-26T11:19:27.209868+0000","last_became_active":"2024-04-26T11:19:24.196404+0000","last_became_peered":"2024-04-26T11:19:24.196404+0000","last_unstale":"2024-04-26T11:19:27.209868+0000","last_undegraded":"2024-04-26T11:19:27.209868+0000","last_fullsized":"2024-04-26T11:19:27.209868+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210961+0000","last_change":"2024-04-26T11:19:18.184063+0000","last_active":"2024-04-26T11:19:27.210961+0000","last_peered":"2024-04-26T11:19:27.210961+0000","last_clean":"2024-04-26T11:19:27.210961+0000","last_became_active":"2024-04-26T11:19:18.181863+0000","last_became_peered":"2024-04-26T11:19:18.181863+0000","last_unstale":"2024-04-26T11:19:27.210961+0000","last_undegraded":"2024-04-26T11:19:27.210961+0000","last_fullsized":"2024-04-26T11:19:27.210961+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210332+0000","last_change":"2024-04-26T11:19:18.181362+0000","last_active":"2024-04-26T11:19:27.210332+0000","last_peered":"2024-04-26T11:19:27.210332+0000","last_clean":"2024-04-26T11:19:27.210332+0000","last_became_active":"2024-04-26T11:19:18.180792+0000","last_became_peered":"2024-04-26T11:19:18.180792+0000","last_unstale":"2024-04-26T11:19:27.210332+0000","last_undegraded":"2024-04-26T11:19:27.210332+0000","last_fullsized":"2024-04-26T11:19:27.210332+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:28.114595+0000","last_change":"2024-04-26T11:19:24.199071+0000","last_active":"2024-04-26T11:19:28.114595+0000","last_peered":"2024-04-26T11:19:28.114595+0000","last_clean":"2024-04-26T11:19:28.114595+0000","last_became_active":"2024-04-26T11:19:24.197711+0000","last_became_peered":"2024-04-26T11:19:24.197711+0000","last_unstale":"2024-04-26T11:19:28.114595+0000","last_undegraded":"2024-04-26T11:19:28.114595+0000","last_fullsized":"2024-04-26T11:19:28.114595+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.271720+0000","last_change":"2024-04-26T11:13:12.918648+0000","last_active":"2024-04-26T11:19:35.271720+0000","last_peered":"2024-04-26T11:19:35.271720+0000","last_clean":"2024-04-26T11:19:35.271720+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:19:35.271720+0000","last_undegraded":"2024-04-26T11:19:35.271720+0000","last_fullsized":"2024-04-26T11:19:35.271720+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211253+0000","last_change":"2024-04-26T11:13:08.110433+0000","last_active":"2024-04-26T11:19:27.211253+0000","last_peered":"2024-04-26T11:19:27.211253+0000","last_clean":"2024-04-26T11:19:27.211253+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:19:27.211253+0000","last_undegraded":"2024-04-26T11:19:27.211253+0000","last_fullsized":"2024-04-26T11:19:27.211253+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:46.745793+0000","last_change":"2024-04-26T11:19:46.745918+0000","last_active":"2024-04-26T11:19:46.745793+0000","last_peered":"2024-04-26T11:19:46.745793+0000","last_clean":"2024-04-26T11:19:46.745793+0000","last_became_active":"2024-04-26T11:19:24.202550+0000","last_became_peered":"2024-04-26T11:19:24.202550+0000","last_unstale":"2024-04-26T11:19:46.745793+0000","last_undegraded":"2024-04-26T11:19:46.745793+0000","last_fullsized":"2024-04-26T11:19:46.745793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:46.745769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:46.745769+0000","last_clean_scrub_stamp":"2024-04-26T11:19:46.745769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:09.707603+0000","scrub_duration":0.001879981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":107,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:31.632539+0000","last_change":"2024-04-26T11:19:18.182788+0000","last_active":"2024-04-26T11:19:31.632539+0000","last_peered":"2024-04-26T11:19:31.632539+0000","last_clean":"2024-04-26T11:19:31.632539+0000","last_became_active":"2024-04-26T11:19:18.182186+0000","last_became_peered":"2024-04-26T11:19:18.182186+0000","last_unstale":"2024-04-26T11:19:31.632539+0000","last_undegraded":"2024-04-26T11:19:31.632539+0000","last_fullsized":"2024-04-26T11:19:31.632539+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210616+0000","last_change":"2024-04-26T11:19:24.203482+0000","last_active":"2024-04-26T11:19:27.210616+0000","last_peered":"2024-04-26T11:19:27.210616+0000","last_clean":"2024-04-26T11:19:27.210616+0000","last_became_active":"2024-04-26T11:19:24.202310+0000","last_became_peered":"2024-04-26T11:19:24.202310+0000","last_unstale":"2024-04-26T11:19:27.210616+0000","last_undegraded":"2024-04-26T11:19:27.210616+0000","last_fullsized":"2024-04-26T11:19:27.210616+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210609+0000","last_change":"2024-04-26T11:19:24.202951+0000","last_active":"2024-04-26T11:19:27.210609+0000","last_peered":"2024-04-26T11:19:27.210609+0000","last_clean":"2024-04-26T11:19:27.210609+0000","last_became_active":"2024-04-26T11:19:24.202566+0000","last_became_peered":"2024-04-26T11:19:24.202566+0000","last_unstale":"2024-04-26T11:19:27.210609+0000","last_undegraded":"2024-04-26T11:19:27.210609+0000","last_fullsized":"2024-04-26T11:19:27.210609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.209705+0000","last_change":"2024-04-26T11:19:24.198685+0000","last_active":"2024-04-26T11:19:27.209705+0000","last_peered":"2024-04-26T11:19:27.209705+0000","last_clean":"2024-04-26T11:19:27.209705+0000","last_became_active":"2024-04-26T11:19:24.197383+0000","last_became_peered":"2024-04-26T11:19:24.197383+0000","last_unstale":"2024-04-26T11:19:27.209705+0000","last_undegraded":"2024-04-26T11:19:27.209705+0000","last_fullsized":"2024-04-26T11:19:27.209705+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211135+0000","last_change":"2024-04-26T11:19:18.181795+0000","last_active":"2024-04-26T11:19:27.211135+0000","last_peered":"2024-04-26T11:19:27.211135+0000","last_clean":"2024-04-26T11:19:27.211135+0000","last_became_active":"2024-04-26T11:19:18.180871+0000","last_became_peered":"2024-04-26T11:19:18.180871+0000","last_unstale":"2024-04-26T11:19:27.211135+0000","last_undegraded":"2024-04-26T11:19:27.211135+0000","last_fullsized":"2024-04-26T11:19:27.211135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:34.750941+0000","last_change":"2024-04-26T11:19:24.200015+0000","last_active":"2024-04-26T11:19:34.750941+0000","last_peered":"2024-04-26T11:19:34.750941+0000","last_clean":"2024-04-26T11:19:34.750941+0000","last_became_active":"2024-04-26T11:19:24.198853+0000","last_became_peered":"2024-04-26T11:19:24.198853+0000","last_unstale":"2024-04-26T11:19:34.750941+0000","last_undegraded":"2024-04-26T11:19:34.750941+0000","last_fullsized":"2024-04-26T11:19:34.750941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":107,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:28.112103+0000","last_change":"2024-04-26T11:19:18.182878+0000","last_active":"2024-04-26T11:19:28.112103+0000","last_peered":"2024-04-26T11:19:28.112103+0000","last_clean":"2024-04-26T11:19:28.112103+0000","last_became_active":"2024-04-26T11:19:18.182228+0000","last_became_peered":"2024-04-26T11:19:18.182228+0000","last_unstale":"2024-04-26T11:19:28.112103+0000","last_undegraded":"2024-04-26T11:19:28.112103+0000","last_fullsized":"2024-04-26T11:19:28.112103+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":111,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210600+0000","last_change":"2024-04-26T11:19:18.183238+0000","last_active":"2024-04-26T11:19:27.210600+0000","last_peered":"2024-04-26T11:19:27.210600+0000","last_clean":"2024-04-26T11:19:27.210600+0000","last_became_active":"2024-04-26T11:19:18.182671+0000","last_became_peered":"2024-04-26T11:19:18.182671+0000","last_unstale":"2024-04-26T11:19:27.210600+0000","last_undegraded":"2024-04-26T11:19:27.210600+0000","last_fullsized":"2024-04-26T11:19:27.210600+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210963+0000","last_change":"2024-04-26T11:13:12.917812+0000","last_active":"2024-04-26T11:19:27.210963+0000","last_peered":"2024-04-26T11:19:27.210963+0000","last_clean":"2024-04-26T11:19:27.210963+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:19:27.210963+0000","last_undegraded":"2024-04-26T11:19:27.210963+0000","last_fullsized":"2024-04-26T11:19:27.210963+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"82'3","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:39.596075+0000","last_change":"2024-04-26T11:19:39.596215+0000","last_active":"2024-04-26T11:19:39.596075+0000","last_peered":"2024-04-26T11:19:39.596075+0000","last_clean":"2024-04-26T11:19:39.596075+0000","last_became_active":"2024-04-26T11:19:18.188177+0000","last_became_peered":"2024-04-26T11:19:18.188177+0000","last_unstale":"2024-04-26T11:19:39.596075+0000","last_undegraded":"2024-04-26T11:19:39.596075+0000","last_fullsized":"2024-04-26T11:19:39.596075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T11:19:39.596051+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T11:19:39.596051+0000","last_clean_scrub_stamp":"2024-04-26T11:19:39.596051+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:18.488192+0000","scrub_duration":0.0035445559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:38.600610+0000","last_change":"2024-04-26T11:19:38.600786+0000","last_active":"2024-04-26T11:19:38.600610+0000","last_peered":"2024-04-26T11:19:38.600610+0000","last_clean":"2024-04-26T11:19:38.600610+0000","last_became_active":"2024-04-26T11:19:18.185372+0000","last_became_peered":"2024-04-26T11:19:18.185372+0000","last_unstale":"2024-04-26T11:19:38.600610+0000","last_undegraded":"2024-04-26T11:19:38.600610+0000","last_fullsized":"2024-04-26T11:19:38.600610+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:38.600585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:38.600585+0000","last_clean_scrub_stamp":"2024-04-26T11:19:38.600585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:00.495830+0000","scrub_duration":0.026821652000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211073+0000","last_change":"2024-04-26T11:19:18.190885+0000","last_active":"2024-04-26T11:19:27.211073+0000","last_peered":"2024-04-26T11:19:27.211073+0000","last_clean":"2024-04-26T11:19:27.211073+0000","last_became_active":"2024-04-26T11:19:18.190374+0000","last_became_peered":"2024-04-26T11:19:18.190374+0000","last_unstale":"2024-04-26T11:19:27.211073+0000","last_undegraded":"2024-04-26T11:19:27.211073+0000","last_fullsized":"2024-04-26T11:19:27.211073+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210709+0000","last_change":"2024-04-26T11:19:18.189666+0000","last_active":"2024-04-26T11:19:27.210709+0000","last_peered":"2024-04-26T11:19:27.210709+0000","last_clean":"2024-04-26T11:19:27.210709+0000","last_became_active":"2024-04-26T11:19:18.189341+0000","last_became_peered":"2024-04-26T11:19:18.189341+0000","last_unstale":"2024-04-26T11:19:27.210709+0000","last_undegraded":"2024-04-26T11:19:27.210709+0000","last_fullsized":"2024-04-26T11:19:27.210709+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210706+0000","last_change":"2024-04-26T11:19:24.202866+0000","last_active":"2024-04-26T11:19:27.210706+0000","last_peered":"2024-04-26T11:19:27.210706+0000","last_clean":"2024-04-26T11:19:27.210706+0000","last_became_active":"2024-04-26T11:19:24.202422+0000","last_became_peered":"2024-04-26T11:19:24.202422+0000","last_unstale":"2024-04-26T11:19:27.210706+0000","last_undegraded":"2024-04-26T11:19:27.210706+0000","last_fullsized":"2024-04-26T11:19:27.210706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210728+0000","last_change":"2024-04-26T11:13:12.917763+0000","last_active":"2024-04-26T11:19:27.210728+0000","last_peered":"2024-04-26T11:19:27.210728+0000","last_clean":"2024-04-26T11:19:27.210728+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:19:27.210728+0000","last_undegraded":"2024-04-26T11:19:27.210728+0000","last_fullsized":"2024-04-26T11:19:27.210728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210688+0000","last_change":"2024-04-26T11:19:24.205087+0000","last_active":"2024-04-26T11:19:27.210688+0000","last_peered":"2024-04-26T11:19:27.210688+0000","last_clean":"2024-04-26T11:19:27.210688+0000","last_became_active":"2024-04-26T11:19:24.204129+0000","last_became_peered":"2024-04-26T11:19:24.204129+0000","last_unstale":"2024-04-26T11:19:27.210688+0000","last_undegraded":"2024-04-26T11:19:27.210688+0000","last_fullsized":"2024-04-26T11:19:27.210688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210568+0000","last_change":"2024-04-26T11:19:18.189530+0000","last_active":"2024-04-26T11:19:27.210568+0000","last_peered":"2024-04-26T11:19:27.210568+0000","last_clean":"2024-04-26T11:19:27.210568+0000","last_became_active":"2024-04-26T11:19:18.189179+0000","last_became_peered":"2024-04-26T11:19:18.189179+0000","last_unstale":"2024-04-26T11:19:27.210568+0000","last_undegraded":"2024-04-26T11:19:27.210568+0000","last_fullsized":"2024-04-26T11:19:27.210568+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:40.624649+0000","last_change":"2024-04-26T11:19:40.624780+0000","last_active":"2024-04-26T11:19:40.624649+0000","last_peered":"2024-04-26T11:19:40.624649+0000","last_clean":"2024-04-26T11:19:40.624649+0000","last_became_active":"2024-04-26T11:19:18.188963+0000","last_became_peered":"2024-04-26T11:19:18.188963+0000","last_unstale":"2024-04-26T11:19:40.624649+0000","last_undegraded":"2024-04-26T11:19:40.624649+0000","last_fullsized":"2024-04-26T11:19:40.624649+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:40.624624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:40.624624+0000","last_clean_scrub_stamp":"2024-04-26T11:19:40.624624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:51.952842+0000","scrub_duration":0.0017518169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.209859+0000","last_change":"2024-04-26T11:19:24.200217+0000","last_active":"2024-04-26T11:19:27.209859+0000","last_peered":"2024-04-26T11:19:27.209859+0000","last_clean":"2024-04-26T11:19:27.209859+0000","last_became_active":"2024-04-26T11:19:24.198397+0000","last_became_peered":"2024-04-26T11:19:24.198397+0000","last_unstale":"2024-04-26T11:19:27.209859+0000","last_undegraded":"2024-04-26T11:19:27.209859+0000","last_fullsized":"2024-04-26T11:19:27.209859+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":107,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:31.632525+0000","last_change":"2024-04-26T11:19:18.183441+0000","last_active":"2024-04-26T11:19:31.632525+0000","last_peered":"2024-04-26T11:19:31.632525+0000","last_clean":"2024-04-26T11:19:31.632525+0000","last_became_active":"2024-04-26T11:19:18.183037+0000","last_became_peered":"2024-04-26T11:19:18.183037+0000","last_unstale":"2024-04-26T11:19:31.632525+0000","last_undegraded":"2024-04-26T11:19:31.632525+0000","last_fullsized":"2024-04-26T11:19:31.632525+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210338+0000","last_change":"2024-04-26T11:19:24.203647+0000","last_active":"2024-04-26T11:19:27.210338+0000","last_peered":"2024-04-26T11:19:27.210338+0000","last_clean":"2024-04-26T11:19:27.210338+0000","last_became_active":"2024-04-26T11:19:24.202442+0000","last_became_peered":"2024-04-26T11:19:24.202442+0000","last_unstale":"2024-04-26T11:19:27.210338+0000","last_undegraded":"2024-04-26T11:19:27.210338+0000","last_fullsized":"2024-04-26T11:19:27.210338+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:51.420225+0000","last_change":"2024-04-26T11:19:51.420347+0000","last_active":"2024-04-26T11:19:51.420225+0000","last_peered":"2024-04-26T11:19:51.420225+0000","last_clean":"2024-04-26T11:19:51.420225+0000","last_became_active":"2024-04-26T11:19:18.184384+0000","last_became_peered":"2024-04-26T11:19:18.184384+0000","last_unstale":"2024-04-26T11:19:51.420225+0000","last_undegraded":"2024-04-26T11:19:51.420225+0000","last_fullsized":"2024-04-26T11:19:51.420225+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:51.420205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:51.420205+0000","last_clean_scrub_stamp":"2024-04-26T11:19:51.420205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:55.572118+0000","scrub_duration":0.001998835,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7958,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738452,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281144,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94090696,"statfs":{"total":96636764160,"available":96348872704,"internally_reserved":0,"allocated":1490944,"data_stored":947441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Fri Apr 26 11:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45800000000000002,"15min":0.39600000000000002},"min":{"1min":0.34399999999999997,"5min":0.17999999999999999,"15min":0.17199999999999999},"max":{"1min":0.68100000000000005,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.316,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.66400000000000003,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.373}]}]},{"osd":0,"up_from":75,"seq":322122547209,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38148,"kb_used_data":1468,"kb_used_omap":10,"kb_used_meta":36661,"kb_avail":94333692,"statfs":{"total":96636764160,"available":96597700608,"internally_reserved":0,"allocated":1503232,"data_stored":949168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11228,"internal_metadata":37540900},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738453,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401128,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":400254,"kb_avail":93970712,"statfs":{"total":96636764160,"available":96226009088,"internally_reserved":0,"allocated":884736,"data_stored":357054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":409860550},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Apr 26 11:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.44700000000000001,"15min":0.40699999999999997},"min":{"1min":0.34999999999999998,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.69199999999999995,"5min":2.056,"15min":2.056},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.499,"15min":0.46400000000000002},"min":{"1min":0.376,"5min":0.193,"15min":0.193},"max":{"1min":0.67600000000000005,"5min":3.9609999999999999,"15min":3.9609999999999999},"last":0.45300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7958,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:19:56.044 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.044 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.044 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.044 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.044 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.044 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.045 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.045 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.045 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.045 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.045 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.045 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.045 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.045 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.045 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.046 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.046 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.046 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.046 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.046 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.046 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.046 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.046 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.047 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.047 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.047 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.047 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.047 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.047 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.047 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.047 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.047 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.048 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.048 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.048 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.048 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.048 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.048 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.048 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.048 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.048 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.048 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.049 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.049 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.049 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.049 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.049 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.049 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.049 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.049 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.049 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.050 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.050 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.050 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.050 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.050 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.050 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.050 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.050 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.050 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.051 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.051 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.051 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.051 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.051 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.051 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.051 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.051 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.051 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.052 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.052 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.052 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.052 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.052 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.052 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.052 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.052 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.053 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.053 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.053 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.053 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.053 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:19:56.053 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T11:20:16.054 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:20:16.413 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:20:16.416 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:20:16.424 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-04-26T11:20:14.572389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":720420,"kb_used_data":3788,"kb_used_omap":14,"kb_used_meta":716593,"kb_avail":282395100,"statfs":{"total":289910292480,"available":289172582400,"internally_reserved":0,"allocated":3878912,"data_stored":2253663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14416,"internal_metadata":733792176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003430"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:31.632644+0000","last_change":"2024-04-26T11:13:12.919196+0000","last_active":"2024-04-26T11:19:31.632644+0000","last_peered":"2024-04-26T11:19:31.632644+0000","last_clean":"2024-04-26T11:19:31.632644+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:19:31.632644+0000","last_undegraded":"2024-04-26T11:19:31.632644+0000","last_fullsized":"2024-04-26T11:19:31.632644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:31.632604+0000","last_change":"2024-04-26T11:13:12.917670+0000","last_active":"2024-04-26T11:19:31.632604+0000","last_peered":"2024-04-26T11:19:31.632604+0000","last_clean":"2024-04-26T11:19:31.632604+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:19:31.632604+0000","last_undegraded":"2024-04-26T11:19:31.632604+0000","last_fullsized":"2024-04-26T11:19:31.632604+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211220+0000","last_change":"2024-04-26T11:19:18.185209+0000","last_active":"2024-04-26T11:19:27.211220+0000","last_peered":"2024-04-26T11:19:27.211220+0000","last_clean":"2024-04-26T11:19:27.211220+0000","last_became_active":"2024-04-26T11:19:18.182972+0000","last_became_peered":"2024-04-26T11:19:18.182972+0000","last_unstale":"2024-04-26T11:19:27.211220+0000","last_undegraded":"2024-04-26T11:19:27.211220+0000","last_fullsized":"2024-04-26T11:19:27.211220+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210609+0000","last_change":"2024-04-26T11:19:18.183286+0000","last_active":"2024-04-26T11:19:27.210609+0000","last_peered":"2024-04-26T11:19:27.210609+0000","last_clean":"2024-04-26T11:19:27.210609+0000","last_became_active":"2024-04-26T11:19:18.182942+0000","last_became_peered":"2024-04-26T11:19:18.182942+0000","last_unstale":"2024-04-26T11:19:27.210609+0000","last_undegraded":"2024-04-26T11:19:27.210609+0000","last_fullsized":"2024-04-26T11:19:27.210609+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:50.417947+0000","last_change":"2024-04-26T11:19:50.418051+0000","last_active":"2024-04-26T11:19:50.417947+0000","last_peered":"2024-04-26T11:19:50.417947+0000","last_clean":"2024-04-26T11:19:50.417947+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:19:50.417947+0000","last_undegraded":"2024-04-26T11:19:50.417947+0000","last_fullsized":"2024-04-26T11:19:50.417947+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:50.417924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:50.417924+0000","last_clean_scrub_stamp":"2024-04-26T11:19:50.417924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:25.937563+0000","scrub_duration":0.016392371999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210596+0000","last_change":"2024-04-26T11:19:18.189355+0000","last_active":"2024-04-26T11:19:27.210596+0000","last_peered":"2024-04-26T11:19:27.210596+0000","last_clean":"2024-04-26T11:19:27.210596+0000","last_became_active":"2024-04-26T11:19:18.188990+0000","last_became_peered":"2024-04-26T11:19:18.188990+0000","last_unstale":"2024-04-26T11:19:27.210596+0000","last_undegraded":"2024-04-26T11:19:27.210596+0000","last_fullsized":"2024-04-26T11:19:27.210596+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:45.509116+0000","last_change":"2024-04-26T11:19:45.509220+0000","last_active":"2024-04-26T11:19:45.509116+0000","last_peered":"2024-04-26T11:19:45.509116+0000","last_clean":"2024-04-26T11:19:45.509116+0000","last_became_active":"2024-04-26T11:19:18.186638+0000","last_became_peered":"2024-04-26T11:19:18.186638+0000","last_unstale":"2024-04-26T11:19:45.509116+0000","last_undegraded":"2024-04-26T11:19:45.509116+0000","last_fullsized":"2024-04-26T11:19:45.509116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:45.509090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:45.509090+0000","last_clean_scrub_stamp":"2024-04-26T11:19:45.509090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:05.567613+0000","scrub_duration":0.017637363999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210059+0000","last_change":"2024-04-26T11:19:18.183968+0000","last_active":"2024-04-26T11:19:27.210059+0000","last_peered":"2024-04-26T11:19:27.210059+0000","last_clean":"2024-04-26T11:19:27.210059+0000","last_became_active":"2024-04-26T11:19:18.182111+0000","last_became_peered":"2024-04-26T11:19:18.182111+0000","last_unstale":"2024-04-26T11:19:27.210059+0000","last_undegraded":"2024-04-26T11:19:27.210059+0000","last_fullsized":"2024-04-26T11:19:27.210059+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210559+0000","last_change":"2024-04-26T11:19:24.202861+0000","last_active":"2024-04-26T11:19:27.210559+0000","last_peered":"2024-04-26T11:19:27.210559+0000","last_clean":"2024-04-26T11:19:27.210559+0000","last_became_active":"2024-04-26T11:19:24.202146+0000","last_became_peered":"2024-04-26T11:19:24.202146+0000","last_unstale":"2024-04-26T11:19:27.210559+0000","last_undegraded":"2024-04-26T11:19:27.210559+0000","last_fullsized":"2024-04-26T11:19:27.210559+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211285+0000","last_change":"2024-04-26T11:13:12.918521+0000","last_active":"2024-04-26T11:19:27.211285+0000","last_peered":"2024-04-26T11:19:27.211285+0000","last_clean":"2024-04-26T11:19:27.211285+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:19:27.211285+0000","last_undegraded":"2024-04-26T11:19:27.211285+0000","last_fullsized":"2024-04-26T11:19:27.211285+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:52.515823+0000","last_change":"2024-04-26T11:19:52.515987+0000","last_active":"2024-04-26T11:19:52.515823+0000","last_peered":"2024-04-26T11:19:52.515823+0000","last_clean":"2024-04-26T11:19:52.515823+0000","last_became_active":"2024-04-26T11:19:18.185543+0000","last_became_peered":"2024-04-26T11:19:18.185543+0000","last_unstale":"2024-04-26T11:19:52.515823+0000","last_undegraded":"2024-04-26T11:19:52.515823+0000","last_fullsized":"2024-04-26T11:19:52.515823+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:52.515775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:52.515775+0000","last_clean_scrub_stamp":"2024-04-26T11:19:52.515775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.954162+0000","scrub_duration":0.016652819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210717+0000","last_change":"2024-04-26T11:19:18.183459+0000","last_active":"2024-04-26T11:19:27.210717+0000","last_peered":"2024-04-26T11:19:27.210717+0000","last_clean":"2024-04-26T11:19:27.210717+0000","last_became_active":"2024-04-26T11:19:18.182827+0000","last_became_peered":"2024-04-26T11:19:18.182827+0000","last_unstale":"2024-04-26T11:19:27.210717+0000","last_undegraded":"2024-04-26T11:19:27.210717+0000","last_fullsized":"2024-04-26T11:19:27.210717+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.499056+0000","last_change":"2024-04-26T11:19:35.499190+0000","last_active":"2024-04-26T11:19:35.499056+0000","last_peered":"2024-04-26T11:19:35.499056+0000","last_clean":"2024-04-26T11:19:35.499056+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:19:35.499056+0000","last_undegraded":"2024-04-26T11:19:35.499056+0000","last_fullsized":"2024-04-26T11:19:35.499056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:35.499030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:35.499030+0000","last_clean_scrub_stamp":"2024-04-26T11:19:35.499030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:49.185477+0000","scrub_duration":0.018123878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:41.593903+0000","last_change":"2024-04-26T11:19:41.594000+0000","last_active":"2024-04-26T11:19:41.593903+0000","last_peered":"2024-04-26T11:19:41.593903+0000","last_clean":"2024-04-26T11:19:41.593903+0000","last_became_active":"2024-04-26T11:19:18.180865+0000","last_became_peered":"2024-04-26T11:19:18.180865+0000","last_unstale":"2024-04-26T11:19:41.593903+0000","last_undegraded":"2024-04-26T11:19:41.593903+0000","last_fullsized":"2024-04-26T11:19:41.593903+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:41.593880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:41.593880+0000","last_clean_scrub_stamp":"2024-04-26T11:19:41.593880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:56.201582+0000","scrub_duration":0.0019243019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:51.517339+0000","last_change":"2024-04-26T11:19:51.517460+0000","last_active":"2024-04-26T11:19:51.517339+0000","last_peered":"2024-04-26T11:19:51.517339+0000","last_clean":"2024-04-26T11:19:51.517339+0000","last_became_active":"2024-04-26T11:19:18.180763+0000","last_became_peered":"2024-04-26T11:19:18.180763+0000","last_unstale":"2024-04-26T11:19:51.517339+0000","last_undegraded":"2024-04-26T11:19:51.517339+0000","last_fullsized":"2024-04-26T11:19:51.517339+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:51.517314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:51.517314+0000","last_clean_scrub_stamp":"2024-04-26T11:19:51.517314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:47:38.185008+0000","scrub_duration":0.0020719620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:07.533224+0000","last_change":"2024-04-26T11:20:07.533355+0000","last_active":"2024-04-26T11:20:07.533224+0000","last_peered":"2024-04-26T11:20:07.533224+0000","last_clean":"2024-04-26T11:20:07.533224+0000","last_became_active":"2024-04-26T11:19:18.184331+0000","last_became_peered":"2024-04-26T11:19:18.184331+0000","last_unstale":"2024-04-26T11:20:07.533224+0000","last_undegraded":"2024-04-26T11:20:07.533224+0000","last_fullsized":"2024-04-26T11:20:07.533224+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:07.533200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:07.533200+0000","last_clean_scrub_stamp":"2024-04-26T11:20:07.533200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:50.283609+0000","scrub_duration":0.0016781039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210548+0000","last_change":"2024-04-26T11:19:24.204827+0000","last_active":"2024-04-26T11:19:27.210548+0000","last_peered":"2024-04-26T11:19:27.210548+0000","last_clean":"2024-04-26T11:19:27.210548+0000","last_became_active":"2024-04-26T11:19:24.203764+0000","last_became_peered":"2024-04-26T11:19:24.203764+0000","last_unstale":"2024-04-26T11:19:27.210548+0000","last_undegraded":"2024-04-26T11:19:27.210548+0000","last_fullsized":"2024-04-26T11:19:27.210548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:43.423642+0000","last_change":"2024-04-26T11:19:43.423762+0000","last_active":"2024-04-26T11:19:43.423642+0000","last_peered":"2024-04-26T11:19:43.423642+0000","last_clean":"2024-04-26T11:19:43.423642+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:19:43.423642+0000","last_undegraded":"2024-04-26T11:19:43.423642+0000","last_fullsized":"2024-04-26T11:19:43.423642+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:43.423617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:43.423617+0000","last_clean_scrub_stamp":"2024-04-26T11:19:43.423617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:58.420909+0000","scrub_duration":0.0017194790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210305+0000","last_change":"2024-04-26T11:19:24.200114+0000","last_active":"2024-04-26T11:19:27.210305+0000","last_peered":"2024-04-26T11:19:27.210305+0000","last_clean":"2024-04-26T11:19:27.210305+0000","last_became_active":"2024-04-26T11:19:24.199142+0000","last_became_peered":"2024-04-26T11:19:24.199142+0000","last_unstale":"2024-04-26T11:19:27.210305+0000","last_undegraded":"2024-04-26T11:19:27.210305+0000","last_fullsized":"2024-04-26T11:19:27.210305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:42.569786+0000","last_change":"2024-04-26T11:19:42.569936+0000","last_active":"2024-04-26T11:19:42.569786+0000","last_peered":"2024-04-26T11:19:42.569786+0000","last_clean":"2024-04-26T11:19:42.569786+0000","last_became_active":"2024-04-26T11:19:18.184282+0000","last_became_peered":"2024-04-26T11:19:18.184282+0000","last_unstale":"2024-04-26T11:19:42.569786+0000","last_undegraded":"2024-04-26T11:19:42.569786+0000","last_fullsized":"2024-04-26T11:19:42.569786+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:42.569760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:42.569760+0000","last_clean_scrub_stamp":"2024-04-26T11:19:42.569760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:17.239747+0000","scrub_duration":0.0018614059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210780+0000","last_change":"2024-04-26T11:19:18.187937+0000","last_active":"2024-04-26T11:19:27.210780+0000","last_peered":"2024-04-26T11:19:27.210780+0000","last_clean":"2024-04-26T11:19:27.210780+0000","last_became_active":"2024-04-26T11:19:18.186605+0000","last_became_peered":"2024-04-26T11:19:18.186605+0000","last_unstale":"2024-04-26T11:19:27.210780+0000","last_undegraded":"2024-04-26T11:19:27.210780+0000","last_fullsized":"2024-04-26T11:19:27.210780+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:59.494778+0000","last_change":"2024-04-26T11:19:59.494778+0000","last_active":"2024-04-26T11:19:59.494778+0000","last_peered":"2024-04-26T11:19:59.494778+0000","last_clean":"2024-04-26T11:19:59.494778+0000","last_became_active":"2024-04-26T11:19:18.181728+0000","last_became_peered":"2024-04-26T11:19:18.181728+0000","last_unstale":"2024-04-26T11:19:59.494778+0000","last_undegraded":"2024-04-26T11:19:59.494778+0000","last_fullsized":"2024-04-26T11:19:59.494778+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:59.494616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:59.494616+0000","last_clean_scrub_stamp":"2024-04-26T11:19:59.494616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:50:32.682411+0000","scrub_duration":0.001815215,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:34.751237+0000","last_change":"2024-04-26T11:19:24.198562+0000","last_active":"2024-04-26T11:19:34.751237+0000","last_peered":"2024-04-26T11:19:34.751237+0000","last_clean":"2024-04-26T11:19:34.751237+0000","last_became_active":"2024-04-26T11:19:24.197487+0000","last_became_peered":"2024-04-26T11:19:24.197487+0000","last_unstale":"2024-04-26T11:19:34.751237+0000","last_undegraded":"2024-04-26T11:19:34.751237+0000","last_fullsized":"2024-04-26T11:19:34.751237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:48.396499+0000","last_change":"2024-04-26T11:19:48.396656+0000","last_active":"2024-04-26T11:19:48.396499+0000","last_peered":"2024-04-26T11:19:48.396499+0000","last_clean":"2024-04-26T11:19:48.396499+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:19:48.396499+0000","last_undegraded":"2024-04-26T11:19:48.396499+0000","last_fullsized":"2024-04-26T11:19:48.396499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:48.396472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:48.396472+0000","last_clean_scrub_stamp":"2024-04-26T11:19:48.396472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:16.773782+0000","scrub_duration":0.0019312940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":107,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.271864+0000","last_change":"2024-04-26T11:19:18.184692+0000","last_active":"2024-04-26T11:19:35.271864+0000","last_peered":"2024-04-26T11:19:35.271864+0000","last_clean":"2024-04-26T11:19:35.271864+0000","last_became_active":"2024-04-26T11:19:18.184451+0000","last_became_peered":"2024-04-26T11:19:18.184451+0000","last_unstale":"2024-04-26T11:19:35.271864+0000","last_undegraded":"2024-04-26T11:19:35.271864+0000","last_fullsized":"2024-04-26T11:19:35.271864+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:08.595129+0000","last_change":"2024-04-26T11:20:08.595253+0000","last_active":"2024-04-26T11:20:08.595129+0000","last_peered":"2024-04-26T11:20:08.595129+0000","last_clean":"2024-04-26T11:20:08.595129+0000","last_became_active":"2024-04-26T11:19:24.198479+0000","last_became_peered":"2024-04-26T11:19:24.198479+0000","last_unstale":"2024-04-26T11:20:08.595129+0000","last_undegraded":"2024-04-26T11:20:08.595129+0000","last_fullsized":"2024-04-26T11:20:08.595129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:08.595106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:08.595106+0000","last_clean_scrub_stamp":"2024-04-26T11:20:08.595106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:18.295964+0000","scrub_duration":0.0021262659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211020+0000","last_change":"2024-04-26T11:19:18.185709+0000","last_active":"2024-04-26T11:19:27.211020+0000","last_peered":"2024-04-26T11:19:27.211020+0000","last_clean":"2024-04-26T11:19:27.211020+0000","last_became_active":"2024-04-26T11:19:18.185105+0000","last_became_peered":"2024-04-26T11:19:18.185105+0000","last_unstale":"2024-04-26T11:19:27.211020+0000","last_undegraded":"2024-04-26T11:19:27.211020+0000","last_fullsized":"2024-04-26T11:19:27.211020+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210480+0000","last_change":"2024-04-26T11:13:12.493425+0000","last_active":"2024-04-26T11:19:27.210480+0000","last_peered":"2024-04-26T11:19:27.210480+0000","last_clean":"2024-04-26T11:19:27.210480+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:19:27.210480+0000","last_undegraded":"2024-04-26T11:19:27.210480+0000","last_fullsized":"2024-04-26T11:19:27.210480+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211182+0000","last_change":"2024-04-26T11:19:18.191042+0000","last_active":"2024-04-26T11:19:27.211182+0000","last_peered":"2024-04-26T11:19:27.211182+0000","last_clean":"2024-04-26T11:19:27.211182+0000","last_became_active":"2024-04-26T11:19:18.190792+0000","last_became_peered":"2024-04-26T11:19:18.190792+0000","last_unstale":"2024-04-26T11:19:27.211182+0000","last_undegraded":"2024-04-26T11:19:27.211182+0000","last_fullsized":"2024-04-26T11:19:27.211182+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":67,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.667261+0000","last_change":"2024-04-26T11:19:35.667355+0000","last_active":"2024-04-26T11:19:35.667261+0000","last_peered":"2024-04-26T11:19:35.667261+0000","last_clean":"2024-04-26T11:19:35.667261+0000","last_became_active":"2024-04-26T11:19:24.202348+0000","last_became_peered":"2024-04-26T11:19:24.202348+0000","last_unstale":"2024-04-26T11:19:35.667261+0000","last_undegraded":"2024-04-26T11:19:35.667261+0000","last_fullsized":"2024-04-26T11:19:35.667261+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:35.667237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:35.667237+0000","last_clean_scrub_stamp":"2024-04-26T11:19:35.667237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:38.776469+0000","scrub_duration":0.0019697669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:44.766975+0000","last_change":"2024-04-26T11:19:44.767086+0000","last_active":"2024-04-26T11:19:44.766975+0000","last_peered":"2024-04-26T11:19:44.766975+0000","last_clean":"2024-04-26T11:19:44.766975+0000","last_became_active":"2024-04-26T11:19:24.198920+0000","last_became_peered":"2024-04-26T11:19:24.198920+0000","last_unstale":"2024-04-26T11:19:44.766975+0000","last_undegraded":"2024-04-26T11:19:44.766975+0000","last_fullsized":"2024-04-26T11:19:44.766975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:44.766950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:44.766950+0000","last_clean_scrub_stamp":"2024-04-26T11:19:44.766950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:30.054801+0000","scrub_duration":0.0017451579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.209812+0000","last_change":"2024-04-26T11:19:24.199051+0000","last_active":"2024-04-26T11:19:27.209812+0000","last_peered":"2024-04-26T11:19:27.209812+0000","last_clean":"2024-04-26T11:19:27.209812+0000","last_became_active":"2024-04-26T11:19:24.197698+0000","last_became_peered":"2024-04-26T11:19:24.197698+0000","last_unstale":"2024-04-26T11:19:27.209812+0000","last_undegraded":"2024-04-26T11:19:27.209812+0000","last_fullsized":"2024-04-26T11:19:27.209812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:47.503571+0000","last_change":"2024-04-26T11:19:47.503709+0000","last_active":"2024-04-26T11:19:47.503571+0000","last_peered":"2024-04-26T11:19:47.503571+0000","last_clean":"2024-04-26T11:19:47.503571+0000","last_became_active":"2024-04-26T11:19:18.190127+0000","last_became_peered":"2024-04-26T11:19:18.190127+0000","last_unstale":"2024-04-26T11:19:47.503571+0000","last_undegraded":"2024-04-26T11:19:47.503571+0000","last_fullsized":"2024-04-26T11:19:47.503571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:47.503550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:47.503550+0000","last_clean_scrub_stamp":"2024-04-26T11:19:47.503550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:33.423364+0000","scrub_duration":0.064283446999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210736+0000","last_change":"2024-04-26T11:19:24.205086+0000","last_active":"2024-04-26T11:19:27.210736+0000","last_peered":"2024-04-26T11:19:27.210736+0000","last_clean":"2024-04-26T11:19:27.210736+0000","last_became_active":"2024-04-26T11:19:24.204122+0000","last_became_peered":"2024-04-26T11:19:24.204122+0000","last_unstale":"2024-04-26T11:19:27.210736+0000","last_undegraded":"2024-04-26T11:19:27.210736+0000","last_fullsized":"2024-04-26T11:19:27.210736+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.209673+0000","last_change":"2024-04-26T11:19:24.198434+0000","last_active":"2024-04-26T11:19:27.209673+0000","last_peered":"2024-04-26T11:19:27.209673+0000","last_clean":"2024-04-26T11:19:27.209673+0000","last_became_active":"2024-04-26T11:19:24.197247+0000","last_became_peered":"2024-04-26T11:19:24.197247+0000","last_unstale":"2024-04-26T11:19:27.209673+0000","last_undegraded":"2024-04-26T11:19:27.209673+0000","last_fullsized":"2024-04-26T11:19:27.209673+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211069+0000","last_change":"2024-04-26T11:19:18.187720+0000","last_active":"2024-04-26T11:19:27.211069+0000","last_peered":"2024-04-26T11:19:27.211069+0000","last_clean":"2024-04-26T11:19:27.211069+0000","last_became_active":"2024-04-26T11:19:18.185578+0000","last_became_peered":"2024-04-26T11:19:18.185578+0000","last_unstale":"2024-04-26T11:19:27.211069+0000","last_undegraded":"2024-04-26T11:19:27.211069+0000","last_fullsized":"2024-04-26T11:19:27.211069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":99,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:05.541740+0000","last_change":"2024-04-26T11:20:05.541862+0000","last_active":"2024-04-26T11:20:05.541740+0000","last_peered":"2024-04-26T11:20:05.541740+0000","last_clean":"2024-04-26T11:20:05.541740+0000","last_became_active":"2024-04-26T11:19:24.200992+0000","last_became_peered":"2024-04-26T11:19:24.200992+0000","last_unstale":"2024-04-26T11:20:05.541740+0000","last_undegraded":"2024-04-26T11:20:05.541740+0000","last_fullsized":"2024-04-26T11:20:05.541740+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:05.541702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:05.541702+0000","last_clean_scrub_stamp":"2024-04-26T11:20:05.541702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:43.691758+0000","scrub_duration":0.001648708,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":110,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211061+0000","last_change":"2024-04-26T11:19:18.190998+0000","last_active":"2024-04-26T11:19:27.211061+0000","last_peered":"2024-04-26T11:19:27.211061+0000","last_clean":"2024-04-26T11:19:27.211061+0000","last_became_active":"2024-04-26T11:19:18.190381+0000","last_became_peered":"2024-04-26T11:19:18.190381+0000","last_unstale":"2024-04-26T11:19:27.211061+0000","last_undegraded":"2024-04-26T11:19:27.211061+0000","last_fullsized":"2024-04-26T11:19:27.211061+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:51.669025+0000","last_change":"2024-04-26T11:19:51.669122+0000","last_active":"2024-04-26T11:19:51.669025+0000","last_peered":"2024-04-26T11:19:51.669025+0000","last_clean":"2024-04-26T11:19:51.669025+0000","last_became_active":"2024-04-26T11:19:24.199659+0000","last_became_peered":"2024-04-26T11:19:24.199659+0000","last_unstale":"2024-04-26T11:19:51.669025+0000","last_undegraded":"2024-04-26T11:19:51.669025+0000","last_fullsized":"2024-04-26T11:19:51.669025+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:51.668999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:51.668999+0000","last_clean_scrub_stamp":"2024-04-26T11:19:51.668999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:13.870535+0000","scrub_duration":0.001713553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210756+0000","last_change":"2024-04-26T11:19:18.181316+0000","last_active":"2024-04-26T11:19:27.210756+0000","last_peered":"2024-04-26T11:19:27.210756+0000","last_clean":"2024-04-26T11:19:27.210756+0000","last_became_active":"2024-04-26T11:19:18.180711+0000","last_became_peered":"2024-04-26T11:19:18.180711+0000","last_unstale":"2024-04-26T11:19:27.210756+0000","last_undegraded":"2024-04-26T11:19:27.210756+0000","last_fullsized":"2024-04-26T11:19:27.210756+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210856+0000","last_change":"2024-04-26T11:19:18.182026+0000","last_active":"2024-04-26T11:19:27.210856+0000","last_peered":"2024-04-26T11:19:27.210856+0000","last_clean":"2024-04-26T11:19:27.210856+0000","last_became_active":"2024-04-26T11:19:18.181615+0000","last_became_peered":"2024-04-26T11:19:18.181615+0000","last_unstale":"2024-04-26T11:19:27.210856+0000","last_undegraded":"2024-04-26T11:19:27.210856+0000","last_fullsized":"2024-04-26T11:19:27.210856+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210343+0000","last_change":"2024-04-26T11:19:18.185625+0000","last_active":"2024-04-26T11:19:27.210343+0000","last_peered":"2024-04-26T11:19:27.210343+0000","last_clean":"2024-04-26T11:19:27.210343+0000","last_became_active":"2024-04-26T11:19:18.183103+0000","last_became_peered":"2024-04-26T11:19:18.183103+0000","last_unstale":"2024-04-26T11:19:27.210343+0000","last_undegraded":"2024-04-26T11:19:27.210343+0000","last_fullsized":"2024-04-26T11:19:27.210343+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210858+0000","last_change":"2024-04-26T11:13:12.916685+0000","last_active":"2024-04-26T11:19:27.210858+0000","last_peered":"2024-04-26T11:19:27.210858+0000","last_clean":"2024-04-26T11:19:27.210858+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:19:27.210858+0000","last_undegraded":"2024-04-26T11:19:27.210858+0000","last_fullsized":"2024-04-26T11:19:27.210858+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210009+0000","last_change":"2024-04-26T11:19:24.199114+0000","last_active":"2024-04-26T11:19:27.210009+0000","last_peered":"2024-04-26T11:19:27.210009+0000","last_clean":"2024-04-26T11:19:27.210009+0000","last_became_active":"2024-04-26T11:19:24.197647+0000","last_became_peered":"2024-04-26T11:19:24.197647+0000","last_unstale":"2024-04-26T11:19:27.210009+0000","last_undegraded":"2024-04-26T11:19:27.210009+0000","last_fullsized":"2024-04-26T11:19:27.210009+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:49.457951+0000","last_change":"2024-04-26T11:19:49.458065+0000","last_active":"2024-04-26T11:19:49.457951+0000","last_peered":"2024-04-26T11:19:49.457951+0000","last_clean":"2024-04-26T11:19:49.457951+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:19:49.457951+0000","last_undegraded":"2024-04-26T11:19:49.457951+0000","last_fullsized":"2024-04-26T11:19:49.457951+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:49.457903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:49.457903+0000","last_clean_scrub_stamp":"2024-04-26T11:19:49.457903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:29.600094+0000","scrub_duration":0.017036468999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":107,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210490+0000","last_change":"2024-04-26T11:19:18.182547+0000","last_active":"2024-04-26T11:19:27.210490+0000","last_peered":"2024-04-26T11:19:27.210490+0000","last_clean":"2024-04-26T11:19:27.210490+0000","last_became_active":"2024-04-26T11:19:18.181907+0000","last_became_peered":"2024-04-26T11:19:18.181907+0000","last_unstale":"2024-04-26T11:19:27.210490+0000","last_undegraded":"2024-04-26T11:19:27.210490+0000","last_fullsized":"2024-04-26T11:19:27.210490+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210680+0000","last_change":"2024-04-26T11:19:24.201756+0000","last_active":"2024-04-26T11:19:27.210680+0000","last_peered":"2024-04-26T11:19:27.210680+0000","last_clean":"2024-04-26T11:19:27.210680+0000","last_became_active":"2024-04-26T11:19:24.201114+0000","last_became_peered":"2024-04-26T11:19:24.201114+0000","last_unstale":"2024-04-26T11:19:27.210680+0000","last_undegraded":"2024-04-26T11:19:27.210680+0000","last_fullsized":"2024-04-26T11:19:27.210680+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210463+0000","last_change":"2024-04-26T11:19:18.182797+0000","last_active":"2024-04-26T11:19:27.210463+0000","last_peered":"2024-04-26T11:19:27.210463+0000","last_clean":"2024-04-26T11:19:27.210463+0000","last_became_active":"2024-04-26T11:19:18.182017+0000","last_became_peered":"2024-04-26T11:19:18.182017+0000","last_unstale":"2024-04-26T11:19:27.210463+0000","last_undegraded":"2024-04-26T11:19:27.210463+0000","last_fullsized":"2024-04-26T11:19:27.210463+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210787+0000","last_change":"2024-04-26T11:19:24.205310+0000","last_active":"2024-04-26T11:19:27.210787+0000","last_peered":"2024-04-26T11:19:27.210787+0000","last_clean":"2024-04-26T11:19:27.210787+0000","last_became_active":"2024-04-26T11:19:24.204476+0000","last_became_peered":"2024-04-26T11:19:24.204476+0000","last_unstale":"2024-04-26T11:19:27.210787+0000","last_undegraded":"2024-04-26T11:19:27.210787+0000","last_fullsized":"2024-04-26T11:19:27.210787+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"82'2","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:44.505106+0000","last_change":"2024-04-26T11:19:44.505212+0000","last_active":"2024-04-26T11:19:44.505106+0000","last_peered":"2024-04-26T11:19:44.505106+0000","last_clean":"2024-04-26T11:19:44.505106+0000","last_became_active":"2024-04-26T11:19:18.181604+0000","last_became_peered":"2024-04-26T11:19:18.181604+0000","last_unstale":"2024-04-26T11:19:44.505106+0000","last_undegraded":"2024-04-26T11:19:44.505106+0000","last_fullsized":"2024-04-26T11:19:44.505106+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-26T11:19:44.505080+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-26T11:19:44.505080+0000","last_clean_scrub_stamp":"2024-04-26T11:19:44.505080+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:07.623145+0000","scrub_duration":0.0032804549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:36.457819+0000","last_change":"2024-04-26T11:19:36.457819+0000","last_active":"2024-04-26T11:19:36.457819+0000","last_peered":"2024-04-26T11:19:36.457819+0000","last_clean":"2024-04-26T11:19:36.457819+0000","last_became_active":"2024-04-26T11:19:18.181462+0000","last_became_peered":"2024-04-26T11:19:18.181462+0000","last_unstale":"2024-04-26T11:19:36.457819+0000","last_undegraded":"2024-04-26T11:19:36.457819+0000","last_fullsized":"2024-04-26T11:19:36.457819+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:36.457692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:36.457692+0000","last_clean_scrub_stamp":"2024-04-26T11:19:36.457692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:46.158550+0000","scrub_duration":0.0018253519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":110,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.271592+0000","last_change":"2024-04-26T11:19:18.183263+0000","last_active":"2024-04-26T11:19:35.271592+0000","last_peered":"2024-04-26T11:19:35.271592+0000","last_clean":"2024-04-26T11:19:35.271592+0000","last_became_active":"2024-04-26T11:19:18.182242+0000","last_became_peered":"2024-04-26T11:19:18.182242+0000","last_unstale":"2024-04-26T11:19:35.271592+0000","last_undegraded":"2024-04-26T11:19:35.271592+0000","last_fullsized":"2024-04-26T11:19:35.271592+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:53.468976+0000","last_change":"2024-04-26T11:19:53.469071+0000","last_active":"2024-04-26T11:19:53.468976+0000","last_peered":"2024-04-26T11:19:53.468976+0000","last_clean":"2024-04-26T11:19:53.468976+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:19:53.468976+0000","last_undegraded":"2024-04-26T11:19:53.468976+0000","last_fullsized":"2024-04-26T11:19:53.468976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:53.468953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:53.468953+0000","last_clean_scrub_stamp":"2024-04-26T11:19:53.468953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:51:47.714133+0000","scrub_duration":0.0018786149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210716+0000","last_change":"2024-04-26T11:19:18.181652+0000","last_active":"2024-04-26T11:19:27.210716+0000","last_peered":"2024-04-26T11:19:27.210716+0000","last_clean":"2024-04-26T11:19:27.210716+0000","last_became_active":"2024-04-26T11:19:18.180506+0000","last_became_peered":"2024-04-26T11:19:18.180506+0000","last_unstale":"2024-04-26T11:19:27.210716+0000","last_undegraded":"2024-04-26T11:19:27.210716+0000","last_fullsized":"2024-04-26T11:19:27.210716+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:50.503948+0000","last_change":"2024-04-26T11:19:50.504053+0000","last_active":"2024-04-26T11:19:50.503948+0000","last_peered":"2024-04-26T11:19:50.503948+0000","last_clean":"2024-04-26T11:19:50.503948+0000","last_became_active":"2024-04-26T11:19:18.185355+0000","last_became_peered":"2024-04-26T11:19:18.185355+0000","last_unstale":"2024-04-26T11:19:50.503948+0000","last_undegraded":"2024-04-26T11:19:50.503948+0000","last_fullsized":"2024-04-26T11:19:50.503948+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:50.503924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:50.503924+0000","last_clean_scrub_stamp":"2024-04-26T11:19:50.503924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:15.276373+0000","scrub_duration":0.001850661,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:00.590718+0000","last_change":"2024-04-26T11:20:00.590840+0000","last_active":"2024-04-26T11:20:00.590718+0000","last_peered":"2024-04-26T11:20:00.590718+0000","last_clean":"2024-04-26T11:20:00.590718+0000","last_became_active":"2024-04-26T11:19:18.186342+0000","last_became_peered":"2024-04-26T11:19:18.186342+0000","last_unstale":"2024-04-26T11:20:00.590718+0000","last_undegraded":"2024-04-26T11:20:00.590718+0000","last_fullsized":"2024-04-26T11:20:00.590718+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:00.590694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:00.590694+0000","last_clean_scrub_stamp":"2024-04-26T11:20:00.590694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:47.383110+0000","scrub_duration":0.0016301460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:03.588748+0000","last_change":"2024-04-26T11:20:03.588894+0000","last_active":"2024-04-26T11:20:03.588748+0000","last_peered":"2024-04-26T11:20:03.588748+0000","last_clean":"2024-04-26T11:20:03.588748+0000","last_became_active":"2024-04-26T11:19:24.201330+0000","last_became_peered":"2024-04-26T11:19:24.201330+0000","last_unstale":"2024-04-26T11:20:03.588748+0000","last_undegraded":"2024-04-26T11:20:03.588748+0000","last_fullsized":"2024-04-26T11:20:03.588748+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:03.588721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:03.588721+0000","last_clean_scrub_stamp":"2024-04-26T11:20:03.588721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:51.328094+0000","scrub_duration":0.029670523000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"82'3","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:06.586122+0000","last_change":"2024-04-26T11:20:06.586222+0000","last_active":"2024-04-26T11:20:06.586122+0000","last_peered":"2024-04-26T11:20:06.586122+0000","last_clean":"2024-04-26T11:20:06.586122+0000","last_became_active":"2024-04-26T11:19:24.201077+0000","last_became_peered":"2024-04-26T11:19:24.201077+0000","last_unstale":"2024-04-26T11:20:06.586122+0000","last_undegraded":"2024-04-26T11:20:06.586122+0000","last_fullsized":"2024-04-26T11:20:06.586122+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T11:20:06.586097+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T11:20:06.586097+0000","last_clean_scrub_stamp":"2024-04-26T11:20:06.586097+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:06.937690+0000","scrub_duration":0.0032225639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210702+0000","last_change":"2024-04-26T11:19:18.187865+0000","last_active":"2024-04-26T11:19:27.210702+0000","last_peered":"2024-04-26T11:19:27.210702+0000","last_clean":"2024-04-26T11:19:27.210702+0000","last_became_active":"2024-04-26T11:19:18.185768+0000","last_became_peered":"2024-04-26T11:19:18.185768+0000","last_unstale":"2024-04-26T11:19:27.210702+0000","last_undegraded":"2024-04-26T11:19:27.210702+0000","last_fullsized":"2024-04-26T11:19:27.210702+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210211+0000","last_change":"2024-04-26T11:19:18.186275+0000","last_active":"2024-04-26T11:19:27.210211+0000","last_peered":"2024-04-26T11:19:27.210211+0000","last_clean":"2024-04-26T11:19:27.210211+0000","last_became_active":"2024-04-26T11:19:18.184149+0000","last_became_peered":"2024-04-26T11:19:18.184149+0000","last_unstale":"2024-04-26T11:19:27.210211+0000","last_undegraded":"2024-04-26T11:19:27.210211+0000","last_fullsized":"2024-04-26T11:19:27.210211+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:36.619910+0000","last_change":"2024-04-26T11:19:36.620064+0000","last_active":"2024-04-26T11:19:36.619910+0000","last_peered":"2024-04-26T11:19:36.619910+0000","last_clean":"2024-04-26T11:19:36.619910+0000","last_became_active":"2024-04-26T11:19:18.181951+0000","last_became_peered":"2024-04-26T11:19:18.181951+0000","last_unstale":"2024-04-26T11:19:36.619910+0000","last_undegraded":"2024-04-26T11:19:36.619910+0000","last_fullsized":"2024-04-26T11:19:36.619910+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:36.619885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:36.619885+0000","last_clean_scrub_stamp":"2024-04-26T11:19:36.619885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:06.660819+0000","scrub_duration":0.001669823,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.271533+0000","last_change":"2024-04-26T11:19:18.182240+0000","last_active":"2024-04-26T11:19:35.271533+0000","last_peered":"2024-04-26T11:19:35.271533+0000","last_clean":"2024-04-26T11:19:35.271533+0000","last_became_active":"2024-04-26T11:19:18.181767+0000","last_became_peered":"2024-04-26T11:19:18.181767+0000","last_unstale":"2024-04-26T11:19:35.271533+0000","last_undegraded":"2024-04-26T11:19:35.271533+0000","last_fullsized":"2024-04-26T11:19:35.271533+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:37.612117+0000","last_change":"2024-04-26T11:19:37.612253+0000","last_active":"2024-04-26T11:19:37.612117+0000","last_peered":"2024-04-26T11:19:37.612117+0000","last_clean":"2024-04-26T11:19:37.612117+0000","last_became_active":"2024-04-26T11:19:18.182060+0000","last_became_peered":"2024-04-26T11:19:18.182060+0000","last_unstale":"2024-04-26T11:19:37.612117+0000","last_undegraded":"2024-04-26T11:19:37.612117+0000","last_fullsized":"2024-04-26T11:19:37.612117+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:37.612061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:37.612061+0000","last_clean_scrub_stamp":"2024-04-26T11:19:37.612061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:24.175151+0000","scrub_duration":0.0016765459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.271558+0000","last_change":"2024-04-26T11:13:12.493217+0000","last_active":"2024-04-26T11:19:35.271558+0000","last_peered":"2024-04-26T11:19:35.271558+0000","last_clean":"2024-04-26T11:19:35.271558+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:19:35.271558+0000","last_undegraded":"2024-04-26T11:19:35.271558+0000","last_fullsized":"2024-04-26T11:19:35.271558+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:48.777587+0000","last_change":"2024-04-26T11:19:48.777713+0000","last_active":"2024-04-26T11:19:48.777587+0000","last_peered":"2024-04-26T11:19:48.777587+0000","last_clean":"2024-04-26T11:19:48.777587+0000","last_became_active":"2024-04-26T11:19:24.203758+0000","last_became_peered":"2024-04-26T11:19:24.203758+0000","last_unstale":"2024-04-26T11:19:48.777587+0000","last_undegraded":"2024-04-26T11:19:48.777587+0000","last_fullsized":"2024-04-26T11:19:48.777587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:48.777563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:48.777563+0000","last_clean_scrub_stamp":"2024-04-26T11:19:48.777563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:26.143928+0000","scrub_duration":0.058175359000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210353+0000","last_change":"2024-04-26T11:19:24.201687+0000","last_active":"2024-04-26T11:19:27.210353+0000","last_peered":"2024-04-26T11:19:27.210353+0000","last_clean":"2024-04-26T11:19:27.210353+0000","last_became_active":"2024-04-26T11:19:24.200963+0000","last_became_peered":"2024-04-26T11:19:24.200963+0000","last_unstale":"2024-04-26T11:19:27.210353+0000","last_undegraded":"2024-04-26T11:19:27.210353+0000","last_fullsized":"2024-04-26T11:19:27.210353+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211210+0000","last_change":"2024-04-26T11:19:18.189488+0000","last_active":"2024-04-26T11:19:27.211210+0000","last_peered":"2024-04-26T11:19:27.211210+0000","last_clean":"2024-04-26T11:19:27.211210+0000","last_became_active":"2024-04-26T11:19:18.189086+0000","last_became_peered":"2024-04-26T11:19:18.189086+0000","last_unstale":"2024-04-26T11:19:27.211210+0000","last_undegraded":"2024-04-26T11:19:27.211210+0000","last_fullsized":"2024-04-26T11:19:27.211210+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:05.442392+0000","last_change":"2024-04-26T11:20:05.442516+0000","last_active":"2024-04-26T11:20:05.442392+0000","last_peered":"2024-04-26T11:20:05.442392+0000","last_clean":"2024-04-26T11:20:05.442392+0000","last_became_active":"2024-04-26T11:19:18.181791+0000","last_became_peered":"2024-04-26T11:19:18.181791+0000","last_unstale":"2024-04-26T11:20:05.442392+0000","last_undegraded":"2024-04-26T11:20:05.442392+0000","last_fullsized":"2024-04-26T11:20:05.442392+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:05.442367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:05.442367+0000","last_clean_scrub_stamp":"2024-04-26T11:20:05.442367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:48.858203+0000","scrub_duration":0.001909062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210246+0000","last_change":"2024-04-26T11:19:18.185313+0000","last_active":"2024-04-26T11:19:27.210246+0000","last_peered":"2024-04-26T11:19:27.210246+0000","last_clean":"2024-04-26T11:19:27.210246+0000","last_became_active":"2024-04-26T11:19:18.183292+0000","last_became_peered":"2024-04-26T11:19:18.183292+0000","last_unstale":"2024-04-26T11:19:27.210246+0000","last_undegraded":"2024-04-26T11:19:27.210246+0000","last_fullsized":"2024-04-26T11:19:27.210246+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210983+0000","last_change":"2024-04-26T11:19:18.190450+0000","last_active":"2024-04-26T11:19:27.210983+0000","last_peered":"2024-04-26T11:19:27.210983+0000","last_clean":"2024-04-26T11:19:27.210983+0000","last_became_active":"2024-04-26T11:19:18.190096+0000","last_became_peered":"2024-04-26T11:19:18.190096+0000","last_unstale":"2024-04-26T11:19:27.210983+0000","last_undegraded":"2024-04-26T11:19:27.210983+0000","last_fullsized":"2024-04-26T11:19:27.210983+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210232+0000","last_change":"2024-04-26T11:19:24.200305+0000","last_active":"2024-04-26T11:19:27.210232+0000","last_peered":"2024-04-26T11:19:27.210232+0000","last_clean":"2024-04-26T11:19:27.210232+0000","last_became_active":"2024-04-26T11:19:24.199834+0000","last_became_peered":"2024-04-26T11:19:24.199834+0000","last_unstale":"2024-04-26T11:19:27.210232+0000","last_undegraded":"2024-04-26T11:19:27.210232+0000","last_fullsized":"2024-04-26T11:19:27.210232+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:56.642304+0000","last_change":"2024-04-26T11:19:56.642416+0000","last_active":"2024-04-26T11:19:56.642304+0000","last_peered":"2024-04-26T11:19:56.642304+0000","last_clean":"2024-04-26T11:19:56.642304+0000","last_became_active":"2024-04-26T11:19:24.196561+0000","last_became_peered":"2024-04-26T11:19:24.196561+0000","last_unstale":"2024-04-26T11:19:56.642304+0000","last_undegraded":"2024-04-26T11:19:56.642304+0000","last_fullsized":"2024-04-26T11:19:56.642304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:56.642282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:56.642282+0000","last_clean_scrub_stamp":"2024-04-26T11:19:56.642282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:16.768522+0000","scrub_duration":0.001607296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210331+0000","last_change":"2024-04-26T11:19:18.182680+0000","last_active":"2024-04-26T11:19:27.210331+0000","last_peered":"2024-04-26T11:19:27.210331+0000","last_clean":"2024-04-26T11:19:27.210331+0000","last_became_active":"2024-04-26T11:19:18.182077+0000","last_became_peered":"2024-04-26T11:19:18.182077+0000","last_unstale":"2024-04-26T11:19:27.210331+0000","last_undegraded":"2024-04-26T11:19:27.210331+0000","last_fullsized":"2024-04-26T11:19:27.210331+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210738+0000","last_change":"2024-04-26T11:19:24.205473+0000","last_active":"2024-04-26T11:19:27.210738+0000","last_peered":"2024-04-26T11:19:27.210738+0000","last_clean":"2024-04-26T11:19:27.210738+0000","last_became_active":"2024-04-26T11:19:24.204538+0000","last_became_peered":"2024-04-26T11:19:24.204538+0000","last_unstale":"2024-04-26T11:19:27.210738+0000","last_undegraded":"2024-04-26T11:19:27.210738+0000","last_fullsized":"2024-04-26T11:19:27.210738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210430+0000","last_change":"2024-04-26T11:19:18.186884+0000","last_active":"2024-04-26T11:19:27.210430+0000","last_peered":"2024-04-26T11:19:27.210430+0000","last_clean":"2024-04-26T11:19:27.210430+0000","last_became_active":"2024-04-26T11:19:18.184460+0000","last_became_peered":"2024-04-26T11:19:18.184460+0000","last_unstale":"2024-04-26T11:19:27.210430+0000","last_undegraded":"2024-04-26T11:19:27.210430+0000","last_fullsized":"2024-04-26T11:19:27.210430+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":235,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210220+0000","last_change":"2024-04-26T11:19:18.181070+0000","last_active":"2024-04-26T11:19:27.210220+0000","last_peered":"2024-04-26T11:19:27.210220+0000","last_clean":"2024-04-26T11:19:27.210220+0000","last_became_active":"2024-04-26T11:19:18.180577+0000","last_became_peered":"2024-04-26T11:19:18.180577+0000","last_unstale":"2024-04-26T11:19:27.210220+0000","last_undegraded":"2024-04-26T11:19:27.210220+0000","last_fullsized":"2024-04-26T11:19:27.210220+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.209868+0000","last_change":"2024-04-26T11:19:24.197315+0000","last_active":"2024-04-26T11:19:27.209868+0000","last_peered":"2024-04-26T11:19:27.209868+0000","last_clean":"2024-04-26T11:19:27.209868+0000","last_became_active":"2024-04-26T11:19:24.196404+0000","last_became_peered":"2024-04-26T11:19:24.196404+0000","last_unstale":"2024-04-26T11:19:27.209868+0000","last_undegraded":"2024-04-26T11:19:27.209868+0000","last_fullsized":"2024-04-26T11:19:27.209868+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:09.531099+0000","last_change":"2024-04-26T11:20:09.531227+0000","last_active":"2024-04-26T11:20:09.531099+0000","last_peered":"2024-04-26T11:20:09.531099+0000","last_clean":"2024-04-26T11:20:09.531099+0000","last_became_active":"2024-04-26T11:19:18.181863+0000","last_became_peered":"2024-04-26T11:19:18.181863+0000","last_unstale":"2024-04-26T11:20:09.531099+0000","last_undegraded":"2024-04-26T11:20:09.531099+0000","last_fullsized":"2024-04-26T11:20:09.531099+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:09.531073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:09.531073+0000","last_clean_scrub_stamp":"2024-04-26T11:20:09.531073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:28.881302+0000","scrub_duration":0.0020025820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210332+0000","last_change":"2024-04-26T11:19:18.181362+0000","last_active":"2024-04-26T11:19:27.210332+0000","last_peered":"2024-04-26T11:19:27.210332+0000","last_clean":"2024-04-26T11:19:27.210332+0000","last_became_active":"2024-04-26T11:19:18.180792+0000","last_became_peered":"2024-04-26T11:19:18.180792+0000","last_unstale":"2024-04-26T11:19:27.210332+0000","last_undegraded":"2024-04-26T11:19:27.210332+0000","last_fullsized":"2024-04-26T11:19:27.210332+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:28.114595+0000","last_change":"2024-04-26T11:19:24.199071+0000","last_active":"2024-04-26T11:19:28.114595+0000","last_peered":"2024-04-26T11:19:28.114595+0000","last_clean":"2024-04-26T11:19:28.114595+0000","last_became_active":"2024-04-26T11:19:24.197711+0000","last_became_peered":"2024-04-26T11:19:24.197711+0000","last_unstale":"2024-04-26T11:19:28.114595+0000","last_undegraded":"2024-04-26T11:19:28.114595+0000","last_fullsized":"2024-04-26T11:19:28.114595+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.271720+0000","last_change":"2024-04-26T11:13:12.918648+0000","last_active":"2024-04-26T11:19:35.271720+0000","last_peered":"2024-04-26T11:19:35.271720+0000","last_clean":"2024-04-26T11:19:35.271720+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:19:35.271720+0000","last_undegraded":"2024-04-26T11:19:35.271720+0000","last_fullsized":"2024-04-26T11:19:35.271720+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211253+0000","last_change":"2024-04-26T11:13:08.110433+0000","last_active":"2024-04-26T11:19:27.211253+0000","last_peered":"2024-04-26T11:19:27.211253+0000","last_clean":"2024-04-26T11:19:27.211253+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:19:27.211253+0000","last_undegraded":"2024-04-26T11:19:27.211253+0000","last_fullsized":"2024-04-26T11:19:27.211253+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:46.745793+0000","last_change":"2024-04-26T11:19:46.745918+0000","last_active":"2024-04-26T11:19:46.745793+0000","last_peered":"2024-04-26T11:19:46.745793+0000","last_clean":"2024-04-26T11:19:46.745793+0000","last_became_active":"2024-04-26T11:19:24.202550+0000","last_became_peered":"2024-04-26T11:19:24.202550+0000","last_unstale":"2024-04-26T11:19:46.745793+0000","last_undegraded":"2024-04-26T11:19:46.745793+0000","last_fullsized":"2024-04-26T11:19:46.745793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:46.745769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:46.745769+0000","last_clean_scrub_stamp":"2024-04-26T11:19:46.745769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:09.707603+0000","scrub_duration":0.001879981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:54.434747+0000","last_change":"2024-04-26T11:19:54.434856+0000","last_active":"2024-04-26T11:19:54.434747+0000","last_peered":"2024-04-26T11:19:54.434747+0000","last_clean":"2024-04-26T11:19:54.434747+0000","last_became_active":"2024-04-26T11:19:18.182186+0000","last_became_peered":"2024-04-26T11:19:18.182186+0000","last_unstale":"2024-04-26T11:19:54.434747+0000","last_undegraded":"2024-04-26T11:19:54.434747+0000","last_fullsized":"2024-04-26T11:19:54.434747+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:54.434725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:54.434725+0000","last_clean_scrub_stamp":"2024-04-26T11:19:54.434725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:50.801459+0000","scrub_duration":0.0020204099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"82'3","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:07.630037+0000","last_change":"2024-04-26T11:20:07.630175+0000","last_active":"2024-04-26T11:20:07.630037+0000","last_peered":"2024-04-26T11:20:07.630037+0000","last_clean":"2024-04-26T11:20:07.630037+0000","last_became_active":"2024-04-26T11:19:24.202310+0000","last_became_peered":"2024-04-26T11:19:24.202310+0000","last_unstale":"2024-04-26T11:20:07.630037+0000","last_undegraded":"2024-04-26T11:20:07.630037+0000","last_fullsized":"2024-04-26T11:20:07.630037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T11:20:07.629975+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T11:20:07.629975+0000","last_clean_scrub_stamp":"2024-04-26T11:20:07.629975+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:21.316423+0000","scrub_duration":0.003499748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210609+0000","last_change":"2024-04-26T11:19:24.202951+0000","last_active":"2024-04-26T11:19:27.210609+0000","last_peered":"2024-04-26T11:19:27.210609+0000","last_clean":"2024-04-26T11:19:27.210609+0000","last_became_active":"2024-04-26T11:19:24.202566+0000","last_became_peered":"2024-04-26T11:19:24.202566+0000","last_unstale":"2024-04-26T11:19:27.210609+0000","last_undegraded":"2024-04-26T11:19:27.210609+0000","last_fullsized":"2024-04-26T11:19:27.210609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.209705+0000","last_change":"2024-04-26T11:19:24.198685+0000","last_active":"2024-04-26T11:19:27.209705+0000","last_peered":"2024-04-26T11:19:27.209705+0000","last_clean":"2024-04-26T11:19:27.209705+0000","last_became_active":"2024-04-26T11:19:24.197383+0000","last_became_peered":"2024-04-26T11:19:24.197383+0000","last_unstale":"2024-04-26T11:19:27.209705+0000","last_undegraded":"2024-04-26T11:19:27.209705+0000","last_fullsized":"2024-04-26T11:19:27.209705+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211135+0000","last_change":"2024-04-26T11:19:18.181795+0000","last_active":"2024-04-26T11:19:27.211135+0000","last_peered":"2024-04-26T11:19:27.211135+0000","last_clean":"2024-04-26T11:19:27.211135+0000","last_became_active":"2024-04-26T11:19:18.180871+0000","last_became_peered":"2024-04-26T11:19:18.180871+0000","last_unstale":"2024-04-26T11:19:27.211135+0000","last_undegraded":"2024-04-26T11:19:27.211135+0000","last_fullsized":"2024-04-26T11:19:27.211135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:34.750941+0000","last_change":"2024-04-26T11:19:24.200015+0000","last_active":"2024-04-26T11:19:34.750941+0000","last_peered":"2024-04-26T11:19:34.750941+0000","last_clean":"2024-04-26T11:19:34.750941+0000","last_became_active":"2024-04-26T11:19:24.198853+0000","last_became_peered":"2024-04-26T11:19:24.198853+0000","last_unstale":"2024-04-26T11:19:34.750941+0000","last_undegraded":"2024-04-26T11:19:34.750941+0000","last_fullsized":"2024-04-26T11:19:34.750941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:08.427084+0000","last_change":"2024-04-26T11:20:08.427208+0000","last_active":"2024-04-26T11:20:08.427084+0000","last_peered":"2024-04-26T11:20:08.427084+0000","last_clean":"2024-04-26T11:20:08.427084+0000","last_became_active":"2024-04-26T11:19:18.182228+0000","last_became_peered":"2024-04-26T11:19:18.182228+0000","last_unstale":"2024-04-26T11:20:08.427084+0000","last_undegraded":"2024-04-26T11:20:08.427084+0000","last_fullsized":"2024-04-26T11:20:08.427084+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:08.427044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:08.427044+0000","last_clean_scrub_stamp":"2024-04-26T11:20:08.427044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:44.490541+0000","scrub_duration":0.0019152240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":111,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210600+0000","last_change":"2024-04-26T11:19:18.183238+0000","last_active":"2024-04-26T11:19:27.210600+0000","last_peered":"2024-04-26T11:19:27.210600+0000","last_clean":"2024-04-26T11:19:27.210600+0000","last_became_active":"2024-04-26T11:19:18.182671+0000","last_became_peered":"2024-04-26T11:19:18.182671+0000","last_unstale":"2024-04-26T11:19:27.210600+0000","last_undegraded":"2024-04-26T11:19:27.210600+0000","last_fullsized":"2024-04-26T11:19:27.210600+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:58.458609+0000","last_change":"2024-04-26T11:19:58.458718+0000","last_active":"2024-04-26T11:19:58.458609+0000","last_peered":"2024-04-26T11:19:58.458609+0000","last_clean":"2024-04-26T11:19:58.458609+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:19:58.458609+0000","last_undegraded":"2024-04-26T11:19:58.458609+0000","last_fullsized":"2024-04-26T11:19:58.458609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:58.458587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:58.458587+0000","last_clean_scrub_stamp":"2024-04-26T11:19:58.458587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:28.129815+0000","scrub_duration":0.001786494,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"82'3","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:39.596075+0000","last_change":"2024-04-26T11:19:39.596215+0000","last_active":"2024-04-26T11:19:39.596075+0000","last_peered":"2024-04-26T11:19:39.596075+0000","last_clean":"2024-04-26T11:19:39.596075+0000","last_became_active":"2024-04-26T11:19:18.188177+0000","last_became_peered":"2024-04-26T11:19:18.188177+0000","last_unstale":"2024-04-26T11:19:39.596075+0000","last_undegraded":"2024-04-26T11:19:39.596075+0000","last_fullsized":"2024-04-26T11:19:39.596075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T11:19:39.596051+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T11:19:39.596051+0000","last_clean_scrub_stamp":"2024-04-26T11:19:39.596051+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:18.488192+0000","scrub_duration":0.0035445559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:38.600610+0000","last_change":"2024-04-26T11:19:38.600786+0000","last_active":"2024-04-26T11:19:38.600610+0000","last_peered":"2024-04-26T11:19:38.600610+0000","last_clean":"2024-04-26T11:19:38.600610+0000","last_became_active":"2024-04-26T11:19:18.185372+0000","last_became_peered":"2024-04-26T11:19:18.185372+0000","last_unstale":"2024-04-26T11:19:38.600610+0000","last_undegraded":"2024-04-26T11:19:38.600610+0000","last_fullsized":"2024-04-26T11:19:38.600610+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:38.600585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:38.600585+0000","last_clean_scrub_stamp":"2024-04-26T11:19:38.600585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:00.495830+0000","scrub_duration":0.026821652000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211073+0000","last_change":"2024-04-26T11:19:18.190885+0000","last_active":"2024-04-26T11:19:27.211073+0000","last_peered":"2024-04-26T11:19:27.211073+0000","last_clean":"2024-04-26T11:19:27.211073+0000","last_became_active":"2024-04-26T11:19:18.190374+0000","last_became_peered":"2024-04-26T11:19:18.190374+0000","last_unstale":"2024-04-26T11:19:27.211073+0000","last_undegraded":"2024-04-26T11:19:27.211073+0000","last_fullsized":"2024-04-26T11:19:27.211073+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210709+0000","last_change":"2024-04-26T11:19:18.189666+0000","last_active":"2024-04-26T11:19:27.210709+0000","last_peered":"2024-04-26T11:19:27.210709+0000","last_clean":"2024-04-26T11:19:27.210709+0000","last_became_active":"2024-04-26T11:19:18.189341+0000","last_became_peered":"2024-04-26T11:19:18.189341+0000","last_unstale":"2024-04-26T11:19:27.210709+0000","last_undegraded":"2024-04-26T11:19:27.210709+0000","last_fullsized":"2024-04-26T11:19:27.210709+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210706+0000","last_change":"2024-04-26T11:19:24.202866+0000","last_active":"2024-04-26T11:19:27.210706+0000","last_peered":"2024-04-26T11:19:27.210706+0000","last_clean":"2024-04-26T11:19:27.210706+0000","last_became_active":"2024-04-26T11:19:24.202422+0000","last_became_peered":"2024-04-26T11:19:24.202422+0000","last_unstale":"2024-04-26T11:19:27.210706+0000","last_undegraded":"2024-04-26T11:19:27.210706+0000","last_fullsized":"2024-04-26T11:19:27.210706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210728+0000","last_change":"2024-04-26T11:13:12.917763+0000","last_active":"2024-04-26T11:19:27.210728+0000","last_peered":"2024-04-26T11:19:27.210728+0000","last_clean":"2024-04-26T11:19:27.210728+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:19:27.210728+0000","last_undegraded":"2024-04-26T11:19:27.210728+0000","last_fullsized":"2024-04-26T11:19:27.210728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210688+0000","last_change":"2024-04-26T11:19:24.205087+0000","last_active":"2024-04-26T11:19:27.210688+0000","last_peered":"2024-04-26T11:19:27.210688+0000","last_clean":"2024-04-26T11:19:27.210688+0000","last_became_active":"2024-04-26T11:19:24.204129+0000","last_became_peered":"2024-04-26T11:19:24.204129+0000","last_unstale":"2024-04-26T11:19:27.210688+0000","last_undegraded":"2024-04-26T11:19:27.210688+0000","last_fullsized":"2024-04-26T11:19:27.210688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210568+0000","last_change":"2024-04-26T11:19:18.189530+0000","last_active":"2024-04-26T11:19:27.210568+0000","last_peered":"2024-04-26T11:19:27.210568+0000","last_clean":"2024-04-26T11:19:27.210568+0000","last_became_active":"2024-04-26T11:19:18.189179+0000","last_became_peered":"2024-04-26T11:19:18.189179+0000","last_unstale":"2024-04-26T11:19:27.210568+0000","last_undegraded":"2024-04-26T11:19:27.210568+0000","last_fullsized":"2024-04-26T11:19:27.210568+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:40.624649+0000","last_change":"2024-04-26T11:19:40.624780+0000","last_active":"2024-04-26T11:19:40.624649+0000","last_peered":"2024-04-26T11:19:40.624649+0000","last_clean":"2024-04-26T11:19:40.624649+0000","last_became_active":"2024-04-26T11:19:18.188963+0000","last_became_peered":"2024-04-26T11:19:18.188963+0000","last_unstale":"2024-04-26T11:19:40.624649+0000","last_undegraded":"2024-04-26T11:19:40.624649+0000","last_fullsized":"2024-04-26T11:19:40.624649+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:40.624624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:40.624624+0000","last_clean_scrub_stamp":"2024-04-26T11:19:40.624624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:51.952842+0000","scrub_duration":0.0017518169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:04.580384+0000","last_change":"2024-04-26T11:20:04.580503+0000","last_active":"2024-04-26T11:20:04.580384+0000","last_peered":"2024-04-26T11:20:04.580384+0000","last_clean":"2024-04-26T11:20:04.580384+0000","last_became_active":"2024-04-26T11:19:24.198397+0000","last_became_peered":"2024-04-26T11:19:24.198397+0000","last_unstale":"2024-04-26T11:20:04.580384+0000","last_undegraded":"2024-04-26T11:20:04.580384+0000","last_fullsized":"2024-04-26T11:20:04.580384+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:04.580360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:04.580360+0000","last_clean_scrub_stamp":"2024-04-26T11:20:04.580360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:29.686078+0000","scrub_duration":0.0018333259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":107,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:31.632525+0000","last_change":"2024-04-26T11:19:18.183441+0000","last_active":"2024-04-26T11:19:31.632525+0000","last_peered":"2024-04-26T11:19:31.632525+0000","last_clean":"2024-04-26T11:19:31.632525+0000","last_became_active":"2024-04-26T11:19:18.183037+0000","last_became_peered":"2024-04-26T11:19:18.183037+0000","last_unstale":"2024-04-26T11:19:31.632525+0000","last_undegraded":"2024-04-26T11:19:31.632525+0000","last_fullsized":"2024-04-26T11:19:31.632525+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:55.673443+0000","last_change":"2024-04-26T11:19:55.673586+0000","last_active":"2024-04-26T11:19:55.673443+0000","last_peered":"2024-04-26T11:19:55.673443+0000","last_clean":"2024-04-26T11:19:55.673443+0000","last_became_active":"2024-04-26T11:19:24.202442+0000","last_became_peered":"2024-04-26T11:19:24.202442+0000","last_unstale":"2024-04-26T11:19:55.673443+0000","last_undegraded":"2024-04-26T11:19:55.673443+0000","last_fullsized":"2024-04-26T11:19:55.673443+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:55.673417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:55.673417+0000","last_clean_scrub_stamp":"2024-04-26T11:19:55.673417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:51.687827+0000","scrub_duration":0.029303546,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:51.420225+0000","last_change":"2024-04-26T11:19:51.420347+0000","last_active":"2024-04-26T11:19:51.420225+0000","last_peered":"2024-04-26T11:19:51.420225+0000","last_clean":"2024-04-26T11:19:51.420225+0000","last_became_active":"2024-04-26T11:19:18.184384+0000","last_became_peered":"2024-04-26T11:19:18.184384+0000","last_unstale":"2024-04-26T11:19:51.420225+0000","last_undegraded":"2024-04-26T11:19:51.420225+0000","last_fullsized":"2024-04-26T11:19:51.420225+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:51.420205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:51.420205+0000","last_clean_scrub_stamp":"2024-04-26T11:19:51.420205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:55.572118+0000","scrub_duration":0.001998835,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7958,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738456,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281144,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94090696,"statfs":{"total":96636764160,"available":96348872704,"internally_reserved":0,"allocated":1490944,"data_stored":947441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":1,"last update":"Fri Apr 26 11:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45800000000000002,"15min":0.39600000000000002},"min":{"1min":0.34399999999999997,"5min":0.17999999999999999,"15min":0.17199999999999999},"max":{"1min":0.68100000000000005,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.316,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.66400000000000003,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.56399999999999995}]}]},{"osd":0,"up_from":75,"seq":322122547213,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38148,"kb_used_data":1468,"kb_used_omap":10,"kb_used_meta":36661,"kb_avail":94333692,"statfs":{"total":96636764160,"available":96597700608,"internally_reserved":0,"allocated":1503232,"data_stored":949168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11228,"internal_metadata":37540900},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738457,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401128,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":400254,"kb_avail":93970712,"statfs":{"total":96636764160,"available":96226009088,"internally_reserved":0,"allocated":884736,"data_stored":357054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":409860550},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":2,"last update":"Fri Apr 26 11:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.44700000000000001,"15min":0.40699999999999997},"min":{"1min":0.34999999999999998,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.69199999999999995,"5min":2.056,"15min":2.056},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.499,"15min":0.46400000000000002},"min":{"1min":0.376,"5min":0.193,"15min":0.193},"max":{"1min":0.67600000000000005,"5min":3.9609999999999999,"15min":3.9609999999999999},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7958,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:20:16.430 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.430 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.431 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.431 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.431 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.431 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.431 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.431 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.431 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.431 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.432 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.432 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.432 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.432 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.432 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.432 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.432 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.432 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.432 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.433 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.433 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.433 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.433 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.433 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.433 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.433 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.433 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.433 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.433 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.434 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.434 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.434 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.434 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.434 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.434 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.434 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.434 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.435 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.435 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.435 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.435 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.435 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.435 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.435 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.435 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.435 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.436 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.436 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.436 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.436 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.436 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.436 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.436 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.436 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.436 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.437 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.437 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.437 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.437 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.437 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.437 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.437 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.437 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:16.437 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T11:20:36.439 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:20:36.802 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:20:36.804 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:20:36.813 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-04-26T11:20:36.577890+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":720420,"kb_used_data":3788,"kb_used_omap":14,"kb_used_meta":716593,"kb_avail":282395100,"statfs":{"total":289910292480,"available":289172582400,"internally_reserved":0,"allocated":3878912,"data_stored":2253663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14416,"internal_metadata":733792176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002878"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:31.632644+0000","last_change":"2024-04-26T11:13:12.919196+0000","last_active":"2024-04-26T11:19:31.632644+0000","last_peered":"2024-04-26T11:19:31.632644+0000","last_clean":"2024-04-26T11:19:31.632644+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:19:31.632644+0000","last_undegraded":"2024-04-26T11:19:31.632644+0000","last_fullsized":"2024-04-26T11:19:31.632644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:31.632604+0000","last_change":"2024-04-26T11:13:12.917670+0000","last_active":"2024-04-26T11:19:31.632604+0000","last_peered":"2024-04-26T11:19:31.632604+0000","last_clean":"2024-04-26T11:19:31.632604+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:19:31.632604+0000","last_undegraded":"2024-04-26T11:19:31.632604+0000","last_fullsized":"2024-04-26T11:19:31.632604+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211220+0000","last_change":"2024-04-26T11:19:18.185209+0000","last_active":"2024-04-26T11:19:27.211220+0000","last_peered":"2024-04-26T11:19:27.211220+0000","last_clean":"2024-04-26T11:19:27.211220+0000","last_became_active":"2024-04-26T11:19:18.182972+0000","last_became_peered":"2024-04-26T11:19:18.182972+0000","last_unstale":"2024-04-26T11:19:27.211220+0000","last_undegraded":"2024-04-26T11:19:27.211220+0000","last_fullsized":"2024-04-26T11:19:27.211220+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210609+0000","last_change":"2024-04-26T11:19:18.183286+0000","last_active":"2024-04-26T11:19:27.210609+0000","last_peered":"2024-04-26T11:19:27.210609+0000","last_clean":"2024-04-26T11:19:27.210609+0000","last_became_active":"2024-04-26T11:19:18.182942+0000","last_became_peered":"2024-04-26T11:19:18.182942+0000","last_unstale":"2024-04-26T11:19:27.210609+0000","last_undegraded":"2024-04-26T11:19:27.210609+0000","last_fullsized":"2024-04-26T11:19:27.210609+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:50.417947+0000","last_change":"2024-04-26T11:19:50.418051+0000","last_active":"2024-04-26T11:19:50.417947+0000","last_peered":"2024-04-26T11:19:50.417947+0000","last_clean":"2024-04-26T11:19:50.417947+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:19:50.417947+0000","last_undegraded":"2024-04-26T11:19:50.417947+0000","last_fullsized":"2024-04-26T11:19:50.417947+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:50.417924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:50.417924+0000","last_clean_scrub_stamp":"2024-04-26T11:19:50.417924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:25.937563+0000","scrub_duration":0.016392371999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210596+0000","last_change":"2024-04-26T11:19:18.189355+0000","last_active":"2024-04-26T11:19:27.210596+0000","last_peered":"2024-04-26T11:19:27.210596+0000","last_clean":"2024-04-26T11:19:27.210596+0000","last_became_active":"2024-04-26T11:19:18.188990+0000","last_became_peered":"2024-04-26T11:19:18.188990+0000","last_unstale":"2024-04-26T11:19:27.210596+0000","last_undegraded":"2024-04-26T11:19:27.210596+0000","last_fullsized":"2024-04-26T11:19:27.210596+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:45.509116+0000","last_change":"2024-04-26T11:19:45.509220+0000","last_active":"2024-04-26T11:19:45.509116+0000","last_peered":"2024-04-26T11:19:45.509116+0000","last_clean":"2024-04-26T11:19:45.509116+0000","last_became_active":"2024-04-26T11:19:18.186638+0000","last_became_peered":"2024-04-26T11:19:18.186638+0000","last_unstale":"2024-04-26T11:19:45.509116+0000","last_undegraded":"2024-04-26T11:19:45.509116+0000","last_fullsized":"2024-04-26T11:19:45.509116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:45.509090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:45.509090+0000","last_clean_scrub_stamp":"2024-04-26T11:19:45.509090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:05.567613+0000","scrub_duration":0.017637363999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:23.683390+0000","last_change":"2024-04-26T11:20:23.683509+0000","last_active":"2024-04-26T11:20:23.683390+0000","last_peered":"2024-04-26T11:20:23.683390+0000","last_clean":"2024-04-26T11:20:23.683390+0000","last_became_active":"2024-04-26T11:19:18.182111+0000","last_became_peered":"2024-04-26T11:19:18.182111+0000","last_unstale":"2024-04-26T11:20:23.683390+0000","last_undegraded":"2024-04-26T11:20:23.683390+0000","last_fullsized":"2024-04-26T11:20:23.683390+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:23.683352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:23.683352+0000","last_clean_scrub_stamp":"2024-04-26T11:20:23.683352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:37.939942+0000","scrub_duration":0.001634702,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210559+0000","last_change":"2024-04-26T11:19:24.202861+0000","last_active":"2024-04-26T11:19:27.210559+0000","last_peered":"2024-04-26T11:19:27.210559+0000","last_clean":"2024-04-26T11:19:27.210559+0000","last_became_active":"2024-04-26T11:19:24.202146+0000","last_became_peered":"2024-04-26T11:19:24.202146+0000","last_unstale":"2024-04-26T11:19:27.210559+0000","last_undegraded":"2024-04-26T11:19:27.210559+0000","last_fullsized":"2024-04-26T11:19:27.210559+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.271976+0000","last_change":"2024-04-26T11:13:12.918521+0000","last_active":"2024-04-26T11:19:35.271976+0000","last_peered":"2024-04-26T11:19:35.271976+0000","last_clean":"2024-04-26T11:19:35.271976+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:19:35.271976+0000","last_undegraded":"2024-04-26T11:19:35.271976+0000","last_fullsized":"2024-04-26T11:19:35.271976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:52.515823+0000","last_change":"2024-04-26T11:19:52.515987+0000","last_active":"2024-04-26T11:19:52.515823+0000","last_peered":"2024-04-26T11:19:52.515823+0000","last_clean":"2024-04-26T11:19:52.515823+0000","last_became_active":"2024-04-26T11:19:18.185543+0000","last_became_peered":"2024-04-26T11:19:18.185543+0000","last_unstale":"2024-04-26T11:19:52.515823+0000","last_undegraded":"2024-04-26T11:19:52.515823+0000","last_fullsized":"2024-04-26T11:19:52.515823+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:52.515775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:52.515775+0000","last_clean_scrub_stamp":"2024-04-26T11:19:52.515775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.954162+0000","scrub_duration":0.016652819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":107,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.271910+0000","last_change":"2024-04-26T11:19:18.183459+0000","last_active":"2024-04-26T11:19:35.271910+0000","last_peered":"2024-04-26T11:19:35.271910+0000","last_clean":"2024-04-26T11:19:35.271910+0000","last_became_active":"2024-04-26T11:19:18.182827+0000","last_became_peered":"2024-04-26T11:19:18.182827+0000","last_unstale":"2024-04-26T11:19:35.271910+0000","last_undegraded":"2024-04-26T11:19:35.271910+0000","last_fullsized":"2024-04-26T11:19:35.271910+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.499190+0000","last_change":"2024-04-26T11:19:35.499190+0000","last_active":"2024-04-26T11:19:35.499190+0000","last_peered":"2024-04-26T11:19:35.499190+0000","last_clean":"2024-04-26T11:19:35.499190+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:19:35.499190+0000","last_undegraded":"2024-04-26T11:19:35.499190+0000","last_fullsized":"2024-04-26T11:19:35.499190+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:35.499030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:35.499030+0000","last_clean_scrub_stamp":"2024-04-26T11:19:35.499030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:49.185477+0000","scrub_duration":0.018123878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:41.593903+0000","last_change":"2024-04-26T11:19:41.594000+0000","last_active":"2024-04-26T11:19:41.593903+0000","last_peered":"2024-04-26T11:19:41.593903+0000","last_clean":"2024-04-26T11:19:41.593903+0000","last_became_active":"2024-04-26T11:19:18.180865+0000","last_became_peered":"2024-04-26T11:19:18.180865+0000","last_unstale":"2024-04-26T11:19:41.593903+0000","last_undegraded":"2024-04-26T11:19:41.593903+0000","last_fullsized":"2024-04-26T11:19:41.593903+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:41.593880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:41.593880+0000","last_clean_scrub_stamp":"2024-04-26T11:19:41.593880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:56.201582+0000","scrub_duration":0.0019243019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:51.517339+0000","last_change":"2024-04-26T11:19:51.517460+0000","last_active":"2024-04-26T11:19:51.517339+0000","last_peered":"2024-04-26T11:19:51.517339+0000","last_clean":"2024-04-26T11:19:51.517339+0000","last_became_active":"2024-04-26T11:19:18.180763+0000","last_became_peered":"2024-04-26T11:19:18.180763+0000","last_unstale":"2024-04-26T11:19:51.517339+0000","last_undegraded":"2024-04-26T11:19:51.517339+0000","last_fullsized":"2024-04-26T11:19:51.517339+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:51.517314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:51.517314+0000","last_clean_scrub_stamp":"2024-04-26T11:19:51.517314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:47:38.185008+0000","scrub_duration":0.0020719620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:07.533224+0000","last_change":"2024-04-26T11:20:07.533355+0000","last_active":"2024-04-26T11:20:07.533224+0000","last_peered":"2024-04-26T11:20:07.533224+0000","last_clean":"2024-04-26T11:20:07.533224+0000","last_became_active":"2024-04-26T11:19:18.184331+0000","last_became_peered":"2024-04-26T11:19:18.184331+0000","last_unstale":"2024-04-26T11:20:07.533224+0000","last_undegraded":"2024-04-26T11:20:07.533224+0000","last_fullsized":"2024-04-26T11:20:07.533224+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:07.533200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:07.533200+0000","last_clean_scrub_stamp":"2024-04-26T11:20:07.533200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:50.283609+0000","scrub_duration":0.0016781039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:20.582602+0000","last_change":"2024-04-26T11:20:20.582731+0000","last_active":"2024-04-26T11:20:20.582602+0000","last_peered":"2024-04-26T11:20:20.582602+0000","last_clean":"2024-04-26T11:20:20.582602+0000","last_became_active":"2024-04-26T11:19:24.203764+0000","last_became_peered":"2024-04-26T11:19:24.203764+0000","last_unstale":"2024-04-26T11:20:20.582602+0000","last_undegraded":"2024-04-26T11:20:20.582602+0000","last_fullsized":"2024-04-26T11:20:20.582602+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:20.582577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:20.582577+0000","last_clean_scrub_stamp":"2024-04-26T11:20:20.582577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:06.502392+0000","scrub_duration":0.083132415000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:43.423762+0000","last_change":"2024-04-26T11:19:43.423762+0000","last_active":"2024-04-26T11:19:43.423762+0000","last_peered":"2024-04-26T11:19:43.423762+0000","last_clean":"2024-04-26T11:19:43.423762+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:19:43.423762+0000","last_undegraded":"2024-04-26T11:19:43.423762+0000","last_fullsized":"2024-04-26T11:19:43.423762+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:43.423617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:43.423617+0000","last_clean_scrub_stamp":"2024-04-26T11:19:43.423617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:58.420909+0000","scrub_duration":0.0017194790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:23.537391+0000","last_change":"2024-04-26T11:20:23.537545+0000","last_active":"2024-04-26T11:20:23.537391+0000","last_peered":"2024-04-26T11:20:23.537391+0000","last_clean":"2024-04-26T11:20:23.537391+0000","last_became_active":"2024-04-26T11:19:24.199142+0000","last_became_peered":"2024-04-26T11:19:24.199142+0000","last_unstale":"2024-04-26T11:20:23.537391+0000","last_undegraded":"2024-04-26T11:20:23.537391+0000","last_fullsized":"2024-04-26T11:20:23.537391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:23.537367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:23.537367+0000","last_clean_scrub_stamp":"2024-04-26T11:20:23.537367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:03.679558+0000","scrub_duration":0.029516655999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:42.569786+0000","last_change":"2024-04-26T11:19:42.569936+0000","last_active":"2024-04-26T11:19:42.569786+0000","last_peered":"2024-04-26T11:19:42.569786+0000","last_clean":"2024-04-26T11:19:42.569786+0000","last_became_active":"2024-04-26T11:19:18.184282+0000","last_became_peered":"2024-04-26T11:19:18.184282+0000","last_unstale":"2024-04-26T11:19:42.569786+0000","last_undegraded":"2024-04-26T11:19:42.569786+0000","last_fullsized":"2024-04-26T11:19:42.569786+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:42.569760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:42.569760+0000","last_clean_scrub_stamp":"2024-04-26T11:19:42.569760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:17.239747+0000","scrub_duration":0.0018614059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210780+0000","last_change":"2024-04-26T11:19:18.187937+0000","last_active":"2024-04-26T11:19:27.210780+0000","last_peered":"2024-04-26T11:19:27.210780+0000","last_clean":"2024-04-26T11:19:27.210780+0000","last_became_active":"2024-04-26T11:19:18.186605+0000","last_became_peered":"2024-04-26T11:19:18.186605+0000","last_unstale":"2024-04-26T11:19:27.210780+0000","last_undegraded":"2024-04-26T11:19:27.210780+0000","last_fullsized":"2024-04-26T11:19:27.210780+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:59.494778+0000","last_change":"2024-04-26T11:19:59.494778+0000","last_active":"2024-04-26T11:19:59.494778+0000","last_peered":"2024-04-26T11:19:59.494778+0000","last_clean":"2024-04-26T11:19:59.494778+0000","last_became_active":"2024-04-26T11:19:18.181728+0000","last_became_peered":"2024-04-26T11:19:18.181728+0000","last_unstale":"2024-04-26T11:19:59.494778+0000","last_undegraded":"2024-04-26T11:19:59.494778+0000","last_fullsized":"2024-04-26T11:19:59.494778+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:59.494616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:59.494616+0000","last_clean_scrub_stamp":"2024-04-26T11:19:59.494616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:50:32.682411+0000","scrub_duration":0.001815215,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:27.592038+0000","last_change":"2024-04-26T11:20:27.592160+0000","last_active":"2024-04-26T11:20:27.592038+0000","last_peered":"2024-04-26T11:20:27.592038+0000","last_clean":"2024-04-26T11:20:27.592038+0000","last_became_active":"2024-04-26T11:19:24.197487+0000","last_became_peered":"2024-04-26T11:19:24.197487+0000","last_unstale":"2024-04-26T11:20:27.592038+0000","last_undegraded":"2024-04-26T11:20:27.592038+0000","last_fullsized":"2024-04-26T11:20:27.592038+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:27.592000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:27.592000+0000","last_clean_scrub_stamp":"2024-04-26T11:20:27.592000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:52:21.837181+0000","scrub_duration":0.0016673460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:48.396499+0000","last_change":"2024-04-26T11:19:48.396656+0000","last_active":"2024-04-26T11:19:48.396499+0000","last_peered":"2024-04-26T11:19:48.396499+0000","last_clean":"2024-04-26T11:19:48.396499+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:19:48.396499+0000","last_undegraded":"2024-04-26T11:19:48.396499+0000","last_fullsized":"2024-04-26T11:19:48.396499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:48.396472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:48.396472+0000","last_clean_scrub_stamp":"2024-04-26T11:19:48.396472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:16.773782+0000","scrub_duration":0.0019312940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:19.512918+0000","last_change":"2024-04-26T11:20:19.513110+0000","last_active":"2024-04-26T11:20:19.512918+0000","last_peered":"2024-04-26T11:20:19.512918+0000","last_clean":"2024-04-26T11:20:19.512918+0000","last_became_active":"2024-04-26T11:19:18.184451+0000","last_became_peered":"2024-04-26T11:19:18.184451+0000","last_unstale":"2024-04-26T11:20:19.512918+0000","last_undegraded":"2024-04-26T11:20:19.512918+0000","last_fullsized":"2024-04-26T11:20:19.512918+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:19.512881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:19.512881+0000","last_clean_scrub_stamp":"2024-04-26T11:20:19.512881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:33.563886+0000","scrub_duration":0.023492367,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:08.595129+0000","last_change":"2024-04-26T11:20:08.595253+0000","last_active":"2024-04-26T11:20:08.595129+0000","last_peered":"2024-04-26T11:20:08.595129+0000","last_clean":"2024-04-26T11:20:08.595129+0000","last_became_active":"2024-04-26T11:19:24.198479+0000","last_became_peered":"2024-04-26T11:19:24.198479+0000","last_unstale":"2024-04-26T11:20:08.595129+0000","last_undegraded":"2024-04-26T11:20:08.595129+0000","last_fullsized":"2024-04-26T11:20:08.595129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:08.595106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:08.595106+0000","last_clean_scrub_stamp":"2024-04-26T11:20:08.595106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:18.295964+0000","scrub_duration":0.0021262659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:13.621793+0000","last_change":"2024-04-26T11:20:13.621938+0000","last_active":"2024-04-26T11:20:13.621793+0000","last_peered":"2024-04-26T11:20:13.621793+0000","last_clean":"2024-04-26T11:20:13.621793+0000","last_became_active":"2024-04-26T11:19:18.185105+0000","last_became_peered":"2024-04-26T11:19:18.185105+0000","last_unstale":"2024-04-26T11:20:13.621793+0000","last_undegraded":"2024-04-26T11:20:13.621793+0000","last_fullsized":"2024-04-26T11:20:13.621793+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:13.621769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:13.621769+0000","last_clean_scrub_stamp":"2024-04-26T11:20:13.621769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:26.915580+0000","scrub_duration":0.0020478789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210480+0000","last_change":"2024-04-26T11:13:12.493425+0000","last_active":"2024-04-26T11:19:27.210480+0000","last_peered":"2024-04-26T11:19:27.210480+0000","last_clean":"2024-04-26T11:19:27.210480+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:19:27.210480+0000","last_undegraded":"2024-04-26T11:19:27.210480+0000","last_fullsized":"2024-04-26T11:19:27.210480+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211182+0000","last_change":"2024-04-26T11:19:18.191042+0000","last_active":"2024-04-26T11:19:27.211182+0000","last_peered":"2024-04-26T11:19:27.211182+0000","last_clean":"2024-04-26T11:19:27.211182+0000","last_became_active":"2024-04-26T11:19:18.190792+0000","last_became_peered":"2024-04-26T11:19:18.190792+0000","last_unstale":"2024-04-26T11:19:27.211182+0000","last_undegraded":"2024-04-26T11:19:27.211182+0000","last_fullsized":"2024-04-26T11:19:27.211182+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":67,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.667261+0000","last_change":"2024-04-26T11:19:35.667355+0000","last_active":"2024-04-26T11:19:35.667261+0000","last_peered":"2024-04-26T11:19:35.667261+0000","last_clean":"2024-04-26T11:19:35.667261+0000","last_became_active":"2024-04-26T11:19:24.202348+0000","last_became_peered":"2024-04-26T11:19:24.202348+0000","last_unstale":"2024-04-26T11:19:35.667261+0000","last_undegraded":"2024-04-26T11:19:35.667261+0000","last_fullsized":"2024-04-26T11:19:35.667261+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:35.667237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:35.667237+0000","last_clean_scrub_stamp":"2024-04-26T11:19:35.667237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:38.776469+0000","scrub_duration":0.0019697669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:44.766975+0000","last_change":"2024-04-26T11:19:44.767086+0000","last_active":"2024-04-26T11:19:44.766975+0000","last_peered":"2024-04-26T11:19:44.766975+0000","last_clean":"2024-04-26T11:19:44.766975+0000","last_became_active":"2024-04-26T11:19:24.198920+0000","last_became_peered":"2024-04-26T11:19:24.198920+0000","last_unstale":"2024-04-26T11:19:44.766975+0000","last_undegraded":"2024-04-26T11:19:44.766975+0000","last_fullsized":"2024-04-26T11:19:44.766975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:44.766950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:44.766950+0000","last_clean_scrub_stamp":"2024-04-26T11:19:44.766950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:30.054801+0000","scrub_duration":0.0017451579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.209812+0000","last_change":"2024-04-26T11:19:24.199051+0000","last_active":"2024-04-26T11:19:27.209812+0000","last_peered":"2024-04-26T11:19:27.209812+0000","last_clean":"2024-04-26T11:19:27.209812+0000","last_became_active":"2024-04-26T11:19:24.197698+0000","last_became_peered":"2024-04-26T11:19:24.197698+0000","last_unstale":"2024-04-26T11:19:27.209812+0000","last_undegraded":"2024-04-26T11:19:27.209812+0000","last_fullsized":"2024-04-26T11:19:27.209812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:47.503571+0000","last_change":"2024-04-26T11:19:47.503709+0000","last_active":"2024-04-26T11:19:47.503571+0000","last_peered":"2024-04-26T11:19:47.503571+0000","last_clean":"2024-04-26T11:19:47.503571+0000","last_became_active":"2024-04-26T11:19:18.190127+0000","last_became_peered":"2024-04-26T11:19:18.190127+0000","last_unstale":"2024-04-26T11:19:47.503571+0000","last_undegraded":"2024-04-26T11:19:47.503571+0000","last_fullsized":"2024-04-26T11:19:47.503571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:47.503550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:47.503550+0000","last_clean_scrub_stamp":"2024-04-26T11:19:47.503550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:33.423364+0000","scrub_duration":0.064283446999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:34.750983+0000","last_change":"2024-04-26T11:19:24.205086+0000","last_active":"2024-04-26T11:19:34.750983+0000","last_peered":"2024-04-26T11:19:34.750983+0000","last_clean":"2024-04-26T11:19:34.750983+0000","last_became_active":"2024-04-26T11:19:24.204122+0000","last_became_peered":"2024-04-26T11:19:24.204122+0000","last_unstale":"2024-04-26T11:19:34.750983+0000","last_undegraded":"2024-04-26T11:19:34.750983+0000","last_fullsized":"2024-04-26T11:19:34.750983+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:24.473040+0000","last_change":"2024-04-26T11:20:24.473172+0000","last_active":"2024-04-26T11:20:24.473040+0000","last_peered":"2024-04-26T11:20:24.473040+0000","last_clean":"2024-04-26T11:20:24.473040+0000","last_became_active":"2024-04-26T11:19:24.197247+0000","last_became_peered":"2024-04-26T11:19:24.197247+0000","last_unstale":"2024-04-26T11:20:24.473040+0000","last_undegraded":"2024-04-26T11:20:24.473040+0000","last_fullsized":"2024-04-26T11:20:24.473040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:24.473016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:24.473016+0000","last_clean_scrub_stamp":"2024-04-26T11:20:24.473016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:59.992655+0000","scrub_duration":0.001721656,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:19.633755+0000","last_change":"2024-04-26T11:20:19.633856+0000","last_active":"2024-04-26T11:20:19.633755+0000","last_peered":"2024-04-26T11:20:19.633755+0000","last_clean":"2024-04-26T11:20:19.633755+0000","last_became_active":"2024-04-26T11:19:18.185578+0000","last_became_peered":"2024-04-26T11:19:18.185578+0000","last_unstale":"2024-04-26T11:20:19.633755+0000","last_undegraded":"2024-04-26T11:20:19.633755+0000","last_fullsized":"2024-04-26T11:20:19.633755+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:19.633732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:19.633732+0000","last_clean_scrub_stamp":"2024-04-26T11:20:19.633732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:47.795228+0000","scrub_duration":0.001874459,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:05.541862+0000","last_change":"2024-04-26T11:20:05.541862+0000","last_active":"2024-04-26T11:20:05.541862+0000","last_peered":"2024-04-26T11:20:05.541862+0000","last_clean":"2024-04-26T11:20:05.541862+0000","last_became_active":"2024-04-26T11:19:24.200992+0000","last_became_peered":"2024-04-26T11:19:24.200992+0000","last_unstale":"2024-04-26T11:20:05.541862+0000","last_undegraded":"2024-04-26T11:20:05.541862+0000","last_fullsized":"2024-04-26T11:20:05.541862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:05.541702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:05.541702+0000","last_clean_scrub_stamp":"2024-04-26T11:20:05.541702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:43.691758+0000","scrub_duration":0.001648708,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"82'5","reported_seq":124,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:31.500638+0000","last_change":"2024-04-26T11:20:31.500638+0000","last_active":"2024-04-26T11:20:31.500638+0000","last_peered":"2024-04-26T11:20:31.500638+0000","last_clean":"2024-04-26T11:20:31.500638+0000","last_became_active":"2024-04-26T11:19:18.190381+0000","last_became_peered":"2024-04-26T11:19:18.190381+0000","last_unstale":"2024-04-26T11:20:31.500638+0000","last_undegraded":"2024-04-26T11:20:31.500638+0000","last_fullsized":"2024-04-26T11:20:31.500638+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'5","last_scrub_stamp":"2024-04-26T11:20:31.500511+0000","last_deep_scrub":"82'5","last_deep_scrub_stamp":"2024-04-26T11:20:31.500511+0000","last_clean_scrub_stamp":"2024-04-26T11:20:31.500511+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:36:22.961021+0000","scrub_duration":0.0037041859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:51.669025+0000","last_change":"2024-04-26T11:19:51.669122+0000","last_active":"2024-04-26T11:19:51.669025+0000","last_peered":"2024-04-26T11:19:51.669025+0000","last_clean":"2024-04-26T11:19:51.669025+0000","last_became_active":"2024-04-26T11:19:24.199659+0000","last_became_peered":"2024-04-26T11:19:24.199659+0000","last_unstale":"2024-04-26T11:19:51.669025+0000","last_undegraded":"2024-04-26T11:19:51.669025+0000","last_fullsized":"2024-04-26T11:19:51.669025+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:51.668999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:51.668999+0000","last_clean_scrub_stamp":"2024-04-26T11:19:51.668999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:13.870535+0000","scrub_duration":0.001713553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"82'10","reported_seq":61,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:15.665075+0000","last_change":"2024-04-26T11:20:15.665204+0000","last_active":"2024-04-26T11:20:15.665075+0000","last_peered":"2024-04-26T11:20:15.665075+0000","last_clean":"2024-04-26T11:20:15.665075+0000","last_became_active":"2024-04-26T11:19:18.180711+0000","last_became_peered":"2024-04-26T11:19:18.180711+0000","last_unstale":"2024-04-26T11:20:15.665075+0000","last_undegraded":"2024-04-26T11:20:15.665075+0000","last_fullsized":"2024-04-26T11:20:15.665075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'10","last_scrub_stamp":"2024-04-26T11:20:15.665049+0000","last_deep_scrub":"82'10","last_deep_scrub_stamp":"2024-04-26T11:20:15.665049+0000","last_clean_scrub_stamp":"2024-04-26T11:20:15.665049+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:43:51.496107+0000","scrub_duration":0.0059687940000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210856+0000","last_change":"2024-04-26T11:19:18.182026+0000","last_active":"2024-04-26T11:19:27.210856+0000","last_peered":"2024-04-26T11:19:27.210856+0000","last_clean":"2024-04-26T11:19:27.210856+0000","last_became_active":"2024-04-26T11:19:18.181615+0000","last_became_peered":"2024-04-26T11:19:18.181615+0000","last_unstale":"2024-04-26T11:19:27.210856+0000","last_undegraded":"2024-04-26T11:19:27.210856+0000","last_fullsized":"2024-04-26T11:19:27.210856+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"82'4","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:33.660558+0000","last_change":"2024-04-26T11:20:33.660657+0000","last_active":"2024-04-26T11:20:33.660558+0000","last_peered":"2024-04-26T11:20:33.660558+0000","last_clean":"2024-04-26T11:20:33.660558+0000","last_became_active":"2024-04-26T11:19:18.183103+0000","last_became_peered":"2024-04-26T11:19:18.183103+0000","last_unstale":"2024-04-26T11:20:33.660558+0000","last_undegraded":"2024-04-26T11:20:33.660558+0000","last_fullsized":"2024-04-26T11:20:33.660558+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-26T11:20:33.660533+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-26T11:20:33.660533+0000","last_clean_scrub_stamp":"2024-04-26T11:20:33.660533+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:09.137970+0000","scrub_duration":0.0039063550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.271759+0000","last_change":"2024-04-26T11:13:12.916685+0000","last_active":"2024-04-26T11:19:35.271759+0000","last_peered":"2024-04-26T11:19:35.271759+0000","last_clean":"2024-04-26T11:19:35.271759+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:19:35.271759+0000","last_undegraded":"2024-04-26T11:19:35.271759+0000","last_fullsized":"2024-04-26T11:19:35.271759+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:16.464920+0000","last_change":"2024-04-26T11:20:16.464920+0000","last_active":"2024-04-26T11:20:16.464920+0000","last_peered":"2024-04-26T11:20:16.464920+0000","last_clean":"2024-04-26T11:20:16.464920+0000","last_became_active":"2024-04-26T11:19:24.197647+0000","last_became_peered":"2024-04-26T11:19:24.197647+0000","last_unstale":"2024-04-26T11:20:16.464920+0000","last_undegraded":"2024-04-26T11:20:16.464920+0000","last_fullsized":"2024-04-26T11:20:16.464920+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:16.464751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:16.464751+0000","last_clean_scrub_stamp":"2024-04-26T11:20:16.464751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:31.462042+0000","scrub_duration":0.001769709,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:49.458065+0000","last_change":"2024-04-26T11:19:49.458065+0000","last_active":"2024-04-26T11:19:49.458065+0000","last_peered":"2024-04-26T11:19:49.458065+0000","last_clean":"2024-04-26T11:19:49.458065+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:19:49.458065+0000","last_undegraded":"2024-04-26T11:19:49.458065+0000","last_fullsized":"2024-04-26T11:19:49.458065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:49.457903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:49.457903+0000","last_clean_scrub_stamp":"2024-04-26T11:19:49.457903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:29.600094+0000","scrub_duration":0.017036468999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.271553+0000","last_change":"2024-04-26T11:19:18.182547+0000","last_active":"2024-04-26T11:19:35.271553+0000","last_peered":"2024-04-26T11:19:35.271553+0000","last_clean":"2024-04-26T11:19:35.271553+0000","last_became_active":"2024-04-26T11:19:18.181907+0000","last_became_peered":"2024-04-26T11:19:18.181907+0000","last_unstale":"2024-04-26T11:19:35.271553+0000","last_undegraded":"2024-04-26T11:19:35.271553+0000","last_fullsized":"2024-04-26T11:19:35.271553+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:34.751165+0000","last_change":"2024-04-26T11:19:24.201756+0000","last_active":"2024-04-26T11:19:34.751165+0000","last_peered":"2024-04-26T11:19:34.751165+0000","last_clean":"2024-04-26T11:19:34.751165+0000","last_became_active":"2024-04-26T11:19:24.201114+0000","last_became_peered":"2024-04-26T11:19:24.201114+0000","last_unstale":"2024-04-26T11:19:34.751165+0000","last_undegraded":"2024-04-26T11:19:34.751165+0000","last_fullsized":"2024-04-26T11:19:34.751165+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"82'12","reported_seq":57,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:20.669835+0000","last_change":"2024-04-26T11:20:20.669954+0000","last_active":"2024-04-26T11:20:20.669835+0000","last_peered":"2024-04-26T11:20:20.669835+0000","last_clean":"2024-04-26T11:20:20.669835+0000","last_became_active":"2024-04-26T11:19:18.182017+0000","last_became_peered":"2024-04-26T11:19:18.182017+0000","last_unstale":"2024-04-26T11:20:20.669835+0000","last_undegraded":"2024-04-26T11:20:20.669835+0000","last_fullsized":"2024-04-26T11:20:20.669835+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'12","last_scrub_stamp":"2024-04-26T11:20:20.669804+0000","last_deep_scrub":"82'12","last_deep_scrub_stamp":"2024-04-26T11:20:20.669804+0000","last_clean_scrub_stamp":"2024-04-26T11:20:20.669804+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:56.741407+0000","scrub_duration":0.0048710799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:34.751255+0000","last_change":"2024-04-26T11:19:24.205310+0000","last_active":"2024-04-26T11:19:34.751255+0000","last_peered":"2024-04-26T11:19:34.751255+0000","last_clean":"2024-04-26T11:19:34.751255+0000","last_became_active":"2024-04-26T11:19:24.204476+0000","last_became_peered":"2024-04-26T11:19:24.204476+0000","last_unstale":"2024-04-26T11:19:34.751255+0000","last_undegraded":"2024-04-26T11:19:34.751255+0000","last_fullsized":"2024-04-26T11:19:34.751255+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"82'2","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:44.505106+0000","last_change":"2024-04-26T11:19:44.505212+0000","last_active":"2024-04-26T11:19:44.505106+0000","last_peered":"2024-04-26T11:19:44.505106+0000","last_clean":"2024-04-26T11:19:44.505106+0000","last_became_active":"2024-04-26T11:19:18.181604+0000","last_became_peered":"2024-04-26T11:19:18.181604+0000","last_unstale":"2024-04-26T11:19:44.505106+0000","last_undegraded":"2024-04-26T11:19:44.505106+0000","last_fullsized":"2024-04-26T11:19:44.505106+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-26T11:19:44.505080+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-26T11:19:44.505080+0000","last_clean_scrub_stamp":"2024-04-26T11:19:44.505080+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:07.623145+0000","scrub_duration":0.0032804549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:36.457819+0000","last_change":"2024-04-26T11:19:36.457819+0000","last_active":"2024-04-26T11:19:36.457819+0000","last_peered":"2024-04-26T11:19:36.457819+0000","last_clean":"2024-04-26T11:19:36.457819+0000","last_became_active":"2024-04-26T11:19:18.181462+0000","last_became_peered":"2024-04-26T11:19:18.181462+0000","last_unstale":"2024-04-26T11:19:36.457819+0000","last_undegraded":"2024-04-26T11:19:36.457819+0000","last_fullsized":"2024-04-26T11:19:36.457819+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:36.457692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:36.457692+0000","last_clean_scrub_stamp":"2024-04-26T11:19:36.457692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:46.158550+0000","scrub_duration":0.0018253519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":110,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.271592+0000","last_change":"2024-04-26T11:19:18.183263+0000","last_active":"2024-04-26T11:19:35.271592+0000","last_peered":"2024-04-26T11:19:35.271592+0000","last_clean":"2024-04-26T11:19:35.271592+0000","last_became_active":"2024-04-26T11:19:18.182242+0000","last_became_peered":"2024-04-26T11:19:18.182242+0000","last_unstale":"2024-04-26T11:19:35.271592+0000","last_undegraded":"2024-04-26T11:19:35.271592+0000","last_fullsized":"2024-04-26T11:19:35.271592+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:53.468976+0000","last_change":"2024-04-26T11:19:53.469071+0000","last_active":"2024-04-26T11:19:53.468976+0000","last_peered":"2024-04-26T11:19:53.468976+0000","last_clean":"2024-04-26T11:19:53.468976+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:19:53.468976+0000","last_undegraded":"2024-04-26T11:19:53.468976+0000","last_fullsized":"2024-04-26T11:19:53.468976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:53.468953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:53.468953+0000","last_clean_scrub_stamp":"2024-04-26T11:19:53.468953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:51:47.714133+0000","scrub_duration":0.0018786149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210716+0000","last_change":"2024-04-26T11:19:18.181652+0000","last_active":"2024-04-26T11:19:27.210716+0000","last_peered":"2024-04-26T11:19:27.210716+0000","last_clean":"2024-04-26T11:19:27.210716+0000","last_became_active":"2024-04-26T11:19:18.180506+0000","last_became_peered":"2024-04-26T11:19:18.180506+0000","last_unstale":"2024-04-26T11:19:27.210716+0000","last_undegraded":"2024-04-26T11:19:27.210716+0000","last_fullsized":"2024-04-26T11:19:27.210716+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:50.503948+0000","last_change":"2024-04-26T11:19:50.504053+0000","last_active":"2024-04-26T11:19:50.503948+0000","last_peered":"2024-04-26T11:19:50.503948+0000","last_clean":"2024-04-26T11:19:50.503948+0000","last_became_active":"2024-04-26T11:19:18.185355+0000","last_became_peered":"2024-04-26T11:19:18.185355+0000","last_unstale":"2024-04-26T11:19:50.503948+0000","last_undegraded":"2024-04-26T11:19:50.503948+0000","last_fullsized":"2024-04-26T11:19:50.503948+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:50.503924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:50.503924+0000","last_clean_scrub_stamp":"2024-04-26T11:19:50.503924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:15.276373+0000","scrub_duration":0.001850661,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:00.590718+0000","last_change":"2024-04-26T11:20:00.590840+0000","last_active":"2024-04-26T11:20:00.590718+0000","last_peered":"2024-04-26T11:20:00.590718+0000","last_clean":"2024-04-26T11:20:00.590718+0000","last_became_active":"2024-04-26T11:19:18.186342+0000","last_became_peered":"2024-04-26T11:19:18.186342+0000","last_unstale":"2024-04-26T11:20:00.590718+0000","last_undegraded":"2024-04-26T11:20:00.590718+0000","last_fullsized":"2024-04-26T11:20:00.590718+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:00.590694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:00.590694+0000","last_clean_scrub_stamp":"2024-04-26T11:20:00.590694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:47.383110+0000","scrub_duration":0.0016301460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:03.588748+0000","last_change":"2024-04-26T11:20:03.588894+0000","last_active":"2024-04-26T11:20:03.588748+0000","last_peered":"2024-04-26T11:20:03.588748+0000","last_clean":"2024-04-26T11:20:03.588748+0000","last_became_active":"2024-04-26T11:19:24.201330+0000","last_became_peered":"2024-04-26T11:19:24.201330+0000","last_unstale":"2024-04-26T11:20:03.588748+0000","last_undegraded":"2024-04-26T11:20:03.588748+0000","last_fullsized":"2024-04-26T11:20:03.588748+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:03.588721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:03.588721+0000","last_clean_scrub_stamp":"2024-04-26T11:20:03.588721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:51.328094+0000","scrub_duration":0.029670523000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"82'3","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:06.586122+0000","last_change":"2024-04-26T11:20:06.586222+0000","last_active":"2024-04-26T11:20:06.586122+0000","last_peered":"2024-04-26T11:20:06.586122+0000","last_clean":"2024-04-26T11:20:06.586122+0000","last_became_active":"2024-04-26T11:19:24.201077+0000","last_became_peered":"2024-04-26T11:19:24.201077+0000","last_unstale":"2024-04-26T11:20:06.586122+0000","last_undegraded":"2024-04-26T11:20:06.586122+0000","last_fullsized":"2024-04-26T11:20:06.586122+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T11:20:06.586097+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T11:20:06.586097+0000","last_clean_scrub_stamp":"2024-04-26T11:20:06.586097+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:06.937690+0000","scrub_duration":0.0032225639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:21.647455+0000","last_change":"2024-04-26T11:20:21.647563+0000","last_active":"2024-04-26T11:20:21.647455+0000","last_peered":"2024-04-26T11:20:21.647455+0000","last_clean":"2024-04-26T11:20:21.647455+0000","last_became_active":"2024-04-26T11:19:18.185768+0000","last_became_peered":"2024-04-26T11:19:18.185768+0000","last_unstale":"2024-04-26T11:20:21.647455+0000","last_undegraded":"2024-04-26T11:20:21.647455+0000","last_fullsized":"2024-04-26T11:20:21.647455+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:21.647424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:21.647424+0000","last_clean_scrub_stamp":"2024-04-26T11:20:21.647424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:30.401562+0000","scrub_duration":0.0017008469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:35.738414+0000","last_change":"2024-04-26T11:20:35.738528+0000","last_active":"2024-04-26T11:20:35.738414+0000","last_peered":"2024-04-26T11:20:35.738414+0000","last_clean":"2024-04-26T11:20:35.738414+0000","last_became_active":"2024-04-26T11:19:18.184149+0000","last_became_peered":"2024-04-26T11:19:18.184149+0000","last_unstale":"2024-04-26T11:20:35.738414+0000","last_undegraded":"2024-04-26T11:20:35.738414+0000","last_fullsized":"2024-04-26T11:20:35.738414+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:35.738376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:35.738376+0000","last_clean_scrub_stamp":"2024-04-26T11:20:35.738376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:19.639335+0000","scrub_duration":0.0020898240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:36.619910+0000","last_change":"2024-04-26T11:19:36.620064+0000","last_active":"2024-04-26T11:19:36.619910+0000","last_peered":"2024-04-26T11:19:36.619910+0000","last_clean":"2024-04-26T11:19:36.619910+0000","last_became_active":"2024-04-26T11:19:18.181951+0000","last_became_peered":"2024-04-26T11:19:18.181951+0000","last_unstale":"2024-04-26T11:19:36.619910+0000","last_undegraded":"2024-04-26T11:19:36.619910+0000","last_fullsized":"2024-04-26T11:19:36.619910+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:36.619885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:36.619885+0000","last_clean_scrub_stamp":"2024-04-26T11:19:36.619885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:06.660819+0000","scrub_duration":0.001669823,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.271533+0000","last_change":"2024-04-26T11:19:18.182240+0000","last_active":"2024-04-26T11:19:35.271533+0000","last_peered":"2024-04-26T11:19:35.271533+0000","last_clean":"2024-04-26T11:19:35.271533+0000","last_became_active":"2024-04-26T11:19:18.181767+0000","last_became_peered":"2024-04-26T11:19:18.181767+0000","last_unstale":"2024-04-26T11:19:35.271533+0000","last_undegraded":"2024-04-26T11:19:35.271533+0000","last_fullsized":"2024-04-26T11:19:35.271533+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:37.612117+0000","last_change":"2024-04-26T11:19:37.612253+0000","last_active":"2024-04-26T11:19:37.612117+0000","last_peered":"2024-04-26T11:19:37.612117+0000","last_clean":"2024-04-26T11:19:37.612117+0000","last_became_active":"2024-04-26T11:19:18.182060+0000","last_became_peered":"2024-04-26T11:19:18.182060+0000","last_unstale":"2024-04-26T11:19:37.612117+0000","last_undegraded":"2024-04-26T11:19:37.612117+0000","last_fullsized":"2024-04-26T11:19:37.612117+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:37.612061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:37.612061+0000","last_clean_scrub_stamp":"2024-04-26T11:19:37.612061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:24.175151+0000","scrub_duration":0.0016765459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:20.495917+0000","last_change":"2024-04-26T11:20:20.496020+0000","last_active":"2024-04-26T11:20:20.495917+0000","last_peered":"2024-04-26T11:20:20.495917+0000","last_clean":"2024-04-26T11:20:20.495917+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:20:20.495917+0000","last_undegraded":"2024-04-26T11:20:20.495917+0000","last_fullsized":"2024-04-26T11:20:20.495917+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:20.495895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:20.495895+0000","last_clean_scrub_stamp":"2024-04-26T11:20:20.495895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:28.263035+0000","scrub_duration":0.001714824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:48.777587+0000","last_change":"2024-04-26T11:19:48.777713+0000","last_active":"2024-04-26T11:19:48.777587+0000","last_peered":"2024-04-26T11:19:48.777587+0000","last_clean":"2024-04-26T11:19:48.777587+0000","last_became_active":"2024-04-26T11:19:24.203758+0000","last_became_peered":"2024-04-26T11:19:24.203758+0000","last_unstale":"2024-04-26T11:19:48.777587+0000","last_undegraded":"2024-04-26T11:19:48.777587+0000","last_fullsized":"2024-04-26T11:19:48.777587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:48.777563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:48.777563+0000","last_clean_scrub_stamp":"2024-04-26T11:19:48.777563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:26.143928+0000","scrub_duration":0.058175359000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210353+0000","last_change":"2024-04-26T11:19:24.201687+0000","last_active":"2024-04-26T11:19:27.210353+0000","last_peered":"2024-04-26T11:19:27.210353+0000","last_clean":"2024-04-26T11:19:27.210353+0000","last_became_active":"2024-04-26T11:19:24.200963+0000","last_became_peered":"2024-04-26T11:19:24.200963+0000","last_unstale":"2024-04-26T11:19:27.210353+0000","last_undegraded":"2024-04-26T11:19:27.210353+0000","last_fullsized":"2024-04-26T11:19:27.210353+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211210+0000","last_change":"2024-04-26T11:19:18.189488+0000","last_active":"2024-04-26T11:19:27.211210+0000","last_peered":"2024-04-26T11:19:27.211210+0000","last_clean":"2024-04-26T11:19:27.211210+0000","last_became_active":"2024-04-26T11:19:18.189086+0000","last_became_peered":"2024-04-26T11:19:18.189086+0000","last_unstale":"2024-04-26T11:19:27.211210+0000","last_undegraded":"2024-04-26T11:19:27.211210+0000","last_fullsized":"2024-04-26T11:19:27.211210+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:05.442392+0000","last_change":"2024-04-26T11:20:05.442516+0000","last_active":"2024-04-26T11:20:05.442392+0000","last_peered":"2024-04-26T11:20:05.442392+0000","last_clean":"2024-04-26T11:20:05.442392+0000","last_became_active":"2024-04-26T11:19:18.181791+0000","last_became_peered":"2024-04-26T11:19:18.181791+0000","last_unstale":"2024-04-26T11:20:05.442392+0000","last_undegraded":"2024-04-26T11:20:05.442392+0000","last_fullsized":"2024-04-26T11:20:05.442392+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:05.442367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:05.442367+0000","last_clean_scrub_stamp":"2024-04-26T11:20:05.442367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:48.858203+0000","scrub_duration":0.001909062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:24.707687+0000","last_change":"2024-04-26T11:20:24.707827+0000","last_active":"2024-04-26T11:20:24.707687+0000","last_peered":"2024-04-26T11:20:24.707687+0000","last_clean":"2024-04-26T11:20:24.707687+0000","last_became_active":"2024-04-26T11:19:18.183292+0000","last_became_peered":"2024-04-26T11:19:18.183292+0000","last_unstale":"2024-04-26T11:20:24.707687+0000","last_undegraded":"2024-04-26T11:20:24.707687+0000","last_fullsized":"2024-04-26T11:20:24.707687+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:24.707649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:24.707649+0000","last_clean_scrub_stamp":"2024-04-26T11:20:24.707649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:50.921059+0000","scrub_duration":0.001693588,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210983+0000","last_change":"2024-04-26T11:19:18.190450+0000","last_active":"2024-04-26T11:19:27.210983+0000","last_peered":"2024-04-26T11:19:27.210983+0000","last_clean":"2024-04-26T11:19:27.210983+0000","last_became_active":"2024-04-26T11:19:18.190096+0000","last_became_peered":"2024-04-26T11:19:18.190096+0000","last_unstale":"2024-04-26T11:19:27.210983+0000","last_undegraded":"2024-04-26T11:19:27.210983+0000","last_fullsized":"2024-04-26T11:19:27.210983+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:28.566429+0000","last_change":"2024-04-26T11:20:28.566554+0000","last_active":"2024-04-26T11:20:28.566429+0000","last_peered":"2024-04-26T11:20:28.566429+0000","last_clean":"2024-04-26T11:20:28.566429+0000","last_became_active":"2024-04-26T11:19:24.199834+0000","last_became_peered":"2024-04-26T11:19:24.199834+0000","last_unstale":"2024-04-26T11:20:28.566429+0000","last_undegraded":"2024-04-26T11:20:28.566429+0000","last_fullsized":"2024-04-26T11:20:28.566429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:28.566404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:28.566404+0000","last_clean_scrub_stamp":"2024-04-26T11:20:28.566404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:24.933139+0000","scrub_duration":0.0016291509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:56.642304+0000","last_change":"2024-04-26T11:19:56.642416+0000","last_active":"2024-04-26T11:19:56.642304+0000","last_peered":"2024-04-26T11:19:56.642304+0000","last_clean":"2024-04-26T11:19:56.642304+0000","last_became_active":"2024-04-26T11:19:24.196561+0000","last_became_peered":"2024-04-26T11:19:24.196561+0000","last_unstale":"2024-04-26T11:19:56.642304+0000","last_undegraded":"2024-04-26T11:19:56.642304+0000","last_fullsized":"2024-04-26T11:19:56.642304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:56.642282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:56.642282+0000","last_clean_scrub_stamp":"2024-04-26T11:19:56.642282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:16.768522+0000","scrub_duration":0.001607296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":119,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:30.510626+0000","last_change":"2024-04-26T11:20:30.510723+0000","last_active":"2024-04-26T11:20:30.510626+0000","last_peered":"2024-04-26T11:20:30.510626+0000","last_clean":"2024-04-26T11:20:30.510626+0000","last_became_active":"2024-04-26T11:19:18.182077+0000","last_became_peered":"2024-04-26T11:19:18.182077+0000","last_unstale":"2024-04-26T11:20:30.510626+0000","last_undegraded":"2024-04-26T11:20:30.510626+0000","last_fullsized":"2024-04-26T11:20:30.510626+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:30.510602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:30.510602+0000","last_clean_scrub_stamp":"2024-04-26T11:20:30.510602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:28.874707+0000","scrub_duration":0.0021031610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210738+0000","last_change":"2024-04-26T11:19:24.205473+0000","last_active":"2024-04-26T11:19:27.210738+0000","last_peered":"2024-04-26T11:19:27.210738+0000","last_clean":"2024-04-26T11:19:27.210738+0000","last_became_active":"2024-04-26T11:19:24.204538+0000","last_became_peered":"2024-04-26T11:19:24.204538+0000","last_unstale":"2024-04-26T11:19:27.210738+0000","last_undegraded":"2024-04-26T11:19:27.210738+0000","last_fullsized":"2024-04-26T11:19:27.210738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:32.614013+0000","last_change":"2024-04-26T11:20:32.614151+0000","last_active":"2024-04-26T11:20:32.614013+0000","last_peered":"2024-04-26T11:20:32.614013+0000","last_clean":"2024-04-26T11:20:32.614013+0000","last_became_active":"2024-04-26T11:19:18.184460+0000","last_became_peered":"2024-04-26T11:19:18.184460+0000","last_unstale":"2024-04-26T11:20:32.614013+0000","last_undegraded":"2024-04-26T11:20:32.614013+0000","last_fullsized":"2024-04-26T11:20:32.614013+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:32.613980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:32.613980+0000","last_clean_scrub_stamp":"2024-04-26T11:20:32.613980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:31.344148+0000","scrub_duration":0.0021711899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"82'159","reported_seq":248,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:11.567529+0000","last_change":"2024-04-26T11:20:11.567623+0000","last_active":"2024-04-26T11:20:11.567529+0000","last_peered":"2024-04-26T11:20:11.567529+0000","last_clean":"2024-04-26T11:20:11.567529+0000","last_became_active":"2024-04-26T11:19:18.180577+0000","last_became_peered":"2024-04-26T11:19:18.180577+0000","last_unstale":"2024-04-26T11:20:11.567529+0000","last_undegraded":"2024-04-26T11:20:11.567529+0000","last_fullsized":"2024-04-26T11:20:11.567529+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'159","last_scrub_stamp":"2024-04-26T11:20:11.567504+0000","last_deep_scrub":"82'159","last_deep_scrub_stamp":"2024-04-26T11:20:11.567504+0000","last_clean_scrub_stamp":"2024-04-26T11:20:11.567504+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:18.611371+0000","scrub_duration":0.0050467979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.209868+0000","last_change":"2024-04-26T11:19:24.197315+0000","last_active":"2024-04-26T11:19:27.209868+0000","last_peered":"2024-04-26T11:19:27.209868+0000","last_clean":"2024-04-26T11:19:27.209868+0000","last_became_active":"2024-04-26T11:19:24.196404+0000","last_became_peered":"2024-04-26T11:19:24.196404+0000","last_unstale":"2024-04-26T11:19:27.209868+0000","last_undegraded":"2024-04-26T11:19:27.209868+0000","last_fullsized":"2024-04-26T11:19:27.209868+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:09.531099+0000","last_change":"2024-04-26T11:20:09.531227+0000","last_active":"2024-04-26T11:20:09.531099+0000","last_peered":"2024-04-26T11:20:09.531099+0000","last_clean":"2024-04-26T11:20:09.531099+0000","last_became_active":"2024-04-26T11:19:18.181863+0000","last_became_peered":"2024-04-26T11:19:18.181863+0000","last_unstale":"2024-04-26T11:20:09.531099+0000","last_undegraded":"2024-04-26T11:20:09.531099+0000","last_fullsized":"2024-04-26T11:20:09.531099+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:09.531073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:09.531073+0000","last_clean_scrub_stamp":"2024-04-26T11:20:09.531073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:28.881302+0000","scrub_duration":0.0020025820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:18.631012+0000","last_change":"2024-04-26T11:20:18.631147+0000","last_active":"2024-04-26T11:20:18.631012+0000","last_peered":"2024-04-26T11:20:18.631012+0000","last_clean":"2024-04-26T11:20:18.631012+0000","last_became_active":"2024-04-26T11:19:18.180792+0000","last_became_peered":"2024-04-26T11:19:18.180792+0000","last_unstale":"2024-04-26T11:20:18.631012+0000","last_undegraded":"2024-04-26T11:20:18.631012+0000","last_fullsized":"2024-04-26T11:20:18.631012+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:18.630989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:18.630989+0000","last_clean_scrub_stamp":"2024-04-26T11:20:18.630989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:25:42.196975+0000","scrub_duration":0.001948642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:25.520668+0000","last_change":"2024-04-26T11:20:25.520792+0000","last_active":"2024-04-26T11:20:25.520668+0000","last_peered":"2024-04-26T11:20:25.520668+0000","last_clean":"2024-04-26T11:20:25.520668+0000","last_became_active":"2024-04-26T11:19:24.197711+0000","last_became_peered":"2024-04-26T11:19:24.197711+0000","last_unstale":"2024-04-26T11:20:25.520668+0000","last_undegraded":"2024-04-26T11:20:25.520668+0000","last_fullsized":"2024-04-26T11:20:25.520668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:25.520630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:25.520630+0000","last_clean_scrub_stamp":"2024-04-26T11:20:25.520630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:29.672543+0000","scrub_duration":0.0018688400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:13.502665+0000","last_change":"2024-04-26T11:20:13.502774+0000","last_active":"2024-04-26T11:20:13.502665+0000","last_peered":"2024-04-26T11:20:13.502665+0000","last_clean":"2024-04-26T11:20:13.502665+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:20:13.502665+0000","last_undegraded":"2024-04-26T11:20:13.502665+0000","last_fullsized":"2024-04-26T11:20:13.502665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:13.502641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:13.502641+0000","last_clean_scrub_stamp":"2024-04-26T11:20:13.502641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:36.927838+0000","scrub_duration":0.00168844,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:25.495362+0000","last_change":"2024-04-26T11:20:25.495474+0000","last_active":"2024-04-26T11:20:25.495362+0000","last_peered":"2024-04-26T11:20:25.495362+0000","last_clean":"2024-04-26T11:20:25.495362+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:20:25.495362+0000","last_undegraded":"2024-04-26T11:20:25.495362+0000","last_fullsized":"2024-04-26T11:20:25.495362+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:25.495337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:25.495337+0000","last_clean_scrub_stamp":"2024-04-26T11:20:25.495337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:20.256651+0000","scrub_duration":0.0016789140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:46.745793+0000","last_change":"2024-04-26T11:19:46.745918+0000","last_active":"2024-04-26T11:19:46.745793+0000","last_peered":"2024-04-26T11:19:46.745793+0000","last_clean":"2024-04-26T11:19:46.745793+0000","last_became_active":"2024-04-26T11:19:24.202550+0000","last_became_peered":"2024-04-26T11:19:24.202550+0000","last_unstale":"2024-04-26T11:19:46.745793+0000","last_undegraded":"2024-04-26T11:19:46.745793+0000","last_fullsized":"2024-04-26T11:19:46.745793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:46.745769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:46.745769+0000","last_clean_scrub_stamp":"2024-04-26T11:19:46.745769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:09.707603+0000","scrub_duration":0.001879981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:54.434747+0000","last_change":"2024-04-26T11:19:54.434856+0000","last_active":"2024-04-26T11:19:54.434747+0000","last_peered":"2024-04-26T11:19:54.434747+0000","last_clean":"2024-04-26T11:19:54.434747+0000","last_became_active":"2024-04-26T11:19:18.182186+0000","last_became_peered":"2024-04-26T11:19:18.182186+0000","last_unstale":"2024-04-26T11:19:54.434747+0000","last_undegraded":"2024-04-26T11:19:54.434747+0000","last_fullsized":"2024-04-26T11:19:54.434747+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:54.434725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:54.434725+0000","last_clean_scrub_stamp":"2024-04-26T11:19:54.434725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:50.801459+0000","scrub_duration":0.0020204099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"82'3","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:07.630037+0000","last_change":"2024-04-26T11:20:07.630175+0000","last_active":"2024-04-26T11:20:07.630037+0000","last_peered":"2024-04-26T11:20:07.630037+0000","last_clean":"2024-04-26T11:20:07.630037+0000","last_became_active":"2024-04-26T11:19:24.202310+0000","last_became_peered":"2024-04-26T11:19:24.202310+0000","last_unstale":"2024-04-26T11:20:07.630037+0000","last_undegraded":"2024-04-26T11:20:07.630037+0000","last_fullsized":"2024-04-26T11:20:07.630037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T11:20:07.629975+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T11:20:07.629975+0000","last_clean_scrub_stamp":"2024-04-26T11:20:07.629975+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:21.316423+0000","scrub_duration":0.003499748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210609+0000","last_change":"2024-04-26T11:19:24.202951+0000","last_active":"2024-04-26T11:19:27.210609+0000","last_peered":"2024-04-26T11:19:27.210609+0000","last_clean":"2024-04-26T11:19:27.210609+0000","last_became_active":"2024-04-26T11:19:24.202566+0000","last_became_peered":"2024-04-26T11:19:24.202566+0000","last_unstale":"2024-04-26T11:19:27.210609+0000","last_undegraded":"2024-04-26T11:19:27.210609+0000","last_fullsized":"2024-04-26T11:19:27.210609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.209705+0000","last_change":"2024-04-26T11:19:24.198685+0000","last_active":"2024-04-26T11:19:27.209705+0000","last_peered":"2024-04-26T11:19:27.209705+0000","last_clean":"2024-04-26T11:19:27.209705+0000","last_became_active":"2024-04-26T11:19:24.197383+0000","last_became_peered":"2024-04-26T11:19:24.197383+0000","last_unstale":"2024-04-26T11:19:27.209705+0000","last_undegraded":"2024-04-26T11:19:27.209705+0000","last_fullsized":"2024-04-26T11:19:27.209705+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211135+0000","last_change":"2024-04-26T11:19:18.181795+0000","last_active":"2024-04-26T11:19:27.211135+0000","last_peered":"2024-04-26T11:19:27.211135+0000","last_clean":"2024-04-26T11:19:27.211135+0000","last_became_active":"2024-04-26T11:19:18.180871+0000","last_became_peered":"2024-04-26T11:19:18.180871+0000","last_unstale":"2024-04-26T11:19:27.211135+0000","last_undegraded":"2024-04-26T11:19:27.211135+0000","last_fullsized":"2024-04-26T11:19:27.211135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:07.104249+0000","last_clean_scrub_stamp":"2024-04-26T11:13:07.104249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"82'2","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:21.514790+0000","last_change":"2024-04-26T11:20:21.514923+0000","last_active":"2024-04-26T11:20:21.514790+0000","last_peered":"2024-04-26T11:20:21.514790+0000","last_clean":"2024-04-26T11:20:21.514790+0000","last_became_active":"2024-04-26T11:19:24.198853+0000","last_became_peered":"2024-04-26T11:19:24.198853+0000","last_unstale":"2024-04-26T11:20:21.514790+0000","last_undegraded":"2024-04-26T11:20:21.514790+0000","last_fullsized":"2024-04-26T11:20:21.514790+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-26T11:20:21.514765+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-26T11:20:21.514765+0000","last_clean_scrub_stamp":"2024-04-26T11:20:21.514765+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:45.584635+0000","scrub_duration":0.0035848450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:08.427084+0000","last_change":"2024-04-26T11:20:08.427208+0000","last_active":"2024-04-26T11:20:08.427084+0000","last_peered":"2024-04-26T11:20:08.427084+0000","last_clean":"2024-04-26T11:20:08.427084+0000","last_became_active":"2024-04-26T11:19:18.182228+0000","last_became_peered":"2024-04-26T11:19:18.182228+0000","last_unstale":"2024-04-26T11:20:08.427084+0000","last_undegraded":"2024-04-26T11:20:08.427084+0000","last_fullsized":"2024-04-26T11:20:08.427084+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:08.427044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:08.427044+0000","last_clean_scrub_stamp":"2024-04-26T11:20:08.427044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:44.490541+0000","scrub_duration":0.0019152240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":111,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210600+0000","last_change":"2024-04-26T11:19:18.183238+0000","last_active":"2024-04-26T11:19:27.210600+0000","last_peered":"2024-04-26T11:19:27.210600+0000","last_clean":"2024-04-26T11:19:27.210600+0000","last_became_active":"2024-04-26T11:19:18.182671+0000","last_became_peered":"2024-04-26T11:19:18.182671+0000","last_unstale":"2024-04-26T11:19:27.210600+0000","last_undegraded":"2024-04-26T11:19:27.210600+0000","last_fullsized":"2024-04-26T11:19:27.210600+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:58.458609+0000","last_change":"2024-04-26T11:19:58.458718+0000","last_active":"2024-04-26T11:19:58.458609+0000","last_peered":"2024-04-26T11:19:58.458609+0000","last_clean":"2024-04-26T11:19:58.458609+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:19:58.458609+0000","last_undegraded":"2024-04-26T11:19:58.458609+0000","last_fullsized":"2024-04-26T11:19:58.458609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:58.458587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:58.458587+0000","last_clean_scrub_stamp":"2024-04-26T11:19:58.458587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:28.129815+0000","scrub_duration":0.001786494,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"82'3","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:39.596075+0000","last_change":"2024-04-26T11:19:39.596215+0000","last_active":"2024-04-26T11:19:39.596075+0000","last_peered":"2024-04-26T11:19:39.596075+0000","last_clean":"2024-04-26T11:19:39.596075+0000","last_became_active":"2024-04-26T11:19:18.188177+0000","last_became_peered":"2024-04-26T11:19:18.188177+0000","last_unstale":"2024-04-26T11:19:39.596075+0000","last_undegraded":"2024-04-26T11:19:39.596075+0000","last_fullsized":"2024-04-26T11:19:39.596075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T11:19:39.596051+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T11:19:39.596051+0000","last_clean_scrub_stamp":"2024-04-26T11:19:39.596051+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:18.488192+0000","scrub_duration":0.0035445559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:38.600610+0000","last_change":"2024-04-26T11:19:38.600786+0000","last_active":"2024-04-26T11:19:38.600610+0000","last_peered":"2024-04-26T11:19:38.600610+0000","last_clean":"2024-04-26T11:19:38.600610+0000","last_became_active":"2024-04-26T11:19:18.185372+0000","last_became_peered":"2024-04-26T11:19:18.185372+0000","last_unstale":"2024-04-26T11:19:38.600610+0000","last_undegraded":"2024-04-26T11:19:38.600610+0000","last_fullsized":"2024-04-26T11:19:38.600610+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:38.600585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:38.600585+0000","last_clean_scrub_stamp":"2024-04-26T11:19:38.600585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:00.495830+0000","scrub_duration":0.026821652000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"82'3","reported_seq":121,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:17.493693+0000","last_change":"2024-04-26T11:20:17.493793+0000","last_active":"2024-04-26T11:20:17.493693+0000","last_peered":"2024-04-26T11:20:17.493693+0000","last_clean":"2024-04-26T11:20:17.493693+0000","last_became_active":"2024-04-26T11:19:18.190374+0000","last_became_peered":"2024-04-26T11:19:18.190374+0000","last_unstale":"2024-04-26T11:20:17.493693+0000","last_undegraded":"2024-04-26T11:20:17.493693+0000","last_fullsized":"2024-04-26T11:20:17.493693+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T11:20:17.493667+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T11:20:17.493667+0000","last_clean_scrub_stamp":"2024-04-26T11:20:17.493667+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:30.759887+0000","scrub_duration":0.0029392099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210709+0000","last_change":"2024-04-26T11:19:18.189666+0000","last_active":"2024-04-26T11:19:27.210709+0000","last_peered":"2024-04-26T11:19:27.210709+0000","last_clean":"2024-04-26T11:19:27.210709+0000","last_became_active":"2024-04-26T11:19:18.189341+0000","last_became_peered":"2024-04-26T11:19:18.189341+0000","last_unstale":"2024-04-26T11:19:27.210709+0000","last_undegraded":"2024-04-26T11:19:27.210709+0000","last_fullsized":"2024-04-26T11:19:27.210709+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210706+0000","last_change":"2024-04-26T11:19:24.202866+0000","last_active":"2024-04-26T11:19:27.210706+0000","last_peered":"2024-04-26T11:19:27.210706+0000","last_clean":"2024-04-26T11:19:27.210706+0000","last_became_active":"2024-04-26T11:19:24.202422+0000","last_became_peered":"2024-04-26T11:19:24.202422+0000","last_unstale":"2024-04-26T11:19:27.210706+0000","last_undegraded":"2024-04-26T11:19:27.210706+0000","last_fullsized":"2024-04-26T11:19:27.210706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.271783+0000","last_change":"2024-04-26T11:13:12.917763+0000","last_active":"2024-04-26T11:19:35.271783+0000","last_peered":"2024-04-26T11:19:35.271783+0000","last_clean":"2024-04-26T11:19:35.271783+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:19:35.271783+0000","last_undegraded":"2024-04-26T11:19:35.271783+0000","last_fullsized":"2024-04-26T11:19:35.271783+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210688+0000","last_change":"2024-04-26T11:19:24.205087+0000","last_active":"2024-04-26T11:19:27.210688+0000","last_peered":"2024-04-26T11:19:27.210688+0000","last_clean":"2024-04-26T11:19:27.210688+0000","last_became_active":"2024-04-26T11:19:24.204129+0000","last_became_peered":"2024-04-26T11:19:24.204129+0000","last_unstale":"2024-04-26T11:19:27.210688+0000","last_undegraded":"2024-04-26T11:19:27.210688+0000","last_fullsized":"2024-04-26T11:19:27.210688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210568+0000","last_change":"2024-04-26T11:19:18.189530+0000","last_active":"2024-04-26T11:19:27.210568+0000","last_peered":"2024-04-26T11:19:27.210568+0000","last_clean":"2024-04-26T11:19:27.210568+0000","last_became_active":"2024-04-26T11:19:18.189179+0000","last_became_peered":"2024-04-26T11:19:18.189179+0000","last_unstale":"2024-04-26T11:19:27.210568+0000","last_undegraded":"2024-04-26T11:19:27.210568+0000","last_fullsized":"2024-04-26T11:19:27.210568+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:40.624649+0000","last_change":"2024-04-26T11:19:40.624780+0000","last_active":"2024-04-26T11:19:40.624649+0000","last_peered":"2024-04-26T11:19:40.624649+0000","last_clean":"2024-04-26T11:19:40.624649+0000","last_became_active":"2024-04-26T11:19:18.188963+0000","last_became_peered":"2024-04-26T11:19:18.188963+0000","last_unstale":"2024-04-26T11:19:40.624649+0000","last_undegraded":"2024-04-26T11:19:40.624649+0000","last_fullsized":"2024-04-26T11:19:40.624649+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:40.624624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:40.624624+0000","last_clean_scrub_stamp":"2024-04-26T11:19:40.624624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:51.952842+0000","scrub_duration":0.0017518169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:04.580384+0000","last_change":"2024-04-26T11:20:04.580503+0000","last_active":"2024-04-26T11:20:04.580384+0000","last_peered":"2024-04-26T11:20:04.580384+0000","last_clean":"2024-04-26T11:20:04.580384+0000","last_became_active":"2024-04-26T11:19:24.198397+0000","last_became_peered":"2024-04-26T11:19:24.198397+0000","last_unstale":"2024-04-26T11:20:04.580384+0000","last_undegraded":"2024-04-26T11:20:04.580384+0000","last_fullsized":"2024-04-26T11:20:04.580384+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:04.580360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:04.580360+0000","last_clean_scrub_stamp":"2024-04-26T11:20:04.580360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:29.686078+0000","scrub_duration":0.0018333259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":107,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:31.632525+0000","last_change":"2024-04-26T11:19:18.183441+0000","last_active":"2024-04-26T11:19:31.632525+0000","last_peered":"2024-04-26T11:19:31.632525+0000","last_clean":"2024-04-26T11:19:31.632525+0000","last_became_active":"2024-04-26T11:19:18.183037+0000","last_became_peered":"2024-04-26T11:19:18.183037+0000","last_unstale":"2024-04-26T11:19:31.632525+0000","last_undegraded":"2024-04-26T11:19:31.632525+0000","last_fullsized":"2024-04-26T11:19:31.632525+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:55.673443+0000","last_change":"2024-04-26T11:19:55.673586+0000","last_active":"2024-04-26T11:19:55.673443+0000","last_peered":"2024-04-26T11:19:55.673443+0000","last_clean":"2024-04-26T11:19:55.673443+0000","last_became_active":"2024-04-26T11:19:24.202442+0000","last_became_peered":"2024-04-26T11:19:24.202442+0000","last_unstale":"2024-04-26T11:19:55.673443+0000","last_undegraded":"2024-04-26T11:19:55.673443+0000","last_fullsized":"2024-04-26T11:19:55.673443+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:55.673417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:55.673417+0000","last_clean_scrub_stamp":"2024-04-26T11:19:55.673417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:51.687827+0000","scrub_duration":0.029303546,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:51.420225+0000","last_change":"2024-04-26T11:19:51.420347+0000","last_active":"2024-04-26T11:19:51.420225+0000","last_peered":"2024-04-26T11:19:51.420225+0000","last_clean":"2024-04-26T11:19:51.420225+0000","last_became_active":"2024-04-26T11:19:18.184384+0000","last_became_peered":"2024-04-26T11:19:18.184384+0000","last_unstale":"2024-04-26T11:19:51.420225+0000","last_undegraded":"2024-04-26T11:19:51.420225+0000","last_fullsized":"2024-04-26T11:19:51.420225+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:51.420205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:51.420205+0000","last_clean_scrub_stamp":"2024-04-26T11:19:51.420205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:55.572118+0000","scrub_duration":0.001998835,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7958,"internal_metadata":0},"log_size":57,"ondisk_log_size":57,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738460,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281144,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94090696,"statfs":{"total":96636764160,"available":96348872704,"internally_reserved":0,"allocated":1490944,"data_stored":947441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.36699999999999999}]},{"osd":1,"last update":"Fri Apr 26 11:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.45800000000000002,"15min":0.39600000000000002},"min":{"1min":0.34399999999999997,"5min":0.17999999999999999,"15min":0.17199999999999999},"max":{"1min":0.68100000000000005,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.45300000000000001},"min":{"1min":0.316,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.66400000000000003,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.40400000000000003}]}]},{"osd":0,"up_from":75,"seq":322122547218,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38148,"kb_used_data":1468,"kb_used_omap":10,"kb_used_meta":36661,"kb_avail":94333692,"statfs":{"total":96636764160,"available":96597700608,"internally_reserved":0,"allocated":1503232,"data_stored":949168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11228,"internal_metadata":37540900},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 11:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.54000000000000004}]},{"osd":2,"last update":"Fri Apr 26 11:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.56599999999999995}]}]},{"osd":1,"up_from":8,"seq":34359738461,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401128,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":400254,"kb_avail":93970712,"statfs":{"total":96636764160,"available":96226009088,"internally_reserved":0,"allocated":884736,"data_stored":357054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":409860550},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:20:17 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.496},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.48299999999999998}]},{"osd":2,"last update":"Fri Apr 26 11:20:17 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44800000000000001,"15min":0.41199999999999998},"min":{"1min":0.29399999999999998,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.65400000000000003,"5min":0.69199999999999995,"15min":2.056},"last":0.44},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.51000000000000001,"15min":0.46500000000000002},"min":{"1min":0.33000000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.60299999999999998,"5min":3.9609999999999999,"15min":3.9609999999999999},"last":0.42399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7958,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:20:36.819 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.819 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.819 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.820 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.820 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.820 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.820 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.820 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.820 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.821 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.821 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.822 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.822 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.822 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.822 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.822 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.822 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.822 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.823 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.823 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.823 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.823 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.823 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.823 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.824 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.824 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.824 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.824 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.824 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T11:13:07.104249+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.825 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.825 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.825 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.825 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.825 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.825 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.825 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:36.826 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T11:20:56.827 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:20:57.187 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:20:57.188 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:20:57.198 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2024-04-26T11:20:56.583132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":720420,"kb_used_data":3788,"kb_used_omap":14,"kb_used_meta":716593,"kb_avail":282395100,"statfs":{"total":289910292480,"available":289172582400,"internally_reserved":0,"allocated":3878912,"data_stored":2253663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14416,"internal_metadata":733792176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003287"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:31.632644+0000","last_change":"2024-04-26T11:13:12.919196+0000","last_active":"2024-04-26T11:19:31.632644+0000","last_peered":"2024-04-26T11:19:31.632644+0000","last_clean":"2024-04-26T11:19:31.632644+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:19:31.632644+0000","last_undegraded":"2024-04-26T11:19:31.632644+0000","last_fullsized":"2024-04-26T11:19:31.632644+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:31.632604+0000","last_change":"2024-04-26T11:13:12.917670+0000","last_active":"2024-04-26T11:19:31.632604+0000","last_peered":"2024-04-26T11:19:31.632604+0000","last_clean":"2024-04-26T11:19:31.632604+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:19:31.632604+0000","last_undegraded":"2024-04-26T11:19:31.632604+0000","last_fullsized":"2024-04-26T11:19:31.632604+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211220+0000","last_change":"2024-04-26T11:19:18.185209+0000","last_active":"2024-04-26T11:19:27.211220+0000","last_peered":"2024-04-26T11:19:27.211220+0000","last_clean":"2024-04-26T11:19:27.211220+0000","last_became_active":"2024-04-26T11:19:18.182972+0000","last_became_peered":"2024-04-26T11:19:18.182972+0000","last_unstale":"2024-04-26T11:19:27.211220+0000","last_undegraded":"2024-04-26T11:19:27.211220+0000","last_fullsized":"2024-04-26T11:19:27.211220+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:43.746491+0000","last_change":"2024-04-26T11:20:43.746595+0000","last_active":"2024-04-26T11:20:43.746491+0000","last_peered":"2024-04-26T11:20:43.746491+0000","last_clean":"2024-04-26T11:20:43.746491+0000","last_became_active":"2024-04-26T11:19:18.182942+0000","last_became_peered":"2024-04-26T11:19:18.182942+0000","last_unstale":"2024-04-26T11:20:43.746491+0000","last_undegraded":"2024-04-26T11:20:43.746491+0000","last_fullsized":"2024-04-26T11:20:43.746491+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:43.746467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:43.746467+0000","last_clean_scrub_stamp":"2024-04-26T11:20:43.746467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:50.125560+0000","scrub_duration":0.0019204280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:50.418051+0000","last_change":"2024-04-26T11:19:50.418051+0000","last_active":"2024-04-26T11:19:50.418051+0000","last_peered":"2024-04-26T11:19:50.418051+0000","last_clean":"2024-04-26T11:19:50.418051+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:19:50.418051+0000","last_undegraded":"2024-04-26T11:19:50.418051+0000","last_fullsized":"2024-04-26T11:19:50.418051+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:50.417924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:50.417924+0000","last_clean_scrub_stamp":"2024-04-26T11:19:50.417924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:25.937563+0000","scrub_duration":0.016392371999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210596+0000","last_change":"2024-04-26T11:19:18.189355+0000","last_active":"2024-04-26T11:19:27.210596+0000","last_peered":"2024-04-26T11:19:27.210596+0000","last_clean":"2024-04-26T11:19:27.210596+0000","last_became_active":"2024-04-26T11:19:18.188990+0000","last_became_peered":"2024-04-26T11:19:18.188990+0000","last_unstale":"2024-04-26T11:19:27.210596+0000","last_undegraded":"2024-04-26T11:19:27.210596+0000","last_fullsized":"2024-04-26T11:19:27.210596+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:45.509116+0000","last_change":"2024-04-26T11:19:45.509220+0000","last_active":"2024-04-26T11:19:45.509116+0000","last_peered":"2024-04-26T11:19:45.509116+0000","last_clean":"2024-04-26T11:19:45.509116+0000","last_became_active":"2024-04-26T11:19:18.186638+0000","last_became_peered":"2024-04-26T11:19:18.186638+0000","last_unstale":"2024-04-26T11:19:45.509116+0000","last_undegraded":"2024-04-26T11:19:45.509116+0000","last_fullsized":"2024-04-26T11:19:45.509116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:45.509090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:45.509090+0000","last_clean_scrub_stamp":"2024-04-26T11:19:45.509090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:05.567613+0000","scrub_duration":0.017637363999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:23.683390+0000","last_change":"2024-04-26T11:20:23.683509+0000","last_active":"2024-04-26T11:20:23.683390+0000","last_peered":"2024-04-26T11:20:23.683390+0000","last_clean":"2024-04-26T11:20:23.683390+0000","last_became_active":"2024-04-26T11:19:18.182111+0000","last_became_peered":"2024-04-26T11:19:18.182111+0000","last_unstale":"2024-04-26T11:20:23.683390+0000","last_undegraded":"2024-04-26T11:20:23.683390+0000","last_fullsized":"2024-04-26T11:20:23.683390+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:23.683352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:23.683352+0000","last_clean_scrub_stamp":"2024-04-26T11:20:23.683352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:37.939942+0000","scrub_duration":0.001634702,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:42.411970+0000","last_change":"2024-04-26T11:20:42.412117+0000","last_active":"2024-04-26T11:20:42.411970+0000","last_peered":"2024-04-26T11:20:42.411970+0000","last_clean":"2024-04-26T11:20:42.411970+0000","last_became_active":"2024-04-26T11:19:24.202146+0000","last_became_peered":"2024-04-26T11:19:24.202146+0000","last_unstale":"2024-04-26T11:20:42.411970+0000","last_undegraded":"2024-04-26T11:20:42.411970+0000","last_fullsized":"2024-04-26T11:20:42.411970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:42.411946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:42.411946+0000","last_clean_scrub_stamp":"2024-04-26T11:20:42.411946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:18.475443+0000","scrub_duration":0.029462447999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:44.426458+0000","last_change":"2024-04-26T11:20:44.426546+0000","last_active":"2024-04-26T11:20:44.426458+0000","last_peered":"2024-04-26T11:20:44.426458+0000","last_clean":"2024-04-26T11:20:44.426458+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:20:44.426458+0000","last_undegraded":"2024-04-26T11:20:44.426458+0000","last_fullsized":"2024-04-26T11:20:44.426458+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:44.426436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:44.426436+0000","last_clean_scrub_stamp":"2024-04-26T11:20:44.426436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:53.146087+0000","scrub_duration":0.001820412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:52.515823+0000","last_change":"2024-04-26T11:19:52.515987+0000","last_active":"2024-04-26T11:19:52.515823+0000","last_peered":"2024-04-26T11:19:52.515823+0000","last_clean":"2024-04-26T11:19:52.515823+0000","last_became_active":"2024-04-26T11:19:18.185543+0000","last_became_peered":"2024-04-26T11:19:18.185543+0000","last_unstale":"2024-04-26T11:19:52.515823+0000","last_undegraded":"2024-04-26T11:19:52.515823+0000","last_fullsized":"2024-04-26T11:19:52.515823+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:52.515775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:52.515775+0000","last_clean_scrub_stamp":"2024-04-26T11:19:52.515775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.954162+0000","scrub_duration":0.016652819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":107,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.271910+0000","last_change":"2024-04-26T11:19:18.183459+0000","last_active":"2024-04-26T11:19:35.271910+0000","last_peered":"2024-04-26T11:19:35.271910+0000","last_clean":"2024-04-26T11:19:35.271910+0000","last_became_active":"2024-04-26T11:19:18.182827+0000","last_became_peered":"2024-04-26T11:19:18.182827+0000","last_unstale":"2024-04-26T11:19:35.271910+0000","last_undegraded":"2024-04-26T11:19:35.271910+0000","last_fullsized":"2024-04-26T11:19:35.271910+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.499190+0000","last_change":"2024-04-26T11:19:35.499190+0000","last_active":"2024-04-26T11:19:35.499190+0000","last_peered":"2024-04-26T11:19:35.499190+0000","last_clean":"2024-04-26T11:19:35.499190+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:19:35.499190+0000","last_undegraded":"2024-04-26T11:19:35.499190+0000","last_fullsized":"2024-04-26T11:19:35.499190+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:35.499030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:35.499030+0000","last_clean_scrub_stamp":"2024-04-26T11:19:35.499030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:49.185477+0000","scrub_duration":0.018123878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:41.593903+0000","last_change":"2024-04-26T11:19:41.594000+0000","last_active":"2024-04-26T11:19:41.593903+0000","last_peered":"2024-04-26T11:19:41.593903+0000","last_clean":"2024-04-26T11:19:41.593903+0000","last_became_active":"2024-04-26T11:19:18.180865+0000","last_became_peered":"2024-04-26T11:19:18.180865+0000","last_unstale":"2024-04-26T11:19:41.593903+0000","last_undegraded":"2024-04-26T11:19:41.593903+0000","last_fullsized":"2024-04-26T11:19:41.593903+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:41.593880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:41.593880+0000","last_clean_scrub_stamp":"2024-04-26T11:19:41.593880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:56.201582+0000","scrub_duration":0.0019243019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:51.517339+0000","last_change":"2024-04-26T11:19:51.517460+0000","last_active":"2024-04-26T11:19:51.517339+0000","last_peered":"2024-04-26T11:19:51.517339+0000","last_clean":"2024-04-26T11:19:51.517339+0000","last_became_active":"2024-04-26T11:19:18.180763+0000","last_became_peered":"2024-04-26T11:19:18.180763+0000","last_unstale":"2024-04-26T11:19:51.517339+0000","last_undegraded":"2024-04-26T11:19:51.517339+0000","last_fullsized":"2024-04-26T11:19:51.517339+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:51.517314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:51.517314+0000","last_clean_scrub_stamp":"2024-04-26T11:19:51.517314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:47:38.185008+0000","scrub_duration":0.0020719620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:07.533224+0000","last_change":"2024-04-26T11:20:07.533355+0000","last_active":"2024-04-26T11:20:07.533224+0000","last_peered":"2024-04-26T11:20:07.533224+0000","last_clean":"2024-04-26T11:20:07.533224+0000","last_became_active":"2024-04-26T11:19:18.184331+0000","last_became_peered":"2024-04-26T11:19:18.184331+0000","last_unstale":"2024-04-26T11:20:07.533224+0000","last_undegraded":"2024-04-26T11:20:07.533224+0000","last_fullsized":"2024-04-26T11:20:07.533224+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:07.533200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:07.533200+0000","last_clean_scrub_stamp":"2024-04-26T11:20:07.533200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:50.283609+0000","scrub_duration":0.0016781039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:20.582602+0000","last_change":"2024-04-26T11:20:20.582731+0000","last_active":"2024-04-26T11:20:20.582602+0000","last_peered":"2024-04-26T11:20:20.582602+0000","last_clean":"2024-04-26T11:20:20.582602+0000","last_became_active":"2024-04-26T11:19:24.203764+0000","last_became_peered":"2024-04-26T11:19:24.203764+0000","last_unstale":"2024-04-26T11:20:20.582602+0000","last_undegraded":"2024-04-26T11:20:20.582602+0000","last_fullsized":"2024-04-26T11:20:20.582602+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:20.582577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:20.582577+0000","last_clean_scrub_stamp":"2024-04-26T11:20:20.582577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:06.502392+0000","scrub_duration":0.083132415000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:43.423762+0000","last_change":"2024-04-26T11:19:43.423762+0000","last_active":"2024-04-26T11:19:43.423762+0000","last_peered":"2024-04-26T11:19:43.423762+0000","last_clean":"2024-04-26T11:19:43.423762+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:19:43.423762+0000","last_undegraded":"2024-04-26T11:19:43.423762+0000","last_fullsized":"2024-04-26T11:19:43.423762+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:43.423617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:43.423617+0000","last_clean_scrub_stamp":"2024-04-26T11:19:43.423617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:58.420909+0000","scrub_duration":0.0017194790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:23.537391+0000","last_change":"2024-04-26T11:20:23.537545+0000","last_active":"2024-04-26T11:20:23.537391+0000","last_peered":"2024-04-26T11:20:23.537391+0000","last_clean":"2024-04-26T11:20:23.537391+0000","last_became_active":"2024-04-26T11:19:24.199142+0000","last_became_peered":"2024-04-26T11:19:24.199142+0000","last_unstale":"2024-04-26T11:20:23.537391+0000","last_undegraded":"2024-04-26T11:20:23.537391+0000","last_fullsized":"2024-04-26T11:20:23.537391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:23.537367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:23.537367+0000","last_clean_scrub_stamp":"2024-04-26T11:20:23.537367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:03.679558+0000","scrub_duration":0.029516655999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:42.569786+0000","last_change":"2024-04-26T11:19:42.569936+0000","last_active":"2024-04-26T11:19:42.569786+0000","last_peered":"2024-04-26T11:19:42.569786+0000","last_clean":"2024-04-26T11:19:42.569786+0000","last_became_active":"2024-04-26T11:19:18.184282+0000","last_became_peered":"2024-04-26T11:19:18.184282+0000","last_unstale":"2024-04-26T11:19:42.569786+0000","last_undegraded":"2024-04-26T11:19:42.569786+0000","last_fullsized":"2024-04-26T11:19:42.569786+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:42.569760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:42.569760+0000","last_clean_scrub_stamp":"2024-04-26T11:19:42.569760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:17.239747+0000","scrub_duration":0.0018614059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:44.771701+0000","last_change":"2024-04-26T11:20:44.771866+0000","last_active":"2024-04-26T11:20:44.771701+0000","last_peered":"2024-04-26T11:20:44.771701+0000","last_clean":"2024-04-26T11:20:44.771701+0000","last_became_active":"2024-04-26T11:19:18.186605+0000","last_became_peered":"2024-04-26T11:19:18.186605+0000","last_unstale":"2024-04-26T11:20:44.771701+0000","last_undegraded":"2024-04-26T11:20:44.771701+0000","last_fullsized":"2024-04-26T11:20:44.771701+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:44.771678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:44.771678+0000","last_clean_scrub_stamp":"2024-04-26T11:20:44.771678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:03.023486+0000","scrub_duration":0.022587506,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:59.494778+0000","last_change":"2024-04-26T11:19:59.494778+0000","last_active":"2024-04-26T11:19:59.494778+0000","last_peered":"2024-04-26T11:19:59.494778+0000","last_clean":"2024-04-26T11:19:59.494778+0000","last_became_active":"2024-04-26T11:19:18.181728+0000","last_became_peered":"2024-04-26T11:19:18.181728+0000","last_unstale":"2024-04-26T11:19:59.494778+0000","last_undegraded":"2024-04-26T11:19:59.494778+0000","last_fullsized":"2024-04-26T11:19:59.494778+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:59.494616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:59.494616+0000","last_clean_scrub_stamp":"2024-04-26T11:19:59.494616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:50:32.682411+0000","scrub_duration":0.001815215,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:27.592038+0000","last_change":"2024-04-26T11:20:27.592160+0000","last_active":"2024-04-26T11:20:27.592038+0000","last_peered":"2024-04-26T11:20:27.592038+0000","last_clean":"2024-04-26T11:20:27.592038+0000","last_became_active":"2024-04-26T11:19:24.197487+0000","last_became_peered":"2024-04-26T11:19:24.197487+0000","last_unstale":"2024-04-26T11:20:27.592038+0000","last_undegraded":"2024-04-26T11:20:27.592038+0000","last_fullsized":"2024-04-26T11:20:27.592038+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:27.592000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:27.592000+0000","last_clean_scrub_stamp":"2024-04-26T11:20:27.592000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:52:21.837181+0000","scrub_duration":0.0016673460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:48.396499+0000","last_change":"2024-04-26T11:19:48.396656+0000","last_active":"2024-04-26T11:19:48.396499+0000","last_peered":"2024-04-26T11:19:48.396499+0000","last_clean":"2024-04-26T11:19:48.396499+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:19:48.396499+0000","last_undegraded":"2024-04-26T11:19:48.396499+0000","last_fullsized":"2024-04-26T11:19:48.396499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:48.396472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:48.396472+0000","last_clean_scrub_stamp":"2024-04-26T11:19:48.396472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:16.773782+0000","scrub_duration":0.0019312940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:19.512918+0000","last_change":"2024-04-26T11:20:19.513110+0000","last_active":"2024-04-26T11:20:19.512918+0000","last_peered":"2024-04-26T11:20:19.512918+0000","last_clean":"2024-04-26T11:20:19.512918+0000","last_became_active":"2024-04-26T11:19:18.184451+0000","last_became_peered":"2024-04-26T11:19:18.184451+0000","last_unstale":"2024-04-26T11:20:19.512918+0000","last_undegraded":"2024-04-26T11:20:19.512918+0000","last_fullsized":"2024-04-26T11:20:19.512918+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:19.512881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:19.512881+0000","last_clean_scrub_stamp":"2024-04-26T11:20:19.512881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:33.563886+0000","scrub_duration":0.023492367,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:08.595129+0000","last_change":"2024-04-26T11:20:08.595253+0000","last_active":"2024-04-26T11:20:08.595129+0000","last_peered":"2024-04-26T11:20:08.595129+0000","last_clean":"2024-04-26T11:20:08.595129+0000","last_became_active":"2024-04-26T11:19:24.198479+0000","last_became_peered":"2024-04-26T11:19:24.198479+0000","last_unstale":"2024-04-26T11:20:08.595129+0000","last_undegraded":"2024-04-26T11:20:08.595129+0000","last_fullsized":"2024-04-26T11:20:08.595129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:08.595106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:08.595106+0000","last_clean_scrub_stamp":"2024-04-26T11:20:08.595106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:18.295964+0000","scrub_duration":0.0021262659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:13.621793+0000","last_change":"2024-04-26T11:20:13.621938+0000","last_active":"2024-04-26T11:20:13.621793+0000","last_peered":"2024-04-26T11:20:13.621793+0000","last_clean":"2024-04-26T11:20:13.621793+0000","last_became_active":"2024-04-26T11:19:18.185105+0000","last_became_peered":"2024-04-26T11:19:18.185105+0000","last_unstale":"2024-04-26T11:20:13.621793+0000","last_undegraded":"2024-04-26T11:20:13.621793+0000","last_fullsized":"2024-04-26T11:20:13.621793+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:13.621769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:13.621769+0000","last_clean_scrub_stamp":"2024-04-26T11:20:13.621769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:26.915580+0000","scrub_duration":0.0020478789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:40.405429+0000","last_change":"2024-04-26T11:20:40.405429+0000","last_active":"2024-04-26T11:20:40.405429+0000","last_peered":"2024-04-26T11:20:40.405429+0000","last_clean":"2024-04-26T11:20:40.405429+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:20:40.405429+0000","last_undegraded":"2024-04-26T11:20:40.405429+0000","last_fullsized":"2024-04-26T11:20:40.405429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T11:20:40.405289+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T11:20:40.405289+0000","last_clean_scrub_stamp":"2024-04-26T11:20:40.405289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:32.550379+0000","scrub_duration":0.001668409,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:43.408650+0000","last_change":"2024-04-26T11:20:43.408650+0000","last_active":"2024-04-26T11:20:43.408650+0000","last_peered":"2024-04-26T11:20:43.408650+0000","last_clean":"2024-04-26T11:20:43.408650+0000","last_became_active":"2024-04-26T11:19:18.190792+0000","last_became_peered":"2024-04-26T11:19:18.190792+0000","last_unstale":"2024-04-26T11:20:43.408650+0000","last_undegraded":"2024-04-26T11:20:43.408650+0000","last_fullsized":"2024-04-26T11:20:43.408650+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:43.408434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:43.408434+0000","last_clean_scrub_stamp":"2024-04-26T11:20:43.408434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:27.015116+0000","scrub_duration":0.0017783230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":67,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.667261+0000","last_change":"2024-04-26T11:19:35.667355+0000","last_active":"2024-04-26T11:19:35.667261+0000","last_peered":"2024-04-26T11:19:35.667261+0000","last_clean":"2024-04-26T11:19:35.667261+0000","last_became_active":"2024-04-26T11:19:24.202348+0000","last_became_peered":"2024-04-26T11:19:24.202348+0000","last_unstale":"2024-04-26T11:19:35.667261+0000","last_undegraded":"2024-04-26T11:19:35.667261+0000","last_fullsized":"2024-04-26T11:19:35.667261+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:35.667237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:35.667237+0000","last_clean_scrub_stamp":"2024-04-26T11:19:35.667237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:38.776469+0000","scrub_duration":0.0019697669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:44.766975+0000","last_change":"2024-04-26T11:19:44.767086+0000","last_active":"2024-04-26T11:19:44.766975+0000","last_peered":"2024-04-26T11:19:44.766975+0000","last_clean":"2024-04-26T11:19:44.766975+0000","last_became_active":"2024-04-26T11:19:24.198920+0000","last_became_peered":"2024-04-26T11:19:24.198920+0000","last_unstale":"2024-04-26T11:19:44.766975+0000","last_undegraded":"2024-04-26T11:19:44.766975+0000","last_fullsized":"2024-04-26T11:19:44.766975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:44.766950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:44.766950+0000","last_clean_scrub_stamp":"2024-04-26T11:19:44.766950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:30.054801+0000","scrub_duration":0.0017451579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:47.408691+0000","last_change":"2024-04-26T11:20:47.408795+0000","last_active":"2024-04-26T11:20:47.408691+0000","last_peered":"2024-04-26T11:20:47.408691+0000","last_clean":"2024-04-26T11:20:47.408691+0000","last_became_active":"2024-04-26T11:19:24.197698+0000","last_became_peered":"2024-04-26T11:19:24.197698+0000","last_unstale":"2024-04-26T11:20:47.408691+0000","last_undegraded":"2024-04-26T11:20:47.408691+0000","last_fullsized":"2024-04-26T11:20:47.408691+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:47.408667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:47.408667+0000","last_clean_scrub_stamp":"2024-04-26T11:20:47.408667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:10.833863+0000","scrub_duration":0.00179385,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:47.503571+0000","last_change":"2024-04-26T11:19:47.503709+0000","last_active":"2024-04-26T11:19:47.503571+0000","last_peered":"2024-04-26T11:19:47.503571+0000","last_clean":"2024-04-26T11:19:47.503571+0000","last_became_active":"2024-04-26T11:19:18.190127+0000","last_became_peered":"2024-04-26T11:19:18.190127+0000","last_unstale":"2024-04-26T11:19:47.503571+0000","last_undegraded":"2024-04-26T11:19:47.503571+0000","last_fullsized":"2024-04-26T11:19:47.503571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:47.503550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:47.503550+0000","last_clean_scrub_stamp":"2024-04-26T11:19:47.503550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:33.423364+0000","scrub_duration":0.064283446999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:34.750983+0000","last_change":"2024-04-26T11:19:24.205086+0000","last_active":"2024-04-26T11:19:34.750983+0000","last_peered":"2024-04-26T11:19:34.750983+0000","last_clean":"2024-04-26T11:19:34.750983+0000","last_became_active":"2024-04-26T11:19:24.204122+0000","last_became_peered":"2024-04-26T11:19:24.204122+0000","last_unstale":"2024-04-26T11:19:34.750983+0000","last_undegraded":"2024-04-26T11:19:34.750983+0000","last_fullsized":"2024-04-26T11:19:34.750983+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:24.473040+0000","last_change":"2024-04-26T11:20:24.473172+0000","last_active":"2024-04-26T11:20:24.473040+0000","last_peered":"2024-04-26T11:20:24.473040+0000","last_clean":"2024-04-26T11:20:24.473040+0000","last_became_active":"2024-04-26T11:19:24.197247+0000","last_became_peered":"2024-04-26T11:19:24.197247+0000","last_unstale":"2024-04-26T11:20:24.473040+0000","last_undegraded":"2024-04-26T11:20:24.473040+0000","last_fullsized":"2024-04-26T11:20:24.473040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:24.473016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:24.473016+0000","last_clean_scrub_stamp":"2024-04-26T11:20:24.473016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:59.992655+0000","scrub_duration":0.001721656,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:19.633755+0000","last_change":"2024-04-26T11:20:19.633856+0000","last_active":"2024-04-26T11:20:19.633755+0000","last_peered":"2024-04-26T11:20:19.633755+0000","last_clean":"2024-04-26T11:20:19.633755+0000","last_became_active":"2024-04-26T11:19:18.185578+0000","last_became_peered":"2024-04-26T11:19:18.185578+0000","last_unstale":"2024-04-26T11:20:19.633755+0000","last_undegraded":"2024-04-26T11:20:19.633755+0000","last_fullsized":"2024-04-26T11:20:19.633755+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:19.633732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:19.633732+0000","last_clean_scrub_stamp":"2024-04-26T11:20:19.633732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:47.795228+0000","scrub_duration":0.001874459,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:05.541862+0000","last_change":"2024-04-26T11:20:05.541862+0000","last_active":"2024-04-26T11:20:05.541862+0000","last_peered":"2024-04-26T11:20:05.541862+0000","last_clean":"2024-04-26T11:20:05.541862+0000","last_became_active":"2024-04-26T11:19:24.200992+0000","last_became_peered":"2024-04-26T11:19:24.200992+0000","last_unstale":"2024-04-26T11:20:05.541862+0000","last_undegraded":"2024-04-26T11:20:05.541862+0000","last_fullsized":"2024-04-26T11:20:05.541862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:05.541702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:05.541702+0000","last_clean_scrub_stamp":"2024-04-26T11:20:05.541702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:43.691758+0000","scrub_duration":0.001648708,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"82'5","reported_seq":124,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:31.500638+0000","last_change":"2024-04-26T11:20:31.500638+0000","last_active":"2024-04-26T11:20:31.500638+0000","last_peered":"2024-04-26T11:20:31.500638+0000","last_clean":"2024-04-26T11:20:31.500638+0000","last_became_active":"2024-04-26T11:19:18.190381+0000","last_became_peered":"2024-04-26T11:19:18.190381+0000","last_unstale":"2024-04-26T11:20:31.500638+0000","last_undegraded":"2024-04-26T11:20:31.500638+0000","last_fullsized":"2024-04-26T11:20:31.500638+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'5","last_scrub_stamp":"2024-04-26T11:20:31.500511+0000","last_deep_scrub":"82'5","last_deep_scrub_stamp":"2024-04-26T11:20:31.500511+0000","last_clean_scrub_stamp":"2024-04-26T11:20:31.500511+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:36:22.961021+0000","scrub_duration":0.0037041859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:51.669025+0000","last_change":"2024-04-26T11:19:51.669122+0000","last_active":"2024-04-26T11:19:51.669025+0000","last_peered":"2024-04-26T11:19:51.669025+0000","last_clean":"2024-04-26T11:19:51.669025+0000","last_became_active":"2024-04-26T11:19:24.199659+0000","last_became_peered":"2024-04-26T11:19:24.199659+0000","last_unstale":"2024-04-26T11:19:51.669025+0000","last_undegraded":"2024-04-26T11:19:51.669025+0000","last_fullsized":"2024-04-26T11:19:51.669025+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:51.668999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:51.668999+0000","last_clean_scrub_stamp":"2024-04-26T11:19:51.668999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:13.870535+0000","scrub_duration":0.001713553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"82'10","reported_seq":61,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:15.665075+0000","last_change":"2024-04-26T11:20:15.665204+0000","last_active":"2024-04-26T11:20:15.665075+0000","last_peered":"2024-04-26T11:20:15.665075+0000","last_clean":"2024-04-26T11:20:15.665075+0000","last_became_active":"2024-04-26T11:19:18.180711+0000","last_became_peered":"2024-04-26T11:19:18.180711+0000","last_unstale":"2024-04-26T11:20:15.665075+0000","last_undegraded":"2024-04-26T11:20:15.665075+0000","last_fullsized":"2024-04-26T11:20:15.665075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'10","last_scrub_stamp":"2024-04-26T11:20:15.665049+0000","last_deep_scrub":"82'10","last_deep_scrub_stamp":"2024-04-26T11:20:15.665049+0000","last_clean_scrub_stamp":"2024-04-26T11:20:15.665049+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:43:51.496107+0000","scrub_duration":0.0059687940000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:52.744204+0000","last_change":"2024-04-26T11:20:52.744313+0000","last_active":"2024-04-26T11:20:52.744204+0000","last_peered":"2024-04-26T11:20:52.744204+0000","last_clean":"2024-04-26T11:20:52.744204+0000","last_became_active":"2024-04-26T11:19:18.181615+0000","last_became_peered":"2024-04-26T11:19:18.181615+0000","last_unstale":"2024-04-26T11:20:52.744204+0000","last_undegraded":"2024-04-26T11:20:52.744204+0000","last_fullsized":"2024-04-26T11:20:52.744204+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:52.744179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:52.744179+0000","last_clean_scrub_stamp":"2024-04-26T11:20:52.744179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:23.622036+0000","scrub_duration":0.0021129399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"82'4","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:33.660558+0000","last_change":"2024-04-26T11:20:33.660657+0000","last_active":"2024-04-26T11:20:33.660558+0000","last_peered":"2024-04-26T11:20:33.660558+0000","last_clean":"2024-04-26T11:20:33.660558+0000","last_became_active":"2024-04-26T11:19:18.183103+0000","last_became_peered":"2024-04-26T11:19:18.183103+0000","last_unstale":"2024-04-26T11:20:33.660558+0000","last_undegraded":"2024-04-26T11:20:33.660558+0000","last_fullsized":"2024-04-26T11:20:33.660558+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-26T11:20:33.660533+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-26T11:20:33.660533+0000","last_clean_scrub_stamp":"2024-04-26T11:20:33.660533+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:09.137970+0000","scrub_duration":0.0039063550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.271759+0000","last_change":"2024-04-26T11:13:12.916685+0000","last_active":"2024-04-26T11:19:35.271759+0000","last_peered":"2024-04-26T11:19:35.271759+0000","last_clean":"2024-04-26T11:19:35.271759+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:19:35.271759+0000","last_undegraded":"2024-04-26T11:19:35.271759+0000","last_fullsized":"2024-04-26T11:19:35.271759+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:16.464920+0000","last_change":"2024-04-26T11:20:16.464920+0000","last_active":"2024-04-26T11:20:16.464920+0000","last_peered":"2024-04-26T11:20:16.464920+0000","last_clean":"2024-04-26T11:20:16.464920+0000","last_became_active":"2024-04-26T11:19:24.197647+0000","last_became_peered":"2024-04-26T11:19:24.197647+0000","last_unstale":"2024-04-26T11:20:16.464920+0000","last_undegraded":"2024-04-26T11:20:16.464920+0000","last_fullsized":"2024-04-26T11:20:16.464920+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:16.464751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:16.464751+0000","last_clean_scrub_stamp":"2024-04-26T11:20:16.464751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:31.462042+0000","scrub_duration":0.001769709,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:49.458065+0000","last_change":"2024-04-26T11:19:49.458065+0000","last_active":"2024-04-26T11:19:49.458065+0000","last_peered":"2024-04-26T11:19:49.458065+0000","last_clean":"2024-04-26T11:19:49.458065+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:19:49.458065+0000","last_undegraded":"2024-04-26T11:19:49.458065+0000","last_fullsized":"2024-04-26T11:19:49.458065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:49.457903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:49.457903+0000","last_clean_scrub_stamp":"2024-04-26T11:19:49.457903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:29.600094+0000","scrub_duration":0.017036468999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":119,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:42.399823+0000","last_change":"2024-04-26T11:20:42.399928+0000","last_active":"2024-04-26T11:20:42.399823+0000","last_peered":"2024-04-26T11:20:42.399823+0000","last_clean":"2024-04-26T11:20:42.399823+0000","last_became_active":"2024-04-26T11:19:18.181907+0000","last_became_peered":"2024-04-26T11:19:18.181907+0000","last_unstale":"2024-04-26T11:20:42.399823+0000","last_undegraded":"2024-04-26T11:20:42.399823+0000","last_fullsized":"2024-04-26T11:20:42.399823+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:42.399800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:42.399800+0000","last_clean_scrub_stamp":"2024-04-26T11:20:42.399800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:27.642376+0000","scrub_duration":0.0017102930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:34.751165+0000","last_change":"2024-04-26T11:19:24.201756+0000","last_active":"2024-04-26T11:19:34.751165+0000","last_peered":"2024-04-26T11:19:34.751165+0000","last_clean":"2024-04-26T11:19:34.751165+0000","last_became_active":"2024-04-26T11:19:24.201114+0000","last_became_peered":"2024-04-26T11:19:24.201114+0000","last_unstale":"2024-04-26T11:19:34.751165+0000","last_undegraded":"2024-04-26T11:19:34.751165+0000","last_fullsized":"2024-04-26T11:19:34.751165+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"82'12","reported_seq":57,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:20.669835+0000","last_change":"2024-04-26T11:20:20.669954+0000","last_active":"2024-04-26T11:20:20.669835+0000","last_peered":"2024-04-26T11:20:20.669835+0000","last_clean":"2024-04-26T11:20:20.669835+0000","last_became_active":"2024-04-26T11:19:18.182017+0000","last_became_peered":"2024-04-26T11:19:18.182017+0000","last_unstale":"2024-04-26T11:20:20.669835+0000","last_undegraded":"2024-04-26T11:20:20.669835+0000","last_fullsized":"2024-04-26T11:20:20.669835+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'12","last_scrub_stamp":"2024-04-26T11:20:20.669804+0000","last_deep_scrub":"82'12","last_deep_scrub_stamp":"2024-04-26T11:20:20.669804+0000","last_clean_scrub_stamp":"2024-04-26T11:20:20.669804+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:56.741407+0000","scrub_duration":0.0048710799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:34.751255+0000","last_change":"2024-04-26T11:19:24.205310+0000","last_active":"2024-04-26T11:19:34.751255+0000","last_peered":"2024-04-26T11:19:34.751255+0000","last_clean":"2024-04-26T11:19:34.751255+0000","last_became_active":"2024-04-26T11:19:24.204476+0000","last_became_peered":"2024-04-26T11:19:24.204476+0000","last_unstale":"2024-04-26T11:19:34.751255+0000","last_undegraded":"2024-04-26T11:19:34.751255+0000","last_fullsized":"2024-04-26T11:19:34.751255+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"82'2","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:44.505106+0000","last_change":"2024-04-26T11:19:44.505212+0000","last_active":"2024-04-26T11:19:44.505106+0000","last_peered":"2024-04-26T11:19:44.505106+0000","last_clean":"2024-04-26T11:19:44.505106+0000","last_became_active":"2024-04-26T11:19:18.181604+0000","last_became_peered":"2024-04-26T11:19:18.181604+0000","last_unstale":"2024-04-26T11:19:44.505106+0000","last_undegraded":"2024-04-26T11:19:44.505106+0000","last_fullsized":"2024-04-26T11:19:44.505106+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-26T11:19:44.505080+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-26T11:19:44.505080+0000","last_clean_scrub_stamp":"2024-04-26T11:19:44.505080+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:07.623145+0000","scrub_duration":0.0032804549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:36.457819+0000","last_change":"2024-04-26T11:19:36.457819+0000","last_active":"2024-04-26T11:19:36.457819+0000","last_peered":"2024-04-26T11:19:36.457819+0000","last_clean":"2024-04-26T11:19:36.457819+0000","last_became_active":"2024-04-26T11:19:18.181462+0000","last_became_peered":"2024-04-26T11:19:18.181462+0000","last_unstale":"2024-04-26T11:19:36.457819+0000","last_undegraded":"2024-04-26T11:19:36.457819+0000","last_fullsized":"2024-04-26T11:19:36.457819+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:36.457692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:36.457692+0000","last_clean_scrub_stamp":"2024-04-26T11:19:36.457692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:46.158550+0000","scrub_duration":0.0018253519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"82'3","reported_seq":122,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:36.463609+0000","last_change":"2024-04-26T11:20:36.463708+0000","last_active":"2024-04-26T11:20:36.463609+0000","last_peered":"2024-04-26T11:20:36.463609+0000","last_clean":"2024-04-26T11:20:36.463609+0000","last_became_active":"2024-04-26T11:19:18.182242+0000","last_became_peered":"2024-04-26T11:19:18.182242+0000","last_unstale":"2024-04-26T11:20:36.463609+0000","last_undegraded":"2024-04-26T11:20:36.463609+0000","last_fullsized":"2024-04-26T11:20:36.463609+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T11:20:36.463584+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T11:20:36.463584+0000","last_clean_scrub_stamp":"2024-04-26T11:20:36.463584+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:07.395616+0000","scrub_duration":0.0032256059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:53.468976+0000","last_change":"2024-04-26T11:19:53.469071+0000","last_active":"2024-04-26T11:19:53.468976+0000","last_peered":"2024-04-26T11:19:53.468976+0000","last_clean":"2024-04-26T11:19:53.468976+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:19:53.468976+0000","last_undegraded":"2024-04-26T11:19:53.468976+0000","last_fullsized":"2024-04-26T11:19:53.468976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:53.468953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:53.468953+0000","last_clean_scrub_stamp":"2024-04-26T11:19:53.468953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:51:47.714133+0000","scrub_duration":0.0018786149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'2","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:40.744434+0000","last_change":"2024-04-26T11:20:40.744564+0000","last_active":"2024-04-26T11:20:40.744434+0000","last_peered":"2024-04-26T11:20:40.744434+0000","last_clean":"2024-04-26T11:20:40.744434+0000","last_became_active":"2024-04-26T11:19:18.180506+0000","last_became_peered":"2024-04-26T11:19:18.180506+0000","last_unstale":"2024-04-26T11:20:40.744434+0000","last_undegraded":"2024-04-26T11:20:40.744434+0000","last_fullsized":"2024-04-26T11:20:40.744434+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-26T11:20:40.744410+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-26T11:20:40.744410+0000","last_clean_scrub_stamp":"2024-04-26T11:20:40.744410+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:11.030235+0000","scrub_duration":0.0034585390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:50.503948+0000","last_change":"2024-04-26T11:19:50.504053+0000","last_active":"2024-04-26T11:19:50.503948+0000","last_peered":"2024-04-26T11:19:50.503948+0000","last_clean":"2024-04-26T11:19:50.503948+0000","last_became_active":"2024-04-26T11:19:18.185355+0000","last_became_peered":"2024-04-26T11:19:18.185355+0000","last_unstale":"2024-04-26T11:19:50.503948+0000","last_undegraded":"2024-04-26T11:19:50.503948+0000","last_fullsized":"2024-04-26T11:19:50.503948+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:50.503924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:50.503924+0000","last_clean_scrub_stamp":"2024-04-26T11:19:50.503924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:15.276373+0000","scrub_duration":0.001850661,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:00.590718+0000","last_change":"2024-04-26T11:20:00.590840+0000","last_active":"2024-04-26T11:20:00.590718+0000","last_peered":"2024-04-26T11:20:00.590718+0000","last_clean":"2024-04-26T11:20:00.590718+0000","last_became_active":"2024-04-26T11:19:18.186342+0000","last_became_peered":"2024-04-26T11:19:18.186342+0000","last_unstale":"2024-04-26T11:20:00.590718+0000","last_undegraded":"2024-04-26T11:20:00.590718+0000","last_fullsized":"2024-04-26T11:20:00.590718+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:00.590694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:00.590694+0000","last_clean_scrub_stamp":"2024-04-26T11:20:00.590694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:47.383110+0000","scrub_duration":0.0016301460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:03.588748+0000","last_change":"2024-04-26T11:20:03.588894+0000","last_active":"2024-04-26T11:20:03.588748+0000","last_peered":"2024-04-26T11:20:03.588748+0000","last_clean":"2024-04-26T11:20:03.588748+0000","last_became_active":"2024-04-26T11:19:24.201330+0000","last_became_peered":"2024-04-26T11:19:24.201330+0000","last_unstale":"2024-04-26T11:20:03.588748+0000","last_undegraded":"2024-04-26T11:20:03.588748+0000","last_fullsized":"2024-04-26T11:20:03.588748+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:03.588721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:03.588721+0000","last_clean_scrub_stamp":"2024-04-26T11:20:03.588721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:51.328094+0000","scrub_duration":0.029670523000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"82'3","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:06.586122+0000","last_change":"2024-04-26T11:20:06.586222+0000","last_active":"2024-04-26T11:20:06.586122+0000","last_peered":"2024-04-26T11:20:06.586122+0000","last_clean":"2024-04-26T11:20:06.586122+0000","last_became_active":"2024-04-26T11:19:24.201077+0000","last_became_peered":"2024-04-26T11:19:24.201077+0000","last_unstale":"2024-04-26T11:20:06.586122+0000","last_undegraded":"2024-04-26T11:20:06.586122+0000","last_fullsized":"2024-04-26T11:20:06.586122+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T11:20:06.586097+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T11:20:06.586097+0000","last_clean_scrub_stamp":"2024-04-26T11:20:06.586097+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:06.937690+0000","scrub_duration":0.0032225639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:21.647455+0000","last_change":"2024-04-26T11:20:21.647563+0000","last_active":"2024-04-26T11:20:21.647455+0000","last_peered":"2024-04-26T11:20:21.647455+0000","last_clean":"2024-04-26T11:20:21.647455+0000","last_became_active":"2024-04-26T11:19:18.185768+0000","last_became_peered":"2024-04-26T11:19:18.185768+0000","last_unstale":"2024-04-26T11:20:21.647455+0000","last_undegraded":"2024-04-26T11:20:21.647455+0000","last_fullsized":"2024-04-26T11:20:21.647455+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:21.647424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:21.647424+0000","last_clean_scrub_stamp":"2024-04-26T11:20:21.647424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:30.401562+0000","scrub_duration":0.0017008469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:35.738414+0000","last_change":"2024-04-26T11:20:35.738528+0000","last_active":"2024-04-26T11:20:35.738414+0000","last_peered":"2024-04-26T11:20:35.738414+0000","last_clean":"2024-04-26T11:20:35.738414+0000","last_became_active":"2024-04-26T11:19:18.184149+0000","last_became_peered":"2024-04-26T11:19:18.184149+0000","last_unstale":"2024-04-26T11:20:35.738414+0000","last_undegraded":"2024-04-26T11:20:35.738414+0000","last_fullsized":"2024-04-26T11:20:35.738414+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:35.738376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:35.738376+0000","last_clean_scrub_stamp":"2024-04-26T11:20:35.738376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:19.639335+0000","scrub_duration":0.0020898240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:36.619910+0000","last_change":"2024-04-26T11:19:36.620064+0000","last_active":"2024-04-26T11:19:36.619910+0000","last_peered":"2024-04-26T11:19:36.619910+0000","last_clean":"2024-04-26T11:19:36.619910+0000","last_became_active":"2024-04-26T11:19:18.181951+0000","last_became_peered":"2024-04-26T11:19:18.181951+0000","last_unstale":"2024-04-26T11:19:36.619910+0000","last_undegraded":"2024-04-26T11:19:36.619910+0000","last_fullsized":"2024-04-26T11:19:36.619910+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:36.619885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:36.619885+0000","last_clean_scrub_stamp":"2024-04-26T11:19:36.619885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:06.660819+0000","scrub_duration":0.001669823,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":119,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:41.391079+0000","last_change":"2024-04-26T11:20:41.391204+0000","last_active":"2024-04-26T11:20:41.391079+0000","last_peered":"2024-04-26T11:20:41.391079+0000","last_clean":"2024-04-26T11:20:41.391079+0000","last_became_active":"2024-04-26T11:19:18.181767+0000","last_became_peered":"2024-04-26T11:19:18.181767+0000","last_unstale":"2024-04-26T11:20:41.391079+0000","last_undegraded":"2024-04-26T11:20:41.391079+0000","last_fullsized":"2024-04-26T11:20:41.391079+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:41.391041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:41.391041+0000","last_clean_scrub_stamp":"2024-04-26T11:20:41.391041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:51.694708+0000","scrub_duration":0.0017201790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:37.612117+0000","last_change":"2024-04-26T11:19:37.612253+0000","last_active":"2024-04-26T11:19:37.612117+0000","last_peered":"2024-04-26T11:19:37.612117+0000","last_clean":"2024-04-26T11:19:37.612117+0000","last_became_active":"2024-04-26T11:19:18.182060+0000","last_became_peered":"2024-04-26T11:19:18.182060+0000","last_unstale":"2024-04-26T11:19:37.612117+0000","last_undegraded":"2024-04-26T11:19:37.612117+0000","last_fullsized":"2024-04-26T11:19:37.612117+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:37.612061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:37.612061+0000","last_clean_scrub_stamp":"2024-04-26T11:19:37.612061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:24.175151+0000","scrub_duration":0.0016765459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:20.495917+0000","last_change":"2024-04-26T11:20:20.496020+0000","last_active":"2024-04-26T11:20:20.495917+0000","last_peered":"2024-04-26T11:20:20.495917+0000","last_clean":"2024-04-26T11:20:20.495917+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:20:20.495917+0000","last_undegraded":"2024-04-26T11:20:20.495917+0000","last_fullsized":"2024-04-26T11:20:20.495917+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:20.495895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:20.495895+0000","last_clean_scrub_stamp":"2024-04-26T11:20:20.495895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:28.263035+0000","scrub_duration":0.001714824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:48.777587+0000","last_change":"2024-04-26T11:19:48.777713+0000","last_active":"2024-04-26T11:19:48.777587+0000","last_peered":"2024-04-26T11:19:48.777587+0000","last_clean":"2024-04-26T11:19:48.777587+0000","last_became_active":"2024-04-26T11:19:24.203758+0000","last_became_peered":"2024-04-26T11:19:24.203758+0000","last_unstale":"2024-04-26T11:19:48.777587+0000","last_undegraded":"2024-04-26T11:19:48.777587+0000","last_fullsized":"2024-04-26T11:19:48.777587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:48.777563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:48.777563+0000","last_clean_scrub_stamp":"2024-04-26T11:19:48.777563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:26.143928+0000","scrub_duration":0.058175359000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:33.470592+0000","last_change":"2024-04-26T11:20:33.470712+0000","last_active":"2024-04-26T11:20:33.470592+0000","last_peered":"2024-04-26T11:20:33.470592+0000","last_clean":"2024-04-26T11:20:33.470592+0000","last_became_active":"2024-04-26T11:19:24.200963+0000","last_became_peered":"2024-04-26T11:19:24.200963+0000","last_unstale":"2024-04-26T11:20:33.470592+0000","last_undegraded":"2024-04-26T11:20:33.470592+0000","last_fullsized":"2024-04-26T11:20:33.470592+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:33.470567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:33.470567+0000","last_clean_scrub_stamp":"2024-04-26T11:20:33.470567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:06.658362+0000","scrub_duration":0.0018913809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.211210+0000","last_change":"2024-04-26T11:19:18.189488+0000","last_active":"2024-04-26T11:19:27.211210+0000","last_peered":"2024-04-26T11:19:27.211210+0000","last_clean":"2024-04-26T11:19:27.211210+0000","last_became_active":"2024-04-26T11:19:18.189086+0000","last_became_peered":"2024-04-26T11:19:18.189086+0000","last_unstale":"2024-04-26T11:19:27.211210+0000","last_undegraded":"2024-04-26T11:19:27.211210+0000","last_fullsized":"2024-04-26T11:19:27.211210+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:05.442392+0000","last_change":"2024-04-26T11:20:05.442516+0000","last_active":"2024-04-26T11:20:05.442392+0000","last_peered":"2024-04-26T11:20:05.442392+0000","last_clean":"2024-04-26T11:20:05.442392+0000","last_became_active":"2024-04-26T11:19:18.181791+0000","last_became_peered":"2024-04-26T11:19:18.181791+0000","last_unstale":"2024-04-26T11:20:05.442392+0000","last_undegraded":"2024-04-26T11:20:05.442392+0000","last_fullsized":"2024-04-26T11:20:05.442392+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:05.442367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:05.442367+0000","last_clean_scrub_stamp":"2024-04-26T11:20:05.442367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:48.858203+0000","scrub_duration":0.001909062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:24.707687+0000","last_change":"2024-04-26T11:20:24.707827+0000","last_active":"2024-04-26T11:20:24.707687+0000","last_peered":"2024-04-26T11:20:24.707687+0000","last_clean":"2024-04-26T11:20:24.707687+0000","last_became_active":"2024-04-26T11:19:18.183292+0000","last_became_peered":"2024-04-26T11:19:18.183292+0000","last_unstale":"2024-04-26T11:20:24.707687+0000","last_undegraded":"2024-04-26T11:20:24.707687+0000","last_fullsized":"2024-04-26T11:20:24.707687+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:24.707649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:24.707649+0000","last_clean_scrub_stamp":"2024-04-26T11:20:24.707649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:50.921059+0000","scrub_duration":0.001693588,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210983+0000","last_change":"2024-04-26T11:19:18.190450+0000","last_active":"2024-04-26T11:19:27.210983+0000","last_peered":"2024-04-26T11:19:27.210983+0000","last_clean":"2024-04-26T11:19:27.210983+0000","last_became_active":"2024-04-26T11:19:18.190096+0000","last_became_peered":"2024-04-26T11:19:18.190096+0000","last_unstale":"2024-04-26T11:19:27.210983+0000","last_undegraded":"2024-04-26T11:19:27.210983+0000","last_fullsized":"2024-04-26T11:19:27.210983+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:28.566429+0000","last_change":"2024-04-26T11:20:28.566554+0000","last_active":"2024-04-26T11:20:28.566429+0000","last_peered":"2024-04-26T11:20:28.566429+0000","last_clean":"2024-04-26T11:20:28.566429+0000","last_became_active":"2024-04-26T11:19:24.199834+0000","last_became_peered":"2024-04-26T11:19:24.199834+0000","last_unstale":"2024-04-26T11:20:28.566429+0000","last_undegraded":"2024-04-26T11:20:28.566429+0000","last_fullsized":"2024-04-26T11:20:28.566429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:28.566404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:28.566404+0000","last_clean_scrub_stamp":"2024-04-26T11:20:28.566404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:24.933139+0000","scrub_duration":0.0016291509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:56.642304+0000","last_change":"2024-04-26T11:19:56.642416+0000","last_active":"2024-04-26T11:19:56.642304+0000","last_peered":"2024-04-26T11:19:56.642304+0000","last_clean":"2024-04-26T11:19:56.642304+0000","last_became_active":"2024-04-26T11:19:24.196561+0000","last_became_peered":"2024-04-26T11:19:24.196561+0000","last_unstale":"2024-04-26T11:19:56.642304+0000","last_undegraded":"2024-04-26T11:19:56.642304+0000","last_fullsized":"2024-04-26T11:19:56.642304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:56.642282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:56.642282+0000","last_clean_scrub_stamp":"2024-04-26T11:19:56.642282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:16.768522+0000","scrub_duration":0.001607296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":119,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:30.510626+0000","last_change":"2024-04-26T11:20:30.510723+0000","last_active":"2024-04-26T11:20:30.510626+0000","last_peered":"2024-04-26T11:20:30.510626+0000","last_clean":"2024-04-26T11:20:30.510626+0000","last_became_active":"2024-04-26T11:19:18.182077+0000","last_became_peered":"2024-04-26T11:19:18.182077+0000","last_unstale":"2024-04-26T11:20:30.510626+0000","last_undegraded":"2024-04-26T11:20:30.510626+0000","last_fullsized":"2024-04-26T11:20:30.510626+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:30.510602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:30.510602+0000","last_clean_scrub_stamp":"2024-04-26T11:20:30.510602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:28.874707+0000","scrub_duration":0.0021031610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210738+0000","last_change":"2024-04-26T11:19:24.205473+0000","last_active":"2024-04-26T11:19:27.210738+0000","last_peered":"2024-04-26T11:19:27.210738+0000","last_clean":"2024-04-26T11:19:27.210738+0000","last_became_active":"2024-04-26T11:19:24.204538+0000","last_became_peered":"2024-04-26T11:19:24.204538+0000","last_unstale":"2024-04-26T11:19:27.210738+0000","last_undegraded":"2024-04-26T11:19:27.210738+0000","last_fullsized":"2024-04-26T11:19:27.210738+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:32.614013+0000","last_change":"2024-04-26T11:20:32.614151+0000","last_active":"2024-04-26T11:20:32.614013+0000","last_peered":"2024-04-26T11:20:32.614013+0000","last_clean":"2024-04-26T11:20:32.614013+0000","last_became_active":"2024-04-26T11:19:18.184460+0000","last_became_peered":"2024-04-26T11:19:18.184460+0000","last_unstale":"2024-04-26T11:20:32.614013+0000","last_undegraded":"2024-04-26T11:20:32.614013+0000","last_fullsized":"2024-04-26T11:20:32.614013+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:32.613980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:32.613980+0000","last_clean_scrub_stamp":"2024-04-26T11:20:32.613980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:31.344148+0000","scrub_duration":0.0021711899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"82'159","reported_seq":248,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:11.567529+0000","last_change":"2024-04-26T11:20:11.567623+0000","last_active":"2024-04-26T11:20:11.567529+0000","last_peered":"2024-04-26T11:20:11.567529+0000","last_clean":"2024-04-26T11:20:11.567529+0000","last_became_active":"2024-04-26T11:19:18.180577+0000","last_became_peered":"2024-04-26T11:19:18.180577+0000","last_unstale":"2024-04-26T11:20:11.567529+0000","last_undegraded":"2024-04-26T11:20:11.567529+0000","last_fullsized":"2024-04-26T11:20:11.567529+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'159","last_scrub_stamp":"2024-04-26T11:20:11.567504+0000","last_deep_scrub":"82'159","last_deep_scrub_stamp":"2024-04-26T11:20:11.567504+0000","last_clean_scrub_stamp":"2024-04-26T11:20:11.567504+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:18.611371+0000","scrub_duration":0.0050467979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:39.358890+0000","last_change":"2024-04-26T11:20:39.359015+0000","last_active":"2024-04-26T11:20:39.358890+0000","last_peered":"2024-04-26T11:20:39.358890+0000","last_clean":"2024-04-26T11:20:39.358890+0000","last_became_active":"2024-04-26T11:19:24.196404+0000","last_became_peered":"2024-04-26T11:19:24.196404+0000","last_unstale":"2024-04-26T11:20:39.358890+0000","last_undegraded":"2024-04-26T11:20:39.358890+0000","last_fullsized":"2024-04-26T11:20:39.358890+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:39.358852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:39.358852+0000","last_clean_scrub_stamp":"2024-04-26T11:20:39.358852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:22.774688+0000","scrub_duration":0.0015974749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:09.531099+0000","last_change":"2024-04-26T11:20:09.531227+0000","last_active":"2024-04-26T11:20:09.531099+0000","last_peered":"2024-04-26T11:20:09.531099+0000","last_clean":"2024-04-26T11:20:09.531099+0000","last_became_active":"2024-04-26T11:19:18.181863+0000","last_became_peered":"2024-04-26T11:19:18.181863+0000","last_unstale":"2024-04-26T11:20:09.531099+0000","last_undegraded":"2024-04-26T11:20:09.531099+0000","last_fullsized":"2024-04-26T11:20:09.531099+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:09.531073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:09.531073+0000","last_clean_scrub_stamp":"2024-04-26T11:20:09.531073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:28.881302+0000","scrub_duration":0.0020025820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:18.631012+0000","last_change":"2024-04-26T11:20:18.631147+0000","last_active":"2024-04-26T11:20:18.631012+0000","last_peered":"2024-04-26T11:20:18.631012+0000","last_clean":"2024-04-26T11:20:18.631012+0000","last_became_active":"2024-04-26T11:19:18.180792+0000","last_became_peered":"2024-04-26T11:19:18.180792+0000","last_unstale":"2024-04-26T11:20:18.631012+0000","last_undegraded":"2024-04-26T11:20:18.631012+0000","last_fullsized":"2024-04-26T11:20:18.631012+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:18.630989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:18.630989+0000","last_clean_scrub_stamp":"2024-04-26T11:20:18.630989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:25:42.196975+0000","scrub_duration":0.001948642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:25.520668+0000","last_change":"2024-04-26T11:20:25.520792+0000","last_active":"2024-04-26T11:20:25.520668+0000","last_peered":"2024-04-26T11:20:25.520668+0000","last_clean":"2024-04-26T11:20:25.520668+0000","last_became_active":"2024-04-26T11:19:24.197711+0000","last_became_peered":"2024-04-26T11:19:24.197711+0000","last_unstale":"2024-04-26T11:20:25.520668+0000","last_undegraded":"2024-04-26T11:20:25.520668+0000","last_fullsized":"2024-04-26T11:20:25.520668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:25.520630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:25.520630+0000","last_clean_scrub_stamp":"2024-04-26T11:20:25.520630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:29.672543+0000","scrub_duration":0.0018688400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:13.502665+0000","last_change":"2024-04-26T11:20:13.502774+0000","last_active":"2024-04-26T11:20:13.502665+0000","last_peered":"2024-04-26T11:20:13.502665+0000","last_clean":"2024-04-26T11:20:13.502665+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:20:13.502665+0000","last_undegraded":"2024-04-26T11:20:13.502665+0000","last_fullsized":"2024-04-26T11:20:13.502665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:13.502641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:13.502641+0000","last_clean_scrub_stamp":"2024-04-26T11:20:13.502641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:36.927838+0000","scrub_duration":0.00168844,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:25.495362+0000","last_change":"2024-04-26T11:20:25.495474+0000","last_active":"2024-04-26T11:20:25.495362+0000","last_peered":"2024-04-26T11:20:25.495362+0000","last_clean":"2024-04-26T11:20:25.495362+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:20:25.495362+0000","last_undegraded":"2024-04-26T11:20:25.495362+0000","last_fullsized":"2024-04-26T11:20:25.495362+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:25.495337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:25.495337+0000","last_clean_scrub_stamp":"2024-04-26T11:20:25.495337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:20.256651+0000","scrub_duration":0.0016789140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:46.745793+0000","last_change":"2024-04-26T11:19:46.745918+0000","last_active":"2024-04-26T11:19:46.745793+0000","last_peered":"2024-04-26T11:19:46.745793+0000","last_clean":"2024-04-26T11:19:46.745793+0000","last_became_active":"2024-04-26T11:19:24.202550+0000","last_became_peered":"2024-04-26T11:19:24.202550+0000","last_unstale":"2024-04-26T11:19:46.745793+0000","last_undegraded":"2024-04-26T11:19:46.745793+0000","last_fullsized":"2024-04-26T11:19:46.745793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:46.745769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:46.745769+0000","last_clean_scrub_stamp":"2024-04-26T11:19:46.745769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:09.707603+0000","scrub_duration":0.001879981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:54.434747+0000","last_change":"2024-04-26T11:19:54.434856+0000","last_active":"2024-04-26T11:19:54.434747+0000","last_peered":"2024-04-26T11:19:54.434747+0000","last_clean":"2024-04-26T11:19:54.434747+0000","last_became_active":"2024-04-26T11:19:18.182186+0000","last_became_peered":"2024-04-26T11:19:18.182186+0000","last_unstale":"2024-04-26T11:19:54.434747+0000","last_undegraded":"2024-04-26T11:19:54.434747+0000","last_fullsized":"2024-04-26T11:19:54.434747+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:54.434725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:54.434725+0000","last_clean_scrub_stamp":"2024-04-26T11:19:54.434725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:50.801459+0000","scrub_duration":0.0020204099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"82'3","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:07.630037+0000","last_change":"2024-04-26T11:20:07.630175+0000","last_active":"2024-04-26T11:20:07.630037+0000","last_peered":"2024-04-26T11:20:07.630037+0000","last_clean":"2024-04-26T11:20:07.630037+0000","last_became_active":"2024-04-26T11:19:24.202310+0000","last_became_peered":"2024-04-26T11:19:24.202310+0000","last_unstale":"2024-04-26T11:20:07.630037+0000","last_undegraded":"2024-04-26T11:20:07.630037+0000","last_fullsized":"2024-04-26T11:20:07.630037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T11:20:07.629975+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T11:20:07.629975+0000","last_clean_scrub_stamp":"2024-04-26T11:20:07.629975+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:21.316423+0000","scrub_duration":0.003499748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:51.377084+0000","last_change":"2024-04-26T11:20:51.377182+0000","last_active":"2024-04-26T11:20:51.377084+0000","last_peered":"2024-04-26T11:20:51.377084+0000","last_clean":"2024-04-26T11:20:51.377084+0000","last_became_active":"2024-04-26T11:19:24.202566+0000","last_became_peered":"2024-04-26T11:19:24.202566+0000","last_unstale":"2024-04-26T11:20:51.377084+0000","last_undegraded":"2024-04-26T11:20:51.377084+0000","last_fullsized":"2024-04-26T11:20:51.377084+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:51.377062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:51.377062+0000","last_clean_scrub_stamp":"2024-04-26T11:20:51.377062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:04.643281+0000","scrub_duration":0.0017230380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:32.490367+0000","last_change":"2024-04-26T11:20:32.490476+0000","last_active":"2024-04-26T11:20:32.490367+0000","last_peered":"2024-04-26T11:20:32.490367+0000","last_clean":"2024-04-26T11:20:32.490367+0000","last_became_active":"2024-04-26T11:19:24.197383+0000","last_became_peered":"2024-04-26T11:19:24.197383+0000","last_unstale":"2024-04-26T11:20:32.490367+0000","last_undegraded":"2024-04-26T11:20:32.490367+0000","last_fullsized":"2024-04-26T11:20:32.490367+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:32.490343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:32.490343+0000","last_clean_scrub_stamp":"2024-04-26T11:20:32.490343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:02.161571+0000","scrub_duration":0.001683667,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:39.707630+0000","last_change":"2024-04-26T11:20:39.707737+0000","last_active":"2024-04-26T11:20:39.707630+0000","last_peered":"2024-04-26T11:20:39.707630+0000","last_clean":"2024-04-26T11:20:39.707630+0000","last_became_active":"2024-04-26T11:19:18.180871+0000","last_became_peered":"2024-04-26T11:19:18.180871+0000","last_unstale":"2024-04-26T11:20:39.707630+0000","last_undegraded":"2024-04-26T11:20:39.707630+0000","last_fullsized":"2024-04-26T11:20:39.707630+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:39.707608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:39.707608+0000","last_clean_scrub_stamp":"2024-04-26T11:20:39.707608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:18.685169+0000","scrub_duration":0.0020719089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"82'2","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:21.514790+0000","last_change":"2024-04-26T11:20:21.514923+0000","last_active":"2024-04-26T11:20:21.514790+0000","last_peered":"2024-04-26T11:20:21.514790+0000","last_clean":"2024-04-26T11:20:21.514790+0000","last_became_active":"2024-04-26T11:19:24.198853+0000","last_became_peered":"2024-04-26T11:19:24.198853+0000","last_unstale":"2024-04-26T11:20:21.514790+0000","last_undegraded":"2024-04-26T11:20:21.514790+0000","last_fullsized":"2024-04-26T11:20:21.514790+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-26T11:20:21.514765+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-26T11:20:21.514765+0000","last_clean_scrub_stamp":"2024-04-26T11:20:21.514765+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:45.584635+0000","scrub_duration":0.0035848450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:08.427084+0000","last_change":"2024-04-26T11:20:08.427208+0000","last_active":"2024-04-26T11:20:08.427084+0000","last_peered":"2024-04-26T11:20:08.427084+0000","last_clean":"2024-04-26T11:20:08.427084+0000","last_became_active":"2024-04-26T11:19:18.182228+0000","last_became_peered":"2024-04-26T11:19:18.182228+0000","last_unstale":"2024-04-26T11:20:08.427084+0000","last_undegraded":"2024-04-26T11:20:08.427084+0000","last_fullsized":"2024-04-26T11:20:08.427084+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:08.427044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:08.427044+0000","last_clean_scrub_stamp":"2024-04-26T11:20:08.427044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:44.490541+0000","scrub_duration":0.0019152240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":123,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:35.449722+0000","last_change":"2024-04-26T11:20:35.449722+0000","last_active":"2024-04-26T11:20:35.449722+0000","last_peered":"2024-04-26T11:20:35.449722+0000","last_clean":"2024-04-26T11:20:35.449722+0000","last_became_active":"2024-04-26T11:19:18.182671+0000","last_became_peered":"2024-04-26T11:19:18.182671+0000","last_unstale":"2024-04-26T11:20:35.449722+0000","last_undegraded":"2024-04-26T11:20:35.449722+0000","last_fullsized":"2024-04-26T11:20:35.449722+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T11:20:35.449595+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T11:20:35.449595+0000","last_clean_scrub_stamp":"2024-04-26T11:20:35.449595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:17.465203+0000","scrub_duration":0.001749993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:58.458718+0000","last_change":"2024-04-26T11:19:58.458718+0000","last_active":"2024-04-26T11:19:58.458718+0000","last_peered":"2024-04-26T11:19:58.458718+0000","last_clean":"2024-04-26T11:19:58.458718+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:19:58.458718+0000","last_undegraded":"2024-04-26T11:19:58.458718+0000","last_fullsized":"2024-04-26T11:19:58.458718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:58.458587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:58.458587+0000","last_clean_scrub_stamp":"2024-04-26T11:19:58.458587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:28.129815+0000","scrub_duration":0.001786494,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"82'3","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:39.596075+0000","last_change":"2024-04-26T11:19:39.596215+0000","last_active":"2024-04-26T11:19:39.596075+0000","last_peered":"2024-04-26T11:19:39.596075+0000","last_clean":"2024-04-26T11:19:39.596075+0000","last_became_active":"2024-04-26T11:19:18.188177+0000","last_became_peered":"2024-04-26T11:19:18.188177+0000","last_unstale":"2024-04-26T11:19:39.596075+0000","last_undegraded":"2024-04-26T11:19:39.596075+0000","last_fullsized":"2024-04-26T11:19:39.596075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T11:19:39.596051+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T11:19:39.596051+0000","last_clean_scrub_stamp":"2024-04-26T11:19:39.596051+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:18.488192+0000","scrub_duration":0.0035445559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:38.600610+0000","last_change":"2024-04-26T11:19:38.600786+0000","last_active":"2024-04-26T11:19:38.600610+0000","last_peered":"2024-04-26T11:19:38.600610+0000","last_clean":"2024-04-26T11:19:38.600610+0000","last_became_active":"2024-04-26T11:19:18.185372+0000","last_became_peered":"2024-04-26T11:19:18.185372+0000","last_unstale":"2024-04-26T11:19:38.600610+0000","last_undegraded":"2024-04-26T11:19:38.600610+0000","last_fullsized":"2024-04-26T11:19:38.600610+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:38.600585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:38.600585+0000","last_clean_scrub_stamp":"2024-04-26T11:19:38.600585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:00.495830+0000","scrub_duration":0.026821652000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"82'3","reported_seq":122,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:17.493793+0000","last_change":"2024-04-26T11:20:17.493793+0000","last_active":"2024-04-26T11:20:17.493793+0000","last_peered":"2024-04-26T11:20:17.493793+0000","last_clean":"2024-04-26T11:20:17.493793+0000","last_became_active":"2024-04-26T11:19:18.190374+0000","last_became_peered":"2024-04-26T11:19:18.190374+0000","last_unstale":"2024-04-26T11:20:17.493793+0000","last_undegraded":"2024-04-26T11:20:17.493793+0000","last_fullsized":"2024-04-26T11:20:17.493793+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T11:20:17.493667+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T11:20:17.493667+0000","last_clean_scrub_stamp":"2024-04-26T11:20:17.493667+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:30.759887+0000","scrub_duration":0.0029392099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210709+0000","last_change":"2024-04-26T11:19:18.189666+0000","last_active":"2024-04-26T11:19:27.210709+0000","last_peered":"2024-04-26T11:19:27.210709+0000","last_clean":"2024-04-26T11:19:27.210709+0000","last_became_active":"2024-04-26T11:19:18.189341+0000","last_became_peered":"2024-04-26T11:19:18.189341+0000","last_unstale":"2024-04-26T11:19:27.210709+0000","last_undegraded":"2024-04-26T11:19:27.210709+0000","last_fullsized":"2024-04-26T11:19:27.210709+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210706+0000","last_change":"2024-04-26T11:19:24.202866+0000","last_active":"2024-04-26T11:19:27.210706+0000","last_peered":"2024-04-26T11:19:27.210706+0000","last_clean":"2024-04-26T11:19:27.210706+0000","last_became_active":"2024-04-26T11:19:24.202422+0000","last_became_peered":"2024-04-26T11:19:24.202422+0000","last_unstale":"2024-04-26T11:19:27.210706+0000","last_undegraded":"2024-04-26T11:19:27.210706+0000","last_fullsized":"2024-04-26T11:19:27.210706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:47.394865+0000","last_change":"2024-04-26T11:20:47.394979+0000","last_active":"2024-04-26T11:20:47.394865+0000","last_peered":"2024-04-26T11:20:47.394865+0000","last_clean":"2024-04-26T11:20:47.394865+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:20:47.394865+0000","last_undegraded":"2024-04-26T11:20:47.394865+0000","last_fullsized":"2024-04-26T11:20:47.394865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:47.394841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:47.394841+0000","last_clean_scrub_stamp":"2024-04-26T11:20:47.394841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:25.800717+0000","scrub_duration":0.017573135,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210688+0000","last_change":"2024-04-26T11:19:24.205087+0000","last_active":"2024-04-26T11:19:27.210688+0000","last_peered":"2024-04-26T11:19:27.210688+0000","last_clean":"2024-04-26T11:19:27.210688+0000","last_became_active":"2024-04-26T11:19:24.204129+0000","last_became_peered":"2024-04-26T11:19:24.204129+0000","last_unstale":"2024-04-26T11:19:27.210688+0000","last_undegraded":"2024-04-26T11:19:27.210688+0000","last_fullsized":"2024-04-26T11:19:27.210688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:11.466521+0000","last_clean_scrub_stamp":"2024-04-26T11:13:11.466521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:27.210568+0000","last_change":"2024-04-26T11:19:18.189530+0000","last_active":"2024-04-26T11:19:27.210568+0000","last_peered":"2024-04-26T11:19:27.210568+0000","last_clean":"2024-04-26T11:19:27.210568+0000","last_became_active":"2024-04-26T11:19:18.189179+0000","last_became_peered":"2024-04-26T11:19:18.189179+0000","last_unstale":"2024-04-26T11:19:27.210568+0000","last_undegraded":"2024-04-26T11:19:27.210568+0000","last_fullsized":"2024-04-26T11:19:27.210568+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:40.624649+0000","last_change":"2024-04-26T11:19:40.624780+0000","last_active":"2024-04-26T11:19:40.624649+0000","last_peered":"2024-04-26T11:19:40.624649+0000","last_clean":"2024-04-26T11:19:40.624649+0000","last_became_active":"2024-04-26T11:19:18.188963+0000","last_became_peered":"2024-04-26T11:19:18.188963+0000","last_unstale":"2024-04-26T11:19:40.624649+0000","last_undegraded":"2024-04-26T11:19:40.624649+0000","last_fullsized":"2024-04-26T11:19:40.624649+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:40.624624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:40.624624+0000","last_clean_scrub_stamp":"2024-04-26T11:19:40.624624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:51.952842+0000","scrub_duration":0.0017518169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:04.580384+0000","last_change":"2024-04-26T11:20:04.580503+0000","last_active":"2024-04-26T11:20:04.580384+0000","last_peered":"2024-04-26T11:20:04.580384+0000","last_clean":"2024-04-26T11:20:04.580384+0000","last_became_active":"2024-04-26T11:19:24.198397+0000","last_became_peered":"2024-04-26T11:19:24.198397+0000","last_unstale":"2024-04-26T11:20:04.580384+0000","last_undegraded":"2024-04-26T11:20:04.580384+0000","last_fullsized":"2024-04-26T11:20:04.580384+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:04.580360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:04.580360+0000","last_clean_scrub_stamp":"2024-04-26T11:20:04.580360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:29.686078+0000","scrub_duration":0.0018333259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":107,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:31.632525+0000","last_change":"2024-04-26T11:19:18.183441+0000","last_active":"2024-04-26T11:19:31.632525+0000","last_peered":"2024-04-26T11:19:31.632525+0000","last_clean":"2024-04-26T11:19:31.632525+0000","last_became_active":"2024-04-26T11:19:18.183037+0000","last_became_peered":"2024-04-26T11:19:18.183037+0000","last_unstale":"2024-04-26T11:19:31.632525+0000","last_undegraded":"2024-04-26T11:19:31.632525+0000","last_fullsized":"2024-04-26T11:19:31.632525+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:55.673443+0000","last_change":"2024-04-26T11:19:55.673586+0000","last_active":"2024-04-26T11:19:55.673443+0000","last_peered":"2024-04-26T11:19:55.673443+0000","last_clean":"2024-04-26T11:19:55.673443+0000","last_became_active":"2024-04-26T11:19:24.202442+0000","last_became_peered":"2024-04-26T11:19:24.202442+0000","last_unstale":"2024-04-26T11:19:55.673443+0000","last_undegraded":"2024-04-26T11:19:55.673443+0000","last_fullsized":"2024-04-26T11:19:55.673443+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:55.673417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:55.673417+0000","last_clean_scrub_stamp":"2024-04-26T11:19:55.673417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:51.687827+0000","scrub_duration":0.029303546,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:51.420225+0000","last_change":"2024-04-26T11:19:51.420347+0000","last_active":"2024-04-26T11:19:51.420225+0000","last_peered":"2024-04-26T11:19:51.420225+0000","last_clean":"2024-04-26T11:19:51.420225+0000","last_became_active":"2024-04-26T11:19:18.184384+0000","last_became_peered":"2024-04-26T11:19:18.184384+0000","last_unstale":"2024-04-26T11:19:51.420225+0000","last_undegraded":"2024-04-26T11:19:51.420225+0000","last_fullsized":"2024-04-26T11:19:51.420225+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:51.420205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:51.420205+0000","last_clean_scrub_stamp":"2024-04-26T11:19:51.420205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:55.572118+0000","scrub_duration":0.001998835,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7958,"internal_metadata":0},"log_size":59,"ondisk_log_size":59,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738464,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281144,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94090696,"statfs":{"total":96636764160,"available":96348872704,"internally_reserved":0,"allocated":1490944,"data_stored":947441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.378}]},{"osd":1,"last update":"Fri Apr 26 11:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44500000000000001,"15min":0.40300000000000002},"min":{"1min":0.34599999999999997,"5min":0.20000000000000001,"15min":0.17199999999999999},"max":{"1min":0.56599999999999995,"5min":0.96499999999999997,"15min":2.1320000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45200000000000001,"15min":0.45500000000000002},"min":{"1min":0.34899999999999998,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.61599999999999999,"5min":0.85599999999999998,"15min":1.9750000000000001},"last":0.49099999999999999}]}]},{"osd":0,"up_from":75,"seq":322122547222,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38148,"kb_used_data":1468,"kb_used_omap":10,"kb_used_meta":36661,"kb_avail":94333692,"statfs":{"total":96636764160,"available":96597700608,"internally_reserved":0,"allocated":1503232,"data_stored":949168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11228,"internal_metadata":37540900},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 11:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.34599999999999997}]},{"osd":2,"last update":"Fri Apr 26 11:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.504}]}]},{"osd":1,"up_from":8,"seq":34359738465,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401128,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":400254,"kb_avail":93970712,"statfs":{"total":96636764160,"available":96226009088,"internally_reserved":0,"allocated":884736,"data_stored":357054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":409860550},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:20:17 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.436}]},{"osd":2,"last update":"Fri Apr 26 11:20:17 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44800000000000001,"15min":0.41199999999999998},"min":{"1min":0.29399999999999998,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.65400000000000003,"5min":0.69199999999999995,"15min":2.056},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.51000000000000001,"15min":0.46500000000000002},"min":{"1min":0.33000000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.60299999999999998,"5min":3.9609999999999999,"15min":3.9609999999999999},"last":0.51600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7958,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:20:57.202 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:57.202 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:57.202 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:57.202 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:57.203 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:57.203 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:57.203 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:57.203 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:57.203 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:57.204 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:57.204 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:57.204 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:57.204 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:57.204 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:57.205 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T11:13:11.466521+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:57.205 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:57.205 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:20:57.205 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T11:21:17.206 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:21:17.566 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:21:17.568 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:21:17.577 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2024-04-26T11:21:16.588200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":720420,"kb_used_data":3788,"kb_used_omap":14,"kb_used_meta":716593,"kb_avail":282395100,"statfs":{"total":289910292480,"available":289172582400,"internally_reserved":0,"allocated":3878912,"data_stored":2253663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14416,"internal_metadata":733792176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002961"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:21:06.378171+0000","last_change":"2024-04-26T11:21:06.378299+0000","last_active":"2024-04-26T11:21:06.378171+0000","last_peered":"2024-04-26T11:21:06.378171+0000","last_clean":"2024-04-26T11:21:06.378171+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:21:06.378171+0000","last_undegraded":"2024-04-26T11:21:06.378171+0000","last_fullsized":"2024-04-26T11:21:06.378171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:06.378149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:06.378149+0000","last_clean_scrub_stamp":"2024-04-26T11:21:06.378149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:13.936826+0000","scrub_duration":0.077886994000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:21:10.392342+0000","last_change":"2024-04-26T11:21:10.392450+0000","last_active":"2024-04-26T11:21:10.392342+0000","last_peered":"2024-04-26T11:21:10.392342+0000","last_clean":"2024-04-26T11:21:10.392342+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:21:10.392342+0000","last_undegraded":"2024-04-26T11:21:10.392342+0000","last_fullsized":"2024-04-26T11:21:10.392342+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:10.392317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:10.392317+0000","last_clean_scrub_stamp":"2024-04-26T11:21:10.392317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:36.754365+0000","scrub_duration":0.002016079,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:56.634247+0000","last_change":"2024-04-26T11:20:56.634367+0000","last_active":"2024-04-26T11:20:56.634247+0000","last_peered":"2024-04-26T11:20:56.634247+0000","last_clean":"2024-04-26T11:20:56.634247+0000","last_became_active":"2024-04-26T11:19:18.182972+0000","last_became_peered":"2024-04-26T11:19:18.182972+0000","last_unstale":"2024-04-26T11:20:56.634247+0000","last_undegraded":"2024-04-26T11:20:56.634247+0000","last_fullsized":"2024-04-26T11:20:56.634247+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:56.634226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:56.634226+0000","last_clean_scrub_stamp":"2024-04-26T11:20:56.634226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:10.682874+0000","scrub_duration":0.0018384880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:43.746595+0000","last_change":"2024-04-26T11:20:43.746595+0000","last_active":"2024-04-26T11:20:43.746595+0000","last_peered":"2024-04-26T11:20:43.746595+0000","last_clean":"2024-04-26T11:20:43.746595+0000","last_became_active":"2024-04-26T11:19:18.182942+0000","last_became_peered":"2024-04-26T11:19:18.182942+0000","last_unstale":"2024-04-26T11:20:43.746595+0000","last_undegraded":"2024-04-26T11:20:43.746595+0000","last_fullsized":"2024-04-26T11:20:43.746595+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:43.746467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:43.746467+0000","last_clean_scrub_stamp":"2024-04-26T11:20:43.746467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:50.125560+0000","scrub_duration":0.0019204280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:50.418051+0000","last_change":"2024-04-26T11:19:50.418051+0000","last_active":"2024-04-26T11:19:50.418051+0000","last_peered":"2024-04-26T11:19:50.418051+0000","last_clean":"2024-04-26T11:19:50.418051+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:19:50.418051+0000","last_undegraded":"2024-04-26T11:19:50.418051+0000","last_fullsized":"2024-04-26T11:19:50.418051+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:50.417924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:50.417924+0000","last_clean_scrub_stamp":"2024-04-26T11:19:50.417924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:25.937563+0000","scrub_duration":0.016392371999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:59.552842+0000","last_change":"2024-04-26T11:20:59.552984+0000","last_active":"2024-04-26T11:20:59.552842+0000","last_peered":"2024-04-26T11:20:59.552842+0000","last_clean":"2024-04-26T11:20:59.552842+0000","last_became_active":"2024-04-26T11:19:18.188990+0000","last_became_peered":"2024-04-26T11:19:18.188990+0000","last_unstale":"2024-04-26T11:20:59.552842+0000","last_undegraded":"2024-04-26T11:20:59.552842+0000","last_fullsized":"2024-04-26T11:20:59.552842+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:59.552784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:59.552784+0000","last_clean_scrub_stamp":"2024-04-26T11:20:59.552784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:42.998804+0000","scrub_duration":0.0018923360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:45.509116+0000","last_change":"2024-04-26T11:19:45.509220+0000","last_active":"2024-04-26T11:19:45.509116+0000","last_peered":"2024-04-26T11:19:45.509116+0000","last_clean":"2024-04-26T11:19:45.509116+0000","last_became_active":"2024-04-26T11:19:18.186638+0000","last_became_peered":"2024-04-26T11:19:18.186638+0000","last_unstale":"2024-04-26T11:19:45.509116+0000","last_undegraded":"2024-04-26T11:19:45.509116+0000","last_fullsized":"2024-04-26T11:19:45.509116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:45.509090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:45.509090+0000","last_clean_scrub_stamp":"2024-04-26T11:19:45.509090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:05.567613+0000","scrub_duration":0.017637363999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:23.683390+0000","last_change":"2024-04-26T11:20:23.683509+0000","last_active":"2024-04-26T11:20:23.683390+0000","last_peered":"2024-04-26T11:20:23.683390+0000","last_clean":"2024-04-26T11:20:23.683390+0000","last_became_active":"2024-04-26T11:19:18.182111+0000","last_became_peered":"2024-04-26T11:19:18.182111+0000","last_unstale":"2024-04-26T11:20:23.683390+0000","last_undegraded":"2024-04-26T11:20:23.683390+0000","last_fullsized":"2024-04-26T11:20:23.683390+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:23.683352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:23.683352+0000","last_clean_scrub_stamp":"2024-04-26T11:20:23.683352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:37.939942+0000","scrub_duration":0.001634702,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:42.411970+0000","last_change":"2024-04-26T11:20:42.412117+0000","last_active":"2024-04-26T11:20:42.411970+0000","last_peered":"2024-04-26T11:20:42.411970+0000","last_clean":"2024-04-26T11:20:42.411970+0000","last_became_active":"2024-04-26T11:19:24.202146+0000","last_became_peered":"2024-04-26T11:19:24.202146+0000","last_unstale":"2024-04-26T11:20:42.411970+0000","last_undegraded":"2024-04-26T11:20:42.411970+0000","last_fullsized":"2024-04-26T11:20:42.411970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:42.411946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:42.411946+0000","last_clean_scrub_stamp":"2024-04-26T11:20:42.411946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:18.475443+0000","scrub_duration":0.029462447999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:44.426458+0000","last_change":"2024-04-26T11:20:44.426546+0000","last_active":"2024-04-26T11:20:44.426458+0000","last_peered":"2024-04-26T11:20:44.426458+0000","last_clean":"2024-04-26T11:20:44.426458+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:20:44.426458+0000","last_undegraded":"2024-04-26T11:20:44.426458+0000","last_fullsized":"2024-04-26T11:20:44.426458+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:44.426436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:44.426436+0000","last_clean_scrub_stamp":"2024-04-26T11:20:44.426436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:53.146087+0000","scrub_duration":0.001820412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:52.515823+0000","last_change":"2024-04-26T11:19:52.515987+0000","last_active":"2024-04-26T11:19:52.515823+0000","last_peered":"2024-04-26T11:19:52.515823+0000","last_clean":"2024-04-26T11:19:52.515823+0000","last_became_active":"2024-04-26T11:19:18.185543+0000","last_became_peered":"2024-04-26T11:19:18.185543+0000","last_unstale":"2024-04-26T11:19:52.515823+0000","last_undegraded":"2024-04-26T11:19:52.515823+0000","last_fullsized":"2024-04-26T11:19:52.515823+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:52.515775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:52.515775+0000","last_clean_scrub_stamp":"2024-04-26T11:19:52.515775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.954162+0000","scrub_duration":0.016652819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":107,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.271910+0000","last_change":"2024-04-26T11:19:18.183459+0000","last_active":"2024-04-26T11:19:35.271910+0000","last_peered":"2024-04-26T11:19:35.271910+0000","last_clean":"2024-04-26T11:19:35.271910+0000","last_became_active":"2024-04-26T11:19:18.182827+0000","last_became_peered":"2024-04-26T11:19:18.182827+0000","last_unstale":"2024-04-26T11:19:35.271910+0000","last_undegraded":"2024-04-26T11:19:35.271910+0000","last_fullsized":"2024-04-26T11:19:35.271910+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:13:12.471344+0000","last_clean_scrub_stamp":"2024-04-26T11:13:12.471344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.499190+0000","last_change":"2024-04-26T11:19:35.499190+0000","last_active":"2024-04-26T11:19:35.499190+0000","last_peered":"2024-04-26T11:19:35.499190+0000","last_clean":"2024-04-26T11:19:35.499190+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:19:35.499190+0000","last_undegraded":"2024-04-26T11:19:35.499190+0000","last_fullsized":"2024-04-26T11:19:35.499190+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:35.499030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:35.499030+0000","last_clean_scrub_stamp":"2024-04-26T11:19:35.499030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:49.185477+0000","scrub_duration":0.018123878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:41.593903+0000","last_change":"2024-04-26T11:19:41.594000+0000","last_active":"2024-04-26T11:19:41.593903+0000","last_peered":"2024-04-26T11:19:41.593903+0000","last_clean":"2024-04-26T11:19:41.593903+0000","last_became_active":"2024-04-26T11:19:18.180865+0000","last_became_peered":"2024-04-26T11:19:18.180865+0000","last_unstale":"2024-04-26T11:19:41.593903+0000","last_undegraded":"2024-04-26T11:19:41.593903+0000","last_fullsized":"2024-04-26T11:19:41.593903+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:41.593880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:41.593880+0000","last_clean_scrub_stamp":"2024-04-26T11:19:41.593880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:56.201582+0000","scrub_duration":0.0019243019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:51.517339+0000","last_change":"2024-04-26T11:19:51.517460+0000","last_active":"2024-04-26T11:19:51.517339+0000","last_peered":"2024-04-26T11:19:51.517339+0000","last_clean":"2024-04-26T11:19:51.517339+0000","last_became_active":"2024-04-26T11:19:18.180763+0000","last_became_peered":"2024-04-26T11:19:18.180763+0000","last_unstale":"2024-04-26T11:19:51.517339+0000","last_undegraded":"2024-04-26T11:19:51.517339+0000","last_fullsized":"2024-04-26T11:19:51.517339+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:51.517314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:51.517314+0000","last_clean_scrub_stamp":"2024-04-26T11:19:51.517314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:47:38.185008+0000","scrub_duration":0.0020719620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:07.533224+0000","last_change":"2024-04-26T11:20:07.533355+0000","last_active":"2024-04-26T11:20:07.533224+0000","last_peered":"2024-04-26T11:20:07.533224+0000","last_clean":"2024-04-26T11:20:07.533224+0000","last_became_active":"2024-04-26T11:19:18.184331+0000","last_became_peered":"2024-04-26T11:19:18.184331+0000","last_unstale":"2024-04-26T11:20:07.533224+0000","last_undegraded":"2024-04-26T11:20:07.533224+0000","last_fullsized":"2024-04-26T11:20:07.533224+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:07.533200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:07.533200+0000","last_clean_scrub_stamp":"2024-04-26T11:20:07.533200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:50.283609+0000","scrub_duration":0.0016781039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:20.582602+0000","last_change":"2024-04-26T11:20:20.582731+0000","last_active":"2024-04-26T11:20:20.582602+0000","last_peered":"2024-04-26T11:20:20.582602+0000","last_clean":"2024-04-26T11:20:20.582602+0000","last_became_active":"2024-04-26T11:19:24.203764+0000","last_became_peered":"2024-04-26T11:19:24.203764+0000","last_unstale":"2024-04-26T11:20:20.582602+0000","last_undegraded":"2024-04-26T11:20:20.582602+0000","last_fullsized":"2024-04-26T11:20:20.582602+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:20.582577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:20.582577+0000","last_clean_scrub_stamp":"2024-04-26T11:20:20.582577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:06.502392+0000","scrub_duration":0.083132415000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:43.423762+0000","last_change":"2024-04-26T11:19:43.423762+0000","last_active":"2024-04-26T11:19:43.423762+0000","last_peered":"2024-04-26T11:19:43.423762+0000","last_clean":"2024-04-26T11:19:43.423762+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:19:43.423762+0000","last_undegraded":"2024-04-26T11:19:43.423762+0000","last_fullsized":"2024-04-26T11:19:43.423762+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:43.423617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:43.423617+0000","last_clean_scrub_stamp":"2024-04-26T11:19:43.423617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:58.420909+0000","scrub_duration":0.0017194790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:23.537391+0000","last_change":"2024-04-26T11:20:23.537545+0000","last_active":"2024-04-26T11:20:23.537391+0000","last_peered":"2024-04-26T11:20:23.537391+0000","last_clean":"2024-04-26T11:20:23.537391+0000","last_became_active":"2024-04-26T11:19:24.199142+0000","last_became_peered":"2024-04-26T11:19:24.199142+0000","last_unstale":"2024-04-26T11:20:23.537391+0000","last_undegraded":"2024-04-26T11:20:23.537391+0000","last_fullsized":"2024-04-26T11:20:23.537391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:23.537367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:23.537367+0000","last_clean_scrub_stamp":"2024-04-26T11:20:23.537367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:03.679558+0000","scrub_duration":0.029516655999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:42.569786+0000","last_change":"2024-04-26T11:19:42.569936+0000","last_active":"2024-04-26T11:19:42.569786+0000","last_peered":"2024-04-26T11:19:42.569786+0000","last_clean":"2024-04-26T11:19:42.569786+0000","last_became_active":"2024-04-26T11:19:18.184282+0000","last_became_peered":"2024-04-26T11:19:18.184282+0000","last_unstale":"2024-04-26T11:19:42.569786+0000","last_undegraded":"2024-04-26T11:19:42.569786+0000","last_fullsized":"2024-04-26T11:19:42.569786+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:42.569760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:42.569760+0000","last_clean_scrub_stamp":"2024-04-26T11:19:42.569760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:17.239747+0000","scrub_duration":0.0018614059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:44.771701+0000","last_change":"2024-04-26T11:20:44.771866+0000","last_active":"2024-04-26T11:20:44.771701+0000","last_peered":"2024-04-26T11:20:44.771701+0000","last_clean":"2024-04-26T11:20:44.771701+0000","last_became_active":"2024-04-26T11:19:18.186605+0000","last_became_peered":"2024-04-26T11:19:18.186605+0000","last_unstale":"2024-04-26T11:20:44.771701+0000","last_undegraded":"2024-04-26T11:20:44.771701+0000","last_fullsized":"2024-04-26T11:20:44.771701+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:44.771678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:44.771678+0000","last_clean_scrub_stamp":"2024-04-26T11:20:44.771678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:03.023486+0000","scrub_duration":0.022587506,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:59.494778+0000","last_change":"2024-04-26T11:19:59.494778+0000","last_active":"2024-04-26T11:19:59.494778+0000","last_peered":"2024-04-26T11:19:59.494778+0000","last_clean":"2024-04-26T11:19:59.494778+0000","last_became_active":"2024-04-26T11:19:18.181728+0000","last_became_peered":"2024-04-26T11:19:18.181728+0000","last_unstale":"2024-04-26T11:19:59.494778+0000","last_undegraded":"2024-04-26T11:19:59.494778+0000","last_fullsized":"2024-04-26T11:19:59.494778+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:59.494616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:59.494616+0000","last_clean_scrub_stamp":"2024-04-26T11:19:59.494616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:50:32.682411+0000","scrub_duration":0.001815215,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:27.592038+0000","last_change":"2024-04-26T11:20:27.592160+0000","last_active":"2024-04-26T11:20:27.592038+0000","last_peered":"2024-04-26T11:20:27.592038+0000","last_clean":"2024-04-26T11:20:27.592038+0000","last_became_active":"2024-04-26T11:19:24.197487+0000","last_became_peered":"2024-04-26T11:19:24.197487+0000","last_unstale":"2024-04-26T11:20:27.592038+0000","last_undegraded":"2024-04-26T11:20:27.592038+0000","last_fullsized":"2024-04-26T11:20:27.592038+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:27.592000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:27.592000+0000","last_clean_scrub_stamp":"2024-04-26T11:20:27.592000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:52:21.837181+0000","scrub_duration":0.0016673460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:48.396499+0000","last_change":"2024-04-26T11:19:48.396656+0000","last_active":"2024-04-26T11:19:48.396499+0000","last_peered":"2024-04-26T11:19:48.396499+0000","last_clean":"2024-04-26T11:19:48.396499+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:19:48.396499+0000","last_undegraded":"2024-04-26T11:19:48.396499+0000","last_fullsized":"2024-04-26T11:19:48.396499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:48.396472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:48.396472+0000","last_clean_scrub_stamp":"2024-04-26T11:19:48.396472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:16.773782+0000","scrub_duration":0.0019312940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:19.512918+0000","last_change":"2024-04-26T11:20:19.513110+0000","last_active":"2024-04-26T11:20:19.512918+0000","last_peered":"2024-04-26T11:20:19.512918+0000","last_clean":"2024-04-26T11:20:19.512918+0000","last_became_active":"2024-04-26T11:19:18.184451+0000","last_became_peered":"2024-04-26T11:19:18.184451+0000","last_unstale":"2024-04-26T11:20:19.512918+0000","last_undegraded":"2024-04-26T11:20:19.512918+0000","last_fullsized":"2024-04-26T11:20:19.512918+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:19.512881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:19.512881+0000","last_clean_scrub_stamp":"2024-04-26T11:20:19.512881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:33.563886+0000","scrub_duration":0.023492367,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:08.595129+0000","last_change":"2024-04-26T11:20:08.595253+0000","last_active":"2024-04-26T11:20:08.595129+0000","last_peered":"2024-04-26T11:20:08.595129+0000","last_clean":"2024-04-26T11:20:08.595129+0000","last_became_active":"2024-04-26T11:19:24.198479+0000","last_became_peered":"2024-04-26T11:19:24.198479+0000","last_unstale":"2024-04-26T11:20:08.595129+0000","last_undegraded":"2024-04-26T11:20:08.595129+0000","last_fullsized":"2024-04-26T11:20:08.595129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:08.595106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:08.595106+0000","last_clean_scrub_stamp":"2024-04-26T11:20:08.595106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:18.295964+0000","scrub_duration":0.0021262659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:13.621793+0000","last_change":"2024-04-26T11:20:13.621938+0000","last_active":"2024-04-26T11:20:13.621793+0000","last_peered":"2024-04-26T11:20:13.621793+0000","last_clean":"2024-04-26T11:20:13.621793+0000","last_became_active":"2024-04-26T11:19:18.185105+0000","last_became_peered":"2024-04-26T11:19:18.185105+0000","last_unstale":"2024-04-26T11:20:13.621793+0000","last_undegraded":"2024-04-26T11:20:13.621793+0000","last_fullsized":"2024-04-26T11:20:13.621793+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:13.621769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:13.621769+0000","last_clean_scrub_stamp":"2024-04-26T11:20:13.621769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:26.915580+0000","scrub_duration":0.0020478789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:40.405429+0000","last_change":"2024-04-26T11:20:40.405429+0000","last_active":"2024-04-26T11:20:40.405429+0000","last_peered":"2024-04-26T11:20:40.405429+0000","last_clean":"2024-04-26T11:20:40.405429+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:20:40.405429+0000","last_undegraded":"2024-04-26T11:20:40.405429+0000","last_fullsized":"2024-04-26T11:20:40.405429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T11:20:40.405289+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T11:20:40.405289+0000","last_clean_scrub_stamp":"2024-04-26T11:20:40.405289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:32.550379+0000","scrub_duration":0.001668409,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:43.408650+0000","last_change":"2024-04-26T11:20:43.408650+0000","last_active":"2024-04-26T11:20:43.408650+0000","last_peered":"2024-04-26T11:20:43.408650+0000","last_clean":"2024-04-26T11:20:43.408650+0000","last_became_active":"2024-04-26T11:19:18.190792+0000","last_became_peered":"2024-04-26T11:19:18.190792+0000","last_unstale":"2024-04-26T11:20:43.408650+0000","last_undegraded":"2024-04-26T11:20:43.408650+0000","last_fullsized":"2024-04-26T11:20:43.408650+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:43.408434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:43.408434+0000","last_clean_scrub_stamp":"2024-04-26T11:20:43.408434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:27.015116+0000","scrub_duration":0.0017783230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":67,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.667261+0000","last_change":"2024-04-26T11:19:35.667355+0000","last_active":"2024-04-26T11:19:35.667261+0000","last_peered":"2024-04-26T11:19:35.667261+0000","last_clean":"2024-04-26T11:19:35.667261+0000","last_became_active":"2024-04-26T11:19:24.202348+0000","last_became_peered":"2024-04-26T11:19:24.202348+0000","last_unstale":"2024-04-26T11:19:35.667261+0000","last_undegraded":"2024-04-26T11:19:35.667261+0000","last_fullsized":"2024-04-26T11:19:35.667261+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:35.667237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:35.667237+0000","last_clean_scrub_stamp":"2024-04-26T11:19:35.667237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:38.776469+0000","scrub_duration":0.0019697669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:44.766975+0000","last_change":"2024-04-26T11:19:44.767086+0000","last_active":"2024-04-26T11:19:44.766975+0000","last_peered":"2024-04-26T11:19:44.766975+0000","last_clean":"2024-04-26T11:19:44.766975+0000","last_became_active":"2024-04-26T11:19:24.198920+0000","last_became_peered":"2024-04-26T11:19:24.198920+0000","last_unstale":"2024-04-26T11:19:44.766975+0000","last_undegraded":"2024-04-26T11:19:44.766975+0000","last_fullsized":"2024-04-26T11:19:44.766975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:44.766950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:44.766950+0000","last_clean_scrub_stamp":"2024-04-26T11:19:44.766950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:30.054801+0000","scrub_duration":0.0017451579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:47.408691+0000","last_change":"2024-04-26T11:20:47.408795+0000","last_active":"2024-04-26T11:20:47.408691+0000","last_peered":"2024-04-26T11:20:47.408691+0000","last_clean":"2024-04-26T11:20:47.408691+0000","last_became_active":"2024-04-26T11:19:24.197698+0000","last_became_peered":"2024-04-26T11:19:24.197698+0000","last_unstale":"2024-04-26T11:20:47.408691+0000","last_undegraded":"2024-04-26T11:20:47.408691+0000","last_fullsized":"2024-04-26T11:20:47.408691+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:47.408667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:47.408667+0000","last_clean_scrub_stamp":"2024-04-26T11:20:47.408667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:10.833863+0000","scrub_duration":0.00179385,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:47.503571+0000","last_change":"2024-04-26T11:19:47.503709+0000","last_active":"2024-04-26T11:19:47.503571+0000","last_peered":"2024-04-26T11:19:47.503571+0000","last_clean":"2024-04-26T11:19:47.503571+0000","last_became_active":"2024-04-26T11:19:18.190127+0000","last_became_peered":"2024-04-26T11:19:18.190127+0000","last_unstale":"2024-04-26T11:19:47.503571+0000","last_undegraded":"2024-04-26T11:19:47.503571+0000","last_fullsized":"2024-04-26T11:19:47.503571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:47.503550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:47.503550+0000","last_clean_scrub_stamp":"2024-04-26T11:19:47.503550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:33.423364+0000","scrub_duration":0.064283446999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:57.240578+0000","last_change":"2024-04-26T11:20:57.240696+0000","last_active":"2024-04-26T11:20:57.240578+0000","last_peered":"2024-04-26T11:20:57.240578+0000","last_clean":"2024-04-26T11:20:57.240578+0000","last_became_active":"2024-04-26T11:19:24.204122+0000","last_became_peered":"2024-04-26T11:19:24.204122+0000","last_unstale":"2024-04-26T11:20:57.240578+0000","last_undegraded":"2024-04-26T11:20:57.240578+0000","last_fullsized":"2024-04-26T11:20:57.240578+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:57.240554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:57.240554+0000","last_clean_scrub_stamp":"2024-04-26T11:20:57.240554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:52.001868+0000","scrub_duration":0.001840721,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:24.473040+0000","last_change":"2024-04-26T11:20:24.473172+0000","last_active":"2024-04-26T11:20:24.473040+0000","last_peered":"2024-04-26T11:20:24.473040+0000","last_clean":"2024-04-26T11:20:24.473040+0000","last_became_active":"2024-04-26T11:19:24.197247+0000","last_became_peered":"2024-04-26T11:19:24.197247+0000","last_unstale":"2024-04-26T11:20:24.473040+0000","last_undegraded":"2024-04-26T11:20:24.473040+0000","last_fullsized":"2024-04-26T11:20:24.473040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:24.473016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:24.473016+0000","last_clean_scrub_stamp":"2024-04-26T11:20:24.473016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:59.992655+0000","scrub_duration":0.001721656,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:19.633755+0000","last_change":"2024-04-26T11:20:19.633856+0000","last_active":"2024-04-26T11:20:19.633755+0000","last_peered":"2024-04-26T11:20:19.633755+0000","last_clean":"2024-04-26T11:20:19.633755+0000","last_became_active":"2024-04-26T11:19:18.185578+0000","last_became_peered":"2024-04-26T11:19:18.185578+0000","last_unstale":"2024-04-26T11:20:19.633755+0000","last_undegraded":"2024-04-26T11:20:19.633755+0000","last_fullsized":"2024-04-26T11:20:19.633755+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:19.633732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:19.633732+0000","last_clean_scrub_stamp":"2024-04-26T11:20:19.633732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:47.795228+0000","scrub_duration":0.001874459,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:05.541862+0000","last_change":"2024-04-26T11:20:05.541862+0000","last_active":"2024-04-26T11:20:05.541862+0000","last_peered":"2024-04-26T11:20:05.541862+0000","last_clean":"2024-04-26T11:20:05.541862+0000","last_became_active":"2024-04-26T11:19:24.200992+0000","last_became_peered":"2024-04-26T11:19:24.200992+0000","last_unstale":"2024-04-26T11:20:05.541862+0000","last_undegraded":"2024-04-26T11:20:05.541862+0000","last_fullsized":"2024-04-26T11:20:05.541862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:05.541702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:05.541702+0000","last_clean_scrub_stamp":"2024-04-26T11:20:05.541702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:43.691758+0000","scrub_duration":0.001648708,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"82'5","reported_seq":124,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:31.500638+0000","last_change":"2024-04-26T11:20:31.500638+0000","last_active":"2024-04-26T11:20:31.500638+0000","last_peered":"2024-04-26T11:20:31.500638+0000","last_clean":"2024-04-26T11:20:31.500638+0000","last_became_active":"2024-04-26T11:19:18.190381+0000","last_became_peered":"2024-04-26T11:19:18.190381+0000","last_unstale":"2024-04-26T11:20:31.500638+0000","last_undegraded":"2024-04-26T11:20:31.500638+0000","last_fullsized":"2024-04-26T11:20:31.500638+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'5","last_scrub_stamp":"2024-04-26T11:20:31.500511+0000","last_deep_scrub":"82'5","last_deep_scrub_stamp":"2024-04-26T11:20:31.500511+0000","last_clean_scrub_stamp":"2024-04-26T11:20:31.500511+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:36:22.961021+0000","scrub_duration":0.0037041859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:51.669025+0000","last_change":"2024-04-26T11:19:51.669122+0000","last_active":"2024-04-26T11:19:51.669025+0000","last_peered":"2024-04-26T11:19:51.669025+0000","last_clean":"2024-04-26T11:19:51.669025+0000","last_became_active":"2024-04-26T11:19:24.199659+0000","last_became_peered":"2024-04-26T11:19:24.199659+0000","last_unstale":"2024-04-26T11:19:51.669025+0000","last_undegraded":"2024-04-26T11:19:51.669025+0000","last_fullsized":"2024-04-26T11:19:51.669025+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:51.668999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:51.668999+0000","last_clean_scrub_stamp":"2024-04-26T11:19:51.668999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:13.870535+0000","scrub_duration":0.001713553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"82'10","reported_seq":61,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:15.665075+0000","last_change":"2024-04-26T11:20:15.665204+0000","last_active":"2024-04-26T11:20:15.665075+0000","last_peered":"2024-04-26T11:20:15.665075+0000","last_clean":"2024-04-26T11:20:15.665075+0000","last_became_active":"2024-04-26T11:19:18.180711+0000","last_became_peered":"2024-04-26T11:19:18.180711+0000","last_unstale":"2024-04-26T11:20:15.665075+0000","last_undegraded":"2024-04-26T11:20:15.665075+0000","last_fullsized":"2024-04-26T11:20:15.665075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'10","last_scrub_stamp":"2024-04-26T11:20:15.665049+0000","last_deep_scrub":"82'10","last_deep_scrub_stamp":"2024-04-26T11:20:15.665049+0000","last_clean_scrub_stamp":"2024-04-26T11:20:15.665049+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:43:51.496107+0000","scrub_duration":0.0059687940000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:52.744204+0000","last_change":"2024-04-26T11:20:52.744313+0000","last_active":"2024-04-26T11:20:52.744204+0000","last_peered":"2024-04-26T11:20:52.744204+0000","last_clean":"2024-04-26T11:20:52.744204+0000","last_became_active":"2024-04-26T11:19:18.181615+0000","last_became_peered":"2024-04-26T11:19:18.181615+0000","last_unstale":"2024-04-26T11:20:52.744204+0000","last_undegraded":"2024-04-26T11:20:52.744204+0000","last_fullsized":"2024-04-26T11:20:52.744204+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:52.744179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:52.744179+0000","last_clean_scrub_stamp":"2024-04-26T11:20:52.744179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:23.622036+0000","scrub_duration":0.0021129399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"82'4","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:33.660558+0000","last_change":"2024-04-26T11:20:33.660657+0000","last_active":"2024-04-26T11:20:33.660558+0000","last_peered":"2024-04-26T11:20:33.660558+0000","last_clean":"2024-04-26T11:20:33.660558+0000","last_became_active":"2024-04-26T11:19:18.183103+0000","last_became_peered":"2024-04-26T11:19:18.183103+0000","last_unstale":"2024-04-26T11:20:33.660558+0000","last_undegraded":"2024-04-26T11:20:33.660558+0000","last_fullsized":"2024-04-26T11:20:33.660558+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-26T11:20:33.660533+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-26T11:20:33.660533+0000","last_clean_scrub_stamp":"2024-04-26T11:20:33.660533+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:09.137970+0000","scrub_duration":0.0039063550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:21:00.238527+0000","last_change":"2024-04-26T11:21:00.238646+0000","last_active":"2024-04-26T11:21:00.238527+0000","last_peered":"2024-04-26T11:21:00.238527+0000","last_clean":"2024-04-26T11:21:00.238527+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:21:00.238527+0000","last_undegraded":"2024-04-26T11:21:00.238527+0000","last_fullsized":"2024-04-26T11:21:00.238527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:00.238503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:00.238503+0000","last_clean_scrub_stamp":"2024-04-26T11:21:00.238503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:08.700207+0000","scrub_duration":0.0014474500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:16.464920+0000","last_change":"2024-04-26T11:20:16.464920+0000","last_active":"2024-04-26T11:20:16.464920+0000","last_peered":"2024-04-26T11:20:16.464920+0000","last_clean":"2024-04-26T11:20:16.464920+0000","last_became_active":"2024-04-26T11:19:24.197647+0000","last_became_peered":"2024-04-26T11:19:24.197647+0000","last_unstale":"2024-04-26T11:20:16.464920+0000","last_undegraded":"2024-04-26T11:20:16.464920+0000","last_fullsized":"2024-04-26T11:20:16.464920+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:16.464751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:16.464751+0000","last_clean_scrub_stamp":"2024-04-26T11:20:16.464751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:31.462042+0000","scrub_duration":0.001769709,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:49.458065+0000","last_change":"2024-04-26T11:19:49.458065+0000","last_active":"2024-04-26T11:19:49.458065+0000","last_peered":"2024-04-26T11:19:49.458065+0000","last_clean":"2024-04-26T11:19:49.458065+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:19:49.458065+0000","last_undegraded":"2024-04-26T11:19:49.458065+0000","last_fullsized":"2024-04-26T11:19:49.458065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:49.457903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:49.457903+0000","last_clean_scrub_stamp":"2024-04-26T11:19:49.457903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:29.600094+0000","scrub_duration":0.017036468999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":119,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:42.399823+0000","last_change":"2024-04-26T11:20:42.399928+0000","last_active":"2024-04-26T11:20:42.399823+0000","last_peered":"2024-04-26T11:20:42.399823+0000","last_clean":"2024-04-26T11:20:42.399823+0000","last_became_active":"2024-04-26T11:19:18.181907+0000","last_became_peered":"2024-04-26T11:19:18.181907+0000","last_unstale":"2024-04-26T11:20:42.399823+0000","last_undegraded":"2024-04-26T11:20:42.399823+0000","last_fullsized":"2024-04-26T11:20:42.399823+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:42.399800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:42.399800+0000","last_clean_scrub_stamp":"2024-04-26T11:20:42.399800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:27.642376+0000","scrub_duration":0.0017102930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:53.337874+0000","last_change":"2024-04-26T11:20:53.338016+0000","last_active":"2024-04-26T11:20:53.337874+0000","last_peered":"2024-04-26T11:20:53.337874+0000","last_clean":"2024-04-26T11:20:53.337874+0000","last_became_active":"2024-04-26T11:19:24.201114+0000","last_became_peered":"2024-04-26T11:19:24.201114+0000","last_unstale":"2024-04-26T11:20:53.337874+0000","last_undegraded":"2024-04-26T11:20:53.337874+0000","last_fullsized":"2024-04-26T11:20:53.337874+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:53.337850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:53.337850+0000","last_clean_scrub_stamp":"2024-04-26T11:20:53.337850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:07.388855+0000","scrub_duration":0.001932121,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"82'12","reported_seq":57,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:20.669835+0000","last_change":"2024-04-26T11:20:20.669954+0000","last_active":"2024-04-26T11:20:20.669835+0000","last_peered":"2024-04-26T11:20:20.669835+0000","last_clean":"2024-04-26T11:20:20.669835+0000","last_became_active":"2024-04-26T11:19:18.182017+0000","last_became_peered":"2024-04-26T11:19:18.182017+0000","last_unstale":"2024-04-26T11:20:20.669835+0000","last_undegraded":"2024-04-26T11:20:20.669835+0000","last_fullsized":"2024-04-26T11:20:20.669835+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'12","last_scrub_stamp":"2024-04-26T11:20:20.669804+0000","last_deep_scrub":"82'12","last_deep_scrub_stamp":"2024-04-26T11:20:20.669804+0000","last_clean_scrub_stamp":"2024-04-26T11:20:20.669804+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:56.741407+0000","scrub_duration":0.0048710799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:21:00.252872+0000","last_change":"2024-04-26T11:21:00.253029+0000","last_active":"2024-04-26T11:21:00.252872+0000","last_peered":"2024-04-26T11:21:00.252872+0000","last_clean":"2024-04-26T11:21:00.252872+0000","last_became_active":"2024-04-26T11:19:24.204476+0000","last_became_peered":"2024-04-26T11:19:24.204476+0000","last_unstale":"2024-04-26T11:21:00.252872+0000","last_undegraded":"2024-04-26T11:21:00.252872+0000","last_fullsized":"2024-04-26T11:21:00.252872+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:00.252834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:00.252834+0000","last_clean_scrub_stamp":"2024-04-26T11:21:00.252834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:58.616940+0000","scrub_duration":0.031654087999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"82'2","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:44.505106+0000","last_change":"2024-04-26T11:19:44.505212+0000","last_active":"2024-04-26T11:19:44.505106+0000","last_peered":"2024-04-26T11:19:44.505106+0000","last_clean":"2024-04-26T11:19:44.505106+0000","last_became_active":"2024-04-26T11:19:18.181604+0000","last_became_peered":"2024-04-26T11:19:18.181604+0000","last_unstale":"2024-04-26T11:19:44.505106+0000","last_undegraded":"2024-04-26T11:19:44.505106+0000","last_fullsized":"2024-04-26T11:19:44.505106+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-26T11:19:44.505080+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-26T11:19:44.505080+0000","last_clean_scrub_stamp":"2024-04-26T11:19:44.505080+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:07.623145+0000","scrub_duration":0.0032804549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:36.457819+0000","last_change":"2024-04-26T11:19:36.457819+0000","last_active":"2024-04-26T11:19:36.457819+0000","last_peered":"2024-04-26T11:19:36.457819+0000","last_clean":"2024-04-26T11:19:36.457819+0000","last_became_active":"2024-04-26T11:19:18.181462+0000","last_became_peered":"2024-04-26T11:19:18.181462+0000","last_unstale":"2024-04-26T11:19:36.457819+0000","last_undegraded":"2024-04-26T11:19:36.457819+0000","last_fullsized":"2024-04-26T11:19:36.457819+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:36.457692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:36.457692+0000","last_clean_scrub_stamp":"2024-04-26T11:19:36.457692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:46.158550+0000","scrub_duration":0.0018253519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"82'3","reported_seq":122,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:36.463609+0000","last_change":"2024-04-26T11:20:36.463708+0000","last_active":"2024-04-26T11:20:36.463609+0000","last_peered":"2024-04-26T11:20:36.463609+0000","last_clean":"2024-04-26T11:20:36.463609+0000","last_became_active":"2024-04-26T11:19:18.182242+0000","last_became_peered":"2024-04-26T11:19:18.182242+0000","last_unstale":"2024-04-26T11:20:36.463609+0000","last_undegraded":"2024-04-26T11:20:36.463609+0000","last_fullsized":"2024-04-26T11:20:36.463609+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T11:20:36.463584+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T11:20:36.463584+0000","last_clean_scrub_stamp":"2024-04-26T11:20:36.463584+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:07.395616+0000","scrub_duration":0.0032256059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:53.468976+0000","last_change":"2024-04-26T11:19:53.469071+0000","last_active":"2024-04-26T11:19:53.468976+0000","last_peered":"2024-04-26T11:19:53.468976+0000","last_clean":"2024-04-26T11:19:53.468976+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:19:53.468976+0000","last_undegraded":"2024-04-26T11:19:53.468976+0000","last_fullsized":"2024-04-26T11:19:53.468976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:53.468953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:53.468953+0000","last_clean_scrub_stamp":"2024-04-26T11:19:53.468953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:51:47.714133+0000","scrub_duration":0.0018786149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'2","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:40.744434+0000","last_change":"2024-04-26T11:20:40.744564+0000","last_active":"2024-04-26T11:20:40.744434+0000","last_peered":"2024-04-26T11:20:40.744434+0000","last_clean":"2024-04-26T11:20:40.744434+0000","last_became_active":"2024-04-26T11:19:18.180506+0000","last_became_peered":"2024-04-26T11:19:18.180506+0000","last_unstale":"2024-04-26T11:20:40.744434+0000","last_undegraded":"2024-04-26T11:20:40.744434+0000","last_fullsized":"2024-04-26T11:20:40.744434+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-26T11:20:40.744410+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-26T11:20:40.744410+0000","last_clean_scrub_stamp":"2024-04-26T11:20:40.744410+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:11.030235+0000","scrub_duration":0.0034585390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:50.503948+0000","last_change":"2024-04-26T11:19:50.504053+0000","last_active":"2024-04-26T11:19:50.503948+0000","last_peered":"2024-04-26T11:19:50.503948+0000","last_clean":"2024-04-26T11:19:50.503948+0000","last_became_active":"2024-04-26T11:19:18.185355+0000","last_became_peered":"2024-04-26T11:19:18.185355+0000","last_unstale":"2024-04-26T11:19:50.503948+0000","last_undegraded":"2024-04-26T11:19:50.503948+0000","last_fullsized":"2024-04-26T11:19:50.503948+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:50.503924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:50.503924+0000","last_clean_scrub_stamp":"2024-04-26T11:19:50.503924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:15.276373+0000","scrub_duration":0.001850661,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:00.590718+0000","last_change":"2024-04-26T11:20:00.590840+0000","last_active":"2024-04-26T11:20:00.590718+0000","last_peered":"2024-04-26T11:20:00.590718+0000","last_clean":"2024-04-26T11:20:00.590718+0000","last_became_active":"2024-04-26T11:19:18.186342+0000","last_became_peered":"2024-04-26T11:19:18.186342+0000","last_unstale":"2024-04-26T11:20:00.590718+0000","last_undegraded":"2024-04-26T11:20:00.590718+0000","last_fullsized":"2024-04-26T11:20:00.590718+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:00.590694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:00.590694+0000","last_clean_scrub_stamp":"2024-04-26T11:20:00.590694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:47.383110+0000","scrub_duration":0.0016301460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:03.588748+0000","last_change":"2024-04-26T11:20:03.588894+0000","last_active":"2024-04-26T11:20:03.588748+0000","last_peered":"2024-04-26T11:20:03.588748+0000","last_clean":"2024-04-26T11:20:03.588748+0000","last_became_active":"2024-04-26T11:19:24.201330+0000","last_became_peered":"2024-04-26T11:19:24.201330+0000","last_unstale":"2024-04-26T11:20:03.588748+0000","last_undegraded":"2024-04-26T11:20:03.588748+0000","last_fullsized":"2024-04-26T11:20:03.588748+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:03.588721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:03.588721+0000","last_clean_scrub_stamp":"2024-04-26T11:20:03.588721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:51.328094+0000","scrub_duration":0.029670523000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"82'3","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:06.586122+0000","last_change":"2024-04-26T11:20:06.586222+0000","last_active":"2024-04-26T11:20:06.586122+0000","last_peered":"2024-04-26T11:20:06.586122+0000","last_clean":"2024-04-26T11:20:06.586122+0000","last_became_active":"2024-04-26T11:19:24.201077+0000","last_became_peered":"2024-04-26T11:19:24.201077+0000","last_unstale":"2024-04-26T11:20:06.586122+0000","last_undegraded":"2024-04-26T11:20:06.586122+0000","last_fullsized":"2024-04-26T11:20:06.586122+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T11:20:06.586097+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T11:20:06.586097+0000","last_clean_scrub_stamp":"2024-04-26T11:20:06.586097+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:06.937690+0000","scrub_duration":0.0032225639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:21.647455+0000","last_change":"2024-04-26T11:20:21.647563+0000","last_active":"2024-04-26T11:20:21.647455+0000","last_peered":"2024-04-26T11:20:21.647455+0000","last_clean":"2024-04-26T11:20:21.647455+0000","last_became_active":"2024-04-26T11:19:18.185768+0000","last_became_peered":"2024-04-26T11:19:18.185768+0000","last_unstale":"2024-04-26T11:20:21.647455+0000","last_undegraded":"2024-04-26T11:20:21.647455+0000","last_fullsized":"2024-04-26T11:20:21.647455+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:21.647424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:21.647424+0000","last_clean_scrub_stamp":"2024-04-26T11:20:21.647424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:30.401562+0000","scrub_duration":0.0017008469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:35.738414+0000","last_change":"2024-04-26T11:20:35.738528+0000","last_active":"2024-04-26T11:20:35.738414+0000","last_peered":"2024-04-26T11:20:35.738414+0000","last_clean":"2024-04-26T11:20:35.738414+0000","last_became_active":"2024-04-26T11:19:18.184149+0000","last_became_peered":"2024-04-26T11:19:18.184149+0000","last_unstale":"2024-04-26T11:20:35.738414+0000","last_undegraded":"2024-04-26T11:20:35.738414+0000","last_fullsized":"2024-04-26T11:20:35.738414+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:35.738376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:35.738376+0000","last_clean_scrub_stamp":"2024-04-26T11:20:35.738376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:19.639335+0000","scrub_duration":0.0020898240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:36.619910+0000","last_change":"2024-04-26T11:19:36.620064+0000","last_active":"2024-04-26T11:19:36.619910+0000","last_peered":"2024-04-26T11:19:36.619910+0000","last_clean":"2024-04-26T11:19:36.619910+0000","last_became_active":"2024-04-26T11:19:18.181951+0000","last_became_peered":"2024-04-26T11:19:18.181951+0000","last_unstale":"2024-04-26T11:19:36.619910+0000","last_undegraded":"2024-04-26T11:19:36.619910+0000","last_fullsized":"2024-04-26T11:19:36.619910+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:36.619885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:36.619885+0000","last_clean_scrub_stamp":"2024-04-26T11:19:36.619885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:06.660819+0000","scrub_duration":0.001669823,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":119,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:41.391079+0000","last_change":"2024-04-26T11:20:41.391204+0000","last_active":"2024-04-26T11:20:41.391079+0000","last_peered":"2024-04-26T11:20:41.391079+0000","last_clean":"2024-04-26T11:20:41.391079+0000","last_became_active":"2024-04-26T11:19:18.181767+0000","last_became_peered":"2024-04-26T11:19:18.181767+0000","last_unstale":"2024-04-26T11:20:41.391079+0000","last_undegraded":"2024-04-26T11:20:41.391079+0000","last_fullsized":"2024-04-26T11:20:41.391079+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:41.391041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:41.391041+0000","last_clean_scrub_stamp":"2024-04-26T11:20:41.391041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:51.694708+0000","scrub_duration":0.0017201790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:37.612117+0000","last_change":"2024-04-26T11:19:37.612253+0000","last_active":"2024-04-26T11:19:37.612117+0000","last_peered":"2024-04-26T11:19:37.612117+0000","last_clean":"2024-04-26T11:19:37.612117+0000","last_became_active":"2024-04-26T11:19:18.182060+0000","last_became_peered":"2024-04-26T11:19:18.182060+0000","last_unstale":"2024-04-26T11:19:37.612117+0000","last_undegraded":"2024-04-26T11:19:37.612117+0000","last_fullsized":"2024-04-26T11:19:37.612117+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:37.612061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:37.612061+0000","last_clean_scrub_stamp":"2024-04-26T11:19:37.612061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:24.175151+0000","scrub_duration":0.0016765459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:20.495917+0000","last_change":"2024-04-26T11:20:20.496020+0000","last_active":"2024-04-26T11:20:20.495917+0000","last_peered":"2024-04-26T11:20:20.495917+0000","last_clean":"2024-04-26T11:20:20.495917+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:20:20.495917+0000","last_undegraded":"2024-04-26T11:20:20.495917+0000","last_fullsized":"2024-04-26T11:20:20.495917+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:20.495895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:20.495895+0000","last_clean_scrub_stamp":"2024-04-26T11:20:20.495895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:28.263035+0000","scrub_duration":0.001714824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:48.777587+0000","last_change":"2024-04-26T11:19:48.777713+0000","last_active":"2024-04-26T11:19:48.777587+0000","last_peered":"2024-04-26T11:19:48.777587+0000","last_clean":"2024-04-26T11:19:48.777587+0000","last_became_active":"2024-04-26T11:19:24.203758+0000","last_became_peered":"2024-04-26T11:19:24.203758+0000","last_unstale":"2024-04-26T11:19:48.777587+0000","last_undegraded":"2024-04-26T11:19:48.777587+0000","last_fullsized":"2024-04-26T11:19:48.777587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:48.777563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:48.777563+0000","last_clean_scrub_stamp":"2024-04-26T11:19:48.777563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:26.143928+0000","scrub_duration":0.058175359000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:33.470592+0000","last_change":"2024-04-26T11:20:33.470712+0000","last_active":"2024-04-26T11:20:33.470592+0000","last_peered":"2024-04-26T11:20:33.470592+0000","last_clean":"2024-04-26T11:20:33.470592+0000","last_became_active":"2024-04-26T11:19:24.200963+0000","last_became_peered":"2024-04-26T11:19:24.200963+0000","last_unstale":"2024-04-26T11:20:33.470592+0000","last_undegraded":"2024-04-26T11:20:33.470592+0000","last_fullsized":"2024-04-26T11:20:33.470592+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:33.470567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:33.470567+0000","last_clean_scrub_stamp":"2024-04-26T11:20:33.470567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:06.658362+0000","scrub_duration":0.0018913809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:21:02.446591+0000","last_change":"2024-04-26T11:21:02.446717+0000","last_active":"2024-04-26T11:21:02.446591+0000","last_peered":"2024-04-26T11:21:02.446591+0000","last_clean":"2024-04-26T11:21:02.446591+0000","last_became_active":"2024-04-26T11:19:18.189086+0000","last_became_peered":"2024-04-26T11:19:18.189086+0000","last_unstale":"2024-04-26T11:21:02.446591+0000","last_undegraded":"2024-04-26T11:21:02.446591+0000","last_fullsized":"2024-04-26T11:21:02.446591+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:02.446566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:02.446566+0000","last_clean_scrub_stamp":"2024-04-26T11:21:02.446566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:04.174145+0000","scrub_duration":0.002079553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:05.442392+0000","last_change":"2024-04-26T11:20:05.442516+0000","last_active":"2024-04-26T11:20:05.442392+0000","last_peered":"2024-04-26T11:20:05.442392+0000","last_clean":"2024-04-26T11:20:05.442392+0000","last_became_active":"2024-04-26T11:19:18.181791+0000","last_became_peered":"2024-04-26T11:19:18.181791+0000","last_unstale":"2024-04-26T11:20:05.442392+0000","last_undegraded":"2024-04-26T11:20:05.442392+0000","last_fullsized":"2024-04-26T11:20:05.442392+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:05.442367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:05.442367+0000","last_clean_scrub_stamp":"2024-04-26T11:20:05.442367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:48.858203+0000","scrub_duration":0.001909062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:24.707687+0000","last_change":"2024-04-26T11:20:24.707827+0000","last_active":"2024-04-26T11:20:24.707687+0000","last_peered":"2024-04-26T11:20:24.707687+0000","last_clean":"2024-04-26T11:20:24.707687+0000","last_became_active":"2024-04-26T11:19:18.183292+0000","last_became_peered":"2024-04-26T11:19:18.183292+0000","last_unstale":"2024-04-26T11:20:24.707687+0000","last_undegraded":"2024-04-26T11:20:24.707687+0000","last_fullsized":"2024-04-26T11:20:24.707687+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:24.707649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:24.707649+0000","last_clean_scrub_stamp":"2024-04-26T11:20:24.707649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:50.921059+0000","scrub_duration":0.001693588,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:21:10.451951+0000","last_change":"2024-04-26T11:21:10.452063+0000","last_active":"2024-04-26T11:21:10.451951+0000","last_peered":"2024-04-26T11:21:10.451951+0000","last_clean":"2024-04-26T11:21:10.451951+0000","last_became_active":"2024-04-26T11:19:18.190096+0000","last_became_peered":"2024-04-26T11:19:18.190096+0000","last_unstale":"2024-04-26T11:21:10.451951+0000","last_undegraded":"2024-04-26T11:21:10.451951+0000","last_fullsized":"2024-04-26T11:21:10.451951+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:10.451927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:10.451927+0000","last_clean_scrub_stamp":"2024-04-26T11:21:10.451927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:41:42.128268+0000","scrub_duration":0.0019660910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:28.566429+0000","last_change":"2024-04-26T11:20:28.566554+0000","last_active":"2024-04-26T11:20:28.566429+0000","last_peered":"2024-04-26T11:20:28.566429+0000","last_clean":"2024-04-26T11:20:28.566429+0000","last_became_active":"2024-04-26T11:19:24.199834+0000","last_became_peered":"2024-04-26T11:19:24.199834+0000","last_unstale":"2024-04-26T11:20:28.566429+0000","last_undegraded":"2024-04-26T11:20:28.566429+0000","last_fullsized":"2024-04-26T11:20:28.566429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:28.566404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:28.566404+0000","last_clean_scrub_stamp":"2024-04-26T11:20:28.566404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:24.933139+0000","scrub_duration":0.0016291509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:56.642304+0000","last_change":"2024-04-26T11:19:56.642416+0000","last_active":"2024-04-26T11:19:56.642304+0000","last_peered":"2024-04-26T11:19:56.642304+0000","last_clean":"2024-04-26T11:19:56.642304+0000","last_became_active":"2024-04-26T11:19:24.196561+0000","last_became_peered":"2024-04-26T11:19:24.196561+0000","last_unstale":"2024-04-26T11:19:56.642304+0000","last_undegraded":"2024-04-26T11:19:56.642304+0000","last_fullsized":"2024-04-26T11:19:56.642304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:56.642282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:56.642282+0000","last_clean_scrub_stamp":"2024-04-26T11:19:56.642282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:16.768522+0000","scrub_duration":0.001607296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":119,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:30.510626+0000","last_change":"2024-04-26T11:20:30.510723+0000","last_active":"2024-04-26T11:20:30.510626+0000","last_peered":"2024-04-26T11:20:30.510626+0000","last_clean":"2024-04-26T11:20:30.510626+0000","last_became_active":"2024-04-26T11:19:18.182077+0000","last_became_peered":"2024-04-26T11:19:18.182077+0000","last_unstale":"2024-04-26T11:20:30.510626+0000","last_undegraded":"2024-04-26T11:20:30.510626+0000","last_fullsized":"2024-04-26T11:20:30.510626+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:30.510602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:30.510602+0000","last_clean_scrub_stamp":"2024-04-26T11:20:30.510602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:28.874707+0000","scrub_duration":0.0021031610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:58.225045+0000","last_change":"2024-04-26T11:20:58.225184+0000","last_active":"2024-04-26T11:20:58.225045+0000","last_peered":"2024-04-26T11:20:58.225045+0000","last_clean":"2024-04-26T11:20:58.225045+0000","last_became_active":"2024-04-26T11:19:24.204538+0000","last_became_peered":"2024-04-26T11:19:24.204538+0000","last_unstale":"2024-04-26T11:20:58.225045+0000","last_undegraded":"2024-04-26T11:20:58.225045+0000","last_fullsized":"2024-04-26T11:20:58.225045+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:58.225021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:58.225021+0000","last_clean_scrub_stamp":"2024-04-26T11:20:58.225021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:00.553775+0000","scrub_duration":0.029226551999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:32.614013+0000","last_change":"2024-04-26T11:20:32.614151+0000","last_active":"2024-04-26T11:20:32.614013+0000","last_peered":"2024-04-26T11:20:32.614013+0000","last_clean":"2024-04-26T11:20:32.614013+0000","last_became_active":"2024-04-26T11:19:18.184460+0000","last_became_peered":"2024-04-26T11:19:18.184460+0000","last_unstale":"2024-04-26T11:20:32.614013+0000","last_undegraded":"2024-04-26T11:20:32.614013+0000","last_fullsized":"2024-04-26T11:20:32.614013+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:32.613980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:32.613980+0000","last_clean_scrub_stamp":"2024-04-26T11:20:32.613980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:31.344148+0000","scrub_duration":0.0021711899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"82'159","reported_seq":249,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:11.567623+0000","last_change":"2024-04-26T11:20:11.567623+0000","last_active":"2024-04-26T11:20:11.567623+0000","last_peered":"2024-04-26T11:20:11.567623+0000","last_clean":"2024-04-26T11:20:11.567623+0000","last_became_active":"2024-04-26T11:19:18.180577+0000","last_became_peered":"2024-04-26T11:19:18.180577+0000","last_unstale":"2024-04-26T11:20:11.567623+0000","last_undegraded":"2024-04-26T11:20:11.567623+0000","last_fullsized":"2024-04-26T11:20:11.567623+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'159","last_scrub_stamp":"2024-04-26T11:20:11.567504+0000","last_deep_scrub":"82'159","last_deep_scrub_stamp":"2024-04-26T11:20:11.567504+0000","last_clean_scrub_stamp":"2024-04-26T11:20:11.567504+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:18.611371+0000","scrub_duration":0.0050467979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:39.358890+0000","last_change":"2024-04-26T11:20:39.359015+0000","last_active":"2024-04-26T11:20:39.358890+0000","last_peered":"2024-04-26T11:20:39.358890+0000","last_clean":"2024-04-26T11:20:39.358890+0000","last_became_active":"2024-04-26T11:19:24.196404+0000","last_became_peered":"2024-04-26T11:19:24.196404+0000","last_unstale":"2024-04-26T11:20:39.358890+0000","last_undegraded":"2024-04-26T11:20:39.358890+0000","last_fullsized":"2024-04-26T11:20:39.358890+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:39.358852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:39.358852+0000","last_clean_scrub_stamp":"2024-04-26T11:20:39.358852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:22.774688+0000","scrub_duration":0.0015974749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:09.531099+0000","last_change":"2024-04-26T11:20:09.531227+0000","last_active":"2024-04-26T11:20:09.531099+0000","last_peered":"2024-04-26T11:20:09.531099+0000","last_clean":"2024-04-26T11:20:09.531099+0000","last_became_active":"2024-04-26T11:19:18.181863+0000","last_became_peered":"2024-04-26T11:19:18.181863+0000","last_unstale":"2024-04-26T11:20:09.531099+0000","last_undegraded":"2024-04-26T11:20:09.531099+0000","last_fullsized":"2024-04-26T11:20:09.531099+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:09.531073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:09.531073+0000","last_clean_scrub_stamp":"2024-04-26T11:20:09.531073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:28.881302+0000","scrub_duration":0.0020025820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:18.631147+0000","last_change":"2024-04-26T11:20:18.631147+0000","last_active":"2024-04-26T11:20:18.631147+0000","last_peered":"2024-04-26T11:20:18.631147+0000","last_clean":"2024-04-26T11:20:18.631147+0000","last_became_active":"2024-04-26T11:19:18.180792+0000","last_became_peered":"2024-04-26T11:19:18.180792+0000","last_unstale":"2024-04-26T11:20:18.631147+0000","last_undegraded":"2024-04-26T11:20:18.631147+0000","last_fullsized":"2024-04-26T11:20:18.631147+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:18.630989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:18.630989+0000","last_clean_scrub_stamp":"2024-04-26T11:20:18.630989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:25:42.196975+0000","scrub_duration":0.001948642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:25.520668+0000","last_change":"2024-04-26T11:20:25.520792+0000","last_active":"2024-04-26T11:20:25.520668+0000","last_peered":"2024-04-26T11:20:25.520668+0000","last_clean":"2024-04-26T11:20:25.520668+0000","last_became_active":"2024-04-26T11:19:24.197711+0000","last_became_peered":"2024-04-26T11:19:24.197711+0000","last_unstale":"2024-04-26T11:20:25.520668+0000","last_undegraded":"2024-04-26T11:20:25.520668+0000","last_fullsized":"2024-04-26T11:20:25.520668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:25.520630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:25.520630+0000","last_clean_scrub_stamp":"2024-04-26T11:20:25.520630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:29.672543+0000","scrub_duration":0.0018688400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:13.502665+0000","last_change":"2024-04-26T11:20:13.502774+0000","last_active":"2024-04-26T11:20:13.502665+0000","last_peered":"2024-04-26T11:20:13.502665+0000","last_clean":"2024-04-26T11:20:13.502665+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:20:13.502665+0000","last_undegraded":"2024-04-26T11:20:13.502665+0000","last_fullsized":"2024-04-26T11:20:13.502665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:13.502641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:13.502641+0000","last_clean_scrub_stamp":"2024-04-26T11:20:13.502641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:36.927838+0000","scrub_duration":0.00168844,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:25.495362+0000","last_change":"2024-04-26T11:20:25.495474+0000","last_active":"2024-04-26T11:20:25.495362+0000","last_peered":"2024-04-26T11:20:25.495362+0000","last_clean":"2024-04-26T11:20:25.495362+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:20:25.495362+0000","last_undegraded":"2024-04-26T11:20:25.495362+0000","last_fullsized":"2024-04-26T11:20:25.495362+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:25.495337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:25.495337+0000","last_clean_scrub_stamp":"2024-04-26T11:20:25.495337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:20.256651+0000","scrub_duration":0.0016789140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:46.745793+0000","last_change":"2024-04-26T11:19:46.745918+0000","last_active":"2024-04-26T11:19:46.745793+0000","last_peered":"2024-04-26T11:19:46.745793+0000","last_clean":"2024-04-26T11:19:46.745793+0000","last_became_active":"2024-04-26T11:19:24.202550+0000","last_became_peered":"2024-04-26T11:19:24.202550+0000","last_unstale":"2024-04-26T11:19:46.745793+0000","last_undegraded":"2024-04-26T11:19:46.745793+0000","last_fullsized":"2024-04-26T11:19:46.745793+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:46.745769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:46.745769+0000","last_clean_scrub_stamp":"2024-04-26T11:19:46.745769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:09.707603+0000","scrub_duration":0.001879981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:54.434747+0000","last_change":"2024-04-26T11:19:54.434856+0000","last_active":"2024-04-26T11:19:54.434747+0000","last_peered":"2024-04-26T11:19:54.434747+0000","last_clean":"2024-04-26T11:19:54.434747+0000","last_became_active":"2024-04-26T11:19:18.182186+0000","last_became_peered":"2024-04-26T11:19:18.182186+0000","last_unstale":"2024-04-26T11:19:54.434747+0000","last_undegraded":"2024-04-26T11:19:54.434747+0000","last_fullsized":"2024-04-26T11:19:54.434747+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:54.434725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:54.434725+0000","last_clean_scrub_stamp":"2024-04-26T11:19:54.434725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:50.801459+0000","scrub_duration":0.0020204099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"82'3","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:07.630037+0000","last_change":"2024-04-26T11:20:07.630175+0000","last_active":"2024-04-26T11:20:07.630037+0000","last_peered":"2024-04-26T11:20:07.630037+0000","last_clean":"2024-04-26T11:20:07.630037+0000","last_became_active":"2024-04-26T11:19:24.202310+0000","last_became_peered":"2024-04-26T11:19:24.202310+0000","last_unstale":"2024-04-26T11:20:07.630037+0000","last_undegraded":"2024-04-26T11:20:07.630037+0000","last_fullsized":"2024-04-26T11:20:07.630037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T11:20:07.629975+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T11:20:07.629975+0000","last_clean_scrub_stamp":"2024-04-26T11:20:07.629975+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:21.316423+0000","scrub_duration":0.003499748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:51.377084+0000","last_change":"2024-04-26T11:20:51.377182+0000","last_active":"2024-04-26T11:20:51.377084+0000","last_peered":"2024-04-26T11:20:51.377084+0000","last_clean":"2024-04-26T11:20:51.377084+0000","last_became_active":"2024-04-26T11:19:24.202566+0000","last_became_peered":"2024-04-26T11:19:24.202566+0000","last_unstale":"2024-04-26T11:20:51.377084+0000","last_undegraded":"2024-04-26T11:20:51.377084+0000","last_fullsized":"2024-04-26T11:20:51.377084+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:51.377062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:51.377062+0000","last_clean_scrub_stamp":"2024-04-26T11:20:51.377062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:04.643281+0000","scrub_duration":0.0017230380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":67,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:32.490476+0000","last_change":"2024-04-26T11:20:32.490476+0000","last_active":"2024-04-26T11:20:32.490476+0000","last_peered":"2024-04-26T11:20:32.490476+0000","last_clean":"2024-04-26T11:20:32.490476+0000","last_became_active":"2024-04-26T11:19:24.197383+0000","last_became_peered":"2024-04-26T11:19:24.197383+0000","last_unstale":"2024-04-26T11:20:32.490476+0000","last_undegraded":"2024-04-26T11:20:32.490476+0000","last_fullsized":"2024-04-26T11:20:32.490476+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:32.490343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:32.490343+0000","last_clean_scrub_stamp":"2024-04-26T11:20:32.490343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:02.161571+0000","scrub_duration":0.001683667,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:39.707630+0000","last_change":"2024-04-26T11:20:39.707737+0000","last_active":"2024-04-26T11:20:39.707630+0000","last_peered":"2024-04-26T11:20:39.707630+0000","last_clean":"2024-04-26T11:20:39.707630+0000","last_became_active":"2024-04-26T11:19:18.180871+0000","last_became_peered":"2024-04-26T11:19:18.180871+0000","last_unstale":"2024-04-26T11:20:39.707630+0000","last_undegraded":"2024-04-26T11:20:39.707630+0000","last_fullsized":"2024-04-26T11:20:39.707630+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:39.707608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:39.707608+0000","last_clean_scrub_stamp":"2024-04-26T11:20:39.707608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:18.685169+0000","scrub_duration":0.0020719089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"82'2","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:21.514790+0000","last_change":"2024-04-26T11:20:21.514923+0000","last_active":"2024-04-26T11:20:21.514790+0000","last_peered":"2024-04-26T11:20:21.514790+0000","last_clean":"2024-04-26T11:20:21.514790+0000","last_became_active":"2024-04-26T11:19:24.198853+0000","last_became_peered":"2024-04-26T11:19:24.198853+0000","last_unstale":"2024-04-26T11:20:21.514790+0000","last_undegraded":"2024-04-26T11:20:21.514790+0000","last_fullsized":"2024-04-26T11:20:21.514790+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-26T11:20:21.514765+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-26T11:20:21.514765+0000","last_clean_scrub_stamp":"2024-04-26T11:20:21.514765+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:45.584635+0000","scrub_duration":0.0035848450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:08.427084+0000","last_change":"2024-04-26T11:20:08.427208+0000","last_active":"2024-04-26T11:20:08.427084+0000","last_peered":"2024-04-26T11:20:08.427084+0000","last_clean":"2024-04-26T11:20:08.427084+0000","last_became_active":"2024-04-26T11:19:18.182228+0000","last_became_peered":"2024-04-26T11:19:18.182228+0000","last_unstale":"2024-04-26T11:20:08.427084+0000","last_undegraded":"2024-04-26T11:20:08.427084+0000","last_fullsized":"2024-04-26T11:20:08.427084+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:08.427044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:08.427044+0000","last_clean_scrub_stamp":"2024-04-26T11:20:08.427044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:44.490541+0000","scrub_duration":0.0019152240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":123,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:35.449722+0000","last_change":"2024-04-26T11:20:35.449722+0000","last_active":"2024-04-26T11:20:35.449722+0000","last_peered":"2024-04-26T11:20:35.449722+0000","last_clean":"2024-04-26T11:20:35.449722+0000","last_became_active":"2024-04-26T11:19:18.182671+0000","last_became_peered":"2024-04-26T11:19:18.182671+0000","last_unstale":"2024-04-26T11:20:35.449722+0000","last_undegraded":"2024-04-26T11:20:35.449722+0000","last_fullsized":"2024-04-26T11:20:35.449722+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T11:20:35.449595+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T11:20:35.449595+0000","last_clean_scrub_stamp":"2024-04-26T11:20:35.449595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:17.465203+0000","scrub_duration":0.001749993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:58.458718+0000","last_change":"2024-04-26T11:19:58.458718+0000","last_active":"2024-04-26T11:19:58.458718+0000","last_peered":"2024-04-26T11:19:58.458718+0000","last_clean":"2024-04-26T11:19:58.458718+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:19:58.458718+0000","last_undegraded":"2024-04-26T11:19:58.458718+0000","last_fullsized":"2024-04-26T11:19:58.458718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:58.458587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:58.458587+0000","last_clean_scrub_stamp":"2024-04-26T11:19:58.458587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:28.129815+0000","scrub_duration":0.001786494,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"82'3","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:39.596075+0000","last_change":"2024-04-26T11:19:39.596215+0000","last_active":"2024-04-26T11:19:39.596075+0000","last_peered":"2024-04-26T11:19:39.596075+0000","last_clean":"2024-04-26T11:19:39.596075+0000","last_became_active":"2024-04-26T11:19:18.188177+0000","last_became_peered":"2024-04-26T11:19:18.188177+0000","last_unstale":"2024-04-26T11:19:39.596075+0000","last_undegraded":"2024-04-26T11:19:39.596075+0000","last_fullsized":"2024-04-26T11:19:39.596075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T11:19:39.596051+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T11:19:39.596051+0000","last_clean_scrub_stamp":"2024-04-26T11:19:39.596051+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:18.488192+0000","scrub_duration":0.0035445559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:38.600610+0000","last_change":"2024-04-26T11:19:38.600786+0000","last_active":"2024-04-26T11:19:38.600610+0000","last_peered":"2024-04-26T11:19:38.600610+0000","last_clean":"2024-04-26T11:19:38.600610+0000","last_became_active":"2024-04-26T11:19:18.185372+0000","last_became_peered":"2024-04-26T11:19:18.185372+0000","last_unstale":"2024-04-26T11:19:38.600610+0000","last_undegraded":"2024-04-26T11:19:38.600610+0000","last_fullsized":"2024-04-26T11:19:38.600610+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:38.600585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:38.600585+0000","last_clean_scrub_stamp":"2024-04-26T11:19:38.600585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:00.495830+0000","scrub_duration":0.026821652000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"82'3","reported_seq":122,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:17.493793+0000","last_change":"2024-04-26T11:20:17.493793+0000","last_active":"2024-04-26T11:20:17.493793+0000","last_peered":"2024-04-26T11:20:17.493793+0000","last_clean":"2024-04-26T11:20:17.493793+0000","last_became_active":"2024-04-26T11:19:18.190374+0000","last_became_peered":"2024-04-26T11:19:18.190374+0000","last_unstale":"2024-04-26T11:20:17.493793+0000","last_undegraded":"2024-04-26T11:20:17.493793+0000","last_fullsized":"2024-04-26T11:20:17.493793+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T11:20:17.493667+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T11:20:17.493667+0000","last_clean_scrub_stamp":"2024-04-26T11:20:17.493667+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:30.759887+0000","scrub_duration":0.0029392099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:21:06.333040+0000","last_change":"2024-04-26T11:21:06.333145+0000","last_active":"2024-04-26T11:21:06.333040+0000","last_peered":"2024-04-26T11:21:06.333040+0000","last_clean":"2024-04-26T11:21:06.333040+0000","last_became_active":"2024-04-26T11:19:18.189341+0000","last_became_peered":"2024-04-26T11:19:18.189341+0000","last_unstale":"2024-04-26T11:21:06.333040+0000","last_undegraded":"2024-04-26T11:21:06.333040+0000","last_fullsized":"2024-04-26T11:21:06.333040+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:06.333015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:06.333015+0000","last_clean_scrub_stamp":"2024-04-26T11:21:06.333015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:48.461252+0000","scrub_duration":0.0019475950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:55.290986+0000","last_change":"2024-04-26T11:20:55.291121+0000","last_active":"2024-04-26T11:20:55.290986+0000","last_peered":"2024-04-26T11:20:55.290986+0000","last_clean":"2024-04-26T11:20:55.290986+0000","last_became_active":"2024-04-26T11:19:24.202422+0000","last_became_peered":"2024-04-26T11:19:24.202422+0000","last_unstale":"2024-04-26T11:20:55.290986+0000","last_undegraded":"2024-04-26T11:20:55.290986+0000","last_fullsized":"2024-04-26T11:20:55.290986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T11:20:55.290943+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T11:20:55.290943+0000","last_clean_scrub_stamp":"2024-04-26T11:20:55.290943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:53:04.798120+0000","scrub_duration":0.0020602419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:47.394865+0000","last_change":"2024-04-26T11:20:47.394979+0000","last_active":"2024-04-26T11:20:47.394865+0000","last_peered":"2024-04-26T11:20:47.394865+0000","last_clean":"2024-04-26T11:20:47.394865+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:20:47.394865+0000","last_undegraded":"2024-04-26T11:20:47.394865+0000","last_fullsized":"2024-04-26T11:20:47.394865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:47.394841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:47.394841+0000","last_clean_scrub_stamp":"2024-04-26T11:20:47.394841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:25.800717+0000","scrub_duration":0.017573135,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:54.315559+0000","last_change":"2024-04-26T11:20:54.315559+0000","last_active":"2024-04-26T11:20:54.315559+0000","last_peered":"2024-04-26T11:20:54.315559+0000","last_clean":"2024-04-26T11:20:54.315559+0000","last_became_active":"2024-04-26T11:19:24.204129+0000","last_became_peered":"2024-04-26T11:19:24.204129+0000","last_unstale":"2024-04-26T11:20:54.315559+0000","last_undegraded":"2024-04-26T11:20:54.315559+0000","last_fullsized":"2024-04-26T11:20:54.315559+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'6","last_scrub_stamp":"2024-04-26T11:20:54.315408+0000","last_deep_scrub":"82'6","last_deep_scrub_stamp":"2024-04-26T11:20:54.315408+0000","last_clean_scrub_stamp":"2024-04-26T11:20:54.315408+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:02.082549+0000","scrub_duration":0.003676393,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:21:04.424983+0000","last_change":"2024-04-26T11:21:04.425086+0000","last_active":"2024-04-26T11:21:04.424983+0000","last_peered":"2024-04-26T11:21:04.424983+0000","last_clean":"2024-04-26T11:21:04.424983+0000","last_became_active":"2024-04-26T11:19:18.189179+0000","last_became_peered":"2024-04-26T11:19:18.189179+0000","last_unstale":"2024-04-26T11:21:04.424983+0000","last_undegraded":"2024-04-26T11:21:04.424983+0000","last_fullsized":"2024-04-26T11:21:04.424983+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:04.424959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:04.424959+0000","last_clean_scrub_stamp":"2024-04-26T11:21:04.424959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:38.691872+0000","scrub_duration":0.0021779529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:40.624649+0000","last_change":"2024-04-26T11:19:40.624780+0000","last_active":"2024-04-26T11:19:40.624649+0000","last_peered":"2024-04-26T11:19:40.624649+0000","last_clean":"2024-04-26T11:19:40.624649+0000","last_became_active":"2024-04-26T11:19:18.188963+0000","last_became_peered":"2024-04-26T11:19:18.188963+0000","last_unstale":"2024-04-26T11:19:40.624649+0000","last_undegraded":"2024-04-26T11:19:40.624649+0000","last_fullsized":"2024-04-26T11:19:40.624649+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:40.624624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:40.624624+0000","last_clean_scrub_stamp":"2024-04-26T11:19:40.624624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:51.952842+0000","scrub_duration":0.0017518169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:04.580384+0000","last_change":"2024-04-26T11:20:04.580503+0000","last_active":"2024-04-26T11:20:04.580384+0000","last_peered":"2024-04-26T11:20:04.580384+0000","last_clean":"2024-04-26T11:20:04.580384+0000","last_became_active":"2024-04-26T11:19:24.198397+0000","last_became_peered":"2024-04-26T11:19:24.198397+0000","last_unstale":"2024-04-26T11:20:04.580384+0000","last_undegraded":"2024-04-26T11:20:04.580384+0000","last_fullsized":"2024-04-26T11:20:04.580384+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:04.580360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:04.580360+0000","last_clean_scrub_stamp":"2024-04-26T11:20:04.580360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:29.686078+0000","scrub_duration":0.0018333259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:21:03.268542+0000","last_change":"2024-04-26T11:21:03.268662+0000","last_active":"2024-04-26T11:21:03.268542+0000","last_peered":"2024-04-26T11:21:03.268542+0000","last_clean":"2024-04-26T11:21:03.268542+0000","last_became_active":"2024-04-26T11:19:18.183037+0000","last_became_peered":"2024-04-26T11:19:18.183037+0000","last_unstale":"2024-04-26T11:21:03.268542+0000","last_undegraded":"2024-04-26T11:21:03.268542+0000","last_fullsized":"2024-04-26T11:21:03.268542+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:03.268519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:03.268519+0000","last_clean_scrub_stamp":"2024-04-26T11:21:03.268519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:46.876508+0000","scrub_duration":0.00191289,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:55.673443+0000","last_change":"2024-04-26T11:19:55.673586+0000","last_active":"2024-04-26T11:19:55.673443+0000","last_peered":"2024-04-26T11:19:55.673443+0000","last_clean":"2024-04-26T11:19:55.673443+0000","last_became_active":"2024-04-26T11:19:24.202442+0000","last_became_peered":"2024-04-26T11:19:24.202442+0000","last_unstale":"2024-04-26T11:19:55.673443+0000","last_undegraded":"2024-04-26T11:19:55.673443+0000","last_fullsized":"2024-04-26T11:19:55.673443+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:55.673417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:55.673417+0000","last_clean_scrub_stamp":"2024-04-26T11:19:55.673417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:51.687827+0000","scrub_duration":0.029303546,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:51.420225+0000","last_change":"2024-04-26T11:19:51.420347+0000","last_active":"2024-04-26T11:19:51.420225+0000","last_peered":"2024-04-26T11:19:51.420225+0000","last_clean":"2024-04-26T11:19:51.420225+0000","last_became_active":"2024-04-26T11:19:18.184384+0000","last_became_peered":"2024-04-26T11:19:18.184384+0000","last_unstale":"2024-04-26T11:19:51.420225+0000","last_undegraded":"2024-04-26T11:19:51.420225+0000","last_fullsized":"2024-04-26T11:19:51.420225+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:51.420205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:51.420205+0000","last_clean_scrub_stamp":"2024-04-26T11:19:51.420205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:55.572118+0000","scrub_duration":0.001998835,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7958,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738468,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281144,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94090696,"statfs":{"total":96636764160,"available":96348872704,"internally_reserved":0,"allocated":1490944,"data_stored":947441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:20:19 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.496}]},{"osd":1,"last update":"Fri Apr 26 11:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44500000000000001,"15min":0.40300000000000002},"min":{"1min":0.34599999999999997,"5min":0.20000000000000001,"15min":0.17199999999999999},"max":{"1min":0.56599999999999995,"5min":0.96499999999999997,"15min":2.1320000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45200000000000001,"15min":0.45500000000000002},"min":{"1min":0.34899999999999998,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.61599999999999999,"5min":0.85599999999999998,"15min":1.9750000000000001},"last":0.45300000000000001}]}]},{"osd":0,"up_from":75,"seq":322122547226,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38148,"kb_used_data":1468,"kb_used_omap":10,"kb_used_meta":36661,"kb_avail":94333692,"statfs":{"total":96636764160,"available":96597700608,"internally_reserved":0,"allocated":1503232,"data_stored":949168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11228,"internal_metadata":37540900},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 11:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.432}]},{"osd":2,"last update":"Fri Apr 26 11:20:18 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.442}]}]},{"osd":1,"up_from":8,"seq":34359738469,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401128,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":400254,"kb_avail":93970712,"statfs":{"total":96636764160,"available":96226009088,"internally_reserved":0,"allocated":884736,"data_stored":357054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":409860550},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:20:17 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.498}]},{"osd":2,"last update":"Fri Apr 26 11:20:17 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44800000000000001,"15min":0.41199999999999998},"min":{"1min":0.29399999999999998,"5min":0.14999999999999999,"15min":0.14999999999999999},"max":{"1min":0.65400000000000003,"5min":0.69199999999999995,"15min":2.056},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.51000000000000001,"15min":0.46500000000000002},"min":{"1min":0.33000000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.60299999999999998,"5min":3.9609999999999999,"15min":3.9609999999999999},"last":0.51700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7958,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:21:17.582 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T11:13:12.471344+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=13, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=19, tm_sec=32, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:21:17.583 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T11:21:37.585 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:21:37.943 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:21:37.945 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-04-26T11:21:37.954 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2024-04-26T11:21:36.593716+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":720420,"kb_used_data":3788,"kb_used_omap":14,"kb_used_meta":716593,"kb_avail":282395100,"statfs":{"total":289910292480,"available":289172582400,"internally_reserved":0,"allocated":3878912,"data_stored":2253663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14416,"internal_metadata":733792176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003118"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:21:06.378171+0000","last_change":"2024-04-26T11:21:06.378299+0000","last_active":"2024-04-26T11:21:06.378171+0000","last_peered":"2024-04-26T11:21:06.378171+0000","last_clean":"2024-04-26T11:21:06.378171+0000","last_became_active":"2024-04-26T11:13:12.918849+0000","last_became_peered":"2024-04-26T11:13:12.918849+0000","last_unstale":"2024-04-26T11:21:06.378171+0000","last_undegraded":"2024-04-26T11:21:06.378171+0000","last_fullsized":"2024-04-26T11:21:06.378171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:06.378149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:06.378149+0000","last_clean_scrub_stamp":"2024-04-26T11:21:06.378149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:13.936826+0000","scrub_duration":0.077886994000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:21:10.392342+0000","last_change":"2024-04-26T11:21:10.392450+0000","last_active":"2024-04-26T11:21:10.392342+0000","last_peered":"2024-04-26T11:21:10.392342+0000","last_clean":"2024-04-26T11:21:10.392342+0000","last_became_active":"2024-04-26T11:13:12.916740+0000","last_became_peered":"2024-04-26T11:13:12.916740+0000","last_unstale":"2024-04-26T11:21:10.392342+0000","last_undegraded":"2024-04-26T11:21:10.392342+0000","last_fullsized":"2024-04-26T11:21:10.392342+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:10.392317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:10.392317+0000","last_clean_scrub_stamp":"2024-04-26T11:21:10.392317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:36.754365+0000","scrub_duration":0.002016079,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:56.634367+0000","last_change":"2024-04-26T11:20:56.634367+0000","last_active":"2024-04-26T11:20:56.634367+0000","last_peered":"2024-04-26T11:20:56.634367+0000","last_clean":"2024-04-26T11:20:56.634367+0000","last_became_active":"2024-04-26T11:19:18.182972+0000","last_became_peered":"2024-04-26T11:19:18.182972+0000","last_unstale":"2024-04-26T11:20:56.634367+0000","last_undegraded":"2024-04-26T11:20:56.634367+0000","last_fullsized":"2024-04-26T11:20:56.634367+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:56.634226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:56.634226+0000","last_clean_scrub_stamp":"2024-04-26T11:20:56.634226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:57:10.682874+0000","scrub_duration":0.0018384880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:43.746595+0000","last_change":"2024-04-26T11:20:43.746595+0000","last_active":"2024-04-26T11:20:43.746595+0000","last_peered":"2024-04-26T11:20:43.746595+0000","last_clean":"2024-04-26T11:20:43.746595+0000","last_became_active":"2024-04-26T11:19:18.182942+0000","last_became_peered":"2024-04-26T11:19:18.182942+0000","last_unstale":"2024-04-26T11:20:43.746595+0000","last_undegraded":"2024-04-26T11:20:43.746595+0000","last_fullsized":"2024-04-26T11:20:43.746595+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:43.746467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:43.746467+0000","last_clean_scrub_stamp":"2024-04-26T11:20:43.746467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:50.125560+0000","scrub_duration":0.0019204280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:50.418051+0000","last_change":"2024-04-26T11:19:50.418051+0000","last_active":"2024-04-26T11:19:50.418051+0000","last_peered":"2024-04-26T11:19:50.418051+0000","last_clean":"2024-04-26T11:19:50.418051+0000","last_became_active":"2024-04-26T11:13:12.916434+0000","last_became_peered":"2024-04-26T11:13:12.916434+0000","last_unstale":"2024-04-26T11:19:50.418051+0000","last_undegraded":"2024-04-26T11:19:50.418051+0000","last_fullsized":"2024-04-26T11:19:50.418051+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:50.417924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:50.417924+0000","last_clean_scrub_stamp":"2024-04-26T11:19:50.417924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:25.937563+0000","scrub_duration":0.016392371999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:59.552842+0000","last_change":"2024-04-26T11:20:59.552984+0000","last_active":"2024-04-26T11:20:59.552842+0000","last_peered":"2024-04-26T11:20:59.552842+0000","last_clean":"2024-04-26T11:20:59.552842+0000","last_became_active":"2024-04-26T11:19:18.188990+0000","last_became_peered":"2024-04-26T11:19:18.188990+0000","last_unstale":"2024-04-26T11:20:59.552842+0000","last_undegraded":"2024-04-26T11:20:59.552842+0000","last_fullsized":"2024-04-26T11:20:59.552842+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:59.552784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:59.552784+0000","last_clean_scrub_stamp":"2024-04-26T11:20:59.552784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:42.998804+0000","scrub_duration":0.0018923360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:45.509116+0000","last_change":"2024-04-26T11:19:45.509220+0000","last_active":"2024-04-26T11:19:45.509116+0000","last_peered":"2024-04-26T11:19:45.509116+0000","last_clean":"2024-04-26T11:19:45.509116+0000","last_became_active":"2024-04-26T11:19:18.186638+0000","last_became_peered":"2024-04-26T11:19:18.186638+0000","last_unstale":"2024-04-26T11:19:45.509116+0000","last_undegraded":"2024-04-26T11:19:45.509116+0000","last_fullsized":"2024-04-26T11:19:45.509116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:45.509090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:45.509090+0000","last_clean_scrub_stamp":"2024-04-26T11:19:45.509090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:05.567613+0000","scrub_duration":0.017637363999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:23.683390+0000","last_change":"2024-04-26T11:20:23.683509+0000","last_active":"2024-04-26T11:20:23.683390+0000","last_peered":"2024-04-26T11:20:23.683390+0000","last_clean":"2024-04-26T11:20:23.683390+0000","last_became_active":"2024-04-26T11:19:18.182111+0000","last_became_peered":"2024-04-26T11:19:18.182111+0000","last_unstale":"2024-04-26T11:20:23.683390+0000","last_undegraded":"2024-04-26T11:20:23.683390+0000","last_fullsized":"2024-04-26T11:20:23.683390+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:23.683352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:23.683352+0000","last_clean_scrub_stamp":"2024-04-26T11:20:23.683352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:43:37.939942+0000","scrub_duration":0.001634702,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:42.411970+0000","last_change":"2024-04-26T11:20:42.412117+0000","last_active":"2024-04-26T11:20:42.411970+0000","last_peered":"2024-04-26T11:20:42.411970+0000","last_clean":"2024-04-26T11:20:42.411970+0000","last_became_active":"2024-04-26T11:19:24.202146+0000","last_became_peered":"2024-04-26T11:19:24.202146+0000","last_unstale":"2024-04-26T11:20:42.411970+0000","last_undegraded":"2024-04-26T11:20:42.411970+0000","last_fullsized":"2024-04-26T11:20:42.411970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:42.411946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:42.411946+0000","last_clean_scrub_stamp":"2024-04-26T11:20:42.411946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:18.475443+0000","scrub_duration":0.029462447999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:44.426458+0000","last_change":"2024-04-26T11:20:44.426546+0000","last_active":"2024-04-26T11:20:44.426458+0000","last_peered":"2024-04-26T11:20:44.426458+0000","last_clean":"2024-04-26T11:20:44.426458+0000","last_became_active":"2024-04-26T11:13:12.916913+0000","last_became_peered":"2024-04-26T11:13:12.916913+0000","last_unstale":"2024-04-26T11:20:44.426458+0000","last_undegraded":"2024-04-26T11:20:44.426458+0000","last_fullsized":"2024-04-26T11:20:44.426458+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:44.426436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:44.426436+0000","last_clean_scrub_stamp":"2024-04-26T11:20:44.426436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:53.146087+0000","scrub_duration":0.001820412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:52.515823+0000","last_change":"2024-04-26T11:19:52.515987+0000","last_active":"2024-04-26T11:19:52.515823+0000","last_peered":"2024-04-26T11:19:52.515823+0000","last_clean":"2024-04-26T11:19:52.515823+0000","last_became_active":"2024-04-26T11:19:18.185543+0000","last_became_peered":"2024-04-26T11:19:18.185543+0000","last_unstale":"2024-04-26T11:19:52.515823+0000","last_undegraded":"2024-04-26T11:19:52.515823+0000","last_fullsized":"2024-04-26T11:19:52.515823+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:52.515775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:52.515775+0000","last_clean_scrub_stamp":"2024-04-26T11:19:52.515775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:58.954162+0000","scrub_duration":0.016652819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:21:15.337802+0000","last_change":"2024-04-26T11:21:15.337920+0000","last_active":"2024-04-26T11:21:15.337802+0000","last_peered":"2024-04-26T11:21:15.337802+0000","last_clean":"2024-04-26T11:21:15.337802+0000","last_became_active":"2024-04-26T11:19:18.182827+0000","last_became_peered":"2024-04-26T11:19:18.182827+0000","last_unstale":"2024-04-26T11:21:15.337802+0000","last_undegraded":"2024-04-26T11:21:15.337802+0000","last_fullsized":"2024-04-26T11:21:15.337802+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:15.337756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:15.337756+0000","last_clean_scrub_stamp":"2024-04-26T11:21:15.337756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:21.413606+0000","scrub_duration":0.0019559209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.499190+0000","last_change":"2024-04-26T11:19:35.499190+0000","last_active":"2024-04-26T11:19:35.499190+0000","last_peered":"2024-04-26T11:19:35.499190+0000","last_clean":"2024-04-26T11:19:35.499190+0000","last_became_active":"2024-04-26T11:13:12.914558+0000","last_became_peered":"2024-04-26T11:13:12.914558+0000","last_unstale":"2024-04-26T11:19:35.499190+0000","last_undegraded":"2024-04-26T11:19:35.499190+0000","last_fullsized":"2024-04-26T11:19:35.499190+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:35.499030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:35.499030+0000","last_clean_scrub_stamp":"2024-04-26T11:19:35.499030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:54:49.185477+0000","scrub_duration":0.018123878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:41.594000+0000","last_change":"2024-04-26T11:19:41.594000+0000","last_active":"2024-04-26T11:19:41.594000+0000","last_peered":"2024-04-26T11:19:41.594000+0000","last_clean":"2024-04-26T11:19:41.594000+0000","last_became_active":"2024-04-26T11:19:18.180865+0000","last_became_peered":"2024-04-26T11:19:18.180865+0000","last_unstale":"2024-04-26T11:19:41.594000+0000","last_undegraded":"2024-04-26T11:19:41.594000+0000","last_fullsized":"2024-04-26T11:19:41.594000+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:41.593880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:41.593880+0000","last_clean_scrub_stamp":"2024-04-26T11:19:41.593880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:56.201582+0000","scrub_duration":0.0019243019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:51.517460+0000","last_change":"2024-04-26T11:19:51.517460+0000","last_active":"2024-04-26T11:19:51.517460+0000","last_peered":"2024-04-26T11:19:51.517460+0000","last_clean":"2024-04-26T11:19:51.517460+0000","last_became_active":"2024-04-26T11:19:18.180763+0000","last_became_peered":"2024-04-26T11:19:18.180763+0000","last_unstale":"2024-04-26T11:19:51.517460+0000","last_undegraded":"2024-04-26T11:19:51.517460+0000","last_fullsized":"2024-04-26T11:19:51.517460+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:51.517314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:51.517314+0000","last_clean_scrub_stamp":"2024-04-26T11:19:51.517314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:47:38.185008+0000","scrub_duration":0.0020719620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:07.533355+0000","last_change":"2024-04-26T11:20:07.533355+0000","last_active":"2024-04-26T11:20:07.533355+0000","last_peered":"2024-04-26T11:20:07.533355+0000","last_clean":"2024-04-26T11:20:07.533355+0000","last_became_active":"2024-04-26T11:19:18.184331+0000","last_became_peered":"2024-04-26T11:19:18.184331+0000","last_unstale":"2024-04-26T11:20:07.533355+0000","last_undegraded":"2024-04-26T11:20:07.533355+0000","last_fullsized":"2024-04-26T11:20:07.533355+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:07.533200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:07.533200+0000","last_clean_scrub_stamp":"2024-04-26T11:20:07.533200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:50.283609+0000","scrub_duration":0.0016781039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:20.582602+0000","last_change":"2024-04-26T11:20:20.582731+0000","last_active":"2024-04-26T11:20:20.582602+0000","last_peered":"2024-04-26T11:20:20.582602+0000","last_clean":"2024-04-26T11:20:20.582602+0000","last_became_active":"2024-04-26T11:19:24.203764+0000","last_became_peered":"2024-04-26T11:19:24.203764+0000","last_unstale":"2024-04-26T11:20:20.582602+0000","last_undegraded":"2024-04-26T11:20:20.582602+0000","last_fullsized":"2024-04-26T11:20:20.582602+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:20.582577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:20.582577+0000","last_clean_scrub_stamp":"2024-04-26T11:20:20.582577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:06.502392+0000","scrub_duration":0.083132415000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:43.423762+0000","last_change":"2024-04-26T11:19:43.423762+0000","last_active":"2024-04-26T11:19:43.423762+0000","last_peered":"2024-04-26T11:19:43.423762+0000","last_clean":"2024-04-26T11:19:43.423762+0000","last_became_active":"2024-04-26T11:13:12.917984+0000","last_became_peered":"2024-04-26T11:13:12.917984+0000","last_unstale":"2024-04-26T11:19:43.423762+0000","last_undegraded":"2024-04-26T11:19:43.423762+0000","last_fullsized":"2024-04-26T11:19:43.423762+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:43.423617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:43.423617+0000","last_clean_scrub_stamp":"2024-04-26T11:19:43.423617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:58.420909+0000","scrub_duration":0.0017194790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:23.537391+0000","last_change":"2024-04-26T11:20:23.537545+0000","last_active":"2024-04-26T11:20:23.537391+0000","last_peered":"2024-04-26T11:20:23.537391+0000","last_clean":"2024-04-26T11:20:23.537391+0000","last_became_active":"2024-04-26T11:19:24.199142+0000","last_became_peered":"2024-04-26T11:19:24.199142+0000","last_unstale":"2024-04-26T11:20:23.537391+0000","last_undegraded":"2024-04-26T11:20:23.537391+0000","last_fullsized":"2024-04-26T11:20:23.537391+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:23.537367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:23.537367+0000","last_clean_scrub_stamp":"2024-04-26T11:20:23.537367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:03.679558+0000","scrub_duration":0.029516655999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:42.569936+0000","last_change":"2024-04-26T11:19:42.569936+0000","last_active":"2024-04-26T11:19:42.569936+0000","last_peered":"2024-04-26T11:19:42.569936+0000","last_clean":"2024-04-26T11:19:42.569936+0000","last_became_active":"2024-04-26T11:19:18.184282+0000","last_became_peered":"2024-04-26T11:19:18.184282+0000","last_unstale":"2024-04-26T11:19:42.569936+0000","last_undegraded":"2024-04-26T11:19:42.569936+0000","last_fullsized":"2024-04-26T11:19:42.569936+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:42.569760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:42.569760+0000","last_clean_scrub_stamp":"2024-04-26T11:19:42.569760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:04:17.239747+0000","scrub_duration":0.0018614059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:44.771866+0000","last_change":"2024-04-26T11:20:44.771866+0000","last_active":"2024-04-26T11:20:44.771866+0000","last_peered":"2024-04-26T11:20:44.771866+0000","last_clean":"2024-04-26T11:20:44.771866+0000","last_became_active":"2024-04-26T11:19:18.186605+0000","last_became_peered":"2024-04-26T11:19:18.186605+0000","last_unstale":"2024-04-26T11:20:44.771866+0000","last_undegraded":"2024-04-26T11:20:44.771866+0000","last_fullsized":"2024-04-26T11:20:44.771866+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:44.771678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:44.771678+0000","last_clean_scrub_stamp":"2024-04-26T11:20:44.771678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:03.023486+0000","scrub_duration":0.022587506,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:59.494778+0000","last_change":"2024-04-26T11:19:59.494778+0000","last_active":"2024-04-26T11:19:59.494778+0000","last_peered":"2024-04-26T11:19:59.494778+0000","last_clean":"2024-04-26T11:19:59.494778+0000","last_became_active":"2024-04-26T11:19:18.181728+0000","last_became_peered":"2024-04-26T11:19:18.181728+0000","last_unstale":"2024-04-26T11:19:59.494778+0000","last_undegraded":"2024-04-26T11:19:59.494778+0000","last_fullsized":"2024-04-26T11:19:59.494778+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:59.494616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:59.494616+0000","last_clean_scrub_stamp":"2024-04-26T11:19:59.494616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:50:32.682411+0000","scrub_duration":0.001815215,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:27.592038+0000","last_change":"2024-04-26T11:20:27.592160+0000","last_active":"2024-04-26T11:20:27.592038+0000","last_peered":"2024-04-26T11:20:27.592038+0000","last_clean":"2024-04-26T11:20:27.592038+0000","last_became_active":"2024-04-26T11:19:24.197487+0000","last_became_peered":"2024-04-26T11:19:24.197487+0000","last_unstale":"2024-04-26T11:20:27.592038+0000","last_undegraded":"2024-04-26T11:20:27.592038+0000","last_fullsized":"2024-04-26T11:20:27.592038+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:27.592000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:27.592000+0000","last_clean_scrub_stamp":"2024-04-26T11:20:27.592000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:52:21.837181+0000","scrub_duration":0.0016673460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:48.396499+0000","last_change":"2024-04-26T11:19:48.396656+0000","last_active":"2024-04-26T11:19:48.396499+0000","last_peered":"2024-04-26T11:19:48.396499+0000","last_clean":"2024-04-26T11:19:48.396499+0000","last_became_active":"2024-04-26T11:13:12.912140+0000","last_became_peered":"2024-04-26T11:13:12.912140+0000","last_unstale":"2024-04-26T11:19:48.396499+0000","last_undegraded":"2024-04-26T11:19:48.396499+0000","last_fullsized":"2024-04-26T11:19:48.396499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:48.396472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:48.396472+0000","last_clean_scrub_stamp":"2024-04-26T11:19:48.396472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:16.773782+0000","scrub_duration":0.0019312940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:19.512918+0000","last_change":"2024-04-26T11:20:19.513110+0000","last_active":"2024-04-26T11:20:19.512918+0000","last_peered":"2024-04-26T11:20:19.512918+0000","last_clean":"2024-04-26T11:20:19.512918+0000","last_became_active":"2024-04-26T11:19:18.184451+0000","last_became_peered":"2024-04-26T11:19:18.184451+0000","last_unstale":"2024-04-26T11:20:19.512918+0000","last_undegraded":"2024-04-26T11:20:19.512918+0000","last_fullsized":"2024-04-26T11:20:19.512918+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:19.512881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:19.512881+0000","last_clean_scrub_stamp":"2024-04-26T11:20:19.512881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:33.563886+0000","scrub_duration":0.023492367,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:08.595129+0000","last_change":"2024-04-26T11:20:08.595253+0000","last_active":"2024-04-26T11:20:08.595129+0000","last_peered":"2024-04-26T11:20:08.595129+0000","last_clean":"2024-04-26T11:20:08.595129+0000","last_became_active":"2024-04-26T11:19:24.198479+0000","last_became_peered":"2024-04-26T11:19:24.198479+0000","last_unstale":"2024-04-26T11:20:08.595129+0000","last_undegraded":"2024-04-26T11:20:08.595129+0000","last_fullsized":"2024-04-26T11:20:08.595129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:08.595106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:08.595106+0000","last_clean_scrub_stamp":"2024-04-26T11:20:08.595106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:11:18.295964+0000","scrub_duration":0.0021262659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:13.621938+0000","last_change":"2024-04-26T11:20:13.621938+0000","last_active":"2024-04-26T11:20:13.621938+0000","last_peered":"2024-04-26T11:20:13.621938+0000","last_clean":"2024-04-26T11:20:13.621938+0000","last_became_active":"2024-04-26T11:19:18.185105+0000","last_became_peered":"2024-04-26T11:19:18.185105+0000","last_unstale":"2024-04-26T11:20:13.621938+0000","last_undegraded":"2024-04-26T11:20:13.621938+0000","last_fullsized":"2024-04-26T11:20:13.621938+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:13.621769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:13.621769+0000","last_clean_scrub_stamp":"2024-04-26T11:20:13.621769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:26.915580+0000","scrub_duration":0.0020478789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:40.405429+0000","last_change":"2024-04-26T11:20:40.405429+0000","last_active":"2024-04-26T11:20:40.405429+0000","last_peered":"2024-04-26T11:20:40.405429+0000","last_clean":"2024-04-26T11:20:40.405429+0000","last_became_active":"2024-04-26T11:13:12.492675+0000","last_became_peered":"2024-04-26T11:13:12.492675+0000","last_unstale":"2024-04-26T11:20:40.405429+0000","last_undegraded":"2024-04-26T11:20:40.405429+0000","last_fullsized":"2024-04-26T11:20:40.405429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T11:20:40.405289+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T11:20:40.405289+0000","last_clean_scrub_stamp":"2024-04-26T11:20:40.405289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:22:32.550379+0000","scrub_duration":0.001668409,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:43.408650+0000","last_change":"2024-04-26T11:20:43.408650+0000","last_active":"2024-04-26T11:20:43.408650+0000","last_peered":"2024-04-26T11:20:43.408650+0000","last_clean":"2024-04-26T11:20:43.408650+0000","last_became_active":"2024-04-26T11:19:18.190792+0000","last_became_peered":"2024-04-26T11:19:18.190792+0000","last_unstale":"2024-04-26T11:20:43.408650+0000","last_undegraded":"2024-04-26T11:20:43.408650+0000","last_fullsized":"2024-04-26T11:20:43.408650+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:43.408434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:43.408434+0000","last_clean_scrub_stamp":"2024-04-26T11:20:43.408434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:27.015116+0000","scrub_duration":0.0017783230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":67,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:35.667261+0000","last_change":"2024-04-26T11:19:35.667355+0000","last_active":"2024-04-26T11:19:35.667261+0000","last_peered":"2024-04-26T11:19:35.667261+0000","last_clean":"2024-04-26T11:19:35.667261+0000","last_became_active":"2024-04-26T11:19:24.202348+0000","last_became_peered":"2024-04-26T11:19:24.202348+0000","last_unstale":"2024-04-26T11:19:35.667261+0000","last_undegraded":"2024-04-26T11:19:35.667261+0000","last_fullsized":"2024-04-26T11:19:35.667261+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:35.667237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:35.667237+0000","last_clean_scrub_stamp":"2024-04-26T11:19:35.667237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:38.776469+0000","scrub_duration":0.0019697669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:44.767086+0000","last_change":"2024-04-26T11:19:44.767086+0000","last_active":"2024-04-26T11:19:44.767086+0000","last_peered":"2024-04-26T11:19:44.767086+0000","last_clean":"2024-04-26T11:19:44.767086+0000","last_became_active":"2024-04-26T11:19:24.198920+0000","last_became_peered":"2024-04-26T11:19:24.198920+0000","last_unstale":"2024-04-26T11:19:44.767086+0000","last_undegraded":"2024-04-26T11:19:44.767086+0000","last_fullsized":"2024-04-26T11:19:44.767086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:44.766950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:44.766950+0000","last_clean_scrub_stamp":"2024-04-26T11:19:44.766950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:58:30.054801+0000","scrub_duration":0.0017451579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:47.408691+0000","last_change":"2024-04-26T11:20:47.408795+0000","last_active":"2024-04-26T11:20:47.408691+0000","last_peered":"2024-04-26T11:20:47.408691+0000","last_clean":"2024-04-26T11:20:47.408691+0000","last_became_active":"2024-04-26T11:19:24.197698+0000","last_became_peered":"2024-04-26T11:19:24.197698+0000","last_unstale":"2024-04-26T11:20:47.408691+0000","last_undegraded":"2024-04-26T11:20:47.408691+0000","last_fullsized":"2024-04-26T11:20:47.408691+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:47.408667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:47.408667+0000","last_clean_scrub_stamp":"2024-04-26T11:20:47.408667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:10.833863+0000","scrub_duration":0.00179385,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":119,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:47.503709+0000","last_change":"2024-04-26T11:19:47.503709+0000","last_active":"2024-04-26T11:19:47.503709+0000","last_peered":"2024-04-26T11:19:47.503709+0000","last_clean":"2024-04-26T11:19:47.503709+0000","last_became_active":"2024-04-26T11:19:18.190127+0000","last_became_peered":"2024-04-26T11:19:18.190127+0000","last_unstale":"2024-04-26T11:19:47.503709+0000","last_undegraded":"2024-04-26T11:19:47.503709+0000","last_fullsized":"2024-04-26T11:19:47.503709+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:47.503550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:47.503550+0000","last_clean_scrub_stamp":"2024-04-26T11:19:47.503550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:33.423364+0000","scrub_duration":0.064283446999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:57.240578+0000","last_change":"2024-04-26T11:20:57.240696+0000","last_active":"2024-04-26T11:20:57.240578+0000","last_peered":"2024-04-26T11:20:57.240578+0000","last_clean":"2024-04-26T11:20:57.240578+0000","last_became_active":"2024-04-26T11:19:24.204122+0000","last_became_peered":"2024-04-26T11:19:24.204122+0000","last_unstale":"2024-04-26T11:20:57.240578+0000","last_undegraded":"2024-04-26T11:20:57.240578+0000","last_fullsized":"2024-04-26T11:20:57.240578+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:57.240554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:57.240554+0000","last_clean_scrub_stamp":"2024-04-26T11:20:57.240554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:52.001868+0000","scrub_duration":0.001840721,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:24.473040+0000","last_change":"2024-04-26T11:20:24.473172+0000","last_active":"2024-04-26T11:20:24.473040+0000","last_peered":"2024-04-26T11:20:24.473040+0000","last_clean":"2024-04-26T11:20:24.473040+0000","last_became_active":"2024-04-26T11:19:24.197247+0000","last_became_peered":"2024-04-26T11:19:24.197247+0000","last_unstale":"2024-04-26T11:20:24.473040+0000","last_undegraded":"2024-04-26T11:20:24.473040+0000","last_fullsized":"2024-04-26T11:20:24.473040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:24.473016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:24.473016+0000","last_clean_scrub_stamp":"2024-04-26T11:20:24.473016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:47:59.992655+0000","scrub_duration":0.001721656,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:19.633755+0000","last_change":"2024-04-26T11:20:19.633856+0000","last_active":"2024-04-26T11:20:19.633755+0000","last_peered":"2024-04-26T11:20:19.633755+0000","last_clean":"2024-04-26T11:20:19.633755+0000","last_became_active":"2024-04-26T11:19:18.185578+0000","last_became_peered":"2024-04-26T11:19:18.185578+0000","last_unstale":"2024-04-26T11:20:19.633755+0000","last_undegraded":"2024-04-26T11:20:19.633755+0000","last_fullsized":"2024-04-26T11:20:19.633755+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:19.633732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:19.633732+0000","last_clean_scrub_stamp":"2024-04-26T11:20:19.633732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:47.795228+0000","scrub_duration":0.001874459,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:05.541862+0000","last_change":"2024-04-26T11:20:05.541862+0000","last_active":"2024-04-26T11:20:05.541862+0000","last_peered":"2024-04-26T11:20:05.541862+0000","last_clean":"2024-04-26T11:20:05.541862+0000","last_became_active":"2024-04-26T11:19:24.200992+0000","last_became_peered":"2024-04-26T11:19:24.200992+0000","last_unstale":"2024-04-26T11:20:05.541862+0000","last_undegraded":"2024-04-26T11:20:05.541862+0000","last_fullsized":"2024-04-26T11:20:05.541862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:05.541702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:05.541702+0000","last_clean_scrub_stamp":"2024-04-26T11:20:05.541702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:43.691758+0000","scrub_duration":0.001648708,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"82'5","reported_seq":124,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:31.500638+0000","last_change":"2024-04-26T11:20:31.500638+0000","last_active":"2024-04-26T11:20:31.500638+0000","last_peered":"2024-04-26T11:20:31.500638+0000","last_clean":"2024-04-26T11:20:31.500638+0000","last_became_active":"2024-04-26T11:19:18.190381+0000","last_became_peered":"2024-04-26T11:19:18.190381+0000","last_unstale":"2024-04-26T11:20:31.500638+0000","last_undegraded":"2024-04-26T11:20:31.500638+0000","last_fullsized":"2024-04-26T11:20:31.500638+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'5","last_scrub_stamp":"2024-04-26T11:20:31.500511+0000","last_deep_scrub":"82'5","last_deep_scrub_stamp":"2024-04-26T11:20:31.500511+0000","last_clean_scrub_stamp":"2024-04-26T11:20:31.500511+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:36:22.961021+0000","scrub_duration":0.0037041859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:51.669025+0000","last_change":"2024-04-26T11:19:51.669122+0000","last_active":"2024-04-26T11:19:51.669025+0000","last_peered":"2024-04-26T11:19:51.669025+0000","last_clean":"2024-04-26T11:19:51.669025+0000","last_became_active":"2024-04-26T11:19:24.199659+0000","last_became_peered":"2024-04-26T11:19:24.199659+0000","last_unstale":"2024-04-26T11:19:51.669025+0000","last_undegraded":"2024-04-26T11:19:51.669025+0000","last_fullsized":"2024-04-26T11:19:51.669025+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:51.668999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:51.668999+0000","last_clean_scrub_stamp":"2024-04-26T11:19:51.668999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:13.870535+0000","scrub_duration":0.001713553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"82'10","reported_seq":62,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:15.665204+0000","last_change":"2024-04-26T11:20:15.665204+0000","last_active":"2024-04-26T11:20:15.665204+0000","last_peered":"2024-04-26T11:20:15.665204+0000","last_clean":"2024-04-26T11:20:15.665204+0000","last_became_active":"2024-04-26T11:19:18.180711+0000","last_became_peered":"2024-04-26T11:19:18.180711+0000","last_unstale":"2024-04-26T11:20:15.665204+0000","last_undegraded":"2024-04-26T11:20:15.665204+0000","last_fullsized":"2024-04-26T11:20:15.665204+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'10","last_scrub_stamp":"2024-04-26T11:20:15.665049+0000","last_deep_scrub":"82'10","last_deep_scrub_stamp":"2024-04-26T11:20:15.665049+0000","last_clean_scrub_stamp":"2024-04-26T11:20:15.665049+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:43:51.496107+0000","scrub_duration":0.0059687940000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:52.744313+0000","last_change":"2024-04-26T11:20:52.744313+0000","last_active":"2024-04-26T11:20:52.744313+0000","last_peered":"2024-04-26T11:20:52.744313+0000","last_clean":"2024-04-26T11:20:52.744313+0000","last_became_active":"2024-04-26T11:19:18.181615+0000","last_became_peered":"2024-04-26T11:19:18.181615+0000","last_unstale":"2024-04-26T11:20:52.744313+0000","last_undegraded":"2024-04-26T11:20:52.744313+0000","last_fullsized":"2024-04-26T11:20:52.744313+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:52.744179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:52.744179+0000","last_clean_scrub_stamp":"2024-04-26T11:20:52.744179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:23.622036+0000","scrub_duration":0.0021129399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"82'4","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:33.660657+0000","last_change":"2024-04-26T11:20:33.660657+0000","last_active":"2024-04-26T11:20:33.660657+0000","last_peered":"2024-04-26T11:20:33.660657+0000","last_clean":"2024-04-26T11:20:33.660657+0000","last_became_active":"2024-04-26T11:19:18.183103+0000","last_became_peered":"2024-04-26T11:19:18.183103+0000","last_unstale":"2024-04-26T11:20:33.660657+0000","last_undegraded":"2024-04-26T11:20:33.660657+0000","last_fullsized":"2024-04-26T11:20:33.660657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-26T11:20:33.660533+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-26T11:20:33.660533+0000","last_clean_scrub_stamp":"2024-04-26T11:20:33.660533+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:09.137970+0000","scrub_duration":0.0039063550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:21:00.238527+0000","last_change":"2024-04-26T11:21:00.238646+0000","last_active":"2024-04-26T11:21:00.238527+0000","last_peered":"2024-04-26T11:21:00.238527+0000","last_clean":"2024-04-26T11:21:00.238527+0000","last_became_active":"2024-04-26T11:13:12.916369+0000","last_became_peered":"2024-04-26T11:13:12.916369+0000","last_unstale":"2024-04-26T11:21:00.238527+0000","last_undegraded":"2024-04-26T11:21:00.238527+0000","last_fullsized":"2024-04-26T11:21:00.238527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:00.238503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:00.238503+0000","last_clean_scrub_stamp":"2024-04-26T11:21:00.238503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:08.700207+0000","scrub_duration":0.0014474500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:16.464920+0000","last_change":"2024-04-26T11:20:16.464920+0000","last_active":"2024-04-26T11:20:16.464920+0000","last_peered":"2024-04-26T11:20:16.464920+0000","last_clean":"2024-04-26T11:20:16.464920+0000","last_became_active":"2024-04-26T11:19:24.197647+0000","last_became_peered":"2024-04-26T11:19:24.197647+0000","last_unstale":"2024-04-26T11:20:16.464920+0000","last_undegraded":"2024-04-26T11:20:16.464920+0000","last_fullsized":"2024-04-26T11:20:16.464920+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:16.464751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:16.464751+0000","last_clean_scrub_stamp":"2024-04-26T11:20:16.464751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:31.462042+0000","scrub_duration":0.001769709,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:49.458065+0000","last_change":"2024-04-26T11:19:49.458065+0000","last_active":"2024-04-26T11:19:49.458065+0000","last_peered":"2024-04-26T11:19:49.458065+0000","last_clean":"2024-04-26T11:19:49.458065+0000","last_became_active":"2024-04-26T11:13:12.914588+0000","last_became_peered":"2024-04-26T11:13:12.914588+0000","last_unstale":"2024-04-26T11:19:49.458065+0000","last_undegraded":"2024-04-26T11:19:49.458065+0000","last_fullsized":"2024-04-26T11:19:49.458065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:49.457903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:49.457903+0000","last_clean_scrub_stamp":"2024-04-26T11:19:49.457903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:29.600094+0000","scrub_duration":0.017036468999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":119,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:42.399823+0000","last_change":"2024-04-26T11:20:42.399928+0000","last_active":"2024-04-26T11:20:42.399823+0000","last_peered":"2024-04-26T11:20:42.399823+0000","last_clean":"2024-04-26T11:20:42.399823+0000","last_became_active":"2024-04-26T11:19:18.181907+0000","last_became_peered":"2024-04-26T11:19:18.181907+0000","last_unstale":"2024-04-26T11:20:42.399823+0000","last_undegraded":"2024-04-26T11:20:42.399823+0000","last_fullsized":"2024-04-26T11:20:42.399823+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:42.399800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:42.399800+0000","last_clean_scrub_stamp":"2024-04-26T11:20:42.399800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:27.642376+0000","scrub_duration":0.0017102930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:53.337874+0000","last_change":"2024-04-26T11:20:53.338016+0000","last_active":"2024-04-26T11:20:53.337874+0000","last_peered":"2024-04-26T11:20:53.337874+0000","last_clean":"2024-04-26T11:20:53.337874+0000","last_became_active":"2024-04-26T11:19:24.201114+0000","last_became_peered":"2024-04-26T11:19:24.201114+0000","last_unstale":"2024-04-26T11:20:53.337874+0000","last_undegraded":"2024-04-26T11:20:53.337874+0000","last_fullsized":"2024-04-26T11:20:53.337874+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:53.337850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:53.337850+0000","last_clean_scrub_stamp":"2024-04-26T11:20:53.337850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:07.388855+0000","scrub_duration":0.001932121,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"82'12","reported_seq":58,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:20.669954+0000","last_change":"2024-04-26T11:20:20.669954+0000","last_active":"2024-04-26T11:20:20.669954+0000","last_peered":"2024-04-26T11:20:20.669954+0000","last_clean":"2024-04-26T11:20:20.669954+0000","last_became_active":"2024-04-26T11:19:18.182017+0000","last_became_peered":"2024-04-26T11:19:18.182017+0000","last_unstale":"2024-04-26T11:20:20.669954+0000","last_undegraded":"2024-04-26T11:20:20.669954+0000","last_fullsized":"2024-04-26T11:20:20.669954+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'12","last_scrub_stamp":"2024-04-26T11:20:20.669804+0000","last_deep_scrub":"82'12","last_deep_scrub_stamp":"2024-04-26T11:20:20.669804+0000","last_clean_scrub_stamp":"2024-04-26T11:20:20.669804+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:56.741407+0000","scrub_duration":0.0048710799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:21:00.252872+0000","last_change":"2024-04-26T11:21:00.253029+0000","last_active":"2024-04-26T11:21:00.252872+0000","last_peered":"2024-04-26T11:21:00.252872+0000","last_clean":"2024-04-26T11:21:00.252872+0000","last_became_active":"2024-04-26T11:19:24.204476+0000","last_became_peered":"2024-04-26T11:19:24.204476+0000","last_unstale":"2024-04-26T11:21:00.252872+0000","last_undegraded":"2024-04-26T11:21:00.252872+0000","last_fullsized":"2024-04-26T11:21:00.252872+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:00.252834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:00.252834+0000","last_clean_scrub_stamp":"2024-04-26T11:21:00.252834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:58.616940+0000","scrub_duration":0.031654087999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"82'2","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:44.505212+0000","last_change":"2024-04-26T11:19:44.505212+0000","last_active":"2024-04-26T11:19:44.505212+0000","last_peered":"2024-04-26T11:19:44.505212+0000","last_clean":"2024-04-26T11:19:44.505212+0000","last_became_active":"2024-04-26T11:19:18.181604+0000","last_became_peered":"2024-04-26T11:19:18.181604+0000","last_unstale":"2024-04-26T11:19:44.505212+0000","last_undegraded":"2024-04-26T11:19:44.505212+0000","last_fullsized":"2024-04-26T11:19:44.505212+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-26T11:19:44.505080+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-26T11:19:44.505080+0000","last_clean_scrub_stamp":"2024-04-26T11:19:44.505080+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:07.623145+0000","scrub_duration":0.0032804549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:36.457819+0000","last_change":"2024-04-26T11:19:36.457819+0000","last_active":"2024-04-26T11:19:36.457819+0000","last_peered":"2024-04-26T11:19:36.457819+0000","last_clean":"2024-04-26T11:19:36.457819+0000","last_became_active":"2024-04-26T11:19:18.181462+0000","last_became_peered":"2024-04-26T11:19:18.181462+0000","last_unstale":"2024-04-26T11:19:36.457819+0000","last_undegraded":"2024-04-26T11:19:36.457819+0000","last_fullsized":"2024-04-26T11:19:36.457819+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:36.457692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:36.457692+0000","last_clean_scrub_stamp":"2024-04-26T11:19:36.457692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:46.158550+0000","scrub_duration":0.0018253519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"82'3","reported_seq":122,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:36.463609+0000","last_change":"2024-04-26T11:20:36.463708+0000","last_active":"2024-04-26T11:20:36.463609+0000","last_peered":"2024-04-26T11:20:36.463609+0000","last_clean":"2024-04-26T11:20:36.463609+0000","last_became_active":"2024-04-26T11:19:18.182242+0000","last_became_peered":"2024-04-26T11:19:18.182242+0000","last_unstale":"2024-04-26T11:20:36.463609+0000","last_undegraded":"2024-04-26T11:20:36.463609+0000","last_fullsized":"2024-04-26T11:20:36.463609+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T11:20:36.463584+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T11:20:36.463584+0000","last_clean_scrub_stamp":"2024-04-26T11:20:36.463584+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:07.395616+0000","scrub_duration":0.0032256059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:53.468976+0000","last_change":"2024-04-26T11:19:53.469071+0000","last_active":"2024-04-26T11:19:53.468976+0000","last_peered":"2024-04-26T11:19:53.468976+0000","last_clean":"2024-04-26T11:19:53.468976+0000","last_became_active":"2024-04-26T11:13:12.911796+0000","last_became_peered":"2024-04-26T11:13:12.911796+0000","last_unstale":"2024-04-26T11:19:53.468976+0000","last_undegraded":"2024-04-26T11:19:53.468976+0000","last_fullsized":"2024-04-26T11:19:53.468976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:53.468953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:53.468953+0000","last_clean_scrub_stamp":"2024-04-26T11:19:53.468953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:51:47.714133+0000","scrub_duration":0.0018786149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'2","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:40.744564+0000","last_change":"2024-04-26T11:20:40.744564+0000","last_active":"2024-04-26T11:20:40.744564+0000","last_peered":"2024-04-26T11:20:40.744564+0000","last_clean":"2024-04-26T11:20:40.744564+0000","last_became_active":"2024-04-26T11:19:18.180506+0000","last_became_peered":"2024-04-26T11:19:18.180506+0000","last_unstale":"2024-04-26T11:20:40.744564+0000","last_undegraded":"2024-04-26T11:20:40.744564+0000","last_fullsized":"2024-04-26T11:20:40.744564+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-26T11:20:40.744410+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-26T11:20:40.744410+0000","last_clean_scrub_stamp":"2024-04-26T11:20:40.744410+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:11.030235+0000","scrub_duration":0.0034585390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:50.504053+0000","last_change":"2024-04-26T11:19:50.504053+0000","last_active":"2024-04-26T11:19:50.504053+0000","last_peered":"2024-04-26T11:19:50.504053+0000","last_clean":"2024-04-26T11:19:50.504053+0000","last_became_active":"2024-04-26T11:19:18.185355+0000","last_became_peered":"2024-04-26T11:19:18.185355+0000","last_unstale":"2024-04-26T11:19:50.504053+0000","last_undegraded":"2024-04-26T11:19:50.504053+0000","last_fullsized":"2024-04-26T11:19:50.504053+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:50.503924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:50.503924+0000","last_clean_scrub_stamp":"2024-04-26T11:19:50.503924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:15.276373+0000","scrub_duration":0.001850661,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:00.590840+0000","last_change":"2024-04-26T11:20:00.590840+0000","last_active":"2024-04-26T11:20:00.590840+0000","last_peered":"2024-04-26T11:20:00.590840+0000","last_clean":"2024-04-26T11:20:00.590840+0000","last_became_active":"2024-04-26T11:19:18.186342+0000","last_became_peered":"2024-04-26T11:19:18.186342+0000","last_unstale":"2024-04-26T11:20:00.590840+0000","last_undegraded":"2024-04-26T11:20:00.590840+0000","last_fullsized":"2024-04-26T11:20:00.590840+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:00.590694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:00.590694+0000","last_clean_scrub_stamp":"2024-04-26T11:20:00.590694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:47.383110+0000","scrub_duration":0.0016301460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:03.588748+0000","last_change":"2024-04-26T11:20:03.588894+0000","last_active":"2024-04-26T11:20:03.588748+0000","last_peered":"2024-04-26T11:20:03.588748+0000","last_clean":"2024-04-26T11:20:03.588748+0000","last_became_active":"2024-04-26T11:19:24.201330+0000","last_became_peered":"2024-04-26T11:19:24.201330+0000","last_unstale":"2024-04-26T11:20:03.588748+0000","last_undegraded":"2024-04-26T11:20:03.588748+0000","last_fullsized":"2024-04-26T11:20:03.588748+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:03.588721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:03.588721+0000","last_clean_scrub_stamp":"2024-04-26T11:20:03.588721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:51.328094+0000","scrub_duration":0.029670523000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"82'3","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:06.586122+0000","last_change":"2024-04-26T11:20:06.586222+0000","last_active":"2024-04-26T11:20:06.586122+0000","last_peered":"2024-04-26T11:20:06.586122+0000","last_clean":"2024-04-26T11:20:06.586122+0000","last_became_active":"2024-04-26T11:19:24.201077+0000","last_became_peered":"2024-04-26T11:19:24.201077+0000","last_unstale":"2024-04-26T11:20:06.586122+0000","last_undegraded":"2024-04-26T11:20:06.586122+0000","last_fullsized":"2024-04-26T11:20:06.586122+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T11:20:06.586097+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T11:20:06.586097+0000","last_clean_scrub_stamp":"2024-04-26T11:20:06.586097+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:41:06.937690+0000","scrub_duration":0.0032225639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:21.647563+0000","last_change":"2024-04-26T11:20:21.647563+0000","last_active":"2024-04-26T11:20:21.647563+0000","last_peered":"2024-04-26T11:20:21.647563+0000","last_clean":"2024-04-26T11:20:21.647563+0000","last_became_active":"2024-04-26T11:19:18.185768+0000","last_became_peered":"2024-04-26T11:19:18.185768+0000","last_unstale":"2024-04-26T11:20:21.647563+0000","last_undegraded":"2024-04-26T11:20:21.647563+0000","last_fullsized":"2024-04-26T11:20:21.647563+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:21.647424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:21.647424+0000","last_clean_scrub_stamp":"2024-04-26T11:20:21.647424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:30.401562+0000","scrub_duration":0.0017008469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:35.738528+0000","last_change":"2024-04-26T11:20:35.738528+0000","last_active":"2024-04-26T11:20:35.738528+0000","last_peered":"2024-04-26T11:20:35.738528+0000","last_clean":"2024-04-26T11:20:35.738528+0000","last_became_active":"2024-04-26T11:19:18.184149+0000","last_became_peered":"2024-04-26T11:19:18.184149+0000","last_unstale":"2024-04-26T11:20:35.738528+0000","last_undegraded":"2024-04-26T11:20:35.738528+0000","last_fullsized":"2024-04-26T11:20:35.738528+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:35.738376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:35.738376+0000","last_clean_scrub_stamp":"2024-04-26T11:20:35.738376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:56:19.639335+0000","scrub_duration":0.0020898240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:36.620064+0000","last_change":"2024-04-26T11:19:36.620064+0000","last_active":"2024-04-26T11:19:36.620064+0000","last_peered":"2024-04-26T11:19:36.620064+0000","last_clean":"2024-04-26T11:19:36.620064+0000","last_became_active":"2024-04-26T11:19:18.181951+0000","last_became_peered":"2024-04-26T11:19:18.181951+0000","last_unstale":"2024-04-26T11:19:36.620064+0000","last_undegraded":"2024-04-26T11:19:36.620064+0000","last_fullsized":"2024-04-26T11:19:36.620064+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:36.619885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:36.619885+0000","last_clean_scrub_stamp":"2024-04-26T11:19:36.619885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:06.660819+0000","scrub_duration":0.001669823,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":119,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:41.391079+0000","last_change":"2024-04-26T11:20:41.391204+0000","last_active":"2024-04-26T11:20:41.391079+0000","last_peered":"2024-04-26T11:20:41.391079+0000","last_clean":"2024-04-26T11:20:41.391079+0000","last_became_active":"2024-04-26T11:19:18.181767+0000","last_became_peered":"2024-04-26T11:19:18.181767+0000","last_unstale":"2024-04-26T11:20:41.391079+0000","last_undegraded":"2024-04-26T11:20:41.391079+0000","last_fullsized":"2024-04-26T11:20:41.391079+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:41.391041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:41.391041+0000","last_clean_scrub_stamp":"2024-04-26T11:20:41.391041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:51.694708+0000","scrub_duration":0.0017201790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:37.612253+0000","last_change":"2024-04-26T11:19:37.612253+0000","last_active":"2024-04-26T11:19:37.612253+0000","last_peered":"2024-04-26T11:19:37.612253+0000","last_clean":"2024-04-26T11:19:37.612253+0000","last_became_active":"2024-04-26T11:19:18.182060+0000","last_became_peered":"2024-04-26T11:19:18.182060+0000","last_unstale":"2024-04-26T11:19:37.612253+0000","last_undegraded":"2024-04-26T11:19:37.612253+0000","last_fullsized":"2024-04-26T11:19:37.612253+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:37.612061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:37.612061+0000","last_clean_scrub_stamp":"2024-04-26T11:19:37.612061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:24.175151+0000","scrub_duration":0.0016765459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:20.495917+0000","last_change":"2024-04-26T11:20:20.496020+0000","last_active":"2024-04-26T11:20:20.495917+0000","last_peered":"2024-04-26T11:20:20.495917+0000","last_clean":"2024-04-26T11:20:20.495917+0000","last_became_active":"2024-04-26T11:13:12.492851+0000","last_became_peered":"2024-04-26T11:13:12.492851+0000","last_unstale":"2024-04-26T11:20:20.495917+0000","last_undegraded":"2024-04-26T11:20:20.495917+0000","last_fullsized":"2024-04-26T11:20:20.495917+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:20.495895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:20.495895+0000","last_clean_scrub_stamp":"2024-04-26T11:20:20.495895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:28.263035+0000","scrub_duration":0.001714824,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:48.777587+0000","last_change":"2024-04-26T11:19:48.777713+0000","last_active":"2024-04-26T11:19:48.777587+0000","last_peered":"2024-04-26T11:19:48.777587+0000","last_clean":"2024-04-26T11:19:48.777587+0000","last_became_active":"2024-04-26T11:19:24.203758+0000","last_became_peered":"2024-04-26T11:19:24.203758+0000","last_unstale":"2024-04-26T11:19:48.777587+0000","last_undegraded":"2024-04-26T11:19:48.777587+0000","last_fullsized":"2024-04-26T11:19:48.777587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:48.777563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:48.777563+0000","last_clean_scrub_stamp":"2024-04-26T11:19:48.777563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:26.143928+0000","scrub_duration":0.058175359000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:33.470712+0000","last_change":"2024-04-26T11:20:33.470712+0000","last_active":"2024-04-26T11:20:33.470712+0000","last_peered":"2024-04-26T11:20:33.470712+0000","last_clean":"2024-04-26T11:20:33.470712+0000","last_became_active":"2024-04-26T11:19:24.200963+0000","last_became_peered":"2024-04-26T11:19:24.200963+0000","last_unstale":"2024-04-26T11:20:33.470712+0000","last_undegraded":"2024-04-26T11:20:33.470712+0000","last_fullsized":"2024-04-26T11:20:33.470712+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:33.470567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:33.470567+0000","last_clean_scrub_stamp":"2024-04-26T11:20:33.470567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:06.658362+0000","scrub_duration":0.0018913809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:21:02.446717+0000","last_change":"2024-04-26T11:21:02.446717+0000","last_active":"2024-04-26T11:21:02.446717+0000","last_peered":"2024-04-26T11:21:02.446717+0000","last_clean":"2024-04-26T11:21:02.446717+0000","last_became_active":"2024-04-26T11:19:18.189086+0000","last_became_peered":"2024-04-26T11:19:18.189086+0000","last_unstale":"2024-04-26T11:21:02.446717+0000","last_undegraded":"2024-04-26T11:21:02.446717+0000","last_fullsized":"2024-04-26T11:21:02.446717+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:02.446566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:02.446566+0000","last_clean_scrub_stamp":"2024-04-26T11:21:02.446566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:04.174145+0000","scrub_duration":0.002079553,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:05.442392+0000","last_change":"2024-04-26T11:20:05.442516+0000","last_active":"2024-04-26T11:20:05.442392+0000","last_peered":"2024-04-26T11:20:05.442392+0000","last_clean":"2024-04-26T11:20:05.442392+0000","last_became_active":"2024-04-26T11:19:18.181791+0000","last_became_peered":"2024-04-26T11:19:18.181791+0000","last_unstale":"2024-04-26T11:20:05.442392+0000","last_undegraded":"2024-04-26T11:20:05.442392+0000","last_fullsized":"2024-04-26T11:20:05.442392+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:05.442367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:05.442367+0000","last_clean_scrub_stamp":"2024-04-26T11:20:05.442367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:48.858203+0000","scrub_duration":0.001909062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:24.707827+0000","last_change":"2024-04-26T11:20:24.707827+0000","last_active":"2024-04-26T11:20:24.707827+0000","last_peered":"2024-04-26T11:20:24.707827+0000","last_clean":"2024-04-26T11:20:24.707827+0000","last_became_active":"2024-04-26T11:19:18.183292+0000","last_became_peered":"2024-04-26T11:19:18.183292+0000","last_unstale":"2024-04-26T11:20:24.707827+0000","last_undegraded":"2024-04-26T11:20:24.707827+0000","last_fullsized":"2024-04-26T11:20:24.707827+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:24.707649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:24.707649+0000","last_clean_scrub_stamp":"2024-04-26T11:20:24.707649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:50.921059+0000","scrub_duration":0.001693588,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:21:10.452063+0000","last_change":"2024-04-26T11:21:10.452063+0000","last_active":"2024-04-26T11:21:10.452063+0000","last_peered":"2024-04-26T11:21:10.452063+0000","last_clean":"2024-04-26T11:21:10.452063+0000","last_became_active":"2024-04-26T11:19:18.190096+0000","last_became_peered":"2024-04-26T11:19:18.190096+0000","last_unstale":"2024-04-26T11:21:10.452063+0000","last_undegraded":"2024-04-26T11:21:10.452063+0000","last_fullsized":"2024-04-26T11:21:10.452063+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:10.451927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:10.451927+0000","last_clean_scrub_stamp":"2024-04-26T11:21:10.451927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:41:42.128268+0000","scrub_duration":0.0019660910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:28.566554+0000","last_change":"2024-04-26T11:20:28.566554+0000","last_active":"2024-04-26T11:20:28.566554+0000","last_peered":"2024-04-26T11:20:28.566554+0000","last_clean":"2024-04-26T11:20:28.566554+0000","last_became_active":"2024-04-26T11:19:24.199834+0000","last_became_peered":"2024-04-26T11:19:24.199834+0000","last_unstale":"2024-04-26T11:20:28.566554+0000","last_undegraded":"2024-04-26T11:20:28.566554+0000","last_fullsized":"2024-04-26T11:20:28.566554+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:28.566404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:28.566404+0000","last_clean_scrub_stamp":"2024-04-26T11:20:28.566404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:24.933139+0000","scrub_duration":0.0016291509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:56.642416+0000","last_change":"2024-04-26T11:19:56.642416+0000","last_active":"2024-04-26T11:19:56.642416+0000","last_peered":"2024-04-26T11:19:56.642416+0000","last_clean":"2024-04-26T11:19:56.642416+0000","last_became_active":"2024-04-26T11:19:24.196561+0000","last_became_peered":"2024-04-26T11:19:24.196561+0000","last_unstale":"2024-04-26T11:19:56.642416+0000","last_undegraded":"2024-04-26T11:19:56.642416+0000","last_fullsized":"2024-04-26T11:19:56.642416+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:56.642282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:56.642282+0000","last_clean_scrub_stamp":"2024-04-26T11:19:56.642282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:16.768522+0000","scrub_duration":0.001607296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":120,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:30.510723+0000","last_change":"2024-04-26T11:20:30.510723+0000","last_active":"2024-04-26T11:20:30.510723+0000","last_peered":"2024-04-26T11:20:30.510723+0000","last_clean":"2024-04-26T11:20:30.510723+0000","last_became_active":"2024-04-26T11:19:18.182077+0000","last_became_peered":"2024-04-26T11:19:18.182077+0000","last_unstale":"2024-04-26T11:20:30.510723+0000","last_undegraded":"2024-04-26T11:20:30.510723+0000","last_fullsized":"2024-04-26T11:20:30.510723+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:30.510602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:30.510602+0000","last_clean_scrub_stamp":"2024-04-26T11:20:30.510602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:28.874707+0000","scrub_duration":0.0021031610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:58.225045+0000","last_change":"2024-04-26T11:20:58.225184+0000","last_active":"2024-04-26T11:20:58.225045+0000","last_peered":"2024-04-26T11:20:58.225045+0000","last_clean":"2024-04-26T11:20:58.225045+0000","last_became_active":"2024-04-26T11:19:24.204538+0000","last_became_peered":"2024-04-26T11:19:24.204538+0000","last_unstale":"2024-04-26T11:20:58.225045+0000","last_undegraded":"2024-04-26T11:20:58.225045+0000","last_fullsized":"2024-04-26T11:20:58.225045+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:58.225021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:58.225021+0000","last_clean_scrub_stamp":"2024-04-26T11:20:58.225021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:00.553775+0000","scrub_duration":0.029226551999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:32.614151+0000","last_change":"2024-04-26T11:20:32.614151+0000","last_active":"2024-04-26T11:20:32.614151+0000","last_peered":"2024-04-26T11:20:32.614151+0000","last_clean":"2024-04-26T11:20:32.614151+0000","last_became_active":"2024-04-26T11:19:18.184460+0000","last_became_peered":"2024-04-26T11:19:18.184460+0000","last_unstale":"2024-04-26T11:20:32.614151+0000","last_undegraded":"2024-04-26T11:20:32.614151+0000","last_fullsized":"2024-04-26T11:20:32.614151+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:32.613980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:32.613980+0000","last_clean_scrub_stamp":"2024-04-26T11:20:32.613980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:31.344148+0000","scrub_duration":0.0021711899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"82'159","reported_seq":249,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:11.567623+0000","last_change":"2024-04-26T11:20:11.567623+0000","last_active":"2024-04-26T11:20:11.567623+0000","last_peered":"2024-04-26T11:20:11.567623+0000","last_clean":"2024-04-26T11:20:11.567623+0000","last_became_active":"2024-04-26T11:19:18.180577+0000","last_became_peered":"2024-04-26T11:19:18.180577+0000","last_unstale":"2024-04-26T11:20:11.567623+0000","last_undegraded":"2024-04-26T11:20:11.567623+0000","last_fullsized":"2024-04-26T11:20:11.567623+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'159","last_scrub_stamp":"2024-04-26T11:20:11.567504+0000","last_deep_scrub":"82'159","last_deep_scrub_stamp":"2024-04-26T11:20:11.567504+0000","last_clean_scrub_stamp":"2024-04-26T11:20:11.567504+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:18.611371+0000","scrub_duration":0.0050467979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:39.359015+0000","last_change":"2024-04-26T11:20:39.359015+0000","last_active":"2024-04-26T11:20:39.359015+0000","last_peered":"2024-04-26T11:20:39.359015+0000","last_clean":"2024-04-26T11:20:39.359015+0000","last_became_active":"2024-04-26T11:19:24.196404+0000","last_became_peered":"2024-04-26T11:19:24.196404+0000","last_unstale":"2024-04-26T11:20:39.359015+0000","last_undegraded":"2024-04-26T11:20:39.359015+0000","last_fullsized":"2024-04-26T11:20:39.359015+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:39.358852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:39.358852+0000","last_clean_scrub_stamp":"2024-04-26T11:20:39.358852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:22.774688+0000","scrub_duration":0.0015974749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:09.531227+0000","last_change":"2024-04-26T11:20:09.531227+0000","last_active":"2024-04-26T11:20:09.531227+0000","last_peered":"2024-04-26T11:20:09.531227+0000","last_clean":"2024-04-26T11:20:09.531227+0000","last_became_active":"2024-04-26T11:19:18.181863+0000","last_became_peered":"2024-04-26T11:19:18.181863+0000","last_unstale":"2024-04-26T11:20:09.531227+0000","last_undegraded":"2024-04-26T11:20:09.531227+0000","last_fullsized":"2024-04-26T11:20:09.531227+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:09.531073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:09.531073+0000","last_clean_scrub_stamp":"2024-04-26T11:20:09.531073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:28.881302+0000","scrub_duration":0.0020025820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:18.631147+0000","last_change":"2024-04-26T11:20:18.631147+0000","last_active":"2024-04-26T11:20:18.631147+0000","last_peered":"2024-04-26T11:20:18.631147+0000","last_clean":"2024-04-26T11:20:18.631147+0000","last_became_active":"2024-04-26T11:19:18.180792+0000","last_became_peered":"2024-04-26T11:19:18.180792+0000","last_unstale":"2024-04-26T11:20:18.631147+0000","last_undegraded":"2024-04-26T11:20:18.631147+0000","last_fullsized":"2024-04-26T11:20:18.631147+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:18.630989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:18.630989+0000","last_clean_scrub_stamp":"2024-04-26T11:20:18.630989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:25:42.196975+0000","scrub_duration":0.001948642,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:25.520792+0000","last_change":"2024-04-26T11:20:25.520792+0000","last_active":"2024-04-26T11:20:25.520792+0000","last_peered":"2024-04-26T11:20:25.520792+0000","last_clean":"2024-04-26T11:20:25.520792+0000","last_became_active":"2024-04-26T11:19:24.197711+0000","last_became_peered":"2024-04-26T11:19:24.197711+0000","last_unstale":"2024-04-26T11:20:25.520792+0000","last_undegraded":"2024-04-26T11:20:25.520792+0000","last_fullsized":"2024-04-26T11:20:25.520792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:25.520630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:25.520630+0000","last_clean_scrub_stamp":"2024-04-26T11:20:25.520630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:29.672543+0000","scrub_duration":0.0018688400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:13.502665+0000","last_change":"2024-04-26T11:20:13.502774+0000","last_active":"2024-04-26T11:20:13.502665+0000","last_peered":"2024-04-26T11:20:13.502665+0000","last_clean":"2024-04-26T11:20:13.502665+0000","last_became_active":"2024-04-26T11:13:12.917645+0000","last_became_peered":"2024-04-26T11:13:12.917645+0000","last_unstale":"2024-04-26T11:20:13.502665+0000","last_undegraded":"2024-04-26T11:20:13.502665+0000","last_fullsized":"2024-04-26T11:20:13.502665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:13.502641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:13.502641+0000","last_clean_scrub_stamp":"2024-04-26T11:20:13.502641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:45:36.927838+0000","scrub_duration":0.00168844,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:25.495474+0000","last_change":"2024-04-26T11:20:25.495474+0000","last_active":"2024-04-26T11:20:25.495474+0000","last_peered":"2024-04-26T11:20:25.495474+0000","last_clean":"2024-04-26T11:20:25.495474+0000","last_became_active":"2024-04-26T11:13:08.110165+0000","last_became_peered":"2024-04-26T11:13:08.110165+0000","last_unstale":"2024-04-26T11:20:25.495474+0000","last_undegraded":"2024-04-26T11:20:25.495474+0000","last_fullsized":"2024-04-26T11:20:25.495474+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:25.495337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:25.495337+0000","last_clean_scrub_stamp":"2024-04-26T11:20:25.495337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:20.256651+0000","scrub_duration":0.0016789140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:46.745918+0000","last_change":"2024-04-26T11:19:46.745918+0000","last_active":"2024-04-26T11:19:46.745918+0000","last_peered":"2024-04-26T11:19:46.745918+0000","last_clean":"2024-04-26T11:19:46.745918+0000","last_became_active":"2024-04-26T11:19:24.202550+0000","last_became_peered":"2024-04-26T11:19:24.202550+0000","last_unstale":"2024-04-26T11:19:46.745918+0000","last_undegraded":"2024-04-26T11:19:46.745918+0000","last_fullsized":"2024-04-26T11:19:46.745918+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:46.745769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:46.745769+0000","last_clean_scrub_stamp":"2024-04-26T11:19:46.745769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:09.707603+0000","scrub_duration":0.001879981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:54.434747+0000","last_change":"2024-04-26T11:19:54.434856+0000","last_active":"2024-04-26T11:19:54.434747+0000","last_peered":"2024-04-26T11:19:54.434747+0000","last_clean":"2024-04-26T11:19:54.434747+0000","last_became_active":"2024-04-26T11:19:18.182186+0000","last_became_peered":"2024-04-26T11:19:18.182186+0000","last_unstale":"2024-04-26T11:19:54.434747+0000","last_undegraded":"2024-04-26T11:19:54.434747+0000","last_fullsized":"2024-04-26T11:19:54.434747+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:54.434725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:54.434725+0000","last_clean_scrub_stamp":"2024-04-26T11:19:54.434725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:50.801459+0000","scrub_duration":0.0020204099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"82'3","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:07.630037+0000","last_change":"2024-04-26T11:20:07.630175+0000","last_active":"2024-04-26T11:20:07.630037+0000","last_peered":"2024-04-26T11:20:07.630037+0000","last_clean":"2024-04-26T11:20:07.630037+0000","last_became_active":"2024-04-26T11:19:24.202310+0000","last_became_peered":"2024-04-26T11:19:24.202310+0000","last_unstale":"2024-04-26T11:20:07.630037+0000","last_undegraded":"2024-04-26T11:20:07.630037+0000","last_fullsized":"2024-04-26T11:20:07.630037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T11:20:07.629975+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T11:20:07.629975+0000","last_clean_scrub_stamp":"2024-04-26T11:20:07.629975+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:21.316423+0000","scrub_duration":0.003499748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:51.377084+0000","last_change":"2024-04-26T11:20:51.377182+0000","last_active":"2024-04-26T11:20:51.377084+0000","last_peered":"2024-04-26T11:20:51.377084+0000","last_clean":"2024-04-26T11:20:51.377084+0000","last_became_active":"2024-04-26T11:19:24.202566+0000","last_became_peered":"2024-04-26T11:19:24.202566+0000","last_unstale":"2024-04-26T11:20:51.377084+0000","last_undegraded":"2024-04-26T11:20:51.377084+0000","last_fullsized":"2024-04-26T11:20:51.377084+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:51.377062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:51.377062+0000","last_clean_scrub_stamp":"2024-04-26T11:20:51.377062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:04.643281+0000","scrub_duration":0.0017230380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":67,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:32.490476+0000","last_change":"2024-04-26T11:20:32.490476+0000","last_active":"2024-04-26T11:20:32.490476+0000","last_peered":"2024-04-26T11:20:32.490476+0000","last_clean":"2024-04-26T11:20:32.490476+0000","last_became_active":"2024-04-26T11:19:24.197383+0000","last_became_peered":"2024-04-26T11:19:24.197383+0000","last_unstale":"2024-04-26T11:20:32.490476+0000","last_undegraded":"2024-04-26T11:20:32.490476+0000","last_fullsized":"2024-04-26T11:20:32.490476+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:32.490343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:32.490343+0000","last_clean_scrub_stamp":"2024-04-26T11:20:32.490343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:29:02.161571+0000","scrub_duration":0.001683667,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:39.707737+0000","last_change":"2024-04-26T11:20:39.707737+0000","last_active":"2024-04-26T11:20:39.707737+0000","last_peered":"2024-04-26T11:20:39.707737+0000","last_clean":"2024-04-26T11:20:39.707737+0000","last_became_active":"2024-04-26T11:19:18.180871+0000","last_became_peered":"2024-04-26T11:19:18.180871+0000","last_unstale":"2024-04-26T11:20:39.707737+0000","last_undegraded":"2024-04-26T11:20:39.707737+0000","last_fullsized":"2024-04-26T11:20:39.707737+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:39.707608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:39.707608+0000","last_clean_scrub_stamp":"2024-04-26T11:20:39.707608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:18.685169+0000","scrub_duration":0.0020719089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"82'2","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:21.514790+0000","last_change":"2024-04-26T11:20:21.514923+0000","last_active":"2024-04-26T11:20:21.514790+0000","last_peered":"2024-04-26T11:20:21.514790+0000","last_clean":"2024-04-26T11:20:21.514790+0000","last_became_active":"2024-04-26T11:19:24.198853+0000","last_became_peered":"2024-04-26T11:19:24.198853+0000","last_unstale":"2024-04-26T11:20:21.514790+0000","last_undegraded":"2024-04-26T11:20:21.514790+0000","last_fullsized":"2024-04-26T11:20:21.514790+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-26T11:20:21.514765+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-26T11:20:21.514765+0000","last_clean_scrub_stamp":"2024-04-26T11:20:21.514765+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:45.584635+0000","scrub_duration":0.0035848450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":119,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:08.427208+0000","last_change":"2024-04-26T11:20:08.427208+0000","last_active":"2024-04-26T11:20:08.427208+0000","last_peered":"2024-04-26T11:20:08.427208+0000","last_clean":"2024-04-26T11:20:08.427208+0000","last_became_active":"2024-04-26T11:19:18.182228+0000","last_became_peered":"2024-04-26T11:19:18.182228+0000","last_unstale":"2024-04-26T11:20:08.427208+0000","last_undegraded":"2024-04-26T11:20:08.427208+0000","last_fullsized":"2024-04-26T11:20:08.427208+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:08.427044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:08.427044+0000","last_clean_scrub_stamp":"2024-04-26T11:20:08.427044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:44.490541+0000","scrub_duration":0.0019152240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":123,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:35.449722+0000","last_change":"2024-04-26T11:20:35.449722+0000","last_active":"2024-04-26T11:20:35.449722+0000","last_peered":"2024-04-26T11:20:35.449722+0000","last_clean":"2024-04-26T11:20:35.449722+0000","last_became_active":"2024-04-26T11:19:18.182671+0000","last_became_peered":"2024-04-26T11:19:18.182671+0000","last_unstale":"2024-04-26T11:20:35.449722+0000","last_undegraded":"2024-04-26T11:20:35.449722+0000","last_fullsized":"2024-04-26T11:20:35.449722+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T11:20:35.449595+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T11:20:35.449595+0000","last_clean_scrub_stamp":"2024-04-26T11:20:35.449595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:17.465203+0000","scrub_duration":0.001749993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:58.458718+0000","last_change":"2024-04-26T11:19:58.458718+0000","last_active":"2024-04-26T11:19:58.458718+0000","last_peered":"2024-04-26T11:19:58.458718+0000","last_clean":"2024-04-26T11:19:58.458718+0000","last_became_active":"2024-04-26T11:13:12.916969+0000","last_became_peered":"2024-04-26T11:13:12.916969+0000","last_unstale":"2024-04-26T11:19:58.458718+0000","last_undegraded":"2024-04-26T11:19:58.458718+0000","last_fullsized":"2024-04-26T11:19:58.458718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:58.458587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:58.458587+0000","last_clean_scrub_stamp":"2024-04-26T11:19:58.458587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:28.129815+0000","scrub_duration":0.001786494,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"82'3","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:39.596075+0000","last_change":"2024-04-26T11:19:39.596215+0000","last_active":"2024-04-26T11:19:39.596075+0000","last_peered":"2024-04-26T11:19:39.596075+0000","last_clean":"2024-04-26T11:19:39.596075+0000","last_became_active":"2024-04-26T11:19:18.188177+0000","last_became_peered":"2024-04-26T11:19:18.188177+0000","last_unstale":"2024-04-26T11:19:39.596075+0000","last_undegraded":"2024-04-26T11:19:39.596075+0000","last_fullsized":"2024-04-26T11:19:39.596075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T11:19:39.596051+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T11:19:39.596051+0000","last_clean_scrub_stamp":"2024-04-26T11:19:39.596051+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:18.488192+0000","scrub_duration":0.0035445559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:38.600610+0000","last_change":"2024-04-26T11:19:38.600786+0000","last_active":"2024-04-26T11:19:38.600610+0000","last_peered":"2024-04-26T11:19:38.600610+0000","last_clean":"2024-04-26T11:19:38.600610+0000","last_became_active":"2024-04-26T11:19:18.185372+0000","last_became_peered":"2024-04-26T11:19:18.185372+0000","last_unstale":"2024-04-26T11:19:38.600610+0000","last_undegraded":"2024-04-26T11:19:38.600610+0000","last_fullsized":"2024-04-26T11:19:38.600610+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:38.600585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:38.600585+0000","last_clean_scrub_stamp":"2024-04-26T11:19:38.600585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:00.495830+0000","scrub_duration":0.026821652000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"82'3","reported_seq":122,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:17.493793+0000","last_change":"2024-04-26T11:20:17.493793+0000","last_active":"2024-04-26T11:20:17.493793+0000","last_peered":"2024-04-26T11:20:17.493793+0000","last_clean":"2024-04-26T11:20:17.493793+0000","last_became_active":"2024-04-26T11:19:18.190374+0000","last_became_peered":"2024-04-26T11:19:18.190374+0000","last_unstale":"2024-04-26T11:20:17.493793+0000","last_undegraded":"2024-04-26T11:20:17.493793+0000","last_fullsized":"2024-04-26T11:20:17.493793+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T11:20:17.493667+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T11:20:17.493667+0000","last_clean_scrub_stamp":"2024-04-26T11:20:17.493667+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:30.759887+0000","scrub_duration":0.0029392099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:21:06.333040+0000","last_change":"2024-04-26T11:21:06.333145+0000","last_active":"2024-04-26T11:21:06.333040+0000","last_peered":"2024-04-26T11:21:06.333040+0000","last_clean":"2024-04-26T11:21:06.333040+0000","last_became_active":"2024-04-26T11:19:18.189341+0000","last_became_peered":"2024-04-26T11:19:18.189341+0000","last_unstale":"2024-04-26T11:21:06.333040+0000","last_undegraded":"2024-04-26T11:21:06.333040+0000","last_fullsized":"2024-04-26T11:21:06.333040+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:06.333015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:06.333015+0000","last_clean_scrub_stamp":"2024-04-26T11:21:06.333015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:48.461252+0000","scrub_duration":0.0019475950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:55.291121+0000","last_change":"2024-04-26T11:20:55.291121+0000","last_active":"2024-04-26T11:20:55.291121+0000","last_peered":"2024-04-26T11:20:55.291121+0000","last_clean":"2024-04-26T11:20:55.291121+0000","last_became_active":"2024-04-26T11:19:24.202422+0000","last_became_peered":"2024-04-26T11:19:24.202422+0000","last_unstale":"2024-04-26T11:20:55.291121+0000","last_undegraded":"2024-04-26T11:20:55.291121+0000","last_fullsized":"2024-04-26T11:20:55.291121+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T11:20:55.290943+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T11:20:55.290943+0000","last_clean_scrub_stamp":"2024-04-26T11:20:55.290943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:53:04.798120+0000","scrub_duration":0.0020602419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:47.394865+0000","last_change":"2024-04-26T11:20:47.394979+0000","last_active":"2024-04-26T11:20:47.394865+0000","last_peered":"2024-04-26T11:20:47.394865+0000","last_clean":"2024-04-26T11:20:47.394865+0000","last_became_active":"2024-04-26T11:13:12.917330+0000","last_became_peered":"2024-04-26T11:13:12.917330+0000","last_unstale":"2024-04-26T11:20:47.394865+0000","last_undegraded":"2024-04-26T11:20:47.394865+0000","last_fullsized":"2024-04-26T11:20:47.394865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:47.394841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:47.394841+0000","last_clean_scrub_stamp":"2024-04-26T11:20:47.394841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:25.800717+0000","scrub_duration":0.017573135,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:54.315559+0000","last_change":"2024-04-26T11:20:54.315559+0000","last_active":"2024-04-26T11:20:54.315559+0000","last_peered":"2024-04-26T11:20:54.315559+0000","last_clean":"2024-04-26T11:20:54.315559+0000","last_became_active":"2024-04-26T11:19:24.204129+0000","last_became_peered":"2024-04-26T11:19:24.204129+0000","last_unstale":"2024-04-26T11:20:54.315559+0000","last_undegraded":"2024-04-26T11:20:54.315559+0000","last_fullsized":"2024-04-26T11:20:54.315559+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'6","last_scrub_stamp":"2024-04-26T11:20:54.315408+0000","last_deep_scrub":"82'6","last_deep_scrub_stamp":"2024-04-26T11:20:54.315408+0000","last_clean_scrub_stamp":"2024-04-26T11:20:54.315408+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:02.082549+0000","scrub_duration":0.003676393,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":50,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:21:04.424983+0000","last_change":"2024-04-26T11:21:04.425086+0000","last_active":"2024-04-26T11:21:04.424983+0000","last_peered":"2024-04-26T11:21:04.424983+0000","last_clean":"2024-04-26T11:21:04.424983+0000","last_became_active":"2024-04-26T11:19:18.189179+0000","last_became_peered":"2024-04-26T11:19:18.189179+0000","last_unstale":"2024-04-26T11:21:04.424983+0000","last_undegraded":"2024-04-26T11:21:04.424983+0000","last_fullsized":"2024-04-26T11:21:04.424983+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:04.424959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:04.424959+0000","last_clean_scrub_stamp":"2024-04-26T11:21:04.424959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:33:38.691872+0000","scrub_duration":0.0021779529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:40.624780+0000","last_change":"2024-04-26T11:19:40.624780+0000","last_active":"2024-04-26T11:19:40.624780+0000","last_peered":"2024-04-26T11:19:40.624780+0000","last_clean":"2024-04-26T11:19:40.624780+0000","last_became_active":"2024-04-26T11:19:18.188963+0000","last_became_peered":"2024-04-26T11:19:18.188963+0000","last_unstale":"2024-04-26T11:19:40.624780+0000","last_undegraded":"2024-04-26T11:19:40.624780+0000","last_fullsized":"2024-04-26T11:19:40.624780+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:40.624624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:40.624624+0000","last_clean_scrub_stamp":"2024-04-26T11:19:40.624624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:10:51.952842+0000","scrub_duration":0.0017518169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:20:04.580503+0000","last_change":"2024-04-26T11:20:04.580503+0000","last_active":"2024-04-26T11:20:04.580503+0000","last_peered":"2024-04-26T11:20:04.580503+0000","last_clean":"2024-04-26T11:20:04.580503+0000","last_became_active":"2024-04-26T11:19:24.198397+0000","last_became_peered":"2024-04-26T11:19:24.198397+0000","last_unstale":"2024-04-26T11:20:04.580503+0000","last_undegraded":"2024-04-26T11:20:04.580503+0000","last_fullsized":"2024-04-26T11:20:04.580503+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:20:04.580360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:20:04.580360+0000","last_clean_scrub_stamp":"2024-04-26T11:20:04.580360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:29.686078+0000","scrub_duration":0.0018333259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:21:03.268542+0000","last_change":"2024-04-26T11:21:03.268662+0000","last_active":"2024-04-26T11:21:03.268542+0000","last_peered":"2024-04-26T11:21:03.268542+0000","last_clean":"2024-04-26T11:21:03.268542+0000","last_became_active":"2024-04-26T11:19:18.183037+0000","last_became_peered":"2024-04-26T11:19:18.183037+0000","last_unstale":"2024-04-26T11:21:03.268542+0000","last_undegraded":"2024-04-26T11:21:03.268542+0000","last_fullsized":"2024-04-26T11:21:03.268542+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:03.268519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:03.268519+0000","last_clean_scrub_stamp":"2024-04-26T11:21:03.268519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:46.876508+0000","scrub_duration":0.00191289,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":51,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:55.673586+0000","last_change":"2024-04-26T11:19:55.673586+0000","last_active":"2024-04-26T11:19:55.673586+0000","last_peered":"2024-04-26T11:19:55.673586+0000","last_clean":"2024-04-26T11:19:55.673586+0000","last_became_active":"2024-04-26T11:19:24.202442+0000","last_became_peered":"2024-04-26T11:19:24.202442+0000","last_unstale":"2024-04-26T11:19:55.673586+0000","last_undegraded":"2024-04-26T11:19:55.673586+0000","last_fullsized":"2024-04-26T11:19:55.673586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:55.673417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:55.673417+0000","last_clean_scrub_stamp":"2024-04-26T11:19:55.673417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:35:51.687827+0000","scrub_duration":0.029303546,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":118,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T11:19:51.420225+0000","last_change":"2024-04-26T11:19:51.420347+0000","last_active":"2024-04-26T11:19:51.420225+0000","last_peered":"2024-04-26T11:19:51.420225+0000","last_clean":"2024-04-26T11:19:51.420225+0000","last_became_active":"2024-04-26T11:19:18.184384+0000","last_became_peered":"2024-04-26T11:19:18.184384+0000","last_unstale":"2024-04-26T11:19:51.420225+0000","last_undegraded":"2024-04-26T11:19:51.420225+0000","last_fullsized":"2024-04-26T11:19:51.420225+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:19:51.420205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:19:51.420205+0000","last_clean_scrub_stamp":"2024-04-26T11:19:51.420205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:55.572118+0000","scrub_duration":0.001998835,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7958,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738472,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281144,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94090696,"statfs":{"total":96636764160,"available":96348872704,"internally_reserved":0,"allocated":1490944,"data_stored":947441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:21:24 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.441,"15min":0.443},"min":{"1min":0.309,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.53200000000000003,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.44500000000000001,"15min":0.44400000000000001},"min":{"1min":0.29499999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.56699999999999995,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.45800000000000002}]},{"osd":1,"last update":"Fri Apr 26 11:20:32 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44500000000000001,"15min":0.40300000000000002},"min":{"1min":0.34599999999999997,"5min":0.20000000000000001,"15min":0.17199999999999999},"max":{"1min":0.56599999999999995,"5min":0.96499999999999997,"15min":2.1320000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.45200000000000001,"15min":0.45500000000000002},"min":{"1min":0.34899999999999998,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.61599999999999999,"5min":0.85599999999999998,"15min":1.9750000000000001},"last":0.379}]}]},{"osd":0,"up_from":75,"seq":322122547230,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38148,"kb_used_data":1468,"kb_used_omap":10,"kb_used_meta":36661,"kb_avail":94333692,"statfs":{"total":96636764160,"available":96597700608,"internally_reserved":0,"allocated":1503232,"data_stored":949168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11228,"internal_metadata":37540900},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 11:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.433,"15min":0.43099999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.44500000000000001,"15min":0.44400000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Apr 26 11:21:22 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.371,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.59799999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.50800000000000001,"15min":0.51300000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.59899999999999998,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.38100000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738473,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401128,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":400254,"kb_avail":93970712,"statfs":{"total":96636764160,"available":96226009088,"internally_reserved":0,"allocated":884736,"data_stored":357054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":409860550},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:21:20 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.441,"15min":0.439},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.438,"5min":0.42999999999999999,"15min":0.42799999999999999},"min":{"1min":0.317,"5min":0.316,"15min":0.316},"max":{"1min":0.51500000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Apr 26 11:21:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.46500000000000002,"15min":0.41799999999999998},"min":{"1min":0.37,"5min":0.26100000000000001,"15min":0.14999999999999999},"max":{"1min":0.59899999999999998,"5min":0.69199999999999995,"15min":2.056},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47999999999999998,"15min":0.46800000000000003},"min":{"1min":0.38600000000000001,"5min":0.30199999999999999,"15min":0.193},"max":{"1min":0.58299999999999996,"5min":0.69299999999999995,"15min":3.9609999999999999},"last":0.50600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7958,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:21:37.961 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T11:21:38.358 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T11:21:38.358 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T11:21:38.743 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:21:38.744 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T11:13:12.899864+0000","modified":"2024-04-26T11:13:15.909042+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6803/1340829810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1340829810},{"type":"v1","addr":"172.21.15.29:6803","nonce":1340829810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T11:21:38.746 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 6 2024-04-26T11:21:38.758 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T11:21:39.146 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:21:39.147 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T11:13:12.899864+0000","modified":"2024-04-26T11:13:15.909042+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6803/1340829810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1340829810},{"type":"v1","addr":"172.21.15.29:6803","nonce":1340829810}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T11:21:39.150 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 6 2024-04-26T11:21:39.161 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:21:39.503 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-04-26T11:21:39.503 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":82,"fsid":"2b52ce04-9559-478f-9787-c3cc3b261c15","created":"2024-04-26T11:12:58.193418+0000","modified":"2024-04-26T11:19:27.206561+0000","last_up_change":"2024-04-26T11:19:17.158398+0000","last_in_change":"2024-04-26T11:12:59.116286+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:13:06.502266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:13:06.913870+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:13:11.430854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:13:11.859264+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3496b3f-5972-47ff-a449-832f5055beac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":67,"last_clean_end":71,"up_from":75,"up_thru":75,"down_at":72,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1813},{"type":"v1","addr":"172.21.15.72:6801","nonce":1813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1813},{"type":"v1","addr":"172.21.15.72:6803","nonce":1813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1813},{"type":"v1","addr":"172.21.15.72:6807","nonce":1813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1813},{"type":"v1","addr":"172.21.15.72:6805","nonce":1813}]},"public_addr":"172.21.15.72:6801/1813","cluster_addr":"172.21.15.72:6803/1813","heartbeat_back_addr":"172.21.15.72:6807/1813","heartbeat_front_addr":"172.21.15.72:6805/1813","state":["exists","up"]},{"osd":1,"uuid":"4842abe1-e7b4-480f-85b3-11c8fa2123f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":41442},{"type":"v1","addr":"172.21.15.82:6801","nonce":41442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":41442},{"type":"v1","addr":"172.21.15.82:6803","nonce":41442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":41442},{"type":"v1","addr":"172.21.15.82:6807","nonce":41442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":41442},{"type":"v1","addr":"172.21.15.82:6805","nonce":41442}]},"public_addr":"172.21.15.82:6801/41442","cluster_addr":"172.21.15.82:6803/41442","heartbeat_back_addr":"172.21.15.82:6807/41442","heartbeat_front_addr":"172.21.15.82:6805/41442","state":["exists","up"]},{"osd":2,"uuid":"57b4a874-e4ce-42a9-a7fd-f9e0acf03cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":41571},{"type":"v1","addr":"172.21.15.122:6801","nonce":41571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":41571},{"type":"v1","addr":"172.21.15.122:6803","nonce":41571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":41571},{"type":"v1","addr":"172.21.15.122:6807","nonce":41571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":41571},{"type":"v1","addr":"172.21.15.122:6805","nonce":41571}]},"public_addr":"172.21.15.122:6801/41571","cluster_addr":"172.21.15.122:6803/41571","heartbeat_back_addr":"172.21.15.122:6807/41571","heartbeat_front_addr":"172.21.15.122:6805/41571","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.123925+0000","dead_epoch":71},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:04.145646+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:13:05.101494+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:21:39.518 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T11:21:39.911 INFO:tasks.ceph.mds.a.smithi029.stderr: -2615> 2024-04-26T11:13:18.237+0000 7f87ea24c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T11:21:39.913 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T11:21:39.926 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T11:21:39.940 INFO:tasks.ceph.mds.a.smithi029.stdout:starting mds.a at 2024-04-26T11:21:40.930 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T11:21:42.112 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' removed 2024-04-26T11:21:42.125 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T11:21:43.119 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' removed 2024-04-26T11:21:43.133 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T11:21:43.133 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T11:21:43.133 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:21:43.143 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T11:21:43.143 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T11:21:43.143 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T11:21:43.143 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:21:43.170 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T11:21:43.170 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T11:21:43.170 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:21:43.218 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T11:21:43.219 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T11:21:43.219 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:21:43.261 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T11:21:43.261 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T11:21:43.261 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T11:21:43.261 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:21:43.288 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T11:21:43.288 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T11:21:43.288 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:21:43.354 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T11:21:43.355 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T11:21:43.355 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T11:21:43.355 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:21:43.407 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T11:21:43.407 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T11:21:43.407 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:21:43.458 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T11:21:43.458 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T11:21:43.459 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:21:43.509 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T11:21:43.509 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T11:21:43.510 DEBUG:teuthology.orchestra.run.smithi029:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2024-04-26T11:21:43.585 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T11:21:43.585 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T11:21:43.835 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T11:21:43.835 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T11:21:43.989 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi122.front.sepia.ceph.com 2024-04-26T11:21:43.990 DEBUG:teuthology.orchestra.run.smithi122:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T11:21:44.148 INFO:tasks.ceph:Archiving mon data... 2024-04-26T11:21:44.149 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674154/data/mon.a.tgz 2024-04-26T11:21:44.149 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-04-26T11:21:44.172 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.bHbDhsGxo9 2024-04-26T11:21:44.172 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.bHbDhsGxo9 2024-04-26T11:21:44.336 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.bHbDhsGxo9 2024-04-26T11:21:44.426 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.bHbDhsGxo9 is 426KB 2024-04-26T11:21:44.525 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.bHbDhsGxo9 2024-04-26T11:21:44.543 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674154/data/mon.b.tgz 2024-04-26T11:21:44.543 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-04-26T11:21:44.600 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.ezxkG3Vh9J 2024-04-26T11:21:44.601 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ezxkG3Vh9J 2024-04-26T11:21:44.743 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.ezxkG3Vh9J 2024-04-26T11:21:44.831 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.ezxkG3Vh9J is 427KB 2024-04-26T11:21:44.930 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.ezxkG3Vh9J 2024-04-26T11:21:44.948 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674154/data/mon.c.tgz 2024-04-26T11:21:44.948 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-04-26T11:21:45.005 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.3jDMoPii1s 2024-04-26T11:21:45.005 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.3jDMoPii1s 2024-04-26T11:21:45.146 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.3jDMoPii1s 2024-04-26T11:21:45.233 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.3jDMoPii1s is 427KB 2024-04-26T11:21:45.330 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.3jDMoPii1s 2024-04-26T11:21:45.348 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T11:21:45.348 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T11:21:45.389 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T11:21:45.392 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T11:21:45.394 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T11:21:45.432 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-26T11:21:45.432 DEBUG:teuthology.orchestra.run.smithi029:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T11:21:45.458 DEBUG:teuthology.orchestra.run.smithi072:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T11:21:45.474 DEBUG:teuthology.orchestra.run.smithi082:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T11:21:45.476 DEBUG:teuthology.orchestra.run.smithi122:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T11:21:45.482 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T11:21:45.505 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T11:21:45.510 INFO:teuthology.orchestra.run.smithi122.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T11:21:45.534 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T11:21:45.540 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T11:21:45.541 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674154/remote/smithi029/crash 2024-04-26T11:21:45.542 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T11:21:45.571 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674154/remote/smithi072/crash 2024-04-26T11:21:45.572 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T11:21:45.616 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674154/remote/smithi082/crash 2024-04-26T11:21:45.617 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T11:21:45.660 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674154/remote/smithi122/crash 2024-04-26T11:21:45.661 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T11:21:45.719 INFO:tasks.ceph:Compressing logs... 2024-04-26T11:21:45.719 DEBUG:teuthology.orchestra.run.smithi029:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T11:21:45.722 DEBUG:teuthology.orchestra.run.smithi072:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T11:21:45.724 DEBUG:teuthology.orchestra.run.smithi082:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T11:21:45.727 DEBUG:teuthology.orchestra.run.smithi122:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T11:22:26.203 INFO:tasks.ceph:Archiving logs... 2024-04-26T11:22:26.203 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674154/remote/smithi029/log 2024-04-26T11:22:26.205 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T11:22:26.540 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674154/remote/smithi072/log 2024-04-26T11:22:26.541 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T11:22:27.352 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674154/remote/smithi082/log 2024-04-26T11:22:27.353 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T11:22:32.123 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674154/remote/smithi122/log 2024-04-26T11:22:32.124 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T11:22:36.895 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T11:22:36.905 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T11:22:36.906 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T11:22:36.908 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T11:22:36.911 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T11:22:36.913 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T11:22:37.034 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T11:22:37.044 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T11:22:37.044 DEBUG:teuthology.orchestra.run.smithi029:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:22:37.046 DEBUG:teuthology.orchestra.run.smithi072:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:22:37.049 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:22:37.051 DEBUG:teuthology.orchestra.run.smithi122:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:22:37.065 INFO:teuthology.orchestra.run.smithi029.stderr:bash: ntpq: command not found 2024-04-26T11:22:37.066 INFO:teuthology.orchestra.run.smithi072.stderr:bash: ntpq: command not found 2024-04-26T11:22:37.068 INFO:teuthology.orchestra.run.smithi082.stderr:bash: ntpq: command not found 2024-04-26T11:22:37.070 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T11:22:37.070 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2024-04-26T11:22:37.070 INFO:teuthology.orchestra.run.smithi072.stdout:^+ hv01.front.sepia.ceph.com 3 6 177 16 +1066us[+1118us] +/- 44ms 2024-04-26T11:22:37.070 INFO:teuthology.orchestra.run.smithi072.stdout:^* hv02.front.sepia.ceph.com 3 6 177 15 -1447us[-1392us] +/- 59ms 2024-04-26T11:22:37.070 INFO:teuthology.orchestra.run.smithi072.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 15 +112us[ +165us] +/- 110ms 2024-04-26T11:22:37.070 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:22:37.072 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T11:22:37.072 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2024-04-26T11:22:37.072 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 36 +1095us[+1136us] +/- 44ms 2024-04-26T11:22:37.072 INFO:teuthology.orchestra.run.smithi029.stdout:^* hv02.front.sepia.ceph.com 3 6 377 36 -1424us[-1384us] +/- 58ms 2024-04-26T11:22:37.072 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 +167us[ +167us] +/- 109ms 2024-04-26T11:22:37.072 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:22:37.073 INFO:teuthology.orchestra.run.smithi122.stderr:bash: ntpq: command not found 2024-04-26T11:22:37.073 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T11:22:37.073 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-04-26T11:22:37.074 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 34 +1157us[+1157us] +/- 44ms 2024-04-26T11:22:37.074 INFO:teuthology.orchestra.run.smithi082.stdout:^* hv02.front.sepia.ceph.com 3 6 377 34 -1356us[-1184us] +/- 58ms 2024-04-26T11:22:37.074 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 +216us[ +216us] +/- 109ms 2024-04-26T11:22:37.074 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:22:37.078 INFO:teuthology.orchestra.run.smithi122.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T11:22:37.078 INFO:teuthology.orchestra.run.smithi122.stdout:=============================================================================== 2024-04-26T11:22:37.078 INFO:teuthology.orchestra.run.smithi122.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 32 +1117us[+1117us] +/- 44ms 2024-04-26T11:22:37.078 INFO:teuthology.orchestra.run.smithi122.stdout:^* hv02.front.sepia.ceph.com 3 6 377 33 -1384us[-1202us] +/- 58ms 2024-04-26T11:22:37.078 INFO:teuthology.orchestra.run.smithi122.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 +180us[ +362us] +/- 109ms 2024-04-26T11:22:37.078 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T11:22:37.078 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T11:22:37.089 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T11:22:37.089 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T11:22:37.098 DEBUG:teuthology.orchestra.run.smithi029:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T11:22:37.187 DEBUG:teuthology.orchestra.run.smithi072:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T11:22:37.323 DEBUG:teuthology.orchestra.run.smithi082:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T11:22:37.396 DEBUG:teuthology.orchestra.run.smithi122:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T11:22:37.470 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T11:22:37.507 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:22:37.507 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T11:22:37.538 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:22:37.539 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T11:22:37.571 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:22:37.572 DEBUG:teuthology.orchestra.run.smithi122:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T11:22:37.604 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:22:37.604 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T11:22:37.615 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T11:22:37.629 INFO:teuthology.task.internal:Duration was 1137.638425 seconds 2024-04-26T11:22:37.630 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T11:22:37.639 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T11:22:37.639 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T11:22:37.642 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T11:22:37.644 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T11:22:37.646 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T11:22:37.694 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T11:22:37.694 INFO:teuthology.orchestra.run.smithi122.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T11:22:37.695 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T11:22:37.730 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T11:22:38.178 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T11:22:38.178 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi029.front.sepia.ceph.com 2024-04-26T11:22:38.178 DEBUG:teuthology.orchestra.run.smithi029:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T11:22:38.207 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi072.front.sepia.ceph.com 2024-04-26T11:22:38.207 DEBUG:teuthology.orchestra.run.smithi072:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T11:22:38.246 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2024-04-26T11:22:38.246 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T11:22:38.271 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi122.front.sepia.ceph.com 2024-04-26T11:22:38.272 DEBUG:teuthology.orchestra.run.smithi122:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T11:22:38.296 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T11:22:38.296 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T11:22:38.299 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T11:22:38.301 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T11:22:38.314 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T11:22:38.381 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T11:22:38.382 DEBUG:teuthology.orchestra.run.smithi029:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T11:22:38.384 DEBUG:teuthology.orchestra.run.smithi072:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T11:22:38.386 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T11:22:38.388 DEBUG:teuthology.orchestra.run.smithi122:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T11:22:38.461 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T11:22:38.473 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T11:22:38.474 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T11:22:38.503 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T11:22:38.544 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T11:22:38.571 DEBUG:teuthology.orchestra.run.smithi122:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T11:22:38.599 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T11:22:38.609 DEBUG:teuthology.orchestra.run.smithi029:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T11:22:38.612 DEBUG:teuthology.orchestra.run.smithi072:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T11:22:38.614 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T11:22:38.616 DEBUG:teuthology.orchestra.run.smithi122:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T11:22:38.637 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = core 2024-04-26T11:22:38.640 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2024-04-26T11:22:38.652 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = core 2024-04-26T11:22:38.665 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = core 2024-04-26T11:22:38.680 DEBUG:teuthology.orchestra.run.smithi029:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T11:22:38.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:22:38.730 DEBUG:teuthology.orchestra.run.smithi072:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T11:22:38.747 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:22:38.748 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T11:22:38.764 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:22:38.764 DEBUG:teuthology.orchestra.run.smithi122:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T11:22:38.781 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:22:38.781 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T11:22:38.792 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T11:22:38.792 DEBUG:teuthology.misc:Transferring archived files from smithi029:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674154/remote/smithi029 2024-04-26T11:22:38.793 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T11:22:38.833 DEBUG:teuthology.misc:Transferring archived files from smithi072:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674154/remote/smithi072 2024-04-26T11:22:38.833 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T11:22:38.870 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674154/remote/smithi082 2024-04-26T11:22:38.871 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T11:22:38.910 DEBUG:teuthology.misc:Transferring archived files from smithi122:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674154/remote/smithi122 2024-04-26T11:22:38.910 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T11:22:38.948 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T11:22:38.948 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T11:22:38.950 DEBUG:teuthology.orchestra.run.smithi072:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T11:22:38.953 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T11:22:38.955 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T11:22:38.999 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T11:22:39.013 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T11:22:39.013 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T11:22:39.023 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T11:22:39.024 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T11:22:39.026 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T11:22:39.028 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T11:22:39.032 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T11:22:39.043 INFO:teuthology.orchestra.run.smithi029.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 11:22 /home/ubuntu/cephtest 2024-04-26T11:22:39.043 INFO:teuthology.orchestra.run.smithi072.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 11:22 /home/ubuntu/cephtest 2024-04-26T11:22:39.045 INFO:teuthology.orchestra.run.smithi082.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 11:22 /home/ubuntu/cephtest 2024-04-26T11:22:39.057 INFO:teuthology.orchestra.run.smithi122.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 11:22 /home/ubuntu/cephtest 2024-04-26T11:22:39.058 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T11:22:39.069 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T11:22:39.093 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-hybrid powercycle/default supported-all-distro/centos_8 tasks/admin_socket_objecter_requests thrashosds-health} duration: 1137.6384253501892 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-26T11:22:39.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T11:22:39.178 INFO:teuthology.run:pass